GRAMOFON: General model-selection framework based on networks

Ensembles constitute one of the most prominent class of hybrid prediction models. One basically assumes that different models compensate each other's errors if one combines them in an appropriate way. Often, a large number of various prediction models are available. However, many of them may share similar error characteristics, which highly depress the error compensation effect. Thus the selection of an appropriate subset of models is crucial. In this paper, we address this issue. As major contribution, for the case if large number of models is present, we propose a network-based framework for model selection while paying special attention to the interaction effect of models. In this framework, we introduce four ensemble techniques and compare them to the state-of-the-art in experiments on publicly available real-world data.