Published on Tue Apr 09 2019

Evaluating Competence Measures for Dynamic Regressor Selection

Thiago J. M. Moura, George D. C. Cavalcanti, Luiz S. Oliveira

Dynamic regressor selection (DRS) systems work by selecting the most competent regressors from an ensemble. This competence is usually quantified using the performance of the regressors in local regions of the feature space around the test pattern.

0
0
0
Abstract

Dynamic regressor selection (DRS) systems work by selecting the most competent regressors from an ensemble to estimate the target value of a given test pattern. This competence is usually quantified using the performance of the regressors in local regions of the feature space around the test pattern. However, choosing the best measure to calculate the level of competence correctly is not straightforward. The literature of dynamic classifier selection presents a wide variety of competence measures, which cannot be used or adapted for DRS. In this paper, we review eight measures used with regression problems, and adapt them to test the performance of the DRS algorithms found in the literature. Such measures are extracted from a local region of the feature space around the test pattern, called region of competence, therefore competence measures.To better compare the competence measures, we perform a set of comprehensive experiments of 15 regression datasets. Three DRS systems were compared against individual regressor and static systems that use the Mean and the Median to combine the outputs of the regressors from the ensemble. The DRS systems were assessed varying the competence measures. Our results show that DRS systems outperform individual regressors and static systems but the choice of the competence measure is problem-dependent.

Wed Sep 02 2015
Machine Learning
A DEEP analysis of the META-DES framework for dynamic selection of ensemble of classifiers
Dynamic ensemble selection (DES) techniques work by estimating the level of competence of each classifier from a pool of classifiers. In order to perform a more robust ensemble selection, we proposed the META-DES framework using meta-learning.
0
0
0
Sun Sep 30 2018
Artificial Intelligence
META-DES: A Dynamic Ensemble Selection Framework using Meta-Learning
Dynamic ensemble selection systems work by estimating the level of competence of each classifier from a pool of classifiers. We present a novel dynamic ensemble selection framework using meta-learning. We propose five distinct sets of meta-features, each one corresponding to a different criterion.
0
0
0
Thu Nov 01 2018
Artificial Intelligence
META-DES.H: a dynamic ensemble selection technique using meta-learning and a dynamic weighting approach
In Dynamic Ensemble Selection (DES) techniques, only the most competent classifiers are selected to classify a given query sample. In this paper, we propose improvements to the training and generalization phase of the META-DES framework. Experiments are carried out on 30 classification datasets.
0
0
0
Thu Nov 01 2018
Machine Learning
A Method For Dynamic Ensemble Selection Based on a Filter and an Adaptive Distance to Improve the Quality of the Regions of Competence
Dynamic classifier selection systems aim to select a group of classifiers that is most adequate for a specific query pattern. This is done by defining aregion around the query pattern and analyzing the competence of the classifiers in this region.
0
0
0
Wed Feb 14 2018
Machine Learning
DESlib: A Dynamic ensemble selection library in Python
DESlib is an open-source python library. It provides the implementation of several dynamic selection techniques. The library is fully documented and has a high test coverage.
0
0
0
Thu Nov 01 2018
Artificial Intelligence
On Meta-Learning for Dynamic Ensemble Selection
In this paper, we propose a novel dynamic ensemble selection framework. The framework is divided into three steps. In the first step, the pool of classifiers is generated from the training data. The second phase is responsible to extract the meta-features and train the meta classifier.
0
0
0