Hostname: page-component-77f85d65b8-zzw9c Total loading time: 0 Render date: 2026-04-18T13:10:57.953Z Has data issue: false hasContentIssue false

A survey of evolutionary algorithms for supervised ensemble learning

Published online by Cambridge University Press:  01 March 2023

Henry E. L. Cagnini
Affiliation:
School of Technology, PUCRS, Avenida Ipiranga 6681, Porto Alegre, RS 90619-900, Brazil; e-mails: henry.cagnini@edu.pucrs.br, silvia.dores@acad.pucrs.br, rodrigo.barros@pucrs.br
Silvia C. N. Das Dôres
Affiliation:
School of Technology, PUCRS, Avenida Ipiranga 6681, Porto Alegre, RS 90619-900, Brazil; e-mails: henry.cagnini@edu.pucrs.br, silvia.dores@acad.pucrs.br, rodrigo.barros@pucrs.br
Alex A. Freitas
Affiliation:
Computing School, University of Kent, Giles Ln, Canterbury CT2 7NZ, UK; e-mail: a.a.freitas@kent.ac.uk
Rodrigo C. Barros
Affiliation:
School of Technology, PUCRS, Avenida Ipiranga 6681, Porto Alegre, RS 90619-900, Brazil; e-mails: henry.cagnini@edu.pucrs.br, silvia.dores@acad.pucrs.br, rodrigo.barros@pucrs.br

Abstract

This paper presents a comprehensive review of evolutionary algorithms that learn an ensemble of predictive models for supervised machine learning (classification and regression). We propose a detailed four-level taxonomy of studies in this area. The first level of the taxonomy categorizes studies based on which stage of the ensemble learning process is addressed by the evolutionary algorithm: the generation of base models, model selection, or the integration of outputs. The next three levels of the taxonomy further categorize studies based on methods used to address each stage. In addition, we categorize studies according to the main types of objectives optimized by the evolutionary algorithm, the type of base learner used and the type of evolutionary algorithm used. We also discuss controversial topics, like the pros and cons of the selection stage of ensemble learning, and the need for using a diversity measure for the ensemble’s members in the fitness function. Finally, as conclusions, we summarize our findings about patterns in the frequency of use of different methods and suggest several new research directions for evolutionary ensemble learning.

Information

Type
Review
Copyright
© The Author(s), 2023. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable