A Diversity-Accuracy Measure for Homogenous Ensemble Selection

TitleA Diversity-Accuracy Measure for Homogenous Ensemble Selection
Publication TypeJournal Article
Year of Publication2019
AuthorsZouggar, T. S., and A. Adla
JournalInternational Journal of Interactive Multimedia and Artificial Intelligence
ISSN1989-1660
IssueRegular Issue
Volume5
Number5
Date Published06/2019
Pagination63-70
Abstract

Several selection methods in the literature are essentially based on an evaluation function that determines whether a model M contributes positively to boost the performances of the whole ensemble. In this paper, we propose a method called DIversity and ACcuracy for Ensemble Selection (DIACES) using an evaluation function based on both diversity and accuracy. The method is applied on homogenous ensembles composed of C4.5 decision trees and based on a hill climbing strategy. This allows selecting ensembles with the best compromise between maximum diversity and minimum error rate. Comparative studies show that in most cases the proposed method generates reduced size ensembles with better performances than usual ensemble simplification methods.

KeywordsBagging, Classification, Decision Trees, Ensemble Methods, Ensemble Pruning, Hill Climbing, Machine Learning
DOI10.9781/ijimai.2018.06.005
URLhttps://www.ijimai.org/journal/sites/default/files/files/2018/06/ijimai_5_5_8_pdf_37634.pdf
AttachmentSize
ijimai_5_5_8.pdf624.89 KB