En-feat: An Effective Feature Selection Method Using Ensemble Approach

Feature selection is a crucial step in machine learning and data preprocessing, significantly influencing model performance and interpretability. This paper presents a comprehensive study and contributions in the domain of feature selection by integrating traditional learning techniques with ensemble-based, proposing an effective approach. We propose a Mutual Information-based feature aggregation approach applied to union sets of features, aiming to derive an optimal subset of features that maximizes accuracy. Then, we employ an ensemble method that utilizes forward selection over union sets to identify the optimal feature subsets through sequential feature selection. Our ensemble-based feature selection method called En-feat, is evaluated using a large number of benchmark datasets. The results have been found highly compared with its other competing methods.