Hybrid Decision-Level Fusion of CNN-Based Deep and Handcrafted Features for Colon Cancer Classification

In recent years, there has been increased attention on classifying histopathological images through hybrid decision-level fusion, and the challenge of exploring data fusion to improve classification accuracy in colon cancer has become significant. This study introduces new elements by incorporating various deep learning (DL) architectures, including EfficientNetB0, DenseNet121, ResNet101V2, NASNetMobile, MobileNetV2, and VGG16 Convolutional Neural Networks (CNNs), as well as Random Forest (RF) and Histogram Gradient Boosting (HGB) Machine Learning (ML) algorithms, along with the original dataset. The proposed hybrid decision-level fusion approach analyzes the LC25000 dataset’s colon histopathological images and handcraft features (HFs) to improve predictive performance. The HFs such as entropy, the Gini index, and the radius of gyration from adenocarcinoma and benign colon tissue (CC) were extracted. The prediction of the proposed models leveraging late fusion was conducted by classifying both deep and HFs. During the experiments, it was demonstrated that the combination of ResNet101V2 with RF classifier and all HFs yielded greater accuracy and consistent performance. The achieved performance metrics include accuracy of 94.1%, F1-score of 94%, Matthews Correlation Coefficient (MCC) of 88.3%, and an area under the curve (AUC) of 0.979. To explain and interpret the decisions made by the DL models, the explainable methods SHapley Additive exPlanations (SHAP) and Gradient-weighted Class Activation Mapping (Grad-CAM) were utilized.