DOI: 10.3390/s26216922 ISSN: 1424-8220

MCHIME-Det: A Lightweight Visual Sensing Framework with Multi-Scale Context and Memory Enhancement for Classroom Behavior Detection

Ting Zhang, Zhaowen Chen, Yingchao Wang, Kun Yang, Yulun Chen, Feng Xue, Tianfu Li, Zhen Sun, Wei Wang, Hong Zhang

Camera-based visual sensing for classroom behavior detection remains challenging because fine-grained behaviors often differ only in subtle posture and hand–object cues, while dense seating, occlusion, scale variation, and background interference further weaken discriminative visual evidence. To address these issues, this study proposes the Multi-scale Context, Hierarchical Integration, and Memory Enhancement Detector (MCHIME-Det), a lightweight, multi-scale context and memory-enhanced detector built on YOLO26n. The framework introduces three complementary components: C3k2PMM combines multi-scale local modeling with direction-aware selective state-space scanning; CGHFF performs channel-guided hierarchical feature interaction across adjacent feature levels; and C2MECM uses input-dependent memory experts to compensate for ambiguous high-level representations. For evaluation, two public classroom behavior datasets were combined into a corpus containing 11,879 images and 71,657 annotated instances across three categories: hand-raising, reading, and writing. On the curated image-level split, MCHIME-Det achieves 76.3% precision, 74.9% recall, 82.1% mAP50, and 61.4% mAP50:95, improving the YOLO26n baseline by 5.6 and 4.4 percentage points in mAP50 and mAP50:95, respectively. These gains are achieved with only 2.36 M parameters and 5.2 GFLOPs, while maintaining 182 FPS on an RTX 4090 and 17.1 FPS on a Jetson Orin Nano edge device. Ablation, cross-architecture, scale-, density-, and overlap-conditioned analyses, cross-source evaluation, image-corruption robustness tests, and cross-hardware benchmarks characterize model performance on the curated benchmark, three sampled external datasets, specified synthetic corruptions, and tested hardware platforms. These results support hierarchical local–global refinement and memory-assisted compensation as effective strategies for lightweight camera-based visual sensing under the evaluated image datasets and inference settings.

More from our Archive