Reliability-Aware Cross-Modal Learning Behavior Sensing for Student Cognitive Bias Recognition and Teaching-Oriented Psychological Risk Warning
Luo Xu, Chenlu Jiang, Moxian Lin, Yan ZhanWith the development of smart classrooms and digital learning platforms, multimodal learning behavior data provide a new sensing basis for understanding students’ cognitive states and psychological risk warnings. However, existing educational data mining methods mainly focus on performance prediction, dropout warning, or surface-level emotion recognition, while continuous and interpretable modeling of deeper cognitive biases and related psychological risks remains insufficient. To address this issue, we propose MLBS-Net, a multimodal learning behavior sensing network for teaching feedback that jointly models students’ textual expressions, behavioral sequences, classroom interactions, and psychological auxiliary signals. MLBS-Net integrates theory-guided textual cognitive bias encoding, temporal behavioral state modeling, and reliability-aware cross-modal fusion to capture psychologically interpretable cognitive patterns, characterize dynamic learning-state changes, and adaptively integrate multimodal information according to data quality and task contribution while providing interpretable feedback for teachers. Experimental results show that MLBS-Net achieves a Macro-F1 of 0.855 for cognitive bias recognition and an AUC of 0.891 for psychological risk warning, outperforming traditional machine learning, unimodal deep learning, and standard multimodal methods. Ablation results further support the effectiveness of theory-guided semantic encoding, temporal behavioral modeling, reliability estimation, and multitask learning. These findings demonstrate that MLBS-Net can jointly characterize cognitive biases and potential psychological risks from multisource learning behaviors, providing a feasible approach for learning-state sensing, risk warning, and interpretable teaching support in smart education.