DOI: 10.1145/3831987 ISSN: 2474-9567

MuscleSense: Making Muscle Effort Audible for Eyes-Free In-the-Loop Regulation

Wenbo Zhang, Chenxu Zhang, Xingying Yan, Guanyu Xin, Yu He, Wenkang Zhang, Jagmohan Chauhan, Yang Gao, Zhanpeng Jin

Strength training often demands attention to form, balance, and pacing, leaving little bandwidth to notice muscle-level deviations such as asymmetric loading or compensatory coordination. We present MuscleSense , a deployable audio-first closed-loop biofeedback system that makes muscle effort perceivable and actionable during movement without requiring visual attention. Using a minimal wearable setup (bilateral front-thigh IMU + EMG) and on-device inference, MuscleSense estimates a feedback-aligned effort state designed for control rather than signal reconstruction: overall intensity ( I ) plus three descriptors capturing symmetry ( S ), co-contraction ( C ), and temporal stability ( D ). This state drives a two-layer sonification policy: continuous pitch supports moment-to-moment effort grounding, while rate-limited event cues highlight persistent deviations with bounded listening load.; AB@We evaluate MuscleSense on N =17 participants, using multi-channel reference EMG only to construct and evaluate labels. Results show strong agreement with EMG-derived ground truth across users and activities, stable smartphone operation with bounded end-to-end latency, and a deployable rate-limited cue policy designed to reduce listening burden. A short within-subject closed-loop squat study further shows significant condition effects on pacing-related outcomes and favorable MuscleSense trends compared with no-feedback, mirror, and IMU-only audio baselines. A supplementary lunge study provides initial subjective evidence that participants perceived deviation-related feedback as useful for noticing inter-limb effort differences, instability, and compensation. Together, these results suggest that audio-first muscle-effort feedback can support eyes-free in-the-loop regulation, while dedicated behavioral validation of individual deviation cues remains an important next step.