AI-Enhanced IoT Tool for Emotional and Social Development in Children with Autism

Autism Spectrum Disorder (ASD) delivers unique challenges for children in their communication, social interaction, and learning abilities. To address these challenges and empower children with ASD, this work introduces an innovative AI-powered education tool that harnesses the potential of the Internet of Things (IoT) and Emotional Intelligence (EI). The proposed tool utilizes cutting-edge Artificial Intelligence (AI) algorithms, such as Haar-cascade Python libraries, Convolution Neural Network (CNN) for accurate Facial Expression Recognition (FER). By capturing real-time facial expressions, the system aims to better understand and respond to the emotional states of children with ASD, enhancing their social engagement and interaction skills. To further support the emotional well-being of children with ASD, the system integrates a sweat conductance detection sensor based on Galvanic Skin Response (GSR). The GSR sensor enables the real-time monitoring of stress levels, providing valuable insights into the child’s emotional states and facilitating timely interventions when emotions become unstable. The power of the Internet of Things (IoT) is leveraged through the use of NodeMCU (ESP8266–12[Formula: see text]E Microcontroller unit), enabling seamless communication and data transmission for remote monitoring and analysis. This allows parents, caregivers, and educators to access valuable information regarding the child’s emotional responses and progress in real-time, facilitating personalized and effective support. Through the AI-powered education tool’s interactive interface, children with ASD are engaged in stimulating and educational activities, fostering their cognitive and emotional growth. The system offers a range of interactive learning experiences, including rhymes audio, promoting self-expression and learning in an inclusive environment.