Sistema embebido inteligente para monitoreo de niveles de estrés y comunicación PECS en niños con TEA

Abstract

CONDITION FOR PUBLICATION OF PROJECT. Autism Disorder (ASD) poses a significant challenge to child communication and emotional regulation, particularly in those with verbal limitations. This project aims to develop a device that integrates an augmentative communication system through physical pictograms with a stress monitoring module based on computer vision and artificial intelligence. The hypothesis states that combining embedded technologies with emotional analysis algorithms enhances communicative autonomy while improving the effectiveness of early intervention in family and educational contexts. The system was developed through an iterative design methodology that encompassed 3D modeling and additive manufacturing, implementation of PECS cards with RFID technology, use of a Jetson Orin Nano processing unit, an ESP32 microcontroller, and multimodal emotion recognition models. Results confirmed the prototype’s capability to detect facial expressions, identify stress-related gestures, and generate structured messages from pictograms. It is concluded that the system represents a viable, accessible, and effective alternative to strengthen communication and promote the emotional well-being of children with ASD. Keywords: Emotional monitoring, Child-Device Interaction, Multimodal analysis, Augmentative and Alternative Communication, Inclusive technology.