Advancing Speech Therapy for Sinhala-Speaking Children with Autism Spectrum Disorder Through an Intelligent Dialog System

Abstract

This paper presents a dialog system integrated with a NAO socially assistive robot, designed to support Sinhala-speaking children with Autism Spectrum Disorder (ASD). The system leverages a pipeline-based architecture implemented using the RASA framework, consisting of Natural Language Understanding (NLU), Dialog Management (DMU), and Natural Language Generation (NLG) units. The NLU unit processes user input by identifying intents, entities, and dialogue acts, incorporating custom tools like the SpokenSinhala VerbTokenizer for handling spoken Sinhala. The DMU includes a Dialog State Tracker (DST) to maintain conversation context and a Dialog Policy Generator, which employs rule-based, TED, and UnexpecTED policies to adapt conversation flows dynamically. The NLG unit generates natural responses to foster interactive and goal-oriented conversations. Integrated with the NAO robot, the system engages children through meaningful dialogues, such as discussing toy preferences, aiming to enhance social interaction and communication skills. This work highlights the potential of conversational AI and robotics in therapeutic interventions for ASD in low-resource languages.