Understanding Spoken Language Development of Children with ASD Using Pre-trained Speech Embeddings

• DOI: 10.48550/arxiv.2305.14117
• Publication Date: 2023-08-20
• Authors: Xu, Anfeng; Hebbar, Rajat; Lahiri, Rimita; Feng, Tiantian; Butler, Lindsay; Shen, Lue; Tager-Flusberg, H...; Narayanan, Shrikanth
• Keywords: FOS: Computer and information sciences; Computer Science - Machine Learning; Audio and Speech Processing (eess.AS); FOS: Electrical engineering, electronic engineering, information engineering; Electrical Engineering and Systems Science - Audio and Speech Processing; Machine Learning (cs.LG)

Speech processing techniques are useful for analyzing speech and language development in children with Autism Spectrum Disorder (ASD), who are often varied and delayed in acquiring these skills. Early identification and intervention are crucial, but traditional assessment methodologies such as caregiver reports are not adequate for the requisite behavioral phenotyping. Natural Language Sample (NLS) analysis has gained attention as a promising complement. Researchers have developed benchmarks for spoken language capabilities in children with ASD, obtainable through the analysis of NLS. This paper proposes applications of speech processing technologies in support of automated assessment of children's spoken language development by classification between child and adult speech and between speech and nonverbal vocalization in NLS, with respective F1 macro scores of 82.6% and 67.8%, underscoring the potential for accurate and scalable tools for ASD research and clinical use.<br/>Accepted to Interspeech 2023, 5 pages<br/>