Improving social skills in children with ASD using a long-term, in-home social robot
Abstract
Social robots can offer tremendous possibilities for autism spectrum disorder (ASD) interventions. To date, most studies with this population have used short, isolated encounters in controlled laboratory settings. Our study focused on a 1-month, home-based intervention for increasing social communication skills of 12 children with ASD between 6 and 12 years old using an autonomous social robot. The children engaged in a triadic interaction with a caregiver and the robot for 30 min every day to complete activities on emotional storytelling, perspective-taking, and sequencing. The robot encouraged engagement, adapted the difficulty of the activities to the child’s past performance, and modeled positive social skills. The system maintained engagement over the 1-month deployment, and children showed improvement on joint attention skills with adults when not in the presence of the robot. These results were also consistent with caregiver questionnaires. Caregivers reported less prompting over time and overall increased communication.
Get full access to this article
View all available purchase options and get full access to this article.
Already a Subscriber?Sign In
Supplementary Material
Summary
Movie S1. The robot leads the child and the caregiver into an interactive barrier game in which the child builds a rocket and then explains to the caregiver their rocket.
Movie S2. The robot tells a story and asks the child how the main character is feeling at a certain point in the story.
Data file S3. Gameplay data set.
Data file S4. Joint attention data set.
Data file S5. Caregiver survey data set.
Resources
REFERENCES AND NOTES
1
American Psychiatric Association, Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association, ed. 5, 2013).
2
C. Kanai, G. Toth, M. Kuroda, A. Miyake, T. Itahashi, Social skills in autism spectrum disorders, in Handbook of Social Behavior and Skills in Children (Springer, 2017), pp. 217–248.
3
V. H. Mackintosh, R. P. Goin-Kochel, B. J. Myers, “What do you like/dislike about the treatments you’re currently using?” A qualitative study of parents of children with autism spectrum disorders. Focus Autism Other Dev. Disabl. 27, 51–60 (2012).
4
B. Scassellati, How social robots will help us to diagnose, treat, and understand autism, in Robotics Research (Springer, 2007), pp. 552–563.
5
D. Feil-Seifer, M. J. Matarić, Defining socially assistive robotics, in 9th International Conference on Rehabilitation Robotics, 2005 (ICORR), (IEEE, 2005), pp. 465–468.
6
M. J. Matarić, B. Scassellati, Socially assistive robotics, in Springer Handbook of Robotics, B. Siciliano, O. Khatib, Eds. (Springer, 2016), pp. 1973–1994.
7
A. Tapus, M. J. Matarić, B. Scassellati, Socially assistive robotics [grand challenges of robotics]. IEEE Robot. Autom. Mag. 14, 35–42 (2007).
8
T. Belpaeme, J. Kennedy, A. Ramachandran, B. Scassellati, F. Tanaka, Social robots for education: A review. Sci. Robot. 3, eaat5954 (2018).
9
N. Tejima, Rehabilitation robotics: A review. Adv. Robot. 14, 551–564 (2001).
10
B. Scassellati, H. Admoni, M. J. Matarić, Robots for use in autism research. Annu. Rev. Biomed. Eng. 14, 275–294 (2012).
11
E. S. Kim, R. Paul, F. Shic, B. Scassellati, Bridging the research gap: Making HRI useful to individuals with autism. J. Hum. Robot Interact. 1, 26–54 (2012).
12
J. J. Diehl, L. M. Schmitt, M. Villano, C. R. Crowell, The clinical use of robots for individuals with autism spectrum disorders: A critical review. Res. Autism Spectr. Disord. 6, 249–262 (2012).
13
J. Wainer, B. Robins, F. Amirabdollahian, K. Dautenhahn, Using the humanoid robot KASPAR to autonomously play triadic games and facilitate collaborative play among children with autism. IEEE Trans. Auton. Ment. Dev. 6, 183–199 (2014).
14
E. S. Kim, L. D. Berkovits, E. P. Bernier, D. Leyzberg, F. Shic, R. Paul, B. Scassellati, Social robots as embedded reinforcers of social behavior in children with autism. J. Autism Dev. Disord. 43, 1038–1049 (2013).
15
Z. Zheng, E. Bekele, A. Swanson, A. Weitlauf, Z. Warren, N. Sarkar, The impact of robots on children with autism spectrum disorder. Autism Imaging Devices 397 (2017).
16
C. D. Elliott, DAS Administration and Scoring Manual (Psychological Corporation, 1990).
17
C. Lord, M. Rutter, A. Le Couteur, Autism Diagnostic Interview-Revised: A revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. J. Autism Dev. Disord. 24, 659–685 (1994).
18
C. Lord, M. Rutter, P. C. DiLavore, S. Risi, K. Gotham, S. L. Bishop, Autism Diagnostic Observation Schedule (ADOS) (Western Psychological Services, 1999).
19
L. Boccanfuso, E. S. Kim, J. C. Snider, Q. Wang, C. A. Wall, L. DiNicola, G. Greco, L. Flink, S. Lansiquot, P. Ventola, K. Chawarska, B. Scassellati, F. Shic, Autonomously detecting interaction with an affective robot to explore connection to developmental ability, in 2015 International Conference on Affective Computing and Intelligent Interaction (ACII) (IEEE, 2015), pp. 1–7.
20
H. Kozima, C. Nakagawa, Y. Yasuda, Children–robot interaction: A pilot study in autism therapy. Prog. Brain Res. 164, 385–400 (2007).
21
B. Robins, K. Dautenhahn, P. Dickerson, From isolation to communication: A case study evaluation of robot assisted play for children with autism with a minimally expressive humanoid robot, in 2009 Second International Conferences on Advances in Computer-Human Interactions (ACHI), (IEEE, 2009), pp. 205–211.
22
M. A. Guadagnoli, D. L. Timothy, Challenge point: A framework for conceptualizing the effects of various practice conditions in motor learning. J. Mot. Behav. 36, 212–24 (2004).
23
S. Al Moubayed, J. Edlund, J. Beskow, Taming Mona Lisa: Communicating gaze faithfully in 2D and 3D facial projections. ACM Trans. Interact. Intell. Syst. 1, 25 (2012).
24
D. Leyzberg, S. Spaulding, M. Toneva, B. Scassellati, The physical presence of a robot tutor increases cognitive learning gains, in Proceedings of the 34th Annual Meeting of the Cognitive Science Society (Cognitive Science Society, 2012).
25
A. Ramachandran, C.M. Huang, E. Gartland, B. Scassellati, Thinking aloud with a tutoring robot to enhance learning, in Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction (ACM, 2018), pp. 59–68.
26
A. Powers, S. Kiesler, S. Fussell, C. Torrey, Comparing a computer agent with a humanoid robot, in 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI) (IEEE, 2007), pp. 145–152.
27
A. Pereira, C. Martinho, I. Leite, A. Paiva, iCat, the chess player: The influence of embodiment in the enjoyment of a game, in Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 3 (AAMAS) (International Foundation for Autonomous Agents and Multiagent Systems, 2008), pp. 1253–1256.
28
D. Leyzberg, S. Spaulding, B. Scassellati, Personalizing robot tutors to individuals’ learning differences, in Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction (HRI) (ACM, 2014), pp. 423–430.
29
B. J. Byiers, J. Reichle, F. J. Symons, Single-subject experimental design for evidence-based practice. Am. J. Speech Lang. Pathol. 21, 397–414 (2012).
30
A. Wagner, Designing research studies on psychosocial interventions in autism. J. Autism Dev. Disord. 37, 354–366 (2007).
31
J. L. Bean, I. M. Eigsti, Assessment of joint attention in school-age children and adolescents. Res. Autism Spectr. Disord. 6, 1304–1310 (2012).
32
Jibo Inc. Jibo. Retrieved from www.jibo.com (2018).
33
M. Quigley, B. Gerkey, K. Conley, J. Faust, T. Foote, J. Leibs, A. Y. Ng, ROS: An open-source Robot Operating System. ICRA Workshop on Open Source Software. 3, 5 (2009).
34
T. Baltrusaitis, P. Robinson, L. P. Morency, Constrained local neural fields for robust facial landmark detection in the wild, in 2013 IEEE International Conference on Computer Vision Workshops (ICCVW) (IEEE, 2013), pp. 354–361.
35
A. Ramachandran, C. M. Huang, B. Scassellati, Give me a break!: Personalized timing strategies to promote learning in robot-child tutoring, in Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (ACM, 2017), pp. 146–155.
36
A. Ramachandran, A. Litoiu, B. Scassellati, Shaping productive help-seeking behavior during robot-child tutoring interactions, in 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI) (IEEE, 2016), pp. 247–254).
Information & Authors
Information
Published In

Science Robotics
Volume 3 | Issue 21
August 2018
August 2018
Copyright
Copyright © 2018 The Authors, some rights reserved; exclusive licensee American Association for the Advancement of Science. No claim to original U.S. Government Works.
This is an article distributed under the terms of the Science Journals Default License.
Submission history
Received: 1 April 2018
Accepted: 30 July 2018
Acknowledgments
We are indebted to the other members of the Expedition in Computing on Socially Assistive Robotics for their contribution of social skills game software and the early development of other socially assistive systems that led to the deployment reported here, especially M. Mataric, C. Breazeal, C. Nass, F. Volkmar, M. Jung, A. Ramachandran, S. Sebo, D. Becerra, C. Claybaugh, J. Kory, S. Shen, M. Baranov, and A. Waugh. We also thank L. Hall for scheduling and administrative support, L. Scassellati for photo assistance, and all of the families that welcomed a robot into their homes. Funding: Support was provided by an NSF Expedition in Computing, B.S. is the principal investigator, #1139078 (Socially Assistive Robotics). F.S. was supported by funding by NIH grant no. K01MH104739. Author contributions: All authors took part in experimental design and deployment. B.S., C.-M.H., M.Q., and N.S. designed and constructed the robotic system and associated software. L.B., M.M., P.V., and F.S. conducted clinical assessments and provided clinical oversight. F.S. and C.-M.H. provided statistical analyses. Competing interests: L.B. is now supported by Vän Robotics, which constructs tutoring robots though not for children with ASD, and F.S. and B.S. serve as advisor board members. Data and materials availability: All data needed to evaluate the conclusions in the paper are present in the paper or the Supplementary Materials. Software available from github.com/ScazLab. Contact B.S. for other materials.
Authors
Funding Information
National Science Foundation: 1139078
National Institutes of Health: 5K01MH104739
Metrics & Citations
Metrics
Article Usage
Altmetrics
Citations
Export citation
Select the format you want to export the citation of this publication.
Cited by
- Theories and Practices Behind Educational Robotics for All, Research Anthology on Computational Thinking, Programming, and Robotics in the Classroom, (677-715), (2022).https://doi.org/10.4018/978-1-6684-2411-7
- Multi-modal Open World User Identification, ACM Transactions on Human-Robot Interaction, 11, 1, (1-50), (2022).https://doi.org/10.1145/3477963
- Assistive Technology to Support Children With Autism Spectrum Disorder, Assistive Technologies for Assessment and Recovery of Neurological Impairments, (25-47), (2022).https://doi.org/10.4018/978-1-7998-7430-0.ch002
- Adults still can't resist: A social robot can induce normative conformity, Computers in Human Behavior, 127, (107041), (2022).https://doi.org/10.1016/j.chb.2021.107041
- undefined, Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction, (162-166), (2021).https://doi.org/10.1145/3434074.3447151
- Future perspectives of robot psychiatry: can communication robots assist psychiatric evaluation in the COVID-19 pandemic era?, Current Opinion in Psychiatry, 34, 3, (277-286), (2021).https://doi.org/10.1097/YCO.0000000000000692
- undefined, Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction, (724-727), (2021).https://doi.org/10.1145/3434074.3444881
- Instructional Design and 3D Virtual Worlds, Handbook of Research on Teaching With Virtual Environments and AI, (444-460), (2021).https://doi.org/10.4018/978-1-7998-7638-0.ch019
- undefined, 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN), (598-603), (2021).https://doi.org/10.1109/RO-MAN50785.2021.9515438
- undefined, Proceedings of the 2021 ACM/IEEE International Conference on Human-Robot Interaction, (341-350), (2021).https://doi.org/10.1145/3434073.3444671
- See more
Loading...
View Options
Get Access
Log in to view the full text
AAAS login provides access to Science for AAAS members, and access to other journals in the Science family to users who have purchased individual subscriptions.
- Become a AAAS Member
- Activate your Account
- Purchase Access to Other Journals in the Science Family
- Account Help
Log in via OpenAthens.
Log in via Shibboleth.
More options
Register for free to read this article
As a service to the community, this article is available for free. Login or register for free to read this article.
View options
PDF format
Download this article as a PDF file
Download PDF





