DIGITAL LIBRARY
SPOT&SPOT: A VIDEO VISUAL SCENE DISPLAY APPLICATION TO ENHANCE COMMUNICATION FOR INDIVIDUALS WITH ASD
1 Shamoon College of Engineering (ISRAEL)
2 Kaye College (ISRAEL)
About this paper:
Appears in: ICERI2023 Proceedings
Publication year: 2023
Pages: 8615-8619
ISBN: 978-84-09-55942-8
ISSN: 2340-1095
doi: 10.21125/iceri.2023.2195
Conference name: 16th annual International Conference of Education, Research and Innovation
Dates: 13-15 November, 2023
Location: Seville, Spain
Abstract:
Autism spectrum disorder (ASD) is a neurodevelopmental condition affecting about one percent of the population, often resulting in difficulties in social interactions that can impact all aspects of life. Augmentative and alternative communication methods have been developed to support those who do not use natural speech as a primary mode of communication. High-tech devices such as tablets and dedicated computers are often employed, featuring visual scene displays (VSDs) as a standard communication interface. However, communication remains a challenge for individuals with moderate to severe forms of ASD. ASD presents unique developmental challenges, particularly in communication and behavior. Over time, a variety of technological solutions, including Augmentative and Alternative Communication (AAC), have been developed to support individuals with ASD who experience speech production difficulties. One such method is the Visual Scene Display (VSD), which offers a means of displaying communication symbols on various AAC devices. A VSD can be static (image-based) or dynamic (video-based), with embedded hotspots that facilitate communication by being clicked. Past research suggests that communication using VSD, and particularly video based VSD (VVSD), offers numerous advantages. Firstly, it provides contextual support for beginning communicators as they learn language skills, given that images or videos capture social interactions within the context they occur. Secondly, VSDs embed vocabulary directly, reducing the need to shift focus between the communication partner, the AAC system, and the activity. Lastly, VSDs offer flexibility in adding meaningful, contextually appropriate vocabulary through just-in-time programming (Light et al., 2019).
"Spot&Spot”, displays video clips and images, allowing the user to identify objects or people by clicking hotspots, and provides feedback consisting of either positive or negative audio in response to participants' clicks. Additionally, "Spot&Spot” included a grid of symbols arrayed around the images, designed to assist the participants in self-expression during the conversation. The mediator can select and prepare video clips, define hotspots and symbols, manage the sessions, and provide feedback.
"Spot&Spot” features a user-friendly interface, designed with educators and people with complex communication needs in mind, to facilitate communication. Also, "Spot&Spot” is completely free, accessible (available for download at any moment in the application store) and supports both Android and iOS operating systems. The application also supports English and Hebrew languages. Although not used in this study, Spot&Spot also supports the transparency of hotspots for follow-up studies. In addition, Spot&Spot enables personal dynamic customization for each participant in several parameters – VSD/VVSD scenes, sounds, and symbols.
The research aimed to determine whether static or video displays would enhance the quality and quantity of interactions for the participants. Findings indicate that VVSD may be more effective in improving communication among individuals with complex communication needs, capturing their interest more than static VSD (SVSD). However, due to some limitations in the study, these conclusions are not definitive.
Keywords:
Autism spectrum disorder, Augmentative and alternative communication, Video visual scene display, Communication difficulties.