Abstract:

Serious games, as well as their subsets, such as Virtual Reality (VR) and Augmented Reality (AR), are increasingly used for healthcare applications. In the present paper we introduce a pilot mobile-based rehabilitation VR and AR serious game for Cochlear Implanted Children. The software comprises 4 stages and aspires to help end- users to improve their auditory skills with respect to sounds: detection, discrimination, identification, and comprehension. We chose to run the software on virtual reality headset devices, since this is a new, most promising technology, particularly popular among children. We have currently completed the first stage regarding sound detection. Various domestic animals appear randomly on the screen, one species at each of four stages. A sound corresponding to one of the animal species involved is produced at random and the user has to touch the animal on the screen within a reasonable time. At the beginning the volume of the sound is set at 100% and becomes gradually reduced during the playing. The data on the user’s performance are registered. The recorded information proves to be useful for the speech therapist in evaluating the user. As far as usability of the software is concerned, a pilot test on three children with cochlear implants provided us with positive preliminary outcomes.

Keywords:

Mobile-based, rehabilitation Cochlear Implanted, Virtual Reality, Augmented Reality.