Abstract:

This paper describes an application that can serve as a learning and training tool for blind or partially sighted children. The app utilizes a mobile device and data on real physical objects to enhance the learning process.

The application recognizes real objects via QR code labels and produces sounds and verbal information. A tutor can use any free online QR encoder to generate the QR code labels. These labels contain instructions and data that guide the application to act in a specific way. Each QR label is specific to the corresponding object. The app aims to provide a fun, low-cost learning and exercise system for learning Braille and enriching the haptic perception of physical objects. The speech to text engine of the application can use any language that the mobile device supports. This multilanguage ability offers a solution in low-income developing countries, where the high cost of other technologies, such as tactile-user interfaces, prohibits their use. Mobile devices are a mainstream technology. Thus, we consider that this application can be used not only in schools but also at home.

Keywords:

Braille, mobile learning, blindness, visual impairment.