Abstract:

The usefulness of the speaking virtual head, as well as 3D augmented reality tools in the new communication, teaching and presentation technologies, as well as in a variety of audiovisual communications software technologies is almost unlimited. Currently we are working in creating the final communication and presentation tool for all. Why for all?

One of the options is the learning through technologies for hearing impaired people [6]. Other, which is a most desired technology, is the use of a virtual head in the field of different communication forms. In the field of crisis management, where the virtual head present the warning messages and navigates during the evacuation of people from reproducing the public institutions such as schools, theatres etc. 3D visualization tools, as well as speaking head and Slovak speech visemes have been designed and tested in our Institute. Currently we are working on creating the final communication and presentation tool for all.

Normal students, and especially hearing impaired students, are very fond of reaching for communication technologies using a virtual head in the process of virtual learning. Such a method does not separate normal students from hearing impaired students.

There are situations in which hearing impaired people are more at risk. These are mainly crisis situations such as fire, evacuation, threats to natural and social elements, flood, bombs… In the field of crisis management, it is advisable to use technology using a virtual, talking head that presents warning messages and navigates during the evacuation of people from public places such as schools, theaters, tunnels... In the environment of such an equipped system, hearing impaired people who orient themselves in such situations, mainly by looking at and watching the warning messages on the monitors, also have a chance.

Many deaf, hearing impaired people use lip reading as the main communication form. They prefer technologies using a virtual speaking head in virtual learning and also in a crisis situation. The main benefit is that a virtual, talking head teaches them to speak, learn and so on. "Viseme" is a presentation unit used to classify speech sounds in a visual domain. "Visemes" describe the specific positions of the face and oral cavity and the movements that occur along with the pronouncing of phonemes. Learning lip-reading using visemes is much easier for hearing impared students than learning lip-reading using a real speaker.

The aim of our creation was to design the perfect anatomy of Slovak language speaking head, which will be of maximum help in communication and learning, audiovisual technologies for all students, children and adults, and even the elderly. The proposal required to make a perfect anatomy of the head and, above all, the design of perfect visemes of the Slovak language. Everything is designed using the latest knowledge of modern 3D virtual reality, augmented reality and mixed reality technologies.

Design of individual modules for Virtual head
The entire design of the Slovak-speaking virtual head has been divided into 5 steps and consists of 5 modules that can work individually or work as a complete system.

1. Basic module – design of the anatomy of the head.
2. Design 17 basic and 5 special visuals of the Slovak language.
3. Module for converting text to speech and speech to text.
4. Synchronize speech module.
5. Synchronize module for the final tool of creating a virtual talking head.

Keywords:

Virtual speaking head, speech therapy, teaching lesson, hearing impaired students.