DIGITAL LIBRARY
REALITY VS VIRTUALITY: THE SMART TACTILE PATH OF THE GAGNA’S CENACOLO AT THE TURIN CATHEDRAL
Politecnico di Torino (ITALY)
About this paper:
Appears in: INTED2022 Proceedings
Publication year: 2022
Pages: 205-210
ISBN: 978-84-09-37758-9
ISSN: 2340-1079
doi: 10.21125/inted.2022.0115
Conference name: 16th International Technology, Education and Development Conference
Dates: 7-8 March, 2022
Location: Online Conference
Abstract:
When the community recognizes an architectural asset or artefact of historical-cultural value, it is necessary to initiate preventive conservation measures over time without compromising its accessibility. Virtual reconstructions and new technologies can increase the strategies opportunities and the pool of potential users. This paper promotes the creation of an innovative tactile experience that combines 3D virtual and physical reproduction using Artificial Intelligence (AI). The experimental occasion was the restoration of Gagna's Cenacolo at Turin Cathedral. As the authentic preservation of the asset is closely linked to the best definition of the virtual replica, the methodological approach has been carefully designed to evaluate the most appropriate survey, digital and physical restitution techniques. The iconographic reproduction has been performed from the integration of various documentary sources. Since the asset is a copy of Leonardo Da Vinci’s more famous Cenacolo, it was possible to use derived-point clouds and open models from bas-reliefs of the painting. The individual geometries were compared and reworked based on a high-resolution photographic survey that allowed us to better frame the compositional differences between the artworks. The digital model is created with specific software that allows the 3D shaping of the characters. Simultaneously, an innovative AI technological system has been designed to limit the gap between reality and virtuality, enabling user interaction with the asset. It uses a specific game development platform that leverages the power of programming to connect hardware components to a speech recognition system. The tactile path is activated by a Proximity sensor that detects the presence of a visitor. The artwork, either in digital format or 3D printed, is divided into parts to associate diversified audio content through a mapping system realized by Leap Motion technology. An InfraRed (IR) sensor tracks the hand’s actual position on the physical replica and transfers the spatial coordinates into the virtual model. In this way, the interaction between real experience and virtual content activation is managed by an algorithm that triggers the audio sequences selectively and automatically. This work explores how technology can become a real support to increase the accessibility of historical-cultural artifacts to a wider and more diverse range of users. Moreover, disabilities are overcome by combining digital technologies and audio-assisted play system for a different and sustainable digital learning experience.
Keywords:
Virtual digital model, Virtual Reality system, Artificial intelligence, Intelligence tactile path, 3D printing.