DIGITAL LIBRARY
INTEGRATING EXTENDED DIGITAL MUSICAL INSTRUMENTS AS INCLUSIVE TECHNOLOGY IN EDUCATION
Unicamp University (BRAZIL)
About this paper:
Appears in: ICERI2024 Proceedings
Publication year: 2024
Pages: 3028-3034
ISBN: 978-84-09-63010-3
ISSN: 2340-1095
doi: 10.21125/iceri.2024.0786
Conference name: 17th annual International Conference of Education, Research and Innovation
Dates: 11-13 November, 2024
Location: Seville, Spain
Abstract:
Extended Digital Musical Instruments (EDMIs) offer a transformative approach to inclusive technology by integrating advanced digital capabilities to enhance expressive and interactive experiences. This paper presents the development and application of BehCreative, an innovative EDMI designed to incorporate environment, ecology, and bodily immersion into the musical process. Utilizing motion capture systems such as IDS Ethernet cameras and Microsoft Kinect 3D optical sensors, BehCreative enables real-time tracking of user movements, facilitating dynamic and responsive musical interactions. BehCreative leverages Mixed Reality (MR) and sonification algorithms to generate sounds based on user gestures, creating immersive experiences that are therapeutic. By fostering creative empowerment and emotional well-being, BehCreative exemplifies the potential of technology to transform traditional inclusive practices. This study explores the theoretical foundations of BehCreative, drawing from embodied cognition and sensorimotor contingency theories to illustrate how physical interactions within digital environments can enhance therapeutic outcomes. The application of BehCreative in therapeutic settings is evaluated through qualitative and quantitative methodologies, highlighting its impact on user engagement, creativity, and inclusivity. The relevance of EDMIs like BehCreative underscores the interdisciplinary connections between inclusive technology, therapy, and education. By addressing the cognitive and social dimensions of therapeutic practices, BehCreative provides an example of integrating innovative technologies to support diverse needs. EDMIs can support diverse learning needs and promote accessibility in therapeutic and educational settings, promoting creativity and therapeutic outcomes through inclusive learning and inclusive technologies.
Keywords:
EDMI, Inclusive, Education, Creativity, Music.