FROM PIXELS TO PRESENCE: A DEEP DIVE INTO VOLUMETRIC VIDEO TECHNOLOGY FOR TRANSFORMATIVE ONLINE EDUCATION EXPERIENCES
University of Arizona (UNITED STATES)
About this paper:
Conference name: 16th International Conference on Education and New Learning Technologies
Dates: 1-3 July, 2024
Location: Palma, Spain
Abstract:
Volumetric Video (VV) technology has emerged as a promising tool for enhancing online learning experiences, offering high-fidelity, three-dimensional representations of people and objects. This abstract delves into the technical aspects of VV capture, software utilization, and network requirements, shedding light on the hardware and software ecosystem currently employed, focusing the technical aspects on how to incorporate this technology into educational settings.
Volumetric Video Capture:
FormaVision is the cornerstone of our VV capture process, enabling the precision and efficiency of recording volumetric data. This system employs an array of synchronized cameras to capture a subject from multiple viewpoints, generating a comprehensive 3D model. The hardware setup includes high-resolution cameras, depth sensors, and sophisticated lighting rigs to ensure optimal data acquisition. Software algorithms then merge these multi-viewpoint recordings into a cohesive volumetric representation, preserving spatial detail and realism.
Software Integration:
In conjunction with FormaVision, specialized software facilitates post-processing and rendering of volumetric content. This includes data alignment, mesh reconstruction, texture mapping, and compression techniques to optimize streaming and storage. Our workflow incorporates industry-standard tools for data manipulation and refinement, ensuring compatibility with delivery platforms and streaming protocols. Furthermore, real-time rendering engines enhance interactivity and immersion, enabling end-users to engage with VV content seamlessly.
Networking Requirements:
The seamless delivery of live or recorded VV broadcasts hinges upon robust networking infrastructure. High-speed internet connectivity and low-latency transmission are paramount to ensure smooth playback and interaction. FormaVision's integration with scalable cloud-based solutions facilitates adaptive bitrate streaming, accommodating varying network conditions and device capabilities. Quality of Service (QoS) protocols prioritize data packets, mitigating latency and buffering issues during transmission. Moreover, Content Delivery Networks (CDNs) optimize content distribution, minimizing latency and enhancing scalability for global audiences.
End-User Experience:
End-users can experience live or recorded VV broadcasts through a variety of platforms and devices. Compatibility with standard web browsers, mobile applications, and virtual reality (VR) headsets ensures accessibility across diverse environments. Interactive features such as 360-degree navigation, spatial audio, and gesture recognition augment user engagement, fostering a sense of presence and immersion. Furthermore, intuitive user interfaces facilitate seamless navigation and content consumption, empowering learners to customize their educational experience.
Finally, our session will demonstrate to participants how to capture and process a volumetric recording.Keywords:
Volumetric video capture, holographic capture, volumetric broadcasting, augmented reality.