Listeners Seeing What They Hear: Virtual Reality & 3D Acoustics Integration

A new technology involving spatial audio translating beautiful sound into virtual reality viewing will soon be available to acoustic designers for maximum functionality. The pilot project is on trial at the Paris Cathedral of Notre Dame where ghost performers recorded audio continuously play a rendition over and over to equate the audio into computer simulated images.

The computer maps out a simulation from an audio in an architectural edifice that could even improve its existing design where the music repeatedly plays. The computer audio aided setup will enhance the quality of tone and music of the new recommended building design. Listeners are seeing what they hear with the help of this technology.

The acoustic research project carries multidisciplinary aspects for demonstration at the "Acoustics '17", the third joint meeting of the Acoustical Society of America from June 25 to 29, 2017, in Boston, Massachusetts. Recordings from a live concert will the audience to see what they hear showing the mapping simulation of the structural images in 3D will be the centerpiece of the demo.

The musical piece for the Acoustic '17 meeting in Boston is a recording from a live concert back in 2012-2013 with the title "La Vierge" (The Virgin), providing viewers a spectral tour of the Paris Cathedral with the aid of computer graphics. Lead Investigator and CNRS Director Brian F.G. Katz of the Institut Jean Le Rond d'Alembert, Pierre, and Marie Curie in Paris says that the integration of the multimodal VR and acoustics is the main focus of the project, reports Physics.org.

The experience of having a 3D acoustic simulation tested back in 2012 as reported by The Verge, presented its earlier technological enhancement capabilities. The improvement of the latest project of seeing what people hear brings in a new experience with the boost of virtual reality putting listeners at the actual spectrum of where it is happening.

Meanwhile, a similar study is in the works concerning virtual reality simulation that is also in connection with computer aided audio graphics. This time it is more in focus with the personal absorption of acoustics. Researchers Ivan J. Tashev and Hannes Gamper, with Microsoft's Audio and Research Group, say that an individual interpretation of acoustic reception depends on the bodily motion while listening to sound. Even head movements could vary when the listener is moving.

Join the Discussion

Recommended Stories

Real Time Analytics