Sony debuts first 'Virtual Reality projection mapping' technology in a music video

Visitors to SXSW were able to put on Playstation VR headsets and see the original music video for a song by US musician Khalid being projection mapped onto objects within a new VR world

David Nurieli
Read +
Follow Us

Sony unveiled Sonic Surf VR at SXSW 2018, a unique suite of spatial audio technology combined with new multi-channel speakers and specially developed software designed to simulate popping, moving, and partitioning sounds in one space using an intuitive software application. 

The technology was used in the debut showing of musician Khalid’s “Young, Dumb and Broke” VR music video at the Lost In Music Sony promotion.

Sonic Surf VR is suitable for wide range of applications, such as location-based entertainment like theme parks, special events, exhibitions, museums, aquariums and corporate showrooms. 

The VR projection mapping technique enhances VR with 360-degree “stereoscopic” images, combined with digital signage, projection mapping and lighting. Creators and producers who are producing attractive and dynamic content with additional, innovative special design elements can further enhance the value of their work. In this case, Khalid’s original video, “Young, Dumb and Broke,” is being projected onto surfaces such as the ocean and planets.

Visitors who came to Sony’s “Lost in Music” event put on PlayStation VR headsets and were first guided through the company’s “acoustic vessel odyssey,” an audio journey with an immersive sound experience.  Sonic Surf VR is the industry first packaged solution which combines Sound Field Synthesis with speakers, a control unit and software based on an algorithm unique to Sony. 

Sony says, “Spatial focused on visual experience. Sonic Surf VR is the industry’s first packaged solution offering a new type of VR from an audio perspective. It can produce powerful space of sound and further enhance VR experience by enabling multiple numbers of people to enjoy simultaneously without headphones.

In an interview with Adweek, Miki Anan, senior manager for entertainment partnerships at Sony said, “This idea of using projection mapping inside a virtual world was something that was created through an original Sony interactive entertainment engine. We wanted to bring together a completely new type of immersive experience to music lovers.”

Recently, Bose released its project called “Bose AR”. Bose AR devices combine data from embedded motion sensors, which they connect with your phone via Bluetooth. GPS detects the user's location, and the nine-axis sensor will determine which direction the user is facing and moving. The Bose AR glasses speak information out loud to you using built-in speakers and you're the only one who can hear it. The combination of audio cues, mixed with Virtual Reality is slowly maturing into real-world applicational uses.