To enhance its AR and VR experiences further, Meta is now developing new spatial audio tools. With the help of this integration, people will be able to live moments of immersive graphics and sounds when they put on their AR glasses.
Spatial audio is one of Meta’s key drivers for the Metaverse, and the company has already introduced a bit of the spatial audio experience in its Ray-Ban Stories glasses that feature open air speakers to deliver sound directly into the wearer’s ears, without an earpiece.
Currently, Meta is creating three new models for audio-visual understanding and inviting developers and audio experts to contribute to its research. According to Meta, the models “focus on human speech and sounds in video.”