6DoF Spatial Sound Simulation in Augmented Reality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) technologies only provide a 3-degree of freedom (DOF) spatial sound effect, lacking the relative 3-axis relationship of moving points, which limits the dynamic change of the sound field when the user approaches or moves away from the sound source.
Innovation Solution
The system employs an anchor device that transmits spatial information packets using multiple communication technologies (e.g., radio waves and ultrasonic) to establish a 6-degree of freedom (6DoF) spatial sound simulation. This involves calculating the distance, angle, and spatial relationship between the AR device and the anchor device, allowing for the conversion of sound packets into 6DoF sound signals using algorithms like HRTF.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If only relative rotation between head device and source device is considered (3DOF), then the system complexity is reduced, but the spatial sound effect accuracy deteriorates when user approaches or moves away from source
Solution Approach 1:
The patent transitions from 3DOF (three rotational degrees of freedom) to 6DOF (six degrees of freedom) spatial sound simulation by adding three translational degrees of freedom. This dimensionality expansion enables the system to track both rotational movements and positional changes, resolving the contradiction by accepting increased computational complexity in exchange for significantly improved spatial sound accuracy when users move through the environment.
Solution Approach 2:
The system implements dynamic spatial sound simulation that adapts to real-time user movement. By continuously updating both rotational and translational parameters, the system maintains accurate spatial sound effects throughout the user's journey through the AR environment, rather than relying on static 3DOF relationships.
2Measurement precision
If 6DoF spatial relationship calculation is implemented, then the spatial sound simulation accuracy is improved, but the computational complexity increases
Solution Approach 1:
The system pre-calculates and stores transfer functions for different spatial relationships between user and sound source. By preparing these computational models in advance based on pre-defined positional and rotational parameters, the system reduces real-time computational burden while maintaining 6DOF spatial accuracy during actual AR experiences.
3Ease of operation
If physical anchors are scanned to build spatial model, then the virtual object positioning is achieved, but errors are introduced due to multiple environmental factors
Solution Approach 1:
The system implements feedback mechanisms that continuously monitor and adjust spatial relationships based on real-time sensor data from the head device. This feedback loop compensates for errors introduced during anchor scanning by constantly refining the spatial model using actual user position and orientation data, thereby maintaining high positioning accuracy despite initial scanning uncertainties.
Data Source
AI summary
A method for simulating spatial sound in augmented reality (AR) is disclosed. Multiple sound packets are emitted by a 4D object located on an anchor device in an AR scene. A distance, an angle and spatial relationship between the AR device and the anchor device are calculated. The sound packets are converted into 6DoF sound signals according to the calculated distance, the angle, the spatial relationship, an original sound source and user volume settings using a sound positioning algorithm. The 6DoF sound signals are sent to a playback device of the AR device.