MPEG-H 3D Audio Head Displacement Tracking for Immersive Localization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The ISO/IEC 23008-3 MPEG-H 3D Audio standard does not support small translational movements of a user's head in a Three Degrees of Freedom (3DoF) environment, limiting the ability to account for positional changes of the listener's head, which restricts the realism of audio object localization and immersion.
Innovation Solution
A method and apparatus for processing position information of audio objects that includes obtaining listener orientation and displacement information, modifying the object position based on this information to account for both translational and rotational movements of the listener's head, enabling a more immersive 3DoF+ experience by simulating audio object movement relative to the listener's head.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the MPEG-H 3D Audio standard is used for 3DoF environment, then rotational head movement is supported, but translational head movement is not supported
Solution Approach 1:
The patent extends the static 3DoF standard to a dynamic 3DoF+ system by introducing time-varying position information and displacement data. The system dynamically updates audio object positions based on listener displacement and orientation changes, enabling both rotational and translational head movements to be accommodated within the audio rendering framework.
Solution Approach 2:
The patent adds a translational dimension to the existing rotational 3DoF framework. By incorporating position information and displacement data along with orientation information, the system transitions from purely rotational head tracking to a six-degree-of-freedom system that accounts for both rotational and translational movements of the listener's head.
2Reliability
If audio scene remains spatially stationary under head orientation change, then 3DoF property is maintained, but realism of audio localization is reduced
Solution Approach 1:
The patent implements feedback by continuously monitoring listener displacement and orientation information and using this data to adjust audio object positions in real-time. The system receives feedback from sensors tracking head position and orientation, then modifies the rendering parameters accordingly to maintain accurate audio localization that reflects the listener's actual head movements.
Solution Approach 2:
The patent applies preliminary action by pre-calculating and applying compensation for head movements before audio rendering. The system receives position information and displacement data in advance, computes the necessary position adjustments, and prepares the modified audio object positions ahead of time, ensuring smooth and accurate audio localization as the listener moves.
Data Source
AI summary
Described is a method of processing position information indicative of an object position of an audio object, wherein the object position is usable for rendering of the audio object, that comprises: obtaining listener orientation information indicative of an orientation of a listener's head; obtaining listener displacement information indicative of a displacement of the listener's head; determining the object position from the position information; modifying the object position based on the listener displacement information by applying a translation to the object position; and further modifying the modified object position based on the listener orientation information. Further described is a corresponding apparatus for processing position information indicative of an object position of an audio object, wherein the object position is usable for rendering of the audio object.