Screen-Related Audio Object Remapping for Non-Centered Screens
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio object remapping technologies are limited in their ability to adapt audio object positions to changes in screen size and shape, particularly for non-centered screens, and often require complex incorporation of camera and projection parameters, which are not always available.
Innovation Solution
An apparatus and method for audio object remapping that includes an object metadata processor and renderer, which calculates and adjusts audio object positions based on screen size and shape metadata, allowing for flexible rendering of audio objects on various screen configurations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If space warping processing is applied to adapt audio playback to screen size changes, then audio-visual coherence is improved, but the system becomes limited to HOA signals and cannot handle non-centered screens
Solution Approach 1:
The patent changes the fundamental parameters of the approach by transitioning from space warping in the sound field domain to individual audio object position remapping in the angular domain. This allows independent control of each audio object's position based on screen size and centering parameters, enabling adaptation to non-centered screens while maintaining audio-visual coherence.
Solution Approach 2:
The patent segments the audio scene into individual audio objects, each with its own position metadata. This segmentation allows independent remapping of each object's position based on screen characteristics, rather than applying a global space warping transformation to the entire sound field. This enables flexible handling of different screen configurations including non-centered screens.
2Measurement precision
If camera and projection parameters are incorporated for accurate audio object positioning, then positioning accuracy is improved, but system complexity increases and availability of parameters decreases
Solution Approach 1:
The patent extracts only the essential parameters needed for audio object positioning - specifically screen size and screen centering information - from the full set of camera and projection parameters. This extraction approach maintains positioning accuracy for audio objects while significantly reducing system complexity and parameter availability requirements compared to incorporating complete camera and projection data.
3Ease of manufacture
If linear scaling of position parameters is applied for screen adaptation, then implementation simplicity is improved, but positioning accuracy deteriorates for non-centered screens
Solution Approach 1:
The patent introduces asymmetric remapping by incorporating screen centering parameters into the position calculation. Instead of simple uniform scaling, each audio object's position is remapped based on the screen's specific centering configuration, allowing accurate positioning on non-centered screens while maintaining relatively simple implementation through metadata processing.
Data Source
AI summary
An apparatus for generating loudspeaker signals includes an object metadata processor configured to receive metadata, to calculate a second position of the audio object depending on the first position of the audio object and on a size of a screen if the audio object is indicated in the metadata as being screen-related, to feed the first position of the audio object as the position information into the object renderer if the audio object is indicated in the metadata as being not screen-related, and to feed the second position of the audio object as the position information into the object renderer if the audio object is indicated in the metadata as being screen-related. The apparatus further includes an object renderer configured to receive an audio object and to generate the loudspeaker signals depending on the audio object and on position information.