Screen-Related Audio Object Remapping for Non-Centered Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio object remapping technologies are limited in their ability to adapt audio object positions to changes in screen size and shape, particularly for non-centered screens, and often require complex incorporation of camera and projection parameters, which are not always available.
Innovation Solution
An apparatus and method for audio object remapping that includes an object metadata processor and renderer, which calculates and adjusts audio object positions based on screen size and shape metadata, allowing for flexible rendering of audio objects on various screen layouts.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If audio object positions are adapted to screen size changes using conventional space warping processing, then audio-visual coherence is maintained for centered screens, but the solution becomes inapplicable for non-centered screens and requires complex camera and projection parameters that are not always available
Solution Approach 1:
The patent extracts the essential function of screen-related audio object adaptation from the complex camera and projection parameter framework. By identifying that only screen size and center position information is actually needed for audio object remapping, the solution removes the unnecessary complexity of full camera and projection parameter incorporation while maintaining the core adaptability function.
Solution Approach 2:
Instead of adapting audio objects to match camera and projection parameters (the conventional approach), the patent inverts the problem by directly calculating audio object positions based on screen geometry parameters. This inversion simplifies the solution by working backwards from the desired outcome (audio-visual coherence) to the minimal necessary inputs (screen size and center).
2Manufacturing precision
If conventional space warping processing is used for audio object remapping, then audio coherence is maintained for centered screens, but the solution fails to provide accurate rendering for non-centered screens
Solution Approach 1:
The patent applies local quality by treating centered and non-centered screens differently through the screenCenterParameter. For centered screens, the conventional approach suffices, but for non-centered screens, the patent introduces a specific offset correction mechanism. This localized adaptation ensures high precision for each screen type without requiring a completely different solution for each case.
Solution Approach 2:
The solution introduces dynamic adaptability by making the audio object remapping process responsive to the screenCenterParameter. The system automatically adjusts its behavior based on whether the screen is centered or non-centered, enabling the same apparatus to handle both cases with appropriate precision through conditional logic that activates different calculation paths.
3Measurement precision
If camera and projection parameters are incorporated into the remapping process, then accurate audio object positioning can be achieved, but the system complexity increases and parameters are not always available
Solution Approach 1:
The patent extracts only the essential parameters needed for accurate audio object positioning: screen size and screen center position. By taking out just these critical elements from the full set of camera and projection parameters, the solution maintains measurement precision while dramatically improving ease of operation, as these minimal parameters are always available in typical audio-visual systems.
Solution Approach 2:
The system performs self-service by using screen geometry parameters that are inherently available in the audio-visual system without requiring external camera or projection data. The apparatus automatically determines audio object positions using only the screen configuration information that is already present in the system, eliminating the need for additional parameter input or complex external data acquisition.
Data Source
AI summary
An apparatus for generating loudspeaker signals includes an object metadata processor configured to receive metadata, to calculate a second position of the audio object depending on the first position of the audio object and on a size of a screen if the audio object is indicated in the metadata as being screen-related, to feed the first position of the audio object as the position information into the object renderer if the audio object is indicated in the metadata as being not screen-related, and to feed the second position of the audio object as the position information into the object renderer if the audio object is indicated in the metadata as being screen-related. The apparatus further includes an object renderer configured to receive an audio object and to generate the loudspeaker signals depending on the audio object and on position information.