Audio Spatialization Parameter Estimation for Real-Time Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies for rendering audio signals stereoscopically require pre-processing parameters, which is not feasible for broadcast signals or real-time streamed audio, making it difficult to output audio signals realistically with video signals without receiving these parameters from an encoder.
Innovation Solution
An electronic apparatus that obtains parameters related to audio object spatialization, generates rendering information using a lookup table, and estimates information using statistical, machine learning, or regression models to render audio objects as three-dimensional sound, even without pre-received parameters, by considering object, electronic apparatus, and user parameters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If pre-processing parameters are obtained from encoder for stereoscopic audio rendering, then audio spatialization accuracy is improved, but system complexity and real-time processing capability deteriorate
Solution Approach 1:
The decoder performs self-service by autonomously generating spatialization parameters from the decoded audio signal itself, rather than relying on external pre-processing parameters from the encoder. The system extracts spatial information directly from the audio content and uses it to configure the rendering process, making the system independent of encoder pre-processing capabilities.
Solution Approach 2:
The patent introduces an intermediary parameter generation module that acts as a bridge between the decoded audio signal and the rendering engine. This intermediary component analyzes the audio signal characteristics and generates appropriate spatialization parameters on-the-fly, mediating between the audio data and the rendering process without requiring external parameter input.
2Manufacturing precision
If pre-processing parameters are obtained from encoder for stereoscopic audio rendering, then audio rendering quality is improved, but real-time processing capability deteriorates
Solution Approach 1:
The system performs preliminary analysis of audio signal characteristics during the decoding phase itself, extracting spatialization parameters directly from the decoded signal before rendering. This preliminary action eliminates the need for separate pre-processing steps at the encoder, enabling real-time processing while maintaining rendering quality.
Solution Approach 2:
The patent dynamically changes spatialization parameters based on real-time analysis of audio signal characteristics. Instead of using fixed pre-determined parameters, the system continuously adjusts parameters such as spatial position, spread, and depth based on the actual audio content being processed, enabling adaptive real-time rendering.
3Measurement precision
If multiple parameters are considered for audio spatialization, then rendering accuracy is improved, but processing complexity increases
Solution Approach 1:
The patent segments the spatialization parameter generation process into distinct functional modules: audio signal analysis, spatial characteristic extraction, parameter calculation, and rendering configuration. Each module handles a specific aspect of the process, reducing overall complexity while considering multiple parameters for accurate spatialization.
Data Source
AI summary
A method of an electronic apparatus for audio signal processing includes obtaining a parameter related to spatialization of an audio object, obtaining rendering information based on the parameter related to spatialization, and rendering the audio object based on the rendering information. The parameter related to spatialization includes at least one of an object parameter of a feature of at least one of the audio object or a video object associated with the audio object, an electronic apparatus parameter of a feature of the electronic apparatus, or a user parameter of a feature of a user.