Spatial Audio Processing Error Concealment for Dimensionality Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
When spatial audio captured in three dimensions is reduced to two dimensions for playback, errors and error margins can increase, leading to reduced audio quality due to errors spanning across axes like front-back or left-right.
Innovation Solution
An apparatus and method for processing spatial audio that involves obtaining three-dimensional parameters, determining ranges for direction parameters when reduced to two dimensions, and applying error concealment processing based on whether these ranges meet specific criteria to mitigate errors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If spatial audio is reduced from three dimensions to two dimensions for playback, then compatibility with playback devices is improved, but error margins increase and audio quality deteriorates
Solution Approach 1:
The patent applies preliminary action by determining error margins and identifying appropriate error concealment processes before the actual dimensionality reduction occurs. The system pre-calculates what errors might arise from reducing 3D parameters to 2D parameters, selects suitable concealment strategies in advance, and applies them during rendering. This proactive approach prevents quality deterioration rather than reacting to it after the fact.
Solution Approach 2:
The patent implements beforehand cushioning by introducing error concealment processing as a protective measure against the inevitable errors that occur during dimensionality reduction. Just as cushioning protects against future impacts, the error concealment processes (such as smoothing direction parameters or adjusting spatial metadata) protect the audio quality from the harmful effects of reduced dimensional representation.
2Reliability
If error concealment processing is applied to mitigate errors during dimensionality reduction, then audio quality is improved, but processing complexity increases
Solution Approach 1:
The patent applies parameter changes by modifying spatial audio parameters (such as direction parameters, spatial metadata, or directionality values) to compensate for errors introduced during dimensionality reduction. Instead of complex structural changes, the system adjusts existing parameters like smoothing direction over time or adjusting the direct-to-ambient ratio, which achieves quality improvement through relatively simple parameter modifications rather than complex processing architectures.
Data Source
AI summary
Examples of the disclosure relate to apparatus, methods and computer programs for processing spatial audio to reduce the effects of errors within the spatial audio. The apparatus can be configured to obtain spatial audio and associated one or more three-dimensional parameters wherein the one or more three-dimensional parameters comprise one or more direction parameters. The apparatus can also be configured to determine one or more ranges for direction parameters when the one or more three-dimensional parameters are reduced to two dimensions to obtain one or more two-dimensional parameters. The apparatus can also be configured to apply processing to the one or more two-dimensional parameters based on whether or not the one or more ranges in two dimensions are in accordance with one or more criteria.