Audio Rendering Matrix Discontinuity Compensation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The complexity and financial and computational costs of rendering audio programs increase with the number of channels, particularly in object-based audio programs, which require accurate spatial playback of audio objects across multiple speakers, leading to discontinuities when rendering matrices are updated, resulting in artifacts like zipper noise.
Innovation Solution
Applying discontinuity correction values to audio samples by modifying the rendering matrix updates, ensuring smooth transitions and reducing perceptible discontinuities through the use of augmented rendering matrices that include correction signals, thereby compensating for matrix updates and maintaining artistic intent.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If rendering matrices are updated frequently to improve spatial accuracy of audio objects, then spatial playback precision is improved, but discontinuities and artifacts (zipper noise) increase
Solution Approach 1:
The patent applies preliminary action by computing discontinuity correction values in advance during the matrix update process. Before applying a new rendering matrix, the system calculates the difference between consecutive matrices and pre-computes correction values that will be applied to audio samples. This preliminary computation ensures that when the matrix update occurs, the discontinuities are already compensated, preventing artifacts like zipper noise while maintaining high spatial accuracy.
2Measurement precision
If the number of channels is increased to improve spatial audio rendering quality, then spatial playback precision is improved, but computational cost and complexity increase
Solution Approach 1:
The patent applies parameter changes by transforming the rendering process from direct large-scale matrix multiplication to a corrected incremental update approach. Instead of computing full rendering matrices for all channels at high rates, the system changes the parameter of matrix update frequency and applies correction values that account for the differences. This parameter transformation maintains spatial precision for multichannel audio while reducing the computational burden of frequent full matrix applications.
3Adaptability or versatility
If rendering matrices are updated to adapt to changing spatial positions, then adaptability is improved, but discontinuities occur at update transitions
Solution Approach 1:
The patent applies continuity of useful action by ensuring that the rendering process maintains continuous audio output despite discrete matrix updates. The system computes discontinuity correction values that bridge the gap between consecutive rendering matrices, applying these corrections to audio samples during the transition. This maintains the continuity of the audio signal while allowing the rendering matrix to adapt to changing spatial positions of audio objects.
4Reliability
If discontinuity correction is applied to reduce artifacts, then audio quality is improved, but processing steps increase
Solution Approach 1:
The patent applies the intermediary principle by introducing discontinuity correction values as a mediating element between consecutive rendering matrices. These correction values act as an intermediary that compensates for the discontinuities introduced by matrix updates. Rather than fundamentally changing the matrix update process or adding complex processing steps, the correction values serve as a simple intermediary layer that maintains audio quality while working within the existing rendering framework.
Data Source
AI summary
Methods for generating encoded audio programs indicative of N channels of discontinuity-corrected, encoded audio content, including by applying discontinuity correction values to multi-channel audio content, and for rendering such a program (e.g., to generate a discontinuity-corrected M-channel mix of content indicated by the program). Other aspects are systems or devices (e.g., encoders or decoders, or rendering systems) configured to implement any of the methods.