3D Audio Coding With Correlation-Based Speaker Reuse
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The high calculation complexity of compression coding on three-dimensional audio signals due to the large amount of data and the need for high bandwidth in transmitting these signals is a significant challenge.
Innovation Solution
A method and apparatus that reduce calculation complexity by reusing a representative virtual speaker set for encoding subsequent frames based on correlation analysis, and selecting representative virtual speakers using a vote-based approach to minimize the search for optimal speakers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the encoder traverses virtual speakers in a candidate virtual speaker set to compress the three-dimensional audio signal, then the sound quality is ensured, but the calculation complexity is high
Solution Approach 1:
The patent applies preliminary action by determining in advance whether the representative virtual speaker set from the previous frame can be reused for the current frame through correlation calculation. This preliminary determination avoids the need to traverse all candidate virtual speakers when conditions permit, thereby reducing calculation complexity while maintaining sound quality through selective reuse of previously optimized speaker configurations
Solution Approach 2:
The patent implements partial action by performing complete virtual speaker traversal only when necessary (when correlation threshold is not met), and using partial action (correlation-based reuse decision) when conditions allow. This selective approach applies the full traversal process partially, reducing overall calculation complexity while ensuring sound quality is maintained when full traversal is performed
2Device complexity
If the encoder reuses the representative virtual speaker set from the previous frame, then the calculation complexity is reduced, but the sound image stability may be affected
Solution Approach 1:
The patent applies feedback by using the correlation between the current frame and the representative virtual speaker set from the previous frame as a decision criterion. This feedback mechanism ensures that reuse only occurs when the acoustic environment has not changed significantly, thereby maintaining sound image stability while reducing calculation complexity through conditional reuse based on environmental feedback
Solution Approach 2:
The patent implements dynamics by making the virtual speaker selection process adaptive rather than static. The system dynamically adjusts between reuse and re-traversal modes based on the calculated correlation value, allowing flexibility to maintain sound image stability when conditions warrant reuse while enabling updates when the environment changes, thus balancing stability with adaptability
3Measurement precision
If the encoder performs full traversal of candidate virtual speakers for each frame, then the orientation accuracy is improved, but the processing time increases
Solution Approach 1:
The patent applies preliminary action by performing a correlation-based preliminary check before full traversal. This preliminary action quickly determines whether the previous frame's representative virtual speaker set is still suitable for the current frame, avoiding unnecessary full traversals and thereby reducing processing time while maintaining orientation accuracy when the preliminary check indicates stability
Solution Approach 2:
The patent implements partial action by performing complete virtual speaker traversal only when necessary (when correlation threshold is not met), and using partial action (correlation-based reuse decision) when conditions allow. This selective approach applies the full traversal process partially, reducing overall processing time while ensuring orientation accuracy is maintained when full traversal is performed
Data Source
AI summary
A three-dimensional audio signal coding method, apparatus, and encoder are described. The method includes, after obtaining a first correlation between a current frame of a three-dimensional audio signal and a representative virtual speaker set for a previous frame, the encoder determines whether the first correlation satisfies a reuse condition, where the first correlation is used to determine whether to reuse the representative virtual speaker set for the previous frame when the current frame is encoded. The method further encodes the current frame based on the representative virtual speaker set for the previous frame when the first correlation satisfies the reuse condition, to obtain a bitstream. A virtual speaker in the representative virtual speaker set for the previous frame is a virtual speaker used for encoding the previous frame of the three-dimensional audio signal.