Virtual Speaker Selection for Seamless HOA Spatial Transitions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In three-dimensional audio encoding and decoding, adjacent frames of HOA signals often result in spatial jumps due to differing virtual speaker positions, leading to discontinuities in the sound experience.
Innovation Solution
A method to determine M target virtual speakers by analyzing attribute information of N first and N second virtual speakers, ensuring smooth transitions by interpolating elevations and azimuths between frames, using a virtual speaker determining apparatus to encode and decode HOA signals effectively.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a virtual speaker matching the HOA coefficient of the current frame is selected from the virtual speaker set, then the current frame of HOA signal is converted into a virtual speaker signal to reduce the quantity of channels and improve encoding and decoding efficiency, but the positions of target virtual speakers corresponding to two adjacent frames may be different, causing spatial jumps in the decoded sound
Solution Approach 1:
The patent determines M candidate target virtual speakers in advance by comparing attribute information (elevation and azimuth) with the previous frame's target virtual speaker, before final selection. This preliminary filtering ensures that the ultimately selected virtual speaker maintains spatial continuity with the previous frame, preventing spatial jumps while preserving encoding efficiency.
Solution Approach 2:
The patent introduces parameter constraints on elevation and azimuth differences between adjacent frames. By limiting the change in these spatial parameters, the system ensures smooth transitions between frames while still allowing flexibility in virtual speaker selection, thus maintaining both encoding efficiency and spatial continuity.
2Productivity
If the target virtual speaker is determined solely based on matching the HOA coefficient of the current frame, then the encoding and decoding efficiency is improved, but the attribute information of the target virtual speaker may be greatly different from the previous frame, causing spatial jumps
Solution Approach 1:
The patent uses the attribute information (elevation and azimuth) of the previous frame's target virtual speaker as feedback to constrain the selection of the current frame's target virtual speaker. By comparing and limiting the difference in these attributes, the system ensures spatial consistency across frames while maintaining encoding efficiency through selective candidate filtering.
Solution Approach 2:
The patent dynamically adjusts the selection criteria for target virtual speakers by considering both the current frame's HOA coefficient matching requirements and the previous frame's spatial attributes. This dynamic balance allows the system to adapt to changing audio scenarios while maintaining spatial continuity, preventing spatial jumps.
Data Source
AI summary
This application discloses a virtual speaker determining method and a related apparatus. The method includes: obtaining attribute information of N first virtual speakers, obtaining attribute information of N second virtual speakers, and determining M target virtual speakers based on the attribute information of the N first virtual speakers and the attribute information of the N second virtual speakers. The target virtual speaker processes a target group of HOA signals, the second virtual speaker processes a reference group of HOA signals, and the first virtual speaker is a virtual speaker that the target group of HOA signals matches. The target virtual speaker is determined based on the attribute information of the second virtual speaker and the attribute information of the first virtual speaker, so that it can be ensured that attribute information of the target virtual speaker is not greatly different from the attribute information of the second virtual speaker.