Spatial Audio Reformatting for Multistream Prioritization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio rendering systems fail to effectively manage simultaneous presentation of multiple audio streams, making it difficult for listeners to differentiate between overlapping audio streams, particularly in stereo and multi-channel setups, and do not facilitate auditory multitasking effectively for both speaker and headphone use.
Innovation Solution
An audio rendering method and system that dynamically processes audio signals by panning and mixing between playback channels, allowing a higher-priority audio stream to be rendered in the foreground while maintaining the current audio stream in the background, using spatial reformatting techniques such as cross-fading and Vector Based Amplitude Panning, applicable to both loudspeakers and virtualized audio channels.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If audio signals are mixed together to allow simultaneous playback of multiple audio streams, then auditory multitasking capability is improved, but listener ability to differentiate between overlapping streams deteriorates
Solution Approach 1:
The patent segments the audio playback space by dynamically assigning different audio streams to different spatial channels. When a new audio stream arrives, the system segments the playback channels by panning the existing stream to less critical channels (e.g., rear channels) and assigning the new stream to primary channels (e.g., front center), thereby maintaining stream differentiation while enabling simultaneous playback of multiple streams
Solution Approach 2:
The patent utilizes the spatial dimension of multi-channel audio playback to resolve the contradiction. By employing Vector Based Amplitude Panning (VBAP) and spatial reformatting techniques, the system distributes audio streams across multiple spatial dimensions (front, rear, left, right channels), allowing listeners to differentiate streams through their spatial locations rather than frequency or temporal separation
2Device complexity
If simple replacement of audio signals is used to manage multiple streams, then device complexity is reduced, but adaptability to different playback scenarios deteriorates
Solution Approach 1:
The patent implements dynamic channel assignment and spatial reformatting that automatically adapts to different playback scenarios. The system dynamically pans audio signals between channels based on stream priority, listener position, and playback context, transitioning smoothly between different spatial configurations without requiring manual intervention or complex device reconfiguration
Solution Approach 2:
The patent changes the spatial parameters of audio signals using Vector Based Amplitude Panning (VBAP) coefficients to achieve different playback configurations. By adjusting the amplitude and phase parameters of signals across multiple channels, the system can adaptively manage different audio streams in various playback scenarios while maintaining a relatively simple device architecture
3Loss of information
If spatial reformatting is applied to prioritize one audio stream, then stream differentiation is improved, but audio signal processing complexity increases
Solution Approach 1:
The patent extracts and prioritizes specific audio streams by separating them from the mixed audio signal through spatial reformatting. When a high-priority stream arrives, the system extracts it from the spatial mix and assigns it to primary playback channels, while panning lower-priority streams to secondary channels, thereby achieving stream differentiation through relatively simple extraction and redistribution operations
Data Source
AI summary
A method and device are described to process an event on an audio rendering device. The method may comprise rendering a first audio stream via at least a first audio signal in a first audio playback channel and a second audio signal in a second audio playback channel and monitoring occurrence of the event with an associated second audio stream. Upon occurrence of the event, the first audio signal may be panned to the second audio playback channel, the first audio signal being mixed with the second audio signal in the second audio playback channel. The second audio stream is then rendered via the first audio playback channel.