Priority-Based Audio Decoding for Real-Time Multi-Channel Playback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current audio codecs, such as MPEG-D USAC, face challenges in reducing the calculation amount required for decoding, especially when dealing with a large number of channels and objects, leading to difficulties in real-time decoding on devices with limited calculation capabilities.
Innovation Solution
A decoding device and method that prioritize and selectively decode audio signals based on priority information, adjusting the calculation burden by determining which channels and objects to decode fully or partially, depending on the device's capability, and using priority information generated from sound pressure and spectral shape to optimize decoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If all channels and objects are decoded to maintain audio quality, then sound quality is preserved, but calculation load increases making real-time decoding difficult on mobile devices
Solution Approach 1:
The patent segments the audio signal into multiple channels and objects, assigning priority levels to each. This allows the decoding device to selectively decode only those channels and objects with high priority, rather than decoding all channels and objects equally. By dividing the audio content into prioritized segments, the system reduces calculation load while preserving essential audio quality.
Solution Approach 2:
The patent applies local quality by differentiating the decoding quality across different channels and objects based on their priority. High-priority channels and objects are decoded with full quality, while low-priority ones are decoded with reduced quality or skipped entirely. This selective approach maintains overall audio quality for important content while reducing the total calculation burden.
2Adaptability or versatility
If the number of channels and objects is increased to enhance sense of presence, then audio immersion is improved, but decoding complexity increases beyond real-time capability
Solution Approach 1:
The patent introduces dynamic adaptability by allowing the decoding device to adjust the number and priority of channels and objects based on its real-time calculation capability. The system can dynamically select which channels and objects to decode, enabling mobile devices with limited resources to handle complex multi-channel audio configurations without being overwhelmed by constant high complexity.
Solution Approach 2:
The patent applies partial action by decoding only a subset of the total channels and objects based on priority and device capability. Rather than attempting to decode all channels and objects simultaneously (which would exceed real-time processing limits), the system performs partial decoding of the most important audio elements, achieving acceptable audio immersion with reduced computational demands.
3Power
If priority information is used to selectively decode channels and objects, then calculation load is reduced, but audio signal completeness may be compromised
Solution Approach 1:
The patent applies preliminary action by pre-assigning priority information to each channel and object during the encoding phase. This advance preparation allows the decoding device to quickly identify which channels and objects are most important without needing to analyze the audio content in real-time, enabling efficient selective decoding while maintaining audio signal completeness for high-priority elements.
Solution Approach 2:
The patent uses feedback by transmitting priority information along with the encoded audio data. This feedback mechanism provides the decoding device with guidance on which channels and objects to prioritize, ensuring that the most important audio information is preserved even when selective decoding is applied to reduce calculation load.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
There is provided a decoding device including at least one circuit configured to acquire one or more encoded audio signals including a plurality of channels and/or a plurality of objects and priority information for each of the plurality of channels and/or the plurality of objects, and to decode the one or more encoded audio signals according to the priority information.