Priority-Based Audio Decoding for Real-Time Multi-Channel Playback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current audio codecs, such as MPEG-D USAC, face challenges in reducing the calculation amount required for decoding, especially when dealing with a large number of channels and objects, making real-time decoding difficult on devices with limited calculation capability.

Innovation Solution

A decoding device and method that prioritize and selectively decode audio signals based on priority information, adjusting the calculation load by determining which channels and objects to decode fully or partially, using priority information generated from sound pressure and spectral shape, and applying gain adjustments to ensure efficient resource utilization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If all channels and objects are decoded to maintain audio quality, then audio reproduction quality is improved, but calculation amount increases making real-time decoding difficult on mobile devices

Engineering Contradiction:
Improveaudio reproduction qualityVSAvoiddecoding speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies partial action by selectively decoding only a subset of audio channels and objects based on priority information. Instead of decoding all 24 channels and multiple objects, the system decodes only those with priority degrees meeting a threshold, achieving acceptable audio quality with reduced calculation load suitable for mobile devices

Inventive Principle:
Principle #16Partial or excessive action

2Productivity

If priority-based selective decoding is implemented, then calculation amount is reduced, but audio reproduction quality may deteriorate

Engineering Contradiction:
Improvedecoding speedVSAvoidaudio reproduction quality
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent changes the parameter of priority degree assignment by generating multiple sets of priority information with different threshold values. This allows the system to adjust the balance between decoding speed and audio quality by selecting appropriate priority thresholds based on device capabilities and playback conditions

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If multiple sets of priority information are generated for different devices, then adaptability to various playback devices is improved, but encoding complexity increases

Engineering Contradiction:
Improvedevice compatibilityVSAvoidencoding complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by generating multiple sets of priority information during the encoding stage. This pre-computation allows the decoding device to simply select from pre-prepared priority sets based on its capabilities, avoiding complex real-time calculations and simplifying the decoding process while maintaining broad device compatibility

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3745397B1Decoding device and decoding method, and program
Publication Date: 2023.06.07 SONY GROUP CORP
  • EP3745397B1 patent drawingFigure 1
  • EP3745397B1 patent drawingFigure 2
  • EP3745397B1 patent drawingFigure 3

AI summary

There is provided a decoding device including at least one circuit configured to acquire one or more encoded audio signals including a plurality of channels and/or a plurality of objects and priority information for each of the plurality of channels and/or the plurality of objects, and to decode the one or more encoded audio signals according to the priority information.