Audio Downmix Decoding Using Speaker Arrangement Metadata

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current multi-channel audio encoding techniques, such as MPEG-2AAC and MPEG-4AAC, struggle to provide high-quality realistic sound by not adequately addressing channel extension in the vertical direction, leading to limitations in reproducing sound with extended channel configurations like 6.1 or 7.1 channels.

Innovation Solution

The proposed solution involves a decoding and encoding method that includes processing units capable of reading and utilizing extended information within the encoded bit stream to downmix audio data, adjusting gain values, and determining coefficients for optimal channel mixing, allowing for the reproduction of audio with extended channel configurations by incorporating speaker arrangement information in the vertical plane.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multi-channel audio encoding is performed using existing standards (MPEG-2AAC, MPEG-4AAC), then encoding compatibility is maintained, but the ability to reproduce high-quality realistic sound with extended channel configurations is limited

Engineering Contradiction:
Improveencoding compatibilityVSAvoidsound quality
Core Design Contradiction:
ReliabilityVSManufacturing precision

Solution Approach 1:

The patent extends the audio channel configuration from traditional horizontal plane arrangements (5.1 channels) to include vertical dimension channels, creating a three-dimensional spatial audio configuration. This allows speakers to be arranged not only left-right-front-back but also at different heights, enabling immersive sound reproduction that encompasses the listener from multiple spatial dimensions.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent creates a universal audio encoding system that can handle both traditional 5.1 channel configurations and extended configurations (6.1, 7.1, and beyond) through a unified framework. The system maintains backward compatibility with existing standards while incorporating new channel arrangements, allowing the same encoding system to serve multiple channel configurations and reproduction scenarios.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Manufacturing precision

If channel configuration is extended beyond 5.1 channels to achieve realistic sound, then sound quality is improved, but compatibility with existing encoding standards deteriorates

Engineering Contradiction:
Improvesound qualityVSAvoidstandard compatibility
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent performs preliminary encoding of audio signals for extended channel configurations into a standardized bit stream format that embeds configuration information. By pre-encoding the spatial arrangement and channel mapping data into the bit stream, the system enables downstream devices to correctly interpret and reproduce the extended channel configuration without requiring changes to existing decoding standards.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary encoding layer that translates extended channel configurations into a compatible bit stream format. This intermediary process acts as a bridge between the new extended channel requirements and existing decoding infrastructure, allowing extended configurations to be transmitted through standard channels and decoded by conventional devices with appropriate extensions.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If speaker arrangement information in vertical plane is incorporated, then realistic sound reproduction is enhanced, but device complexity increases

Engineering Contradiction:
Improvesound reproduction qualityVSAvoidencoding system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent extends the parameter set for speaker arrangement by adding vertical position parameters to the traditional horizontal plane coordinates. Instead of only specifying left-right and front-back positions, the system now includes height/elevation parameters, transforming the spatial description from two-dimensional to three-dimensional while maintaining a consistent mathematical framework for position specification.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10304466B2Decoding device, decoding method, encoding device, encoding method, and program with downmixing of decoded audio data
Publication Date: 2019.05.28 SONY GROUP CORP
  • US10304466B2 patent drawing
  • US10304466B2 patent drawing
  • US10304466B2 patent drawing

AI summary

The present technique relates to a decoding device, a decoding method, an encoding device, an encoding method, and a program which can obtain a high-quality realistic sound.The encoding device stores speaker arrangement information in a comment region in a PCE of an encoded bit stream and stores a synchronous word and identification information in the comment region such that other public comments and the speaker arrangement information stored in the comment region can be distinguished from each other. When an encoded bit stream is decoded, it is determined whether the speaker arrangement information is stored on the basis of the synchronous word and the identification information stored in the comment region. Audio data included in the encoded bit stream is output according to the arrangement of the speakers corresponding to the determination result. The present technique can be applied to an encoding device.