3D Audio Metadata Embedding in AAC and MP3 Bitstreams

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional audio encoding technologies like AAC and MP3 are not capable of directly encoding and transmitting 3D Audio metadata, which is necessary for reproducing three-dimensional audio, leading to compatibility issues when trying to use these standards for 3D Audio.

Innovation Solution

The solution involves storing 3D Audio metadata in an ancillary data area of the encoded bit stream, using existing encoding techniques such as AAC and MP3, and employing methods like thinning processing and channel mapping to ensure compatibility, allowing for the transmission and reproduction of 3D Audio even if the decoding device does not support it.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional audio encoding standards (AAC, MP3) are used, then compatibility with existing systems is maintained, but the ability to encode and transmit 3D Audio metadata is lost

Engineering Contradiction:
Improve3D Audio metadata encoding capabilityVSAvoidcompatibility with conventional standards
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent introduces an ancillary data area as an intermediary component that carries 3D Audio metadata within the conventional audio bitstream. This mediator allows 3D metadata to coexist with standard audio data without disrupting existing encoding/decoding processes, thereby maintaining compatibility while enabling extended functionality.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The audio bitstream structure is enhanced to serve multiple functions: it simultaneously carries conventional audio data for standard playback and embedded 3D Audio metadata for spatial audio reproduction. This multi-functionality allows a single encoding system to support both traditional and advanced audio formats.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If 3D Audio metadata is embedded in the ancillary data area, then 3D Audio transmission is enabled, but the data structure becomes more complex

Engineering Contradiction:
Improve3D Audio transmission capabilityVSAvoidbitstream structure complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The bitstream is segmented into distinct functional areas: the main audio data portion and the ancillary data area for 3D metadata. This segmentation allows independent processing of standard audio and 3D metadata, reducing the complexity burden on decoding devices while preserving full 3D audio functionality.

Inventive Principle:
Principle #1Segmentation

3Productivity

If thinning processing is applied to 3D Audio metadata, then data transmission efficiency is improved, but metadata precision is reduced

Engineering Contradiction:
Improvedata transmission efficiencyVSAvoidmetadata precision
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies partial action by selectively transmitting only essential 3D Audio metadata parameters through the ancillary data area, while optional or less critical metadata can be omitted or transmitted with lower precision. This approach achieves adequate 3D audio reproduction with improved transmission efficiency.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP3693961B1Encoding device and method, decoding device and method, and program
Publication Date: 2024.06.12 SONY GROUP CORP
  • EP3693961B1 patent drawingFigure 1
  • EP3693961B1 patent drawingFigure 2
  • EP3693961B1 patent drawingFigure 3

AI summary

The present technology relates to an encoding device and method, a decoding device and method, and a program, which are adapted to be capable of improving convenience. The decoding device is provided with: a decoding unit that decodes audio data including an object audio, the audio data being included in an encoded bit stream, and reads metadata of the object audio from an area in which arbitrary data of the encoded bit stream can be stored; and an output unit that outputs the decoded audio data on the basis of the metadata. The present technology can be applied to the decoding device.