Scene Audio Decoding with Embedded Metadata for Faster Binaural Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing immersive audio technologies for extended reality (XR) applications require significant time to obtain metadata for rendering binaural audio signals, leading to inefficiencies and suboptimal user experiences.
Innovation Solution
A decoding method that includes encoding scene audio signals with metadata, allowing the decoder to parse and utilize this metadata directly, reducing the need for local generation and improving rendering efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If metadata is obtained from another electronic device or locally generated, then the decoder can acquire necessary rendering information, but the time required to obtain binaural rendered signals increases
Solution Approach 1:
The encoder pre-processes and embeds metadata directly into the bitstream during the encoding phase. This preliminary action eliminates the need for the decoder to perform time-consuming operations such as obtaining metadata from external devices or generating it locally, thereby reducing the time required to obtain binaural rendered signals and improving rendering efficiency
2Productivity
If metadata is embedded in the bitstream, then the decoder can directly parse and use it, but the bitstream size increases
Solution Approach 1:
The patent extracts only the essential metadata required for rendering (such as scene description, microphone positions, and audio signal parameters) and embeds only these critical elements into the bitstream. This selective extraction approach ensures that the decoder can directly parse and use the metadata efficiently while minimizing the increase in bitstream size by excluding redundant information
Data Source
AI summary
A decoding method and an electronic device are provided. The method includes: first receiving a bitstream; parsing the bitstream to obtain metadata of a scene audio signal; and obtaining a reconstructed audio signal of the scene audio signal based on the bitstream, where the scene audio signal describes a sound field of a sound source in a scene including a plurality of microphones, the metadata includes first metadata used in combination with a distance between two of the plurality of microphones to determine a virtual loudspeaker radius, the virtual loudspeaker radius and a virtual loudspeaker signal are used for rendering to obtain a rendered audio signal, and the virtual loudspeaker signal is generated based on the reconstructed audio signal.