Scene Audio Metadata Encoding for Faster Binaural Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing immersive audio technologies for extended reality (XR) applications require significant time to obtain metadata for binaural rendering, leading to inefficiencies and reduced user experience.
Innovation Solution
An encoding method that writes scene audio signal metadata into a bitstream, allowing the decoder to bypass local generation, thereby reducing the time needed for rendering and improving efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If the decoder locally generates metadata of the scene audio signal, then the rendering process can be completed, but the time required for obtaining the binaural rendered signal increases
Solution Approach 1:
The encoder generates and embeds the metadata of the scene audio signal into the bitstream in advance, before the decoding process. This preliminary action eliminates the need for the decoder to generate metadata locally, directly reducing the time required for obtaining the binaural rendered signal and improving processing efficiency
2Ease of operation
If the decoder obtains metadata from another electronic device, then the rendering process can be completed, but the complexity of the system increases
Solution Approach 1:
The metadata generation function is merged into the encoder, which simultaneously encodes the scene audio signal and generates the metadata. This consolidation eliminates the need for separate metadata generation devices or complex inter-device communication protocols, simplifying the overall system architecture while maintaining ease of metadata acquisition
Data Source
AI summary
An encoding method and an electronic device are provided. The method includes obtaining a scene audio signal and metadata of the scene audio signal, where the metadata includes first metadata, the first metadata is used in combination with a distance between two of the plurality of microphones to determine a virtual loudspeaker radius, the virtual loudspeaker radius and a virtual loudspeaker signal are used for rendering to obtain a rendered audio signal, and the virtual loudspeaker signal is generated based on a reconstructed audio signal of the scene audio signal The method also includes encoding the scene audio signal and the metadata to obtain a bitstream.