Sink Device Audio Object Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current audio processing systems require source devices to decode, modify, and reencode audio streams for sink devices, which is inefficient for user-interactivity such as volume adjustments or adding/removing audio objects, as these tasks are better handled by the sink device.
Innovation Solution
A method and apparatus that allow sink devices to receive and process object-based audio signals with user-selected commands, enabling real-time modification and rendering of audio objects within the audio stream, such as volume adjustments, spatial relocation, or addition/removal of audio objects, directly within the sink device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the source device decodes and recodes the audio stream to modify it, then the audio stream can be modified (e.g., volume adjustment, adding/removing audio objects), but the processing complexity and computational burden on the source device increases
Solution Approach 1:
The patent extracts the audio modification functions from the source device and relocates them to the sink device. The source device sends the encoded audio stream and metadata to the sink device, which then performs the decoding, modification, and rendering operations. This extraction resolves the contradiction by maintaining audio modification capability while reducing source device processing complexity.
Solution Approach 2:
The patent inverts the traditional audio processing architecture where the source device performs all processing. Instead, the sink device becomes the active processing unit that receives encoded streams and performs modifications locally. This inversion allows the source device to focus on encoding while the sink device handles the computationally intensive modification tasks.
2Ease of operation
If the source device decodes and recodes the audio stream for modification, then audio objects can be modified in real-time, but the processing time and latency increase
Solution Approach 1:
The patent applies preliminary action by having the source device prepare and send all necessary audio objects and metadata in advance to the sink device. The sink device then has the audio data ready for immediate modification when user commands are received, eliminating the need for real-time decoding and recoding operations that would cause latency.
3Reliability
If the source device performs all audio processing, then audio quality can be maintained, but the computational burden and energy consumption on the source device increases
Solution Approach 1:
The patent extracts the computationally intensive decoding and rendering operations from the source device and relocates them to the sink device. The source device focuses on efficient encoding and metadata generation, while the sink device handles the energy-intensive processing tasks. This distribution maintains audio quality while significantly reducing source device energy consumption.
Data Source
AI summary
A method and apparatus for processing object-based audio signals for reproduction through a playback system is provided. The apparatus receives a plurality of object-based audio signals in at least one audio frame. In addition, the apparatus receives at least one audio object command associated with at least one object-based audio signal of the plurality of object-based audio signals. In addition, the apparatus processes the at least one object-based audio signal based on the received at least one audio object command. Further, the apparatus renders a set of object-based audio signals of the plurality of object-based audio signals to a set of output signals based on the at least one audio object command. The at least one audio frame may be received from one of a set top box, an OD player, or a television. The apparatus may be an AV receiver or a television.