Multi-Device Spatial Audio Processing With Reduced Head Orientations
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Spatial audio processing is complex and requires significant computational resources due to the need for head-tracking and rendering adjustments, especially in split-rendering systems with multiple devices, leading to inefficiencies and potential duplication of processing.
Innovation Solution
A system determines a reduced set of reference head orientations based on user head orientations from multiple devices, processing audio signals and metadata for these orientations, and transmits them to devices for localized rendering adjustments, reducing overall processing requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If spatial audio processing is performed for each device individually with full head-tracking and rendering adjustments, then audio quality and spatial accuracy are improved, but computational resources and processing complexity increase significantly
Solution Approach 1:
The patent merges processing requests from multiple devices by determining a reduced set of reference head orientations that represent multiple user head orientations. Instead of processing spatial audio separately for each device, the system combines similar requests and processes a consolidated set of reference orientations, reducing computational complexity while maintaining spatial audio accuracy for all devices.
Solution Approach 2:
The system creates universal reference head orientations that serve multiple devices simultaneously. A single reference head orientation can be used by multiple devices with similar user head orientations, making the processing system multi-functional and reducing the overall number of processing operations required while maintaining accuracy for all served devices.
2Measurement precision
If spatial audio processing is performed for each device individually, then spatial audio accuracy is improved, but processing time and latency increase
Solution Approach 1:
The patent merges processing operations by combining multiple device requests into a reduced set of reference head orientations. This consolidation reduces the total number of spatial audio processing operations required, thereby reducing processing time and latency while still providing accurate spatial audio to all devices through the shared reference orientations.
3Measurement precision
If the number of reference head orientations is increased to match the number of devices, then spatial audio accuracy for each device is improved, but the number of audio signal and metadata transmissions increases
Solution Approach 1:
The patent merges multiple device requests into a reduced set of reference head orientations (where N < M). This consolidation reduces the number of spatial audio signals and metadata sets that need to be transmitted from the server, as multiple devices can share the same reference orientation data, thereby reducing transmission quantity while maintaining accuracy.
Solution Approach 2:
The reference head orientations are designed to be universal, serving multiple devices simultaneously. A single reference head orientation and its associated spatial audio signal can be transmitted once and then used by multiple devices, making the transmission system multi-functional and reducing the total number of transmissions required.
4Measurement precision
If spatial audio processing is performed for each device individually, then device-specific audio quality is improved, but energy consumption increases
Solution Approach 1:
The patent merges processing operations by determining a reduced set of reference head orientations that represent multiple devices. This consolidation reduces the total computational energy required, as the server performs fewer spatial audio processing operations while still providing device-specific accuracy through the shared reference orientations.
Data Source
Figure 1
Figure 2~4
Figure 5
AI summary
Example embodiments relating to audio signal processing are disclosed. For example, a method may comprise receiving an audio signal, and receiving, from a plurality M of devices, respective requests for a spatial audio signal, wherein the respective requests indicate respective user head orientations. The method may further comprise determining a plurality N of reference head orientations, wherein N < M and processing the received audio signal to obtain a plurality of spatial audio signals respectively associated with the plurality N of reference head orientations and a plurality of sets of metadata respectively associated with the plurality of spatial audio signals. The method may further comprise transmitting, to at least one of the devices, a selected spatial audio signal and associated metadata, wherein the selection is based on which reference head orientation is most closely associated with the user head orientation indicated in the request from the at least one device.