3D Audio Upmixing Reduces Storage and Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The implementation of 3D audio technologies is limited by high computational requirements, which can hinder scalability and real-time performance in applications like video games and virtual reality.
Innovation Solution
A computer-implemented method for processing 3D audio that involves obtaining a first ambisonic signal and upmixing it to derive a second ambisonic signal with higher quality and spatial resolution, using a trained machine learning model, while minimizing storage and processing demands.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a higher quality ambisonic signal is used for 3D audio playback, then the audio quality and spatial resolution are improved, but the storage requirements and processing power increase
Solution Approach 1:
The patent creates a lower-quality copy (first ambisonic signal) for storage purposes, which can then be upmixed to generate the higher-quality version (second ambisonic signal) during playback. This copying approach allows the system to store less data while still being able to produce high-quality output when needed.
Solution Approach 2:
The patent performs preliminary downmixing to create the first ambisonic signal for storage, so that during playback the upmixing process can reconstruct the higher-quality second ambisonic signal. This preliminary action separates the storage function from the playback function, allowing optimized quality at each stage.
2Measurement precision
If a higher quality ambisonic signal is used for 3D audio playback, then the audio quality and spatial resolution are improved, but the processing power requirements increase
Solution Approach 1:
The patent performs the computationally intensive processing in advance during the downmixing stage to create the first ambisonic signal, so that during playback only the lighter upmixing operation is needed. This preliminary action shifts the processing burden to a different stage where resources may be more abundant.
Solution Approach 2:
By creating and storing a simplified copy (first ambisonic signal) rather than the full-quality version, the patent reduces the processing power needed for storage and retrieval operations, while still enabling high-quality playback through upmixing when the full processing resources are available.
3Reliability
If traditional 3D audio techniques are implemented, then immersive audio experience is achieved, but computational intensity and resource requirements increase
Solution Approach 1:
The patent creates a simplified copy (first ambisonic signal) that captures the essential spatial information in a more compact form, reducing computational requirements while preserving the ability to deliver immersive audio experiences through subsequent upmixing to the second ambisonic signal.
Solution Approach 2:
The patent segments the audio processing into two distinct stages: downmixing to create the first ambisonic signal for storage, and upmixing to generate the second ambisonic signal for playback. This segmentation allows each stage to be optimized independently, reducing overall computational complexity.
Data Source
AI summary
A computer-implemented method for processing 3D audio, the method comprising: there is provided a computer-implemented method for processing 3D audio, the method comprising: obtaining a first ambisonic signal representing a sound; and upmixing the first ambisonic signal to derive a second ambisonic signal representing the sound; wherein the second ambisonic signal is a higher quality representation of the sound than the first ambisonic signal. This reduces the storage and processing requirements of providing high quality 3D audio.