Spatial Audio Rendering Using Real-Scene Acoustic Feature Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio processing methods for electronic devices result in spatial audio signals with low quality and diminished immersion due to discrepancies between the acoustic responses generated by computing technology and real-world environments.
Innovation Solution
An audio processing method that adjusts acoustic features in virtual scenes based on conversion information derived from real scenes, using techniques like acoustic feature extraction and modeling to generate spatial audio signals that more accurately replicate real-world acoustic experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If acoustic response is generated by using existing computing technology, then spatial audio signal can be rendered, but the acoustic response is different from real scene acoustic response resulting in low quality and diminished immersion
Solution Approach 1:
The patent applies parameter changes by adjusting acoustic features (such as reverberation time, clarity, and frequency response) of the virtual scene to match real scene characteristics. The system modifies acoustic parameters dynamically based on the relationship between virtual and real acoustic environments, thereby improving the accuracy of acoustic response while maintaining spatial audio rendering capability.
Solution Approach 2:
The patent uses copying by creating a virtual scene that replicates the acoustic characteristics of the real scene. By capturing and reproducing key acoustic features (impulse response, reverberation patterns, and spatial distribution) from the real environment into the virtual model, the system generates spatial audio signals that closely mimic real-world acoustic experiences, thus improving both accuracy and immersion.
2Productivity
If acoustic feature extraction is performed based on virtual scene parameters, then spatial audio signal can be generated, but the extracted acoustic features do not match real scene acoustic features
Solution Approach 1:
The patent implements feedback by continuously comparing the extracted acoustic features from the virtual scene with the actual acoustic features from the real scene. The system uses this comparison information to adjust and refine the virtual scene's acoustic parameters, creating a closed-loop optimization process that improves acoustic feature accuracy while maintaining efficient spatial audio generation.
Solution Approach 2:
The patent applies preliminary action by pre-establishing the conversion relationship between virtual and real acoustic features before spatial audio generation. The system pre-processes and stores acoustic feature mappings, allowing for rapid extraction and adjustment during actual spatial audio rendering, thus achieving both high efficiency and accurate acoustic feature reproduction.
Data Source
AI summary
Embodiments of this application provide an audio processing method and an electronic device. The method includes: First, a source audio signal, a sound source position corresponding to the source audio signal in a virtual scene, and a first position corresponding to a user in the virtual scene are obtained, where the virtual scene is obtained through construction based on a real scene; and a first acoustic feature is obtained, where the first acoustic feature is obtained by converting, based on an acoustic feature at a second position in the real scene and an acoustic feature at the second position in the virtual scene, an acoustic feature at the first position in the virtual scene when the source audio signal is at the sound source position. Then, a spatial audio signal is generated based on the first acoustic feature and the source audio signal.