AR Audio Mixing Modes for Real and Virtual Sound Integration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems primarily focus on visual integration of real and virtual worlds, lacking diversity in audio integration, which limits the immersive experience for users.
Innovation Solution
An audio processing method that integrates real and virtual audio signals through selectable sound mixing modes, allowing for diverse auditory experiences by mixing real and virtual audio signals based on user preferences or environmental conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If only visual integration is implemented in augmented reality, then image fusion capability is achieved, but auditory integration capability is lacking
Solution Approach 1:
The patent combines real audio signals from the physical environment with virtual audio signals from the augmented reality scene through sound mixing processing. The mixing module merges these two audio sources into a unified audio output, enabling simultaneous presentation of both real and virtual auditory information to the user.
Solution Approach 2:
The audio processing system is designed to handle multiple audio sources and mixing modes universally. It can process real audio signals, virtual audio signals, and their combinations through different mixing strategies (additive mixing, multiplicative mixing, or selective mixing), making the system adaptable to various augmented reality scenarios.
2Adaptability or versatility
If multiple sound mixing modes are provided, then user customization and scene adaptability are improved, but system complexity increases
Solution Approach 1:
The system provides dynamic sound mixing modes that can be switched based on different augmented reality scenes and user preferences. The mixing module can adaptively change between additive mixing, multiplicative mixing, and selective mixing strategies, allowing the system to respond dynamically to different operational contexts without requiring separate hardware for each mode.
Solution Approach 2:
Different sound mixing modes are achieved by changing the processing parameters and algorithms within the mixing module. By adjusting mixing coefficients, signal combination methods, and gain parameters, the system can transition between different mixing strategies using the same hardware infrastructure, thereby reducing overall system complexity.
3Reliability
If real and virtual audio signals are mixed, then immersive experience is enhanced, but audio processing complexity increases
Solution Approach 1:
The audio processing system segments the audio signal stream into distinct real audio signals and virtual audio signals. This segmentation allows independent processing of each signal type before combining them, enabling precise control over the mixing process while maintaining manageable complexity through modular signal handling.
Solution Approach 2:
The mixing module acts as an intermediary component that receives both real and virtual audio signals, processes them through selected mixing strategies, and produces the final mixed audio output. This intermediary structure simplifies the overall system architecture by centralizing the complex mixing operations in a dedicated module rather than distributing complexity throughout the entire audio processing chain.
Data Source
AI summary
This application provides an audio processing method performed by a computer device. The method includes: obtaining a real audio signal from a real environment and a virtual audio signal from a virtual environment in an augmented reality scene; selecting one sound mixing mode from a plurality of sound mixing modes configured for the augmented reality scene as a target sound mixing mode; performing sound mixing processing on the real audio signal and the virtual audio signal according to the target sound mixing mode to obtain a sound-mixed signal; and outputting the sound-mixed signal via a speaker of the computer device. In this way, integration of sounds in an augmented reality scene is realized in an auditory dimension, thereby enriching an integration capability in the augmented reality scene, and improving an overall immersed sense of a user in the augmented reality scene.