Mixed Reality Sound Generation for Immersive 3D Audio
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies fail to effectively combine real and virtual sounds to create immersive 3D audio experiences, lacking the ability to generate high-immersion mixed reality environments.
Innovation Solution
A system and method for generating a combined sound by combining real and virtual sounds, using a sound generation device that includes a processor to select, filter, and adjust real and virtual object sounds, and convert 2D sounds to 3D sounds, creating a mixed reality experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If real and virtual sounds are combined to create mixed reality audio, then immersion and reality sense are improved, but system complexity increases
Solution Approach 1:
The system segments audio processing into distinct modules: real sound acquisition through microphones, virtual sound generation from audio data, spatial position calculation for multiple sound sources, and combined sound output. This modular segmentation manages complexity while achieving immersive mixed reality audio effects.
Solution Approach 2:
The processor acts as an intermediary that receives both real sound signals and virtual sound signals, calculates their spatial positions, and combines them into a unified mixed reality audio output. This intermediary processing layer integrates multiple audio sources while managing system complexity.
2Reliability
If 3D sound conversion is applied to 2D sound, then immersion is improved, but processing time and complexity increase
Solution Approach 1:
The system performs preliminary spatial position calculations for multiple sound sources based on audio data before combining them with real sounds. By pre-calculating positions and preparing virtual sound fields in advance, the system reduces real-time processing time while maintaining high immersion quality.
3Reliability
If multiple sound sources are processed and combined, then audio realism is improved, but computational load increases
Solution Approach 1:
The system applies different processing qualities to different sound sources based on their spatial positions and importance. Sounds are processed with appropriate levels of detail according to their location in the mixed reality environment, optimizing computational load while maintaining audio realism where most needed.
Data Source
AI summary
Disclosed are a method for generating a sound, and devices for performing same. The method for generating a sound, according to one embodiment, includes the acquiring a real sound generated in a real space, and a play sound generated in a virtual space, and generating, by combining the real sound and the play sound, a combined sound generated in a mixed reality in which the real space and the virtual space are mixed.


