Dynamic Microphone Array Control for Mixed Reality Audio
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual see-through (VST) devices lack effective audio control mechanisms to adapt audio performance to user intentions based on whether they are in virtual or real modes, leading to suboptimal audio experiences.
Innovation Solution
An electronic device with a processor and memory that operates in either a virtual or real mode, dynamically determining which microphones to activate, how many to use, and the direction of beamforming for voice signals, allowing for appropriate audio amplification or blocking based on the user's environment and screen content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the VST device uses a fixed audio control mechanism for both virtual and see-through modes, then the device structure remains simple, but the audio performance cannot be adapted to user intentions for each mode
Solution Approach 1:
The patent implements dynamic audio control by automatically switching between different audio processing configurations based on the operational mode (virtual or see-through). The system dynamically adjusts microphone activation, beamforming directions, and audio output settings according to the current mode, enabling adaptability without requiring manual user configuration for each scenario.
Solution Approach 2:
The system performs self-service by automatically determining the appropriate audio control parameters based on the detected operational mode. The processor autonomously selects which microphones to activate, configures beamforming directions, and adjusts audio output settings without requiring user intervention, thereby achieving mode-specific audio optimization while maintaining simple operation.
2Reliability
If multiple microphones are activated simultaneously for all modes, then external sound capture is comprehensive, but power consumption increases and audio focus is reduced
Solution Approach 1:
The patent applies local quality by activating only the specific microphones needed for the current operational mode rather than all microphones simultaneously. In virtual mode, microphones optimized for virtual space audio are activated, while in see-through mode, microphones suited for real-world sound capture are selected. This selective activation maintains voice signal reception accuracy while reducing overall power consumption.
Solution Approach 2:
The system uses partial action by activating only the necessary subset of microphones for each mode rather than all available microphones. This partial activation provides sufficient audio capture quality for each specific mode while significantly reducing power consumption compared to using all microphones continuously.
3Adaptability or versatility
If beamforming is applied in all directions for all modes, then voice reception coverage is maximized, but the device cannot provide focused audio performance for specific modes
Solution Approach 1:
The patent implements dynamic beamforming control by automatically adjusting beamforming directions and activation based on the operational mode. In virtual mode, beamforming is configured to optimize virtual space audio reception, while in see-through mode, beamforming directions are adjusted for real-world voice capture. This dynamic reconfiguration provides mode-specific audio performance without requiring complex manual controls.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution enables tailored audio utilization for virtual or real environments, enhancing user experience by ensuring audio performance aligns with the intended mode, whether in virtual or real space interactions.
Implementation Method 1
a plurality of microphones configured to input an external signal
Implementation Method 2
a speaker configured to reproduce a signal
Data Source
AI summary
An electronic device according to the disclosure may include: a display disposed around an eye of a user when being worn on a body part of the user, a plurality of microphones configured to receive an external signal, a camera, a speaker configured to reproduce a signal, at least one processor, comprising processing circuitry, and a memory. At least one processor, individually and/or collectively, may be configured to execute the instructions stored in the memory and to operate any one of a first mode or a second mode according to a designated condition, the first mode displaying a virtual space on the display and the second mode displaying a real space captured via the camera on the display. Based on the operation of one of the first mode or the second mode, at least one processor, individually and/or collectively may be configured to control the electronic device to: differently determine a location of a microphone to be activated for inputting an external signal among the plurality of microphones disposed in the electronic device, may differently determine a number of microphones to be activated for inputting an external signal among the plurality of microphones disposed in the electronic device, may differently determine whether to activate functions related to amplifying or blocking an external sound, and may differently determine a direction of beamforming generation for receiving a voice signal via the microphone.