VR Environmental Sound Pass-Through With Directional Audio Pickup
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
VR devices with see-through modes struggle to allow users to clearly hear ambient environmental sounds while maintaining visual immersion, as existing noise reduction technologies either block sound or require users to remove headphones.
Innovation Solution
An environmental sound pass-through method and apparatus that utilizes microphones to acquire ambient audio, determines sound source position, filters and adjusts audio signals based on noise reduction and speaker characteristics to play clear environmental sounds.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Object-affected harmful factors
If noise reduction performance of earphones is improved, then environmental noises are isolated better, but environmental sounds cannot be heard clearly in see-through mode
Solution Approach 1:
The patent segments the audio processing into multiple independent modules: environmental audio acquisition, sound source positioning, filtering, directional pickup, and amplitude adjustment. Each module handles a specific aspect of audio processing, allowing noise reduction and sound clarity to be optimized independently through targeted processing at different stages.
Solution Approach 2:
The patent applies different processing qualities to different audio components. Environmental noises are heavily filtered and reduced, while environmental sounds undergo selective processing to maintain clarity. The directional pickup module applies quality enhancement specifically to sounds from relevant directions, creating local quality differentiation in the audio processing pipeline.
2Adaptability or versatility
If wired earphones are used for noise reduction, then immersion in VR content is enhanced, but users must remove earphones to hear environmental sounds
Solution Approach 1:
The patent makes the wired earphones multi-functional by integrating environmental sound pass-through capability. The same earphones that provide noise reduction for immersion also transmit environmental sounds clearly through the processing pipeline, eliminating the need to remove them for either function.
Solution Approach 2:
The patent introduces an intermediary audio processing system between the earphones and the user's ear. This intermediary system (comprising microphones, processors, and algorithms) mediates the audio signal to simultaneously achieve noise reduction and environmental sound transmission, allowing the earphones to serve both purposes.
3Illumination intensity
If see-through mode is activated, then visual immersion is maintained, but environmental sound clarity deteriorates
Solution Approach 1:
The patent implements dynamic audio processing that adapts to the see-through mode. When see-through mode is activated, the system dynamically adjusts the audio processing parameters including filtering strength, directional pickup sensitivity, and amplitude adjustment to maintain environmental sound clarity alongside visual see-through capability.
Solution Approach 2:
The patent performs preliminary sound source positioning and filtering before the audio is played through the earphones. By pre-processing the environmental audio to identify and enhance sound sources, the system ensures audio clarity is maintained from the outset when see-through mode is activated, rather than attempting to correct clarity issues afterward.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables users to hear ambient sounds clearly in see-through mode, improving user experience by enhancing audio clarity and stability while maintaining visual immersion.
Implementation Method 1
Environmental audio information of an ambient environment is acquired by a microphone on a VR device
Implementation Method 2
The environmental audio information is located to determine sound source position information according to a time difference of the environmental audio information reaching microphones on the VR device
Implementation Method 3
a filtering process is performed on the environmental audio information to determine filtered audio information
Implementation Method 4
the target audio information is played by a speaker of the VR device
Data Source
AI summary
Provided are an environmental sound pass-through method and apparatus applied to VR, a device and a storage medium. The method includes the steps below. Environmental audio information of an ambient environment is acquired by a microphone on a VR device based on a see-through mode of the VR device. The environmental audio information is located to determine sound source position information according to the time difference of the environmental audio information reaching microphones on the VR device, and a filtering process is performed on the environmental audio information to determine filtered audio information. Directional pickup is performed on the filtered audio information to determine to-be-processed audio information according to the sound source position information. A signal amplitude and pass-through loudness of the to-be-processed audio information are adjusted to determine target audio information, and the target audio information is played by a speaker of the VR device.