Gaming Headset Sound Classification for Ambient Audio Mixing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current audio headsets used in computer gaming often overwhelm environmental sounds with multi-channel surround sound, making it difficult for users to hear important sounds from their surroundings, such as conversations or notifications, without having to remove the headset.
Innovation Solution
The integration of far-field microphones and a signal processor in the headset that uses classification and selective mixing of sound sources, employing neural networks to differentiate and amplify environmental sounds, allowing them to be mixed with the media sound in real-time, enabling the user to perceive targeted sounds while maintaining the gaming experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If multi-channel surround sound is used in the headset, then the gaming audio experience is enhanced, but environmental sounds are canceled out and become inaudible
Solution Approach 1:
The patent segments the audio signal processing into distinct components: game audio processing and environmental sound processing. The headset separates these two audio streams and processes them independently, allowing selective mixing where environmental sounds can be heard alongside or above game audio, preventing complete cancellation of environmental sounds while maintaining immersive gaming audio
Solution Approach 2:
The patent introduces an intermediary signal processing system that acts as a mediator between the game audio and environmental sounds. This intermediary processor selectively mixes and balances the two audio streams, allowing users to hear environmental sounds without completely removing the gaming audio experience, thus resolving the contradiction between enhanced gaming audio and environmental sound awareness
2Duration of action of stationary object
If the headset plays media sound continuously, then the gaming audio experience is maintained, but the user cannot hear important environmental sounds without removing the headset
Solution Approach 1:
The patent implements dynamic audio mixing that continuously adjusts the balance between game audio and environmental sounds. The system dynamically processes audio signals in real-time, allowing environmental sounds to break through the continuous media playback when necessary, enabling users to hear important sounds without removing the headset while maintaining continuous gaming audio
Solution Approach 2:
The patent changes the audio parameter mixing ratios dynamically based on the detected environmental sound characteristics. When environmental sounds are detected, the system adjusts the mixing parameters to allow these sounds to be heard alongside or above the continuous media playback, preventing the harmful masking effect while maintaining continuous audio output
Data Source
AI summary
In device having at least one microphone and one or more speakers, environmental sound may be recorded using the microphone, classified and mixed with source media sound to produce a mixed sound depending on the classification. The mixed sound may then be played over the one or more speakers.