Gaming Headset Audio Mixing for Ambient Sound Awareness

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current audio headsets used in computer gaming often overwhelm environmental sounds with multi-channel surround sound, making it difficult for users to hear important sounds from their surroundings, such as conversations or notifications, without having to remove the headset.

Innovation Solution

The integration of far-field microphones and a signal processor in the headset that uses a neural network to classify and selectively mix environmental sounds with the media sound, allowing targeted sounds to be heard while maintaining the multi-channel audio experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If multi-channel surround sound is used in the headset, then the audio experience is enhanced, but environmental sounds are canceled out and become inaudible

Engineering Contradiction:
Improveaudio experience qualityVSAvoidenvironmental sound information
Core Design Contradiction:
Illumination intensityVSLoss of information

Solution Approach 1:

The patent segments the audio signal into game audio and environmental audio components using separate microphones and processing channels. The first microphones capture game-related audio while second microphones capture environmental sounds, allowing independent processing and selective mixing to preserve both audio types simultaneously

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a signal processor as an intermediary that receives inputs from multiple microphones and dynamically mixes game audio with environmental sounds. This mediator balances the audio signals to prevent complete cancellation of environmental sounds while maintaining immersive game audio experience

Inventive Principle:
Principle #24Intermediary (Mediator)

2Illumination intensity

If the headset plays massive sound field, then gaming audio is immersive, but users cannot hear important environmental sounds like conversations or notifications

Engineering Contradiction:
Improvegaming audio immersionVSAvoidmasking of important environmental sounds
Core Design Contradiction:
Illumination intensityVSObject-generated harmful factors

Solution Approach 1:

The patent applies different processing qualities to different audio sources. Environmental sounds captured by second microphones are processed separately with specific gain and mixing parameters tailored to their characteristics, ensuring that important sounds like conversations and notifications are enhanced rather than overwhelmed by game audio

Inventive Principle:
Principle #3Local quality

3Reliability

If environmental sounds are completely blocked by the headset, then gaming audio quality is maintained, but users must remove the headset to engage in conversation

Engineering Contradiction:
Improvegaming audio qualityVSAvoidconvenience of communication
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent enables continuous capture and processing of environmental sounds throughout gaming sessions. The second microphones continuously monitor environmental audio, and the signal processor continuously mixes these sounds with game audio, allowing users to maintain headset wear while staying aware of and able to engage in conversations without removal

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS11050399B2Ambient sound activated device
Publication Date: 2021.06.29 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11050399B2 patent drawing
  • US11050399B2 patent drawing
  • US11050399B2 patent drawing

AI summary

In device having at least one microphone and one or more speakers, environmental sound may be recorded using the microphone, classified and mixed with source media sound to produce a mixed sound depending on the classification. The mixed sound may then be played over the one or more speakers.