Binauralization Steering for Gaming Audio
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional binauralization techniques in gaming applications lead to frequent switching between binauralized and un-binauralized audio, causing discomfort and potentially incorrect directional cues, due to inadequate handling of mixed audio environments with short-term binauralized sounds and background noise.
Innovation Solution
A method for steering binauralization that dynamically adjusts the audio output by mixing binauralized and un-binauralized signals using threshold periods and confidence values based on inter-channel features, avoiding dual-binauralization and ensuring smooth transitions to prevent abrupt changes in audio perception.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If binauralization is applied dynamically to all audio frames, then directional information is provided for short-term sounds, but frequent switching between binauralized and un-binauralized audio causes user discomfort and instability
Solution Approach 1:
The patent changes the parameter of binauralization application from frame-by-frame dynamic processing to selective processing based on audio event detection. By detecting specific audio events (gunshots, explosions) and applying binauralization only to those frames, the system maintains directional accuracy while avoiding frequent switching that causes user discomfort.
Solution Approach 2:
Instead of applying binauralization to all audio frames (excessive action), the patent applies it only to specific frames containing short-term binauralized sounds (partial action). This selective application provides directional information where needed while minimizing the harmful effects of frequent switching.
2Measurement precision
If binauralization is applied to mixed audio environments, then directional cues are provided for foreground sounds, but dual-binauralization occurs causing incorrect directional perception
Solution Approach 1:
The patent extracts and processes only the binauralized audio frames separately from the monophonic background audio. By taking out the binauralized components and processing them independently before mixing, the system avoids dual-binauralization of the entire audio stream, ensuring correct directional perception.
Solution Approach 2:
The patent segments the audio stream into binauralized and monophonic components, applying different processing paths to each. This segmentation prevents dual-binauralization by ensuring that binauralization is applied only to the appropriate frames, maintaining reliable directional cues.
3Speed
If binauralization switching is implemented without energy threshold checking, then response time is reduced, but abrupt audio changes occur causing instability during continuous sounds
Solution Approach 1:
The patent performs preliminary energy threshold checking before switching binauralization on or off. By checking whether the current frame's energy is below a threshold and whether previous frames were binauralized, the system prevents abrupt switching during continuous sounds, maintaining audio stability while still responding quickly to valid events.
Data Source
Figure 1
Figure 2
Figure 3A~3B
AI summary
A method for steering binauralization of audio is provided. The method comprises steps of: receiving (410) an audio input signal, calculating (430) a confidence value indicating a likelihood that a current audio frame of the audio input signal comprises binauralized audio; determining (450) a state signal based on the confidence value; determining (460) a steering signal, based on the first confidence value, the state signal and an energy value of the audio frame; and generating (470) an audio output signal with steered binauralization by processing the audio input signal according to the steering signal.