Audio Signal Processing Adjusting Gain for Head Movement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional audio signal processing methods fail to accurately adjust output signals based on head turning and position changes of a listener, leading to discomfort due to mismatched sound volume and position, which is not natural and affects the auditory experience in immersive audio environments like virtual reality.

Innovation Solution

The proposed method adjusts the gain of the audio rendering function in real-time based on changes in the listener's position and orientation relative to the sound source, using HRTF and BRIR, to improve the natural feeling of binaural input signals and enhance auditory effects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional binaural reproduction method is used, then three-dimensional audio effect is implemented, but the auditory effect is unnatural when listener moves or turns head

Engineering Contradiction:
Improveadaptability to listener movementVSAvoidnaturalness of auditory effect
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent applies dynamics by making the audio rendering function adaptable to listener movement. The system dynamically adjusts the audio output based on detected head position and orientation changes, allowing the audio reproduction to adapt to the listener's movements rather than remaining static. This resolves the contradiction by enabling the system to maintain natural auditory effects while accommodating listener mobility.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements feedback by using sensors to detect listener head position and orientation, then using this information to adjust the audio rendering function in real-time. The system continuously monitors listener movement and feeds this information back into the audio processing pipeline, allowing dynamic compensation for head movements and maintaining accurate spatial audio perception.

Inventive Principle:
Principle #23Feedback

2Reliability

If head turning tracking is added to adjust sound volume, then auditory effect is improved, but device complexity increases

Engineering Contradiction:
Improvenaturalness of auditory effectVSAvoidcomplexity of tracking system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent uses an intermediary approach by introducing sensors (such as gyroscopes or accelerometers) as mediators between the listener's head movements and the audio rendering function. These sensors indirectly detect head position and orientation without requiring complex direct measurement systems, simplifying the overall device architecture while still enabling accurate tracking for natural auditory effects.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP3893523B1Audio signal processing method and apparatus
Publication Date: 2024.05.22 HUAWEI TECH CO LTD
  • EP3893523B1 patent drawingFigure 1(a)~1(b)
  • EP3893523B1 patent drawingFigure 2
  • EP3893523B1 patent drawingFigure 3

AI summary

This application relates to the signal processing field, and discloses an audio signal processing method and apparatus, to resolve a problem about how to adjust an output signal based on a head turning change of a listener and/or a position movement change of the listener to improve an auditory effect of the listener. A specific solution is: obtaining a current position relationship between a sound source at a current moment and a listener; determining a current audio rendering function based on the current position relationship; if the current position relationship is different from a stored previous position relationship, adjusting an initial gain of the current audio rendering function based on the current position relationship and the previous position relationship, to obtain an adjusted gain of the current audio rendering function; determining an adjusted audio rendering function based on the current audio rendering function and the adjusted gain; and determining a current output signal based on a current input signal and the adjusted audio rendering function. Embodiments of this application are applied to an audio signal processing process.