Optimized virtual sound synthesis method based on headphone replay

Abstract

The invention discloses an optimized virtual sound synthesis method based on headphone replay. The method includes the steps that according to the physical and geometric characteristics of a sound environment needing to be virtually created, the room impulse response (RIR) arriving at the position of a listener is determined; according to the arrival spatial orientation of direct sounds and reflected sounds in the RIR relative to the center of the head of the listener, the corresponding head-related impulse response (HRIR) and the direct sounds and the reflected sounds in the RIR are selected to be respectively subjected to convolution so that binaural room impulse response (BRIR) can be obtained; single-path signals of a virtual sound source and the BRIR are subjected to convolution so that binaural sound signals can be obtained; the binaural sound signals and the inverse function of a headphone transfer function HpTF are subjected to convolution so that headphone compensated binaural sound signals can be obtained and fed back to headphones for replay. With the method, a signal processing algorithm can be optimized, the calculation amount is reduced, the synthesized binaural sound signals are subjected to headphone compensation, the in-head positioning and sound image distorsion problems can be well solved, and the method is wide in application range.

Description

technical field [0001] The invention relates to 3D sound playback technology, in particular to an optimized virtual 3D sound synthesis method based on earphone playback, which is especially suitable for realizing 3D virtual sound when the hardware level is not high (such as a handheld mobile communication terminal). Background technique [0002] The human auditory system perceives external acoustic information through binaural acoustic signals. Virtual sound technology artificially synthesizes binaural sound signals by means of signal processing, and uses headphones to replay, so that the listener can obtain virtual external sound information (including sound source information and environmental information), and then generate an "immersive" experience. auditory effect. [0003] In a real environment, the sound waves of the sound source interact with the environment (such as walls) and the physiological structure of the listener (such as the head, shoulders), and finally re...

AI Technical Summary

Problems solved by technology

In the headphone playback stage, since the sound transmission spectrum HpTF (Headphone-to-ear-canal Transfer Function) from the headphone to the ear canal is not flat, directly feeding the synthesized binaural sound signal to the headphone playback will damage the ears. The spectral characteristics of the acoustic signal cause auditory distortion (including positioning errors, front and rear confusion, etc.), reducing the auditory quality of 3D playback

Images