A full-band 3D virtual sound customization method and device based on physiological characteristics

Abstract

The invention discloses a method for customizing full-band 3D virtual sound based on physiological characteristics. The method utilizes the physiological similarity of the head and the auricle to respectively customize low-frequency and high-frequency head-related transfer functions that meet the auditory characteristics of the listener. And the method of gradual transition synthesis is used to obtain the head-related transfer function of the whole frequency band, which is further applied to the synthesis of binaural virtual sound signals. The corresponding realization device includes an image acquisition module, an operation control module, and a virtual sound playback module. The invention optimizes the physiological parameters required for customization, and can realize the customization of the head-related transfer function of the whole frequency band by using one physiological parameter of the head and four physiological parameters of the auricle. Retransmitting the binaural virtual sound signal with the earphone can reduce the positioning error and improve the immersion of the listener.

Description

technical field [0001] The present invention relates to the technical field of 3D virtual sound, in particular to a method and device for customizing 3D virtual sound based on physiological characteristics, which generate virtual sound satisfying individual auditory characteristics. Background technique [0002] With the development of three-dimensional (3D) television, movies and virtual reality (VR) technology, 3D virtual sound technology has become a research hotspot in the field of multimedia and consumer electronics. As the name implies, virtual sound technology uses signal processing methods to form a virtual sound source (or sound image), so that the listener can obtain the same subjective experience as the real sound source. The head-related transfer function (head-related transfer function, HRTF) is the core of the virtual sound algorithm; it characterizes the change of the sound wave by the human physiological organs (such as the head, auricle) during the transmiss...

AI Technical Summary

Problems solved by technology

However, existing studies have the following deficiencies: (1) Zotkin's work selected seven auricle parameters already in the baseline database without screening them, so the number of physiological parameters required for customization has not been optimized; (2) Existing work is limited to the high frequency (above 5kHz) where the auricle has obvious effects, and lacks a custom HRTF acquisition strategy for the full frequency band (the human auditory frequency range is 0-20kHz)

These deficiencies restrict the development of virtual acoustic technology based on physiological characteristics and the further improvement of related product performance

Images