Multi-channel surround sound dynamic binaural replaying method based on body-sensing camera

Abstract

The invention discloses a multi-channel surround sound dynamic binaural replaying method based on a body-sensing camera. The method includes steps: 1) inputting initial data, wherein the data comprises position parameters of virtual loudspeakers and head related transfer function data; 2) detecting motion data of the head of a listener in real time by employing the body-sensing camera, and calculating the space direction of the head after rotation; 3) calling a corresponding head related transfer function principal component decomposition coefficient according to the space direction of the head of the listener after rotation, multiplying input multi-channel surround sound signals by the coefficient, and performing filtering by employing a common filter group obtained by decomposition of head related transfer functions; and 4) mixing output signals of the common filter group, and obtaining binaural replaying signals of multi-channel surround sound for replaying by an earphone after filtering equalization processing. According to the method, the motion information of the head is obtained by employing the body-sensing camera, each virtual loudspeaker of the multi-channel surround sound is dynamically simulated in real time, and the similar effect of replaying the multi-channel surround sound by the loudspeakers is produced.

Description

Technical field [0001] The patent of the invention relates to the field of electroacoustic technology, in particular to a multi-channel surround sound dynamic binaural playback method based on a somatosensory camera. Background technique [0002] Multi-channel surround sound uses multiple speaker arrangements surrounding the listener and corresponding signal paths to produce a spatial auditory effect of sound. For example, the 5.1-channel surround sound recommended by the International Telecommunication Union has 5 full-band channels in front of left (L), center (C), right (R), left surround (LS), and right surround (RS), plus a low frequency The effect path (LFE) can get the auditory effect of horizontal surround sound. More channels of surround sound systems have also been developed internationally, including 7.1 channels of horizontal surround sound systems, 9.1 channels, 10.2 channels, 11.1 channels, 22.2 channels, Dolby Atmos and other three-dimensional surround sound syste...

AI Technical Summary

Problems solved by technology

This kind of head tracker is relatively simple, and can approximate the dynamic binaural replay of the horizontal plane, but cannot realize the dynamic binaural replay of the entire three-dimensional space

In addition, the above two head trackers are contact tracking technologies, and the listener needs to wear a tracking sensor, which sometimes brings inconvenience to the application

And these tracking technologies are also susceptible to interference from the outside world (such as metal, magnetic field)

Images