System and method for processing dynamic space virtual sound in VR television

Abstract

The invention discloses a dynamic space virtual sound processing system and method in a VR TV. The processing system includes a VR TV remote controller, a first processor, a calling module and a second processor. The first processor calculates the head orientation angle information of the user according to the reference coordinates, the orientation change instruction information and the setting angle of the virtual speaker. The calling module reads the head azimuth angle information and the setting angle of the virtual speaker to obtain the relative azimuth angle between the head and the virtual speaker; calls out the transfer function corresponding to the relative azimuth angle from the head-related transfer function database or matches to the closest one The transfer function corresponding to a relative azimuth angle in the head-related transfer function database. The second processor convolves the input signal according to the transfer function to generate the first channel signal and the second channel signal. The present invention outputs the corresponding audio signal according to the moving position of the audience user, thereby helping to improve the immersive experience of the audience user.

Description

technical field [0001] The invention relates to a data processing technology, in particular to a dynamic space virtual sound processing system and processing method in a VR TV based on virtual reality. Background technique [0002] With the emergence of VR TV, the traditional mode of viewers watching TV has undergone major changes. When users watch VR TV, the audio signal of VR is generally played back by audio playback equipment (such as earphones) to the sound in virtual reality. Audience users can control the TV screen through the remote control to change the viewing angle. When watching virtual reality images, as the scene and plot of the virtual reality change, the action behavior of audience users may also change accordingly. For example, in a virtual reality scene, in a virtual football match scene, players hit the ball and run on the field, or in a virtual TV drama war scene, gunshots or explosions suddenly sounded behind the audience user, and the user's head often ...

AI Technical Summary

Problems solved by technology

However, when the action behavior of the audience user changes, for the user, the orientation of the sound source in the virtual reality has changed, but the orientation of the sound source reproduced in the audio playback device (such as earphones) worn by the audience user has not. Make corresponding changes, which greatly affects the immersion created by virtual reality and reduces the effect of user experience

Images