Dynamic image fusion method and system for VR panoramic live broadcast

Abstract

The invention discloses a dynamic image fusion method and system for VR panoramic live broadcast, and the method comprises the steps: collecting a multi-view live broadcast stream, carrying out compression coding, and pushing the multi-view live broadcast stream to a streaming media server in real time; using a dynamic image fusion algorithm to seamlessly splice the live broadcast images of different visual angles to generate VR panoramic live broadcast streams; creating a virtual scene and a 3D sphere object, and establishing a grid model in the virtual scene by taking the VR panorama as a material; creating a virtual perspective camera, and specifying an initial position, a direction and a visual field range of the camera; creating a 3D renderer, rendering all the two-dimensional live broadcast pictures in the visual field range of the virtual camera in the scene into a three-dimensional image, and displaying the three-dimensional image; and changing the position and direction of thevirtual camera according to the change of the viewing angle of the user so as to generate and display live broadcast pictures of different viewing angles. According to the invention, the visual anglechange of the user is supported, the visual field range of the user in live broadcast can be expanded, the live broadcast blind area is eliminated, immersive visual perception is brought to the user,and the live broadcast effect is improved.

Description

technical field [0001] The invention belongs to the field of 5G online live broadcast, and in particular relates to a dynamic image fusion method and system for VR panoramic live broadcast. Background technique [0002] The advent of the 5G era has brought vigorous vitality to the webcast industry and made it more widely used. With the development of science and technology, people have been pursuing higher comfort and experience, so the experience requirements for watching live broadcasts are getting higher and higher. The live broadcast itself is bound to develop a new form of existence, and its functions will become more and more powerful. . With the application of 5G network, immersive experience will become an important form of learning, life, entertainment and aesthetics, so the combination of immersive experience and webcast has become the focus of current research. [0003] The traditional immersive experience requires the purchase and wearing of professional VR gla...

AI Technical Summary

Problems solved by technology

[0003] The traditional immersive experience requires the purchase and wearing of professional VR glasses, which are not only expensive and have a high threshold, but are also very detrimental to the promotion and dissemination of live broadcasts, which runs counter to the flexibility of watching live broadcasts anytime, anywhere

In addition, the live broadcast screen seen in this way does not support the change of the user's viewing angle, the field of view is small, the blind area is large, and the interaction is poor.

Images