Somatosensory interactive broadcasting guide system and method based on free viewpoints

Abstract

The invention relates to a somatosensory interactive broadcasting guide system and method based on free viewpoints. The system comprises a server side, a video transmission network and a client side, wherein, the server side comprises a multi-camera system, a video processing server and a streaming media server which are used for completing multi-channel video capture, panoramic video synthesis, H.264 encoding and RTSP (real time streaming protocol) streaming media service; the video transmission network is a local area network (LAN) or wide area network (WAN) based on a TCP/IP (transmission control protocol/Internet protocol); and the client side comprises a free viewpoint playing terminal and a somatosensory sensor, wherein, the free viewpoint playing terminal comprises functional modules which are used for completing video streaming media receiving and decoding, gesture recognition based on a somatosensory controller, free viewpoint generation and other tasks. The somatosensory interactive broadcasting guide system and method have the beneficial effects that by combining multi-channel video into panoramic video, software and hardware investment and technical cost can be saved by directly utilizing the currently mature video coding and streaming media transmission technology, and meanwhile panoramic seamless roaming at 360 degrees and free viewpoint switchover can be really realized.

Description

technical field [0001] The present invention belongs to the field of computer vision, in particular to a somatosensory interactive guidance system and implementation method based on free-viewpoint video, and more specifically a somatosensory interactive guidance system for viewers to perform human-computer interaction through somatosensory interaction equipment to realize free-viewpoint video on the Internet and implementation methods. Background technique [0002] Video / film system has become the most influential mass media in the current information society. In the traditional video / video system, the audience can only passively accept the photographer or broadcaster’s choice of angle of view or lens switching, and there are jumps in the position of the viewpoint and the video screen when the angle of view or lens is switched, resulting in the audience’s lack of presence and sense of presence when watching. presence. [0003] With the rapid development of digital multimed...

AI Technical Summary

Problems solved by technology

Mouse, keyboard, touch screen and other devices have become indispensable human-computer interaction devices in the current network video live broadcast / on-demand system. However, these traditional interactive devices have limitations such as limited distance, unintuitive interaction process, and inflexibility.

Images