System for implementing remote control interaction in virtual three-dimensional scene

Abstract

The invention relates to a system and a controlling method for realizing remote control interaction in a virtual three-dimensional scene. An interactive control system solves how to carry out the interaction and control on a virtual studio scene, animation and an object in the scene by an operator. The system mainly comprises three modules: first, a three-dimensional producing and real-time rendering module; second, a playing and controlling module; third, an interactive module. The interactive module includes subsystems such as a wireless remote control subsystem, a voice recognizing subsystem, an image recognizing subsystem, a position tracking subsystem (an action recognizing subsystem), a touch screen subsystem (a visual multimedia playing and controlling interface and a multi-point touch controlling method are provided), and the like. A three-dimensional real-time rendering engine can be driven by the playing and controlling module by the operator through various interactive methods, thus realizing the selectively instant playing of the virtual scene and the controlling of the virtual object. The system can be applied to virtual studios of television stations and other virtual interactive demonstrating occasions.

Description

Technical field: [0001] The invention mainly relates to three-dimensional virtual simulation technology and interactive control technology, and is a human-computer interactive virtual demonstration system related to broadcasting in a TV station's interactive virtual studio and applications in the field of high-end interactive multimedia display in other fields. Background technique: [0002] The present invention is a high-end demonstration system combining 3D virtual real-time rendering engine technology and various interactive control technologies. Good 3D animations and virtual scenes are rendered in real time during broadcasting and combined with images of hosts and guests through deduction synthesis technology, so as to realize a broadcast application in 3D virtual scenes. It is characterized by the use of 3D technology to achieve a variety of gorgeous 3D effects and the introduction of virtual 3D objects, and to achieve switching between different scenes in the same pr...

AI Technical Summary

Problems solved by technology

[0024] Due to the coordination and synchronization between the background control personnel and the front-end operators, this kind of virtual studio program has a great impact on the operator's on-site performance and the continuity of the overall program, and the operator has to pay attention to the ear pulse at all times Instructions from the middle and background directors, and you have to remember where you are at all times. The operator is just reading the script, and the program has a single form of expression, just combining the background and the operator.

Images