Real-time rendering interactive cinema system and method based on multi-modal interaction

Abstract

The invention discloses a real-time rendering interactive cinema system and a real-time rendering interactive cinema method based on multi-modal interaction. The system comprises a network module, a dynamic platform module, a Kinect action recognition module, a mobile phone interaction module, a feedback module and an arc screen three-dimensional rendering module, wherein by virtue of the network module, communication and data transmission paths are provided; the dynamic platform module is used for acquiring attitude data for driving a three-freedom-degree seat and a six-freedom-degree platform in real time; the Kinect action recognition module is used for acquiring body actions of a user and for conducting data coding; the mobile interaction module is used for acquiring and encapsulating user input; the feedback module is used for implementing feedback on an arc screen in accordance with the input information and the body actions of the user; and the arc screen three-dimensional rendering module is used for rendering left and right eye frame pictures corresponding to a role viewpoint by virtue of a three-dimensional camera, splicing and fusing the left and right eye frame pictures, sequentially outputting the left and right eye frame pictures in an alternate mode and projecting the left and right eye frame pictures on the arc screen so as to obtain a three-dimensional picture. The real-time rendering interactive cinema system disclosed by the invention has abundant interactive modes and a strong sense of immersion of interactive equipment, so that the user can enjoy more real experience and the problem of an interactive cinema which has a single interactive mode can be solved.

Description

technical field [0001] The invention relates to a real-time rendering interactive theater system and method based on multi-channel interaction. Background technique [0002] With domestic theme parks springing up like mushrooms after a spring rain, interactive theaters are also developing continuously. It combines the internationally popular 3D film and television technology with multi-person interactive technology, enabling movie viewers to become characters in movies. Advanced interactive equipment intervenes in the environment and plot of the film, so that viewers feel as if they are part of the film. The viewer is the protagonist or a member of the film and continues to interact with the film interaction. The interactive theater satisfies the audience's ability to actively participate in the plot of the film while watching the film and become a participant in the plot, instead of simply passively accepting the plot, which increases the audience's sense of participation ...

AI Technical Summary

Problems solved by technology

[0004] 1) The audience interacts through a special interactive gun, and the interaction method is single;

[0005] 2) The sense of substitution of the interactive gun is not strong;

[0006] 3 Most of them use flat projection, with low screen resolution and insufficient immersion;

[0007] 4) Although the audience can work together to complete the task of the film, the way each audience participates in the interaction of the film is the same, and there is no division of labor and cooperation. There is a lack of interaction between the audience and the interactive experience is mediocre

Images