True three-dimensional panoramic display and interactive apparatus without calibration

Abstract

The invention provides a true three-dimensional panoramic display and interactive device without calibration, which comprises a main support, a helmet-mounted display, an image storage processor and a host computer. The main support is provided with a holder used for installing a plurality of cameras. The cameras are arranged on the holder. An observer standing in the inner space of the main support can watch a virtual scene in real time through the helmet-mounted display. The observer can move freely in the space including turning the head, walking and turning freely. The observer can interact with the scene in real time. The image information of the observer is collected through the plurality of cameras. After images are preprocessed, the host computer analyzes, matches and calculates a plurality of images to get the information of positions, poses and actions of the observer in real time. In this way, corresponding change of the virtual scene in the helmet-mounted display can be controlled to achieve visual display and interactive effect. Without calibrating the observer, the observer can turn the head and body naturally to change the view point, thus achieving true three-dimensional panoramic display and interaction. The invention has the advantages of better immersion and flexibility.

Description

technical field [0001] The invention relates to a calibration-free true three-dimensional panoramic display and interaction device and method, belonging to the fields of computer vision and human-computer interaction. Background technique [0002] Immersion is fundamental to make people feel real and gain experience, while interaction is the key to achieve harmony between man and machine. The display and interaction of virtual scenes is the core of virtual reality. At present, the display part is mainly realized by various display devices, such as stereoscopic display, column screen or ring screen system, and CAVE system, to provide people with a sense of immersion; while the interaction is mainly Realized by various input devices such as data gloves, optical markers, position trackers, etc. If you want to track the movement of the human head, you need a special position tracker, which is bulky, expensive, heavy, and inconvenient to use. And if people want to interact with...

AI Technical Summary

Problems solved by technology

If you want to track the movement of the human head, you need a special position tracker, which is bulky, expensive, and has a large weight, which is inconvenient to use

And if people want to interact with the virtual scene with their hands, they must wear data gloves, and they can only capture information of a few degrees of freedom, which is not flexible enough.

Images