Tele-immersion teamwork device based on multi-camera acquisition

Abstract

A tele-immersion teamwork device based on multi-camera acquisition is disclosed, comprising; three cameras, three displays arranged at an alpha angle and semitransparent semireflecting mirrors which are respectively positioned in front of each display at an angle of 45 degrees and which are used for changing light path; the three cameras are respectively fixed directly above the semitransparent semireflecting mirrors with lenses thereof facing vertically downwards, projection of the lenses in the semitransparent semireflecting mirrors is coincided with that of eyes of a user in the semitransparent semireflecting mirrors when the user faces directly towards the display; wherein, alpha is larger than 90 degrees; the three cameras receive the same external triggering signal sent by an external host, and collect synchronous real images in an identical scene is performed by collecting lights reflected by the semitransparent semireflecting mirrors. The invention can collect front sight line of human, bringing people the sense of eye contact; in addition, two-dimensional video can be enabled to be more realistic when being viewed in three-dimensional scene.

Description

technical field [0001] The invention relates to a remote immersion collaborative work device, which belongs to the field of virtual reality, and in particular to an immersion collaborative work device which uses multiple cameras to collect real images and fuses and displays them with a virtual environment. Background technique [0002] The meaning of remote immersion collaborative work is that participants from all over the world share a virtual space through network interconnection. They can roam freely, communicate with each other, and interact with the virtual environment. Therefore, a set of devices that can collect real person information and display it in fusion with the virtual scene is needed. According to the different methods of remote immersion and collaborative work, the devices used are also different, mainly because of the different collection devices. At present, it can be roughly divided into three categories. [0003] The first category, the marker method....

AI Technical Summary

Problems solved by technology

[0006] The first type of method has high accuracy, but the equipment is expensive and not easy to popularize. The second type of method drives the model through video, which has poor accuracy, and because both types use the model, the sense of reality is poor

Although the third category is real-person images, since human images are two-dimensional, they also have the disadvantage of being unreal when superimposed on a three-dimensional scene. Moreover, when people interact with remote nodes, their eyes are directed towards the display screen, so the camera cannot capture To the person's direct line of sight, which gives the impression that eye contact cannot be made

Images