A remote follow-up stereo vision system

Abstract

The invention provides a remote follow-up stereo vision system, which is composed of a slave end deployed at the video signal acquisition site and an active end deployed at the user's site. The slave end consists of a binocular camera, a video processing module, a high-speed pan-tilt, The pan / tilt control module is composed of a signal transmission module, and the active end is composed of a head-mounted display, a head posture tracking module, a data processing module and a signal transmission module. The system "maps" the user's head movement to the synchronous movement of the high-speed pan-tilt through the head attitude detection module, the pan-tilt control module, and the high-speed pan-tilt, and at the same time displays the process captured by the binocular camera on the head-mounted display. The calibrated and scale-transformed stereoscopic video allows users to have a stereoscopic remote viewing capability that conforms to normal visual habits. At the same time, the video signal that the user sees through the system captures the scene of the scene and is actually on the scene with naked eyes. The scene seen has a consistent visual perception effect, such as a sense of depth and three-dimensionality.

Description

technical field [0001] The invention belongs to the fields of augmented reality, virtual reality, and computer vision, and more specifically relates to a remote follow-up stereoscopic vision system. Background technique [0002] The remote follow-up stereo vision system based on the Head Mounted Display (HMD), binocular camera, and high-speed pan / tilt is mainly used to operate large construction machinery in a dangerous environment by remote control. [0003] Compared with the traditional flat display monitoring system, the remote follow-up stereo vision system has many advantages, such as: providing immersive stereo vision perception ability, large field of view, and operation in line with normal visual habits. [0004] In order to ensure the safety and efficiency of remote control operations, it is necessary to ensure that the objects in the far-end scene seen by the user through the system at the active end are consistent or similar to the objects seen by the naked eye wh...

Images