Three-dimensional vision semi-matter simulating system and method

Abstract

The system comprises: a projector, a video camera, a cradle head of video camera, a projection screen and a computer. When using the simulation system to make simulation, in the first, the virtual view software in the computer generates a virtual 3D image to get multi virtual stereovision 3D images from more than two viewpoints at same time. The projector projects each 3D image to the screen; the real video camera respectively captures the 3D images from different viewpoints on the screen to get the output images of the simulation system at the measurement time; calculating the parameters of the virtual video camera, the parameters of imaging model of real video camera and the parameters of imaging model of projector; finally, based on the basis principle of stereovision, getting the virtual 3D scene and 3D space coordinates in the image.

Description

technical field [0001] The invention relates to a stereo vision semi-physical simulation system and method. Background technique [0002] Stereo vision is to determine the three-dimensional structure of the scene according to two or more images taken from different viewpoints. The theoretical basis of its research is that a single three-dimensional position in the real world is projected to a unique pair of image positions. Different from the general photography system which can only record the 3D scene in 2D form and lose a lot of information, stereo vision can obtain 3D data of the scene, and it is getting better and better in robot vision, aerial surveying and mapping, military application, medical diagnosis and industrial inspection. It is more and more widely used, and researchers at home and abroad are also studying it more and more deeply. At present, stereo vision simulations are mainly pure digital simulations, which can provide a research and development platform ...

AI Technical Summary

Problems solved by technology

Since the hardware-in-the-loop simulation needs to combine software and hardware to build a system, it is difficult to establish a system model between software and hardware and determine the relationship between the digital scene and the actual camera image. It is a stereo vision hardware-in-the-loop simulation system and method bottlenecks

There is no mention in the existing materials that a hardware-in-the-loop simulation system can well solve the problem of difficult simulation of complex situations encountered in the process of stereo vision research

Images