Three-dimensional enhancing realizing method for multi-viewpoint free stereo display

Abstract

The invention discloses a three-dimensional enhancing realizing method for multi-viewpoint free stereo display, which comprises the following steps: 1) stereoscopically shooting a natural scene by using a binocular camera; 2) extracting and matching a characteristic point of an image of a main camera, generating a three-dimensional point cloud picture of the natural scene in real time, and calculating a camera parameter; 3) calculating a depth image corresponding to the image of the main camera, drawing a virtual viewpoint image and a depth image thereof, and performing hollow repairing; 4) utilizing three-dimensional making software to draw a three-dimensional virtual model and utilizing a false-true fusing module to realize the false-true fusing of the multi-viewpoint image; 5) suitably combining multiple paths of false-true fused images; and 6) providing multi-viewpoint stereo display by a 3D display device. According to the method provided by the invention, the binocular camera is used for stereoscopically shooting and the characteristic extracting and matching technique with better instantaneity is adopted, so that no mark is required in the natural scene; the false-true fusing module is used for realizing the illumination consistency and seamless fusing of the false-true scenes; and the multi-user multi-angle naked-eye multi-viewpoint stereo display effect is supplied by the 3D display device.

Description

technical field [0001] The invention relates to a three-dimensional augmented reality method, in particular to a three-dimensional augmented reality method for multi-viewpoint autostereoscopic display. Background technique [0002] Augmented Reality (Augmented Reality, AR), also known as mixed reality, extended reality. It applies virtual information to the real world through computer technology, so that the real environment and virtual objects are superimposed on the same picture or space in real time. Different from the full immersion effect achieved by traditional virtual reality (Virtual Reality, VR) technology, augmented reality technology is committed to superimposing computer-generated objects on real scenes, not only showing real-world information, but also virtual information at the same time. It is shown that the two kinds of information complement and superimpose each other, which enhances the output characteristics of the real environment, so it has more obvious...

AI Technical Summary

Problems solved by technology

However, this system has two shortcomings: one is that it needs to mark the image, which is not suitable for applying to natural scenes; the other is that the display module needs HMD, which cannot realize three-dimensional display with naked eyes

This invention is limited to the shooting of natural scenes, content production and stereoscopic display, and does not involve the fusion of virtual objects and real scenes

Images