Systems and methods for 2D image and spatial data capture for 3D stereo imaging

Abstract

Systems and methods for 2D image and spatial data capture for 3D stereo imaging are disclosed. The system utilizes a cinematography camera and at least one reference or “witness” camera spaced apart from the cinematography camera at a distance much greater that the interocular separation to capture 2D images over an overlapping volume associated with a scene having one or more objects. The captured image date is post-processed to create a depth map, and a point cloud is created form the depth map. The robustness of the depth map and the point cloud allows for dual virtual cameras to be placed substantially arbitrarily in the resulting virtual 3D space, which greatly simplifies the addition of computer-generated graphics, animation and other special effects in cinemagraphic post-processing.

Description

CLAIM OF PRIORITY[0001]This application claims the benefit of priority under 35 U.S.C. §119(e) of U.S. Provisional Application Ser. No. 61 / 312,330, filed on Mar. 10, 2010, which application is incorporated by reference herein.FIELD[0002]The present disclosure relates generally to creating three-dimensional (3D) stereo images from two-dimensional (2D) photography, and in particular to systems and methods for 2D image capture and spatial data capture for 3D stereo imaging.BACKGROUND ART[0003]The process of “converting” 2D photographed images into three-dimensional 3D stereo images (left eye and right eye pairs) for the motion picture and television industry is extremely labor intensive, time consuming, financially expensive, and has the added problem of being geometrically inaccurate to the original scene.[0004]Current technologies allow for the creation of 3D stereo imaging from 2D photography. However, the available 3D technologies do so through interpretive and creative means, or t...

AI Technical Summary

Benefits of technology

"The patent describes a method for creating 3D images of a scene by capturing 2D images from different cameras and using a disparity map to create a 3D point cloud representation of the scene. This allows for the creation of a depth map or point cloud that can be used to create a continuous 3D stereo pair. The method also allows for the creation of virtual cameras and the addition of CG visual effect elements. The technical effects of this patent include improved depth perception and the ability to create realistic 3D images from 2D images."

Problems solved by technology

The process of “converting” 2D photographed images into three-dimensional 3D stereo images (left eye and right eye pairs) for the motion picture and television industry is extremely labor intensive, time consuming, financially expensive, and has the added problem of being geometrically inaccurate to the original scene.

However, the available 3D technologies do so through interpretive and creative means, or through system configurations that do not capture the true depth and geometry of the original environment using the 2D photography.

While this allows for creation of a 3D effect, the actual image-capture process does not collect a substantial amount of true 3D information for the given scene mainly because the interocular distance DH is too small relative to the distance DS.

This lack of accurate volumetric data and true 3D geometry provides significant problems and challenges when visual effects such as computer-generated elements need to be added to the photographed or filmed scenes.

However, in 3D movie post-processing, the jet contrail is also in 3D and thus is much more difficult to remove.

Because of the limitations of present-day 3D imaging technology, critical 3D-stereo-related decisions must made at the time of shooting rather than in post-production.

The addition of visual effects in the form of computer-graphics (CG) environments and CG characters into scenes that have been originally shot in 2D and converted into 3D stereo further complicates matters and poses great technical and financial challenges to visual effects post-production.

Images