A method and system for augmenting depth data from a depth sensor by using data from a multi-view camera system.

Abstract

A method for determining the depth of a scene and related systems are disclosed. [Solution] In some embodiments, the method may include a step of augmenting depth data of a scene captured using a depth sensor with depth data from one or more images of the scene. For example, the method may include a step of capturing images of the scene using multiple cameras. The method may further include a step of generating a point cloud representing the scene based on depth data from a depth sensor, and a step of identifying missing areas in the point cloud, such as areas hidden from the viewpoint of the depth sensor. The method may then include a step of generating depth data for the missing areas based on the image data. Finally, the depth data for the missing areas can be fused with depth data from the depth sensor to generate a fused point cloud representing the scene.

Images