Color and depth imaging method and device based on structured light and light-field imaging

Abstract

The invention discloses a color and depth imaging method based on structured light and light-field imaging. The method comprises steps as follows: a light field image of a preset shoot scene to be shot by a user is acquired; the acquired light field image is subjected to scene analysis, and a specific scene type of the preset shoot scene is acquired; a corresponding mode of structured light of the preset shoot scene is acquired and shot to the preset shoot scene according to the relation between different preset screen types and structured light in different modes; a depth image of the preset shoot scene under radiation of the structured light is acquired; color images and depth images in the light field image are extracted and processed and fused together with the depth image, and a comprehensive image with color and depth for the preset shoot scene is finally acquired. According to the color and depth imaging method based on structured light and light-field imaging and a device used for the method, an active and inactive combined depth imaging mode is adopted, an active depth imaging mode and an inactive depth imaging mode complement each other's advantages, color and depth imaging is realized, and the imaging quality is guaranteed.

Description

technical field [0001] The invention relates to the technical fields of optical engineering and computer vision, in particular to a color depth imaging method and device based on structured light and light field imaging. Background technique [0002] At present, with the continuous development of human science and technology, in computer vision systems, 3D scene information provides more possibilities for computer vision applications such as image segmentation, target detection, and object tracking. Compared with 2D images, depth images With the three-dimensional feature information of objects, that is, depth information, depth images are also widely used as a general expression of three-dimensional scene information. Therefore, the detection and recognition of three-dimensional objects using an imaging device that can capture both color and depth information will surely become a new hot spot in the field of computer vision, in which the acquisition of depth images is a key ...

AI Technical Summary

Problems solved by technology

[0005] However, although light field imaging can obtain enough information of the scene in one exposure process, and obtain depth information through computational imaging correlation algorithms, and achieve simultaneous acquisition of color images and depth images, it is not suitable for some images that lack texture and have no obvious grayscale changes. The depth information extraction of objects or scenes is poor

The biggest advantage of structured light depth imaging technology is that it can improve the accuracy of depth information in some special cases. For some surface areas that are smooth, lack texture, and have no obvious grayscale or shape changes, structured light can be used to form a clear image on the surface of the object. stripes, thus avoiding the problem of correlation matching in information-poor areas, but there are usually problems such as lack of depth information areas, noise, etc.

Images