An Optimal Method for Depth Image Restoration and Viewpoint Synthesis Based on Color Image Guidance

Abstract

The invention discloses a color map guide-based depth map restoration and view synthesis optimization method, which comprises the following steps: firstly, detecting inconsistent regions, detecting the edge of an input depth map, performing swelling processing on the edge, and marking the swelled edge as a potential inconsistent region; secondly, constructing a weight based on an iterative reweighting-based least squares algorithm, and after weight construction is completed, performing integral solving, and updating a depth map; judging whether the iteration is performed for set times or not according to a result; and if YES, outputting the depth map, and ending the calculation, or redetecting the inconsistent regions. The color map guide-based depth map restoration and view synthesis optimization method disclosed by the invention can suppress strong noise and restore inconsistent regions between the depth map and a color map to improve the consistency between the depth map and the color map and restore a correct boundary of the depth map, and has important guiding significance for improving the quality of a synthesized view. Meanwhile, the denoising and edge retaining capacity forconsistent regions is high; and an adopted matured iterative weighted least squares model is high in adaptability to parameters, and the robustness of the model is improved.

Description

technical field [0001] The invention belongs to the technical field of image processing, and in particular relates to a depth map restoration and viewpoint synthesis optimization method guided by a color map. Background technique [0002] With the advent of depth sensors and the rapid development of stereoscopic display technology, depth maps have become a research hotspot in recent years. There are two ways to obtain the depth map: active and passive. The active method mainly performs stereo matching on the visible light data of two or more viewpoints to calculate the disparity of the corresponding position, and then converts it into a depth map according to the geometric relationship. The accuracy of the depth map obtained by stereo matching has been greatly improved, but the calculation is complex, and the requirements for visible light data are high, which has certain limitations in practical applications. Passive type mainly refers to the direct acquisition of depth i...

AI Technical Summary

Problems solved by technology

This method takes into account the impact of the inconsistency between the depth image and the color image, but the edge extraction is highly dependent on the image gradient, the anti-noise ability is poor, and the consistency measure is only valid at the edge, and the repair of the inconsistent area value cannot be realized, and the scope of application is limited.

Images