The invention provides a novel viewpoint synthesis method based on a
depth map. The method comprises the steps of firstly, obtaining a virtual viewpoint
color image and a virtual viewpoint depth image through 3D (three-dimensional)
image transformation, and removing small cavities and mapping error points; then, carrying out cavity filling on the virtual viewpoint depth image, and recording pixel coordinates at the cavities; afterwards, carrying out reversed 3D
image transformation, locating a target area, for forming the cavities, in a target frame of a reference viewpoint, and carrying out background
recovery on the target area by utilizing the previous frame and the next frame; and finally, repairing the remaining cavities by using an image repairing
algorithm based on a sample. According to the method, time and space domains are combined for filling the cavities by utilizing the image information of the previous frame and the next frame, such a cavity filling operation has the advantages that the result is more accurate, and the quality of the virtual viewpoint image is improved compared with the cavity filling operation purely based on the space domain; and in addition, the target area is located via reversed mapping, the background
recovery is performed in a targeted way, and the larger-scale background
recovery can be used for realizing more efficient cavity
filling in the similar result condition.