Method for automatically filling structure information and texture information of hole area of image scene

Abstract

The invention provides a method for automatically filling the structure information and texture information of a hole area of an image scene. By adoption of the method, the texture information and structure information of the hole area of the image scene can be automatically filled, and the visual continuity and reasonability of the filled image scene are ensured. The method comprises the following steps of: firstly, dividing an image into a structure part and a texture part based on an image main brief graph model, and calculating the geometrical characteristic of the structure part; secondly, automatically connecting a missing structure line of the hole area by using a tensor voting algorithm, and finishing the filling of the structure information of the hole area; thirdly, on this basis, according to confidence, gradient and a distance value, calculating the priority of boundary points of the hole area, quickly searching a similar image block based on a uniform image descriptor and a k-d tree by using an image block of the boundary point with the highest priority, and determining a candidate image block which is used for filling the hole area by using a greedy algorithm idea; and finally, fusing the candidate image block and the known image, and finishing the filling of the texture information of the hole area. The method can be widely applied and popularized to the fields of film and television program production, sports research, training simulation and the like.

Description

technical field [0001] The invention belongs to the fields of image processing, computer vision technology and virtual reality, in particular to a method for automatically filling in the structure and texture information of an image scene hole region. Background technique [0002] The virtual-real fusion scene generation technology based on video image material is an important part of virtual reality, and it is also a research hotspot in the organic intersection of virtual reality, augmented reality, computer vision and related research directions. During the entire process of image virtual scene generation, the following situations may occur: After extracting some scene objects in the video scene to form scene object materials, the original video scene will appear "hole" phenomenon; adding different sources to the video virtual scene In the past, some unnecessary objects or objects may need to be removed from the scene; in the process of editing and merging scene objects, n...

AI Technical Summary

Problems solved by technology

Minimizing the Euler elastic functional often results in a smooth curve, but cannot obtain the filling effect of broken line or cross structure information

Images