Color video matting method based on depth foreground tracking

Abstract

The invention proposes a color video matting method based on depth foreground tracking, which relates to the field of digital image processing. The method comprises: before the starting of the matting, defining a clear search area by a user at a designated foreground area of a depth image; then in the search box, using the depth information difference of the foreground, segmenting the foreground targets; reconstructing the depth image to the resolution of the color image and performing the registration so that the pixels of the two gradually correspond to each other and generating a three-part map; according to the color information of the color image, making the refined adjustment to the three-part map; based on the three-part map and the color image, using the super-pixel gradient for fast foreground extraction; and finally according to the extracted foreground position, establishing and updating the motion equation; predicting the foreground center of the next frame; and updating the search box position. With the above steps, the video matting can be completed frame by frame. Compared with the current video matting algorithm, the invention greatly simplifies the operation, has low complexity of the algorithm, and realizes the real-time and accurate video foreground matting.

Description

technical field [0001] The invention relates to the field of digital image processing, in particular to a color video matting method based on depth foreground tracking. Background technique [0002] Video matting is an extension of digital image matting on video, that is, in each frame, the foreground, background and transparency are calculated separately, the foreground object is cut out from the video background, and then it can be combined with any background image to create a Realistic scene change effect. [0003] At present, real-time video session cutouts often require a pure green curtain as the background, and the characters are cut out and combined with other backgrounds. However, video matting under complex backgrounds is still at the stage of laboratory research, and requires the use of key frames or 3D space-time labeling methods. The interaction is more complicated and cannot be completed in real time, but can only be post-processed on video files. In the key...

AI Technical Summary

Problems solved by technology

The disadvantages of the existing video matting strategy are: some key frames in the video sequence need to be marked, and the workload of manual interaction is heavy; the processing time cannot meet the real-time requirements, and the algorithm is often post-processing; affected by the propagation strategy, local Artifacts and jumps at edges

Images