Complex background real-time alternating method based on background modeling and energy minimization

Abstract

The invention provides a complex background real-time alternating method based on background modeling and energy minimization, comprising the steps of: firstly, segmenting a current frame image into a foreground pixel set, a background pixel set and an unknown label pixel set by using a provided fusion background model; secondly, constructing a target energy function according to the color and contrast information under a dynamic diagram cutting frame, designing a data item of the fusion background model based on time continuity information and a contrast smooth item based on a local two-value mode, solving two-value labels of all pixels by using a diagram cutting algorithm minimization energy function; and seamlessly fusing segmented foreground targets into a virtual background by adopting postprocessing methods of boundary smooth, alpha value estimation and the like. Experimental results show that the method can better segment the targets in the complex background in real time and really synthesize the segmented targets into the virtual background. The invention has the characteristics of automatically segmenting the complex background in real time and replacing the segmented complex background into the virtual background to obtain a virtual effect sequence diagram with high quality.

Description

technical field [0001] The invention relates to the fields of image processing and computer vision, in particular to a method for accurately segmenting and replacing complex backgrounds in video streams in real time. Background technique [0002] At present, video object segmentation methods can be divided into interactive segmentation and automatic segmentation algorithms. The interactive video target segmentation algorithm refers to intervening the algorithm with the help of user interaction information in the segmentation process to improve the segmentation effect. Although the interactive segmentation technology has made great progress, there are still some problems. For example, the interaction is cumbersome, the workload is heavy, and there are certain skills in the interaction. The quality of the interaction directly affects the final segmentation effect; the automatic segmentation algorithm does not need manual intervention in the segmentation process, and automatic...

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problem of real-time and accurate background replacement under a complex background with a single camera, the purpose of the present invention is to provide a complex background real-time replacement method based on background modeling and energy minimization, which can accurately segment the foreground and background in real time, and The obtained real background is replaced with a virtual background picture to generate a video effect with a virtual background

Images