Complex background real-time alternating method based on background modeling and energy minimization

A technology of energy minimization and background modeling, applied in image data processing, instrumentation, computing, etc., to achieve the effect of improving segmentation efficiency, accurate results, and simple construction

Inactive Publication Date: 2010-07-14
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF0 Cites 70 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problem of real-time and accurate background replacement under a complex background with a single camera, the purpose of the present invention is to provide a complex background real-time replacement method based on ba

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Complex background real-time alternating method based on background modeling and energy minimization
  • Complex background real-time alternating method based on background modeling and energy minimization
  • Complex background real-time alternating method based on background modeling and energy minimization

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0043] The present invention will be described in detail below in conjunction with the accompanying drawings. It should be pointed out that the described embodiments are only intended to facilitate the understanding of the present invention and do not have any limiting effect on it.

[0044] figure 1 It is a flowchart of a real-time replacement method for complex backgrounds. According to the flow sequence, the specific implementation process of each step of the method of the present invention is as follows:

[0045] 1. Read in the video stream

[0046] The system first obtains the video stream data. There are two ways to obtain video data: one is the image sequence collected by the camera in real time. The second is the video files collected in advance.

[0047] 2. Background learning, construct a fusion background model

[0048] (21) Learning N-frame image sequence; generally learning 40-80 frames, about 2s;

[0049] (22) Establish a feature background based on brightness informatio...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a complex background real-time alternating method based on background modeling and energy minimization, comprising the steps of: firstly, segmenting a current frame image into a foreground pixel set, a background pixel set and an unknown label pixel set by using a provided fusion background model; secondly, constructing a target energy function according to the color and contrast information under a dynamic diagram cutting frame, designing a data item of the fusion background model based on time continuity information and a contrast smooth item based on a local two-value mode, solving two-value labels of all pixels by using a diagram cutting algorithm minimization energy function; and seamlessly fusing segmented foreground targets into a virtual background by adopting postprocessing methods of boundary smooth, alpha value estimation and the like. Experimental results show that the method can better segment the targets in the complex background in real time and really synthesize the segmented targets into the virtual background. The invention has the characteristics of automatically segmenting the complex background in real time and replacing the segmented complex background into the virtual background to obtain a virtual effect sequence diagram with high quality.

Description

technical field [0001] The invention relates to the fields of image processing and computer vision, in particular to a method for accurately segmenting and replacing complex backgrounds in video streams in real time. Background technique [0002] At present, video object segmentation methods can be divided into interactive segmentation and automatic segmentation algorithms. The interactive video target segmentation algorithm refers to intervening the algorithm with the help of user interaction information in the segmentation process to improve the segmentation effect. Although the interactive segmentation technology has made great progress, there are still some problems. For example, the interaction is cumbersome, the workload is heavy, and there are certain skills in the interaction. The quality of the interaction directly affects the final segmentation effect; the automatic segmentation algorithm does not need manual intervention in the segmentation process, and automatic...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/00
Inventor 王阳生吴晓雨李基拓
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products