Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Video matting based on foreground-background constraint propagation

A technology of background and foreground, applied in the field of video image matting method and device, can solve problems such as huge complexity

Inactive Publication Date: 2012-03-21
INTERDIGITAL CE PATENT HLDG
View PDF3 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the complexity of this method can be enormous due to the imposition of spatio-temporal edge consistency between the original image and the alpha matte

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video matting based on foreground-background constraint propagation
  • Video matting based on foreground-background constraint propagation
  • Video matting based on foreground-background constraint propagation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] Apart from the inventive concept, the elements shown in the drawings are known and will not be described in detail. For example, familiarity with digital image processing is assumed and not described here, other than the inventive concept. It should also be noted that embodiments of the invention may be implemented using various combinations of hardware and software. Finally, the same reference numbers in the figures denote similar elements.

[0020] In general, image matting methods process an input image I assumed to be a composite of a foreground image F and a background image B. The color of the i-th pixel is assumed to correspond to the foreground F i and background B i Linear combinations of colors or intensities:

[0021] I i = α i f i +(1-α i )B i , (1)

[0022] where α i is the foreground opacity of the i-th pixel and 0≤α≤1. Not all quantities on the right-hand side of Equation 1 are known. Thus, for a three-channel c...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A method for propagating user-provided foreground-background constraint information for a first video frame to subsequent frames allows extraction of moving foreground objects with minimal user interaction. Video matting is performed wherein constraints derived from user input with respect to a first frame are propagated to subsequent frames using the estimated alpha matte of each frame. The matte of a frame is processed in order to arrive at a rough foreground-background segmentation which is then used for estimating the matte of the next frame. At each frame, the propagated constraints are used by an image matting method for estimating the corresponding matte which is in turn used for propagating the constraints to the next frame, and so on.

Description

[0001] Related Patent Applications [0002] This application claims the benefit under 35 U.S.C. §119(e) of U.S. Provisional Application No. 61 / 207,261, filed February 10, 2009, the entire contents of which are hereby incorporated by reference into this application for all purposes. technical field [0003] The present invention generally relates to digital image processing, and in particular to a method and device for matting video images. Background technique [0004] Image matting is the process of extracting objects from an image with some human guidance. Image matting may be an interactive process that relies on limited user input, usually in the form of some scribbles, to mark foreground and background regions. Hereafter, "foreground" refers to the object to be extracted, while "background" refers to everything else in the image. [0005] Video matting is an extension of image matting, where the goal is to extract moving objects from video sequences. Video matting ca...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/36
CPCG06T2207/20092G06T7/2053G06T2207/20096G06T7/0097G06T2207/10016G06T7/174G06T7/254G06T11/00G06T11/006G06T11/60G06T11/80
Inventor S.巴加瓦西J.拉克
Owner INTERDIGITAL CE PATENT HLDG
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products