Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Video segmentation method based on depth recovery and motion estimation

A technology of depth restoration and motion estimation, applied in computing, image analysis, image data processing, etc., can solve problems such as inability to effectively extract moving objects and difficulty in reliably estimating background information

Inactive Publication Date: 2013-09-04
ZHEJIANG UNIV +1
View PDF0 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, for the situation where the foreground motion is not large, this method cannot effectively extract the moving object because the background information is difficult to estimate reliably.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video segmentation method based on depth recovery and motion estimation
  • Video segmentation method based on depth recovery and motion estimation
  • Video segmentation method based on depth recovery and motion estimation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0111] 1. Solve the mapping relationship

[0112] In order to take any frame of image I i Mapped to another frame image I j , it is necessary to solve the image I i and image I j transformation relationship between them. The present invention proposes two different algorithms aiming at different situations of video sequence background scene motion. When the scene is not in planar motion, the camera motion and its dense depth map of each frame image can be estimated by using the video sequence consistent depth recovery method, and then any frame I i Pixels in the I j on the image. When the background scene is moving in a plane, we map between images by estimating the homography matrix between images. First estimate the homography matrix between consecutive frames. The KLT method is used to extract and match feature points for consecutive frames, and the matching points on moving objects are excluded as much as possible according to the initial segmentation results, so a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a video segmentation method based on depth recovery and motion estimation. The video segmentation method based on the depth recovery and motion estimation comprises the following steps of: (1) working out a background subtraction measure by using homography matrix estimation or using a camera motion and dense depth map recovered by a video sequence consistent depth recovery method; (2) performing dense motion estimation, and estimating dense motion fields d and occlusion maps o of continuous two frames of images; (3) calculating a video segmentation result according to an interactively generated combination strategy of multiple measures; and (4) repeating the step (3) for at least two times, and then, ending. Firstly, according to the video segmentation method based on the depth recovery and motion estimation disclosed by the invention, videos can be segmented by iterative optimization of motion, depth and segmentation information. Secondly, according to the video segmentation method based on the depth recovery and motion estimation disclosed by the invention videos of which the backgrounds do a planar motion can be segmented without estimating camera parameters and the depth information. Finally, the video segmentation method based on the depth recovery and motion estimation disclosed by the invention is a video segmentation method of combining multiple measures, the accuracy of various measures can be measured, and reliable measures are screened out to involve in video segmentation calculation.

Description

technical field [0001] The invention relates to a video segmentation method, in particular to a video segmentation method based on depth restoration and motion estimation. Background technique [0002] Video segmentation refers to dividing each frame of video into several regions according to certain rules. It has a wide range of applications in pattern recognition, computer vision, video retrieval, scene recognition and other fields. Video segmentation is developed on the basis of image segmentation. Traditional image segmentation algorithms are generally based on image color, edge, texture and other metrics. One of the difficulties in video segmentation is that both the camera and the object may move, and the motion composition is relatively complex (may include both translation and rotation). Double-layer video segmentation is a video segmentation that divides the image of each frame in the video into two regions, the foreground and the background. [0003] For situatio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/20H04N13/00
Inventor 章国锋鲍虎军孙佰贵熊君君
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com