Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Motion compensation method and system based on occlusion detection

A technology of occlusion detection and motion compensation, applied in the field of image processing, which can solve the problems that the proportion of exposed/occluded areas is small and cannot be completely removed

Active Publication Date: 2020-01-03
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although these methods can detect most of the exposed / occluded areas, since these methods are block-based methods, at the junction of the exposed / occluded area and the background, there may be a small proportion of the exposed / occluded area in the junction block , causing the block to be detected as a normal area (not an exposed / occluded area), resulting in a circle of halo at the junction of the exposed / occluded and background after motion compensation
Even if post-processing and filtering are used, the above-mentioned halo effect can only be reduced, but not completely removed.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Motion compensation method and system based on occlusion detection
  • Motion compensation method and system based on occlusion detection
  • Motion compensation method and system based on occlusion detection

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0093] Preferred embodiments of the present invention are described below with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are only used to explain the technical principles of the present invention, and are not intended to limit the protection scope of the present invention.

[0094] The present invention proposes a motion compensation method based on occlusion detection, such as figure 1 shown, including the following steps:

[0095] Step 1, perform motion estimation, generate forward motion vector and backward motion vector;

[0096] Step 2, perform occlusion detection, and detect exposed blocks and occluded blocks on the interpolated frame;

[0097] Step 3, calculating the exposure and occlusion probabilities of blocks in the interpolation frame and generating interpolation weights;

[0098] Step 4, generating the motion vector of the interpolated frame;

[0099] Step 5, correcting the interpolation weights o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a motion compensation method and system based on occlusion detection. The motion compensation method comprises the following steps: carrying out motion estimation to obtain a frontward motion vector and a backward motion vector, and detecting a revealed / shielded region; calculating revealing / shielding probability according to an overlapped area of a position where the motion vector reaches an interpolation frame and a block to be processed and calculating an interpolation weight ; calculating to obtain the motion vector of the interpolation frame according to respective corresponding frontward and backward motion vectors of the former frame and the current frame and a detection result of the revealed / shielded region; detecting a crossed part of the revealed / shielded region and a background through the consistency of the motion vector of the interpolation frame and the interpolation weight and correcting the interpolation weight; carrying out interpolation to obtain pixel-by-pixel interpolation weight; interpolating according to the motion vector of the interpolation frame and the pixel interpolation weight to finally obtain a video with the improved frame rate. The accuracy of detecting the revealed / shielded region is improved and a halo phenomenon in a motion compensation image is remarkably alleviated.

Description

technical field [0001] The invention relates to the field of image processing, in particular to a motion compensation method and system based on occlusion detection. Background technique [0002] Due to the hold-type display characteristics of liquid crystal displays, motion blur and jitter will appear when playing moving pictures. The above-mentioned distortion can be alleviated by increasing the video frame rate through motion compensation technology. [0003] Due to the difference in motion of different areas in the image, exposed areas and occluded areas are formed. These areas only exist in one frame of two adjacent frames. Using the traditional motion estimation method based on two frames before and after, may cause exposed / occluded areas. The motion vector estimation error and the motion compensation error of , appear halo effect around the object, which is called halo. [0004] The existing occlusion detection methods mainly use two motion vector fields obtained by...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N5/14
CPCH04N5/144H04N5/145
Inventor 韩睿郭若杉李晨刘壮
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products