Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method and apparatus for generating an interpolated frame image of a video

A technology for generating video and frame images, applied in the field of video processing, can solve problems such as inability to accurately compensate for frame insertion, inability to correctly estimate motion vectors, etc., and achieve the effect of good robustness and high image quality.

Inactive Publication Date: 2019-06-21
CHONGQING IQIYI INTELLIGENT TECHNOLOGY CO LTD
View PDF4 Cites 35 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the commonly used block matching algorithm has a fixed search step and only has a good frame interpolation effect for characteristic scenes.
[0004] However, the current traditional video frame interpolation method often cannot correctly estimate the accurate motion vector for the object occlusion and large motion displacement and rotation of the object in the video, so that it cannot accurately compensate for a frame interpolation picture

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and apparatus for generating an interpolated frame image of a video
  • A method and apparatus for generating an interpolated frame image of a video
  • A method and apparatus for generating an interpolated frame image of a video

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe operations as sequential processing, many of the operations may be performed in parallel, concurrently, or simultaneously. In addition, the order of operations can be rearranged. The process may be terminated when its operations are complete, but may also have additional steps not included in the figure. The processing may correspond to a method, function, procedure, subroutine, subroutine, or the like.

[0030] The term "computer equipment" in this context, also referred to as "computer", refers to an intelligent electronic device that can perform predetermined processing procedures such as numerical calculations and / or logic calculations by running predetermined programs or instructions, which may include a processor and The memory is realized by the processor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention aims to provide a method and a device for generating an inserted frame image of a video. The method comprises steps of respectively obtaining corresponding forward optical flow displacement mapping images and backward optical flow displacement mapping images according to the continuous first frame images and second frame images in the video; Performing feature extraction on the firstframe image and the second frame image respectively to obtain a first feature image and a second feature image; According to the first characteristic image, the second characteristic image, the forward optical flow displacement mapping image and the backward optical flow displacement mapping image, respectively obtaining a first characteristic image after compensation, a first visual image aftercompensation, a second characteristic image after compensation and a second visual image after compensation through motion compensation; And inputting the result into a video frame insertion model toobtain a frame insertion image. Compared with the prior art, the method has the advantages that two continuous frames of images in the video are utilized to directly interpolate one frame of interpolated image, and the method has better robustness for inaccurate motion vectors estimated under the conditions of object shielding and large displacement, so that the interpolated image with higher image quality is obtained.

Description

technical field [0001] The present invention relates to the technical field of video processing, in particular to a technology for generating interpolation frame images of videos. Background technique [0002] In the video frame interpolation method, motion estimation and motion compensation (Motion Estimate and Motion Compensation, MEMC) is usually used to interpolate an interpolation frame. In order to interpolate a correct frame interpolation picture, it is necessary to estimate the correct motion vector between related picture frames, and then interpolate the correct frame interpolation picture according to the estimated motion vector. [0003] In the existing traditional video frame interpolation method, the block matching algorithm is used to estimate the motion estimation, and the interpolation frame picture is compensated by the motion estimation. However, the commonly used block matching algorithm has a fixed search step and only has a better frame interpolation ef...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N5/14H04N7/01
Inventor 史杰王西颖
Owner CHONGQING IQIYI INTELLIGENT TECHNOLOGY CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com