Method for generating new video frame

A video frame and video technology, applied in the field of video editing, can solve the problems of inaccurate estimation, low efficiency, waste of time, etc., and achieve the effect of good video frame insertion effect

Active Publication Date: 2019-01-04
FUDAN UNIV
View PDF8 Cites 47 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, such methods require step-by-step processing and cannot generate new video frames end-to-end, so a lot of time is wasted and the efficiency is low
In addition, the traditional motion estimation method often cannot accurately estimate the motion existing in the video, resulting in the existence of motion errors and making the generated new video frame effect worse.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for generating new video frame
  • Method for generating new video frame
  • Method for generating new video frame

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0062] For a video clip with a limited number of video frames, you can use figure 1 The method described is implemented.

[0063] The specific implementation method is:

[0064] First, two frames before and after the video (I 1 , I 2 ) input optical flow estimation network PWCNET [6] In , pass through a dilated convolutional layer and calculate the correlation of the generated features; finally, input the cv into 5 convolutional layers with a size of 3×3 and feature numbers of 128, 128, 96, 64, and 32 to generate light flow (f 1→2 H / 4,W / 4 ,f 2→1 H / 4,W / 4 ); Use bilinear interpolation to downsample the original video (I 1 H / 4,W / 4 , I 2 H / 4,W / 4 ), and then combine it with the optical flow (f 1→2 H / 4,W / 4 ,f 2→1 H / 4,W / 4 ) cascaded into the first sub-network NET 1 , learn the optical flow between the new video frame and the two frames before and after (f t→1 H / 4,W / 4 ,f t→2 H / 4,W / 4 ) and its corresponding mask (m 1 H / 4,W / 4 ,m 2 H / 4,W / 4 );

[0065] Next, the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method for generating a new video frame, and belongs to the technical field of video editing. An optical flow of former and latter video frames is used to estimate an optical flow from a newly generated intermediate frame to the former and latter video frames, and corresponding inverse interpolation is carried out on the former and latter frames according to an optical flow value to generate a new intermediate video frame. The new video frame is predicted from coarsely to finely by combining association between the former and latter frames with a multi-scale framework, and according to an experimental result, the intermediate video frame of higher quality is generated, the time continuity of a new video is maintained, am rapid and almost real-time processing effect is achieved, and compared with a traditional video frame inserting method, the method of the invention has higher application value and wider research meanings.

Description

technical field [0001] The invention belongs to the technical field of video editing, and relates to a video frame insertion method. Background technique [0002] Traditional video frame insertion technology is basically a research branch of video quality enhancement technology. It is a modern video processing technology with high scientific research value and wide application fields. [0003] The number of video frames is an important indicator to measure the quality of the video. The more the number of video frames, the more information the video contains, and the smoother and more stable the viewing effect. Therefore, video with more frames has important application and scientific research value in various fields. However, due to the conditional restrictions in the process of video collection, storage, and transmission, it is impossible to obtain video clips with more frames. Usually, the cost of obtaining video cameras with more frames is very high, and it also takes u...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N19/132H04N19/577
CPCH04N19/132H04N19/577
Inventor 颜波林楚铭谭伟敏马晨曦
Owner FUDAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap