Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A way to generate new video frames

A video frame and video technology, applied in the field of video editing, can solve problems such as inaccurate estimation, poor effect of new video frames, and low efficiency

Active Publication Date: 2020-10-30
FUDAN UNIV
View PDF8 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, such methods require step-by-step processing and cannot generate new video frames end-to-end, so a lot of time is wasted and the efficiency is low
In addition, the traditional motion estimation method often cannot accurately estimate the motion existing in the video, resulting in the existence of motion errors and making the generated new video frame effect worse.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A way to generate new video frames
  • A way to generate new video frames
  • A way to generate new video frames

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0062] For a video clip with a limited number of video frames, you can use figure 1 The method described is implemented.

[0063] The specific implementation method is:

[0064] First, two frames before and after the video (I 1 , I 2 ) input optical flow estimation network PWCNET [6] In , pass through a dilated convolutional layer and calculate the correlation of the generated features; finally, input the cv into 5 convolutional layers with a size of 3×3 and feature numbers of 128, 128, 96, 64, and 32 to generate light flow (f 1→2 H / 4,W / 4 , f 2→1 H / 4,W / 4 ); Use bilinear interpolation to downsample the original video (I 1 H / 4,W / 4 , I 2 H / 4,W / 4 ), and then combine it with the optical flow (f 1→2 H / 4,W / 4 , f 2→1 H / 4,W / 4 ) cascaded into the first sub-network NET 1 , learn the optical flow between the new video frame and the two frames before and after (f t→1 H / 4,W / 4 , f t→2 H / 4,W / 4 ) and its corresponding mask (m 1 H / 4,W / 4 ,m 2 H / 4,W / 4 );

[0065] Next, ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a method for generating a new video frame, and belongs to the technical field of video editing. An optical flow of former and latter video frames is used to estimate an optical flow from a newly generated intermediate frame to the former and latter video frames, and corresponding inverse interpolation is carried out on the former and latter frames according to an optical flow value to generate a new intermediate video frame. The new video frame is predicted from coarsely to finely by combining association between the former and latter frames with a multi-scale framework, and according to an experimental result, the intermediate video frame of higher quality is generated, the time continuity of a new video is maintained, am rapid and almost real-time processing effect is achieved, and compared with a traditional video frame inserting method, the method of the invention has higher application value and wider research meanings.

Description

technical field [0001] The invention belongs to the technical field of video editing, and relates to a video frame insertion method. Background technique [0002] Traditional video frame insertion technology is basically a research branch of video quality enhancement technology. It is a modern video processing technology with high scientific research value and wide application fields. [0003] The number of video frames is an important indicator to measure the quality of the video. The more the number of video frames, the more information the video contains, and the smoother and more stable the viewing effect. Therefore, video with more frames has important application and scientific research value in various fields. However, due to the conditional restrictions in the process of video collection, storage, and transmission, it is impossible to obtain video clips with more frames. Usually, the cost of obtaining video cameras with more frames is very high, and it also takes u...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N19/132H04N19/577
CPCH04N19/132H04N19/577
Inventor 颜波林楚铭谭伟敏马晨曦
Owner FUDAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com