Model training method and device, frame image generation method and device, frame insertion method and device, equipment and medium

A model training and image technology, applied in the field of model training, can solve the problem of inaccurate intermediate frame images

Pending Publication Date: 2020-11-06
NETEASE (HANGZHOU) NETWORK CO LTD
View PDF0 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to provide a model training, frame image generation, frame interpolation method, device, equipment, and medium to solve the above-mentioned deficiencies in the prior art, so as to solve the kernel estimation method adopt

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Model training method and device, frame image generation method and device, frame insertion method and device, equipment and medium
  • Model training method and device, frame image generation method and device, frame insertion method and device, equipment and medium
  • Model training method and device, frame image generation method and device, frame insertion method and device, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0098] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments.

[0099]Accordingly, the following detailed description of the embodiments of the application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely represents selected embodiments of the application. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

[0100] It should be noted that the terms "first" and "second" in the description and claims of the pr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a model training method and device, a frame image generation method and device, a frame insertion method and device, equipment and a medium and relates to the technical field ofmodel training. The method is applied to a neural network model and adopts a first feature extraction module to extract local features of front and back frame images of a sample; a second feature extraction module is adopted to extract non-local features of front and back frame images of the sample; a frame synthesis module is adopted to generate a sample intermediate frame image according to thesynthesis features of the local features and the non-local features; and the neural network model is trained according to the sample intermediate frame image and the corresponding label intermediateframe image to obtain a trained neural network model. According to the neural network model obtained by training based on the mode, the receptive field is expanded, the learning ability of large changes in front and back frame images is enhanced, and when the front and back frame images are processed based on the trained neural network model, the generated middle frame image is more accurate.

Description

technical field [0001] The present invention relates to the technical field of model training, in particular, to a method, device, equipment and medium for model training, frame image generation, and frame insertion. Background technique [0002] The frame rate refers to the frequency at which continuous images are displayed on the monitor. The higher the frame rate within a certain range, the smoother the picture. Due to force majeure such as cost issues, hardware limitations, and network transmission, usually only low frame rate pictures can be obtained. Therefore, intermediate frames can be generated between existing frames by frame interpolation to make the picture smoother. [0003] In the related art, a convolution kernel is trained for each pixel in the previous frame image and the rear frame image by means of kernel estimation, and the intermediate frame image is generated by performing convolution operations with several independent convolution kernels on the front ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62G06K9/46G06N3/04
CPCG06V10/40G06N3/045G06F18/214Y02T10/40
Inventor 陈伟民袁燚范长杰胡志鹏
Owner NETEASE (HANGZHOU) NETWORK CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products