Training method and device of image super-division model and computer readable storage medium

A model and image technology, which is applied in the computer field, can solve the problems of difficult to achieve real-time response time, large amount of calculation, parameter volume, memory read and write, and difficult deployment, so as to maintain accuracy, solve degradation and gradient problems, and reduce The effect of calculation volume

Pending Publication Date: 2021-12-24
BEIJING QIYI CENTURY SCI & TECH CO LTD
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, this application provides a training method, device, and computer-readable storage medium for an image super-resolution model, which solves the calculation, parameter, and memory read/write volumes of the convolutional

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Training method and device of image super-division model and computer readable storage medium
  • Training method and device of image super-division model and computer readable storage medium
  • Training method and device of image super-division model and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0039] An exemplary embodiment of the present application will be described in more detail below with reference to the accompanying drawings. While the exemplary embodiments of the present application are shown, it is understood that the present application can be implemented in various forms and should not be limited herein. Instead, providing these embodiments is to be more thoroughly understood, and the scope of the present application can be fully communicated to those skilled in the art.

[0040] figure 1 It is a flow chart of a training method for an image super-division model provided by the embodiment of the present application, such as figure 1 As shown, the method can include:

[0041] Step 101 obtains a low resolution image and a high resolution image having the same content, and the initial model.

[0042] Wherein, the initial model includes a super-division module configured by a plurality of first tail connected information distillation sub-modules; the information ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a training method and device for an image super-division model. The training method comprises the steps of forming an initial model which comprises a super-division module composed of a plurality of information distillation sub-modules which are sequentially connected end to end, wherein the information distillation sub-module comprises a plurality of residual units which are sequentially connected end to end; inputting the low-resolution image into the initial model, and extracting shallow layer features of the low-resolution image; extracting the deep features from the shallow features through a super-division module; summing and fusing the shallow-layer features and the deep-layer features, and then performing up-sampling processing to obtain a super-resolution image output by the initial model; and training the initial model according to a loss function determined by the super-resolution image and the high-resolution image to obtain an image super-resolution model. According to the method, refined features can be extracted by using an information multi-distillation structure based on a residual unit, and superposing shallow features with the refined features, so that the problems of degradation and gradient generated when a model network is in a deep layer are solved, and the parameter quantity and the calculation quantity are greatly reduced.

Description

technical field [0001] The present application belongs to the field of computer technology, and in particular relates to a training method and device for an image super-resolution model, an image super-resolution method and device, and a computer-readable storage medium. Background technique [0002] Functions such as special effect cameras and shooting props have become standard configurations for video applications. However, due to the limitation of equipment computing power, the on-end model only allows inference at a small image resolution, resulting in blurred images. Therefore, super resolution is required. Algorithms to improve the overall image effect. [0003] In related technologies, a trained convolutional neural network model can be used to perform super-resolution processing on an original image to obtain a super-resolution image with higher definition. [0004] However, in the current solution, the convolutional neural network model has a large amount of calcu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T3/40G06N3/04G06N3/08
CPCG06T3/4053G06T3/4046G06N3/08G06N3/045Y02D10/00
Inventor 梁彦军
Owner BEIJING QIYI CENTURY SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products