Super-resolution restoration network model generation method, image super-resolution restoration method and image super-resolution restoration device

A network model and image technology, applied in the field of image processing, can solve problems such as the inability to balance the repair effect and delay, and the time-consuming over-score repair method.

Pending Publication Date: 2021-07-27
BEIJING YOUZHUJU NETWORK TECH CO LTD
View PDF3 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in order to achieve a better repair effect, many super-resolution repair methods

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Super-resolution restoration network model generation method, image super-resolution restoration method and image super-resolution restoration device
  • Super-resolution restoration network model generation method, image super-resolution restoration method and image super-resolution restoration device
  • Super-resolution restoration network model generation method, image super-resolution restoration method and image super-resolution restoration device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] In order to make the above objects, features and advantages of the present application more obvious and understandable, the embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0052] In the research of image restoration, the inventors found that traditional image restoration methods generally have the problem of unbalanced restoration effect and processing delay, resulting in serious time-consuming. In addition, the traditional image super-resolution restoration method uses Peak Signal to Noise Ratio (PSNR) as an index to perform super-resolution restoration network training. Among them, PSNR mainly calculates the mean square error between the original image and the processed image, which cannot be consistent with the visual effect seen by the human eye, which affects the restoration effect.

[0053] Based on this, the embodiment of the present application p...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a super-resolution restoration network model generation method. The method specifically comprises the steps: obtaining a to-be-trained image, and inputting the to-be-trained image into a student network model and a teacher network model, so as to obtain a loss function corresponding to the student network model; and updating parameters of the student network model according to the loss function, so that the loss function of the student network model meets a preset condition, and generating and obtaining a super-resolution restoration network. The student network model is an ESRGAN network, and the ESRGAN network comprises a basic module, an up-sampling module and a convolution module. The basic module comprises one or more RRDB modules, each RRDB module comprises a plurality of processing modules, the input of each processing module is used as the input of a subsequent processing module, the transmission of features is enhanced, the subsequent processing module is enabled to use more image features for training, and the restoration effect is improved. A first convolution layer with a smaller convolution kernel is added in the processing modules, so that the dimension of image features is reduced, the calculation amount is reduced, and the processing speed is improved.

Description

technical field [0001] The present application relates to the technical field of image processing, and in particular to a method for generating a super-resolution inpainting network model, an image super-resolution inpainting method and a device. Background technique [0002] With the continuous development of Internet technology, short, flat, fast and high-traffic communication content has gradually gained the favor of major platforms and users, especially the transmission of short videos. However, due to noise, compression and other losses, video and image images are blurred and noisy, resulting in poor display images. [0003] In order to improve the quality of the image, a large number of image restoration methods have appeared, such as using the super-resolution restoration network to repair the image. However, in order to achieve a better repair effect, many super-resolution repair methods are time-consuming, resulting in an inability to balance the repair effect and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T5/00G06T3/40G06N3/04G06N3/08
CPCG06T5/005G06T3/4053G06T3/4046G06N3/08G06T2207/20081G06T2207/20084G06N3/045
Inventor 孙佳袁泽寰王长虎
Owner BEIJING YOUZHUJU NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products