Self-adaptive super-resolution method based on meta transfer learning

A technology of super-resolution and transfer learning, applied in neural learning methods, image analysis, image data processing, etc., can solve problems such as poor model performance, difficult model reproduction, ignoring the computational burden of deep neural networks, etc., and achieve generalization ability Strong, good reconstruction effect

Pending Publication Date: 2021-10-08
WEIHAI POWER SUPPLY COMPANY OF STATE GRID SHANDONG ELECTRIC POWER COMPANY
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] The concept of super-resolution was first proposed in the 1960s. Super-resolution initially only meant the restoration of a single image, and then various image restoration methods appeared, but this technology has not been widely used in practice.
[0007] (1) Most of the focus is on the design of the model structure and the data set, and many methods ignore the computational burden brought by the deep neural network. Performance on actual super-resolutio

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Self-adaptive super-resolution method based on meta transfer learning
  • Self-adaptive super-resolution method based on meta transfer learning
  • Self-adaptive super-resolution method based on meta transfer learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The specific implementation manners of the present application will be further described below in conjunction with the accompanying drawings.

[0033] Such as figure 1 As shown, the adaptive super-resolution method based on meta-transfer learning involved in this application includes the following steps:

[0034] Step 1. Pre-train the adaptive super-resolution model based on meta-transfer learning through the external image data set, so that the model can initially learn the basic prior information of image reconstruction, that is, initially learn the common features of the image, and provide a basis for transfer Learning lays the foundation. Among them, the external image dataset refers to some recognized image collections in the field of image processing.

[0035] For the pre-training process, the preprocessing of the external image dataset is the same as the conventional model using bicubic interpolation to construct image pairs, and the adaptive super-resolution m...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a self-adaptive super-resolution method based on meta transfer learning, which comprises the following steps: pre-training a self-adaptive super-resolution model based on meta transfer learning through an external image data set, so that the model can learn prior information of image reconstruction; performing random parameter down-sampling on images in the external image data set through a random Gaussian sampling method, so that training data in a meta transfer learning process contains multi-task information; performing down-sampling on a to-be-reconstructed target low-resolution image to obtain a low-resolution sub-image, and training the model by taking the low-resolution image and the low-resolution sub-image as training data; performing adversarial training by means of a twin neural network and the model, and adjusting model parameters by comparing the difference between a low-resolution image and a low-resolution sub-image to complete model training; and applying the model to a target image to reconstruct and generate a super-resolution image. According to the method, the image reconstruction quality can be improved, and the generalization ability of the super-resolution model is enhanced.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to an adaptive super-resolution method based on meta-transfer learning. Background technique [0002] The concept of super-resolution was first proposed in the 1960s. Super-resolution initially only meant the restoration of a single image, and various image restoration methods appeared later, but this technology has not been widely used in practice. At the end of the 20th century, with the development of computer technology, signal processing theory and optimization theory, a series of super-resolution methods have been proposed, mainly including interpolation-based, reconstruction-based and learning-based methods. Today, the vigorous development of deep learning technology has brought the performance of image super-resolution to a higher level. The current research on super-resolution includes image super-resolution based on interpolation, image super-resolution b...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T3/40G06N3/04G06N3/08
CPCG06T3/4053G06T3/4007G06N3/088G06T2207/20081G06N3/045
Inventor 卢媛范春磊冷小洁栾卫平杨尉穆芮顾建伟王伟荣俊兴李柔霏赵慧群张睿杨冉昕王丽锋王艳红周子程张志浩黄征贺艳丽冯逊周学军张赟施举鹏李静羊麟威杨禹太陶方杰孔亮
Owner WEIHAI POWER SUPPLY COMPANY OF STATE GRID SHANDONG ELECTRIC POWER COMPANY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products