Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Single-image super-resolution method

A single image, super-resolution technology, applied in image data processing, graphics and image conversion, neural learning methods, etc., can solve the problems that objective evaluation indicators cannot truly reflect subjective visual effects, and evaluation results vary from person to person.

Active Publication Date: 2020-04-21
SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Image quality evaluation index is an important part of evaluating super-resolution image quality. It is mainly divided into two categories: objective evaluation and subjective evaluation. The commonly used objective evaluation indexes include mean square error (MSE), peak signal-to-noise ratio (PSNR) and structural similarity Sex Index (SSIM), but objective evaluation indicators often cannot truly reflect human subjective visual effects
Subjective evaluation mainly relies on methods such as manual scoring and averaging, which can effectively reflect the quality of visual effects, but due to different subjective feelings, the evaluation results often vary from person to person

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Single-image super-resolution method
  • Single-image super-resolution method
  • Single-image super-resolution method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments. It should be understood that in the technical field involving image super-resolution, the so-called low-resolution images and high-resolution images are only relative concepts, not the definition of resolution after dividing specific numerical values, and do not belong to the meaning identified in the review guidelines Uncertain terms.

[0029] The specific embodiment of the present invention proposes a method for super-resolution of a single image, refer to figure 1 , the method includes the following steps S1 to S6:

[0030] Step S1, using such as bicubic interpolation method, nearest neighbor interpolation method or bilinear interpolation method to perform upsampling on a single low-resolution image (denoted as P0) to obtain image P1; image P1 has a higher resolution than image P0 high.

[0031] Step S2, taking P1 as the input of the deep l...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a single-image super-resolution method. The method comprises the following steps: up-sampling a single low-resolution image to obtain an image P1; inputting the P1 into a VDSR,and outputting a high-resolution image P2; performing Saak transformation on the P1 and the P2 by using the transformation kernels T1 and T2 respectively, and obtaining 2n2 Saak feature maps by usingthe P1 and the P2 respectively, wherein the transformation kernel T1 and the transformation kernel T2 are respectively calculated by P1 and P2, the convolution kernel of Saak transformation is n * n,and n is a natural number; selecting the first m Saak feature maps from the 2n2 Saak feature maps of the P1 as a training set to train a convolutional neural network, inputting the selected m Saak feature maps into the convolutional neural network, and outputting the m feature maps of the P1, 1 < = m < = n2; selecting the last 2n2-m Saak feature maps from the 2n2 Sak feature maps of P2 to form 2n2 maps with the m feature maps of P1 output by the convolutional neural network, and performing Saak inverse transformation to obtain a high-resolution image P3; and fusing P2 and P3 to obtain a finalhigh-resolution image P4.

Description

technical field [0001] The invention relates to the fields of computer vision and digital image processing, in particular to a single image super-resolution method. Background technique [0002] Single image super-resolution reconstruction technology refers to an image processing technology that uses a computer to process a low-resolution image to restore a high-resolution image. It has always been a very popular direction in the field of computer vision. High resolution means that the image has a high pixel density, which can provide more details, which often play a key role in the application. Therefore, it is widely used in video surveillance, target detection, face recognition, automatic driving and other fields. [0003] Due to the asymmetry of high- and low-resolution image information, this is a typical ill-posed problem, that is, a low-resolution image often corresponds to countless high-resolution solutions. In the current super-resolution algorithm, whether it is...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40G06N3/04G06N3/08
CPCG06T3/4053G06N3/08G06N3/045Y02D10/00
Inventor 张永兵李晶晶季向阳王好谦戴琼海杨芳
Owner SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products