Infrared image super-resolution reconstruction method based on generative adversarial network

A super-resolution reconstruction and infrared image technology, which is applied in biological neural network models, image data processing, graphics and image conversion, etc., can solve problems such as fuzzy details, inconsistent subjective visual impressions, low structural similarity, etc., and achieve realistic vision Effect, improve the effect of objective evaluation index

Inactive Publication Date: 2020-08-25
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF4 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

But its disadvantage is that there will be artifacts in the low-frequency area, that is, the texture that does not exist, and the details of the high-frequency area will be blurred after zooming in. The objective evaluation indicators of the generated image, the peak signal-to-noise ratio PSNR and the structural similarity SSIM are too low, which does not match the subjective visual impression.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Infrared image super-resolution reconstruction method based on generative adversarial network
  • Infrared image super-resolution reconstruction method based on generative adversarial network
  • Infrared image super-resolution reconstruction method based on generative adversarial network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] S1. Select a BSD300 training data set, input the low-resolution image into the generation network, and output the generated high-resolution image.

[0039] S1.1. Input a low-resolution image into a convolutional layer and output a linear feature map.

[0040] S1.2. Input the linear feature map into the modified linear unit, that is, the activation layer, to obtain a nonlinear feature map.

[0041] S1.3. Pass the nonlinear feature map through 6 residual network modules with the same structure. The composition of each residual network module is a convolutional layer, which is used to extract the feature map of the input feature; then a batch normalization layer, which can prevent the gradient from disappearing; followed by a corrected linear unit, that is, the ReLU activation function layer, adding The nonlinearity of the network prevents the gradient from disappearing; then the convolution layer and the batch normalization layer; finally, the skip connection is used to ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an infrared image super-resolution reconstruction method based on a generative adversarial network, and belongs to the field of computer vision. According to the method, two aspects of a generation network and a loss function of an existing algorithm SRGAN are improved; in the improvement of the structure of the generation network, the generation network is combined with atraditional bicubic interpolation method; in the improvement of a loss function, in order to obtain high objective evaluation indexes (peak signal-to-noise ratio and structural similarity) while a good visual effect is achieved, pixel-by-pixel mean square error loss is added into the loss function of a generation network. Compared with the original SRGAN algorithm, the improved algorithm has the advantages that the low-frequency region of the reconstructed image is smoother, artifacts are reduced, high-frequency details are clearer, and the peak signal-to-noise ratio (PSNR) and the structuralsimilarity (SSIM) of the objective evaluation index are both improved.

Description

technical field [0001] The invention belongs to the field of computer vision, and in particular relates to an infrared image super-resolution reconstruction technology based on a generation confrontation network capable of obtaining clear high-frequency details. Background technique [0002] Infrared imaging refers to a technology that uses a detector to receive infrared rays reflected by a target object and obtain an infrared image through photoelectric conversion. Infrared imaging technology has many applications in civil and military fields. Infrared imaging technology has the advantages of strong ability to penetrate smog and dust, long detection distance, little influence by external light, and sensitivity to thermal radiation of objects. With these advantages, infrared imaging technology can be widely used in the fields of quality inspection and safety inspection, and can also assist visible light imaging in environments with smog or poor lighting conditions, and work...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40G06N3/04G06N3/08
CPCG06T3/4053G06N3/08G06N3/045
Inventor 贾海涛周兰兰贾宇明许文波罗欣王磊赵行伟范世炜
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products