Image restoration method based on wavelet transform attention model

An attention model and wavelet transform technology, applied in image enhancement, image analysis, image data processing, etc., can solve the problems of blurred texture details, incoherent content, low image quality, etc., and achieve clear texture, coherent content, and accurate structure Effect

Active Publication Date: 2020-04-21
BEIJING UNIV OF TECH
View PDF7 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

(H.Ishikawa, H.Ishikawa, and H.Ishikawa, Globally and locally consistent image completion, 2017.) Although the image restoration method based on convolutional neural network can deal with complex scenes or image restoration problems with many missing areas, it usually It will cause problems such as structural distortion, blurred texture and incoherent content...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image restoration method based on wavelet transform attention model
  • Image restoration method based on wavelet transform attention model
  • Image restoration method based on wavelet transform attention model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] In order to describe the technical content of the present invention more clearly, further description will be given below in conjunction with specific examples:

[0049] In this invention, driven by the development of convolutional neural network and attention mechanism, a new architecture is proposed, which combines wavelet transform and attention mechanism into the framework of generative adversarial network, and Unet++ encoder and decoder The structure is the basic structure of the generator network, which effectively solves practical problems in image restoration.

[0050] The frame diagram of the present invention is as figure 2 As shown, in the training process, the goal of the generator network G is to complete the damaged image into a real repaired image to deceive the discriminator network D. The goal of D is to distinguish the error between the repair image generated by G and the ground-truth image. Through the continuous game between G and D, the global los...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an image restoration method based on a wavelet transform attention model, and is used for providing a high-quality image restoration method. The method is based on an image restoration network, and the network is based on a GAN and comprises a generator network and a discriminator network. The generator network part firstly utilizes DWT to decompose known region features in a damaged image into multi-frequency sub-bands, then further extracts deep information of a known region through an attention mechanism, and finally generates a restored image through IDWT. A full convolution discriminator network structure of a PatchGAN is adopted in a discriminator network part; the restored image and the ground-true image are jointly used as input, the generator network and the discriminator network are alternately optimized, back propagation is carried out by minimizing a global loss function, generator network parameters are iteratively adjusted, and finally, the optimized generator network can generate a high-quality image restoration result.

Description

Technical field: [0001] The invention relates to the field of computer image processing, in particular to an image restoration method based on a wavelet transform attention model and a generation confrontation network. Background technique: [0002] Image inpainting refers to the technology of inferring the content of the missing area and repairing it by using a certain method to infer the content of the missing area through the known area information of the image. This is a classic and challenging image processing topic widely used in image editing, image-based rendering, and computational photography. There are two problems to be solved in the image restoration work: first, in the restoration process, the continuity of the texture structure of the image should be maintained, so that the missing area should be as close as possible to or achieve the effect of the original image; second, the restored image should be real Natural, in line with people's visual coherence, let t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T5/00G06T5/10G06N3/04G06N3/08
CPCG06T5/005G06T5/10G06N3/084G06T2207/20064G06T2207/20081G06T2207/20084G06N3/047G06N3/045Y02T10/40
Inventor 王瑾王琛朱青
Owner BEIJING UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products