Multi-level image restoration method based on partial-to-overall attention mechanism

A repair method and attention technology, applied in image enhancement, image analysis, image data processing, etc., can solve the problems of ignoring the internal semantic continuity of the region, unreasonable repair results, etc.
CN111127346APending Publication Date: 2020-05-08FUDAN UNIV
4 Cites 28 Cited by

Patent Information

Authority / Receiving Office
CN · China
Current Assignee / Owner
FUDAN UNIV
Publication Date
2020-05-08

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention belongs to the technical field of digital image intelligent processing, and particularly relates to a multi-level image restoration method based on a partial-to-overall attention mechanism. Image restoration refers to replacing and generating lost or defective image data by using an algorithm. The method comprises the steps that a multi-level deep convolutional neural network generator structure is provided; and an attention mechanism convolution layer from is partially and wholly integrated into a generator and a discriminator of the network. An image block discriminator and four loss functions of reconstruction loss, perception loss, style loss and adversarial loss are introduced in the training process of the network to assist a generator to learn an image restoration task. Experimental results show that the restored image with vivid details and a reasonable overall structure can be generated, and the image restoration problem is effectively solved.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention belongs to the technical field of digital image intelligent processing, and relates to an image restoration method, more specifically, to a multi-level image restoration method based on a part-to-whole attention mechanism. Background technique

[0002] As the media people use to store information has changed, so has the definition of the task of image restoration, from the restoration of damaged frescoes during the Renaissance to the restoration of aging paper photographs in earlier years , and then to the current processing of digital pictures stored on the computer. It should be emphasized that the application of image repair is not limited to the function of "repair". In addition, the current repair technology can also be applied to object removal, watermark removal, occlusion removal, face acne removal, skin smoothing, etc. Scenes.

[0003] Early image inpainting techniques are mainly divided into two categories based on the size of...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More