Unlock instant, AI-driven research and patent intelligence for your innovation.

Image Blind Motion Deblurring Based on CNN-Transformer Hybrid Autoencoder

A self-encoder and deblurring technology, applied in the fields of computer vision and image processing, can solve the problems of insufficient balance of high-level context information and poor visual effects

Active Publication Date: 2022-07-22
HUNAN UNIV +1
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, most methods do not perform well enough in the balance between spatial texture details and high-level contextual information, and the visual effect is not good enough.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image Blind Motion Deblurring Based on CNN-Transformer Hybrid Autoencoder
  • Image Blind Motion Deblurring Based on CNN-Transformer Hybrid Autoencoder
  • Image Blind Motion Deblurring Based on CNN-Transformer Hybrid Autoencoder

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The present invention will be described in further detail below with reference to the accompanying drawings and embodiments.

[0036] refer to figure 1 , the method of this embodiment includes two stages, namely a model training stage and a prediction stage, and the model training stage includes the following steps:

[0037] Step 1: Prepare a standard data set for image deblurring; the three motion blur data sets selected in this embodiment are: GoPro data set, DVD data set and NFS data set.

[0038] Step 2: Preprocessing of experimental data; randomly cut experimental data into 256x256 size before entering into model training.

[0039] Step 3: Input the blurred images in the training set of the image deblurring standard dataset into the hybrid autoencoder part for recovery; the hybrid autoencoder part mainly includes two parts: CNN-Transformer hybrid encoder and decoder. The experimental data first enters the CNN-Transformer hybrid encoder for encoding and representa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

An image blind motion deblurring method based on a CNN-Transformer hybrid autoencoder. The method includes two stages, namely a model training stage and a prediction stage. The model training stage includes the following steps: Step 1: Prepare a standard dataset for image deblurring ; Step 2: Preprocessing of experimental data; Step 3: Input the blurred image in the training set of the image deblurring standard data set into the hybrid auto-encoder part for recovery; Step 4: Combine the potentially clear image generated by the hybrid auto-encoder with its standard data The corresponding clear pictures of the target are input into the discriminator together, and the discriminator calculates the loss and returns the gradient; Step 5: The hybrid autoencoder receives the gradient from the discriminator to update the parameters; the model prediction stage includes a step: input the fuzzy picture into the training The output of the hybrid autoencoder is a clear image after deblurring. By using the present invention, better image deblurring effect can be obtained, and the image details can be recovered more clearly.

Description

technical field [0001] The invention belongs to the technical field of computer vision and image processing, and relates to an image blind motion deblurring method based on a CNN-Transformer hybrid self-encoder. Background technique [0002] As an important medium for transmitting information, images play an indispensable role in people's life and work. But the problem of image blur is common in life: due to camera shake, fast movement of objects or out-of-focus problems, the quality of the image will be reduced and the image will become blurred. In addition, various reasons: such as depth variation, occlusion of motion boundaries complicates blurring. Many shooting scenes are constantly changing over time and are not repeatable, and blurring problems caused by camera shake or fast movement of objects is very likely to result in an unusable image. How to effectively use these blurred images, the research on image deblurring methods is of great significance. [0003] Image...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T5/00G06T7/11G06T9/00G06N3/04G06N3/08
CPCG06T7/11G06T9/002G06N3/08G06T2207/20081G06T2207/20084G06T2207/20201G06N3/045G06T5/73
Inventor 陈华赵露露孙纪康张小刚王炼红潘政李磊谢冰心
Owner HUNAN UNIV