Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image deblurring method based on multi-task CNN

A deblurring, multi-tasking technology, applied in image enhancement, image analysis, image data processing, etc., can solve the problems of loss of detailed texture, insufficient generalization ability of network model, and failure to consider image detail information recovery, etc., to achieve enhanced recovery. Effect

Active Publication Date: 2020-02-11
TIANJIN UNIV
View PDF6 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, at present, most of the convolutional neural networks are used to restore images, and the restoration of image detail information is not considered, resulting in the loss of detailed texture after image deblurring.
On the other hand, the generalization ability and adaptability of single-task network models are not enough, and it is difficult to achieve multi-type and multi-scene image deblurring tasks.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image deblurring method based on multi-task CNN
  • Image deblurring method based on multi-task CNN
  • Image deblurring method based on multi-task CNN

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0013] The present invention will be described in further detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0014] The present invention proposes to increase the convolutional neural network for detail recovery, designs an image detail recovery module to fully extract and protect the detail features of fuzzy images, and proposes to increase the gradient loss to enhance the network's ability to recover details. In the overall structure, based on the network structure of Multi-scale [6], a multi-task end-to-end learning defuzzification CNN network is proposed.

[0015] 1. Basic principles of the algorithm

[0016] At present, most convolutional neural networks do not consider the restoration of image detail information in the deblurring process, resulting in the loss of detailed texture afte...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an image deblurring method based on a multi-task CNN. The image deblurring method comprises the following steps: (1) acquiring a total training set, a test set and preprocessing; (2) performing multi-scale zooming and parameter setting on the image; and (3) deblurring based on a multi-task convolutional neural network, wherein the multi-task convolutional neural network comprises three scales, and each scale is divided into an image deblurring module, an image detail recovery module and a feature fusion module; the image deblurring module comprises an image encoding block E and an image decoding block D, and the image encoding block E extracts image features and encodes the image features, and then a deblurred image is obtained through the image decoding block D; the image detail recovery module only comprises a convolution feature extraction layer with a residual structure, and the size of a network feature map is kept the same as the input size, and only blurred image high-order features are extracted and fused, and high-frequency information is provided for the final image recovery process; and the feature fusion module comprises an image merging module and a convolution layer.

Description

technical field [0001] The invention belongs to the field of computer image processing, and is mostly used in related fields such as image or video deblurring, and specifically relates to an image deblurring method based on multi-task CNN. Background technique [0002] During the image acquisition process, due to the shaking of the camera equipment or the rapid movement of the shooting scene during the exposure time, coupled with the influence of atmospheric light, the image quality will be degraded. The degradation of image quality will seriously affect the subsequent processing of images, such as image comparison, feature extraction, image recognition, etc. Due to its cutting-edge and wide application, image deblurring has always been a hot spot in the field of computer vision and image processing. [0003] Existing image deblurring methods can be divided into traditional methods and deep learning-based methods. Traditional methods can be divided into deblurring algorith...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T5/00G06T5/50G06N3/04G06N3/08
CPCG06T5/50G06N3/08G06T2207/10004G06T2207/20081G06T2207/20084G06T2207/20221G06N3/045G06T5/73Y02T10/40
Inventor 杨爱萍张兵杨炳旺何宇清
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products