Compressed low-resolution image restoration method based on combined deep network

A low-resolution image and deep network technology, applied in the field of compressed low-resolution image restoration, to achieve the effect of eliminating pre-processing and post-processing

Active Publication Date: 2017-05-24
BEIJING UNIV OF TECH
View PDF3 Cites 162 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0010] The purpose of the present invention is to overcome the deficiencies of the prior art, and to provide a joint deep network for decompression distortion and super-resolution restoration for low-quality images that contain both compression distortion and low-resolution degradation problems, so that it can cooperate Solving the problem of super-resolution restoration of low-resolution images with compression artifacts

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Compressed low-resolution image restoration method based on combined deep network
  • Compressed low-resolution image restoration method based on combined deep network
  • Compressed low-resolution image restoration method based on combined deep network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] Below in conjunction with accompanying drawing of description, the embodiment of the present invention is described in detail:

[0059] A compressed low-resolution image restoration method based on a joint deep network, the overall flow chart is attached figure 1 shown; the algorithm is divided into an offline part and an online part; the flow charts are as attached figure 2 And attached image 3 As shown; in the offline part, a training sample library is established according to the image downsampling and compression distortion; for an image with a size of M×N, in the first stage, it is first down-sampled by S times, and then up-sampled by S times, Finally, a low-resolution LR image with a size of M×N is obtained; in the second stage, different compression quality parameters (CQ, Compressed Quality) values ​​are used to compress the low-resolution image; The training samples are used as the first set of training sample libraries, and the high and low resolution trai...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a compressed low-resolution image restoration method based on a combined deep network, belonging to the digital image / video signal processing field. The compressed low-resolution image restoration method based on the combined deep network starts from the aspect of the coprocessing of the compression artifact and downsampling factors to complete the restoration of a degraded image with the random combination of the compression artifact and the low resolution; the network provided by the invention comprises 28 convolution layers to establish a leptosomatic network structure, according to the idea of transfer learning, a model trained in advance employs a fine tuning mode to complete the training convergence of a greatly deep network so as to solve the problems of vanishing gradients and gradient explosion; the compressed low-resolution image restoration method completes the setting of the network model parameters through feature visualization, and the relation of the end-to-end learning degeneration feature and the ideal features omits the preprocessing and postprocessing; and finally, three important fusions are completed, namely the fusion of the feature figures with the same size, the fusion of residual images and the fusion of the high-frequency information and the high-frequency initial estimation figure, and the compressed low-resolution image restoration method can solve the super-resolution restoration problem of the low-resolution image with the compression artifact.

Description

technical field [0001] The invention belongs to the field of digital image / video signal processing, in particular to a method for restoring compressed low-resolution images based on a joint deep network. Background technique [0002] With the rapid development and wide application of multimedia technology, high-quality images and videos have become a mainstream demand. The higher the quality of video data, the greater its analysis value. However, affected by factors such as limited channel bandwidth and storage capacity, images and videos have been compressed for transmission and normal storage. The most common image degradation factors are downsampling and compression artifacts. Downsampling reduces the spatial resolution of an image, and compression artifacts lead to image blockiness, ringing, and blurring. Therefore, it is of great theoretical significance and practical application value to study image restoration technology with multiple degradation factors for low-re...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40G06T5/00
CPCG06T3/4007G06T3/4053G06T5/002G06T2207/10004G06T2207/10024G06T2207/20081G06T2207/20084
Inventor 李晓光孙旭卓力
Owner BEIJING UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products