Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image reconstruction method and device based on progressive convolution measurement network

An image reconstruction and progressive technology, applied in image coding, image data processing, instruments, etc., can solve the problem of block effect in reconstructed images, and achieve the effect of block effect suppression.

Active Publication Date: 2020-11-10
BEIJING JIAOTONG UNIV
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to provide an image reconstruction method based on a progressive convolution measurement network to solve the problem that the existing image reconstruction method in the above-mentioned background technology can only test a fixed-size image and the reconstructed image has block effects technical problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image reconstruction method and device based on progressive convolution measurement network
  • Image reconstruction method and device based on progressive convolution measurement network
  • Image reconstruction method and device based on progressive convolution measurement network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 2

[0050] Such as figure 2 Shown is the system block diagram that this patent proposes. It can be seen from the figure that PCM-Net can be divided into three cascaded modules: progressive convolution measurement module, preliminary reconstruction module and residual reconstruction module. Below we will introduce their detailed structures and parameter settings in an orderly manner.

[0051] (1) Progressive convolution measurement module

[0052] Existing CNN-based algorithms either use fixed random matrices or fully connected layers in the measurement phase, which requires that the training image must be the same size as the test image. Therefore, they have to split the dataset into fixed-size image patches for training and testing. This block-based mode does avoid the problem of limited GPU memory, but it also causes severe blocking artifacts.

[0053] Therefore, we employ a fully convolutional measurement network as an adaptive random matrix. To extract more semantic info...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an image reconstruction method and device based on a progressive convolution measurement network, and belongs to the technical field of image reconstruction. The method comprises the following steps: firstly, carrying out progressive convolution operation on an original image through a plurality of downsampling layers, and then generating a corresponding number of feature maps meeting a given measurement rate through a downsampling feature extraction layer; Carrying out progressive deconvolution operation on the feature map through a plurality of upper sampling layers corresponding to the plurality of lower sampling layers, and generating a preliminary reconstructed image consistent with the original image in size through an upper sampling feature extraction layer; And finally, carrying out quality optimization training on the preliminary reconstructed image by using a residual convolutional neural network to obtain a final feature map, and carrying out error processing on the final feature map and the original image to obtain a final optimized reconstructed image. According to the method, the image is sampled and reconstructed end to end, the reconstructionspeed is high, the block effect in the reconstructed image is eliminated especially at an extremely low measurement rate, and the image quality is obviously improved.

Description

technical field [0001] The invention relates to the technical field of image reconstruction, in particular to an image reconstruction method and device based on a progressive convolution measurement network. Background technique [0002] Compressed sensing (Compressive Sensing, CS), as a new type of data compression technology, has received widespread attention. Using fewer measurements than required by the Nyquist sampling theorem, CS theory demonstrates that when a signal exhibits sparsity under certain conditions, it is very likely to be fully reconstructed. Mathematically, the goal of CS reconstruction is to measure Y=ΦX∈R from CS M×1 The original signal X ∈ R is inferred from N×1 . Here, Φ∈R M×N is a linear random matrix. Random Gaussian matrices are commonly used as measurement matrices because we must ensure that the basis of the sparse domain of the matrix is ​​completely inconsistent with the measurement. Because M<<N, the inverse problem is usually ill-...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T9/00
Inventor 白慧慧赵晨
Owner BEIJING JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products