Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Single-image super-resolution method based on multi-scale structural self-similarity and compressive sensing

A technology of structural self-similarity and compressed sensing, applied in image enhancement, image data processing, graphics and image conversion, etc., can solve the problems of high computational complexity, may not be able to provide additional information for low-resolution images to be processed, and is not effective. Achieve high computing efficiency

Active Publication Date: 2015-02-18
TSINGHUA UNIV
View PDF5 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since the samples used for dictionary learning are taken from the image library, it will bring two problems: First, due to the variety of image content, in order to make all image blocks have a better sparse representation under the trained dictionary, The image library used to build the dictionary must have a large scale, which makes it difficult for the dictionary learning process to converge; in addition, the image library may not be able to provide the additional information required for low-resolution images to be processed, although for training samples The dictionary is optimal, but this global dictionary is neither optimal nor efficient for a particular image patch
However, most of the current super-resolution methods based on structural self-similarity only use self-similar structures of the same scale, but do not use self-similar structures of different scales, so the acquisition of additional information is limited; Search for similar image blocks in the entire image, so the computational complexity is high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Single-image super-resolution method based on multi-scale structural self-similarity and compressive sensing
  • Single-image super-resolution method based on multi-scale structural self-similarity and compressive sensing
  • Single-image super-resolution method based on multi-scale structural self-similarity and compressive sensing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] The present invention will be described in further detail below in conjunction with the accompanying drawings.

[0020] Let X ∈ R N Denotes a high-resolution image, Y ∈ R M represents a low-resolution image, Represents a high-resolution reconstructed image. Then the relationship between the high-resolution image X and the low-resolution image Y can be expressed as:

[0021] Y=DHX+υ (2.1)

[0022] Among them, D represents the downsampling matrix, H represents the fuzzy matrix, and υ represents the additive noise. The observation model shown in Equation (2.1) shows that the low-resolution image is obtained from the high-resolution image through blurring, down-sampling, and adding noise. The super-resolution method reconstructs high-resolution images by solving the inverse process of the degradation process, which can be expressed as the following optimization problem:

[0023] X ^ = arg min ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A single-image super-resolution method based on the multi-scale structural self-similarity and the compressive sensing comprises the following steps of: firstly setting an initial estimated value of a high resolution reconstructed image, setting a stopping error and the maximum time of iteration, determining a downsampling matrix and a fuzzy matrix according to the process of image degradation to construct an image pyramid, and building a dictionary by using the image pyramid as a training sample of the K-SVD (K-singular value decomposition) method; secondly, according to a Nonlocal method, searching for similar image blocks with the same scale in the current high resolution reconstructed image and determining a weight matrix; thirdly, updating the estimated value of the high resolution reconstructed matrix, updating the sparse representation coefficient, and updating the estimated value of the high resolution reconstructed matrix again; and fourthly carrying out the next iteration until two sequential high resolution reconstructed matrixes meet the corresponding requirement or reach the maximum time of iteration. The single-image super-resolution method of the invention adds the additional information contained in a multi-scale self-similar structure of an image into the high resolution reconstructed image through a compressive sensing frame, thereby having a high computational efficiency.

Description

technical field [0001] The invention relates to a single image super-resolution method based on multi-scale structural self-similarity and compressed sensing. Background technique [0002] High-resolution images can provide a lot of detailed information, so the acquisition of high-resolution images is of great significance in many fields. Image resolution is limited by various factors such as imaging platform, imaging equipment manufacturing process, and cost. Therefore, in practical applications, super-resolution methods are usually used to improve the spatial resolution of images. Super-resolution methods use signal processing methods to reconstruct high-resolution images from single or multiple low-resolution images. Traditional super-resolution methods usually use multiple low-resolution images, and use their complementary information to reconstruct high-resolution images. This makes it an urgent problem to be solved in the current super-resolution technology to improv...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T5/00
CPCG06T3/4053
Inventor 潘宗序禹晶孙卫东
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products