Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Low-illumination image brightness enhancement and super-resolution method based on double-channel codec

A super-resolution and codec technology, which is applied in the field of low-light image brightness enhancement and super-resolution, can solve the problems of lack of details, low quality of bright light images, poor subjective visual effects, etc., and achieve the preservation of texture content and bright light images The effect of light weight and expanding the receptive field

Pending Publication Date: 2021-04-06
BEIJING UNIV OF POSTS & TELECOMM
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to overcome the deficiencies of the prior art, aiming at the defects of the current low-illuminance enhancement method - the restored bright light image is not of high quality, lacks details and the subjective visual effect is poor, and skillfully combines low-illuminance enhancement and image super-resolution Combined with high-resolution tasks, a method for brightness enhancement and super-resolution of low-light images based on dual codecs is proposed with reasonable design, high-quality restored bright-light images and relatively light weight.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Low-illumination image brightness enhancement and super-resolution method based on double-channel codec
  • Low-illumination image brightness enhancement and super-resolution method based on double-channel codec
  • Low-illumination image brightness enhancement and super-resolution method based on double-channel codec

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0060] Embodiments of the present invention will be described in further detail below in conjunction with the accompanying drawings.

[0061] A method for brightness enhancement and super-resolution of low-light images based on a two-way codec, such as Figure 1 to Figure 4 shown, including the following steps:

[0062] Step S1. In the image input stage, randomly adopt data enhancement technology to transform sample content;

[0063] Step S2. Input the original dark-light image after step S1 data enhancement into the network, and perform feature extraction on the input dark-light image through an encoder that shares all parameters. The encoder includes operations such as convolution and down-sampling, where the convolution kernel The sizes are all 3×3, but the number of output channels for convolution is 32, 64, 128, 256, and 512, respectively. The encoder outputs a set of feature maps;

[0064] Step S3, the output feature map of step 2 is first sent to the super-resolution...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a low-illumination image brightness enhancement and super-resolution method based on a double-channel codec, and belongs to the technical field of computer vision images. The method comprises the steps of 1, performing feature extraction on a dark light image through an encoder sharing parameters to obtain a set of feature maps; 2, sending the feature map to a super-resolution decoder for decoding to obtain a super-resolution feature map; 3, pooling the feature map output by the encoder in the step 1 and the super-resolution feature map in the step 2 respectively to obtain two feature vectors, performing weighted fusion on the feature vectors by using an attention mechanism, and then sending the feature vectors to a low-illumination decoder for decoding; and finally, carrying out post-processing on the outputs of the two decoders to obtain a corresponding image after super-resolution. The invention is reasonable in design, low-illumination enhancement and image super-resolution tasks are combined for the defects of an existing low-illumination enhancement method, the visual effect of the reconstructed image is improved, and a good effect is achieved on the low-illumination enhancement and super-resolution comprehensive tasks on the whole.

Description

technical field [0001] The invention belongs to the technical field of computer vision images, in particular to a low-illuminance image brightness enhancement and super-resolution method based on a two-way codec. Background technique [0002] With the advancement of science and technology, mobile devices are becoming more and more popular, and image acquisition is becoming more and more convenient. However, in the process of image acquisition, limited by the camera equipment, shooting environment, and lighting conditions, dark-light images that are difficult to see are often captured, and the quality of dark-light images is usually low. For example, although the images captured by surveillance cameras have a higher resolution, they are actually of low quality and have serious noise, especially at night; Causes noise, blurring, and loss of detail in the image. These problems will not only affect the visual effect of the image, but also bring difficulties to subsequent appli...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00G06T3/40H04N19/42
CPCG06T3/4053G06T3/4046H04N19/42G06T5/92
Inventor 姜竹青刘畅王雅楠门爱东王海婴
Owner BEIJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products