Single-frame high-dynamic imaging method based on convolutional neural network

A technology of convolutional neural network and imaging method, which is applied in the field of single-frame high dynamic imaging based on convolutional neural network, can solve the problems of image detail improvement, complex model, large amount of calculation, etc., and achieve high contrast, easy to use, dynamic wide range of effects

Active Publication Date: 2019-08-23
XIDIAN UNIV
View PDF12 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

One of the existing methods is to modify the image by cascading two encoder-decoders. The first encoder-decoder is used to generate high-dynamic range images (High-Dynamic Range, referred to as HDR), and the second encoder-decoder The decoder is used to map the HDR image, and correct the overexposure and underexposure areas in the LDR image through reciprocating HDR conversion, but the model will lose image information when downsampling, and artifacts will be generated when upsampling, and the model is complex. heavy calculation
Another existing method is to sample two different sizes of convolution kernels and down-sampling to extract the high-frequency, mid-frequency, and low-frequency details in the LDR image respectively and fuse these three detail feature maps to generate an HDR image. , but the calculation amount and running time of the three branches of the method are quite different, and the image details need to be improved

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Single-frame high-dynamic imaging method based on convolutional neural network
  • Single-frame high-dynamic imaging method based on convolutional neural network
  • Single-frame high-dynamic imaging method based on convolutional neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0055] See figure 1 , figure 1 It is a schematic flowchart of a convolutional neural network-based single-frame high dynamic imaging method provided by the present invention. The single frame high dynamic imaging method includes:

[0056] S1: Construct an enhanced module;

[0057] In this embodiment, constructing the enhancement module includes: constructing the first enhancement module and the second enhancement module by using an attention mechanism. Specifically, see figure 2 , figure 2 It is a structural schematic diagram of an enhanced module provided by the present invention. The first enhancement module and the second enhancement module have the same structure, respectively including the first convolutional layer, the first activation layer, the second convolutional layer, the second activation layer, the third convolutional layer, the third activation layer and mask layer.

[0058] Specifically, the size of the convolution kernel of the first convolutional lay...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a single-frame high-dynamic imaging method based on a convolutional neural network. The method comprises the following steps: constructing an enhancement module; constructing an initial convolutional neural network with an enhancement module according to the enhancement module; training the initial convolutional neural network to obtain a trained convolutional neural network; and processing the original single-frame low-dynamic image through the trained convolutional neural network to generate a high-dynamic image. According to the method, the high-dynamic image can bedirectly generated from the single-frame low-dynamic image, the problem that multiple frames of exposure images cannot be obtained at the same time by a moving video in multi-exposure fusion is solved, parameter adjustment is not needed, and the method is convenient to use.

Description

technical field [0001] The invention belongs to the field of digital image processing, and in particular relates to a single-frame high dynamic imaging method based on a convolutional neural network. Background technique [0002] Scenes in nature have a large dynamic range, and there are often bright and dark areas at the same time. The dynamic range of an ordinary digital camera is only two to three orders of magnitude, and the brightness range of the obtained digital image will be compressed. Details and textures in dark and dark areas are lost, colors are distorted, and the layered brightness effects in the original scene cannot be displayed, making it impossible to accurately capture all the information in the real situation. Professional high-dynamic cameras are expensive, and their effects are limited by hardware conditions. Therefore, high-dynamic imaging methods are required to process images. [0003] High-Dynamic Range imaging (HDRI for short) is a photography tec...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00G06T1/00H04N5/235G06K9/62G06N3/04G06N3/08
CPCG06T5/007G06T1/0007G06N3/08G06T2207/10016H04N23/741G06N3/045G06F18/22
Inventor 赖睿王东李奕诗官俊涛徐昆然
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products