Image fusion method for brightness consistency learning

An image fusion and consistency technology, applied in image enhancement, image analysis, image data processing, etc., can solve the problems of ignoring the tone, light and shade of the foreground image, and failing to obtain satisfactory results

Active Publication Date: 2018-12-11
EAST CHINA NORMAL UNIVERSITY
View PDF7 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the problem with the Poisson fusion method is that it only retains the gradient field of the foreground image, that is, the relative change feature, while ignoring other original features such as the hue, light and shade of the

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image fusion method for brightness consistency learning
  • Image fusion method for brightness consistency learning
  • Image fusion method for brightness consistency learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0055] The present invention will be further described below in conjunction with the accompanying drawings.

[0056] This embodiment is implemented under the Windows 10 64-bit operating system on the PC, and its hardware configuration is CPU i5-6500, memory 16G, GPU NVIDIA GeForce GTX 1060 6G. Deep learning library Keras 2.0.8, which uses Tensorflow1.3.0 as the backend. Programming adopts Python language.

[0057] The specific technical solution for realizing the purpose of the present invention is: an image fusion method based on brightness consistency learning. It is characterized by proposing an unsupervised deep learning method, which can realize image fusion with appearance consistency, and an image fusion method based on Lab color space is designed. strategy, to preserve the foreground tone, and use the deep learning model based on the generator-adversarial network structure (GAN) to predict the brightness channel of the image, ensuring the consistency of light and shad...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an image fusion method for brightness consistency learning, which adopts an unsupervised depth learning method and adopts a generator-based image fusion method. A deep learningmodel based on a generative adversarial net (GAN) predicts the lightness channel of an image, the inherent semantics of the foreground part is maintained, and the background appearance is ensured toremain unchanged by adding a background covering layer, so that the image fusion result with the consistency of light and shade is obtained, and the problem of inherent semantics loss in the traditional image fusion technology is solved.

Description

technical field [0001] The present invention relates to the technical field of image synthesis, in particular to an image fusion method for brightness consistency learning, which uses a deep learning model based on a generator-adversarial network structure (GAN) to predict the brightness channel of an image, ensuring the accuracy of the fusion region Consistency of light and shade, to obtain a fusion effect with a sense of reality and consistency of light and shade. Background technique [0002] The problem of image fusion is to fuse the foreground image with the background image. At present, in the key technology of image fusion, the main difficulty is to make the fused image have illumination, texture and other aspects under the premise of maintaining the inherent characteristics of the foreground object. consistency. Existing image fusion techniques can be divided into image fusion methods based on gradient field and image fusion methods based on multi-resolution. [00...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T5/50
CPCG06T5/50G06T2207/10024
Inventor 全红艳沈卓荟
Owner EAST CHINA NORMAL UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products