Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Infrared video colorization method based on two-channel-circulation generative adversarial network

A dual-channel, colorized technology, applied in the field of image processing, can solve problems such as manual intervention, and achieve the effect of improving recognition and enhancing observability

Inactive Publication Date: 2018-07-24
DONGHUA UNIV
View PDF9 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method improves the accuracy of colorization, but the colorization result of this method is still quite different from the real color scene, and manual intervention is required

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Infrared video colorization method based on two-channel-circulation generative adversarial network
  • Infrared video colorization method based on two-channel-circulation generative adversarial network
  • Infrared video colorization method based on two-channel-circulation generative adversarial network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] Below in conjunction with specific embodiment, further illustrate the present invention. It should be understood that these examples are only used to illustrate the present invention and are not intended to limit the scope of the present invention. In addition, it should be understood that after reading the teachings of the present invention, those skilled in the art can make various changes or modifications to the present invention, and these equivalent forms also fall within the scope defined by the appended claims of the present application.

[0024] Embodiments of the present invention relate to an infrared video colorization method based on a dual-channel recurrent generation confrontation network, such as figure 1 As shown, it includes the following steps: collecting night vision infrared video data and color video data, the scene in the night vision infrared video data is the same as the scene in the color video data; put the video data set into the database afte...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an infrared video colorization method based on two-channel-circulation generative adversarial network. The method comprises the following steps of collecting night-vision infrared video data and color video data; carrying out frame extraction processing on a video data set and then putting into a database, and building a training set and a test set; constructing a two-channel-circulation generative adversarial deep learning network, and through a circulation training method, improving the abilities of generating a network G, generating a network F, discriminating a network DX, and discriminating a network DY; and acquiring an infrared image in an infrared video in real time, inputting the colorization results of the infrared image and the previous frame of infrared image into the trained and generated network G, and using the generated network G to carry out colorization processing on an infrared image sequence. In the invention, the colorization effect of a night-vision infrared video is enhanced, the observability of a colorization video is increased and manual intervention is not needed.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to an infrared video colorization method based on a dual-channel cyclic generative confrontation network. Background technique [0002] Infrared video colorization refers to endowing infrared image color and texture information in infrared video, which is essentially an image enhancement problem. Adding color and texture to infrared video can help people observe video content more intuitively, and can also help unmanned vehicles or robots better understand the environment. [0003] The traditional methods of infrared video colorization mainly include pseudo-colorization method, colorization method based on human intervention, colorization method based on template and colorization method based on multi-sensor fusion. However, the realization of these four types of traditional algorithms requires manual intervention, and the colorization results are quite different from the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T5/50G06N3/04G06N3/08
CPCG06N3/08G06T5/50G06T2207/10024G06T2207/10048G06T2207/10016G06T2207/20081G06T2207/20084G06N3/045
Inventor 李佳豪孙韶媛吴雪平
Owner DONGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products