Multispectral imaging method and device based on RGB camera and deep neural network

A deep neural network and RGB camera technology, applied in the field of computational photography, can solve problems such as unrecovered multispectral images, and achieve the effect of fitting practical applications

Active Publication Date: 2019-11-12
BEIJING INSTITUTE OF TECHNOLOGYGY
View PDF5 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, there is no algorithm that can directly restore the multispectral image from the data collected by the detector (that is, the mosaic image)

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multispectral imaging method and device based on RGB camera and deep neural network
  • Multispectral imaging method and device based on RGB camera and deep neural network
  • Multispectral imaging method and device based on RGB camera and deep neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038]Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.

[0039] The multispectral imaging method and device based on the RGB camera and the deep neural network proposed according to the embodiments of the present invention are described below with reference to the accompanying drawings. Imaging method.

[0040] figure 1 It is a flowchart of a multispectral imaging method based on an RGB camera and a deep neural network according to an embodiment of the present invention.

[0041] Such as figure 1 As shown, the multispectral imaging method based on RGB camera and deep neural network i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multispectral imaging method and device based on an RGB camera and a deep neural network, and the method comprises the following steps: designing a convolutional neural network which takes a mosaic image as an input and takes a corresponding multispectral image as an output; training the convolutional neural network by using the existing multispectral data set to obtain an optimal network model; and shooting by adopting an RGB color camera to obtain a current mosaic image of an actual scene, and taking the mosaic image as the input of the optimal network model to obtain a target multispectral image. According to the method, calculation imaging from mosaic images to multispectral images can be directly completed by utilizing the deep neural network, and the methodis more suitable for practical application and is simple and easy to implement.

Description

technical field [0001] The invention relates to the technical field of computational photography, in particular to a multispectral imaging method and device based on an RGB camera and a deep neural network. Background technique [0002] Multispectral imaging technology emerged in the 1980s. It combines spectral technology and imaging technology to obtain information of multiple bands for each pixel of the image. Compared with ordinary color cameras, such as the three spectral channels of RGB cameras, multispectral imaging systems generally contain dozens or even hundreds of spectral channels, and each spectral band can be regarded as a static grayscale image, representing different bands. Intensity information, images on different spectral bands contain more spatial information and spectral information of the observed object. Compared with traditional imaging technology, multispectral imaging technology has great advantages. It can understand and recognize observation targe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T11/00G06N3/04G06N3/08
CPCG06T11/00G06N3/08G06N3/044G06N3/045
Inventor 边丽蘅傅毫张军曹先彬
Owner BEIJING INSTITUTE OF TECHNOLOGYGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap