Method and device for accelerating hyperspectral video reconstruction

A hyperspectral and video technology, applied in the field of computational photography, can solve the problems of difficult realization and acceleration of hyperspectral video, achieve the effect of accelerating hyperspectral video reconstruction, reducing the amount of calculation, and improving efficiency

Active Publication Date: 2019-11-22
NANJING UNIV
View PDF3 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, cropping or sampling spectral video and RGB video cannot completely solve the acceleration problem, especially when hyperspectral video cameras need to capture high-speed dynamic targets and large-area complex scenes, it will be difficult to reconstruct high-resolution and high-precision hyperspectral video

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for accelerating hyperspectral video reconstruction
  • Method and device for accelerating hyperspectral video reconstruction
  • Method and device for accelerating hyperspectral video reconstruction

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0085] The parameters of the hyperspectral video reconstruction equipment are: processor, i7-4790K CPU@4 GHZ*8; memory, 32G; graphics card; GTX1080Ti; disk, 1T.

[0086] Among them, the parameters of the hyperspectral video reconstruction image are: wavelength range: 450nm-900nm; spatial resolution: 1465×959; spectral resolution: 3nm; number of spectral bands: 143.

[0087] like figure 2 As shown, a hyperspectral video camera is used to shoot a dynamic scene. The dynamic scene is divided into two light paths by a beam splitter. The first light path is reflected into the RGB camera, the second light path is transmitted to the mask for encoding, and then directly to the prism for dispersion. Finally, it is directed to the spectral camera, and the spectral video and RGB video are transmitted to the server using the data cable, and the hyperspectral video reconstruction algorithm is used to calculate and display the spectral image of the target band in real time.

[0088] like ...

Embodiment 2

[0095] see Image 6 , this embodiment provides a device for accelerating hyperspectral video reconstruction, which is used to accelerate hyperspectral video reconstruction, including:

[0096] Calibration matrix acquisition module 201, for obtaining the calibration matrix of spectral video and RGB video according to spectral video and RGB video taken by hyperspectral video camera;

[0097] The calibration matrix sorting module 202 is used to sort the calibration matrix by using a quick sort algorithm according to the condition constraints of hyperspectral video camera space downsampling;

[0098] The vertical calculation unit 2021 of adjacent calibration points is used in the RGB ordered calibration matrix to calculate the horizontal distance value between the non-zero data points of half the number of marking points, and the horizontal distance value is averaged;

[0099] The horizontal calculation unit 2022 of adjacent calibration points is used in the RGB ordered calibrati...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a device for accelerating hyperspectral video reconstruction. The method comprises the following steps: acquiring a calibration matrix of a spectral video and an RGB video according to the spectral video and the RGB video shot by a hyperspectral video camera; sorting the calibration matrix to generate an ordered calibration matrix; converting the spectrum videoand the RGB video into a data matrix in a parallel mode according to the ordered calibration matrix; according to the ordered calibration matrix, obtaining all related calibration points of the reconstruction area; and reconstructing a hyperspectral video in a parallel mode according to the related calibration points and the data matrix. The related calibration points are obtained through sortingprocessing of the calibration matrixes, the traversal frequency of the calibration matrixes is reduced, the calculated amount of hyperspectral video reconstruction is reduced, meanwhile, the data matrix is generated in a parallel mode, hyperspectral video reconstruction is conducted, and the efficiency of hyperspectral video reconstruction is improved.

Description

technical field [0001] The invention relates to the field of computational photography, in particular to a method and device for accelerating hyperspectral video reconstruction. Background technique [0002] In recent years, with the continuous innovation of hyperspectral imaging technology in software and hardware research, hyperspectral imaging has played an important role in many fields such as aerial remote sensing, chemical analysis, and environmental monitoring. [0003] In order to make hyperspectral imaging data more accurate, more stable, and faster, some methods for accelerating hyperspectral video reconstruction have been proposed. Commonly used hyperspectral video reconstruction algorithms are generally divided into two categories: [0004] The first category is data optimization, which mainly optimizes the spectral data to be reconstructed by means of feature extraction, principal component analysis, and dimension compression. After removing duplicate data and r...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/80H04N9/04
CPCG06T7/80G06T2207/10016G06T2207/10024H04N23/10G06T2207/10036G06T5/50H04N9/67H04N23/84G06T7/30G06T3/40
Inventor 曹汛黄尔齐陈都陈林森
Owner NANJING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap