Multi-Spectral Sampling Calibration via Two-Path Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional multi-spectral sampling systems face challenges in achieving precise spatial and spectral calibration, resulting in compromised spatial and time resolutions when sampling spectral information.

Innovation Solution

A method and apparatus for calibrating a multi-spectral sampling system that involves obtaining two-path multi-spectral images, calibrating the spectrum of sampling points using spectral signatures, and performing spatial location calibration through scanning videos in different directions, allowing for precise matching of spatial locations and spectral wavelengths.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional multi-spectral sampling systems sample multi-spectral information by compensating spectral resolution, then spectral resolution is improved, but spatial resolution and time resolution deteriorate

Engineering Contradiction:
Improvespectral resolutionVSAvoidspatial resolution
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent divides the imaging system into two separate paths: a first path (imaging spectrometer) dedicated to spectral sampling and a second path (color camera) dedicated to spatial sampling. This segmentation allows each path to optimize for its specific function, enabling high spectral resolution in the first path without compromising spatial resolution in the second path.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a temporal dimension by capturing images at multiple time points (t1, t2, t3) and using scanning motion to acquire spectral data across different spatial positions. This transforms a 2D spatial problem into a 3D problem incorporating time, allowing spectral information to be extracted without sacrificing spatial resolution in any single frame.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If conventional multi-spectral sampling systems sample multi-spectral information by compensating spectral resolution, then spectral resolution is improved, but time resolution deteriorates

Engineering Contradiction:
Improvespectral resolutionVSAvoidtime resolution
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent employs periodic scanning motion where the imaging spectrometer systematically scans across the scene at regular time intervals (t1, t2, t3). This periodic action allows the system to build up complete spectral information over time while maintaining the ability to capture dynamic changes, thus improving spectral resolution without completely losing time resolution.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent maintains continuous operation of both imaging paths simultaneously, with the color camera continuously capturing spatial information while the imaging spectrometer continuously scans for spectral information. This continuity ensures that both spectral and temporal information are captured without interruption, resolving the trade-off between spectral and time resolution.

Inventive Principle:
Principle #20Continuity of useful action

3Productivity

If two-path sampling is used to sample multi-spectral information, then multi-spectral information sampling is improved, but spatial calibration and spectral calibration precision deteriorate

Engineering Contradiction:
Improvemulti-spectral information samplingVSAvoidspatial calibration precision
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent introduces a demonstrating device displaying scanning videos as an intermediary element. This device provides known reference patterns that facilitate precise calibration of the imaging system. By using these intermediary reference patterns, the system can accurately determine the correspondence between spatial positions and spectral measurements, thereby achieving precise spatial and spectral calibration.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent uses scanning videos displayed on the demonstrating device as copies or representations of the actual scene being imaged. These video copies contain known spatial-temporal patterns that can be used to calibrate the imaging system by comparing the captured images against the known patterns in the videos, enabling precise calibration without requiring complex direct measurements.

Inventive Principle:
Principle #26Copying

4Productivity

If two-path sampling is used to sample multi-spectral information, then multi-spectral information sampling is improved, but spectral calibration precision deteriorates

Engineering Contradiction:
Improvemulti-spectral information samplingVSAvoidspectral calibration precision
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The demonstrating device displaying scanning videos serves as an intermediary that provides known spectral reference information. By comparing the spectral measurements from the imaging spectrometer against the known spectral content of the displayed videos, the system can precisely calibrate its spectral response, thereby achieving high spectral calibration precision.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent systematically varies temporal parameters (capturing images at different time points t1, t2, t3) and spatial parameters (scanning across different positions) to collect comprehensive calibration data. By changing these parameters in a controlled manner and analyzing the results, the system can precisely determine the spectral calibration parameters, achieving high spectral calibration precision.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables precise spectral and spatial calibration, ensuring effective sampling of spectral information with high spectral, spatial, and time resolutions.

Implementation Method 1

splitting a light ray reflected from the white screen into a first light ray and a second light ray by a beam splitter

Methodology Applied
Scientific EffectLight splitting: Reflection

Implementation Method 2

dispersing a sampled light ray by a prism, and shooting dispersed light rays by a gray-scale camera

Methodology Applied
Scientific EffectLight dispersion: Prism

Data Source

PatentUS9210418B2Method and apparatus for calibrating multi-spectral sampling system
Publication Date: 2015.12.08 TSINGHUA UNIVERSITY
  • US9210418B2 patent drawing
  • US9210418B2 patent drawing
  • US9210418B2 patent drawing

AI summary

A method and an apparatus for calibrating a multi-spectral sampling system are provided. The method includes: sampling scene information of a scene to obtain a two-path multi-spectral image comprising a multi-spectral image consisting of a plurality of sampling points and a RGB color image; calibrating a spectrum of each of the plurality of sampling points to obtain a spatial location thereof and a spectral wavelength corresponding to the spatial location; providing two scanning videos in different scanning directions, demonstrating and shooting the two scanning videos to obtain two two-path multi-spectral videos, in which each two-path multi-spectral video comprises a multi-spectral video and a RGB color video; and based on the spatial location of each of the plurality of sampling points, obtaining a matching point of each of the plurality of sampling points, so as to implement a spatial location calibration of the multi-spectral sampling system.