Multispectral Imaging with Panchromatic Thumbnail Super-Resolution

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current spatial imaging techniques face challenges in acquiring high-resolution multispectral and panchromatic images due to limitations in sensor speed, data transmission, and processing, particularly with the 'single shot' technique which struggles to produce clear multispectral images with low flux and high integration time, leading to image blur.

Innovation Solution

A method utilizing a monochrome matrix-array sensor with a filter having a panchromatic band and spectral bands, acquiring multispectral images through all bands and panchromatic thumbnail images between bands, enabling 'super-resolution' processing to enhance panchromatic image resolution, with data processing optimized to reduce transmission load.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If the 'single shot' technique uses a matrix-array sensor to construct a 2D image in one pass, then the acquisition speed is improved, but the integration time becomes high causing image blur and making it difficult to take clear multispectral images

Engineering Contradiction:

Improveacquisition speedVSAvoidimage clarity

Core Design Contradiction:

SpeedVSManufacturing precision

Solution Approach 1:

The filter is divided into multiple horizontal bands, each covering a different wavelength interval. This segmentation allows the sensor to capture multispectral information across different wavelength ranges simultaneously, enabling clear multispectral images to be obtained without requiring long integration times.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The filter bands are arranged horizontally across the sensor array, adding a spectral dimension to the spatial capture. This allows simultaneous acquisition of multiple spectral bands in a single pass, resolving the contradiction between fast acquisition and clear imaging.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

2Measurement precision

If a large number of acquisitions are achieved very close over time for super-resolution processing, then the panchromatic image resolution is improved, but the quantity of data generated becomes significant and difficult to transmit

Engineering Contradiction:

Improvepanchromatic image resolutionVSAvoiddata quantity

Core Design Contradiction:

Measurement precisionVSQuantity of substance

Solution Approach 1:

The invention extracts only the necessary panchromatic thumbnail images from the filter's panchromatic band for super-resolution processing, rather than transmitting all multispectral data. This selective extraction reduces data quantity while maintaining the ability to achieve high-resolution panchromatic images through processing.

Inventive Principle:

Principle #2Taking out (Extraction)

3Adaptability or versatility

If the filter has multiple spectral bands for multispectral imaging, then the spectral coverage is improved, but the acquisition time for each band increases leading to temporal offsetting issues

Engineering Contradiction:

Improvespectral coverageVSAvoidacquisition time

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

The filter is segmented into multiple horizontal bands that simultaneously capture different spectral ranges. This allows the sensor to acquire multispectral information across all bands in parallel during a single pass, eliminating temporal offsetting issues while maintaining comprehensive spectral coverage.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The continuous movement of the satellite combined with the horizontal band arrangement ensures continuous acquisition across all spectral bands without interruption or temporal gaps, maintaining both spectral versatility and time efficiency.

Inventive Principle:

Principle #20Continuity of useful action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This method increases the number of panchromatic acquisitions, improving the resolution of panchromatic images through 'super-resolution' processing while minimizing data transmission, allowing for efficient onboard processing and high-resolution image generation.

Implementation Method 1

The matrix-array sensor is provided with a filter having a panchromatic filtering band followed by at least two spectral filtering bands, each covering a different wavelength interval

Methodology Applied

Scientific EffectOptical filtering: Filter (optical)

Data Source

PatentUS20240386694A1Method for acquiring multispectral images and panchromatic thumbnail images

Publication Date: 2024.11.21 SAFRAN REOSC

AI summary

A method for acquiring multispectral images and panchromatic thumbnail images by a matrix-array sensor installed in a carrier travelling above a scene and covered with a filter having a panchromatic filtering band followed by at least two spectral filtering bands. The panchromatic and spectral filtering bands are parallel and extending in a direction that is substantially orthogonal to the movement of the carrier. The method includes: a) acquiring a multispectral image at least through the two spectral filtering bands; b) transferring the multispectral image; c) acquiring a panchromatic thumbnail image only through the panchromatic filtering band; d) transferring the panchromatic thumbnail image; e) as long as the scene is not within another of the filtering bands, repeating steps c) and d); and f) repeating steps a) to e) until a multispectral image of the scene through each filtering band is obtained. An acquisition device and a vehicle using the method.