Multi-band Image Motion Compensation Using Eigenfunction Analysis

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional imaging platforms face challenges in correcting frame-to-frame image changes caused by platform motion, especially in low-light conditions and high angular rates, which affect image interpretation and require complex computations or prior knowledge of platform motion.

Innovation Solution

The system captures images in both high and low-light spectral bands, calculates eigenfunction coefficients to correct for induced motion, and digitally transforms frames to compensate for rotation, zoom, and anamorphic stretches, allowing for higher signal-to-noise ratio imagery without blur, using multi-band focal plane arrays for precise registration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If longer exposure times are used in low-light conditions to collect more photons, then signal-to-noise ratio improves, but platform motion causes image blur and distortion

Engineering Contradiction:

Improvesignal-to-noise ratioVSAvoidimage quality

Core Design Contradiction:

Measurement precisionVSReliability

Solution Approach 1:

The system performs preliminary motion compensation by calculating transformation parameters from photon-rich band frames and applying them to photon-poor band frames before aggregation, preparing the data in advance to prevent motion-induced blur and distortion in the final composite image

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent uses photon-rich spectral band frames as an intermediary to derive motion compensation parameters, which then serve as transformation coefficients for correcting photon-poor spectral band frames, enabling the system to achieve both long exposure benefits and motion correction

Inventive Principle:

Principle #24Intermediary (Mediator)

2Measurement precision

If frame aggregation is performed to improve signal-to-noise ratio in low-light conditions, then image interpretability improves, but platform motion causes misalignment and blur between frames

Engineering Contradiction:

Improveimage interpretabilityVSAvoidframe alignment

Core Design Contradiction:

Measurement precisionVSManufacturing precision

Solution Approach 1:

The system uses frames from the photon-rich spectral band as reference data to calculate motion compensation parameters, which are then fed back to correct the photon-poor spectral band frames, creating a feedback loop that continuously aligns frames during aggregation

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent replaces mechanical stabilization systems with a digital image processing approach, using computational methods to calculate and apply transformation parameters that compensate for platform motion, substituting physical stabilization with algorithmic correction

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If complex motion correction algorithms are applied to prevent blur, then image quality improves, but computational requirements and processing time increase

Engineering Contradiction:

Improveimage qualityVSAvoidcomputational complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the imaging system into two functional components: photon-rich spectral band sensing for motion parameter extraction and photon-poor spectral band sensing for high-sensitivity imaging, allowing each to be optimized independently and reducing overall computational complexity

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system uses the photon-rich spectral band frames as a reference copy to derive motion compensation parameters that are then applied to the photon-poor spectral band frames, creating a simplified computational pathway that avoids complex direct motion analysis of the low-light frames

Inventive Principle:

Principle #26Copying

4Productivity

If a priori knowledge of platform motion is used to compute correction coefficients, then processing speed improves, but accuracy decreases due to random errors and jitter in motion data

Engineering Contradiction:

Improveprocessing speedVSAvoidcorrection accuracy

Core Design Contradiction:

ProductivityVSMeasurement precision

Solution Approach 1:

The system performs self-calibration by using its own photon-rich spectral band sensor data to compute motion compensation parameters, eliminating the need for external motion sensors or a priori knowledge, and automatically correcting for random errors and jitter through internal reference measurements

Inventive Principle:

Principle #25Self-service

Data Source

PatentEP3456037B1Method and system for capturing images in a photon-rich spectral band and in a photon-poor spectral band

Publication Date: 2020.11.25 RAYTHEON CO

Figure 1A~1B
Figure 2A~2B
Figure 3A~3B

AI summary

Methods and systems are disclosed for compensating for image motion induced by a relative motion between an imaging platform and a scene. During an exposure period, frames of the scene may be captured respectively in multiple spectral bands, where one of the spectral bands has a lower light level than the first spectral band, and contemporaneous frames include a nearly identical induced image motion. Image eigenfunctions are utilized to estimate the induced image motion from the higher SNR spectral band, and compensate in each of the multiple bands.