Digital Image Stabilization for Moving Overhead Platforms

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional persistent video sensors struggle with interpreting frame-to-frame image changes caused by motion in overhead platforms, leading to complications in human and machine recognition of targets and features, especially in applications with wide fields of view and high angular rates.

Innovation Solution

A system and method that utilize a movable imaging platform with a single sensor to calculate and apply transformations to captured images, digitally correcting for relative motion between the platform and the scene, ensuring images appear as if taken by a non-moving platform, while identifying and monitoring 3-D features with predictable motion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional persistent video sensors are used on moving overhead platforms, then the sensors can capture images of the scene, but frame-to-frame image changes occur due to platform motion causing complications in target and feature recognition

Engineering Contradiction:
Improvetarget recognition accuracyVSAvoidimage processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent replaces mechanical stabilization systems with digital image processing. Instead of using complex mechanical gimbals or stabilization mechanisms to physically counteract platform motion, the system captures images during motion and applies computational transformations to correct for the motion effects, thereby reducing mechanical complexity while improving target recognition reliability

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent applies preliminary geometric transformations to images before they are displayed or analyzed. By pre-correcting for platform motion effects through calculated transformations, the system eliminates the need for complex real-time stabilization and simplifies subsequent target recognition processes

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If digital transformations are applied to correct frame-to-frame image changes, then image quality is enhanced and target recognition is facilitated, but additional digital processing is required

Engineering Contradiction:
Improveimage geometric accuracyVSAvoidprocessing system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent implements self-service through automated transformation applications. The system automatically calculates and applies geometric corrections to images without requiring manual intervention or complex external processing systems. The transformations are applied programmatically based on platform motion parameters, reducing the need for additional complex processing infrastructure

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent changes image geometric parameters through mathematical transformations. By applying calculated transformations that modify pixel coordinates and geometric properties, the system corrects for platform motion effects, achieving high geometric accuracy while using standard digital processing capabilities rather than complex specialized hardware

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If conventional stereo photogrammetric systems are used to create 3-D maps, then two disparate views of the scene are collected, but height estimates have large errors typically a multiple of the ground sample distance

Engineering Contradiction:
Improveheight estimation accuracyVSAvoidsystem configuration complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts height information directly from transformed 2-D images without requiring complex stereo photogrammetric systems. By removing the need for multiple sensors and complex 3-D mapping algorithms, the system achieves improved height estimation accuracy through simpler image transformation and analysis techniques

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent creates accurate 2-D transformed images that serve as sufficient copies for height estimation, eliminating the need for actual 3-D maps. The transformed images contain all necessary geometric information for accurate height measurement, reducing system complexity while improving measurement precision

Inventive Principle:
Principle #26Copying

Data Source

PatentEP2445221B1Correcting frame-to-frame image changes due to motion for three dimensional (3-d) persistent observations
Publication Date: 2020.09.23 RAYTHEON CO
  • EP2445221B1 patent drawingFigure 1A~1B
  • EP2445221B1 patent drawingFigure 2A~2B
  • EP2445221B1 patent drawingFigure 3A~3B

AI summary

An imaging platform minimizes inter-frame image changes when there is relative motion of the imaging platform with respect to the scene being imaged, where the imaging platform may be particularly susceptible to image change, especially when it is configured with a wide field of view or high angular rate of movement. In one embodiment, a system is configured to capture images and comprises: a movable imaging platform having a sensor that is configured to capture images of a scene, each image comprising a plurality of pixels; and an image processor configured to: digitally transform captured images with respect to a common field of view (FOV) such that the transformed images appear to be taken by a non-moving imaging platform, wherein the pixel size and orientation of pixels of each transformed image are the same. A method for measuring and displaying 3-D features is also described.