Motion Compensation for Stereoscopic Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional imaging systems face challenges with pixel smearing and distortion due to relative motion between objects and image sensors, particularly in space-based platforms like the ISS, where long exposure times and high velocities result in blurred images, and existing motion compensation techniques are limited in addressing these issues, especially for infrared wavelengths and stereoscopic imaging.

Innovation Solution

An imaging system utilizing a rectilinear lens assembly and 2D-image sensors with a motion compensation module that translates the lens assembly and sensors relative to each other in two dimensions to compensate for motion, allowing for stereoscopic image pair generation and improved infrared sensitivity, while maintaining image quality by ensuring the object and image planes are parallel.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If long exposure time is used for imaging from space-based platform, then image quality improves in low light conditions, but pixel smearing increases due to relative motion

Engineering Contradiction:
Improveimage qualityVSAvoidpixel smearing
Core Design Contradiction:
Illumination intensityVSObject-affected harmful factors

Solution Approach 1:

The patent implements dynamic motion compensation by translating the image sensor in the direction of platform motion during the exposure period. This dynamic adjustment allows the sensor to track moving features in the scene, maintaining image sharpness despite the long exposure time and high platform velocity, thereby resolving the contradiction between capturing sufficient light and avoiding motion-induced pixel smearing

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses a motion compensation module that determines motion vectors of the image scene and uses this information to control the translation of the image sensor. This feedback mechanism allows real-time adjustment of sensor position based on actual scene motion, enabling the system to maintain image quality while compensating for the harmful effects of relative motion during long exposures

Inventive Principle:
Principle #23Feedback

2Object-affected harmful factors

If forward motion compensation is applied using film-based system, then pixel smearing is reduced, but the system cannot capture consecutive image frames due to shutter requirement

Engineering Contradiction:
Improvepixel smearingVSAvoidconsecutive image frame capture
Core Design Contradiction:
Object-affected harmful factorsVSProductivity

Solution Approach 1:

The patent replaces the mechanical shutter-based film transport system with an electronic sensor and electronic translation mechanism. This substitution allows continuous exposure and readout without the need to stop the film, enabling consecutive image frames to be captured while maintaining motion compensation benefits, thus resolving the contradiction between reducing pixel smearing and maintaining productivity

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Illumination intensity

If TDI-CCD sensor is used for motion compensation, then low signal conditions are improved, but distortion effects are not addressed and infrared sensitivity is limited

Engineering Contradiction:
Improvelow signal detectionVSAvoidspectral sensitivity and distortion correction
Core Design Contradiction:
Illumination intensityVSAdaptability or versatility

Solution Approach 1:

The patent employs a 2D image sensor that can detect multiple wavelengths including infrared, making it universally applicable across different spectral ranges. Combined with the two-dimensional translation capability that addresses various motion components, this multi-functional approach resolves the contradiction by providing both low signal detection capability and adaptability to different spectral regions and distortion scenarios

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system transitions from one-dimensional TDI-CCD translation to two-dimensional sensor translation, adding another dimension of motion compensation. This enables correction of distortion effects in addition to motion compensation, while the 2D sensor architecture naturally supports infrared detection, thereby resolving the limitations of spectral sensitivity and distortion correction

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

4Object-affected harmful factors

If image sensor is offset from optical axis to reduce pixel smearing, then motion compensation improves, but image circle coverage must be increased

Engineering Contradiction:
Improvepixel smearingVSAvoidimage circle
Core Design Contradiction:
Object-affected harmful factorsVSArea of stationary object

Solution Approach 1:

The patent implements dynamic offset adjustment where the image sensor is translated from the optical axis position during exposure based on the determined motion vector. This dynamic positioning allows the sensor to be offset by the optimal amount to compensate for scene motion without requiring a permanently larger image circle, resolving the contradiction between motion compensation effectiveness and optical system size

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution effectively reduces pixel smearing and distortion, enabling clear and accurate imaging by compensating for both forward motion and Earth's rotation, and allows for stereoscopic image pairs to be generated, enhancing the ability to capture detailed images of objects and terrain features.

Implementation Method 1

a rectilinear lens assembly having an optical axis, an object plane, and a focal plane

Methodology Applied
Scientific EffectRectilinear lens optics: Lens

Implementation Method 2

the motion compensation module can translate the rectilinear lens assembly and the first 2D-image sensor relative to each other in two dimensions to compensate for the motion of the image scene

Methodology Applied
Scientific EffectMechanical translation: Displacement

Implementation Method 3

a first 2D-image sensor located in the focal plane and parallel to the object plane

Methodology Applied
Scientific EffectPhotoelectric detection: Photoelectric Effect

Data Source

PatentUS10109070B1Methods and systems for motion compensation and stereoscopic images generation
Publication Date: 2018.10.23 AEROSPACE CORP
  • US10109070B1 patent drawing
  • US10109070B1 patent drawing
  • US10109070B1 patent drawing

AI summary

An image acquisition system with motion compensation is disclosed. Embodiments of the system include: includes a rectilinear lens assembly, a first 2D-image sensor, and a motion compensation module. The rectilinear lens assembly has an optical axis, an object plane, and a focal plane. During an image acquisition cycle, the rectilinear lens assembly is positioned such that the optical axis is orthogonal to the object plane while the first 2D-image sensor is parallel to the object plane. The motion compensation module can determine a motion vector of an image scene in the object plane. In response the determined motion vector, the rectilinear lens assembly and the first 2D-image sensor relative are translated relative to each other in two dimensions to compensate for the motion of the image scene.