EO/IR Staring Focal Plane Array ROI Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current Electro-Optic (EO)/Infrared (IR) staring focal plane arrays face limitations in bandwidth, leading to compromised performance in data rate, resolution, and temporal characterization, making it difficult to simultaneously achieve high data rate, resolution, and dynamic range, resulting in inadequate persistence and response times in observing and responding to events within the Field of Regard.

Innovation Solution

The system simultaneously acquires data at a high bandwidth and transmits at a low bandwidth, allowing for sustained persistence over the entire Field of Regard by reconfiguring to track events, with analog and digital circuits constantly reading pixel data from the entire Field of View at a high sample rate, performing temporal filtering, and integrating samples for real-time high-rate readout of Region Of Interest (ROI) data upon event detection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the system transmits all pixel data from the entire Field of View at high bandwidth, then the data rate and temporal resolution are improved, but the system bandwidth capacity is exceeded and persistence is lost

Engineering Contradiction:
Improvedata rateVSAvoidbandwidth capacity
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent divides the Field of View into multiple regions: a Region of Interest (ROI) that receives high-rate data transmission and full-frame areas that use persistence. This segmentation allows the system to prioritize bandwidth resources to the most critical area while maintaining overall situational awareness through persistence in other regions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different data handling qualities to different spatial locations. The ROI receives high-bandwidth, high-temporal-resolution data with real-time updates, while other regions use lower-bandwidth persistence modes. This local differentiation optimizes the overall system performance by matching data transmission quality to operational requirements in each region.

Inventive Principle:
Principle #3Local quality

2Area of stationary object

If the system increases the number of pixels and resolution to cover the entire Field of Regard, then the area coverage is improved, but the object space resolution and temporal frequency are compromised

Engineering Contradiction:
ImproveField of Regard coverageVSAvoidobject space resolution
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent segments the detector array into a ROI subset and full-frame regions. The ROI contains high-resolution detectors focused on the area requiring detailed observation, while other regions use fewer detectors or lower resolution. This allows the system to achieve high object space resolution in the ROI while maintaining broad Field of Regard coverage through the combined detector array.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements local quality by providing high-resolution detection capability specifically in the ROI where detailed characterization is needed, while using lower-resolution or persistent imaging in other regions. This optimizes the distribution of detection resources to match the varying resolution requirements across different areas of the Field of Regard.

Inventive Principle:
Principle #3Local quality

3Area of stationary object

If the system uses step stare sensors to cover the Field of Regard, then the area coverage is improved, but persistence is lost and response time increases

Engineering Contradiction:
ImproveField of Regard coverageVSAvoidresponse time
Core Design Contradiction:
Area of stationary objectVSLoss of time

Solution Approach 1:

The patent segments the imaging function into persistent full-frame imaging and high-rate ROI tracking. The persistent imaging maintains continuous coverage of the entire Field of Regard, enabling rapid response to new events, while the ROI tracking provides detailed real-time characterization of identified targets without requiring full sensor repositioning.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements multi-functionality by combining persistent imaging capabilities with high-rate ROI tracking in a single sensor system. The sensor can simultaneously maintain persistence across the full Field of Regard and provide high temporal resolution data in the ROI, eliminating the need to choose between coverage and response time.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Quantity of substance

If the system reduces the temporal frequency to enable reasonable data rates, then the bandwidth requirements are reduced, but the capability for time-based characterization of events is reduced

Engineering Contradiction:
Improvebandwidth requirementsVSAvoidtemporal resolution
Core Design Contradiction:
Quantity of substanceVSMeasurement precision

Solution Approach 1:

The patent segments the data transmission stream into high-rate ROI data and lower-rate full-frame data. The ROI data maintains high temporal frequency to enable accurate time-based characterization of events, while the full-frame data uses lower temporal frequency and persistence to reduce overall bandwidth requirements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different temporal sampling qualities to different regions. The ROI receives high temporal frequency updates for precise event characterization, while other regions use lower temporal frequency with persistence. This local differentiation maintains temporal resolution where needed while reducing overall bandwidth consumption.

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP3078059B1Electro-optical (EO)/infrared (IR) staring focal planes with high rate region of interest processing and event driven forensic look-back capability
Publication Date: 2018.10.03 RAYTHEON CO
  • EP3078059B1 patent drawingFigure 1
  • EP3078059B1 patent drawingFigure 2A
  • EP3078059B1 patent drawingFigure 2B

AI summary

A focal plane array having: a plurality of detectors; a plurality of unit cell sections, each section being fed by charge produced by corresponding detector for producing a sequence of frames; and a plurality of sets of storage sections, each section being coupled to a corresponding one of the unit cells. Each set of storage sections includes a plurality of storage units for sequentially storing the frames. A region of interest selector section examines the frames of the plurality of unit cells, to detect at least one of the frames having a predetermined characteristic. A processor: (i) identifies a sub-set of the plurality of unit cells proximate the detected unit cells having the predetermined characteristic to establish a region of interest; and (ii) sequentially reads the plurality of storage units in the storage sections coupled to the sub-set of unit cells in the established region of interest.