Frameless Random-Access Image Sensor Pixel Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional focal plane arrays process pixels on a frame-by-frame basis, leading to suboptimal image sensing as each pixel is treated equally, ignoring differences in range, motion, and brightness, and cannot handle varying integration times or update rates for individual pixels.

Innovation Solution

A frameless random-access image sensor design allows for individual pixel-by-pixel processing by enabling random access and control of each pixel, with independent integration times and phases, using a modified readout integrated circuit and standard detector array, enabling dynamic processing of pixels with different characteristics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If frame-by-frame processing is used in conventional focal plane arrays, then all pixels are processed uniformly, but this ignores differences in range, motion, and brightness of individual pixels

Engineering Contradiction:
Improvepixel processing adaptabilityVSAvoidreadout circuit complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the image sensor into individually addressable pixel regions that can be processed independently. Each pixel or group of pixels can have its own integration time and processing parameters, allowing uniform pixels to be processed together while differentiating between pixels with different characteristics (range, motion, brightness).

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic integration times for different pixel regions, allowing the integration period to vary based on pixel characteristics. This enables pixels detecting fast-moving objects to use shorter integration times while pixels for stationary objects use longer integration times, optimizing detection for each region.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If individual pixel control is implemented, then pixels with different characteristics can be processed independently, but this increases readout circuit complexity

Engineering Contradiction:
Improvepixel integration time controlVSAvoidreadout integrated circuit complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent designs a universal readout integrated circuit that can handle multiple processing modes through a single interface. The ROIC supports both frame-by-frame processing and random-access pixel-by-pixel processing, accommodating different integration times and readout patterns without requiring separate dedicated circuits for each mode.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent changes the operational parameters of the readout circuit dynamically, allowing integration time, readout timing, and pixel selection to be adjusted based on scene requirements. This enables the same hardware to adapt to different detection scenarios without increasing physical circuit complexity.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If all pixels are read out simultaneously in conventional arrays, then simple readout control is used, but this prevents handling of varying update rates for individual pixels

Engineering Contradiction:
Improvepixel update rate flexibilityVSAvoidreadout time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent implements periodic readout cycles where pixels are read out in different sequences based on their update rate requirements. High-priority pixels with motion detection needs are read out more frequently, while static region pixels are read out less frequently, optimizing the use of readout bandwidth and reducing overall readout time.

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables independent pixel-by-pixel sensor processing, allowing for flexible image capture and processing sequences, reducing power usage and improving image data quality by accommodating pixels with unique characteristics and requirements.

Implementation Method 1

A focal plane array (FPA) is an image sensing device consisting of an array of light-sensing elements at the focal plane of a lens... each light-sensing element in the array of light-sensing elements may generate a pixel of an image

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS10540733B2Frameless random-access image sensing
Publication Date: 2020.01.21 THE BOEING CO
  • US10540733B2 patent drawing
  • US10540733B2 patent drawing
  • US10540733B2 patent drawing

AI summary

A method and apparatus for frameless random-access image sensing. Instructions identifying a pixel detector in an array of pixel detectors and integration instructions for the pixel detector may be received by an image detector controller. Integration by the pixel detector may be controlled as defined by the integration instructions to generate pixel data by the pixel detector. The pixel data may be read from the pixel detector.