Programmable Pixel Array for Low-Bandwidth Image Sensing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Image sensors face challenges in providing high-resolution images and high frame rates due to the generation, transmission, and processing of large volumes of pixel data, leading to high power consumption and bandwidth limitations, particularly in wearable devices with low power and speed constraints.

Innovation Solution

The image sensor incorporates a programmable pixel cell array with a peripheral circuit that receives a pixel array programming map to configure light measurement operations, enabling only a subset of pixel cells to generate data, reducing data volume by disabling unnecessary pixel cells, implementing compressive sensing, and performing post-processing to compress data, thereby optimizing power and bandwidth usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If all pixel cells generate and transmit pixel data, then image resolution is maintained, but power consumption and bandwidth requirements increase

Engineering Contradiction:
Improveimage resolutionVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The pixel array is segmented into multiple independently controllable pixel cells, each with its own configuration memory. The peripheral circuit can selectively enable or disable individual pixel cells based on programming data, allowing only necessary pixels to generate and transmit data while maintaining overall image resolution through coordinated operation of active pixels.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If all pixel cells generate and transmit pixel data, then image resolution is maintained, but bandwidth requirements increase

Engineering Contradiction:
Improveimage resolutionVSAvoidbandwidth requirements
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the necessary pixel data from the complete pixel array by selectively disabling unnecessary pixel cells through the peripheral circuit. Configuration memories store programming data that identifies which pixel cells should remain active, thereby extracting minimal required data volume while preserving image resolution through intelligent selection of active pixels.

Inventive Principle:
Principle #2Taking out (Extraction)

3Use of energy by moving object

If a subset of pixel cells is enabled to reduce data volume, then power consumption and bandwidth are reduced, but image resolution may be compromised

Engineering Contradiction:
Improvepower consumptionVSAvoidimage resolution
Core Design Contradiction:
Use of energy by moving objectVSMeasurement precision

Solution Approach 1:

Different regions of the pixel array can have different operational states through local quality control. The peripheral circuit applies programming data to individual pixel cells or regions, enabling some pixels to generate full-resolution data while disabling others, creating localized variations in data generation that reduce overall power consumption and bandwidth while maintaining necessary resolution in critical regions.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for high-resolution image data transmission with reduced bandwidth and power consumption, improving the performance of applications like 2D and 3D sensing, object recognition, and location tracking in wearable devices.

Implementation Method 1

Each pixel cell may include a photodiode to sense light by converting photons into charge (e.g., electrons or holes)

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS12034015B2Programmable pixel array
Publication Date: 2024.07.09 META PLATFORMS TECHNOLOGIES LLC
  • US12034015B2 patent drawing
  • US12034015B2 patent drawing
  • US12034015B2 patent drawing

AI summary

Methods and systems for performing light measurement are disclosed. In one example, an apparatus comprises an array of pixel cells, each pixel cell of the array of pixel cells configured to perform a light measurement operation and to generate a digital output of the light measurement operation. The apparatus further includes a peripheral circuit configured to: receive a pixel array programming map including programming data targeted at each pixel cell of the array of pixel cells, and configure the light measurement operation at the each pixel cell based on the programming data targeted at the each pixel cell. The apparatus further includes an image processor configured to generate an image frame based on the digital outputs of at least some of the array of pixel cells.