Image Sensor Module Selective Photon Readout for Eye Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Head-mounted display devices with inward-facing cameras for eye tracking consume excessive power and processing resources due to reading out entire rows of photon sensors, even when only a portion of the field of view is necessary for individual users.

Innovation Solution

An image sensor module with an array of photon sensors and data selector components that selectively output signals from a subset of photon sensors, reducing the need to read out entire rows and conserving power and processing resources by using fewer analog-to-digital converters (ADCs) or shifting rows to isolate pixels of interest.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If entire rows of photon sensors are read out for eye tracking, then complete field of view data is acquired, but power consumption and processing resources increase excessively

Engineering Contradiction:
Improvefield of view data completenessVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent segments the array of photon sensors into multiple groups, where each group corresponds to a specific region of interest. Instead of reading out the entire array, only the segmented groups containing relevant eye tracking data are activated and read out, reducing power consumption while maintaining measurement precision for the targeted regions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by configuring different regions of the photon sensor array with different operational characteristics. Regions containing eyes of interest are configured with higher sensitivity and active reading, while other regions are either inactive or read with lower priority, optimizing power usage based on local requirements rather than uniform processing.

Inventive Principle:
Principle #3Local quality

2Loss of information

If entire rows of photon sensors are read out, then all pixel data is available, but processing resources and data transfer time increase

Engineering Contradiction:
Improvedata completenessVSAvoiddata transfer time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent extracts only the necessary data from the photon sensor array by identifying and isolating regions of interest containing eye images. The data extraction process selectively retrieves information from specific sensor groups rather than processing the entire array, reducing data transfer time while preserving all necessary information for eye tracking functionality.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent implements partial action by reading out only the portion of the photon sensor array that contains relevant eye tracking data. This selective reading approach processes less data than the complete array would require, significantly reducing processing resources and data transfer time while obtaining sufficient information for the intended application.

Inventive Principle:
Principle #16Partial or excessive action

3Use of energy by moving object

If data selector components selectively output signals from subset of photon sensors, then power consumption is reduced, but device complexity increases

Engineering Contradiction:
Improvepower consumptionVSAvoiddata selector component complexity
Core Design Contradiction:
Use of energy by moving objectVSDevice complexity

Solution Approach 1:

The patent introduces data selector components as intermediary elements between the photon sensor array and the processing circuitry. These mediators selectively route signals from specific sensor groups to the output, enabling controlled data flow that reduces power consumption. The added complexity of the selectors is offset by the significant energy savings and improved system controllability.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11653083B2Image sensor module
Publication Date: 2023.05.16 QUALCOMM INC
  • US11653083B2 patent drawing
  • US11653083B2 patent drawing
  • US11653083B2 patent drawing

AI summary

Various aspects of the present disclosure generally relate to a sensor module. In some aspects, an image sensor module may include an array of photon sensors configured to output a first set of signals corresponding to a set of photon sensors of the array of photon sensors. The set of photon sensors may include a row of photon sensors, or a column of photon sensors, of the array of photon sensors. The image sensor module may include a plurality of data selector components configured to receive the first set of signals and output a second set of signals corresponding to a subset of the set of photon sensors.