Selective Image Sensor Readouts for Low-Power Head-Mounted Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Head mounted display devices are power constrained due to energy-intensive image processing techniques, necessitating improved energy efficiency to sustain operation throughout the day while being comfortably wearable.

Innovation Solution

Implementing non-destructive and destructive readouts from image sensors, where non-destructive readouts identify regions of interest using lower quality scans and destructive readouts capture higher quality images only in those regions, thereby conserving power.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If destructive readouts are used to capture high quality images, then image quality is improved, but power consumption increases

Engineering Contradiction:
Improveimage qualityVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The image sensor is divided into multiple regions, with only specific regions of interest undergoing destructive readouts while other regions use non-destructive readouts. This segmentation allows high-quality imaging only where needed, reducing overall power consumption while maintaining image quality in critical areas.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the image sensor are assigned different readout methods based on local requirements. Regions of interest receive destructive readouts for high quality, while non-interest regions use energy-efficient non-destructive readouts, optimizing the balance between quality and power consumption locally.

Inventive Principle:
Principle #3Local quality

2Use of energy by moving object

If non-destructive readouts are used to identify regions of interest, then power consumption is reduced, but image quality deteriorates

Engineering Contradiction:
Improvepower consumptionVSAvoidimage quality
Core Design Contradiction:
Use of energy by moving objectVSMeasurement precision

Solution Approach 1:

The patent extracts only the necessary information (regions of interest) using low-power non-destructive readouts, then applies high-power destructive readouts only to those extracted regions where high quality is actually needed. This extraction approach avoids wasting power on entire image captures when only局部 information is required.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Non-destructive readouts are performed first as a preliminary step to identify regions of interest and determine where high-quality imaging is needed. This preliminary action guides subsequent destructive readouts to only the necessary regions, optimizing the balance between power consumption and image quality.

Inventive Principle:
Principle #10Preliminary action

3Use of energy by moving object

If destructive readouts are limited to regions of interest, then power consumption is reduced, but processing complexity increases

Engineering Contradiction:
Improvepower consumptionVSAvoidprocessing complexity
Core Design Contradiction:
Use of energy by moving objectVSDevice complexity

Solution Approach 1:

The system uses non-destructive readout results as feedback to determine which regions require destructive readouts. This feedback mechanism automatically guides the selective readout process, reducing the need for complex manual configuration while maintaining low power consumption through automated region-based processing.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20250244937A1Techniques for image processing of non-destructive readouts
Publication Date: 2025.07.31 APPLE INC
  • US20250244937A1 patent drawing
  • US20250244937A1 patent drawing
  • US20250244937A1 patent drawing

AI summary

In some implementations, the techniques may include performing a first readout of an image sensor to generate a first image frame, where the first readout is a first type of readout of the image sensor. In addition, the techniques may include identifying, by the first processor, one or more first regions of interest in the first image frame. The techniques may include performing a second readout of the image sensor to generate a second image frame, where the second readout is a second type of readout of the image sensor of a device, and the second image frame may include the one or more first regions of interest, where the electronic device has a display and the second image frame is smaller than the display. Moreover, the techniques may include presenting the second image frame on the display.