Head-Mounted Display Eye-Tracking Layout With Edge Cameras

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing head-mountable displays lack effective methods for accurately determining eye gaze direction and integrating multiple cameras and illumination systems to enhance user interaction and immersion in virtual and mixed reality environments.

Innovation Solution

A head-mountable display system with strategically positioned cameras and an illumination strip around the display screen, along with an eye-tracking system that uses weighted averaging to determine gaze direction based on patterns of light reflection, and a structural frame with optical modules for enhanced visual projection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple cameras are positioned at different locations around the display screen, then eye gaze tracking accuracy is improved, but device complexity increases

Engineering Contradiction:
Improveeye gaze tracking accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system divides the eye tracking function into multiple independent camera units positioned at different locations around the display screen. Each camera captures light reflection patterns from specific regions, and the controller integrates these segmented measurements to determine overall gaze direction, improving accuracy without requiring a single complex camera system

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Multiple camera systems are merged into a unified eye tracking apparatus where the controller receives and processes data from all cameras simultaneously. The system combines the light reflection patterns captured by different cameras to calculate gaze direction, achieving higher measurement precision through integration of multiple data sources

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If an illumination strip is added around the display screen to enhance light reflection patterns, then eye gaze detection precision is improved, but device complexity and energy consumption increase

Engineering Contradiction:
Improveeye gaze detection precisionVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The illumination strip is positioned around the display screen to pre-establish controlled light reflection patterns on the user's eye surface before gaze detection occurs. This preliminary illumination ensures consistent and enhanced light patterns are available for the cameras to capture, improving detection precision without requiring complex real-time lighting control systems

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The illumination strip serves as an intermediary light source that mediates between the display screen and the cameras. It enhances the light reflection patterns from the eye by providing controlled illumination, enabling the cameras to capture clearer gaze information without directly interfering with the display content or requiring complex integration with the camera systems

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If cameras are positioned close to the display screen edges, then gaze tracking accuracy is improved, but manufacturing precision requirements increase

Engineering Contradiction:
Improvegaze tracking accuracyVSAvoidmanufacturing precision
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The camera mounting structure is designed with universal positioning capabilities that can accommodate cameras at multiple predetermined locations around the display screen. The structural frame includes standardized mounting features that allow flexible camera placement while maintaining consistent geometric relationships, reducing the need for high-precision custom manufacturing for each camera position

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Improves user interaction and immersion by accurately tracking eye gaze and integrating multiple cameras and illumination systems, enhancing the overall experience in virtual and mixed reality environments.

Implementation Method 1

an eye-tracking system that uses weighted averaging to determine gaze direction based on patterns of light reflection

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS12554323B2Head mountable display
Publication Date: 2026.02.17 APPLE INC
  • US12554323B2 patent drawing
  • US12554323B2 patent drawing
  • US12554323B2 patent drawing

AI summary

A head-mountable display can include a structural frame defining a viewing opening, an optical module coupled to the structural frame. The optical module can include a display screen to project light through the viewing opening. The display screen can define an inner edge, an outer edge opposite the inner edge, a lower edge extending between the inner edge and the outer edge, and an upper edge opposite the lower edge. The optical module can include a first camera disposed adjacent the inner edge and closer to the lower edge than the upper edge, and a second camera disposed adjacent the lower edge and closer to the outer edge than the inner edge.