Under-Display Eye Tracking Layout for HMD Viewing Clarity

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing head-mounted displays (HMDs) face challenges in eye and face tracking due to the positioning of cameras and LEDs, which cause manufacturing difficulties and interfere with display and optical viewing experiences.

Innovation Solution

Integrate cameras and LEDs directly inside or behind the display panel of HMDs, positioning them out of the user's field of view to minimize interference and enhance tracking performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If cameras and LEDs are positioned around the optical lens or in front of display panels, then eye tracking and face tracking functions can be implemented, but manufacturing and integration challenges increase and tracking performance deteriorates due to light distortions

Engineering Contradiction:

Improvetracking accuracyVSAvoidmanufacturing and integration difficulty

Core Design Contradiction:

Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent extracts the cameras and LEDs from their traditional positions around the optical lens or in front of the display panel, and relocates them to the back of the display panel. This extraction from the problematic location eliminates the light distortion issues and manufacturing challenges associated with integrating components around the optical lens, while maintaining the tracking functionality through the display panel material.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent transitions the positioning of cameras and LEDs from a two-dimensional arrangement around the optical lens to a three-dimensional configuration behind the display panel. By moving components to the back of the display panel, the system utilizes the depth dimension to achieve proper optical alignment without interfering with the forward-facing optical path, thereby improving both manufacturing ease and tracking accuracy.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

2Measurement precision

If cameras and LEDs are positioned around the optical lens, then eye tracking can be achieved, but the position of cameras and LEDs interferes with the display and optical viewing experiences

Engineering Contradiction:

Improvetracking accuracyVSAvoidinterference with display and optical viewing

Core Design Contradiction:

Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent removes the cameras and LEDs from the optical path by extracting them from positions around the optical lens and relocating them to the back of the display panel. This extraction eliminates the harmful interference with the optical viewing experience while maintaining tracking functionality through the semi-transparent display panel material.

Inventive Principle:

Principle #2Taking out (Extraction)

3Ease of operation

If cameras and LEDs are positioned in front of or outside the display panels, then eye and face tracking functions are implemented, but light distortions reduce tracking performance

Engineering Contradiction:

Improvetracking function implementationVSAvoidtracking performance

Core Design Contradiction:

Ease of operationVSMeasurement precision

Solution Approach 1:

The patent inverts the conventional arrangement by positioning the cameras and LEDs behind the display panel rather than in front of it. This inversion allows the optical components to view through the display panel material, eliminating the light distortions that occur when components are positioned in front of the panel, while still enabling eye and face tracking functions.

Inventive Principle:

Principle #13The other way round (Inversion)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Improves eye and face tracking accuracy by reducing distortions and interference, enhancing the user experience in immersive environments.

Implementation Method 1

a light source arranged so that light from the light source is incident upon the user's eyes through the optical assembly

Methodology Applied

Scientific EffectLight emission: Light Emitting Diode

Implementation Method 2

receive a signal from the camera, process the signal to generate tracking data associated with the user's eyes and face

Methodology Applied

Scientific EffectLight reflection: Reflection

Data Source

PatentUS20260064197A1Eye and face tracking with under display camera and LED

Publication Date: 2026.03.05 META PLATFORMS TECHNOLOGIES LLC

AI summary

A head mounted display for eye and face tracking includes an optical assembly arranged proximate to a user's eyes, a display panel arranged behind the optical assembly and visible to the user through the optical assembly along a line of sight of the user, a camera arranged within the display panel so that the user's eyes are visible to the camera through the optical assembly, and a light source arranged proximate to the camera so that light from the light source is incident upon the user's eyes through the optical assembly.