Head-Mounted Device Gaze Tracking for External Object Color Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing head-mounted devices lack the capability to accurately determine the color of external objects in real-time, which is essential for augmented reality, mixed reality, and virtual reality applications.

Innovation Solution

A head-mounted device equipped with a gaze tracking system and an external optical sensor that determines the angle of the user's gaze and adjusts the measured color of external objects based on information from additional ambient light sensors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If head-mounted devices use existing environmental sensors for sensing external objects, then the device can detect external environment, but the device cannot accurately determine the color of external objects in real-time

Engineering Contradiction:
Improvecolor determination accuracyVSAvoidreal-time color detection capability
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent applies multi-functionality by enabling the existing environmental sensors (optical sensors, cameras, ambient light sensors) to perform multiple functions: not only sensing the external environment but also accurately determining colors of external objects in real-time. This resolves the contradiction by making the sensor system universally capable of both general environmental sensing and specific color measurement tasks simultaneously.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent employs parameter changes by adjusting sensor parameters (such as optical filter configurations, sensor sensitivity settings, and processing algorithms) to optimize for accurate color determination. By dynamically changing sensor parameters based on detection needs, the system achieves both environmental sensing and precise real-time color measurement without sacrificing either capability.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If head-mounted devices add additional ambient light sensors for color correction, then the color measurement accuracy improves, but the device complexity increases

Engineering Contradiction:
Improvecolor measurement accuracyVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges the color correction function with the existing ambient light sensing capability. Instead of adding completely separate correction sensors, the system combines color determination and color correction functions into a unified sensor processing pipeline, where additional ambient light sensors serve dual purposes of both environmental illumination detection and color accuracy correction.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent implements feedback mechanisms where the additional ambient light sensors provide correction data back to the color determination system. This feedback loop allows the system to automatically adjust and correct color measurements based on ambient lighting conditions, improving accuracy without requiring complex manual calibration or additional processing complexity.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate real-time color determination of external objects, allowing for improved color input in virtual spaces and enhanced interaction with real-world environments in AR/VR applications.

Implementation Method 1

The external optical sensor may be used to determine the color of an external object in the direction of the determined angle/direction

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

The head-mounted device may include an additional ambient light sensor or other optical sensor to determine the color shift imparted to the external object from an external light source

Methodology Applied
Scientific EffectLight detection: Photoelectric Effect

Data Source

PatentUS12326973B2Electronic device with optical sensor for color detection
Publication Date: 2025.06.10 APPLE INC
  • US12326973B2 patent drawing
  • US12326973B2 patent drawing
  • US12326973B2 patent drawing

AI summary

A head-mounted device may have a gaze tracking system and an optical sensor. The gaze tracking system may include a camera, ambient light sensor, or other optical sensor to determine an angle/direction of a user's gaze. The optical sensor may be a camera, directional color ambient light sensor, or other optical sensor. After determining the user's gaze, the optical sensor may be used to determine the color of an external object in the direction of the determined angle/direction. For example, the color of the external object may be determined in response to an input from the user, such as a button press, a voice command, or a blink. The determined color may be used as an input color in a virtual space or on another device.