AR Gaze Tracking for Visual Impairment Diagnosis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for diagnosing visual impairment using augmented reality (AR) devices are not efficient in accurately detecting impaired areas of the visual field and providing assistance to users with visual impairments, leading to inconvenience during AR service delivery.

Innovation Solution

An electronic device equipped with a display, optical engine, waveguide, gaze tracking sensor, and processor that outputs target images at different locations, determines gaze direction, and generates a vision map to identify impaired areas, allowing users to self-diagnose and receive assistance for visual impairments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional visual impairment diagnosis methods are used, then diagnosis can be performed, but the accuracy in detecting impaired areas of the visual field is insufficient

Engineering Contradiction:
Improvedetection accuracy of impaired areasVSAvoidcomplexity of diagnosis system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system enables users to perform self-diagnosis of visual impairment through the AR device. The processor automatically captures gaze information, processes it to identify impaired areas, and generates diagnostic results without requiring external medical equipment or professional operators, thus achieving accurate detection while maintaining system simplicity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The AR device is designed to serve multiple functions: it provides augmented reality services while simultaneously performing visual impairment diagnosis. The same display, waveguide, and gaze tracking components used for AR purposes are leveraged for diagnostic functions, eliminating the need for separate dedicated diagnostic equipment and improving measurement precision without increasing overall device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If AR services are provided to users with visual impairment, then users can access AR functionality, but inconvenience is caused due to undetected or inaccurate identification of impaired visual areas

Engineering Contradiction:
Improveconvenience of AR service deliveryVSAvoidaccuracy of visual impairment identification
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system continuously monitors user gaze information and provides real-time feedback to identify impaired visual areas. By analyzing where users fail to detect displayed content or exhibit abnormal gaze patterns, the system reliably identifies impaired areas and uses this information to adaptively adjust AR service delivery, ensuring both accuracy in identification and ease of operation.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary visual impairment diagnosis before providing AR services. By pre-identifying impaired areas through gaze tracking analysis, the system can proactively adapt the AR content delivery to accommodate the user's visual limitations, preventing inconvenience rather than reacting to it after the fact.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If gaze tracking is used to detect visual impairment, then impaired areas can be identified, but the complexity of the system increases due to additional sensors and processing requirements

Engineering Contradiction:
Improveaccuracy of impaired area detectionVSAvoidcomplexity of gaze tracking system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The gaze tracking functionality is merged with the existing AR display system. The waveguide and display components serve dual purposes: delivering AR content to the user and simultaneously tracking gaze patterns by monitoring user interaction with the displayed content. This integration allows accurate impaired area detection without adding separate complex gaze tracking hardware.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system uses the user's own visual behavior and gaze patterns as the diagnostic tool. By analyzing where users naturally look, how long they fixate on elements, and where they fail to detect content, the system derives diagnostic information from the user's inherent visual responses rather than requiring external testing equipment or complex active sensing mechanisms.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate self-diagnosis of visual impairment and minimizes inconvenience by providing assistance to users, allowing them to recognize impaired areas and receive AR services effectively.

Implementation Method 1

a display including an optical engine and a waveguide

Methodology Applied
Scientific EffectTotal Internal Reflection: Total Internal Reflection

Data Source

PatentUS12073016B2Electronic device and method of operating the same
Publication Date: 2024.08.27 SAMSUNG ELECTRONICS CO LTD
  • US12073016B2 patent drawing
  • US12073016B2 patent drawing
  • US12073016B2 patent drawing

AI summary

Provided is an electronic device for detecting lost portions of a field of vision and distorted portions of a field of vision and storing these in a vision map. The lost portions and distorted portions are identified in cooperation with the user by means of virtual image superposition on a real scene, audible requests to the user, gesture inputs provided by the user and gaze tracking. The electronic device may detect an object and provide visual information to a user when the object is in a lost portion or distorted portion of the field of vision.