Gaze Tracking Mixed Reality Display Adaptation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mixed reality devices face challenges in presenting content to users due to head and eye movement, varying visual capabilities, which can cause disorientation or motion sickness and make it difficult for users to identify items of interest.
Innovation Solution
An electronic device equipped with a camera and display, utilizing control circuitry that gathers information on the user's point of gaze and real-world image attributes, along with user vision data, to dynamically display supplemental information such as icons, text labels, and enhanced image content, while adjusting image attributes to compensate for user vision impairments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If mixed reality content is presented to users, then information overlay and enhancement are improved, but user disorientation and motion sickness increase due to head and eye movement
Solution Approach 1:
The system dynamically adjusts the display of mixed reality content based on real-time detection of user head and eye movement. When movement is detected, the system suppresses or adjusts overlays to prevent disorientation and motion sickness, while maintaining information availability when the user is stable.
Solution Approach 2:
The system uses sensors to continuously monitor user head and eye movement, providing feedback to the control circuitry. This feedback loop enables the system to adapt the mixed reality presentation in real-time, suppressing content when movement causes discomfort and maintaining it when the user is stable.
2Loss of information
If mixed reality content is presented to users, then information overlay is improved, but user identification of items of interest becomes difficult
Solution Approach 1:
The system applies local quality enhancement by analyzing the real-world image to identify items of interest and applying selective overlays or enhancements only to specific regions where users are likely to focus attention, rather than uniformly across the entire display.
Solution Approach 2:
The system performs preliminary image analysis to identify potential items of interest before presenting mixed reality content. By pre-processing the real-world image to detect and highlight relevant objects, the system prepares the display to facilitate easier identification of items of interest.
3Device complexity
If standardized mixed reality content is displayed, then device complexity is reduced, but adaptability to different user visual capabilities deteriorates
Solution Approach 1:
The system changes display parameters such as contrast, brightness, and overlay intensity based on detected user visual capabilities. By adjusting these parameters dynamically, the system adapts to different users without requiring complex custom display hardware for each user type.
Solution Approach 2:
The display system is designed to serve multiple user types with different visual capabilities through a single unified system. The control circuitry adapts the display output based on user characteristics, making the device universally applicable without requiring separate specialized displays for different user needs.
Data Source
AI summary
An electronic device may have a display and a camera. Control circuitry in the device can gather information on a user's point of gaze using a gaze tracking system and other sensors, can gather information on the real-world image such as information on content, motion, and other image attributes by analyzing the real-world image, can gather user vision information such as user acuity, contrast sensitivity, field of view, and geometrical distortions, can gather user input such as user preferences and user mode selection commands, and can gather other input. Based on the point-of-gaze information and/or other gathered information, the control circuitry can display the real-world image and supplemental information on the display. The supplemental information can include augmentations such as icons, text labels, and other computer-generated text and graphics overlaid on the real world image and can include enhanced image content such as magnified portions of the real-world image.