HMD Content Scrolling via Eye and Head Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality systems lack efficient methods to dynamically adjust content display on head-mounted displays (HMDs) based on user reading pace and environmental lighting conditions, leading to suboptimal reading experiences.
Innovation Solution
The system integrates eye tracking and head tracking to automatically scroll content on HMDs, adjusts font size and contrast based on ambient lighting, and includes features like bookmarking and customizable display settings to enhance readability and user interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If automated content scrolling is implemented on HMDs, then reading efficiency is improved, but device complexity increases due to integration of eye tracking and head tracking systems
Solution Approach 1:
The patent combines multiple tracking systems (eye tracking and head tracking) into a unified automated scrolling mechanism. The eye tracking system detects gaze position and the head tracking system detects head movement, and both are integrated to control content scrolling on the HMD display, allowing the system to leverage multiple data sources for improved reading efficiency while managing complexity through unified control logic.
Solution Approach 2:
The system implements automated scrolling that adapts to user behavior patterns. By continuously monitoring eye gaze and head movement, the system automatically adjusts scrolling speed and position without requiring manual intervention, enabling the reading system to serve itself by learning and adapting to individual user preferences over time.
2Measurement precision
If dynamic adjustment of font size and contrast is implemented, then readability is improved, but device complexity increases due to additional sensors and processing
Solution Approach 1:
The patent dynamically adjusts display parameters including font size, contrast, and brightness based on environmental lighting conditions detected by sensors and user reading behavior analyzed through eye tracking. The system modifies these visual parameters in real-time to optimize readability for different lighting environments and individual user preferences, enhancing the reading experience through adaptive parameter tuning.
Solution Approach 2:
The system applies different display qualities to different regions or portions of content based on local conditions. For example, it may adjust contrast or brightness specifically for text in certain areas of the display, or modify font size for specific paragraphs based on detected reading patterns, allowing localized optimization of readability without uniformly changing all display parameters.
3Ease of operation
If automated scrolling based on eye tracking is used, then user interaction ease is improved, but measurement precision requirements increase for accurate gaze detection
Solution Approach 1:
The patent employs head tracking as an intermediary mechanism to supplement eye tracking for scrolling control. While eye tracking provides precise gaze position data, head tracking captures broader directional information. The system combines these two measurement streams, using head movement as a mediator that confirms and contextualizes eye gaze data, thereby maintaining ease of operation while managing the precision requirements of individual sensing modalities.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach provides a more intuitive and adaptive reading experience by synchronizing content scrolling with user reading speed and environmental conditions, improving readability and user engagement in augmented reality environments.
Implementation Method 1
An eye tracking device is used to determine the area on the display that the user is gazing
Implementation Method 2
The user may then move their head in an up and down motion in order to control the scrollbar
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
Methods for controlling the display of content as the content is being viewed by an end user of a head-mounted display device (HMD) are described. In some embodiments, an HMD may display the content using a virtual content reader for reading the content. The content may comprise text and/or images, such as text or images associated with an electronic book, an electronic magazine, a word processing document, a webpage, or an email. The virtual content reader may provide automated content scrolling based on a rate at which the end user reads a portion of the displayed content on the virtual content reader. In one embodiment, an HMD may combine automatic scrolling of content displayed on the virtual content reader with user controlled scrolling (e.g., via head tracking of the end user of the HMD).