Automatic Text Scrolling in Head-Mounted Displays via Eye Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current head-mounted display (HMD) devices require manual and unnatural methods for advancing text, which is cumbersome, especially in applications like electronic books, karaoke, or teleprompting, as they lack automatic and natural text scrolling capabilities.
Innovation Solution
An HMD device that uses a combination of eye tracking, geographical data, inertial measurement unit (IMU) data, 3D environment modeling, audio, and biometric data to automatically scroll text in a natural and personalized manner, integrating inputs from the user's gaze direction, focal distance, and environmental context.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual methods are used to advance text in HMD devices, then the device structure remains simple, but the ease of operation deteriorates and reading becomes cumbersome
Solution Approach 1:
The system automatically detects user gaze direction and reading progress, then autonomously advances text without requiring manual input. The HMD device monitors its own usage state through eye tracking sensors and automatically controls text scrolling based on detected reading patterns, making the system self-regulating and eliminating the need for manual text advancement operations
Solution Approach 2:
The patent replaces manual mechanical text advancement (button presses, wheel rotations) with an automated optical sensing system. Eye tracking cameras and gaze detection algorithms substitute for physical interaction mechanisms, using optical fields and computational processing instead of mechanical controls to advance text display
2Ease of operation
If automatic text scrolling is implemented using eye tracking and environmental sensors, then the ease of operation improves, but the device complexity increases
Solution Approach 1:
The HMD device integrates multiple functions into a unified system: eye tracking for gaze detection, IMU sensors for head orientation monitoring, environmental sensors for context awareness, and automated text scrolling control. These diverse components work together through a centralized control algorithm that processes multiple input streams to manage text display, allowing the system to perform reading assistance, gesture control, and environmental adaptation through a single integrated architecture
Solution Approach 2:
The patent combines eye tracking technology, inertial measurement unit data, environmental sensing capabilities, and text rendering systems into a unified automated scrolling mechanism. Rather than implementing separate systems for each function, the invention merges these components into a coordinated system where gaze detection, head movement tracking, and environmental context are processed together to control text advancement
3Adaptability or versatility
If natural and personalized text scrolling is achieved through multiple sensors, then the ease of operation improves, but the extent of automation increases system complexity
Solution Approach 1:
The system continuously monitors user gaze direction, reading speed, and comprehension indicators through eye tracking sensors, then uses this feedback to dynamically adjust text scrolling speed and positioning. The control algorithm processes real-time gaze data and modifies display parameters accordingly, creating a closed-loop system that adapts to individual user reading patterns and maintains optimal text visibility based on detected attention and understanding levels
Data Source
AI summary
A see-through head-mounted display (HMD) device, e.g., in the form of glasses, provides view an augmented reality image including text, such as in an electronic book or magazine, word processing document, email, karaoke, teleprompter or other public speaking assistance application. The presentation of text and/or graphics can be adjusted based on sensor inputs indicating a gaze direction, focal distance and/or biological metric of the user. A current state of the text can be bookmarked when the user looks away from the image and subsequently resumed from the bookmarked state. A forward facing camera can adjust the text if a real word object passes in front of it, or adjust the appearance of the text based on a color of pattern of a real world background object. In a public speaking or karaoke application, information can be displayed regarding a level of interest of the audience and names of audience members.