Gaze-Driven Text Rendering in Head-Mounted Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Head-mounted displays (HMDs) present challenges in naturally and intuitively displaying text information within immersive three-dimensional environments, as conventional display surfaces are not available, leading to awkward or unnatural presentation methods.
Innovation Solution
The system tracks the orientation and gaze of the user's head-mounted display, identifying a gaze target in the virtual environment to render text information at appropriate locations, such as near the user's view depth or on objects within the environment, using a combination of image analysis and inertial sensors, and optionally using a controller device to simulate a display surface for text rendering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If text information is displayed on conventional display surfaces in immersive 3D environments, then text presentation is straightforward, but head-mounted displays lack conventional display surfaces making text presentation awkward and unnatural
Solution Approach 1:
The patent transitions from 2D conventional display surfaces to 3D spatial positioning within the immersive environment. Text is rendered at specific 3D coordinates determined by gaze direction and view depth, allowing natural integration into the virtual space without requiring traditional flat display surfaces.
Solution Approach 2:
The patent introduces a virtual display surface as an intermediary between the user and text information. This virtual surface is positioned in the 3D environment based on gaze tracking and orientation data, serving as a natural presentation medium that bridges the gap between the user's view and the text information.
2Loss of information
If text information is presented in the user's field of view, then information accessibility is improved, but visual obstruction of the primary environment may occur
Solution Approach 1:
The patent positions text information at specific local regions in the 3D environment based on gaze direction and view depth. Text is rendered laterally or at the edges of the user's visual field rather than centrally, ensuring it does not obstruct the primary view while remaining accessible.
Solution Approach 2:
The patent dynamically adjusts text position based on real-time gaze tracking and head orientation. As the user moves their gaze, the text information repositions accordingly to maintain optimal visibility without causing obstruction, creating a dynamic adaptation to user viewing behavior.
3Measurement precision
If gaze tracking and orientation processing are implemented to identify gaze targets, then text positioning accuracy is improved, but system complexity increases
Solution Approach 1:
The patent uses the head-mounted display's existing orientation tracking capability (designed for navigation and movement) to also determine gaze direction. The same sensors and processing systems serve multiple functions: navigation, positioning, and gaze-based text placement, reducing the need for separate dedicated tracking systems.
Data Source
AI summary
A method for presenting text information on a head-mounted display is provided, comprising: rendering a view of a virtual environment to the head-mounted display; tracking an orientation of the head-mounted display; tracking a gaze of a user of the head-mounted display; processing the gaze of the user and the orientation of the head-mounted display, to identify a gaze target in the virtual environment towards which the gaze of the user is directed; receiving text information for rendering on the head-mounted display; presenting the text information in the virtual environment in a vicinity of the gaze target.