HMD Gaze-Based Information Placement for Surroundings Awareness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image displaying methods on HMDs can cause user discomfort, particularly when displaying two-dimensional videos like dialogue boxes, making it difficult for users to check their surroundings.
Innovation Solution
An information processing device that generates a real space image on a head-mounted display, acquires a reference direction associated with the user's line of sight, arranges an information element at a derived position based on this direction, and changes the element's position if the reference direction deviates by a predetermined angle or more for a certain period.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a two-dimensional video (dialogue box) is displayed on an HMD, then information can be presented to the user, but the user may feel discomfort and have difficulty checking the surroundings
Solution Approach 1:
The patent transitions from traditional two-dimensional video display to a three-dimensional virtual space display. The dialogue box is rendered as a three-dimensional object positioned in virtual space at coordinates (x, y, z), allowing it to exist as a spatial element rather than a flat overlay. This dimensional transformation enables the information element to be integrated into the three-dimensional environment, reducing the visual conflict between the two-dimensional interface and the three-dimensional virtual world, thereby decreasing user discomfort while maintaining information delivery.
Solution Approach 2:
The patent implements dynamic positioning of the dialogue box based on the user's line of sight. The system continuously monitors the user's gaze direction and automatically adjusts the position of the information element in three-dimensional space. When the user looks away from the dialogue box, it is repositioned to remain within the user's visual field. This dynamic adaptation ensures the information element stays visible without requiring fixed positioning, reducing user discomfort while maintaining effective information presentation.
2Loss of information
If a two-dimensional video is always displayed in front direction, then information is always visible, but the user cannot easily check surroundings
Solution Approach 1:
The system dynamically adjusts the dialogue box position based on real-time detection of the user's line of sight. Instead of fixed positioning, the information element's coordinates (x, y, z) are continuously updated according to where the user is looking. This dynamic behavior allows the dialogue box to automatically follow the user's attention, ensuring information remains visible without blocking the user's ability to observe the surrounding virtual environment.
Solution Approach 2:
The system implements a feedback loop where the user's gaze direction is continuously monitored and used to adjust the dialogue box position. The detection unit measures the user's line of sight, and this information feeds back to the control unit, which then repositions the information element accordingly. This closed-loop control ensures the dialogue box adapts to user behavior, maintaining visibility while preserving situational awareness.
Data Source
AI summary
An image generation section 240 generates a real space image to be displayed on a head-mounted display worn on the head of a user. A reference direction acquisition section 230 acquires a reference direction associated with the line of sight of the user. The image generation section 240 arranges an information element in the real space image at a position derived on the basis of the reference direction. The image generation section 240 changes the position of the information element in the real space image when, after the information element is arranged, a state in which the reference direction deviates by a predetermined angle or more from the reference direction used at the time of arranging the information element has continued for a predetermined period of time.