AR HMD Gaze-Region Selection for Crowded Image Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video display apparatuses, such as HMDs, face difficulties in user operability and usability when dealing with a large number of AR images, particularly in detecting selection gestures, which are often challenging and inefficient.
Innovation Solution
The apparatus employs a sight line detection system to define a selectable region on the display, assigning ID images only to AR images within this region, allowing selection through audio commands and optional gesture inputs, thereby reducing visual clutter and enhancing user interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If gesture detection method is used for selecting AR images, then selection capability is provided, but detection reliability deteriorates when there are many objects and AR images
Solution Approach 1:
The display screen is divided into a selectable region and a non-selectable region. ID images are only displayed and made selectable within the selectable region, which is a portion of the display screen. This segmentation reduces the number of detectable targets from all AR images to only those within the selectable region, improving gesture detection reliability while maintaining selection capability.
2Loss of information
If all AR images are displayed on the screen, then information completeness is improved, but visual clutter increases making selection difficult
Solution Approach 1:
The display is segmented into a selectable region where ID images are displayed and a non-selectable region where AR images are not selectable. This allows all AR images to be displayed for information completeness, while only those in the selectable region participate in selection operations, reducing visual clutter for active selection.
Solution Approach 2:
Different regions of the display screen have different properties: the selectable region allows interaction and displays ID images, while the non-selectable region displays AR images without selection capability. This local differentiation enables users to easily identify and select from active targets without being distracted by inactive elements throughout the entire display.
3Ease of operation
If ID images are displayed for all AR images, then selection identification is improved, but device complexity increases
Solution Approach 1:
ID images are displayed only within the selectable region rather than for all AR images across the entire display. This segmentation reduces the total number of ID images that need to be generated, managed, and rendered, thereby reducing device complexity while maintaining selection identification capability for active elements.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Provided is a video display device configured such that operability or usability for a user regarding a generated image of AR (Augmented Reality), etc., can be improved. An HMD which is the video display device displays an AR image 30 on a display surface 2, forms an ID image 40 including identification information (ID) for assisting a user's operation on the AR image 30, detects the user's visual line direction so as to set a visual line region 20, and displays the ID image 40 in association with the AR image 30 when the AR image 30 is in the visual line region 20 . The HMD receives the user's selection operation for the ID image 40, selects the AR image 30 associated with the ID image 40 upon reception of the selection operation for the ID image 40, and carries out a prescribed process associated with the AR image 30.