HMD Pointer Detection via Segmented Display Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Head-mounted display devices face challenges in accurately detecting and processing pointer movements due to deteriorated visibility of the outside scene when a displayed image is overlaid, making it difficult to operate the device's input sections with high accuracy and convenience.
Innovation Solution
A head-mounted display device with a display section showing an image recognizable with the outside scene, a detecting section to identify pointer movements, and a display control section that displays the detection state and corresponding input content, allowing users to confirm detection accuracy and select options easily.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a displayed image is overlaid on the outside scene in a head-mounted display device, then the user can visually recognize the image together with the outside scene, but the visibility of the outside scene is deteriorated making it difficult to operate input sections with high accuracy
Solution Approach 1:
The display region is segmented into multiple areas including a detection area for the pointer and a candidate display area for input content. This segmentation allows the system to display multiple types of information (detection state, candidates, outside scene) in organized spatial regions, reducing visual clutter and improving both visual recognition and input accuracy simultaneously
2Adaptability or versatility
If the display section displays an image in a display region transmitted through the outside scene, then the user can recognize the image together with the outside scene, but it becomes difficult to operate the operation section of the head-mounted display device
Solution Approach 1:
The system provides real-time visual feedback by displaying the detected pointer position and candidate input content directly in the display region. This feedback mechanism allows users to confirm detection accuracy and select options without diverting attention from the outside scene, thereby maintaining ease of operation while enabling image recognition functionality
Solution Approach 2:
The invention transitions from traditional physical operation sections to a virtual interface displayed in the field of view. By presenting candidates and detection states in spatial dimensions within the display region, users can interact through gesture-based pointer control rather than manual operation section manipulation, improving operability
3Adaptability or versatility
If the detecting section detects pointer movement in a region including the display section range, then input capability is enabled, but the detection accuracy is reduced due to deteriorated visibility
Solution Approach 1:
The system displays the detection area and candidate positions in advance within the display region before the user performs the input gesture. This preliminary visual information helps users understand where their pointer should be detected and what options are available, compensating for the reduced visibility and improving detection accuracy
Data Source
AI summary
An HMD includes an image display section configured to display an image in a display region to be transmitted through an outside scene and recognizable together with the outside scene, a camera and an imaging control section configured to detect a pointer associated with a motion of the user in a region including at least a range in which the image is transmitted through the image display section, and a display control section configured to cause the image display section to display, in the display region, an image indicating a detection state of the pointer by the camera and the imaging control section and cause the display section to display a candidate of input content corresponding to at least any one of a movement, a shape, and a position of the pointer detected by the camera and the imaging control section.