Transmissive Head-Mount Display Gesture Control via Camera Intermediary
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing head-mount type display devices face challenges in providing intuitive and efficient control over multiple control target devices, leading to usability issues such as user fatigue and difficulty in recognizing and controlling objects within the visual field.
Innovation Solution
A transmissive head-mount type display device equipped with an image display section, an object acquisition section, and a control section that allows users to visually recognize and control objects without changing their eye direction, by displaying object-correspondence virtual images and detecting changes in object position, enabling intuitive operation and improved usability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the user controls multiple control target devices using existing methods, then the control functionality is achieved, but the operation becomes non-intuitive and usability deteriorates
Solution Approach 1:
The patent introduces a camera as an intermediary device to capture the user's line of sight and hand position. This intermediary translates physical gestures into control commands, making the control process more intuitive. The camera mediates between the user's natural actions and the control target devices, eliminating the need for complex control interfaces.
Solution Approach 2:
The patent replaces traditional mechanical control interfaces (buttons, switches, keyboards) with an optical-based system using a camera to detect hand gestures and eye position. This substitution eliminates the need for physical interaction with control devices, allowing users to control multiple devices through natural gestures captured by the camera, thereby improving intuitiveness.
2Measurement precision
If the user maintains fingertip position for object selection, then the selection accuracy is improved, but user fatigue increases
Solution Approach 1:
The system uses periodic capture of hand position and eye position data to determine object selection. Instead of requiring continuous fingertip positioning, the camera periodically captures the user's gestures and line of sight, processing these discrete data points to identify the selected object. This periodic sampling reduces the burden of continuous positioning while maintaining selection accuracy.
Solution Approach 2:
The patent creates a virtual copy of the user's hand position and eye position in the digital realm through camera capture and image processing. This copied data is then used to determine object selection, eliminating the need for precise physical fingertip positioning. The system processes the captured images to identify hand gestures and correlate them with objects in the field of view, reducing physical strain while maintaining selection precision.
3Measurement precision
If additional information is required for hand-based control, then the control precision is improved, but the operation becomes less intuitive
Solution Approach 1:
The patent merges multiple data sources - hand position from image recognition, eye position from line of sight detection, and spatial relationships - into a unified control system. By combining these information streams, the system achieves precise control without requiring the user to manually process or input each piece of information separately. The integrated approach maintains intuitiveness while improving precision through multi-factor correlation.
Data Source
AI summary
A transmissive head-mount type display device including a display configured to display a virtual image, and capable of transmitting an external sight. The head-mounted display including at least one processor or circuit configured to obtain an object located in a predetermined distance range from the display, and a position of a specific object included in the external sight, control the display to display a virtual image associated with the obtained object, identify a change in the position of the specific object based on a position of the specific object obtained, select the object based on a relationship between the change in the position of the specific object identified and a position of the object obtained, and control the display to display a specific check image associated with the object selected as the virtual image.