HMD Touch Control via Virtual Operation Surface
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Head-mounted displays (HMDs) face challenges in operability due to the need for an operation surface within a visual field range, making multi-touch operations difficult when the HMD is mounted on a user's head, as existing solutions struggle to effectively manage and display multiple objects' positions during touch operations.
Innovation Solution
A head-mounted display system that includes a detection section and a control section capable of switching between single-operation and multi-operation modes, where the display positions of objects are managed within a coordinate management region larger than the display region, and auxiliary images are displayed to aid in recognizing operation positions, allowing for improved touch operation recognition and management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If the operation surface is disposed within the visual field range of the head mounted display, then the user can visually recognize the operation surface, but the multi-touch operation becomes difficult to perform when the HMD is mounted on the user's head
Solution Approach 1:
The patent creates a virtual copy of the operation surface in the visual field that mirrors the physical operation surface's touch positions. When the user touches the physical operation surface, the system generates corresponding touch positions on the virtual operation surface displayed in the visual field, enabling multi-touch operations to be visually recognized and performed even when the HMD is mounted on the user's head
Solution Approach 2:
The patent introduces a virtual operation surface as an intermediary between the physical operation surface and the display region. This virtual surface acts as a mediator that maps touch positions from the physical operation surface to coordinates in the display region, allowing multi-touch operations to be performed and visually recognized without requiring the physical operation surface to be directly visible
2Adaptability or versatility
If the coordinate management region is larger than the display region, then the display positions of multiple objects can be managed, but the objects may move outside the visible display region
Solution Approach 1:
The patent implements a feedback mechanism where the system detects when objects move outside the display region and automatically adjusts their positions back into the visible area. The control section monitors object positions in the coordinate management region and performs position correction when objects exceed the display region boundaries, ensuring objects remain visible while allowing flexible position management
Solution Approach 2:
The patent makes the object position management dynamic by allowing objects to move freely within the larger coordinate management region while implementing automatic boundary detection and correction. The system dynamically adjusts object positions based on their current location relative to the display region, enabling versatile position management while maintaining object visibility
3Adaptability or versatility
If the second object is moved to a position outside the display region, then the coordinate management flexibility is improved, but the user cannot recognize the object's position
Solution Approach 1:
The patent uses feedback to detect when the second object moves outside the display region and triggers automatic position correction. The control section monitors object positions and provides feedback by adjusting the object's position back into the visible display region, ensuring the user can always recognize object positions while maintaining coordinate management flexibility
Data Source
AI summary
A head mounted display includes a control section that switches between a single-touch mode and a multi-touch mode in a case where an operation in a preset aspect is detected, and, in the multi-touch mode, in a case where a pseudo-pointer is moved to a corresponding position outside a display region of an image display section according to an operation on an operation surface, the control section changes a display aspect of the pseudo-pointer.