HMD and Control Device Interface Switching for Flexible Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing display systems that combine a head-mounted display (HMD) with a touch-enabled control device limit the user's view of display units during input operations, restricting the flexibility of input methods and user interfaces.
Innovation Solution
A display system comprising a head-mounted display apparatus with a first display unit and a control device featuring a second display unit and a touch sensor, allowing switching between multiple user interfaces, including a first user interface for input detection and a second user interface for input display, with notifications for interface changes, and an application executing unit that utilizes detected touch data for operation events.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the user views the display of the mobile terminal device during input operations, then the user can optionally view multiple display units, but the display unit that the user should view is limited
Solution Approach 1:
The system segments the display functionality by providing multiple independent display units (HMD and mobile terminal) that can be independently controlled. Different user interfaces are assigned to different display units based on the current operation mode, allowing the input screen to be displayed on one device while the result screen is displayed on another, thus resolving the conflict between viewing flexibility and input clarity.
Solution Approach 2:
The system dynamically switches between different user interfaces and display configurations based on the current operation state. The control device can switch between a first user interface (displaying input screen on mobile terminal) and a second user interface (displaying input screen on HMD), allowing the display arrangement to adapt dynamically to the user's needs while maintaining clear input operation guidance.
2Adaptability or versatility
If multiple user interfaces are provided for different input methods, then the adaptability and versatility of the system is improved, but the complexity of interface management increases
Solution Approach 1:
The control device is designed with multi-functionality to handle multiple user interfaces and display configurations. It can function as both a display controller for the HMD and a display controller for the mobile terminal, managing different input methods (touch sensor, voice, gesture) through a unified control architecture. This universal design allows the system to support diverse input methods without proportionally increasing complexity.
Solution Approach 2:
The system implements feedback mechanisms to manage interface switching. When the user performs a specific operation or the system detects a change in operation state, it automatically switches between the first and second user interfaces and provides notifications. This feedback-driven approach simplifies interface management by automating the switching logic based on actual usage context rather than requiring complex manual control.
3Loss of information
If notifications are provided when user interfaces are switched, then the user is informed of interface changes, but the frequency of notifications may increase
Solution Approach 1:
The system provides preliminary notifications before interface switching occurs. By informing the user in advance of an upcoming interface change, the user can mentally prepare for the transition, reducing the cognitive load during actual switching. This preliminary action approach minimizes the perceived frequency of notifications by making them more predictable and less disruptive.
Solution Approach 2:
The notification system operates periodically based on actual interface switching events rather than continuously. Notifications are triggered only when necessary (when interfaces actually switch), and the system maintains awareness of the current interface state to avoid redundant notifications. This periodic, event-driven notification approach reduces unnecessary information loss while minimizing time spent on frequent notifications.
Data Source
AI summary
A display system includes an HMD and a control device. The control device can execute switching between a plurality of user interfaces. When the user interfaces are switched without change of display of an image display unit, a notification is made by the control device. When the user interfaces are switched with change of display of the image display unit, a notification is made by the HMD.