UI Element Position Adjustment for Head-Mounted Display Touch Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users wearing head-mounted electronic devices face difficulty in selecting UI elements on the device's screen due to blocked vision, as they cannot see the touch panel to perform accurate touch inputs.
Innovation Solution
The electronic device adjusts the location of UI elements on its screen based on touch panel information and user input, using a communicator to receive and process touch data, allowing users to select elements accurately even when their view is obstructed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If a head-mounted electronic device is worn to display a screen, then the user can view content through the device's display, but the user's view is blocked and they cannot see the touch panel to perform accurate touch inputs
Solution Approach 1:
The system introduces an intermediary mapping mechanism that translates touch panel coordinates to screen display coordinates. The processor receives touch input from the external device's touch panel, determines the corresponding location on the displayed screen, and enables accurate selection of UI elements without requiring the user to visually align their finger with the screen content
Solution Approach 2:
The system provides feedback by displaying information about the correlation between touch panel locations and screen display locations. This allows the user to understand where their touch input will register on the virtual screen, enabling accurate operation even without direct visual feedback of the touch panel itself
2Ease of operation
If the UI element location is fixed on the screen, then the display layout is simple, but the user cannot accurately select UI elements when their view is blocked
Solution Approach 1:
The system performs preliminary action by pre-establishing the coordinate mapping relationship between the touch panel and the screen display. This mapping is set up in advance through the processor, which correlates touch panel coordinates with display coordinates based on device configuration, enabling accurate touch input without requiring real-time complex calculations
Data Source
AI summary
An electronic device includes a communicator configured to perform communication with an external device, a display configured to display a UI (User Interface) element in a screen, and a processor. The processor receives through the communicator, touch panel information of the external device and first data according to a first input of a user detected on the touch panel of the external device, and changes a location of the UI element displayed on the screen based on the touch panel information and the first data.