HMD-Synced Touch Track Mode for Precision Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies for controlling touch screens on terminal devices connected to head-mounted display devices suffer from low accuracy and require complex systems with high costs, as users cannot directly operate the touch screen due to its invisibility.
Innovation Solution
Implementing a method and device that switches between track and trigger modes, where the sliding track of a user's finger is displayed synchronously on both the terminal and head-mounted display devices to locate the finger's position, allowing direct control of the touch screen without additional hardware.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If gesture recognition sensors are added to the head-mounted display device to enable touch screen control, then the controllability of the touch screen is improved, but the device complexity and cost increase
Solution Approach 1:
The patent introduces an intermediary mechanism - the visual feedback loop between the head-mounted display and touch screen - to enable control without direct sensors on the HMD. The system mediates the control process by displaying touch screen content on the HMD and using head movement as a natural intermediary for pointing and selection, eliminating the need for complex gesture sensors.
Solution Approach 2:
The system uses the head-mounted display's existing display capability to serve dual purposes: showing content and providing visual feedback for touch screen control. The HMD itself serves as the feedback mechanism, eliminating the need for separate sensor systems. The user's natural head movements serve as the control input, requiring no additional sensors.
2Measurement precision
If gesture recognition technology is enhanced to improve recognition accuracy, then the control precision is improved, but the implementation system becomes more complicated and costly
Solution Approach 1:
The patent replaces complex mechanical gesture recognition systems with a simpler optical-visual feedback system. Instead of using sensors to detect and interpret gestures, the system uses the visual display on the HMD to provide real-time feedback about touch screen interactions, allowing users to control the touch screen through natural head movements and visual confirmation.
3Adaptability or versatility
If the touch screen is made invisible to the user, then the head-mounted display can provide an immersive experience, but the user cannot directly operate the touch screen
Solution Approach 1:
The patent merges the display functions of the touch screen and head-mounted display by showing the same content on both devices simultaneously. This creates a unified visual experience where the HMD serves as both the immersive display and the feedback mechanism for touch screen control, allowing users to maintain immersion while retaining operability.
Data Source
AI summary
This invention discloses a method and device for controlling a touch screen, including: determining that that the touch screen is working in a track mode; when a finger is sliding on the touch screen, obtaining a sliding track of the finger and displaying the sliding track on both the terminal device and the head-mounted display device synchronously, wherein the sliding track is used to locate the position of the finger on the touch screen; when a switching condition is satisfied, switching the touch screen from the track mode to a trigger mode; and when an operation instruction to the touch screen is detected, triggering the touch screen to perform the corresponding function in accordance with the operation instruction. Compared with existing technologies, the method and device provided by this invention have a higher control precision of the touch screen, do not need to add additional hardware and thus reduce the cost invested.