Virtual Gesture Point for Wearable Display Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing gesture recognition technologies for intelligent wearable devices face challenges such as limited functionality, confusion due to mismatched visual and mental models, and inability to accurately control interactive controls on the display interface.
Innovation Solution
A gesture-based display interface control method that involves acquiring a first gesture, determining if it is held for a preset time, displaying a virtual gesture point, and then moving this point on the display interface based on subsequent gestures, allowing for precise control of interactive controls.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If wrist gesture recognition is used for remote operation, then hand-free operation is enabled, but the screen moves together with the wrist which hinders information transmission
Solution Approach 1:
The patent introduces a virtual gesture point as an intermediary element that remains stationary on the screen while the user's wrist moves. This virtual point acts as a mediator between the physical gesture and the screen content, allowing the screen to stay fixed for information transmission while still enabling remote gesture control through the virtual point's interaction with UI elements
2Ease of operation
If simple gestures are used for remote control, then operation simplicity is improved, but functionality is limited and cannot accurately control interactive controls
Solution Approach 1:
The patent implements dynamic gesture recognition that adapts to different operational needs. The system recognizes multiple gesture types (swiping, clicking, long-pressing) and dynamically responds with appropriate functions. The virtual gesture point can be positioned dynamically based on finger movement direction, enabling both simple navigation and precise control of interactive controls within the same framework
Solution Approach 2:
The patent creates a universal gesture control system where a single virtual gesture point mechanism handles multiple functions including interface switching, element selection, and interactive control operation. By combining different gesture actions (swipe direction, hold duration, release position) with the virtual point, the system achieves multi-functionality while maintaining operational simplicity
3Ease of operation
If fingers are not actually on the screen during remote gesture operation, then hand-free operation is enabled, but visual and mental models mismatch causing confusion
Solution Approach 1:
The patent creates a virtual copy of the finger interaction on the screen through the virtual gesture point. This virtual point replicates the function of a physical finger touch, providing visual feedback that matches the user's mental model of screen interaction. The virtual point's position, movement, and interaction states mirror what would occur with direct touch, maintaining consistency between visual and mental models while enabling hand-free operation
Data Source
AI summary
A gesture-based display interface control method and apparatus, a device and a storage medium, belonging to the technical field of intelligent devices. The method includes: acquiring a first gesture of a user, and determining whether the first gesture is kept for more than a preset time; if the first gesture is kept for more than the preset time, displaying a target virtual gesture point on the current display interface; and acquiring a second gesture of the user, and moving the target virtual gesture point on the current display interface according to the second gesture. According to the method, the virtual gesture point is displayed on the display interface, and the virtual gesture point is randomly moved on the display interface, so that any interactive control on the current display interface can be operated, and gesture control is more intelligent and comprehensive while improving the accuracy of gesture control.