Virtual Mouse Gesture Recognition via Segmentation and Parameter Changes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing control systems for virtual mice on electronic devices with larger screens face challenges in accurately recognizing and interpreting touch gestures, particularly slide and click gestures, which can lead to inefficient navigation and application activation.
Innovation Solution
A control system and method that includes a processing unit, a touch unit, and a storage unit to display a virtual mouse and cursor on the interface, recognize touch gestures, compare them with predefined gestures, and generate control orders to move the cursor or activate applications, enhancing gesture recognition and navigation efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a virtual mouse is implemented on a touch screen for navigation, then ease of operation is improved, but measurement precision of touch gestures deteriorates
Solution Approach 1:
The touch gesture recognition is segmented into distinct types (slide gestures with different angles and durations, click gestures). By dividing the continuous touch input into discrete gesture categories, the system achieves both ease of operation through natural touching and measurement precision through categorical classification.
Solution Approach 2:
The system changes parameters of the touch gesture (slide angle, slide duration, click position) to determine different control orders. By monitoring changes in these parameters over time, the system precisely interprets user intent while maintaining simple touch-based operation.
2Ease of operation
If touch gestures are used to control cursor movement on larger screens, then ease of operation is improved, but reliability of gesture recognition deteriorates
Solution Approach 1:
The system performs preliminary classification of touch gestures into predefined categories (different slide angles, durations, and click gestures) before executing control orders. By establishing these predefined gesture types in advance, the system ensures reliable and consistent recognition of user intent across different screen sizes.
Solution Approach 2:
The system provides feedback by comparing actual touch gestures against predefined gesture patterns and generating corresponding control orders. This comparison process ensures reliable recognition by validating that the detected gesture matches expected patterns before executing navigation or application activation.
3Measurement precision
If gesture recognition complexity is increased to improve navigation accuracy, then measurement precision is improved, but device complexity increases
Solution Approach 1:
The gesture recognition system is segmented into simple, discrete gesture types (specific slide angles, durations, and click gestures) rather than attempting to recognize all possible touch variations. This segmentation achieves measurement precision for navigation control while keeping the recognition logic simple and manageable.
Solution Approach 2:
The system monitors changes in key parameters (slide angle, slide duration, click position) to determine control orders without implementing complex gesture analysis. By focusing on changes in these specific parameters, the system achieves accurate navigation control with relatively simple recognition logic.
Data Source
AI summary
A control method for virtual mouse is provided. The control method is run on an electronic device. The control method includes a plurality of steps. Control a touch unit of the electronic device to display a user interface, a virtual mouse and a cursor on the user interface. Recognize a slide gesture dragging the virtual mouse. Compare the slide gesture with a plurality of predefined gestures stored in a storage unit of the electronic device. Obtain a control order corresponding to one of the plurality of predefined gestures when the slide gesture is the same as the one of the plurality of predefined gestures. Control the cursor to move a motion vector according to the control order. Recognize a click gesture clicking the virtual mouse. Control the electronic device to activate an application program or enter into a link of a text or a picture.