Gesture Control for Touchscreen Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current touchscreen-enabled user devices require complex and non-intuitive user interactions for functions like file transfer and deletion, making them difficult to operate, especially for those unfamiliar with the device.
Innovation Solution
An object control method and apparatus that utilizes intuitive gestures, such as multi-hovering and hand gestures, detected by a combination of touchscreen sensors and camera inputs, to execute functions like file transfer and deletion, providing visual feedback and enabling communication between devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional touchscreen interactions are used for file transfer and deletion, then device functionality is achieved, but user operation becomes complex and non-intuitive
Solution Approach 1:
The patent replaces traditional mechanical touchscreen interactions (clicking, scrolling through menus) with gesture-based control detected by camera and sensor systems. Users perform natural hand gestures in 3D space above the device, which are captured by the camera and translated into command inputs, eliminating the need to navigate hierarchical menu structures.
Solution Approach 2:
The patent introduces a third spatial dimension for interaction by detecting gestures above the touchscreen surface. Instead of limiting interactions to the 2D touchscreen plane, the system captures hand positions and movements in 3D space using camera and sensor arrays, enabling intuitive gestures like pinching, spreading, and circular motions to control device functions.
2Productivity
If multiple input steps are required to execute functions, then precise control is achieved, but user time and operational efficiency decrease
Solution Approach 1:
The system performs preliminary detection and interpretation of user gestures before executing commands. The camera and sensor systems continuously monitor hand positions and movements, pre-processing gesture data to identify intended actions, so that when a gesture is completed, the corresponding function can be executed immediately without requiring sequential menu navigation.
Solution Approach 2:
The gesture recognition system serves multiple functions simultaneously - it detects hand position, determines gesture type, identifies target objects, and triggers appropriate commands all through a single interaction modality. This multi-functional approach consolidates what would traditionally require multiple separate input steps into unified gesture-based control.
Data Source
Figure 1
Figure 2
Figure 3(a)~3(c)
AI summary
An object control method and apparatus of the user device using hovering gestures are provided. The object control method includes displaying at least one object on a display screen, detecting a multi-finger hovering gesture for selecting the object on the display screen, activating a camera upon detection of the multi-finger hovering gesture, recognizing a hand in a picture input through the camera, and entering, when the hand disappears out of a viewing angle of the camera, a file transfer standby state for transmitting the selected object.