Snap Motion Gesture Detection via Hand Landmark Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mobile devices lack an efficient method for detecting finger-snap gestures, which could simplify user interactions, such as responding to incoming calls or selecting modes, without requiring physical touch input.
Innovation Solution
A mobile device system that uses an image capturing device to capture a series of image frames of a hand, generates maps of hand landmarks, and determines if they match reference maps for start and progressed positions of a snap motion, allowing the execution of specific actions based on detected finger-snap gestures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional touch input methods are used, then direct control is achieved, but physical contact with the device is required
Solution Approach 1:
The patent replaces the mechanical touch input system with an optical gesture recognition system. The image capturing device records hand movements, and the processor analyzes these visual inputs to detect finger-snap gestures, substituting physical contact with optical-based gesture recognition.
Solution Approach 2:
The patent introduces an intermediary gesture recognition system between the user and the device control. Instead of direct touch, the user performs hand gestures that are captured by the image capturing device and translated into control commands through the processor's gesture detection algorithms.
2Adaptability or versatility
If gesture detection is added to enable finger-snap control, then user interaction flexibility is improved, but device complexity increases
Solution Approach 1:
The patent makes the existing image capturing device serve multiple functions: its primary function for photography/video is enhanced with a secondary function for gesture detection. The same hardware component (image capturing device) is used for both traditional media capture and new gesture-based control, eliminating the need for separate sensors.
Solution Approach 2:
The device uses its own existing resources (image capturing device and processor) to enable gesture detection functionality. Rather than requiring external specialized hardware, the device leverages its built-in components to provide the new capability, making the system self-sufficient.
Data Source
AI summary
A method for detecting and responding to snap motions. The method includes detecting a triggering event that switches a mobile device into a snap motion gesture detection state to commence a finger-snap gesture motion detection process. The method includes activating, based on detecting the triggering event, an image capturing device to capture a series of image frames of a scene and capturing, using the image capturing device, the series of image frames of the scene that includes a hand. The method includes determining, by analyzing at least two frames among the series of image frames, that a finger-snap gesture is detected in the series of image frames. The method includes executing an action corresponding to a determination that a finger-snap gesture is detected in the series of image frames.