Context-Aware Gesture Recognition for Mobile Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current mobile device gesture recognition systems do not consider surrounding circumstances such as location and time when performing gestures, limiting the precision and versatility of gesture-based actions.
Innovation Solution
A method that combines gesture recognition with circumstance information like location and time to map specific gestures to various application items, allowing for context-dependent execution of actions, using sensors like GPS, accelerometers, and PIM systems to generate and store circumstantial gesture information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If gesture recognition is performed without considering surrounding circumstances, then the system is simple and easy to operate, but the precision and versatility of gesture-based actions is limited
Solution Approach 1:
The patent combines gesture recognition with circumstance information (location, time, calendar events) into a unified circumstantial gesture information system. The gesture recognition module integrates multiple data sources including sensor data, location information, time information, and calendar information to comprehensively determine user intent, thereby improving recognition precision while systematically managing the added complexity through modular integration.
Solution Approach 2:
The system enables a single gesture to perform multiple functions based on different circumstances. For example, a shake gesture can trigger different application items depending on the current location, time, or calendar event context. This multi-functionality approach allows the gesture recognition system to adapt to various scenarios without requiring separate gestures for each function, improving versatility while maintaining system manageability.
2Adaptability or versatility
If multiple gestures are defined for different circumstances, then the versatility of gesture operations is improved, but the number of gestures needed increases and ease of operation decreases
Solution Approach 1:
The patent implements circumstantial gesture information that allows a single gesture to map to multiple application items based on context. The system determines user intent by combining gesture data with circumstance information (location, time, calendar), enabling one gesture to perform different functions in different situations. This reduces the total number of gestures users must learn while maintaining high versatility in gesture operations.
3Reliability
If circumstance information is integrated with gesture recognition, then user intent recognition is enhanced, but the device complexity and processing requirements increase
Solution Approach 1:
The patent merges gesture recognition with circumstance information processing into an integrated system. The gesture recognition module combines sensor data, location information, time information, and calendar information to comprehensively determine user intent. This integrated approach improves reliability by considering multiple context factors simultaneously while managing processing complexity through systematic data fusion and prioritization of relevant circumstances.
Data Source
Figure 1~2
Figure 3a
Figure 3b
AI summary
A method of operating a mobile device by recognizing a user's gesture and a mobile device that uses the method, the method includes recognizing the user's gesture and circumstance information; generating circumstantial gesture information according to a combination of the recognized gesture and the circumstance information; and executing an application item corresponding to the circumstantial gesture information.