Gesture Recognition for Wet Mobile Device Operation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mobile devices are difficult to operate in wet environments due to the limitations of traditional touch panels, which hinder user interaction with electronic devices such as smartphones in conditions like beaches or kitchens.
Innovation Solution
The integration of a recognition module and control module in mobile devices that allow users to perform gestures with their fingers to control applications and execute commands, enabling operation without direct contact with the touch panel, using a combination of depth sensors and cameras to recognize and interpret finger movements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a touch panel is used for mobile device operation, then user interaction is enabled, but operation becomes difficult in wet environments
Solution Approach 1:
The patent replaces the mechanical touch panel contact system with an optical recognition system using cameras and depth sensors. The system captures images and depth information of hand gestures, processes them to recognize gesture patterns, and executes corresponding commands without requiring physical contact with the device surface, thereby enabling reliable operation in wet environments.
Solution Approach 2:
The patent introduces an intermediary gesture recognition system that mediates between the user and the device. Instead of direct touch contact, the user performs gestures in the air that are captured by cameras and depth sensors, processed through gesture pattern matching, and translated into device commands. This intermediary layer eliminates the need for direct contact while maintaining intuitive control.
2Ease of operation
If gesture recognition is implemented, then hands-free control is enabled, but device complexity increases
Solution Approach 1:
The patent integrates multiple functions into existing device components. The camera and depth sensor, originally used for other purposes, are also utilized for gesture recognition. The processor handles both standard device operations and gesture pattern recognition. This multi-functionality approach enables hands-free control without proportionally increasing device complexity, as existing hardware resources are leveraged for the new capability.
Solution Approach 2:
The patent combines the gesture recognition functionality with the existing image processing and control systems. The gesture recognition module integrates with the camera system, depth sensor, and processor that already exist in modern mobile devices. By merging these functions rather than adding completely separate systems, the patent achieves hands-free control while minimizing the increase in device complexity.
Data Source
AI summary
An electronic device and method is disclosed. The electronic device includes a storage module, a recognition module, and a control module. The storage module is configured to store a first and second movement of one or more fingers of a user, and a first and second process. The first movement is different from the second movement. The first process comprises executing an application. The second process is configured to notify information related to the first process. The recognition module is configured to recognize a gesture of one or more fingers as the first movement or the second movement. The control module configured to perform the first process when the gesture is recognized as the first movement. The control module is further configured to perform the second process when the gesture is recognized as the second movement.