Mobile Gesture Control Using Camera-Based User Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional touchless control systems are limited by the need for external controllers, which are bulky, unintuitive, and require training, and do not provide seamless interaction on mobile devices.
Innovation Solution
A mobile device system that uses integrated camera-based gesture recognition to track user characteristics, apply mathematical transformations, and smooth cursor movements for intuitive touchless control without external controllers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If external controllers (gloves, remote controllers, wristbands) are used for touchless control, then gesture recognition capability is improved, but device complexity and user burden increase due to additional hardware that needs to be carried, maintained, updated, synchronized, calibrated, and learned
Solution Approach 1:
The patent merges the gesture recognition functionality directly into the mobile device by integrating the camera, processor, and software algorithms into a single unit. This eliminates the need for separate external controllers while maintaining full gesture recognition capability. The mobile device's existing hardware resources (camera, processor, display) are combined to create a complete touchless control system.
Solution Approach 2:
The mobile device is designed to perform multiple functions: it serves as both the gesture recognition system and the controlled device. The camera captures images for gesture analysis, the processor performs mathematical algorithms to interpret gestures, and the display provides visual feedback. This multi-functional approach eliminates the need for dedicated gesture control hardware.
2Adaptability or versatility
If external controllers are used for touchless control, then gesture-based interaction is enabled, but ease of operation deteriorates because controllers are bulky, unintuitive, and require training time
Solution Approach 1:
The system uses the mobile device's existing resources (camera, processor, display) to provide gesture control functionality without requiring external accessories. The device serves itself by utilizing its built-in components for gesture capture, processing, and feedback, eliminating the need for users to learn and adapt to external controller interfaces.
Solution Approach 2:
The patent transforms the physical state of gesture control by using visual feedback displayed on the mobile device screen to represent gesture recognition status and control actions. This parameter change from physical controller feedback to visual display feedback makes the system more intuitive and easier to understand, as users can see real-time representation of their gestures and system responses.
3Adaptability or versatility
If conventional touchless control systems with external controllers are used, then gesture recognition is achieved, but productivity decreases due to time required for training and setup
Solution Approach 1:
The mobile device comes pre-configured with all necessary components for gesture control: the camera is already integrated and calibrated, the processing algorithms are pre-loaded in the operating system, and the display is ready to provide visual feedback. Users can begin using gesture control immediately without external setup, calibration, or training sessions, thus maintaining high productivity from the start.
Data Source
AI summary
Methods and systems for touchless control of a device include receiving at least one image; determining a first map, the first map including a function that generates a correspondence between data associated with the image to a feature space; determining a second map including a representation of a user in the image based on the first map; determining a third map comprising a field associated with the data in the image; determining a characteristic of the user based on one or more of the second map and the third map; and tracking the characteristic of the user to generate a historical data of the characteristic for performing the touchless control of the device.