Contactless Gesture Recognition via Device Motion Compensation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing portable electronic devices with touch-sensitive displays face challenges in accurately determining gestures, especially when device movement is mistaken for object movement, leading to erroneous gesture recognition, particularly in three-dimensional gestures.
Innovation Solution
Incorporating an object sensor and a motion sensor, with a processor that communicates between the two to detect and compensate for device movement during contactless object movement, allowing for accurate determination of gestures, including three-dimensional gestures, by subtracting device movement from object movement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If device movement is detected using motion sensor, then gesture recognition accuracy is improved, but device complexity increases due to additional sensors and processing
Solution Approach 1:
The patent combines the object sensor and motion sensor into an integrated gesture detection system. The processor receives data from both sensors and processes them together to determine gestures, merging the functionality of multiple sensors into a unified system that improves accuracy while managing complexity through integration.
Solution Approach 2:
The motion sensor serves multiple functions: it detects device movement for gesture compensation, tracks device orientation changes, and provides data for both contactless and contact-based gesture recognition. This multi-functionality justifies the added complexity by providing broad utility across different gesture types.
2Adaptability or versatility
If contactless gesture detection is implemented, then user interface functionality is expanded, but measurement precision deteriorates due to difficulty in distinguishing object movement from device movement
Solution Approach 1:
The processor acts as an intermediary that receives raw data from both the object sensor and motion sensor, then processes and combines this information to distinguish object movement from device movement. By using the motion sensor data as a reference frame, the system can filter out device movement and accurately detect contactless gestures.
Solution Approach 2:
The system compensates for device movement by subtracting the motion sensor data from the object sensor data, effectively counterbalancing the unwanted device movement signal. This allows accurate detection of contactless gestures even when the device is moving or being held at different orientations.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution enhances the accuracy of gesture recognition, enabling more precise user interactions and expanding the range of gestures that can control the device, improving user interface functionality.
Implementation Method 1
the ultrasonic sensor is for detecting motion of the object by sensing Doppler shift during the period of contactless object movement
Data Source
AI summary
An electronic device includes an object sensor for detecting motion of an object, such as a stylus or finger, relative to device and during a period of contactless object movement. A motion sensor, such as an accelerometer, detects device motion during the period of contactless object movement. A processor determines a gesture that corresponds to the movement of the object and to movement of the device. This device, and the associated method, results in a more accurate determination of an intended gesture, such as a three-dimensional gesture. For example, the processor, or gesture determinator, can compensate for movement of the device when determining the gesture corresponding to detected contactless movement of the object.