Gesture Control via Device Motion Under Stationary Finger
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mobile electronic devices with limited screen space face challenges in providing diverse functionality due to physical limitations of sensors like accelerometers and gyroscopes, necessitating innovative gesture control methods that do not interfere with conventional inputs.
Innovation Solution
Introducing novel gestures that involve moving or rotating the device under a stationary finger, allowing for additional functions to be accessed without altering conventional touchscreen interactions, utilizing a combination of accelerometers, gyroscopes, and magnetometers for combined motion analysis to distinguish between conventional and novel gestures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional touchscreen gestures are used, then the interface is simple and familiar, but the number of accessible functions is limited due to small screen space
Solution Approach 1:
The patent combines data from multiple sensors (accelerometer, gyroscope, magnetometer) with touchscreen input data to create a unified gesture recognition system. This merging allows the system to distinguish between conventional touchscreen gestures and novel device movement gestures, enabling multiple functions to be accessed from single touchscreen locations through different gesture types without requiring additional physical buttons or controls.
Solution Approach 2:
The patent implements a universal gesture recognition framework that handles both traditional touchscreen gestures (taps, swipes) and novel motion-based gestures (shakes, rotations) through a single integrated system. This multi-functional approach allows the same touchscreen interface to serve multiple purposes: conventional navigation, novel gesture control, and sensor-based motion recognition, thereby increasing the number of accessible functions without adding physical components.
2Measurement precision
If multiple sensors are combined for gesture detection, then gesture recognition accuracy improves, but sensor limitations and interference with conventional inputs occur
Solution Approach 1:
The patent segments gesture recognition into distinct categories: conventional touchscreen gestures (handled by touchscreen controller) and novel motion gestures (handled by sensor fusion). The system analyzes sensor data to determine whether a detected pattern corresponds to intentional device movement (shake, rotation) or natural hand movement during touchscreen interaction. This segmentation prevents false positives where conventional touchscreen usage is misinterpreted as novel gestures, maintaining ease of operation while improving measurement precision for novel gesture detection.
Solution Approach 2:
The patent introduces an intermediary processing layer that receives data from both the touchscreen controller and sensor array. This intermediary analyzes the temporal and spatial relationships between touchscreen events and sensor readings to distinguish between genuine novel gestures and artifacts of conventional interaction. By acting as a mediator, this layer reconciles the potentially conflicting data streams, ensuring that conventional touchscreen inputs remain reliable while enabling accurate detection of novel gestures that combine device movement with touchscreen contact.
Data Source
AI summary
A method for gesture-based control of a portable, electronic device with a touch-sensitive surface. Novel gestures are introduced that may be compatible with conventional touchscreen gestures. Contrary to custom, the user may hold a finger or any other input object in a steady manner and may move, shift, and/or rotate the electronic device below the unmoved finger or input object. In one embodiment, the user moves a smartphone or a smartwatch toward or away from the unmoved finger to establish or terminate contact with the touchscreen. In another embodiment, the user drags or rotates the smartphone below the unmoved finger such that the unmoved finger slides on the touchscreen. An acceleration sensor and/or a gyroscope may be used for capturing the movements of the electronic device.