Off-Screen Gesture Detection for One-Handed, Eyes-Free Mobile Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing computing devices face challenges in enabling efficient one-handed and eyes-free mobile interaction due to the limitations of relying solely on on-screen touch events.
Innovation Solution
The use of off-screen gesture detection techniques, employing inertial measurement units and other sensors, to initiate interaction modes and perform functions on a mobile computing device, such as tapping on the device housing to interact with on-screen elements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If off-screen gesture detection is implemented using sensors, then ease of operation is improved for one-handed and eyes-free interaction, but device complexity increases due to additional sensor integration and gesture processing logic
Solution Approach 1:
The patent applies universality by enabling the inertial measurement unit and other sensors to serve multiple functions: detecting off-screen gestures, determining device orientation, and triggering various interaction modes. This allows a single sensor system to handle diverse interaction scenarios (one-handed mode, eyes-free mode, background interaction) without requiring separate dedicated sensors for each function, thereby improving ease of operation while limiting the increase in device complexity.
2Measurement precision
If multiple sensor signals are processed to identify gestures, then measurement precision is improved for gesture detection, but use of energy increases due to continuous sensor operation and signal processing
Solution Approach 1:
The patent implements partial action by selectively processing sensor signals based on the current interaction mode and user needs. The system processes multiple sensor signals (accelerometer, gyroscope, magnetometer) with varying degrees of intensity depending on the gesture type and context, rather than continuously maximizing processing for all signals at all times. This approach maintains high measurement precision for gesture detection while reducing unnecessary energy consumption during periods of low activity or in modes where full precision is not required.
3Ease of operation
If off-screen gestures are used to initiate interaction modes, then ease of operation is improved, but difficulty of detecting and measuring increases due to ambiguous gesture signals from multiple sensors
Solution Approach 1:
The patent applies feedback by continuously monitoring sensor signals and providing real-time analysis to distinguish between intentional off-screen gestures and incidental device handling movements. The system uses feedback loops to adjust gesture detection thresholds and parameters based on detected patterns, allowing it to learn and adapt to user behavior. This feedback mechanism resolves the ambiguity in gesture signals by comparing detected movements against known gesture patterns and adjusting detection sensitivity accordingly, making off-screen gesture initiation easier while maintaining accurate detection.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables users to interact with mobile devices in a more intuitive and efficient manner, allowing for one-handed and eyes-free operation by clearly differentiating between foreground and background interactions.
Implementation Method 1
an inertial measurement unit that includes one or more of an accelerometer, a gyroscope, and/or a magnetometer
Implementation Method 2
an inertial measurement unit that includes one or more of an accelerometer, a gyroscope, and/or a magnetometer
Implementation Method 3
an inertial measurement unit that includes one or more of an accelerometer, a gyroscope, and/or a magnetometer
Data Source
AI summary
An example method includes identifying, by a mobile computing device that includes a housing and a presence-sensitive display, and based on a first group of sensor signals provided at least by an inertial measurement unit included in one or more sensors, at least one first gesture that is performed at portions of the housing, wherein the one or more portions are separate from the display, initiating an interaction mode, outputting at least one visual or audio indicator for the interaction mode that is associated with a particular function of the mobile computing device, identifying, based on a third group of sensor signals provided by the one or more sensors, at least one second gesture that is performed at the one or more portions of the housing to confirm a user selection of the particular function, and, responsive to identifying the at least one second gesture, performing the particular function.