Spatial Hand Gesture Control for Multi-Device Wearable Interfaces
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional wearable devices have small displays that require precise inputs for interaction, leading to difficulties in accurately performing operations and potential frustration due to accidental activations or prolonged search times for desired actions.
Innovation Solution
The system interprets in-air hand gestures detected by sensors on a wearable device, considering the device's operational context and spatial orientation to perform appropriate and intuitive operations, allowing for efficient control of user interfaces across multiple devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Volume of moving object
If small displays are used in wearable devices to reduce device size, then device portability is improved, but input precision and interaction accuracy deteriorate
Solution Approach 1:
The patent transitions from 2D touchscreen interaction to 3D spatial gesture recognition. By detecting hand gestures in three-dimensional space using sensors (accelerometers, gyroscopes, magnetometers), the system enables precise input control without requiring a larger display. The spatial orientation and movement of the hand provide additional dimensional information for accurate input interpretation.
Solution Approach 2:
The patent replaces the mechanical touchscreen interface with a sensor-based gesture recognition system. Instead of requiring physical contact with the small display, the system uses inertial sensors and magnetic field sensors to detect hand movements and interpret them as input commands, eliminating the limitation of small display size.
2Measurement precision
If precise touch inputs are required on small displays, then interaction accuracy is improved, but ease of operation deteriorates due to accidental activations and prolonged search times
Solution Approach 1:
The patent introduces an intermediary gesture recognition layer between the user and the device interface. Hand gestures serve as a mediator that translates user intent into device commands, providing a more natural and intuitive interaction method that reduces accidental inputs and speeds up operation compared to direct touchscreen manipulation.
Solution Approach 2:
The system dynamically adapts gesture interpretation based on device context and spatial orientation. The same physical gesture can trigger different operations depending on the device's current state and orientation in space, enabling intuitive control without requiring users to learn multiple gesture variants for different scenarios.
3Adaptability or versatility
If multiple wearable devices are used simultaneously, then functionality and versatility are improved, but difficulty in detecting and measuring user intent deteriorates
Solution Approach 1:
The patent implements a universal gesture recognition system that works across multiple wearable devices (wrist-worn, head-worn, etc.). The same set of hand gestures can control different devices based on which device is detected as the primary target, providing a unified interaction model that simplifies multi-device management while maintaining versatility.
Solution Approach 2:
The system uses feedback from device detection and spatial orientation to disambiguate user intent. When multiple devices are present, the system analyzes the spatial relationship between the user's hand and each device, along with device context information, to determine which device should respond to the gesture, thereby accurately detecting user intent in multi-device scenarios.
Data Source
AI summary
Methods of interpreting navigating user interfaces on multiple devices based on spatial orientations of a user's hand are provided. The method includes receiving, from one or more sensors of a wrist-wearable device, data associated with performance of an in-air hand gesture by a hand of a wearer of the wrist-wearable device. The method further includes in accordance with a determination that the data indicates that the hand of the wearer is in a first orientation when the in-air hand gesture was performed, causing performance of a first operation at the wrist-wearable device. The method further includes in accordance with a determination that the data indicates that the hand of the wearer is in a second orientation when the in-air hand gesture was performed, causing performance of a second operation at a head-wearable device.