Smartwatch Micro-Gesture UI Control Without Screen Touch
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional swipe gestures for smartwatches require physical contact with the screen, which can be inconvenient or impossible when the user's other hand is not free, necessitating more robust and scalable UI control solutions.
Innovation Solution
Implementing finger swipe-based UI control using biosensors on a wrist-wearable device to detect micro-gestures without physical contact, utilizing PPG, EMG, and IMU sensors to recognize finger-swipe and finger-drag commands for controlling the UI.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional touch-based swipe gestures are used for smartwatch UI control, then the device can detect finger movements accurately, but the user cannot operate the device when their other hand is not free
Solution Approach 1:
The patent replaces the mechanical touch-based interaction system with a biosensor-based detection system. Instead of requiring physical contact with the touchscreen, the system uses PPG, EMG, and IMU sensors to detect physiological signals and motion patterns associated with finger gestures, enabling hands-free operation while maintaining gesture recognition capability
Solution Approach 2:
The patent introduces biosensors as an intermediary between the user's finger gestures and the UI control system. The biosensors detect physiological changes and motion patterns in the air (without direct contact) and translate them into UI commands, serving as a mediator that enables gesture recognition without physical touch
2Reliability
If touch-based swipe gestures are implemented on smartwatches, then the screen can respond to user input, but the user experiences inconvenience when their other hand is occupied
Solution Approach 1:
The system substitutes the mechanical touch interface with a biosensor-based detection mechanism that monitors physiological signals (PPG, EMG) and motion (IMU) to recognize gestures in the air, eliminating the need for physical contact while maintaining reliable gesture detection
Solution Approach 2:
The wrist-wearable device monitors its own physiological signals and motion patterns to detect gestures, allowing the device to serve itself by using the user's natural physiological responses as input signals without requiring external touch interaction
3Adaptability or versatility
If the wrist-wearable device uses biosensors to detect micro-gestures without physical contact, then single-handed control is enabled, but the device complexity increases
Solution Approach 1:
The patent employs multi-functional biosensors that serve multiple purposes: PPG sensors detect both physiological signals and motion patterns, EMG sensors capture muscle activity and gesture intent, and IMU sensors monitor wrist movement and orientation. This multi-functionality allows the same sensor system to support various gesture types and UI operations without requiring separate dedicated components for each function
Solution Approach 2:
The patent combines multiple sensor types (PPG, EMG, IMU) into an integrated biosensor system that works together to detect gestures. By merging these sensors and processing their combined data, the system achieves accurate gesture recognition without physical contact while managing complexity through integrated sensor fusion rather than separate independent systems
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables single-handed control of smartwatch UIs through natural and discreet micro-gestures, enhancing user interaction by allowing gesture recognition with higher reliability and convenience compared to touch-based methods.
Implementation Method 1
the at least one first sensor being configured to detect micro-gestures of the finger of the user without any fingers of the user touching the wrist-wearable device
Implementation Method 2
utilizing PPG, EMG, and IMU sensors to recognize finger-swipe and finger-drag commands
Implementation Method 3
utilizing PPG, EMG, and IMU sensors to recognize finger-swipe and finger-drag commands for controlling the UI
Data Source
AI summary
Novel tools and techniques are provided for implementing novel finger swipe-based smart watch user interface (“UI”) control or novel micro finger gesture-based UI control for wrist-wearable device. In various embodiments, a computing system may analyze biosensor data to identify micro-gestures of a user's finger, the biosensor data being received from biosensor(s) disposed on a wrist-wearable device when it is being worn by the user. In response to identifying a first micro-gesture of the user's finger in the biosensor data, the computing system may determine whether the first micro-gesture corresponds to one of a finger-swipe command or a finger-drag command for controlling a UI of the wrist-wearable device. If so, the computing system may cause the UI of the wrist-wearable device to perform one or more first functions in response to the one of the finger-swipe command or the finger-drag command.