Hand Gesture Tracking With Haptic-Triggered Inertial Gating
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In existing hand gesture tracking technologies, the accuracy of inertial sensing data is compromised when haptic feedback and inertial sensing units operate simultaneously, leading to reduced accuracy in gesture tracking.
Innovation Solution
A hand gesture tracking device and method that dynamically adjusts the use of inertial sensing data based on the detection of haptic feedback interactions, using a processor to trigger and deactivate inertial sensing data during specific time intervals.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the haptic feedback device and inertial sensing unit operate simultaneously, then the user interaction experience is improved, but the accuracy of gesture tracking is reduced
Solution Approach 1:
The system dynamically adjusts the operational state of the inertial sensing unit based on real-time detection of haptic feedback events. When haptic feedback is detected, the system automatically inactivates the inertial sensing unit to prevent data contamination, and activates it again when haptic feedback ceases. This dynamic adaptation resolves the contradiction by making the sensing system responsive to the operational context.
Solution Approach 2:
The system performs preliminary detection of haptic feedback events before processing inertial sensing data. By detecting the haptic feedback event first and then proactively inactivating the inertial sensing unit in anticipation of data contamination, the system prevents accuracy degradation before it occurs, rather than attempting to correct it afterward.
2Duration of action of stationary object
If the inertial sensing data is continuously used for hand gesture tracking, then the tracking continuity is improved, but the data accuracy is reduced during haptic feedback
Solution Approach 1:
The system implements periodic monitoring of haptic feedback events and correspondingly periodic activation/inactivation of the inertial sensing unit. This rhythmic on-off operation synchronized with haptic feedback events allows the system to maintain tracking continuity over time while periodically excluding inaccurate data segments, thus resolving the contradiction between continuous tracking and data accuracy.
Solution Approach 2:
The system extracts and removes the contaminated inertial sensing data segments that occur during haptic feedback events from the continuous data stream. By taking out only the problematic portions while maintaining the overall continuity of tracking through alternative methods or resumption after the event, the system preserves tracking continuity while eliminating accuracy-degrading data.
Data Source
AI summary
A hand gesture tracking device, method, and non-transitory computer readable storage medium thereof are provided. The device performs hand gesture tracking corresponding to a user based on multiple real-time images and an inertial sensing data. The device determines whether a virtual object associated with a haptic feedback interaction is contacted based on the hand gesture tracking. In response to determining that the virtual object associated with the haptic feedback interaction is contacted, the device triggers a haptic feedback device of a wearable device to perform the haptic feedback interaction corresponding to a time interval. The device inactivates the inertial sensing data corresponding to the wearable device to perform the hand gesture tracking corresponding to the time interval.