Wearable Contact Sensing for Precise VR Hand-to-Body Gestures
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual and augmented reality technologies face challenges in accurately determining the position and contact of extremities, particularly hands, due to limitations in camera-based systems, which struggle to capture intricate hand movements and contact with the skin.
Innovation Solution
Employing wearable devices that generate and detect ultrasonic or electromagnetic signals to determine contact gestures by transmitting and receiving signals through the user's body, allowing precise detection of contact and hover gestures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If camera-based systems are used to determine position of extremities, then the system structure is simple, but the measurement precision of hand position and contact is insufficient
Solution Approach 1:
The patent replaces camera-based optical detection with electromagnetic signal-based detection. Transducers generate electromagnetic signals that penetrate the user's body, and receivers detect these signals to determine contact gestures. This substitution enables precise measurement of hand position and contact status by detecting signal changes caused by body composition differences, resolving the limitation of camera systems in capturing intricate hand movements and contact points.
Solution Approach 2:
The patent utilizes changes in electromagnetic signal parameters (such as amplitude, phase, or frequency) that occur when signals pass through different body tissues. By monitoring these parameter variations, the system can detect contact gestures with high precision. The receiver device analyzes signal characteristics to determine whether a contact gesture has been made, leveraging the fact that electromagnetic signals interact differently with various body compositions during contact events.
2Reliability
If cameras are used to capture extremity position, then the device is easy to operate, but the reliability of contact detection is insufficient
Solution Approach 1:
The patent replaces camera-based detection with electromagnetic signal detection to improve reliability. The transducer array generates electromagnetic signals that penetrate the user's body, and the receiver device detects these signals to reliably determine contact gestures. This method provides more consistent and trustworthy detection results compared to camera systems, which struggle with capturing subtle contact events and hand intricacies.
Solution Approach 2:
The system implements feedback by continuously monitoring electromagnetic signal characteristics and using this information to determine contact status. The receiver device receives signals from transducers, analyzes the signal parameters, and provides feedback about detected contact gestures. This feedback mechanism enhances detection reliability by continuously adjusting based on real-time signal variations caused by body contact.
3Measurement precision
If camera-based systems are used, then the device complexity is low, but the measurement precision of gesture location is insufficient
Solution Approach 1:
The patent divides the detection system into multiple transducers arranged in arrays, with each transducer capable of generating and detecting electromagnetic signals independently. This segmentation allows the system to capture spatial variations in signal characteristics across different body locations, enabling precise determination of gesture locations. The receiver device processes signals from multiple transducers to triangulate and pinpoint the exact location of contact gestures on the user's body.
Solution Approach 2:
The patent exploits changes in electromagnetic signal parameters that occur during contact events to precisely locate gestures. By monitoring variations in signal amplitude, phase, or frequency as electromagnetic waves interact with different body tissues during contact, the system can accurately determine gesture location. The receiver device analyzes these parameter changes to identify the specific location where contact occurred on the user's body.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate and reliable detection of contact and gesture interactions on the user's body, enhancing the interaction capabilities of virtual and augmented reality systems.
Implementation Method 1
generate multiple signals (e.g. ultrasonic waves, electromagnetic waves, high frequency signals, etc.) that traverse on or through the user
Implementation Method 2
generate multiple signals (e.g. ultrasonic waves, electromagnetic waves, high frequency signals, etc.) that traverse on or through the user
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method of determining contact on a user of a virtual reality and/or augmented reality device includes a first device including a plurality of transducers and a control circuit coupled to the plurality of transducers. The method includes activating one or more of the first plurality of transducers and generating waves that couple into at least a portion of a first appendage of a user wearing the first wearable device. The method further includes at a second wearable device having a second plurality of transducers, receiving at least a portion of the waves generated by the first plurality of transducers when the first appendage of the user is within a threshold distance from the second wearable device. The user is wearing the second wearable device on a second appendage different from the first appendage and in response to receiving the portion of the waves, providing a signal corresponding to the received portion of the waves to a computing device that uses the signal to determine a position of the first appendage with respect to a position of the second wearable device.