Optical Skin Tracking for Reliable Wearable Gesture Inference
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users of virtual reality or augmented reality systems often lack traditional input devices, and existing gesture-based solutions like surface electromyography are hindered by skin contact requirements and electromagnetic interference, making them unsuitable for all-day wearables.
Innovation Solution
A tracking device using surface optical myography that integrates an illumination source and optical sensor into a wearable garment, inferring user poses or gestures by analyzing skin patterns and displacements through machine-learned models.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If surface electromyography is used to infer hand gestures, then gesture recognition capability is improved, but skin contact quality and electromagnetic interference sensitivity worsen the reliability
Solution Approach 1:
The patent replaces surface electromyography (electrical/mechanical measurement) with optical imaging to detect skin surface changes. The optical sensor captures images of skin patterns and displacements, substituting electrical signal detection with optical field detection, thereby eliminating electromagnetic interference sensitivity while maintaining gesture recognition capability
Solution Approach 2:
The patent introduces skin surface optical patterns as an intermediary between muscle contraction and gesture detection. Instead of directly measuring electrical signals from muscles, the system detects optical changes on the skin surface that result from muscle movement, providing an indirect but more reliable measurement path that avoids electromagnetic interference
2Measurement precision
If traditional input devices are provided in VR/AR systems, then user input accuracy is improved, but device complexity and lack of wireless compatibility worsen
Solution Approach 1:
The patent makes the wearable device itself multi-functional by integrating both tracking functionality and gesture recognition capability. The same optical sensor and processor that track head or body movement also analyze skin surface patterns to detect gestures, eliminating the need for separate controllers and reducing overall system complexity
Solution Approach 2:
The patent merges the functions of traditional controllers with the wearable tracking device. By combining gesture recognition capabilities into the wearable device, the system consolidates multiple input methods into a single integrated unit, reducing device complexity while maintaining input accuracy
3Ease of operation
If all-day wearable device is implemented, then user comfort and portability are improved, but skin contact stability and electromagnetic interference resistance worsen
Solution Approach 1:
The patent substitutes electrical signal measurement with optical measurement, eliminating sensitivity to electromagnetic interference. The optical sensor detects skin surface optical patterns rather than electrical signals, providing stable measurements in the electromagnetic environment of modern devices while maintaining wearable comfort
Solution Approach 2:
The patent changes the measurement parameter from electrical conductivity (sEMG) to optical reflectance/absorption properties of skin. This parameter change makes the measurement inherently more stable against electromagnetic interference while allowing for comfortable all-day wear without signal degradation
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate and reliable gesture recognition without direct skin contact, overcoming interference issues and providing seamless interaction in immersive environments.
Implementation Method 1
The tracking device includes an illumination source that illuminates the portion of the user's skin
Implementation Method 2
An optical sensor of the tracking device may capture images of the illuminated portion of skin
Data Source
AI summary
A tracking device monitors a portion of a user's skin to infer a pose or gesture made by a body part of a user that engages the portion of the user's skin as the pose or gesture is made. For example, the tracking device monitors a portion of skin on a user's forearm to infer a pose or gesture made by the user's hand. The tracking device may include an illumination source that illuminates the portion of the user's skin. An optical sensor of the tracking device may capture images of the illuminated portion of skin. A controller of the tracking device infers a pose or gesture of the body part based in part on a model (e.g., a machine-learned model) and the captured images. The model may map various configurations of the user's skin to different poses or gestures of the body part.