Multi-Finger Motion Capture Interface Using Fingertip Sensors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current motion capture technologies for virtual and augmented reality face challenges in accurately tracking finger motions due to issues with optical marker overlap, imprecise measurements with gloves and exoskeletons, and limited visual fields, which hinder realistic interaction with virtual objects.
Innovation Solution
A method and apparatus for motion capture using multiple fingers, involving the measurement of finger positions and lengths, derivation of reference positions, and calculation of length ratios to control a virtual hand model, allowing precise tracking and interaction in virtual reality or augmented reality environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If optical markers are used for finger tracking, then the system can capture hand motion, but the optical markers overlap and hide from each other causing measurement errors
Solution Approach 1:
The patent extracts the measurement function from optical markers and relocates it to the fingertips themselves. By placing sensors directly on the finger tips rather than using separate optical markers, the system eliminates the overlap problem while maintaining tracking capability. The fingertip sensors directly measure position without requiring line-of-sight visibility.
Solution Approach 2:
The patent introduces an intermediary calculation process that uses the measured fingertip positions to derive finger joint positions and hand pose. Instead of directly tracking multiple markers that may overlap, the system measures fingertip positions and mathematically infers the positions of intermediate joints, avoiding the marker overlap issue while achieving comprehensive hand tracking.
2Measurement precision
If gloves and exoskeletons with bending sensors are used, then finger motion can be measured, but the measurement precision is insufficient
Solution Approach 1:
The patent replaces the mechanical bending sensor system (gloves and exoskeletons) with an optical measurement system using sensors at the fingertips. This substitution eliminates the mechanical complexity and measurement errors associated with bending sensors while achieving more reliable and precise finger motion tracking through direct position measurement.
3Ease of operation
If image sensors or infrared sensors are used for hand tracking, then motion can be detected, but the visual field is limited and measurement accuracy decreases due to overlapping
Solution Approach 1:
The patent segments the hand tracking problem by placing independent sensors at each fingertip rather than using a single comprehensive image or infrared sensor. This segmentation allows each sensor to independently measure its local position without interference from other fingers, eliminating the overlap problem while maintaining full hand tracking capability.
Data Source
AI summary
A method and apparatus for motion capture interface using multiple fingers are disclosed. The method includes measuring a position of an end of a middle finger of an actual hand in a state in which the actual hand is spread, deriving a starting reference position of the middle finger of the actual hand, and calculating a length of the middle finger of the actual hand. The method further includes recognizing a relationship between starting reference positions of a thumb, an index finger, a middle finger, and a wrist based on using a virtual hand reference model that models a virtual hand to be controlled.