Finger Movement Tracking via Palm Sensor and Skeleton Model
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing computer input devices for virtual and augmented reality applications often require multiple sensor devices attached to phalange bones and the metacarpal bone, which can be cumbersome and limit independent movement, necessitating a solution for accurate finger movement tracking without these attachments.
Innovation Solution
A hand-worn data input device with inertial sensors on finger modules and a palm module that estimates and predicts the orientation of phalange bones and metacarpal bones without separate sensors, using a skeleton model to compute positions and orientations, allowing for intuitive gesture recognition and control in VR/AR environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple sensor devices are attached to phalange bones and metacarpal bone, then measurement precision of finger movements is improved, but device complexity and ease of operation deteriorate
Solution Approach 1:
The patent extracts the sensing function from multiple distributed sensors and consolidates it into a single inertial sensor mounted on the palm. This eliminates the need to attach sensors to individual phalange bones and metacarpal bones, thereby reducing device complexity while maintaining measurement precision through mathematical modeling of the skeleton structure.
Solution Approach 2:
The patent creates a virtual skeleton model that copies the structural relationships of the actual hand bones. By tracking the position of the palm and using the predetermined skeleton model to calculate the positions of untracked bones, the system achieves accurate finger movement measurement without physically attaching sensors to each bone.
2Measurement precision
If multiple sensor devices are attached to phalange bones and metacarpal bone, then measurement precision of finger movements is improved, but ease of operation worsens
Solution Approach 1:
The patent removes the burden of multiple sensor attachments from the user by extracting the sensing function to a single palm-mounted device. This significantly improves ease of operation as users no longer need to have sensors attached to individual fingers and bones, making the system more comfortable and user-friendly while maintaining measurement precision through computational methods.
3Measurement precision
If separate sensors are attached to each bone, then measurement precision is improved, but manufacturing precision requirements worsen
Solution Approach 1:
The patent consolidates the sensing function into a single inertial sensor, eliminating the need for multiple precision-manufactured sensor attachments. This reduces the cumulative manufacturing precision requirements while maintaining measurement accuracy through the skeleton model-based calculation approach.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate and intuitive finger movement tracking and control in VR/AR applications with reduced hardware requirements, improving user experience and input accuracy by estimating orientations of unattached bones based on sensor data from attached modules.
Implementation Method 1
Each of the finger modules (104a-c) has an inertial sensor (102a-c) that measures the orientation of a finger bone on which the corresponding finger module (104a-c) is worn. The palm module (108) has an inertial sensor (102n) that measures the orientation of the palm of the hand.
Implementation Method 2
A hand-worn data input device with inertial sensors on finger modules and a palm module that estimates and predicts the orientation of phalange bones and metacarpal bones without separate sensors, using a skeleton model to compute positions and orientations
Data Source
AI summary
A system including: a first sensor module having an inertial measurement unit and attached to a palm of a hand of a user; a second sensor module having an inertial measurement unit and attached to a first bone of a finger (e.g., a middle or proximal phalange bone) on the palm; and a computing device coupled to the first sensor module and the second sensor module to calculate, based on the orientation of the palm and the orientation of the first bone, orientations of the second bones of the finger (e.g., a distal or proximal phalange bone, a metacarpal bone of the thumb) that have no separately attached inertial measurement unit, according to a predetermined ratio of rotation from a reference orientation along a same axis of rotation.