Embedded Sensor Array for Hand Pose Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current hand tracking devices for virtual and remote environments face challenges in accurately measuring hand and finger movements, particularly in distinguishing between fingers and determining grasp states, often requiring numerous sensors and complex configurations.

Innovation Solution

A device with a uniformly or non-uniformly distributed array of sensors, including optical and capacitive sensors, embedded in the surface or within the device, which measures hand and finger positions using emitter-detector pairs and capacitive sensing, allowing for precise detection of finger presence, proximity, and grasp states, with optional ergonomic features to guide hand placement and reduce sensor complexity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a uniformly distributed array of sensors is used to measure hand and finger positions, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvehand and finger position measurement precisionVSAvoidsensor array complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The sensor array is divided into multiple sensor groups, where each group is associated with a specific finger. This segmentation allows the system to process and interpret sensor data more efficiently by finger, reducing the computational complexity while maintaining the ability to precisely track each finger's position and grasp state.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent pre-establishes the mapping between sensor array positions and finger locations during device design. This preliminary configuration allows the system to directly interpret sensor readings without requiring complex real-time calculations to determine which finger is contacting which sensor, thereby reducing processing complexity while preserving measurement precision.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If numerous sensors are used to distinguish between fingers and determine grasp states, then measurement precision is improved, but the number of sensors increases

Engineering Contradiction:
Improvefinger distinction and grasp state detection precisionVSAvoidnumber of sensors
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The sensor array is organized into distinct sensor groups, with each group dedicated to detecting a specific finger's presence and position. This segmentation enables the system to use fewer total sensors by focusing detection capabilities on individual fingers rather than requiring comprehensive coverage of the entire hand.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the sensor array have specialized detection characteristics optimized for specific fingers. Each sensor group is positioned and configured to detect the unique grasp patterns of its associated finger, allowing precise finger distinction with a reduced sensor count by placing sensors strategically where they provide maximum discriminatory information.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If optical emitter-detector pairs are used to sense finger proximity, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvefinger proximity sensing precisionVSAvoidoptical sensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines the optical emitter and detector into integrated emitter-detector pairs that are embedded within the device housing. This merging of components reduces the overall system complexity by eliminating separate mounting structures and simplifying the optical path, while the paired configuration maintains precise proximity sensing capability through coordinated emission and detection.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enables accurate and reliable hand and finger tracking, reducing the number of sensors needed while providing tactile feedback and force estimation, enhancing user interaction in virtual reality, gaming, and robotic applications.

Implementation Method 1

This measurement may be based on measuring the light reflected off of the user's fingers and/or hand (or gloved/covered fingers and/or hand) to the device's embedded light detectors

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

a uniformly distributed array of capacitive, electrostatic, and/or capaciflective sensors for measuring the presence and/or proximity of a person's hand and/or fingers near a device based on measuring the change of capacitance due to the proximity of a user's fingers and/or hand

Methodology Applied
Scientific EffectCapacitance: Capacitance

Data Source

PatentEP3265895B1Embedded grasp sensing devices, systems, and methods
Publication Date: 2020.04.08 TACTICAL HAPTICS INC
  • EP3265895B1 patent drawingFigure 1
  • EP3265895B1 patent drawingFigure 2a~2b
  • EP3265895B1 patent drawingFigure 3a~3b

AI summary

Implementations of the present invention relate to apparatuses, systems, and methods for measuring the grasp state, position, or hand pose of a user's hand relative to a device, which could be used as an input for human-machine input, augmented reality, virtual reality, video games, or tele-manipulation. The device may include a plurality of grasp sensors embedded within the device. A kinematic hand model can be used in combination with grasp sensing data to estimate a user's hand pose.