Tailored Illumination Profile for Hand Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing near-eye display devices, such as HMDs, face inefficiencies in power consumption due to unnecessary illumination of regions outside the interaction volume, leading to wasted power and reduced battery life in portable devices.

Innovation Solution

The illumination profile of the HMD device is optimized to match the predicted interaction volume and compensate for optical losses, using a tailored design that adjusts illumination intensity based on user hand locations and the device's hardware components, ensuring efficient illumination only where user interactions occur.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the illumination module provides illumination to the entire field of view, then the depth camera system can capture the full environment, but power consumption increases due to unnecessary illumination of regions outside the interaction volume

Engineering Contradiction:
Improvedepth camera system performanceVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The illumination module is configured to provide illumination with a tailored illumination profile that matches the predicted interaction volume, concentrating light intensity in regions where user hands are expected to be located during interaction, rather than uniformly illuminating the entire field of view. This localizes illumination quality to where it is most needed for hand tracking.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The illumination module provides illumination only to the predicted interaction volume rather than the complete field of view, using partial action to illuminate only the necessary region for hand tracking while avoiding excessive illumination of unused areas, thereby reducing overall power consumption.

Inventive Principle:
Principle #16Partial or excessive action

2Measurement precision

If the illumination intensity is increased to compensate for optical losses, then signal quality improves, but power consumption increases

Engineering Contradiction:
Improvesignal qualityVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The illumination module dynamically adjusts illumination intensity parameters based on the predicted interaction volume and detected hand locations. The processor determines adjustments to illumination intensity that compensate for optical losses in specific regions while avoiding unnecessary power consumption, optimizing the balance between signal quality and energy usage.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system uses feedback from depth camera measurements and hand location detection to dynamically adjust illumination intensity. The processor continuously monitors hand positions and modifies illumination parameters accordingly, ensuring optimal signal quality where needed while reducing power consumption in regions where hands are not present.

Inventive Principle:
Principle #23Feedback

3Use of energy by moving object

If the illumination profile is tailored to match the interaction volume, then power consumption is reduced, but the illumination coverage area is limited

Engineering Contradiction:
Improvepower consumptionVSAvoidillumination coverage area
Core Design Contradiction:
Use of energy by moving objectVSArea of stationary object

Solution Approach 1:

The illumination profile is dynamically adjusted based on predicted interaction volume and detected hand locations. Rather than using a fixed illumination pattern, the system adapts the illumination coverage and intensity in real-time to match where hands are actually located, optimizing the balance between power consumption and effective coverage area.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach reduces power consumption by focusing illumination where it is needed, enhancing the depth camera system's performance and maintaining consistent signal quality, thereby improving hand tracking accuracy and extending battery life.

Implementation Method 1

a light source emits light onto nearby objects

Methodology Applied
Scientific EffectLight emission: Light

Implementation Method 2

a ToF camera captures the light after it reflects off surfaces of the objects

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 3

The time taken for the light to travel from the light source and to reflect back from an object to the ToF camera is converted, based on the known speed of light, into a depth measurement

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS10430647B2Tailored illumination profile for articulated hand tracking
Publication Date: 2019.10.01 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10430647B2 patent drawing
  • US10430647B2 patent drawing
  • US10430647B2 patent drawing

AI summary

Disclosed are a device and a method of hand tracking based on a tailored illumination profile. In some embodiments, the hand tracking device includes an illumination module, an imaging sensor and a processor. The illumination module provides an illumination profile that matches a predicted interaction volume within which a user of the near-eye display device is expected to place a body part of the user to interact with a user interface of the near-eye display device. The imaging sensor receives light reflected by an environment of the near-eye display device including the body part of the user and generates depth values corresponding to depths of the environment relative to the near-eye display device. The processor tracks a location of the body part of the user based on the depth values and determines an adjustment of an illumination intensity of the illumination module based on the location of the body part of the user.