Depth Camera Gesture Recognition for Natural Interface Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies cannot accurately interpret human movements within images without the use of special reflective tags or markers, limiting the ability of computers to assess and respond to human gestures in a natural manner.

Innovation Solution

A depth camera system that models human movements using virtual skeletons, allowing physical gestures to be interpreted as input commands for interactive interfaces, such as spell-casting games, without the need for conventional controllers or markers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If reflective tags or markers are used to track human movements, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvemovement tracking accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent removes the reflective tags and markers from the system, extracting the essential function of movement tracking without the complex marker-based infrastructure. The depth camera directly captures human movements in natural environments without requiring additional tracking components on the user's body.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The depth camera serves as an intermediary device that captures spatial information about human movements without requiring direct contact or attached markers. The camera records depth data that can be processed to determine movement trajectories and gestures in three-dimensional space.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If conventional controllers are used for game input, then ease of operation is maintained, but adaptability decreases

Engineering Contradiction:
Improveinput control simplicityVSAvoidinteraction flexibility
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The depth camera system provides universal input methods that can interpret various types of gestures and movements (pointing, throwing, waving, body posture) as control commands. This single device can handle multiple input modalities, replacing the need for specialized controllers for different game actions.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system dynamically adapts to different user gestures and movements, interpreting them contextually as various input commands. The gesture recognition algorithm analyzes the motion patterns, speed, direction, and position to determine the intended action, allowing flexible and adaptive control without predefined button mappings.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables users to control game actions and applications through natural gestures, providing a more intuitive and immersive interaction experience by accurately recognizing and translating physical movements into in-game actions or system commands.

Implementation Method 1

Gestures of a computer user are observed with a depth camera

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS8740702B2Action trigger gesturing
Publication Date: 2014.06.03 MICROSOFT TECHNOLOGY LICENSING LLC
  • US8740702B2 patent drawing
  • US8740702B2 patent drawing
  • US8740702B2 patent drawing

AI summary

Gestures of a computer user are observed with a depth camera. A throwing gesture of the computer user is identified and an aiming vector is calculated from a path of a left and/or right hand during the throwing gesture. An interface action is directed along the aiming vector within an interactive interface.