Hand Segmentation Using Depth Range Data for Gesture Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current gesture analysis mechanisms are slow and cumbersome, particularly in mobile devices, due to the inclusion of forearm regions in hand segmentation, which complicates gesture detection and recognition.

Innovation Solution

A method and apparatus for hand segmentation in gesture analysis systems that utilize depth range data from 3D imaging to isolate the hand from the forearm, determining a target region, identifying a point of interest, and removing the forearm portion to enhance gesture classification and recognition performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If depth range data is used to segment hand regions, then gesture recognition accuracy is improved, but processing time increases

Engineering Contradiction:
Improvegesture recognition accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies segmentation by dividing the hand region into multiple depth ranges (e.g., first depth range for palm, second depth range for fingers) and processing each segment separately. This allows the system to maintain high accuracy through detailed depth-based segmentation while reducing overall processing time by handling smaller, more manageable regions independently rather than processing the entire hand as one large region.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If the entire target region including forearm is analyzed, then gesture detection coverage is improved, but gesture classification complexity increases

Engineering Contradiction:
Improvegesture detection coverageVSAvoidgesture classification complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent extracts and removes the forearm region from the target region, retaining only the hand portion for gesture analysis. By taking out the forearm (which has different geometric characteristics and movement patterns), the system maintains comprehensive gesture detection coverage for hand gestures while significantly reducing classification complexity, as hand gestures have more distinct and easier-to-recognize geometric features compared to arm movements.

Inventive Principle:
Principle #2Taking out (Extraction)

3Productivity

If hand segmentation is performed without depth data, then processing speed is improved, but segmentation accuracy deteriorates

Engineering Contradiction:
Improveprocessing speedVSAvoidsegmentation accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent leverages depth information as an additional dimension to enhance segmentation accuracy. By incorporating depth range data into the segmentation process, the system can distinguish between different parts of the hand (palm, fingers, knuckles) based on their spatial depth characteristics, achieving high accuracy without significantly sacrificing processing speed, as the depth data provides direct geometric cues that simplify the segmentation task.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentEP2374089B1Method, apparatus and computer program product for providing hand segmentation for gesture analysis
Publication Date: 2020.02.12 NOKIA TECHNOLOGIES OY
  • EP2374089B1 patent drawingFigure 1A~1F
  • EP2374089B1 patent drawingFigure 2
  • EP2374089B1 patent drawingFigure 3A~3E

AI summary

A method for providing hand segmentation for gesture analysis may include determining a target region based at least in part on depth range data corresponding to an intensity image. The intensity image may include data descriptive of a hand. The method may further include determining a point of interest of a hand portion of the target region, determining a shape corresponding to a palm region of the hand, and removing a selected portion of the target region to identify a portion of the target region corresponding to the hand. An apparatus and computer program product corresponding to the method are also provided.