Hand Gesture Recognition via Feature Point Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing user interface systems struggle to accurately distinguish between hand gestures for command input and hand movements for direction input, leading to misrecognition and incorrect execution of commands.

Innovation Solution

An input user interface device equipped with an image pickup unit, shape detection unit, and command deciding unit that determines whether the detected object shape corresponds to a gesture command or a position designation command, allowing for precise differentiation and execution of commands.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a direction-input user interface and gesture recognition are combined, then the system can recognize both hand movement for cursor control and hand gestures for command input, but the control unit may misrecognize the user's action and execute incorrect commands

Engineering Contradiction:
Improvecommand recognition capabilityVSAvoidcommand execution accuracy
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent segments the hand object into multiple feature points (tips of fingers, joints, palm center) and tracks their relative positions and movements independently. By analyzing the movement patterns of individual feature points rather than treating the hand as a single entity, the system can distinguish between directional movement (where all points move together) and gestural movement (where points move differently relative to each other), thereby resolving the misrecognition problem while maintaining both input modes

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent dynamically adjusts the recognition logic based on the detected movement type. When the hand moves as a rigid body (all feature points maintaining fixed relative positions), the system interprets it as directional input for cursor control. When the hand shape changes (feature points move differently), the system interprets it as a gesture command. This dynamic switching between recognition modes eliminates misrecognition while preserving versatility

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If the control unit recognizes hand gestures to execute commands, then gesture-based control is enabled, but the system may misinterpret gesture as direction input or vice versa

Engineering Contradiction:
Improvegesture-based controlVSAvoidhand action recognition accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent implements feedback by continuously monitoring the relative positions and movements of hand feature points throughout the interaction. The system provides real-time distinction between gesture and directional movement through shape analysis, allowing the control unit to accurately determine user intent. This feedback mechanism prevents misinterpretation by constantly verifying whether the hand shape remains consistent (directional input) or changes (gesture command)

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9213411B2Input user interface device, projecting device, command deciding method and program storage medium storing command deciding method program
Publication Date: 2015.12.15 CASIO COMPUTER CO LTD
  • US9213411B2 patent drawing
  • US9213411B2 patent drawing
  • US9213411B2 patent drawing

AI summary

An input user interface device includes an image pickup unit which picks up an image including an object image, a shape detection unit which detects a shape of the object image in the image picked up by the image pickup unit, a determination unit which determines whether the shape of the object image detected by the shape detection unit corresponds to a shape associated with a gesture command or a shape associated with a position designation command for designating a position data, and a command deciding unit which decides the gesture command or the position designation command on the basis of the decision by the deciding unit.