Hand Gesture Recognition via Dynamic Region Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies face challenges in recognizing hand gestures at high speed and with high accuracy, often requiring large image processing and being prone to erroneous recognition due to environmental factors and the need to process the entire image.

Innovation Solution

An image processing apparatus that includes a hand shape recognition unit to detect the position and size of a hand with a specific shape, a determination region setting unit to set regions near the hand for gesture recognition, and a gesture recognition unit that monitors movement within these regions, allowing for precise and efficient gesture recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the entire image is set as a monitoring target to recognize hand gestures, then the gesture recognition coverage is improved, but the processing time increases and recognition speed decreases

Engineering Contradiction:
Improvegesture recognition coverageVSAvoidgesture recognition speed
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The patent divides the image processing into two stages: first performing hand shape recognition to locate the hand region, then setting a determination region around the detected hand for gesture monitoring. This segmentation allows the system to process only relevant regions rather than the entire image, improving recognition speed while maintaining coverage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different processing quality to different regions: high-precision hand shape recognition is applied to locate the hand, then a determination region is set around it. This local quality approach ensures accurate gesture recognition within the determined region without requiring full-image processing, thus improving speed while maintaining recognition coverage.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If the entire image is processed to improve gesture recognition accuracy, then the recognition accuracy is improved, but the processing complexity increases

Engineering Contradiction:
Improvegesture recognition accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the processing into hand shape recognition followed by gesture recognition in a determination region. This reduces processing complexity by avoiding full-image analysis while maintaining accuracy through focused regional processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary hand shape recognition to locate the hand before performing gesture recognition. This preliminary action simplifies subsequent processing by pre-identifying the relevant region, reducing overall processing complexity while maintaining recognition accuracy.

Inventive Principle:
Principle #10Preliminary action

3Speed

If the region of a moving subject is used to recognize gestures, then the gesture recognition speed is improved, but erroneous recognition occurs due to environmental factors

Engineering Contradiction:
Improvegesture recognition speedVSAvoidgesture recognition accuracy
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The patent applies local quality by setting a determination region around the detected hand with specific spatial relationships. This ensures that only movements within the hand's vicinity are considered for gesture recognition, filtering out environmental movements while maintaining fast recognition speed.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent uses feedback by continuously monitoring whether the hand moves into the determination region and recognizing gestures based on this feedback. This feedback mechanism improves reliability by confirming hand presence and movement within the relevant region, reducing erroneous recognition while maintaining speed.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9916012B2Image processing apparatus, image processing method, and program
Publication Date: 2018.03.13 SONY GROUP CORP
  • US9916012B2 patent drawing
  • US9916012B2 patent drawing
  • US9916012B2 patent drawing

AI summary

Provided is an image processing apparatus including a hand shape recognition unit that performs hand shape recognition on an input image to detect a position and a size of a hand with a specific shape in the input image, a determination region setting unit that sets a region in a vicinity of the hand on the input image as a determination region used to recognize a gesture performed using the hand, based on the position and the size of the hand, and a gesture recognition unit that recognizes the gesture by monitoring movement of the hand to the determination region.