Gesture Judgment Device Using Face Reference Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing gesture judgment technologies face challenges in accurately distinguishing between intended gestures and unintended motions, especially in environments with changing backgrounds, and are unsuitable for short-duration gesture operations.

Innovation Solution

A gesture judgment device and method that includes a reference part detection unit, movement extraction unit, reference part disappearance judgment unit, and timing judgment unit to synchronize the detection of reference part disappearance and movement regions, allowing for accurate judgment of short-duration gestures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the operator performs a predetermined operation continuously for a predetermined period to increase gesture judgment accuracy, then the gesture judgment accuracy is improved, but the gesture operation cannot be performed in a short time

Engineering Contradiction:
Improvegesture judgment accuracyVSAvoidgesture operation duration
Core Design Contradiction:
Measurement precisionVSDuration of action of moving object

Solution Approach 1:

The system performs preliminary detection of the reference part (face) and establishes a reference region before the gesture occurs. This preliminary action creates a spatial and temporal reference framework that allows the system to quickly judge gestures without requiring continuous operation for a predetermined period, thus resolving the contradiction between accuracy and short duration.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces a reference part (face) as an intermediary object to establish a reference region. This intermediary serves as a stable reference point that enables accurate gesture judgment even for short-duration operations, as the gesture can be judged relative to this pre-established reference rather than requiring continuous operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If image processing is performed on the entire frame to detect gestures, then all gesture operations can be detected, but background changes cause misjudgment

Engineering Contradiction:
Improvegesture detection coverageVSAvoidgesture judgment accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent segments the image processing by first detecting the reference part (face) and establishing a reference region, then focusing gesture detection only within this segmented region. This segmentation approach maintains versatility in detecting various gestures while improving accuracy by excluding background changes outside the reference region from causing misjudgment.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies local quality by concentrating processing resources on the reference region derived from the face position, rather than uniformly processing the entire frame. This allows accurate gesture detection within the relevant local area while being insensitive to background changes in other regions, thus resolving the contradiction between coverage and accuracy.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If the target region is limited with reference to the operator's face position, then background changes are excluded, but the operation requires continuous predetermined period

Engineering Contradiction:
Improvegesture judgment accuracyVSAvoidoperation duration
Core Design Contradiction:
Measurement precisionVSDuration of action of moving object

Solution Approach 1:

The system performs preliminary detection of the face and establishment of the reference region before the gesture occurs. This preliminary action creates a ready-to-use reference framework that enables immediate gesture judgment when movement is detected within the region, eliminating the need for continuous operation for a predetermined period while maintaining high accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The reference region is dynamically established based on the detected face position and can adapt to different gestures. This dynamic approach allows the system to use the reference region for immediate gesture judgment without requiring fixed-duration continuous operation, thus resolving the contradiction between accuracy and operation duration.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10719697B2Gesture judgment device, gesture operation device, and gesture judgment method
Publication Date: 2020.07.21 MITSUBISHI ELECTRIC MOBILITY CORP
  • US10719697B2 patent drawing
  • US10719697B2 patent drawing
  • US10719697B2 patent drawing

AI summary

A gesture judgment device includes a reference part detection unit that outputs reference part information indicating a reference part region, a movement extraction unit that outputs movement information indicating a movement region, a reference part disappearance judgment unit that generates a reference part disappearance information, a timing judgment unit that judges whether first timing indicated by the reference part disappearance information and second timing of occurrence of a frame in which the movement region overlaps with the reference part region indicated by the reference part information are synchronized with each other or not and outputs a timing judgment result as the result of the judging, and an operation judgment unit that judges contents of a gesture operation performed by an operator based on the timing judgment result and the movement information.