Gesture Tracking via Comparative Reference for Detection Reliability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional gesture control methods face challenges in detecting gestures from certain image frames due to angles and light, leading to user experience issues, as they often return to the initialization state and restart detection, rather than tracking gestures within a preset time interval.

Innovation Solution

A gesture control method that acquires an image, performs gesture detection, and if no gesture is recognized, determines if the time interval since the last detection is less than a preset period (0.5-1 second), allowing for tracking and updating of the comparative gesture to continue detection based on the last recognized or tracked gesture, thereby improving user experience by avoiding immediate initialization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the system returns to initialization state when gesture is not detected, then the detection process can be restarted fresh, but the user experience deteriorates due to frequent re-initialization interruptions

Engineering Contradiction:
Improvegesture detection reliabilityVSAvoiduser experience continuity
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system performs preliminary tracking of gesture features (hand position, orientation, shape) even when complete gesture recognition has not been achieved. This preliminary action maintains the detection context ready, so when the gesture becomes fully visible or recognizable, the system can immediately complete recognition without re-initialization, thus improving both reliability and user experience continuity

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The tracking module continues to execute useful actions by monitoring gesture features continuously even during partial recognition states. This continuity ensures that the system maintains an up-to-date understanding of the gesture state without interrupting the detection flow, allowing seamless transition from partial to complete recognition and eliminating the need for disruptive re-initialization

Inventive Principle:
Principle #20Continuity of useful action

2Measurement precision

If the system performs full gesture detection on every image frame, then detection accuracy is maintained, but processing time and computational resources increase

Engineering Contradiction:
Improvegesture detection accuracyVSAvoiddetection processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system applies partial detection actions by using the tracking module to monitor only critical gesture features (position, orientation, shape) rather than performing complete gesture recognition on every frame. This partial action reduces processing time while maintaining accuracy because the tracking provides continuous contextual information that complements periodic full detection

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The detection process is segmented into two distinct modules: a tracking module that continuously monitors basic gesture features with low computational cost, and a recognition module that performs comprehensive gesture analysis only when needed. This segmentation allows the system to maintain detection accuracy through the tracking module's continuous monitoring while reducing overall processing time by avoiding redundant full detections on every frame

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If the system re-acquires images and restarts detection frequently, then detection can be performed on fresh data, but detection stability deteriorates due to loss of gesture context

Engineering Contradiction:
Improvegesture detection precisionVSAvoiddetection stability
Core Design Contradiction:
Measurement precisionVSStability of the object's composition

Solution Approach 1:

The tracking module provides continuous feedback on gesture features (hand position, orientation, shape) that maintains contextual information across multiple frames. This feedback mechanism allows the system to adjust detection parameters and maintain stable recognition even when re-acquiring images, preventing complete loss of gesture context and improving detection stability without sacrificing precision

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11609638B2Recognizing and tracking gestures
Publication Date: 2023.03.21 BOE TECHNOLOGY GROUP CO LTD
  • US11609638B2 patent drawing
  • US11609638B2 patent drawing
  • US11609638B2 patent drawing

AI summary

A gesture control method comprises: acquiring an image; performing a gesture detection on the image to recognize a gesture from the image; determining, if no gesture is recognized from the image, whether a time interval from a last gesture detection, in which a gesture was recognized, to the gesture detection is less than a preset time period; tracking, if the time interval is less than the preset time period, the gesture in the image based on a comparative gesture which is a gesture recognized last time or tracked last time; and updating the comparative gesture with a currently recognized gesture or a currently tracked gesture. A gesture control method is provided that comprises: identifying an image acquisition device for acquiring image, to determine whether the image acquisition device is a depth-of-field image acquisition device, and performing gesture control based on the identification.