Wearable Device Gesture Recognition Using Key Point Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional wearable devices have slow and inaccurate gesture recognition speeds, limiting user interaction efficiency due to reliance on one-dimensional touchpad interactions and image acquisition-based recognition methods.

Innovation Solution

A control method and system that acquires key point information of user gestures, recognizes input instructions, and generates control instructions for executing tasks, utilizing image acquisition devices and neural networks for accurate gesture recognition, allowing for faster and more precise control.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image acquisition-based gesture recognition is used, then gesture control capability is provided, but recognition speed is slow and accuracy is low

Engineering Contradiction:
Improvegesture recognition accuracyVSAvoidgesture recognition speed
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The patent segments the gesture recognition process by first detecting key points (landmarks) of body parts in images, then using these key points to recognize gestures. This segmentation allows the system to focus computational resources on identifying critical features rather than processing entire images, thereby improving both speed and accuracy of gesture recognition

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts key point information from images to represent gestures. By taking out only the essential key points (such as joint positions, fingertip locations) rather than using full image data, the system achieves faster processing while maintaining recognition accuracy, directly resolving the contradiction between speed and accuracy

Inventive Principle:
Principle #2Taking out (Extraction)

2Ease of operation

If one-dimensional touchpad interaction is used, then device control is enabled, but interaction efficiency is limited

Engineering Contradiction:
Improveinteraction efficiencyVSAvoidoperation time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent transitions from one-dimensional touchpad interaction to multi-dimensional gesture recognition by detecting key points in two-dimensional images and interpreting their spatial relationships. This dimensional expansion enables more intuitive and efficient control, reducing operation time while improving ease of use through natural body movements

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11782514B2Wearable device and control method thereof, gesture recognition method, and control system
Publication Date: 2023.10.10 SZ DJI TECH CO LTD
  • US11782514B2 patent drawing
  • US11782514B2 patent drawing
  • US11782514B2 patent drawing

AI summary

A wearable device and its control method, a gesture recognition method, a movable platform control system and a storage medium are provided. The control method may include acquiring key point information of a gesture action of a target user, recognizing an input instruction based upon the key point information, and generating a control instruction based upon the input instruction and executing a task operation according to the control instruction.