AI Hand Landmark Recognition for Electronic Device Control

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional gesture control systems focus on function-calling rather than controlling objects, affecting user experience, and most operations require auxiliary tools like a mouse, which can hinder intuitive control.

Innovation Solution

An electronic device with an image capturing module and processing module that captures hand gestures using an AI model to generate hand landmarks, enabling intuitive control and unlocking modes based on predefined gestures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional control systems use auxiliary tools like mice for operations, then device functionality can be achieved, but user experience and intuitiveness deteriorate

Engineering Contradiction:

Improveuser experienceVSAvoidauxiliary tools requirement

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces mechanical input devices (mouse, keyboard) with a vision-based gesture recognition system. The image capturing module detects hand gestures, and the processing module translates them into control commands, eliminating the need for physical auxiliary tools and directly improving user experience through intuitive hand movements.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an image capturing module and processing module as intermediaries between the user's hand gestures and the electronic device control. This intermediary system captures visual information, processes it through AI models to generate hand landmarks, and converts gestures into operational commands, enabling direct control without traditional auxiliary tools.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Speed

If gesture control systems focus on function-calling, then system responsiveness is improved, but control precision and object manipulation capability deteriorate

Engineering Contradiction:

Improvesystem responsivenessVSAvoidcontrol precision

Core Design Contradiction:

SpeedVSMeasurement precision

Solution Approach 1:

The patent segments the hand into multiple landmark points (21 key points) through AI processing. Each landmark represents a specific finger joint or hand position, enabling precise tracking of hand geometry and movement. This segmentation allows the system to distinguish between different gesture types and achieve both rapid response and high control precision for object manipulation.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent transitions from simple function-calling gestures to multi-dimensional hand landmark coordinates. By capturing the spatial positions of 21 hand landmarks in three-dimensional space, the system gains additional dimensional information about hand shape, orientation, and movement trajectory, enabling precise object control while maintaining rapid system responsiveness.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS12443287B2Electronic device and operation method thereof

Publication Date: 2025.10.14 INNOLUX CORP

AI summary

An electronic device includes an image capturing module and a processing module. The image capturing module is configured to capture a hand to obtain a first hand image. The processing module is configured to receive the first hand image, process the first hand image through an artificial intelligence model to generate a first hand landmark, and control the electronic device to enter the unlock mode according to a first gesture corresponding to the first hand landmark.