3D Gesture Recognition Using Mark Points to Replace Sensors

Solution Overview

Problem

Existing methods for recognizing three-dimensional gestures in head-mounted devices require multiple tracking and positioning sensors on gloves, leading to increased production costs, heat emission, and reduced flexibility, thereby compromising user experience.

Innovation Solution

A method and apparatus for recognizing three-dimensional gestures based on mark points, which uses cameras and gloves with mark points to determine the three-dimensional coordinate positions of the mark points, eliminating the need for tracking and positioning sensors on the gloves.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple tracking and positioning sensors are arranged on the gloves, then three-dimensional gesture recognition capability is improved, but production cost increases

Engineering Contradiction:

Improvegesture recognition capabilityVSAvoidproduction cost

Core Design Contradiction:

ReliabilityVSEase of manufacture

Solution Approach 1:

The patent uses visual copying through camera imaging to replace physical sensors. Instead of embedding tracking sensors in the gloves, the system captures images of the gloves wearing mark points and processes these visual copies to determine three-dimensional gesture information, thereby eliminating the need for expensive sensors while maintaining recognition capability

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical sensor-based tracking system with an optical imaging system. The mechanical sensors (IMU, electromagnetic sensors) are substituted by cameras that capture optical images, and the processing system converts these images into three-dimensional coordinate information, achieving sensorless gesture recognition

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If multiple tracking and positioning sensors are arranged on the gloves, then three-dimensional gesture recognition capability is improved, but heat emission increases

Engineering Contradiction:

Improvegesture recognition capabilityVSAvoidheat emission

Core Design Contradiction:

ReliabilityVSTemperature

Solution Approach 1:

The system uses visual copying through camera imaging to replace physical sensors. Instead of embedding tracking sensors in the gloves, the system captures images of the gloves wearing mark points and processes these visual copies to determine three-dimensional gesture information, thereby eliminating the need for expensive sensors while maintaining recognition capability

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical sensor-based tracking system with an optical imaging system. The mechanical sensors (IMU, electromagnetic sensors) are substituted by cameras that capture optical images, and the processing system converts these images into three-dimensional coordinate information, achieving sensorless gesture recognition

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If multiple tracking and positioning sensors are arranged on the gloves, then three-dimensional gesture recognition capability is improved, but flexibility is reduced

Engineering Contradiction:

Improvegesture recognition capabilityVSAvoidflexibility

Core Design Contradiction:

ReliabilityVSEase of operation

Solution Approach 1:

The system uses visual copying through camera imaging to replace physical sensors. Instead of embedding tracking sensors in the gloves, the system captures images of the gloves wearing mark points and processes these visual copies to determine three-dimensional gesture information, thereby eliminating the need for expensive sensors while maintaining recognition capability

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical sensor-based tracking system with an optical imaging system. The mechanical sensors (IMU, electromagnetic sensors) are substituted by cameras that capture optical images, and the processing system converts these images into three-dimensional coordinate information, achieving sensorless gesture recognition

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12217544B2Method, apparatus and device for recognizing three-dimensional gesture based on mark points

Publication Date: 2025.02.04 QINGDAO PICO TECH CO LTD

AI summary

A method and apparatus for recognizing a three-dimensional gesture based on mark points, a device and a storage medium are provided. An image collected by each camera is acquired; for each image, an identifier and a corresponding two-dimensional coordinate position of each mark point in the image are determined; a three-dimensional coordinate position of each mark point in a coordinate system of a corresponding camera is determined according to the two-dimensional coordinate position of each mark point and a calibration parameter of the corresponding camera; the three-dimensional coordinate position is converted to an initial three-dimensional coordinate position in a coordinate system of the designated space; and a target three-dimensional coordinate position of each mark point in the coordinate system of the designated space is determined according to the initial three-dimensional coordinate position of each mark point in each image and the identifier of the corresponding mark point.