Fiducial Marker Discrimination for Multi-User Hand Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems that capture images of objects using markers, such as gloves, cannot determine the identity of the user associated with the hand when multiple users are present, making it impossible to accurately issue operation instructions based on marker states.

Innovation Solution

A program that includes a fiducial-marker discrimination unit, start-point identification unit, structured-marker determination unit, and operation instruction unit, which use marker information to discriminate fiducial markers, identify start points, determine structured marker states, and output instructions to the correct object based on object identifiers, enabling accurate user identification and operation control.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Difficulty of detecting and measuring

If marker recognition is used to detect hand motion, then hand motion detection capability is improved, but user identity determination capability deteriorates when multiple users are present

Engineering Contradiction:
Improvehand motion detectionVSAvoiduser identity determination
Core Design Contradiction:
Difficulty of detecting and measuringVSMeasurement precision

Solution Approach 1:

The marker system is divided into two distinct types: fiducial markers for user identification and structured markers for hand motion detection. This segmentation allows each marker type to serve its specific function independently, resolving the contradiction between detecting hand motion and determining user identity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Fiducial markers serve as intermediaries that link captured images to object identifiers, enabling the system to determine which user is associated with which hand. These markers mediate between the image data and user identity information, solving the problem of user identification in multi-user scenarios.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Difficulty of detecting and measuring

If only structured markers are used for hand detection, then hand motion recognition is improved, but object association capability deteriorates

Engineering Contradiction:
Improvehand motion recognitionVSAvoidobject identifier association
Core Design Contradiction:
Difficulty of detecting and measuringVSLoss of information

Solution Approach 1:

The marker system separates identification functions (fiducial markers) from motion detection functions (structured markers). This segmentation ensures that structured markers can be optimized for hand motion recognition while fiducial markers handle object association, eliminating the loss of information about object identifiers.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If marker information is stored and processed, then user identification accuracy is improved, but system complexity increases

Engineering Contradiction:
Improveuser identification accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system extracts and stores only essential identification information (object identifiers associated with fiducial markers) rather than processing complete image data. This extraction approach improves user identification accuracy while minimizing the increase in system complexity by storing only necessary data.

Inventive Principle:
Principle #2Taking out (Extraction)

4Measurement precision

If fiducial markers are introduced for user identification, then user identity determination is improved, but marker discrimination difficulty increases

Engineering Contradiction:
Improveuser identity determinationVSAvoidmarker discrimination
Core Design Contradiction:
Measurement precisionVSDifficulty of detecting and measuring

Solution Approach 1:

Different regions of the image are processed with different discrimination strategies: fiducial markers use object identifier-based discrimination while structured markers use shape-based discrimination. This local quality approach optimizes discrimination difficulty for each marker type according to its specific characteristics and function.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10719943B2Program and image processing device
Publication Date: 2020.07.21 CYGAMES INC
  • US10719943B2 patent drawing
  • US10719943B2 patent drawing
  • US10719943B2 patent drawing

AI summary

A program stored on a non-transitory computer readable medium executable on a computer to perform discriminating a fiducial marker from captured images successively output from a camera, based on marker information representing associations between fiducial markers and object identifiers, identifying start points of one or more structured markers in the captured images based on the discriminated fiducial marker and position information defined in association with the fiducial marker, determining states of the one or more structured markers continuing from the start points, and outputting an operation instruction in accordance with the determined states of the one or more structured markers to an object discriminated based on the object identifier associated with the discriminated fiducial marker.