Structured Light Gesture Recognition via Surface Distinction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current gesture recognition technologies face challenges in accurately distinguishing and interpreting human gestures, particularly in differentiating between an object and the projection surface, and in effectively triggering specific operations based on recognized gestures.

Innovation Solution

The method involves projecting a structured light pattern, composed of a specific wavelength of light, onto a surface, acquiring and processing images to identify regions of change in intensity and disparity, and performing frame-to-frame tracking to determine the path of movement, allowing for the recognition of specific gestures and triggering corresponding actions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a camera is used to read human body movements for gesture recognition, then gesture control capability is provided, but the system cannot accurately distinguish between objects and the projection surface

Engineering Contradiction:

Improvegesture control capabilityVSAvoidobject-surface distinction accuracy

Core Design Contradiction:

Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system segments the problem into two distinct detection modes: one for detecting hand gestures in the air (without contact) and another for detecting contact with the projection surface. This segmentation allows the system to apply different analysis criteria and algorithms for each scenario, resolving the ambiguity between objects and surface.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary detection mechanism that analyzes intermediate states between hand movement and surface contact. By detecting subtle changes in the projection pattern and hand position, the system can distinguish whether an object is approaching, contacting, or interacting with the surface, rather than treating all detections uniformly.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Ease of operation

If gesture recognition is implemented without mechanical devices, then user interaction is simplified, but the system lacks precision in interpreting specific gestures and triggering operations

Engineering Contradiction:

Improvecontactless interactionVSAvoidgesture interpretation accuracy

Core Design Contradiction:

Ease of operationVSMeasurement precision

Solution Approach 1:

The system employs dynamic gesture recognition that adapts to different interaction scenarios. It dynamically adjusts detection sensitivity and interpretation rules based on the detected gesture type, hand position, movement trajectory, and context, enabling precise interpretation of various gestures without mechanical contact.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent changes multiple parameters including detection threshold, analysis depth, and response triggering criteria based on the detected gesture characteristics. By dynamically adjusting these parameters, the system achieves high precision in gesture interpretation while maintaining ease of contactless operation.

Inventive Principle:

Principle #35Parameter changes

3Difficulty of detecting and measuring

If the system detects regions with intensity changes in the acquired image, then object detection is enabled, but the system cannot determine whether the detected feature is within the specified distance of the projection surface

Engineering Contradiction:

Improveobject detection capabilityVSAvoiddistance measurement accuracy

Core Design Contradiction:

Difficulty of detecting and measuringVSMeasurement precision

Solution Approach 1:

The system transitions from two-dimensional image intensity analysis to three-dimensional spatial understanding by incorporating depth information from the projection pattern distortion. By analyzing how the structured light pattern deforms when reflected from objects at different distances, the system can accurately determine the z-distance of detected features from the projection surface.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables precise recognition of gestures, such as hand movements, and effectively triggers operations, such as controlling a display or lighting, by distinguishing objects from the projection surface and interpreting their movements as specific inputs.

Implementation Method 1

acquiring an image based on light of the particular wavelength reflected from a vicinity of the projection surface

Methodology Applied

Scientific EffectLight reflection: Reflection

Data Source

PatentUS10474297B2Projecting a structured light pattern onto a surface and detecting and responding to interactions with the same

Publication Date: 2019.11.12 AMS OSRAM ASIA PACIFIC PTE LTD

AI summary

The present disclosure describes projecting a structured light pattern projected onto a surface and detecting and responding to interactions with the same. The techniques described here can, in some cases, facilitate recognizing that an object such as a user's hand is adjacent the plane of a projection surface and can distinguish the object from the projection surface itself. Movement of the object then can be interpreted, for example, as a specified type of gesture that can trigger a specified type of operation to occur.