Gesture Recognition Using Sharpness Depth Lookup

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional gesture recognition systems fail to accurately determine the depth of objects and distinguish them from background objects, leading to control errors, especially when ambient light interferes with the recognition process.

Innovation Solution

A gesture recognition system employing a zoom lens, image sensor, and processing unit that uses a lookup table to calculate the current depth of objects based on sharpness values, while also removing objects outside a predetermined operable range and reducing processing power through sub-sampling, allowing for accurate three-dimensional coordinate calculation and interaction with display devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional image sensors are used to capture images, then the system can identify position variation of objects, but the system cannot identify depth of objects or distinguish them from background objects

Engineering Contradiction:
Improvedepth identification accuracyVSAvoiddepth information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent changes the focus length parameter of the zoom lens to capture multiple images at different focus lengths. By comparing the sharpness values of objects across these images, the system can determine depth information without requiring additional sensors or complex algorithms.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system pre-establishes a lookup table that stores the relationship between sharpness values and depth information during the calibration phase. This preliminary action enables rapid depth determination during actual operation by simply querying the pre-computed table, avoiding real-time complex calculations.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If infrared light sources are used to project patterns for depth identification, then the processing unit can identify depth of objects, but the system becomes vulnerable to interference from ambient light sources

Engineering Contradiction:
Improvedepth identification accuracyVSAvoidambient light interference
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The system uses the existing optical properties of objects (how they reflect light and appear sharp or blurry at different focus lengths) to determine depth. This self-service approach eliminates the need for external active illumination, making the system immune to ambient light interference while maintaining depth measurement capability.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If the processing unit processes all captured images to calculate sharpness values, then accurate depth determination is achieved, but the power consumption of the processing unit increases

Engineering Contradiction:
Improvedepth determination accuracyVSAvoidprocessing unit power consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system extracts only the essential information needed for depth determination by implementing sub-sampling, which selects specific pixels from the full image rather than processing all pixels. This extraction approach maintains sufficient accuracy for depth measurement while dramatically reducing the computational load and power consumption.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Instead of processing the complete image data, the system performs partial processing by calculating sharpness values only at selected sampling points. This partial action is sufficient to determine depth information while avoiding the excessive power consumption of full-image processing.

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system effectively determines the depth of objects, reduces interference from environment objects, and conserves processing unit power, enabling precise control and interaction with display devices by calculating three-dimensional coordinates and controlling cursor motion or applications.

Implementation Method 1

The zoom lens is configured to receive a control signal to accordingly adjust a focus length of the zoom lens

Methodology Applied
Scientific EffectFocus length adjustment: Lens

Implementation Method 2

The image sensor is configured to capture an image frame

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS9628698B2Gesture recognition system and gesture recognition method based on sharpness values
Publication Date: 2017.04.18 PIXART IMAGING INC
  • US9628698B2 patent drawing
  • US9628698B2 patent drawing
  • US9628698B2 patent drawing

AI summary

A gesture recognition system includes an image capturing device, a memory unit and a processing unit. The image capturing device includes a zoom lens and captures an image frame with a focus length. The memory unit previously saves a lookup table of depths versus sharpness associated with at least one the focus length of the zoom lens. The processing unit is configured to calculate a current sharpness value of at least one object image in the image frame and to obtain a current depth of the object image according to the lookup table.