3D Depth Camera Gesture Recognition via Virtual Spatial Touch Screen
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional navigation gesture recognition systems face complexity in detecting various hand gestures under different environmental conditions, requiring a more stable and efficient method for recognizing up, down, left, and right motions.
Innovation Solution
A navigation gesture recognition system utilizing a three-dimensional depth camera to generate a virtual spatial touch screen and detect gestures by dividing the physical surface into regions, allowing for the detection of moving directions and generating control commands based on the location of points within these regions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional hand detection and trace analysis methods are used to recognize navigation gestures, then the system can detect hand positions and recognize basic directions, but the algorithm becomes complex and difficult to implement under various environmental conditions
Solution Approach 1:
The patent transitions from conventional 2D image-based hand detection to 3D depth camera-based spatial coordinate detection. By capturing depth information and converting hand positions into three-dimensional spatial coordinates (x, y, z), the system achieves more robust gesture recognition that is independent of hand shape, color, and environmental lighting conditions, thereby improving reliability while maintaining algorithmic simplicity
Solution Approach 2:
The system changes the detection parameters from 2D image coordinates to 3D spatial coordinates. The depth camera captures Z-axis distance information, and the processor converts this into standardized spatial coordinates where the origin is the camera position. This parameter transformation enables the system to recognize gestures based on spatial position and movement direction rather than complex visual pattern recognition
2Adaptability or versatility
If conventional 2D image-based hand detection is used, then the system can recognize hand positions, but it fails to provide stable detection under various environmental conditions and requires complex algorithms
Solution Approach 1:
The patent introduces the Z-axis depth dimension to create 3D spatial coordinates, making the detection system adaptable to various environmental conditions. The depth camera captures distance information that is independent of lighting conditions, hand appearance, and background complexity, allowing the system to reliably detect hand positions and movement directions without complex environmental adaptation algorithms
3Measurement precision
If linear trace analysis of hand positions is used for gesture recognition, then the system can recognize basic directions, but it results in misrecognition and requires complex algorithms to improve accuracy
Solution Approach 1:
The system uses 3D spatial coordinates to directly calculate movement directions between consecutive hand positions, avoiding the need for complex linear trace analysis. By computing the difference in x, y, z coordinates between current and previous hand positions, the system accurately determines movement direction (up, down, left, right, forward, backward) with simple arithmetic operations, achieving high precision without algorithmic complexity
Solution Approach 2:
The patent replaces complex visual trace analysis with direct spatial coordinate differential calculation. Instead of analyzing the path and curvature of hand movement in 2D space, the system simply computes the vector difference between consecutive 3D positions, substituting a complex mechanical analysis process with a simple mathematical operation that is computationally efficient and highly accurate
Data Source
AI summary
Provided are a navigation gesture recognition system and a gesture recognition method thereof. The navigation gesture recognition system includes a depth camera configured to capture a depth image, a memory configured to store a program for recognizing a navigation gesture of an object, and a processor configured to execute the program stored in the memory, wherein the processor executes the program to generate a virtual spatial touch screen from the depth image, detects a moving direction of a gesture of the object included in the depth image on the spatial touch screen, and generates a control command corresponding to the moving direction.