3D Interactive Device Using Projected Pattern for Hand Gesture Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing interactive input devices struggle to accurately capture and position small-range motions in 3D space due to limitations in depth map technology, making them unsuitable for portable, contact-free human-machine interfaces that require precise hand or finger motion recognition.
Innovation Solution
A 3D interactive device combining a projection unit and an image capturing unit, with an image processing unit that performs hand geometric recognition, allowing for gesture-based interaction by projecting an interactive pattern and capturing depth images to determine hand region coordinates, enabling precise gesture recognition and control within a small range.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If depth map technology is used for spatial 3D interaction, then the system can capture spatial image information, but the absolute coordinate of hand motion and delicate finger motion cannot be accurately obtained due to limitations in distance and resolution
Solution Approach 1:
The patent introduces an interactive pattern as an intermediary element projected onto the user's hand or surrounding space. This pattern serves as a mediator between the depth camera and the user's hand motions, providing reference points that enable accurate coordinate calculation and gesture recognition without requiring the depth map technology to directly resolve fine hand motion details
Solution Approach 2:
The system changes the parameter of measurement reference by projecting structured light patterns with known geometric features. Instead of relying on raw depth map data alone, the system uses the projected pattern's known parameters (position, shape, size) to establish a reference coordinate system, transforming the measurement approach from direct depth mapping to pattern-based coordinate calculation
2Area of stationary object
If existing interactive input devices are applied for wide-range human-machine interactions, then they can cover large interaction areas, but they cannot accurately position objects moving within a small range in the 3D space
Solution Approach 1:
The patent applies local quality by projecting interactive patterns with different characteristics in different spatial zones. The projection unit can adaptively adjust the pattern's size, resolution, and density based on the detected hand position and interaction distance, providing high measurement precision in the local hand interaction region while maintaining wide overall coverage
Solution Approach 2:
The system dynamically adjusts the projection parameters and image capturing settings based on real-time hand position and motion detection. The projection unit can change the projected pattern's scale and position, while the image capturing unit adjusts its focusing and exposure, enabling accurate tracking of small-range motions within the broader interaction space
3Adaptability or versatility
If handheld infrared projectors or markers are used to track and recognize user gestures, then gestures can be tracked in wide interaction range, but the devices are not applicable to portable, contact-free 3D human-machine interactive interface that may capture short-range motions
Solution Approach 1:
The patent merges the projection unit and image capturing unit into an integrated system that can function as a portable device. The projection unit projects patterns that serve as both the interaction interface and the tracking reference, eliminating the need for separate markers or complex marker recognition systems. This integration enables contact-free gesture tracking suitable for portable applications
Solution Approach 2:
The system uses the projected interactive pattern itself as the tracking reference, making the system self-sufficient. The projected pattern provides the necessary geometric features for the image capturing unit to calculate hand position and gesture information, eliminating the need for external markers or additional tracking devices that would increase complexity and reduce portability
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The device achieves contact-free, accurate interaction in a 3D space, resistant to environmental changes and ambient light, allowing for precise positioning of hand motions and reducing the risk of bacteria infection when integrated into medical devices.
Implementation Method 1
a projection unit for projecting an interactive pattern to a surface
Implementation Method 2
An image capturing unit for capturing a depth image of the hand region within an image capturing range
Data Source
AI summary
A three-dimensional (3D) interactive device and an operation method thereof are provided. The 3D interactive device includes a projection unit, an image capturing unit, and an image processing unit. The projection unit projects an interactive pattern to a surface of a body, so that a user performs an interactive trigger operation on the interactive pattern by a gesture. The image capturing unit captures a depth image within an image capturing range. The image processing unit receives the depth image and determines whether the depth image includes a hand region of the user. If yes, the image processing unit performs hand geometric recognition on the hand region to obtain gesture interactive semantics. According to the gesture interactive semantics, the image processing unit controls the projection unit and the image capturing unit. Accordingly, the disclosure provides a portable, contact-free 3D interactive device.