3D HCI System Using Optical Markers for Precise Hand Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D Human-Computer Interfaces (HCIs) with body-worn sensors and actuators, such as gloves, suffer from limited resolution and delays in updating hand position, leading to incomplete hand visibility and exaggerated motion corrections, making them unsuitable for design work and immersive applications.
Innovation Solution
A 3D HCI system with sensors and actuators that provide natural and intuitive interaction by projecting controls in three spatial dimensions, allowing body movements to directly manipulate 3D images with haptic feedback, enabling precise control and adjustment of design parameters through hand and body interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If body-worn sensors (gloves) are used to detect hand position in 3D HCI, then hand position can be tracked, but the resolution is limited and updates are delayed causing incomplete hand visibility and motion errors
Solution Approach 1:
The patent introduces optical markers attached to the user's hand as an intermediary element. These markers are detected by external cameras rather than relying solely on body-worn sensors, providing a mediation layer that improves both the precision and timeliness of hand position detection without requiring complex sensor systems in the glove itself
Solution Approach 2:
The patent replaces the mechanical sensor-based detection system with an optical detection system using cameras and visual markers. This substitution eliminates the limitations of body-worn sensors by using non-contact optical fields to detect hand position, achieving higher resolution and real-time updates
2Loss of information
If virtual hand is displayed on 2D screen to show hand position, then user can see hand location, but the view is limited and subtle motions are lost
Solution Approach 1:
The patent transitions from 2D display to true 3D virtual reality environment. Instead of projecting a flat virtual hand image on a screen, the system renders the virtual hand within the immersive 3D scene, allowing users to view their hand from multiple angles and perceive subtle motions naturally through depth and spatial context
Solution Approach 2:
The patent creates a faithful visual copy of the user's actual hand within the virtual environment. By rendering the virtual hand with high fidelity to match the user's real hand geometry and motion, the system preserves all subtle motion details without requiring additional display complexity
3Ease of operation
If 3D display system with haptic feedback is used for design work, then immersion and realism are improved, but the system is not suited for practical design manipulation
Solution Approach 1:
The patent makes the 3D display system with haptic feedback universally applicable to various design tasks. By integrating versatile tools and controls within the immersive environment, the system can handle diverse design operations (modeling, editing, visualization) without requiring task-specific hardware, thus adapting to different design applications while maintaining ease of operation
Solution Approach 2:
The patent enhances design manipulation by implementing real-time haptic feedback that responds to user interactions with virtual objects. This feedback loop allows designers to feel resistance, texture, and force when manipulating 3D models, making the immersive system practically suitable for design work while maintaining intuitive control
Data Source
AI summary
A system includes a three dimensional display device configured to project computer generated controls and a target image in a three dimensional target volume; and an actuator configured to be worn by an operator. The system further includes one or more sensors configured to sense a movement of the actuator, wherein the controls are configured to be manipulated corresponding with the movement of the actuator within the target volume to alter an appearance of the target image.