Single 3D Imaging System for Multi-Modal Gesture Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing human-to-computer interactive systems face challenges in providing accurate, reliable, and cost-effective multi-modal touch and touch-less three-dimensional gesture interactions, as they often require multiple sensing systems, which increase complexity and limit versatility and ergonomics.
Innovation Solution
A single three-dimensional imaging system is used to detect and track objects for both touch and touch-less gestures, enabling multi-modal interactions by determining gesture-based control commands, with the imaging system and display aligned to minimize calibration issues and allow operation on various surfaces.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple sensing systems are used to enable multi-modal touch and touch-less gesture interactions, then the interaction capabilities are improved, but the device complexity increases
Solution Approach 1:
The patent applies a single depth sensing system that performs multiple functions: it detects both touch gestures (when objects contact the display surface) and touch-less gestures (when objects are positioned in three-dimensional space above the surface). This multi-functional approach eliminates the need for separate sensing systems for different interaction modes, reducing device complexity while maintaining versatile interaction capabilities
Solution Approach 2:
The patent merges touch and touch-less gesture recognition into a unified system using a single depth sensing system. By combining previously separate sensing functions into one integrated system, the patent reduces the number of components needed while enabling comprehensive multi-modal interaction support
2Measurement precision
If multiple sensing systems are used to provide accurate gesture detection, then the measurement precision is improved, but the ease of manufacture deteriorates
Solution Approach 1:
The single depth sensing system is designed to accurately detect both touch and touch-less gestures through its ability to measure depth information. This universal sensor provides precise measurement for multiple interaction modes without requiring calibration or integration of multiple specialized sensors, thereby improving ease of manufacture while maintaining high measurement precision
3Device complexity
If a single sensing system is used for both touch and touch-less gestures, then the device complexity is reduced, but the adaptability to different interaction surfaces deteriorates
Solution Approach 1:
The patent employs a depth sensing system that measures distance parameters to differentiate between touch and touch-less gestures. By utilizing depth information as a key parameter, the system can determine whether an object is contacting the display surface or positioned above it, enabling accurate gesture recognition across various interaction surfaces without requiring multiple specialized sensors
Data Source
AI summary
Described herein is a method and a system for providing efficient and complementary natural multi-modal gesture based interaction with a computerized system which displays visual feedback information on a graphical user interface on an interaction surface. The interaction surface is within the frustum of an imaging device comprising a single sensing system. The system uses the single sensing system for detecting both touch gesture interactions with the interaction surface (120) and three-dimensional touch-less gesture interactions in areas or volumes above the interaction surface performed by hands of a user. Both types of interaction are associated contextually with an interaction command controlling the computerized system when the gesture has been detected. The system comprises preferably a projection system for displaying the graphical user interface and visual feedback on the interaction surface, the projection system being locatable on the same side or on the opposite side of the interaction surface to the sensing system.