Contactless Input Detection via Optical Gesture Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing user interfaces rely on physical contact with input devices, which can be inconvenient or impractical in situations where users prefer not to touch surfaces, such as when hands are dirty or wet, and there is a need to detect inputs without physical contact or the use of coupled devices.
Innovation Solution
The system uses 2D and 3D image capture to detect inputs near a surface by analyzing the location and motion of an input object, such as a hand, within a threshold region, determining touch events based on distance and direction changes, and estimating the input location on the surface using shadow analysis or extrapolation techniques.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If physical contact input devices are used, then input reliability and precision are improved, but ease of operation deteriorates when hands are dirty or wet
Solution Approach 1:
The patent replaces mechanical contact-based input devices with an optical detection system using cameras and image processing. The system captures images of the user's hand and determines input based on hand position, motion, and gesture analysis, eliminating the need for physical contact with input surfaces.
Solution Approach 2:
The patent introduces an intermediary optical system (camera and image processing algorithms) between the user and the computer system. This intermediary captures visual information about hand gestures and translates them into digital inputs, allowing contactless interaction while maintaining reliable input detection.
2Ease of operation
If contactless input detection is implemented, then ease of operation is improved, but measurement precision deteriorates
Solution Approach 1:
The patent transitions from 2D image coordinates to 3D spatial understanding by analyzing hand motion trajectories, depth information, and temporal sequences of gestures. This dimensional enhancement allows precise determination of input locations and gestures without physical contact.
Solution Approach 2:
The system performs preliminary calibration and establishes baseline hand positions before detecting actual inputs. By pre-establishing reference frames and thresholds for hand motion detection, the system ensures precise measurement of subsequent gestures without requiring physical contact.
3Reliability
If traditional physical input devices are used, then input reliability is improved, but adaptability deteriorates in environments where touching surfaces is undesirable
Solution Approach 1:
The patent creates a universal input system that can detect multiple types of gestures (pointing, clicking, dragging, scrolling) and work across different surfaces and environments. The same optical detection system adapts to various input scenarios without requiring different physical devices, maintaining reliability while enhancing adaptability.
Data Source
AI summary
A number of images of an environment may be obtained over time by a number of sensors. The images may include an input surface and an input object, such as a hand or stylus, that may be utilized by a user to provide an input via the input surface. In some cases, the input may be provided without the input object touching the input surface. The location of the input object with respect to the input surface over time and a speed of the input object over time may be used to determine whether an input has been indicated by the input object without contacting the input surface.