Touchless Terminal Interface Using Depth Camera Gesture Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The COVID-19 pandemic has highlighted concerns about virus transmission through touchscreen displays on transaction terminals, as they are often not sanitized frequently enough, posing health risks to users and operators, especially in essential businesses that cannot shut down.
Innovation Solution
A touchless terminal interface system using depth cameras and infrared motion detection to translate air gestures into interface actions, allowing operators to interact with transaction terminals without physically touching the screen, enhancing health and safety by creating a logical air-based touch field adjacent to the display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If touchscreen displays are used for transaction interfaces, then ease of operation is improved, but health safety deteriorates due to virus transmission risk
Solution Approach 1:
The patent introduces an intermediary system consisting of depth cameras and infrared sensors that detect hand gestures in the air space in front of the touchscreen. This intermediary translation layer converts touchless gestures into touchscreen commands, allowing users to interact with the terminal without direct contact, thus eliminating virus transmission risk while preserving ease of operation
Solution Approach 2:
The patent replaces the mechanical contact-based touchscreen interaction system with an optical and infrared detection system. Depth cameras capture hand position and motion in three-dimensional space, while infrared sensors detect hand presence and gestures. These physical gestures are then translated into digital commands, substituting mechanical touch with optical detection to eliminate surface contact
2Object-affected harmful factors
If touchscreen displays are sanitized frequently, then health safety is improved, but productivity deteriorates due to operational interruptions
Solution Approach 1:
The patent implements preliminary action by introducing touchless interaction capability before any contamination can occur. By enabling users to interact with the terminal without contact from the outset, the system eliminates the need for repeated sanitization interruptions, maintaining both health safety and continuous productivity
Solution Approach 2:
The gesture recognition system acts as a mediator that completely decouples user interaction from physical contact with the touchscreen surface. This intermediary layer allows transactions to proceed continuously without sanitization interruptions, as the display surface remains uncontaminated by direct touch
3Object-affected harmful factors
If touchless interface system is implemented, then health safety is improved, but device complexity increases
Solution Approach 1:
The patent applies universality by using depth cameras and infrared sensors that can serve multiple functions: detecting hand presence, tracking hand motion, recognizing gestures, and determining touch intent. This multi-functional approach consolidates what could be multiple separate systems into a unified touchless interaction platform, managing device complexity while achieving health safety
Solution Approach 2:
The patent merges the depth camera system and infrared sensor system into an integrated touchless interaction platform. By combining these detection technologies and their processing functions into a unified system that works together to recognize gestures and translate them into touchscreen commands, the patent manages complexity through integration rather than separate independent systems
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution enables safe and efficient transactions by eliminating the need for physical contact with the terminal, reducing the risk of virus transmission and maintaining business operations during pandemics.
Implementation Method 1
A touch action is detected with respect to an interface rendered on a touchscreen display. The touch action is made within a field that is in front of and adjacent to a touch surface of the touchscreen display.
Implementation Method 2
A touch action is detected with respect to an interface rendered on a touchscreen display. The touch action is made within a field that is in front of and adjacent to a touch surface of the touchscreen display.
Data Source
AI summary
A touch field is created around a touchscreen display, the field is in front of a touch surface of the display and the field maps to locations on the display. An operator of a terminal during a transaction is presented with transaction interface screens that are visually rendered on the display. The operator makes interface options selections, performs screen navigation, and provides date entry field inputs by placing the operator's hand within the field without touching the touch surface of the display and making hand poses, hand movements, and/or hand gestures. The poses, movements, and/or gestures are translated into touch actions and touch inputs recognized by the transaction interface and processed as operator-provided input during the transaction.