Contactless Touch Screen Interaction via Gesture and Mobile Commands
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Touch screen interfaces in public devices are frequently touched by multiple users without proper disinfection, leading to concerns about germ and virus transmission, and existing contactless interaction technologies are not practical or user-friendly.
Innovation Solution
The implementation of gesture processing units and mobile commands processing units that enable users to interact with touch screen interfaces without physical contact, using cameras and mobile devices to detect gestures and translate them into human interface device commands, allowing for contactless interaction through hand gestures or mobile device inputs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If touch screen interfaces are used in public devices, then ease of operation is improved, but risk of germ transmission increases
Solution Approach 1:
The patent introduces a camera as an intermediary device that captures images of the touch screen interface. The camera acts as a mediator between the user and the touch screen, allowing users to interact with the interface by taking photos and sharing them rather than directly touching the screen. This eliminates physical contact while maintaining the functionality of the touch interface.
Solution Approach 2:
The patent replaces the mechanical touch input system with an optical system. Instead of requiring physical contact with the touch screen, the system uses a camera to capture visual information and transmit it to a remote device. This substitution of mechanical interaction with optical capture resolves the contradiction by eliminating germ transmission risk while preserving ease of operation.
2Object-affected harmful factors
If contactless interaction technologies are implemented, then germ transmission risk is reduced, but device complexity increases
Solution Approach 1:
The patent leverages the universal functionality of mobile devices that most users already possess. The system uses the camera and communication capabilities of smartphones, which are ubiquitous and multi-functional. By building upon existing universal devices rather than requiring specialized equipment, the solution reduces overall system complexity while achieving contactless interaction.
Solution Approach 2:
The system utilizes the self-service capabilities of existing mobile devices. The smartphone's camera, processor, and communication modules automatically perform the functions of capturing, processing, and transmitting the touch interface information without requiring additional dedicated hardware or complex setup. This self-service approach minimizes the complexity burden on the original touch interface device.
Data Source
AI summary
Systems and methods are provided to enable users to interact with user terminals having a touch screen interface without requiring the user to physically contact a surface of the touch screen interface.


