Mobile UI Navigation for Contactless Transaction Terminals
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The concern of virus transmission through touchscreen displays on transaction terminals due to multiple users touching the same surface, exacerbated by the COVID-19 pandemic, necessitates a solution for contactless interaction.
Innovation Solution
A method and system enabling mobile navigational control of transaction terminal User Interfaces (UIs) through a remote-control user session using a mobile device, where UI events are generated by the mobile device and relayed as Human Interface Device (HID) events to the terminal, simulating keyboard interactions without direct network connection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If touchscreen displays are used for transaction interfaces, then ease of operation is improved, but virus transmission risk increases
Solution Approach 1:
The patent introduces a mobile device as an intermediary between the user and the touchscreen terminal. The mobile device captures images of the touchscreen display and transmits control commands wirelessly, allowing users to interact with the terminal without physically touching the display surface. This mediator approach maintains ease of operation while eliminating direct contact with potentially contaminated surfaces.
Solution Approach 2:
The patent replaces the mechanical touch interaction system with an optical-electronic system. Instead of mechanical contact through fingers on the touchscreen, the system uses camera imaging to detect user intent and wireless communication to transmit commands. This substitution eliminates the physical contact mechanism that enables virus transmission while preserving the interactive functionality.
2Object-affected harmful factors
If touchscreen displays are disinfected frequently, then virus transmission risk is reduced, but productivity decreases
Solution Approach 1:
The patent implements preliminary action by establishing contactless control capability before the transaction begins. Users set up wireless control through mobile devices at the start of their interaction, eliminating the need for repeated disinfection interventions during transactions. This preliminary setup maintains productivity while addressing health concerns.
Solution Approach 2:
By introducing the mobile device as a mediator, the system reduces dependency on frequent disinfection. The intermediary layer allows continuous operation without interrupting transactions for cleaning, thereby maintaining productivity while reducing virus transmission risk through eliminated physical contact.
3Object-affected harmful factors
If contactless control is implemented, then virus transmission risk is reduced, but device complexity increases
Solution Approach 1:
The patent leverages the universal functionality of mobile devices that users already possess. The mobile device serves multiple purposes: capturing display images, recognizing UI elements, transmitting control commands, and providing feedback. By utilizing an existing multi-functional device rather than introducing specialized equipment, the system reduces overall complexity while achieving contactless control.
Solution Approach 2:
The system implements self-service by using the user's own mobile device for control functions. The mobile device's camera, processor, and communication capabilities are utilized without requiring additional terminal hardware or complex infrastructure. This self-service approach minimizes system complexity by relying on the user's existing personal technology.
Data Source
AI summary
A mobile device establishes an indirect network connection to a User Interface (UI) agent of a terminal. The indirect connection managed as a mobile navigational control session maintained through a server or through the server and a proxy. A keyboard widget/object and a navigation-selection widget/object are rendered within a mobile screen on a display of the mobile device. During the session, a user interacts with the keyboard and/or navigation-selection widgets and corresponding UI key events are forwarded to the UI agent. The UI agent provides the UI key events as Human Interface Device (HID) key events to the terminal causing a transaction interface to update transaction screens being rendered on a transaction display of the terminal during a transaction. The user conducts the transaction at the terminal without touching the transaction display and controls the transaction screens for the transaction via the keyboard and navigational widgets from the mobile device.