Contactless Touch Screen Interaction via Gesture and Mobile Commands

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Touch screen interfaces in public devices are frequently touched by multiple users without proper disinfection, leading to concerns about germ and virus transmission, and existing contactless interaction technologies are not practical or user-friendly.

Innovation Solution

The implementation of gesture processing units and mobile commands processing units that enable users to interact with touch screen interfaces without physical contact, using cameras and mobile devices to detect gestures and translate them into human interface device commands, allowing for contactless interaction through hand gestures or mobile device inputs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If touch screen interfaces are used in public devices, then ease of operation is improved, but risk of germ transmission increases

Engineering Contradiction:
Improveease of operationVSAvoidgerm transmission risk
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The patent introduces a camera as an intermediary device that captures images of the touch screen interface. The camera acts as a mediator between the user and the touch screen, allowing users to interact with the interface by taking photos and sharing them rather than directly touching the screen. This eliminates physical contact while maintaining the functionality of the touch interface.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical touch input system with an optical system. Instead of requiring physical contact with the touch screen, the system uses a camera to capture visual information and transmit it to a remote device. This substitution of mechanical interaction with optical capture resolves the contradiction by eliminating germ transmission risk while preserving ease of operation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Object-affected harmful factors

If contactless interaction technologies are implemented, then germ transmission risk is reduced, but device complexity increases

Engineering Contradiction:
Improvegerm transmission riskVSAvoiddevice complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The patent leverages the universal functionality of mobile devices that most users already possess. The system uses the camera and communication capabilities of smartphones, which are ubiquitous and multi-functional. By building upon existing universal devices rather than requiring specialized equipment, the solution reduces overall system complexity while achieving contactless interaction.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system utilizes the self-service capabilities of existing mobile devices. The smartphone's camera, processor, and communication modules automatically perform the functions of capturing, processing, and transmitting the touch interface information without requiring additional dedicated hardware or complex setup. This self-service approach minimizes the complexity burden on the original touch interface device.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11693557B2Systems and methods for non-contacting interaction with user terminals
Publication Date: 2023.07.04 EZRA ARON
  • US11693557B2 patent drawing
  • US11693557B2 patent drawing
  • US11693557B2 patent drawing

AI summary

Systems and methods are provided to enable users to interact with user terminals having a touch screen interface without requiring the user to physically contact a surface of the touch screen interface.