Contactless Touchscreen Interface Using Optical Detection and Ultrasonic Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing touchscreen technologies require physical contact, limiting their application in environments where hygiene or accessibility is a concern, such as ATMs and medical equipment.

Innovation Solution

A contactless touchscreen interface using a proximity detector and gaze determining imaging system to detect user interactions at a virtual touch intersection plane, combined with ultrasonic transducers for mid-air tactile feedback, allowing touchless interaction and accurate depth indication.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If physical contact touchscreen is used, then ease of operation is improved, but hygiene and safety deteriorate due to germ transmission and infection risk

Engineering Contradiction:
Improveease of operationVSAvoidhygiene
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The patent replaces the mechanical contact-based touchscreen system with an optical detection system using image sensors. The system detects finger positions, gestures, and interactions through optical imaging without requiring physical contact with the display surface, thereby eliminating germ transmission while maintaining ease of operation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary optical field between the user and the touchscreen. Image sensors capture optical information from the user's interactions, and this information is processed to generate touch inputs, serving as a mediator that enables interaction without direct contact.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If multiple image sensors are arranged around the digital display to provide full coverage, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvemeasurement precisionVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the detection task among multiple image sensors positioned at different locations around the display. Each sensor covers a specific region, and their data is integrated to achieve complete coverage and high measurement precision across the entire touchscreen surface.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs image sensors that serve multiple functions: detecting finger position, recognizing gestures, determining gaze direction, and measuring depth. This multi-functionality reduces the need for separate specialized sensors, thereby managing device complexity while maintaining measurement precision.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If ultrasonic transducers are used for mid-air tactile feedback, then ease of operation is improved through haptic feedback, but device complexity and manufacturing difficulty increase

Engineering Contradiction:
Improveease of operationVSAvoidease of manufacture
Core Design Contradiction:
Ease of operationVSEase of manufacture

Solution Approach 1:

The patent replaces traditional mechanical haptic feedback mechanisms with ultrasonic transducers that generate tactile sensations through acoustic radiation pressure in mid-air. This allows haptic feedback without mechanical contact points, simplifying the manufacturing process while maintaining ease of operation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables touchless interaction across various applications, providing accurate and hygienic user input while maintaining usability and feedback, suitable for diverse environments including ATMs and medical equipment.

Implementation Method 1

A proximity detector comprising an image sensor detects user interaction at a virtual touch intersection plane

Methodology Applied
Scientific EffectOptical imaging: Photography

Implementation Method 2

A gaze determining imaging system comprising an image sensor determines a gaze relative offset with respect to the digital display using facial image data captured by the image sensor

Methodology Applied
Scientific EffectOptical imaging: Photography

Implementation Method 3

a feedback interface comprising a plurality of ultrasonic transducers which emit ultrasound which induces mid-air tactile feedback

Methodology Applied
Scientific EffectUltrasound: Ultrasound

Implementation Method 4

ultrasound which induces mid-air tactile feedback

Methodology Applied
Scientific EffectAcoustic radiation pressure: Acoustic Radiation Pressure

Data Source

PatentUS11861113B2Contactless touchscreen interface
Publication Date: 2024.01.02 VAN DER MERWE MARTHINUS
  • US11861113B2 patent drawing
  • US11861113B2 patent drawing
  • US11861113B2 patent drawing

AI summary

A contactless touchscreen interface has a digital display to display digital information; the proximity detector and a proximity detector comprising an image sensor to detect user interaction at a virtual touch intersection plane offset a distance from the digital display and to resolve the interaction into XY offset-plane interaction coordinates with reference to the digital display. A gaze determining imaging system comprising an image sensor determines a gaze relative offset with respect to the digital display using facial image data captured by the image sensor. An interface controller comprising a parallax adjustment controller to convert the XY offset-plane interaction coordinates to XY on-screen apparent coordinates using the gaze relative offset and the distance and an input controller generates an input at the XY on-screen apparent coordinates accordingly.