Touchscreen Automation Using Optical Sensing and Solenoid Taps

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Automation technologies struggle to interact with touch-screen devices due to regulatory requirements and the need for human intervention, making it difficult to automate activities that require receipt of instructions or interactions via these devices.

Innovation Solution

A system comprising optical sensors and solenoids is used to detect and engage with touch-screen devices, allowing automated interaction by sensing predetermined characteristics and operating solenoids to tactilely interact with the screen, controlled by a controller.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If automation technologies are used to interact with touch-screen devices, then productivity is improved, but reliability deteriorates due to regulatory requirements and need for human intervention

Engineering Contradiction:

Improveautomation efficiencyVSAvoidinteraction validity

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The patent introduces an intermediary system consisting of optical sensors and solenoids that mediate between the automated process and the touch-screen device. The optical sensors detect touch-screen characteristics and trigger solenoid actuators to physically interact with the screen, serving as a mediator that enables automation while maintaining the appearance of human interaction required by regulations

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces direct mechanical control (human finger touching) with an optical-mechanical system. Optical sensors detect visual characteristics of the touch-screen interface, and solenoid actuators provide the mechanical touch interaction, substituting the human mechanical interaction system with an automated optical-mechanical system

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If optical sensors and solenoids are used for automated interaction, then ease of operation is improved, but device complexity increases

Engineering Contradiction:

Improveautomation capabilityVSAvoidsystem structure

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent creates a universal automated interaction system that can work with multiple different touch-screen devices and interfaces. The optical sensors detect various touch-screen characteristics and the solenoid actuators can interact with different screen types, making the system multi-functional and adaptable to different devices rather than requiring device-specific customization

Inventive Principle:

Principle #6Universality (Multi-functionality)

3Reliability

If touch-screen interactions are required by regulation, then reliability is improved, but productivity deteriorates due to human intervention requirements

Engineering Contradiction:

Improvecompliance validityVSAvoidoperation speed

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The patent enables the automated system to serve itself by using optical sensors to autonomously detect what interaction is needed and triggering solenoid actuators to perform the required touch actions without human intervention. The system monitors and responds to touch-screen prompts automatically, allowing it to self-complete regulatory-required interactions while maintaining compliance validity

Inventive Principle:

Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables automated interaction with touch-screen devices without human intervention, facilitating seamless operation of activities that require touch-screen interactions.

Implementation Method 1

at least one optical sensor configured to sense at least a first portion of a touch-screen of the touch-screen device

Methodology Applied

Scientific EffectOptical sensing: Reflection

Implementation Method 2

at least one solenoid including an end effector that is tactilely detectable by the touch-screen, wherein operation of the at least one solenoid causes the end effector to tactilely engage with a second portion of the touch-screen

Methodology Applied

Scientific EffectSolenoid actuation: Solenoid

Data Source

PatentUS20250348172A1Systems and methods for automated interaction with a touch-screen device

Publication Date: 2025.11.13 JACKPOCKET LLC

AI summary

Systems and methods for automated interaction with a touch-screen device are described. A system for automated interaction with a touch-screen device may include at least one optical sensor configured to sense at least a first portion of a touch-screen of the touch-screen device; at least one solenoid including an end effector that is tactilely detectable by the touch-screen, wherein operation of the at least one solenoid causes the end effector to tactilely engage with a second portion of the touch-screen; and a controller that is operatively connected to the at least one optical sensor and the at least one solenoid, and that is configured to operate the at least one solenoid in response to detecting a predetermined characteristic of the touch-screen via the at least one sensor.