Remote Robotic Card Handling With KVM Feedback Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous remote computing systems face errors and inefficiencies in performing tasks, particularly in interacting with card readers and point-of-sale terminals, due to the lack of effective remote control and data extraction mechanisms.

Innovation Solution

A system comprising an autonomous robot device with a controller, articulated arm, and image capture device, coupled with a Keyboard Video Mouse (KVM) switch device, allows for remote control and replication of displays to facilitate interaction with card readers, enabling the extraction of actions performed by the robot and transmission of instructions for accurate card authentication and data input.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If autonomous robot devices perform tasks without remote control, then productivity is improved, but reliability deteriorates due to errors in task execution

Engineering Contradiction:
Improvetask execution efficiencyVSAvoidtask execution accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent introduces a switch device as an intermediary between the remote computing system and the autonomous robot device. This mediator enables bidirectional communication: it transmits instructions from the remote system to the robot and captures video/keyboard/mouse signals from the robot to the remote system, allowing real-time monitoring and correction of autonomous operations to maintain reliability while preserving productivity benefits

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements feedback mechanisms by capturing the robot device's display output through the switch device and transmitting it to the remote computing system. This allows the remote system to monitor the robot's actions in real-time, detect errors, and send corrective instructions, thereby maintaining task execution accuracy while the robot operates autonomously

Inventive Principle:
Principle #23Feedback

2Reliability

If remote control interface is provided for autonomous robot, then reliability is improved through error correction, but device complexity increases

Engineering Contradiction:
Improveerror correction capabilityVSAvoidsystem structure
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The switch device serves multiple functions simultaneously: it acts as a video switch to capture and transmit the robot's display output, functions as a keyboard switch to transmit keystrokes from the remote system to the robot, and operates as a mouse switch to transmit mouse movements. This multi-functionality reduces the need for separate control systems, thereby limiting the increase in device complexity while providing comprehensive remote control capabilities for error correction

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Reliability

If display replication is implemented for remote monitoring, then reliability is improved through action extraction, but loss of information increases due to data transmission delays

Engineering Contradiction:
Improveaction extraction accuracyVSAvoidreal-time data accuracy
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The switch device continuously captures and transmits the robot device's display output to the remote computing system without interruption. This continuous data stream ensures that the remote system receives real-time information about the robot's actions, minimizing information loss and enabling immediate error detection and correction while maintaining reliable action extraction

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS11123871B2Systems and methods autonomously performing instructed operations using a robotic device
Publication Date: 2021.09.21 WALMART APOLLO LLC
  • US11123871B2 patent drawing
  • US11123871B2 patent drawing
  • US11123871B2 patent drawing

AI summary

Described in detail herein is autonomous system for performing instructed operations. A switch device in electrical communication with an autonomous robot device and a remote computing system, can replicate a first display of the autonomous robot device on a second display of the remote computing system. The switch device provides an interface for remotely controlling the autonomous robot device via the remote computing system. The autonomous robot device can control the articulated arm to move the at least one card to physically interact with a card reader. The remote computing system can autonomously extract each action performed by the autonomous robot device from the first display in response to replication of the first display on the second display via the switch device.