Mobile Robot GUI for Wireless Collaborative Robot Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Small and medium-sized manufacturing enterprises face challenges in integrating robotic automation due to high production variability and the need for customization, as commercial off-the-shelf robotic systems are not adaptable to human skill and judgment, and existing teach pendants limit mobility and safety in robot control.

Innovation Solution

A mobile device with a robot graphical user interface (RGUI) that uses wireless protocols to determine distance and position, allowing for dynamic adaptation of robot control modes based on user interaction, enabling greater mobility and safety in robot programming and operation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a teach pendant is used for robot control, then the robot can be programmed and controlled, but the programmer must be in close proximity to the robot which creates safety concerns and limits mobility

Engineering Contradiction:
Improvemobility in robot controlVSAvoidsafety risks from proximity
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

A mobile computing device serves as an intermediary between the operator and the robot. The device receives wireless communications from the robot controller and displays robot status, alerts, and enables control functions remotely, eliminating the need for the operator to be physically close to the robot while maintaining full control capability

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical/wired connection of traditional teach pendants with wireless communication protocols. The mobile device communicates with the robot controller through wireless signals, substituting the physical tether connection and enabling remote operation without mechanical constraints

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If multiple robots are deployed in an facility, then production capacity increases, but managing multiple teach pendants becomes difficult and time-consuming

Engineering Contradiction:
Improveproduction capacityVSAvoidrobot control management
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The mobile computing device provides a universal interface that can control multiple different robots through wireless communication. A single device can manage multiple robots in the facility, eliminating the need for separate teach pendants for each robot and simplifying control management

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent merges the control functions for multiple robots into a single mobile device interface. The device consolidates control capabilities for multiple robots, allowing operators to manage several robots from one location rather than switching between multiple separate teach pendants

Inventive Principle:
Principle #5Merging (Combining)

3Ease of manufacture

If commercial off-the-shelf robotic systems are used, then initial setup is simplified, but the systems cannot adapt to human skill and judgment required for customized manufacturing tasks

Engineering Contradiction:
Improveinitial system setupVSAvoidadaptation to human skill and judgment
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The mobile device acts as an intermediary layer between the operator's expertise and the robotic system. It captures and processes manual guidance inputs from the operator and translates them into robot control commands, enabling the transfer of human skill and judgment to the automated system

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary capture and processing of operator expertise through the mobile device interface before executing robot operations. The device stores and processes the operator's manual guidance and decision-making patterns, preparing them for automated execution while preserving human expertise

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3371684B1Method, device, and computer-readable medium for mobile device management of collaborative industrial robot
Publication Date: 2023.10.11 JOHNS HOPKINS UNIVERSITY
  • EP3371684B1 patent drawingFigure 1
  • EP3371684B1 patent drawingFigure 2
  • EP3371684B1 patent drawingFigure 3

AI summary

Provided is a method, device, and computer-readable medium for controlling a robot graphic user interface ("RGUI") on a mobile device. The method can include determining a distance, a position, or both of the mobile device with respect to a first robot; and causing, by a processor, a first RGUI to be displayed on a display of the mobile device based on the determining.