Robotic GUI Generation for Plug-In Peripheral Reconfiguration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Small and medium-sized manufacturing enterprises face challenges in integrating robotic automation due to high production variability and the need for customized tasks, as commercial off-the-shelf robotic systems are not adaptable to accommodate human skill and judgment, and existing systems lack seamless integration of graphical user interfaces for added peripherals.

Innovation Solution

A GUI-based robotic programming platform that dynamically generates and adapts user interfaces and updates robotic properties in response to changes in robotic configuration, allowing for easy installation and swapping of peripherals, with minimal requirement for integrating drivers or GUI elements, enabling novice users to interact and control robots seamlessly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If commercial off-the-shelf robotic systems are used, then initial setup and infrastructure costs are reduced, but adaptability to customized tasks and high product variability in SMEs is poor

Engineering Contradiction:
ImproveInitial setup costVSAvoidAdaptability to customized tasks
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The robotic system employs dynamic reconfigurability where the robot can be programmatically reconfigured through a user-friendly interface to adapt to different tasks and peripherals. The system dynamically adjusts its operational parameters, tooling configurations, and integration protocols based on real-time requirements, enabling SMEs to leverage off-the-shelf hardware while achieving high adaptability for customized manufacturing tasks.

Inventive Principle:
Principle #15Dynamics

2Productivity

If robotic automation is integrated into SMEs with high product variability, then productivity is improved, but programming complexity and setup effort increase significantly

Engineering Contradiction:
ImproveProductivityVSAvoidProgramming complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system implements self-service capabilities through automated peripheral detection and configuration. When new peripherals are connected, the system automatically detects them, retrieves appropriate drivers and parameters, and configures integration without requiring extensive programming knowledge. This self-configuration mechanism enables SME users to improve productivity while minimizing programming complexity through intuitive, automated setup processes.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If peripherals are added to robotic systems to expand functionality, then versatility is improved, but integration effort and GUI customization requirements increase

Engineering Contradiction:
ImproveFunctionality expansionVSAvoidIntegration effort
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The robotic system employs universal integration protocols and a standardized graphical user interface that can accommodate multiple peripheral types through a common architecture. The system provides multi-functional capabilities where a single GUI framework handles diverse peripherals (sensors, actuators, end-effectors) uniformly, eliminating the need for separate integration efforts for each device type and simplifying the expansion of system versatility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Ease of operation

If seamless integration of GUI for attached tooling is required, then ease of use is improved, but system complexity and development time increase

Engineering Contradiction:
ImproveEase of useVSAvoidSystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system merges the GUI generation process with the peripheral detection and configuration workflow into a unified automated process. When peripherals are detected, the system simultaneously generates the appropriate GUI elements, integrates them into the existing interface framework, and configures operational parameters in a single coordinated action. This merging of functions provides seamless integration and ease of use while avoiding the complexity of separate, manual GUI development processes.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentEP3371666B1Generation of robotic user interface responsive to connection of peripherals to robot
Publication Date: 2021.08.18 JOHNS HOPKINS UNIVERSITY
  • EP3371666B1 patent drawingFigure 1
  • EP3371666B1 patent drawingFigure 2
  • EP3371666B1 patent drawingFigure 3

AI summary

Methods and systems for connection-driven generation of robotic user interfaces and modification of robotic properties include detecting (210) a connection of a robotic peripheral to a robot (50); obtaining (230, 242) a peripheral property set (150) corresponding to the robotic peripheral, wherein the peripheral property set (140) includes one or more properties of the robotic peripheral; modifying (230, 242), based on the peripheral property set, a robotic property set that includes one or more properties of the robot to provide a modified robotic property set; generating (234, 246), during runtime, a robotic graphical user interface ("RGUI") dynamically based on the peripheral property set, wherein the RGUI provides at least one user-accessible interface to control the robot and the robotic peripheral; and controlling (234, 246), based on the modified robotic property set, the robot and the robotic peripheral in response to user input received via the RGUI.