Teleoperated Robot GUI With Haptic Feedback for Precise Remote Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Teleoperation of industrial robots faces challenges in providing an effective user interface for remote operation, especially when the operator is not in direct line of sight or at a safe distance, requiring improved visualization and feedback mechanisms to manage complex movements and orientations accurately.
Innovation Solution
A graphical user interface system that synchronizes the position and orientation of a teleoperated member with a robot, using calibrated indicators and haptic feedback to correlate movements of a haptic joystick with the robot's actions, providing real-time visual and tactile feedback for precise operation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Object-affected harmful factors
If the operator is located at a remote facility or different location to ensure safety during teleoperation, then operator safety is improved, but communication delay and synchronization accuracy between operator inputs and robot actions deteriorate
Solution Approach 1:
The system creates a virtual copy of the robot (virtual robot) that replicates the physical robot's movements and actions in real-time within the graphical user interface. This virtual copy allows the operator to see immediate visual feedback of robot actions without waiting for actual robot responses, effectively eliminating perceived communication delay while maintaining safe remote operation distances.
Solution Approach 2:
The system implements real-time visual feedback by continuously updating the virtual robot's position and orientation in the GUI to match the physical robot's actual position and orientation. This immediate feedback loop allows the operator to see the direct correlation between their teleoperation member inputs and the robot's actions, maintaining synchronization accuracy despite physical distance.
2Object-affected harmful factors
If the operator is not in direct line of sight of the robot to maintain safety distance, then operator safety is improved, but visualization accuracy and spatial awareness of robot position and orientation deteriorate
Solution Approach 1:
The system creates a virtual copy of the robot (virtual robot) that replicates the physical robot's movements and actions in real-time within the graphical user interface. This virtual copy allows the operator to see immediate visual feedback of robot actions without waiting for actual robot responses, effectively eliminating perceived communication delay while maintaining safe remote operation distances.
Solution Approach 2:
The graphical user interface acts as an intermediary between the operator and the physical robot, providing a virtual representation that bridges the gap caused by remote operation. The GUI translates complex robot position and orientation data into intuitive visual indicators, maintaining spatial awareness accuracy without requiring direct line of sight.
3Object-affected harmful factors
If complex robot movements and orientations are controlled remotely, then operator safety is improved, but control precision and operation complexity increase
Solution Approach 1:
The system creates a virtual copy of the robot (virtual robot) that replicates the physical robot's movements and actions in real-time within the graphical user interface. This virtual copy allows the operator to see immediate visual feedback of robot actions without waiting for actual robot responses, effectively eliminating perceived communication delay while maintaining safe remote operation distances.
Solution Approach 2:
The system replaces complex mechanical control interfaces with a graphical user interface that uses visual indicators, icons, and virtual representations to control robot movements. This substitution simplifies the control interface by translating complex multi-axis robot movements into intuitive graphical manipulations, reducing operational complexity while maintaining precision.
Data Source
Figure 1
Figure 2~3A
Figure 3B~4B
AI summary
A teleoperated robotic system that utilizes a graphical user interface (GUI) to perform work on a workpiece(s) using a robot. A coordinate system of the GUI can be correlated to the tool center point (TCP) of the robot and the TCP or workspace of a teleoperated member, such as a haptic joystick. Operable manipulation of the teleoperated member can be correlated to a movement at a particular location in the robot station, such as movement of the TCP of the robot. The GUI can also provide digital representations of the workpiece, which can be based on inputted and/or scanned information relating to a reference workpiece and/or the particular workpiece on which the robot is performing work. The GUI can further provide indications of the various stages of assembly of the workpiece, as well as an indication of work already, or to be, performed on the workpiece.