Teleoperated Robot GUI Synchronizing TCP and Joystick Coordinates
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current teleoperation systems for industrial robots lack an effective graphical user interface that synchronizes the position and orientation of both the robot and the teleoperated member, making it difficult for operators to accurately control robots remotely, especially in hazardous or distant locations.
Innovation Solution
A system and method that utilize a computing device to receive and calibrate sensor data from both the robot and teleoperated member stations, synchronizing their positions and orientations within a graphical user interface, which includes a haptic joystick for providing force feedback and intuitive control.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If teleoperation is implemented with traditional control interfaces, then operator safety is improved by remote operation, but control precision deteriorates due to lack of synchronized visualization
Solution Approach 1:
The patent creates a virtual copy of the robot and its environment in a graphical user interface that mirrors the physical robot's position and orientation in real-time. This virtual representation allows the operator to see exactly what the robot is doing without being physically present, maintaining safety while improving control precision through accurate visual feedback.
Solution Approach 2:
The system implements closed-loop feedback by continuously synchronizing the robot's actual position and orientation data with its virtual representation in the GUI. This real-time feedback loop ensures the operator always sees the current state of the robot, enabling precise remote control while maintaining safety through distance.
2Object-affected harmful factors
If remote operation distance is increased for safety, then operator protection from hazards is improved, but system complexity increases due to synchronization requirements
Solution Approach 1:
The patent introduces a graphical user interface as an intermediary between the operator and the robot. This GUI acts as a mediator that receives sensor data from the robot, processes it into a visual representation, and presents it to the operator. This intermediary simplifies the overall system by consolidating communication protocols and data processing in one layer.
Solution Approach 2:
The system replaces direct mechanical control linkages with electronic and software-based communication. Instead of complex mechanical teleoperation systems, the patent uses digital sensor data transmission and virtual representation, reducing physical complexity while enabling greater remote operation distances for operator safety.
3Measurement precision
If synchronized graphical representation is implemented, then control accuracy is improved, but information processing requirements increase
Solution Approach 1:
The patent extracts only the essential position and orientation data from the robot's sensor suite needed for accurate graphical representation. By selecting and processing only the critical parameters rather than all available sensor data, the system achieves high control accuracy while minimizing information processing requirements and energy consumption.
Data Source
AI summary
A teleoperated robotic system that utilizes a graphical user interface (GUI) to perform work on a workpiece(s) using a robot. A coordinate system of the GUI is correlated to the tool center point (TCP) of the robot and the TCP or workspace of a teleoperated member, such as a haptic joystick. Operable manipulation of the teleoperated member is correlated to a movement at a particular location in the robot station, such as movement of the TCP of the robot. The GUI can also provide digital representations of the workpiece, which is based on inputted and/or scanned information relating to a reference workpiece and/or the particular workpiece on which the robot is performing work. The GUI can further provide indications of the various stages of assembly of the workpiece, as well as an indication of work already, or to be, performed on the workpiece.