Robot Motion Visualization in See-Through Collaborative Operation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Operators face difficulties in intuitively understanding how a robot will move based on set control parameters during collaborative operations, particularly with viscosity settings, as existing techniques do not effectively convey the orientation and movement changes in real space.
Innovation Solution
A collaborative operation support device equipped with a head-mounted display, camera, and processor that displays movement data of the robot in association with its operation mode, allowing the operator to visualize the robot's movements and settings through a transparent display, with positional relationships and dynamic adjustments based on control parameters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the operator uses a teach pendant to confirm settings or input control parameters for robot movements, then the operator can control the robot, but the operator needs to temporarily stop the ongoing task, reducing operation efficiency
Solution Approach 1:
The patent introduces a camera and display device as intermediaries between the operator and the robot. The camera captures images of the robot, and the display device presents these images with superimposed visual information about movement directions and viscosity settings. This intermediary system allows the operator to understand robot behavior without stopping to use a teach pendant, thereby maintaining operation efficiency while preserving control capability.
2Ease of operation
If the operator sets control parameters such as viscosity values for robot movements, then the robot movement can be controlled, but the operator cannot intuitively understand which direction the predetermined direction is oriented in real space or what extent movements are changed
Solution Approach 1:
The patent implements visual feedback by superimposing display information directly onto the camera image of the robot. The display device shows arrows or visual indicators that represent the predetermined direction and the effect of viscosity settings on robot movement. This immediate visual feedback allows the operator to intuitively understand the orientation and movement extent without needing to mentally translate abstract parameter values, thus preventing information loss while maintaining ease of parameter setting.
Data Source
AI summary
The collaborative operation support device includes a display device including a display area; and a processor configured to detect, based on an image in which the operator or the robot is represented, a position of a section of the robot in the display area when the operator looks at the robot through the display area, the section associated with an operation mode of the robot specified by means of an input device; select, in accordance with the specified operation mode of the robot, display data corresponding to the specified mode among display data stored in a memory; and display the selected display data in the display area of the display device in such a way that the selected display data is displayed at a position that satisfies a certain positional relationship with the position of the section of the robot in the display area.