Robotic Arm Route Correction With Synthesized Visual Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Industrial robots face challenges in adapting to varying work objects and environments, leading to reduced work quality and increased operator labor when manually correcting robotic arm routes in master-slave systems.

Innovation Solution

A robot system that allows remote control of a robotic arm with real-time route correction capabilities, using a synthesized image of the scheduled route and captured images to guide the operator for precise adjustments, reducing operator labor and improving adaptability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the robot operates automatically based on a preset program, then high speed and high accuracy are achieved, but the system cannot adapt when work objects vary or work environment changes

Engineering Contradiction:
Improvework speed and accuracyVSAvoidadaptability to varying work objects
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The system dynamically switches between automatic operation mode (for high speed and accuracy) and manual operation mode (for adaptability). The operation mode is not fixed but can be changed based on the work situation, allowing the robot to maintain high productivity during routine tasks while adapting to variations when needed.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system provides real-time visual feedback through a monitor displaying the robot's current position and preset route. This allows the operator to observe the automatic operation and intervene when adaptation is needed, creating a feedback loop that combines automatic efficiency with human adaptability.

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If the operator manually operates a master arm in a master-slave system, then flexible adaptation to each work object is achieved, but significant time and labor are required

Engineering Contradiction:
Improveflexibility for each work objectVSAvoidoperator time and labor
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

Instead of requiring full manual operation for the entire work process, the system uses partial manual action only when needed for route correction during automatic operation. The operator intervenes partially to correct specific portions of the route rather than controlling the entire operation, significantly reducing time and labor while maintaining adaptability.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system performs preliminary action by presetting the robot's operation route in advance. This preset route handles the majority of the work automatically, and the operator only needs to make minor corrections when necessary, rather than manually controlling every movement from scratch.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If the operator remotely controls the robotic arm during automatic operation, then route correction is possible, but suitable correction cannot be achieved unless the operator grasps in advance how the preset route is to be corrected

Engineering Contradiction:
Improveroute correction capabilityVSAvoidease of route correction
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The monitor provides real-time visual feedback showing the robot's current position overlaid with the preset route. This feedback mechanism eliminates the need for the operator to predict corrections in advance, as they can directly observe the robot's position and make intuitive corrections based on visual information, greatly improving ease of operation.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The monitor serves as an intermediary between the automatic operation system and the operator. It translates the robot's position and preset route into visual information that the operator can easily interpret, facilitating smooth and intuitive route correction without requiring the operator to mentally calculate or predict the necessary adjustments.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP3342552B1Robot system
Publication Date: 2022.08.03 KAWASAKI JUKOGYO KK
  • EP3342552B1 patent drawingFigure 1
  • EP3342552B1 patent drawingFigure 2
  • EP3342552B1 patent drawingFigure 3

AI summary

A robot system includes a robotic arm having an end effector configured to perform a work to a work object, a memory part storing information that causes the end effector to move as scheduled route information, a motion controller configured to operate the robotic arm by using the scheduled route information to move the end effector, a route correcting device configured to generate, by being manipulated, manipulating information to correct a route of the end effector during movement, a camera configured to image the work object, an image generator configured to generate a synthesized image by synthesizing a scheduled route of the end effector obtained from the scheduled route information with a captured image sent from the camera, and a monitor configured to display the synthesized image.