Robot Video Confirmation with 3D Posture Replay for Error Diagnosis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In wafer processing facilities, robots often experience errors that require quick identification and resolution, but data transfer and communication with external networks are restricted, making it difficult for operators to understand and address these issues effectively.

Innovation Solution

A video confirmation computer system that displays a side-by-side model area and video area, using computer graphics to show the robot's posture and captured video, allowing operators to intuitively understand the robot's operation and quickly identify errors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If data transfer and communication with external networks are restricted for security reasons, then facility security is improved, but the ability to quickly identify and resolve robot errors deteriorates

Engineering Contradiction:
Improvefacility securityVSAvoiderror identification capability
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system creates a virtual copy of the robot's physical state through a 3D model that reproduces the robot's posture and position. This virtual model allows operators to observe and analyze robot operations without requiring direct access to the physical robot or external network communication, thus maintaining security while enabling error identification.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The 3D model serves as an intermediary between the robot's internal state and the operator's observation capability. Instead of directly accessing the robot or external networks, operators interact with the 3D model which mediates the information flow, allowing error analysis while maintaining network restrictions.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Device complexity

If only traditional video monitoring is used, then system simplicity is maintained, but the operator's understanding of robot operation and error situation is insufficient

Engineering Contradiction:
Improvesystem simplicityVSAvoidoperation situation understanding
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The system merges traditional video monitoring with a 3D model display, combining the strengths of both approaches. The video provides real-time visual confirmation while the 3D model provides spatial and positional context, together offering comprehensive operation situation understanding without discarding either method.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system adds a third dimension to traditional 2D video monitoring by introducing a 3D model that reproduces the robot's posture and position in three-dimensional space. This dimensional enhancement provides deeper insight into robot operations while building upon the existing video monitoring foundation.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Quantity of substance

If detailed robot operation data is displayed without visualization, then information completeness is improved, but operator comprehension and quick understanding deteriorate

Engineering Contradiction:
Improveinformation completenessVSAvoidoperator comprehension
Core Design Contradiction:
Quantity of substanceVSEase of operation

Solution Approach 1:

The system creates a visual copy of the robot's operational state through the 3D model, which replicates the robot's posture, position, and movements. This visual reproduction transforms abstract data into intuitive visual information that operators can quickly comprehend while maintaining complete operational information.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS12045972B2Video confirmation computer
Publication Date: 2024.07.23 KAWASAKI JUKOGYO KK
  • US12045972B2 patent drawing
  • US12045972B2 patent drawing
  • US12045972B2 patent drawing

AI summary

A video confirmation computer for confirming video related to robot operation includes a storage unit and a processor. The storage unit stores information on the position of the electric motor that drives a link body of the robot received from the controller of the robot and information on the video obtained by a camera attached to the robot. The processor makes at least one of the video confirmation computer itself and a computer connected to the video confirmation computer display a model area and a video area side by side. In the model area, a two-dimensional or three-dimensional model reproducing the posture of the robot is displayed by computer graphics. In the video area, the video is displayed.