Handling Robot Abnormality Detection via Event-Triggered Image Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing handling robots lack an efficient method for easily checking the state of the robot or items when an abnormality occurs, leading to prolonged recovery times and potential inventory discrepancies.
Innovation Solution
A processing device that obtains events and images of a handling robot, identifies specific periods around abnormality occurrences, and extracts relevant images for easy inspection and inventory correction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If handling robots operate autonomously without continuous monitoring, then productivity is improved, but reliability deteriorates when abnormalities occur
Solution Approach 1:
The patent implements a feedback mechanism where images captured during robot operation are transmitted to a terminal device, and abnormality detection results are fed back to provide feedback to operators. This allows the system to maintain autonomous operation while providing reliable abnormality detection through continuous image monitoring and analysis.
Solution Approach 2:
The patent introduces an image processing system as an intermediary between the handling robot and the monitoring operator. The system captures images, transmits them to a terminal device, and performs automated abnormality detection, serving as a mediator that enables autonomous operation while maintaining reliable monitoring capabilities.
2Measurement precision
If detailed inspection procedures are implemented for abnormality checking, then measurement precision is improved, but loss of time increases
Solution Approach 1:
The patent performs preliminary actions by continuously capturing and storing images during normal robot operation. When an abnormality is detected, the system can immediately retrieve and analyze previously captured images without waiting for the abnormality to occur, enabling quick and accurate inspection while minimizing recovery time.
Solution Approach 2:
The patent creates visual copies of the handling robot's operation through captured images. These image copies are transmitted to terminal devices and used for abnormality detection, allowing detailed inspection without requiring physical intervention or stopping the robot, thus maintaining both high detection accuracy and fast response time.
3Reliability
If continuous image monitoring is implemented, then reliability is improved, but use of energy increases
Solution Approach 1:
The patent implements periodic action by capturing images at specific intervals or at predetermined positions during the handling robot's operation, rather than continuously monitoring. This approach maintains reliable monitoring capability while significantly reducing energy consumption compared to continuous image capture and processing.
Data Source
AI summary
According to one embodiment, a processing device is configured to obtain first events indicating that a holding part of a handling robot has passed through respective predetermined passing-through positions. The processing device is configured to obtain a plurality of images of the handling robot. The processing device is configured to identify, when obtaining a second event indicating an abnormality in the handling robot, a first period that is between two of the plurality of first events and includes occurrence timing of the second event, or a second period that is from one of the plurality of first events immediately before the occurrence timing to the occurrence timing. The processing device is configured to extract at least one of the plurality of images obtained in the first period or the second period from the plurality of images.