Robot Vision Entry Control via Image Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing robot systems require significant software and circuit changes, are costly, and pose safety risks when attempting to modify them to accommodate human presence, with challenges in stopping positions and restarting operations safely.

Innovation Solution

A robot system equipped with an imaging unit, image processing unit, and signal output unit that allows for safe entry and exit of humans by determining the presence of people and robots, enabling stoppage or continuation of operations without altering existing software or circuits, using visual and auditory signals to indicate safety and permission to enter.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If software programs and circuits of the robot system are changed to accommodate human presence, then human safety is improved, but the cost and complexity increase significantly

Engineering Contradiction:
Improvehuman safetyVSAvoidsoftware and circuit changes
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces an image processing unit as an intermediary component that detects human presence and generates signals to control robot operation. This mediator enables safety functionality without requiring changes to the robot's core software programs or control circuits, thus improving human safety while avoiding increased device complexity

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces complex software-based safety systems with a visual detection system using image processing. Instead of modifying the robot's control software to detect and respond to human presence, the system uses optical detection (imaging device) to monitor the area and control robot operation based on visual signals, simplifying the overall system architecture

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If the robot stops at the detected position when a foreign object is detected, then safety is improved, but it becomes difficult to restart the operation

Engineering Contradiction:
ImprovesafetyVSAvoidrestart capability
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent teaches predetermined stop positions to the image processing unit in advance. When a foreign object is detected, the robot is directed to stop at one of these pre-defined positions rather than stopping at the arbitrary detection location. This preliminary preparation ensures that the robot always stops at safe, restartable positions, maintaining both safety and ease of operation

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The image processing unit continuously monitors the robot's position and provides feedback signals to the control unit. This feedback mechanism ensures the robot reaches the correct predetermined stop position before halting, and enables the system to determine when it is safe to restart operation by confirming the robot is at an appropriate position

Inventive Principle:
Principle #23Feedback

3Productivity

If the robot continues to the end of a block before stopping for maintenance, then productivity is maintained, but the robot may contact obstacles when moving to the maintenance position

Engineering Contradiction:
Improveoperation continuityVSAvoidobstacle contact risk
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The system determines a safe stop position in advance based on the robot's current location and the detected foreign object position. Instead of always stopping at the end of the block, the robot is directed to a predetermined safe position that is calculated to avoid obstacles, enabling maintenance without compromising productivity or safety

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent makes the stop position dynamic rather than fixed. The image processing unit calculates the appropriate stop position based on real-time conditions (foreign object location, robot position, block structure). This dynamic adjustment allows the robot to maintain productivity by minimizing unnecessary travel while ensuring safety by avoiding obstacle contact

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables safe human interaction with robot systems by allowing entry without changing existing software or circuits, ensuring safety through precise stopping and restarting mechanisms, reducing the risk of accidents and maintenance challenges.

Implementation Method 1

an image processing unit which processes images taken by the imaging unit

Methodology Applied
Scientific EffectImage processing: Image Processing

Data Source

PatentUS10016898B2Robot system using a vision sensor
Publication Date: 2018.07.10 FANUC LTD
  • US10016898B2 patent drawing
  • US10016898B2 patent drawing
  • US10016898B2 patent drawing

AI summary

The robot system includes an imaging unit, an image processing unit, an entry request unit for a person to request entry to a predetermined section, and a signal output unit which, in a case where the person has requested entry into the predetermined section, outputs, depending on a processing result of the image processing unit, an entry permission signal indicating that the person is permitted to enter the predetermined section. If the image processing unit detects that the robot has reached a stopping position taught in advance after the person requested to enter the predetermined section, at least one of an instruction to stop the robot and an instruction to stop a part of the robot system which is necessary to enable the person to enter therein is outputted, and the signal output unit outputs the entry permission signal.