Robot Action Detection for Human-Robot Work Coordination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current robot systems lack the ability to intuitively coordinate with human workers during cooperative tasks, requiring manual operation to activate and control robots, which limits their effectiveness in synchronizing movements with human actions.

Innovation Solution

A robot system equipped with detection apparatuses to identify predetermined human actions and a control device that triggers robot operations based on these detections, allowing the robot to perform tasks such as gripping and transporting objects in coordination with human workers without manual device operation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual operation is used to activate and control robots, then robot activation is possible, but coordination with human worker movements is poor

Engineering Contradiction:
Improverobot activationVSAvoidcoordination with human movements
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent replaces manual mechanical operation with an optical detection system. The detection apparatus uses cameras and image processing to automatically recognize human actions, substituting the mechanical control interface with an optical field-based detection system that captures and analyzes visual information about worker movements.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The robot system performs self-activation by automatically detecting human actions through the detection apparatus. Instead of requiring external manual activation, the system autonomously determines when to activate and what work to execute based on detected human actions, enabling the robot to service itself through automatic action recognition and decision-making.

Inventive Principle:
Principle #25Self-service

2Productivity

If detection apparatus is added to detect human actions, then coordination with human workers improves, but device complexity increases

Engineering Contradiction:
Improvecooperative work coordinationVSAvoidsystem structure
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The detection apparatus is designed with multi-functionality to reduce overall system complexity. The same detection apparatus that detects human actions for robot activation also identifies work objects and their positions, and continues to monitor human actions throughout the work process. This universal detection system performs multiple functions that would otherwise require separate specialized devices.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent merges the detection of human actions with the detection of work objects and their positions into a single integrated detection apparatus. By combining these detection functions into one system rather than using separate devices, the overall device complexity is reduced while maintaining the capability to coordinate robot operations with human workers.

Inventive Principle:
Principle #5Merging (Combining)

3Productivity

If robot activates automatically based on detected action, then coordination with human worker improves, but manual control capability is reduced

Engineering Contradiction:
Improveaction synchronizationVSAvoidmanual control
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The robot control system operates dynamically, switching between automatic activation mode and manual control mode as needed. The detection apparatus continuously monitors human actions, and the control device can automatically activate the robot when appropriate actions are detected, while still allowing manual control when required. This dynamic adaptability enables the system to balance automatic coordination with manual control capability.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11235463B2Robot system and robot control method for cooperative work with human
Publication Date: 2022.02.01 FANUC LTD
  • US11235463B2 patent drawing
  • US11235463B2 patent drawing
  • US11235463B2 patent drawing

AI summary

A robot system that can perform cooperative work in accordance with an action of a person. A robot system according to the present disclosure includes a robot, a detection apparatus detecting a work object and detecting a predetermined action of a worker with respect to the work object, and a robot controller causing the robot to execute a predetermined work on the work object detected by the detection apparatus when the detection apparatus detects the predetermined action.