Wearable Robot Visibility Control for Obstructed Operator View

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing robot control systems face challenges in safely preventing unintended contact between robots and operators or objects due to limitations in estimating the visual range of humans, especially when environmental objects obstruct the view of the visual sensor.

Innovation Solution

A robot control device equipped with a camera attached to a display device worn by the operator, which captures the environment and displays it, along with sensors to measure the operator's head movements, allowing the processor to determine if the robot is within the operator's visual range and control the robot's motion accordingly, either slowing it down or stopping it if not visible.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a visual sensor is used to estimate the human's visual range, then the robot can be controlled based on whether the human recognizes the robot, but the estimation becomes inaccurate when objects interrupt the imaging range

Engineering Contradiction:
Improvevisual range estimation accuracyVSAvoidrobustness to environmental obstacles
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent introduces a wearable display device (camera and display) as an intermediary between the human operator and the robot. Instead of using a fixed visual sensor to estimate the human's visual range, the system captures images through the wearable device worn by the operator, directly reflecting what the operator can see. This intermediary approach eliminates the problem of objects interrupting the imaging range, as the camera moves with the operator's head movements, ensuring accurate and robust visual range estimation in various environmental conditions.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If the robot motion is controlled based on visual sensor imaging, then contact danger can be reduced, but the control becomes unreliable when the human head position changes relative to the visual sensor

Engineering Contradiction:
Improvecontact prevention reliabilityVSAvoidoperator mobility freedom
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent implements a dynamic control system where the robot's motion control is continuously adjusted based on real-time detection of the operator's head position and the robot's visibility in captured images. As the operator moves their head or changes position, the system dynamically updates the visual range estimation and adjusts robot motion accordingly. This dynamic approach maintains high reliability in contact prevention while allowing the operator full mobility freedom, as the control adapts continuously to changing spatial relationships rather than relying on fixed sensor positions.

Inventive Principle:
Principle #15Dynamics

3Device complexity

If a fixed visual sensor is used to monitor the robot, then the system structure is simple, but the visual range estimation fails when the operator and robot positional relationship changes

Engineering Contradiction:
Improvesensor system simplicityVSAvoidvisual range detection accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent makes the visual sensing system universal by integrating it into a wearable display device that the operator wears. This single wearable unit serves multiple functions: capturing images of the environment, tracking the operator's head position, and adapting to various operator-robot positional relationships. The camera and display components work together to provide continuous visual range estimation regardless of how the operator or robot moves, eliminating the need for multiple fixed sensors while maintaining detection accuracy across all scenarios.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11254005B2Robot control device
Publication Date: 2022.02.22 FANUC LTD
  • US11254005B2 patent drawing
  • US11254005B2 patent drawing
  • US11254005B2 patent drawing

AI summary

A robot control device includes a camera configured to be attached to a display device carried by or put on an operator and capture an environment surrounding the operator to generate an image of the environment; and a processor configured to slow down or stop motion of a predetermined robot included in the environment when the predetermined robot is not displayed on the display device, when only a portion of the predetermined robot is displayed, or when a ratio of a region representing the predetermined robot to a display area of the display device is equal to or lower than a predetermined threshold.