Transparent Robot Display Control for Operator Information Overload

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In interactive robot operating systems, both image information from cameras and actual peripheral information are often displayed simultaneously on a head-mounted display, leading to unnecessary information overload for operators, reducing work efficiency.

Innovation Solution

A robot system with a transparent display unit that only shows sensor-detected information when required, allowing operators to focus on the physical world and reducing information overload.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If both image information from camera and actual peripheral information are displayed simultaneously on head-mounted display, then the operator can access both types of information, but the operator experiences information overload and increased burden

Engineering Contradiction:
Improveinformation completenessVSAvoidoperator burden
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent extracts and displays only the necessary sensor information on the head-mounted display rather than showing all available information. The control device determines which sensor data to display based on robot operation state, extracting only relevant information to avoid overload while maintaining completeness of necessary data.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent dynamically adjusts the displayed information based on the robot's operation state. The control device changes what sensor information is shown on the head-mounted display according to real-time operation conditions, making the information system adaptive rather than static, thus preventing information overload while ensuring necessary information is always available.

Inventive Principle:
Principle #15Dynamics

2Loss of information

If all sensor information is continuously displayed on the transparent display unit, then the operator has access to complete information, but the work efficiency decreases due to unnecessary information display

Engineering Contradiction:
Improveinformation availabilityVSAvoidwork efficiency
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The control device extracts and displays only the sensor information that is currently necessary for the robot's operation. By filtering out unnecessary information while maintaining availability of complete sensor data, the system improves work efficiency without sacrificing information accessibility when needed.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent implements periodic updates of sensor information display based on operation phases. Rather than continuous display of all data, the system periodically refreshes and updates the relevant sensor information on the head-mounted display according to the robot's operational state, reducing visual clutter while maintaining information availability.

Inventive Principle:
Principle #19Periodic action

3Loss of information

If the transparent display unit displays comprehensive sensor information, then the operator can make informed decisions, but the operator's focus on the physical world is reduced

Engineering Contradiction:
Improvedecision-making informationVSAvoidfocus on physical world
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The control device extracts and displays only the critical sensor information needed for decision-making on the transparent display unit. By selecting and showing only essential data rather than comprehensive information, the system enables informed decisions while maintaining the operator's ability to focus on the physical workspace.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies local quality by displaying different types of sensor information in different locations or contexts on the display unit. Critical decision-making information is prominently displayed, while less important data is minimized or placed in secondary positions, allowing the operator to access comprehensive information while maintaining focus on key elements and the physical world.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11358286B2Robot system and method of operating the same
Publication Date: 2022.06.14 KAWASAKI JUKOGYO KK
  • US11358286B2 patent drawing
  • US11358286B2 patent drawing
  • US11358286B2 patent drawing

AI summary

A robot system includes a user interface configured to receive an operational instruction from an operator, a robot installed in a workspace and configured to perform a series of works including a plurality of processes, a sensor installed in the workspace, a transparent type display unit configured so that the operator is visible of a physical real world and configured to display information detected by the sensor as the image screen, and a control device. The control device displays on the transparent type display unit, when the robot is operated by the user interface, first information that is information detected by the sensor, as the image screen.