Transparent Robot Display for Context-Aware Sensor Viewing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing robot systems display both image information and peripheral information simultaneously, which can be unnecessary and burdensome for operators, reducing work efficiency.

Innovation Solution

A robot system with a transparent type display unit that displays sensor information only when the robot is operated by a user interface, allowing the operator to view the physical real world without unnecessary information display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If image information and peripheral information are always displayed on the transparent type display unit, then the operator can constantly monitor the environment and robot status, but the operator's burden increases and work efficiency decreases due to unnecessary information display

Engineering Contradiction:
Improvemonitoring capabilityVSAvoidwork efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The display unit dynamically adjusts its content based on the robot's operational state. When the robot is operating autonomously, the display shows autonomous operation information. When the robot requires manual operation, the display switches to show manual operation information. This dynamic adaptation resolves the contradiction by making the monitoring capability context-dependent, showing only relevant information for the current operational mode, thus maintaining reliability while improving work efficiency.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The display unit provides different types of information in different operational contexts. Instead of uniformly displaying all information all the time, the system tailors the displayed content to the specific operational needs - showing autonomous operation status during automated modes and manual operation status during manual modes. This local quality approach ensures that the operator receives appropriate information for each situation, reducing cognitive burden while maintaining necessary monitoring capability.

Inventive Principle:
Principle #3Local quality

2Loss of information

If image information from the camera is always displayed, then the operator can monitor the robot's view, but the display becomes cluttered and annoying when the information is not needed

Engineering Contradiction:
Improveinformation availabilityVSAvoidoperator comfort
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The display unit periodically switches between different information modes based on the robot's operational state. During autonomous operation, it displays autonomous operation information; during manual operation, it displays manual operation information including camera feeds. This periodic switching ensures that information is available when needed (maintaining information availability) while avoiding clutter during periods when certain information types are not relevant (improving operator comfort).

Inventive Principle:
Principle #19Periodic action

Data Source

PatentEP3610996B1Robot system and method for operating same
Publication Date: 2025.12.10 KAWASAKI JUKOGYO KK
  • EP3610996B1 patent drawingFigure 1
  • EP3610996B1 patent drawingFigure 2
  • EP3610996B1 patent drawingFigure 3

AI summary

A robot system includes a user interface (2) configured to receive an operational instruction from an operator, a robot (1) installed in a workspace and configured to perform a series of works comprised of a plurality of processes, a sensor (3) installed in the workspace, a transparent type display unit (6) configured so that the operator is visible of a physical real world and configured to display information detected by the sensor (3) as the image screen, and a control device (4). The control device (4) displays on the transparent type display unit (6), when the robot (1) is operated by the user interface (2), first information that is information detected by the sensor (3), as the image screen.