Robot Control UI Layout for Integrated Camera Operation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing robot systems lack a user-friendly user interface (UI) for operating both an imaging apparatus and a robot apparatus using a single external input device, which complicates operations and reduces safety and efficiency.

Innovation Solution

An external input device is designed with a display area that includes a robot apparatus operation unit, an imaging operation unit, and an image display unit, allowing simultaneous operation and observation of both systems on the same screen, with features like face authentication and synchronized image capture to enhance safety and efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a single external input device includes a monitor for displaying images and operation units for both imaging apparatus and robot apparatus, then integration and space saving are improved, but user interface usability and operational clarity deteriorate

Engineering Contradiction:
Improvedevice integration areaVSAvoiduser interface usability
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

The display area is segmented into distinct functional regions: a first area for displaying images from the imaging apparatus and a second area for displaying operation units to control both the imaging apparatus and robot apparatus. This segmentation allows operators to clearly distinguish between different control functions while using a single integrated device, resolving the contradiction between integration and usability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the display area are assigned different functional qualities: the first area is optimized for image visualization while the second area is optimized for control operations. This local differentiation ensures that each part of the interface serves its specific purpose effectively, maintaining operational clarity despite device integration.

Inventive Principle:
Principle #3Local quality

2Device complexity

If operation units for robot apparatus and imaging apparatus are combined on the same display, then device complexity is reduced, but operational precision and control clarity worsen

Engineering Contradiction:
Improvecontrol device structureVSAvoidcontrol operation precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The display area is divided into a first area for images and a second area for operation units, with further segmentation within the second area to distinguish between robot apparatus controls and imaging apparatus controls. This multi-level segmentation reduces overall device complexity while maintaining precise control capabilities for each subsystem.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The display area acts as an intermediary space that mediates between the operator and both the robot apparatus and imaging apparatus. By providing dedicated display regions for each system's controls and feedback, it enables precise control without requiring separate physical control devices.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If image display unit is positioned between robot operation unit and imaging operation unit, then operational workflow and safety are improved, but response time and efficiency worsen

Engineering Contradiction:
Improveoperational safetyVSAvoidoperation response time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The image display unit is positioned in the middle area of the display area, establishing a predetermined visual workflow pattern where operators naturally progress from robot controls to image feedback to imaging controls. This preliminary arrangement of visual elements creates an intuitive operational sequence that enhances safety without significantly impacting response time.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12479106B2External input device, robot system, control method of robot system, control program, and recording medium
Publication Date: 2025.11.25 CANON KK
  • US12479106B2 patent drawing
  • US12479106B2 patent drawing
  • US12479106B2 patent drawing

AI summary

An external input device is employed, the external input device being configured to operate a robot system including an imaging apparatus capable of changing an imaging point of view and a robot apparatus, the external input device includes a display area, a robot apparatus operation unit configured to operate the robot apparatus, an imaging operation unit configured to operate the imaging apparatus, and an image display unit configured to display an image captured by the imaging apparatus, wherein the robot apparatus operation unit, the imaging operation unit, and the image display unit are displayed on the display area, and wherein the image display unit is disposed between the robot apparatus operation unit and the imaging operation unit.