Robotic Simulation Display Layout for Collision Warning Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current simulators used for robotic systems in virtual environments face challenges in visually recognizing and intuitively judging interference and collision events, especially during animated displays, which can lead to inefficiencies in verification processes due to cumbersome GUIs and difficulties in identifying instant interference or shadow points.

Innovation Solution

An information processing apparatus and method that includes a display controller to output display information for a robotic system's operation in a virtual environment, featuring an operation display area and an information display area showing operation parameters in a time-series manner, with an analysis unit that specifies warning events and displays them accordingly, allowing for intuitive recognition of interference and collision occurrences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the display color of the 3D model is changed to indicate interference, then the interference state can be confirmed in stationary conditions, but it becomes difficult to visually recognize interference in animated moving images

Engineering Contradiction:
Improveinterference detection accuracyVSAvoidvisual recognition ease
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The display is segmented into multiple regions: a first display region showing the 3D model animation and a second display region showing operation parameters in a graph format. This segmentation allows the interference information to be displayed in a dedicated area without obstructing the visual animation, enabling simultaneous viewing of both the animated model and the parameter changes that indicate interference.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The interference information is displayed by adding a temporal dimension through time-series graphs of operation parameters. Instead of relying solely on color changes in the 3D model during animation, the system plots parameters like joint angles and positions over time, allowing users to detect interference events as distinct patterns in the temporal data while the animation continues to play.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Duration of action of moving object

If animation display is used to show robotic system operation, then continuous operation can be visualized, but it becomes difficult to identify instant interference or shadow points

Engineering Contradiction:
Improveoperation visualization continuityVSAvoidinterference event detection difficulty
Core Design Contradiction:
Duration of action of moving objectVSDifficulty of detecting and measuring

Solution Approach 1:

The system provides feedback by displaying operation parameters in real-time during animation playback. When interference occurs, the parameter graphs show characteristic patterns (such as sudden angle changes or position deviations) that provide immediate feedback about the interference event, allowing users to detect issues while watching the continuous animation without pausing or rewinding.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If frames are fed back and forth to confirm interference timing, then accurate timing can be identified, but verification time increases significantly

Engineering Contradiction:
Improveinterference timing precisionVSAvoidverification time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The operation parameters are pre-calculated and displayed as time-series data during the animation playback. This preliminary preparation of the data allows users to directly observe interference timing from the graphs without needing to manually step through frames, as the temporal information is already organized and visible in the second display region throughout the animation.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20230267690A1Information processing apparatus and control method of display apparatus
Publication Date: 2023.08.24 CANON KK
  • US20230267690A1 patent drawing
  • US20230267690A1 patent drawing
  • US20230267690A1 patent drawing

AI summary

An information processing apparatus includes a display controller configured to output display information to be displayed on a display apparatus, and an analysis unit. The display apparatus includes an operation display area displaying an operation of a robotic system based on robot control data and an information display area displaying information related to an operation parameter of the robotic system in a time-series manner based on the robot control data. The analysis unit is configured to analyze the operation parameter to specify a warning event. The display controller displays the warning event specified by the analysis unit in the operation display area and the information display area in association with each other.