Robot Program Generation with Visual-to-Text Editing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing visual programming methods for robot operation programs make it difficult to transition to text programming, as users struggle to understand how generated visual programs correspond to text programming, hindering skill improvement and limiting the range of robot operations.

Innovation Solution

A program generation device and medium that display an input screen with operation block and text areas, allowing users to perform visual programming, convert it to text format, and edit the text program for enhanced readability and understanding, enabling side-by-side comparison of visual and text programs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If visual programming is used to generate robot operation programs, then ease of operation is improved, but understanding of text programming deteriorates

Engineering Contradiction:
Improveease of program generationVSAvoidunderstanding of text programming correspondence
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent merges visual programming and text programming interfaces into a single integrated environment. The program generation device displays both visual operation blocks and their corresponding text code simultaneously, allowing users to drag and drop visual blocks while viewing the generated text programming in real-time. This combination enables users to benefit from the ease of visual programming while simultaneously understanding the underlying text programming structure.

Inventive Principle:
Principle #5Merging (Combining)

2Ease of operation

If visual programming interface is used, then ease of operation is improved, but adaptability to text programming deteriorates

Engineering Contradiction:
Improveease of visual programmingVSAvoidability to shift to text programming
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent introduces an intermediary function that translates visual operation blocks into text programming code in real-time. This intermediary translation layer allows users to work with the intuitive visual programming interface while automatically generating and displaying the corresponding text code. Users can gradually transition from visual to text programming by observing the generated code and eventually editing it directly, thus improving adaptability without sacrificing ease of operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If only visual programming is provided, then ease of operation is improved, but device complexity increases due to lack of integration

Engineering Contradiction:
Improvesimplicity of interfaceVSAvoidprogram generation system integration
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent implements a universal program generation device that performs multiple functions: visual block dragging, automatic text code generation, real-time code display, and code editing. This multi-functional system consolidates what would otherwise require separate tools into a single integrated platform, maintaining interface simplicity while reducing overall system complexity through functional consolidation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP4187336A1Program generation device and non-transitory computer-readable storage medium storing program
Publication Date: 2023.05.31 SEIKO EPSON CORP
  • EP4187336A1 patent drawingFigure 1
  • EP4187336A1 patent drawingFigure 2
  • EP4187336A1 patent drawingFigure 3

AI summary

A program generation device generating an operation program causing a robot to execute a task is provided. The program generation device includes: a display control unit displaying an input screen including an operation block display area where an operation block relating to an operation of the robot is displayed, an operation block arrangement area where the operation block selected from the operation block display area is arranged to generate the operation program, and a text display area where the operation program is displayed in a text format; and a text editing unit editing the operation program in the text format and displaying the edited operation program in the text display area.