Device, method and program for creating layout diagram

Abstract

To create a layout diagram more easily than before in a method for creating a layout diagram for an FA.SOLUTION: A device receives apparatus information from a user terminal (S201). Next, the device receives, from a user terminal, a designation relating to a layout diagram (S202). The designation can be described in a natural language, and includes apparatus names of multiple apparatuses, and the placement or function of each apparatus. Subsequently, the device determines multiple elements included in the designation, and requests a generative AI to generate layout diagram data that represents a layout diagram having an identifier of each element arranged in one or a plurality of cells (S203). The generative AI then generates the layout diagram data (S204), and transmits the data to the device (S205). The device generates layout diagram display information based on the generated layout diagram data (S206), and transmits the information to the user terminal (S207).SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an apparatus, a method, and a program for creating a layout diagram. [Background technology]

[0002] Factory automation (FA), a technology that automates the manufacturing process of products, is achieved by combining a variety of equipment. When determining the appropriate placement of equipment, a layout diagram is often created, taking into consideration factors such as safety, efficiency, and scalability of the factory. Summary of the Invention [Problem to be solved by the invention]

[0003] However, currently, even if existing tools are used, layout diagrams must be created manually, which is a significant burden. In addition, layout diagrams must ultimately be visually conveyed in a way that is appropriate for the reader, so it takes a significant amount of time to become proficient with the tools. As such, creating layout diagrams requires not only technical knowledge but also excellent diagramming skills, so there are only a limited number of people who can create them.

[0004] The present invention has been made in view of the above points, and its purpose is to provide an apparatus, method, or program for creating a layout diagram for FA that enables the creation of a layout diagram more easily than conventional methods.

[0005] In this specification, the term "layout diagram" refers to a diagram that visually represents the arrangement of multiple devices. [Means for solving the problem]

[0006] In order to achieve this object, a first aspect of the present invention is a method for creating a layout drawing for FA, comprising the steps of: acquiring specifications regarding the layout drawing; determining multiple elements included in the specifications and requesting a generative AI model to generate layout drawing data in which identifiers of each element are placed in one or more cells on an m (m is an integer of 2 or more) x n (m is an integer of 2 or more) grid; and creating layout drawing display information for displaying the layout drawing based on the generated layout drawing data.

[0007] A second aspect of the present invention is the method of the first aspect, wherein the designation includes element names of the plurality of elements and the location or function of each element.

[0008] A third aspect of the present invention is the method of the first aspect, wherein said designation further includes the number of at least any of said plurality of elements.

[0009] A fourth aspect of the present invention is the method of any one of the first to third aspects, wherein the request includes an explanation of each of a plurality of elements that may be included in the specification.

[0010] A fifth aspect of the present invention is the method of any one of the first to fourth aspects, wherein the request includes dimensions of each of a plurality of elements that may be included in the specification.

[0011] A sixth aspect of the present invention is the method according to any one of the first to fifth aspects, wherein the request includes a specification or a part thereof and an example of layout drawing data to be generated based on the specification.

[0012] Furthermore, a seventh aspect of the present invention is a method according to any one of the first to sixth aspects, wherein the generative AI model is an LLM to which a Transformer architecture is applied.

[0013] An eighth aspect of the present invention is the method according to any one of the first to seventh aspects, further comprising the step of transmitting the layout plan display information to a user terminal.

[0014] A ninth aspect of the present invention is the method according to the eighth aspect, wherein said layout drawing display information includes a rotation angle of each element included in the layout drawing data.

[0015] A tenth aspect of the present invention is the method according to the eighth aspect, wherein the layout diagram display information is information for displaying an image file of the layout diagram.

[0016] An eleventh aspect of the present invention is a program for causing a computer to execute a method for creating a layout drawing for FA, the method comprising the steps of: acquiring a designation related to the layout drawing; determining a plurality of elements included in the designation and requesting a generation AI model to generate layout drawing data in which identifiers of each element are arranged in one or more cells on an m (m is an integer of 2 or more) × n (m is an integer of 2 or more) grid; and creating layout drawing display information for displaying the layout drawing based on the generated layout drawing data. Includes:

[0017] In addition, a twelfth aspect of the present invention is an apparatus for creating a layout drawing for FA, which is configured to obtain specifications regarding the layout drawing, determine multiple elements included in the specifications, request a generation AI model to generate layout drawing data in which identifiers of each element are placed in one or multiple cells on an m (m is an integer of 2 or more) x n (m is an integer of 2 or more) grid, and create layout drawing display information for displaying the layout drawing based on the generated layout drawing data. [Effects of the Invention]

[0018] According to one aspect of the present invention, by providing a designation regarding a layout diagram, it is possible to create layout diagram display information that can visually depict a combination of devices including the relative positions of a plurality of devices in an easily understandable manner. [Brief explanation of the drawings]

[0019] [Figure 1] 1 is a diagram illustrating a system according to one embodiment of the present invention. [Figure 2] FIG. 1 is a diagram illustrating a method flow according to one embodiment of the present invention. [Figure 3A] 1 is an example of a code portion for a request to a generative AI model according to one embodiment of the present invention. [Figure 3B] 10 is an example of a layout drawing creation rule included in code for a request to a generative AI model according to one embodiment of the present invention. [Figure 3C] FIG. 10 is an example of a layout diagram created in code for a request to a generative AI model according to one embodiment of the present invention. [Figure 4] 10 is a flowchart showing a flow of generating layout chart display information according to an embodiment of the present invention. [Figure 5A] 10 is a diagram illustrating an example of a portion of layout drawing display information according to an embodiment of the present invention. [Figure 5B] This is the second half of the example in Figure 5A. [Figure 6] FIG. 1 is an example of a layout diagram according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0020] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0021] 1 shows a system according to a first embodiment of the present invention. In order to create a layout drawing for FA, an apparatus 100 communicates with a user terminal 110 used by a user and a platform 120 that provides a generative AI model via an IP network such as the Internet. While the AI model will be described as being provided by the platform 120 that can communicate with the apparatus 100 as an example, it is also possible to run an application for providing the AI model on the apparatus 100 so that the AI model is provided by the apparatus 100.

[0022] The device 100 includes a communication unit 101 such as a communication interface, a processing unit 102 such as a processor or CPU, and a storage unit 103 including a storage device or storage medium such as a memory or hard disk. The device 100 may be configured by executing a program for each process or operation in the processing unit 102. The device 100 may include one or more devices, computers, or servers. The program may include one or more programs, and may be recorded on a computer-readable storage medium to form a non-transitory program product. The program may be stored in the storage unit 103 or in a storage device or storage medium 104 accessible from the device 100 via an IP network, and instructions included in the program may be executed by at least one processor of the processing unit 102. Data described below as being stored in the storage unit 103 may also be stored in the storage device or storage medium 104, and vice versa. For convenience, the storage device or storage medium 104 is depicted in FIG. 1 as a database.

[0023] First, the apparatus 100 receives device information from the user terminal 110 (S201). The device information includes dimensions, device type, and device description for each device. For example, device registration screen display information for displaying a device registration screen on the user terminal 110 can be sent as an HTML file, and the device registration screen can be displayed on the display screen of the user terminal 110. When a user registers a collaborative robot, the user can select "collaborative robot" from a pull-down menu on the device registration screen, enter "2 x 2" as the dimensions, select "ROBOT" as the device type from the pull-down menu, and enter a device description as free text. The device registration screen may also allow the user to enter a device name as free text. The user can also upload an image from the device registration screen.

[0024] Upon receiving the device information, the device 100 associates it with a device identifier such as a device name or device number, and stores it as a device definition in the storage unit 103. The device 100 can also store the received image and store its image identifier, such as its file name or URL, in the storage unit 103, associating it with the device identifier. In the above description, the dimensions, device type, and device description are described as being input or selected by the user, but at least one of them may be set as a default value, eliminating the need for user specification. The dimensions, device type, and device description are not necessarily required. The image identifier may also be set as a default value, eliminating the need for the user to upload an image. The use of the dimensions, device type, device description, and image identifier will be described later.

[0025] An example of a device definition stored in device 100 is as follows: The image identifier or the image identifier and the device type may be stored in the same table as this information, or, for example, the image definition including the device identifier and the image identifier may be stored in a separate table. In this case, the image definition may further include at least one of dimensions and device type.

[0026] Collaborative robot = 1, Dimensions: 2 x 2, A robot designed to work in collaboration with humans Vertical articulated robot = 2, Dimensions: 2 x 2, Robot good at three-dimensional movement Horizontal articulated robot = 3, Dimensions: 2 x 2, Robot good at two-dimensional movements Parallel link robot = 4, Dimensions: 2 x 2, Robot good at high speed and precise movement Dual-arm robot = 5, Dimensions: 2 x 2, Robot that can perform tasks with both arms Cartesian coordinate robot = 6, Dimensions: 2 x 2, Robot that performs work using a Cartesian coordinate system Belt conveyor = 7, Dimensions: 1 x 1, A machine that rotates a belt to transport objects Control panel = 8, Dimensions: 1 x 1, Panel for operating the machine (omitted) Safety fence = 15, Dimensions: 1 x 1, Safety fence Vision sensor = 16, Dimensions: 1 x 1, Image processing sensor

[0027] In addition to devices, objects to be operated by a robot can also be registered, and when registering objects that cannot be classified as devices, they are more generally called "components," and element definitions are stored in the device 100. In the above explanation, an example was given in which device information was transmitted from the user terminal 110, but it is sufficient that the device 100 is capable of storing and acquiring element definitions or element definitions and image definitions in some manner.

[0028] Examples of element types include the following: It is also possible that one device may be assigned multiple types.

[0029] NONE: No classification PATHWAY: Objects that are placed along a path ROBOT: Things that require consideration of the direction of the hand, like a robot TARGET: The object that the robot operates

[0030] Next, the device 100 receives a specification for the layout drawing from the user terminal 110 (S202). The specification can be written in natural language and includes the names of multiple pieces of equipment and the location or function of each piece of equipment. One example is, "Boxes will be delivered on a conveyor belt, and picked up by a palletizing robot. Two robots will be installed." In this example, the device names are "conveyor belt" and "palletizing robot," the conveyor belt has the function of transporting boxes, the palletizing robot has the function of picking boxes, and the two palletizing robots are specified to be positioned apart. The number of palletizing robots is also specified to be two. Thus, the specification received by the device 100 may include the number of pieces of equipment. The specification may also include a grid size m (m is an integer equal to or greater than 2) x n (n is an integer equal to or greater than 2) of the layout drawing to be created, such as "10 x 10." However, the specification may be determined by the device 100, or an appropriate grid size may be determined by the generative AI model based on the specification for the layout drawing.

[0031] Next, the device 100 determines the multiple elements included in the specification and requests the generative AI model to generate layout chart data representing a layout chart in which the identifiers of each element are placed in one or more cells on an m x n grid (S203). Since the output of the generative AI model is not necessarily the same each time, the request may include determining layout chart data based on multiple output results. Alternatively, the request may be made to the generative AI model multiple times, and the device 100 may determine layout chart data based on multiple responses to those requests. Alternatively, multiple layout chart data may be used to draw multiple layout charts in the layout chart display information described below. This allows the user to ultimately select a preferred layout chart.

[0032] FIG. 3A shows an example of a portion of code for making a request to a generative AI model according to the first embodiment of the present invention. The example in FIG. 3A is a portion of code written in the programming language Python, and executing this code allows a generative AI model provided on the platform 120 to generate layout drawing data. Here, the variable "model" represents the type of generative AI model to be used, and the variable "temperature" represents the diversity of output. The OpenAI API is an example, and other APIs may be used. Furthermore, the programming language Python is an example, and other languages may be used. The code for making this request is stored in the storage unit 103, and the device 100 acquires this code and executes the code obtained by setting values to variables included in the code.

[0033] FIG. 3B shows an example of the variable “grid_rules,” and FIG. 3C shows an example of the variable “examples.” The variable “description” can be set to a specification received from the user terminal 110 or at least a portion thereof. The variable “component definitions” in the prompt set to the variable “grid_rules” shown in FIG. 3B is set to at least a portion of the element definitions stored in the device 100. If the variable “component definitions” contains element descriptions for multiple elements that may be included in the specification received by the device 100, the generative AI model is more likely to be able to determine the appropriate element and assign its identifier, even if the element name of the element actually included in the specification does not match the element name included in the element definition. The prompt shown in FIG. 3C shows a description of the layout diagram and example layout diagram data representing a 5 x 5 layout diagram based on the description.

[0034] The value of the variable "grid_rules" specifies the conditions imposed on the generative AI model, and other variables may be set to impose other conditions. For example, the priorities of the determined elements may be further determined, and the elements with the highest priorities may be placed first.

[0035] Then, the generative AI model that receives the request from the device 100 generates layout drawing data (S204) and sends it to the device 100 (S205). An example of layout drawing data generated when the device 100 receives the following layout drawing specification using the codes in FIGS. 3A to 3C: "Boxes will be delivered on a belt conveyor and picked up by a palletizing robot. Two robots will be placed." and a grid size of 10 x 10. A belt conveyor represented by element identifier "7" is installed in a straight line, and two collaborative robots represented by element identifier "1" are placed along the belt conveyor.

[0036] ``` 0,0,0,0,0,0,0,0,0,0 0,0,1,1,0,0,1,1,0,0 0,0,1,1,0,0,1,1,0,0 7,7,7,7,7,7,7,7,7,7 0,0,0,0,0,0,0,0,0,0 0,0,0,0,0,0,0,0,0,0 0,0,0,0,0,0,0,0,0,0 0,0,0,0,0,0,0,0,0,0 0,0,0,0,0,0,0,0,0,0 0,0,0,0,0,0,0,0,0,0 ```

[0037] As used herein, the term "AI model" refers to a machine learning model trained to predict output for input, and the term "generative AI model" refers to a large-scale language model (LLM) trained using text data to generate output for input. While LLMs incorporating the Transformer architecture are particularly preferred as generative AI models, the name of the architecture is expected to change as technology advances. Therefore, the term "Transformer architecture" as used herein encompasses architectures that incorporate one or more features of the Transformer architecture or improvements thereof. While the example in Figure 3 illustrates a single API call to fulfill a desired request, it is also possible to split the request into multiple requests and implement them through multiple API calls. In this case, the multiple API calls may be directed to the same or different generative AI models. As used herein, whether "generative AI models" are identical is determined by whether the types of generative AI models specified by the user are identical. In the example in Figure 3, if the values of the variable "model" are the same, they are considered to be the same generative AI models. If multiple generative AI models are not identical, they may be provided on the same platform 120.

[0038] The device 100 generates layout drawing display information for displaying the layout drawing based on the generated layout drawing data (S206) and transmits it to the user terminal 110 (S207). The layout drawing display information can be data in JSON format or SVG format, for example, and can be read by the web browser of the user terminal 110 to display a viewing screen on the display screen of the user terminal 110.

[0039] To generate layout chart display information, the device 100 may, as necessary, determine the element type of each of multiple elements included in the layout chart data based on the element identifier (S401) and, for each element, determine a rotation angle determined according to the determined element type (S402). For example, a belt conveyor may be assigned the element type "PATHWAY" and rotated so that images of adjacent belt conveyors are connected along the conveyance direction. Alternatively, a collaborative robot may be assigned the element type "ROBOT" and a belt conveyor may be assigned the element type "TARGET," and the image of the collaborative robot may be rotated so that its front faces the belt conveyor. Alternatively, a collaborative robot may be assigned the element type "ROBOT" and its front faces the direction of the nearest different element. By performing rotations according to element type in this way, the layout chart can be visually represented in a more easily understandable manner. Those skilled in the art can cause the device 100 to determine the rotation angle using, for example, the programming language Python.

[0040] The device 100 then creates layout chart display information capable of drawing a layout chart corresponding to at least one of the relative positions of multiple elements included in the layout chart data and the dimensions and rotation angles of each element (S403). FIG. 5 shows an example of a portion of the layout chart display information according to the first embodiment of the present invention. The example in FIG. 5 describes the positions and rotation angles of multiple elements in JSON format, and a web browser running on the user terminal 110 can visually draw the layout chart using this data. FIG. 5A describes the positions and rotation angles of two collaborative robots, with the upper left corner of the layout chart data described above set to (x, y) = (0, 0). FIG. 5B then describes the positions and rotation angles of two belt conveyors. Eight more belt conveyors are also described, but are omitted due to paper width limitations.

[0041] Figure 6 is an example of a layout diagram displayed on the user terminal 110. In accordance with the layout diagram display information shown in Figure 5, the registered images of the two collaborative robots have been rotated 180 degrees so that their fronts face the direction of the belt conveyor, and the belt conveyor has been rotated 90 degrees so that they are connected along the conveyance direction. In addition, in accordance with the layout diagram display information shown in Figure 5, the two collaborative robots are displayed with dimensions that occupy four cells.

[0042] Thus, according to one embodiment of the present invention, by providing specifications regarding the layout diagram to device 100, it is possible to create layout diagram display information that can visually depict a combination of multiple devices, including the relative positions of the devices, in an easily understandable manner.

[0043] In the above embodiments, it should be noted that unless the word "only" is used, such as "based only on," "depending only on," or "only when," the specification assumes that additional information may be taken into consideration. Also, as an example, it should be noted that the phrase "do b when a" does not necessarily mean "do b always when a" or "do b immediately after a" unless explicitly stated otherwise. Furthermore, the phrase "each a constituting A" does not necessarily mean that A is composed of multiple components, but includes the case where the component is singular.

[0044] Also, just to be clear, even if there is an aspect of a method, program, terminal, device, server, or system (hereinafter referred to as a "method, etc.") that performs an operation different from that described in this specification, each aspect of the present invention is directed to an operation that is identical to one of the operations described in this specification, and the existence of an operation different from that described in this specification does not make the method, etc. outside the scope of each aspect of the present invention.

[0045] In the above example, layout diagram display information is sent to the user terminal 110, and the layout diagram is drawn on the user terminal 110. However, the device 100 may store a layout diagram corresponding to the relative positions of multiple elements included in the layout diagram data and at least one of the dimensions and rotation angle of each element as an image file, and may create layout diagram display information as information for displaying the image file and send it to the user terminal 110.

[0046] The device 100 may also verify the layout diagram data or the layout diagram displayed by the layout diagram display information. The device 100 verifies whether the layout diagram data or the layout diagram satisfies a predetermined condition, and if it does not, it can request the generation AI model to generate layout diagram data again. [Explanation of symbols]

[0047] 100 devices 101 Communications Department 102 Processing section 103 Storage section 104 Database 110 User Terminals 120 Platform

Claims

1. A method for creating a layout drawing for an FA, comprising: obtaining specifications regarding the layout drawing; a step of determining a plurality of elements included in the specification and requesting a generative AI model to generate layout drawing data in which identifiers of each element are arranged in one or more cells on an m (m is an integer of 2 or more) x n (m is an integer of 2 or more) grid; creating layout drawing display information for displaying the layout drawing based on the generated layout drawing data; Includes:

2. 10. The method of claim 1, The designation includes the element names of the multiple elements and the location or function of each element.

3. 10. The method of claim 1, The specification further includes the number of at least any of the plurality of elements.

4. 4. A method according to any one of claims 1 to 3, comprising: The request includes a description of each of a number of elements that may be included in the specification.

5. 5. A method according to any one of claims 1 to 4, comprising: The request includes dimensions for each of multiple elements that may be included in the specification.

6. 6. A method according to any one of claims 1 to 5, comprising: The request includes a specification or a part thereof and an example of layout drawing data to be generated based on the specification.

7. 7. A method according to any one of claims 1 to 6, comprising: The generative AI model is an LLM that applies the Transformer architecture.

8. 8. A method according to any one of claims 1 to 7, comprising: The method further includes transmitting the layout drawing display information to a user terminal.

9. 9. The method of claim 8, The layout drawing display information includes the rotation angle of each element included in the layout drawing data.

10. 9. The method of claim 8, The layout chart display information is information for displaying an image file of the layout chart.

11. A program for causing a computer to execute a method for creating a layout drawing for FA, the method comprising: obtaining specifications regarding the layout drawing; a step of determining a plurality of elements included in the specification and requesting a generative AI model to generate layout drawing data in which identifiers of each element are arranged in one or more cells on an m (m is an integer of 2 or more) x n (m is an integer of 2 or more) grid; creating layout drawing display information for displaying the layout drawing based on the generated layout drawing data; Includes:

12. An apparatus for creating a layout drawing for FA, Obtaining specifications regarding the layout drawing; Identifying a plurality of elements included in the specification and requesting the generation AI model to generate layout drawing data in which the identifiers of each element are arranged in one or more cells on an m (m is an integer of 2 or more) x n (m is an integer of 2 or more) grid; Based on the generated layout chart data, layout chart display information for displaying the layout chart is created.

Images