Machine operation assistance device and machine operation assistance method
The machine operation support device and method enhance the quality and accuracy of operation manuals by using a generation AI device to modify and generate high-quality operation procedure information and programs, addressing the inefficiencies and inaccuracies of traditional methods.
Patent Information
- Application Number
- PCT/JP2024/001103
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-01-17
- Publication Date
- 2025-07-24
AI Technical Summary
Existing work procedure manuals for machine operations are time-consuming to create, prone to omissions, and lack reliability and accuracy, leading to increased operator burden and potential incorrect operations.
A machine operation support device and method that utilizes a generation AI device to modify and generate high-quality operation procedure information and programs by acquiring first procedure information, creating prompts, and outputting corrected second procedure information and programs.
Reduces operator burden and improves the quality of operation manuals by ensuring accurate and complete operation procedures, supporting efficient and correct machine operations.
Smart Images

Figure JP2024001103_24072025_PF_FP_ABST
Abstract
Description
Machine operation support device and machine operation support method
[0001] The present disclosure relates to a machine operation assistance device and a machine operation assistance method, and more particularly to a machine operation assistance device and a machine operation assistance method that output operation procedure information and an operation program for operating a machine.
[0002] Generally, when an operator performs maintenance work (such as tool replacement and inspection) on a machine tool, the operator creates a work procedure manual and performs the work. Patent Document 1 describes an information processing device that reduces the time required for verification of differences between the description in the work procedure manual and the operator's work, compared to when a human verifies the differences between the description in the work procedure manual and the operator's work. Specifically, Patent Document 1 describes functions executed by a processor of the information processing device, including a function for identifying an order that increases the similarity between a first explanatory sentence generated from images representing each process in video image data capturing the operator's work and a second explanatory sentence corresponding to each process described in the work procedure manual, and a function for detecting differences between the description in the work procedure manual and the operator's work based on the identified order.
[0003] JP 2023-128459 A
[0004] It is desirable for work procedures to be written concisely so that workers do not make mistakes and work time can be shortened. Creating work procedures is time-consuming, as workers must check whether the contents of the manual properly describe the operation of the machine, and it is difficult for anyone other than those who are familiar with the specifications and terminology.
[0005] Veterans (also known as skilled workers) and everyday workers often forget to include familiar tasks when creating work procedures because they are familiar with the work. This can lead to omissions in work procedures. It is time-consuming for another worker to check for these omissions. While it is possible to have a generating AI device correct the work procedures, the reliability of the corrections may not be sufficient, and the accuracy of the content cannot be guaranteed. In addition, the workload of verifying the corrected work procedures is significant.
[0006] Therefore, there is a demand for a machine operation support device and a machine operation support method that output high-quality operation procedure information and operation programs with less burden on the operator.
[0007] A first representative aspect of the present disclosure is a machine operation assistance device comprising: a procedure information acquisition unit that acquires first operation procedure information indicating operation procedure information for a machine; a prompt sending unit that creates a prompt and sends it to the generating AI device, requesting the generating AI device to generate second operation procedure information that modifies the first operation procedure information based on the first operation procedure information, and requesting the generating AI device to generate an operation program for operating the machine using the second operation procedure information; an information receiving unit that receives the second operation procedure information and the operation program output by the generating AI device in response to the prompt; and an information output unit that outputs the second operation procedure information and the operation program.
[0008] A second representative aspect of the present disclosure is a machine operation assistance method in which a computer executes the following processes: a process of acquiring first operation procedure information indicating operation procedure information for a machine; a process of requesting a generating AI device to generate second operation procedure information that modifies the first operation procedure information based on the first operation procedure information, and a process of creating and sending a prompt to the generating AI device that requests the generating AI device to generate an operation program for operating the machine using the second operation procedure information; a process of receiving the second operation procedure information and the operation program output by the generating AI device in response to the prompt; and a process of outputting the second operation procedure information and the operation program.
[0009] FIG. 1 is a block diagram showing an example of a configuration of a machine operation system including a machine operation assistance device according to an embodiment of the present disclosure; FIG. 2 is a diagram showing an example of first operation procedure information; FIG. 3 is a diagram showing an example of a prompt; FIG. 4 is a diagram showing an example of information necessary for generating an operation program; FIG. 5 is a diagram showing an example of second operation procedure information and an operation program; FIG. 6 is a flowchart showing an example of the operation of the machine operation assistance device; and FIG. 7 is a diagram showing an example of a prompt including information necessary for generating an operation program.
[0010]
[0023] Hereinafter, an embodiment of the present disclosure will be described in detail with reference to the drawings. Fig. 1 is a block diagram showing an example configuration of a machine operation system including a machine operation assistance device according to an embodiment of the present disclosure. As shown in Fig. 1, the machine operation system 10 includes a machine operation assistance device 100, a generation AI device 200, a display device 300, a machine operation unit 400, and a machine control device 500.
[0011] The following describes the operation of the machine operation system 10. Based on first operation procedure information, in which machine operation procedure information is written in natural language, the machine operation assistance device 100 requests the generation AI device 200 to generate second operation procedure information by modifying the first operation procedure information, and also creates a prompt requesting the generation AI device 200 to generate an operation program for operating the machine using the second operation procedure information, and sends the prompt to the generation AI device 200.
[0012] The generating AI device 200 generates second operation procedure information for the prompt and an operation program corresponding to the second operation procedure, and transmits the second operation procedure information and the operation program to the machine operation assistance device 100.
[0013] The machine operation assistance device 100 outputs the second operation procedure information received from the generation AI device 200 to the display device 300, and outputs the operation program received from the generation AI device 200 to the machine operation unit 400. The target to which the machine operation assistance device 100 outputs the second operation procedure information is not limited to the display device 300, but may also be, for example, a printing device such as a printer, or a storage device that stores the second operation procedure information.
[0014] The display device 300 is a liquid crystal display device or the like, and displays the second operation procedure information output from the machine operation assistance device 100 on the display screen.
[0015] The machine operation unit 400 outputs an operation signal to the machine control device 500 based on the operation program output from the machine operation assistance device 100. The machine controlled by the machine control device 500 is a machine tool, a robot, or the like.
[0016] The following describes the configuration of the machine operation assistance device 100. As shown in Figure 1, the machine operation assistance device 100 includes a procedure information acquisition unit 110, a prompt transmission unit 120, an information reception unit 130, and an information output unit 140.
[0017] The procedure information acquisition unit 110 acquires first operation procedure information input by a user such as an operator using an input device such as a keyboard or a touch panel, and outputs the information to the prompt transmission unit 120. The first operation procedure information is, for example, explanatory text data written in a natural language. The procedure information acquisition unit 110 may acquire the first operation procedure information by converting information other than character information, such as voice information, input by the user into explanatory text data written in a natural language. Figure 2 is a diagram showing an example of the first operation procedure information. The first operation procedure information shown in Figure 2 is information describing a procedure for replacing a jig of a machine tool.
[0018] The prompt sending unit 120 creates a prompt and sends it to the generating AI device 200, requesting the generating AI device 200 to generate second operation procedure information by modifying the first operation procedure information based on the first operation procedure information, and also requesting the generating AI device 200 to generate an operation program for operating the machine tool using the second operation procedure information. Figure 3 is a diagram showing an example of a prompt. The prompt shown in Figure 3 commands the receiving AI device 200 to make corrections to fill in any deficiencies in the first operation procedure information (which will become machine operation procedure information), and at the same time commands the receiving AI device 200 to output an operation program corresponding to the second operation procedure information obtained by modifying the first operation procedure information.
[0019] The generating AI device 200 generates second operation procedure information in response to the prompt and an operation program corresponding to the second operation procedure. The generating AI device 200 has already learned the information necessary to generate the operation program. Figure 4 is a diagram showing an example of the information necessary to generate the operation program. In Figure 4, the information necessary to generate the operation program includes a terminology explanation of the operation accepted by the machine and the format of the operation program.
[0020] The information receiving unit 130 receives the second operation procedure information and the operation program corresponding to the second operation procedure information output by the generating AI device 200, and outputs the second operation procedure information and the operation program to the information output unit 140. Figure 5 is a diagram showing an example of the second operation procedure information and the operation program. The second operation procedure information is information obtained by modifying the machine tool jig replacement procedure of the first operation procedure information. In the second operation procedure information shown in Figure 5, the parts where modifications have been made to the first operation procedure information are shown in bold and underlined.
[0021] The information output unit 140 outputs the second operation procedure information to the display device 300, and outputs the operation program to the machine operation unit 400. The target to which the information output unit 140 transmits the second operation procedure information is not limited to the display device 300, and may be a printing device such as a printer, or a storage device that stores the second operation procedure information, as described above.
[0022] Next, the machine operation assistance method of this embodiment will be described using a flowchart. In the following description, an example will be described in which the machine operation assistance method is executed by the machine operation assistance device 100 shown in Fig. 1. The machine operation assistance method of this embodiment is not limited to the configuration of the machine operation assistance device 100 shown in Fig. 1. For example, the machine operation assistance method of this embodiment may be executed in a configuration in which a device including the procedure information acquisition unit 110 and the prompt transmission unit 120 is separated from a device including the information receiving unit 130 and the information output unit 140.
[0023] 6 is a flowchart showing an example of the operation of the machine operation assistance device. In step S11, the procedure information acquisition unit 110 acquires first operation procedure information input by a user via an input device such as a keyboard or a touch panel, and outputs the information to the prompt transmission unit 120. The first operation procedure information is, for example, explanatory text data written in a natural language.
[0024] In step S12, the prompt sending unit 120 requests the generating AI device 200 to generate second operation procedure information that modifies the first operation procedure information based on the first operation procedure information, and also creates a prompt requesting the generation of an operation program for operating the machine tool using the second operation procedure information and sends it to the generating AI device 200.
[0025] In step S13, the information receiving unit 130 receives the second operation procedure information (the modified first operation procedure information) and the corresponding operation program output by the generating AI device 200 in response to the prompt, and outputs the second operation procedure information and the corresponding operation program to the information output unit 140.
[0026] In step S14 , the information output unit 140 outputs the second operation procedure information to the display device 300 and outputs the operation program to the machine operation unit 400 .
[0027] The machine operation assistance device and machine operation assistance method of this embodiment described above can output second operation procedure information corrected based on first operation procedure information. Therefore, for example, a machine tool or numerical control device manual containing the first operation procedure information and a work procedure manual containing the second operation procedure information can be created so that the terminology and explanations match, thereby improving the quality of the work procedure manual. Furthermore, the machine operation assistance device and machine operation assistance method of this embodiment can detect errors in work procedure manuals containing the second operation procedure information by comparing the second operation procedure information output by the AI generation device with the machine operation in accordance with the second operation procedure information, thereby enabling the user to easily verify the validity of the contents of the work procedure manual. This reduces the workload.
[0028] (Modification) In the machine operation system described using Figure 1, it is assumed that the generation AI device 200 has already learned the information necessary to generate an operation program. The machine operation assistance device 100 of this modification includes the information necessary to generate an operation program in a prompt and transmits the prompt to the generation AI device 200. Figure 7 is a diagram showing an example of a prompt including the information necessary to generate an operation program. The prompt shown in Figure 7 is the prompt shown in Figure 3 with the information necessary to generate an operation program shown in Figure 4 added.
[0029] According to the modified machine operation assistance device described above, the user provides the AI generation device with the information necessary to generate an operation program, making it possible to reflect the user's knowledge in the generation of an operation program by the AI generation device.
[0030] In order to realize the functional blocks included in the machine operation assistance device in each embodiment described above, the machine operation assistance device can be realized by hardware, software, or a combination of these. The machine operation assistance method can also be realized by hardware, software, or a combination of these. Here, "realized by software" means that the method is realized by a computer reading and executing a program.
[0031] To realize the components included in the machine operation assistance device by software or a combination thereof, the machine operation assistance device includes a processing unit such as a CPU (Central Processing Unit). The processing unit functions as an execution unit. The machine operation assistance device also includes an auxiliary storage device such as an HDD (Hard Disk Drive) that stores various control programs such as application software or an OS (Operating System), and a main storage device such as a RAM (Random Access Memory) that stores data temporarily required for the processing unit to execute the programs.
[0032] The machine operation assistance device has an arithmetic processing unit that reads application software or an OS from the auxiliary storage device, and then loads the loaded application software or OS into the main storage device while performing arithmetic processing based on the application software or OS. Furthermore, the machine operation assistance device controls various hardware components based on the results of this calculation. This realizes the functional blocks of this embodiment. The machine operation assistance method can also be realized using a configuration similar to that of the machine operation assistance device.
[0033] The components included in the machine operation assistance device can be realized by hardware including electronic circuits, etc. When the machine operation assistance device is configured by hardware, some or all of the functions of each component included in the machine operation assistance device can be configured by integrated circuits (ICs), such as an ASIC (Application Specific Integrated Circuit), a gate array, an FPGA (Field Programmable Gate Array), or a CPLD (Complex Programmable Logic Device). Although examples have been described above in which the machine operation assistance device is realized by hardware, software, or a combination thereof, the same applies to simulation devices and control devices.
[0034] The program can be stored and supplied to a computer using various types of non-transitory computer-readable media. Non-transitory computer-readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media (e.g., hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, and semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (Random Access Memory)). The program may also be supplied to the computer by various types of transient computer readable media.
[0035] According to the machine operation assistance device and machine operation assistance method disclosed herein, including the embodiments described above, a generating AI device can be used to output high-quality operation procedure information and operation programs with less burden on the worker.
[0036] Although the above-described embodiments are preferred embodiments of the present invention, the scope of the present invention is not limited to the above-described embodiments, and the present invention can be implemented in various modified forms within the scope that does not deviate from the gist of the present invention.
[0037] The following supplementary note is further disclosed regarding the above embodiment. (Supplementary note 1) A machine operation assistance device (100) comprising: a procedure information acquisition unit (110) that acquires first operation procedure information indicating operation procedure information for a machine; a prompt sending unit (120) that requests a generating AI device (200) to generate second operation procedure information by modifying the first operation procedure information based on the first operation procedure information, and that requests the generating AI device (200) to generate an operation program for operating the machine using the second operation procedure information, and that creates and sends the prompt to the generating AI device (200); an information receiving unit (130) that receives the second operation procedure information and the operation program output by the generating AI device (200) in response to the prompt; and an information output unit (140) that outputs the second operation procedure information and the operation program.
[0038] (Supplementary Note 2) The machine operation assistance device according to Supplementary Note 1, wherein the prompt sending unit (120) includes information necessary for generating the operation program in the prompt and sends the prompt to the generation AI device (200).
[0039] (Supplementary Note 3) The machine operation assistance device according to Supplementary Note 1, wherein the information output unit (140) outputs the second operation procedure information to a display device (300) and outputs the operation program to a control device (500) of the machine.
[0040] (Supplementary Note 4) A machine operation assistance method in which a computer executes the following processes: a process of acquiring first operation procedure information indicating machine operation procedure information; a process of requesting a generating AI device (200) to generate second operation procedure information by modifying the first operation procedure information based on the first operation procedure information, and a process of creating and sending a prompt to the generating AI device (200) that requests the generating AI device (200) to generate an operation program for operating the machine using the second operation procedure information; a process of receiving the second operation procedure information and the operation program output by the generating AI device (200) in response to the prompt; and a process of outputting the second operation procedure information and the operation program.
[0041] 10 Machine operation system 100 Machine operation support device 110 Procedure information acquisition unit 120 Prompt transmission unit 130 Information reception unit 140 Information output unit 200 Generating AI device 300 Display device 400 Machine operation unit 500 Machine control device
Claims
1. A machine operation support device comprising: a procedure information acquisition unit that acquires first operation procedure information indicating operation procedure information of a machine; a prompt transmission unit that creates a prompt for requesting generation of second operation procedure information obtained by modifying the first operation procedure information for a generation AI device based on the first operation procedure information, and for requesting generation of an operation program for operating the machine with the second operation procedure information for the generation AI device, and transmits the prompt to the generation AI device; an information reception unit that receives the second operation procedure information and the operation program output by the generation AI device in response to the prompt; and an information output unit that outputs the second operation procedure information and the operation program.
2. The machine operation support device according to claim 1, wherein the prompt transmission unit transmits the prompt including information necessary for generating the operation program to the generation AI device.
3. The machine operation support device according to claim 1, wherein the information output unit outputs the second operation procedure information to a display device and outputs the operation program to a control device of the machine.
4. A machine operation support method in which a computer executes: a process of acquiring first operation procedure information indicating operation procedure information of a machine; a process of creating a prompt for requesting generation of second operation procedure information obtained by modifying the first operation procedure information for a generation AI device based on the first operation procedure information, and for requesting generation of an operation program for operating the machine with the second operation procedure information for the generation AI device, and transmitting the prompt to the generation AI device; a process of receiving the second operation procedure information and the operation program output by the generation AI device in response to the prompt; and a process of outputting the second operation procedure information and the operation program.
Citation Information
Patent Citations
Robot process automation method and device, electronic equipment and storage medium
CN116562807A
Natural language control of a robot
US20230311335A1
Setting code generating device, industrial machine, setting code generating method, and setting code generating program
WO2022009764A1