How it is performed by a computing system

Abstract

To make information about RPA scenarios easily understandable to users. [Solution] When a user provides a check / comment instruction (natural language output instruction) for a scenario Sm (automation scenario) (step S201), the improved scenario Smr output from the LLM12 in response to the check / comment instruction is displayed on the improved scenario display unit 85, and text (natural language output) indicating the improvements of the improved scenario Smr is displayed on the improvement point explanation display unit 84. Therefore, the user can easily understand information about the RPA scenario Sm by checking the displayed text (natural language output).

Description

Technical Field

[0001] This invention relates to RPA (Robotic Process Automation) technology that reduces the burden on users by automating the tasks that users have been performing using a computer.

Background Art

[0002] RPA can be used to automate the tasks performed by users by operating applications and the like that operate on a computer. This RPA automates tasks by executing a scenario that shows the execution procedure of computer processing. As shown in Patent Document 1, this scenario is created by combining a plurality of activities each showing the processing to be executed by the computer. Therefore, even a user without programming knowledge can create a scenario by arranging the activities according to the execution order and setting values such as numbers and paths in the activities as necessary.

[0003] Particularly in Patent Document 1, a technique for assisting users in creating scenarios has been proposed. Specifically, options corresponding to typical tasks for which users desire automation are provided. When an option is selected by the user, a GUI that guides the procedure for creating a scenario for executing the task corresponding to the selected option is displayed. Therefore, the user can create a scenario according to this guidance.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] Incidentally, for purposes such as refactoring program source code, readability is generally required for source code. Similarly, readability is also required for RPA scenarios. In particular, users who handle RPA are less familiar with programming than users who handle source code. Therefore, higher readability is required for RPA scenarios. In contrast, when creating scenarios using the technology of Patent Document 1, it is possible to display information that ensures readability. However, scenarios that have been further modified after creation, such as by adding, deleting, or editing activities, may deviate from the information attached at the time of scenario creation.

[0006] This invention was made in view of the above-mentioned problems, and aims to make information regarding RPA scenarios easily understandable to users. [Means for solving the problem]

[0007] The method according to the present invention is a method executed by a computing system, which accepts the selection of an automation scenario for automating a target task, accepts instructions for natural language output for the selected automation scenario, acquires the natural language output to be output for the automation scenario, and displays a scenario output result consisting of the acquired natural language output and an activity GUI that indicates the output scenario corresponding to the content of the natural language output.

[0008] In this configuration, the present invention receives instructions from the user for natural language output regarding an automation scenario, and displays the natural language output to the user in accordance with the output scenario corresponding to the content of the natural language output. Therefore, the user can easily understand information about the RPA scenario by checking the displayed natural language output. [Effects of the Invention]

[0009] As described above, according to the present invention, users can easily understand information regarding RPA scenarios. [Brief explanation of the drawing]

[0010] [Figure 1] A block diagram showing an example of a scenario management system equipped with a scenario management device according to the present invention. [Figure 2] A schematic block diagram illustrating an example of the functions configured in conjunction with the execution of the scenario management program by the calculation unit. [Figure 3] A flowchart illustrating the scenario creation assistance performed by the calculation unit according to the scenario management program. [Figure 4A] Figure 3 schematically shows the screen displayed on the display using the scenario creation assistance. [Figure 4B] Figure 3 schematically shows the screen displayed on the display using the scenario creation assistance. [Figure 4C] Figure 3 schematically shows the screen displayed on the display using the scenario creation assistance. [Figure 5] A schematic diagram illustrating an example of a system prompt. [Figure 6] A flowchart showing the natural language output executed by the arithmetic unit according to the scenario management program. [Figure 7A] Figure 6 schematically shows the screen displayed on the display based on the natural language output. [Figure 7B] Figure 6 schematically shows the screen displayed on the display based on the natural language output. [Figure 7C] Figure 6 schematically shows the screen displayed on the display based on the natural language output. [Figure 8A] Figure 6 schematically shows the screen displayed on the display based on the natural language output. [Figure 8B] Figure 6 schematically shows the screen displayed on the display based on the natural language output. [Modes for carrying out the invention]

[0011] Figure 1 is a block diagram showing an example of a scenario management system equipped with a scenario management device according to the present invention. This scenario management system 1 comprises a server 11 and a terminal device 2 that functions as a client of the server 11. The server 11 is a computer and is equipped with a storage unit 111 consisting of an HDD (Hard Disk Drive) or SSD (Solid State Drive), and the storage unit 111 stores an LLM (Large Language Model) 12 and a search unit 13. The LLM 12 is a machine learning model that has been pre-trained in natural language, and has also been pre-trained in general-purpose programming languages ​​such as C# in addition to natural language. A specific example of the LLM 12 is ChatGPT (Generative Pretrained Transformer) (chatgpt is a registered trademark). The search unit 13 is a machine learning model that has been pre-trained in activities that can be used to perform tasks indicated by natural language.

[0012] Terminal device 2 is a computer for managing scenarios used in RPA. This terminal device 2 comprises a processing unit 21, a storage unit 22, a UI (User Interface) 24, a communication unit 25, and a bus 26. The storage unit 22 consists of a memory unit 221 and a storage unit 222. Signal transmission and reception between the processing unit 21, the memory unit 221, the storage unit 222, the UI 24, and the communication unit 25 are performed via the bus 26.

[0013] The arithmetic unit 21 is a processor such as a CPU (Central Processing Unit) and controls the memory unit 221, storage unit 222, UI 24, and communication unit 25. The memory unit 221 has main memory and cache memory, and volatilently stores data based on instructions from the arithmetic unit 21, and the arithmetic unit 21 performs calculations using the data read from the memory unit 221.

[0014] The storage unit 222 has an HDD, an SSD, etc., and stores data non-volatilely. The UI 24 has input devices such as a keyboard 241, a mouse 242, and a microphone 243, and output devices such as a display 244. Therefore, the user can execute an input operation on the terminal device 2 by operating the keyboard 241, the mouse 242, or the microphone 243, and can check various data stored in the memory unit 221 and the storage unit 222 by checking the display on the display 244. Note that the input device and the output device do not have to be configured separately, and these may be integrally configured by a touch panel display. Also, the communication unit 25 executes communication with the server 11. This communication unit 25 transmits input information Ii corresponding to an input operation from the user received by the UI 24 to the server 11, and receives output information Io, which is a response from the LLM 12 or the search unit 13 to this input information Ii, from the server 11.

[0015] Also, a scenario management program G is stored in the storage unit 222. This scenario management program G is downloaded from, for example, an external server via the communication unit 25 and stored in the storage unit 222. However, the mode of providing the scenario management program G to the terminal device 2 is not limited to downloading from an external server. Therefore, it may be provided by another recording medium such as an optical disc such as a DVD (Digital Versatile Disc) or a USB (Universal Serial Bus) memory. The terminal device 2 can store the scenario management program G read from these recording media in the storage unit 222. Also, when the arithmetic unit 21 executes the scenario management program G, each functional unit in FIG. 2 for executing scenario management is configured in the arithmetic unit 21.

[0016] Note that, in this embodiment, the scenario used in RPA and managed by the terminal device 2 is a scenario for automating operations performed by the user of this terminal device 2 or another person on an application program other than the scenario management program G. The operations include an operation of obtaining a value from an application program other than the scenario management program G, an operation of processing the value, and an operation of inputting a value into an application program other than the scenario management program G. The operation of obtaining a value from an application program other than the scenario management program G includes a human operating an application program other than the scenario management program G to output the information to be referred to from an output device such as the display 244. Also, the operation of inputting a value into an application program other than the scenario management program G includes a human operating an input device such as the keyboard 241 or the mouse 242 so that a value is input into an application program other than the scenario management program G. For example, it includes directly inputting a value using the keyboard 241 and selecting a value to be input from options displayed by an application program using an input device.

[0017] For example, as will be shown later using FIG. 4B and the like, a scenario is composed of a plurality of activities, and each activity defines an operation to be executed by a computer. Specific examples of activities include · An activity indicating acquisition of a table described in a CSV (Comma-Separated Values) format or the like · An activity of narrowing down the values of the table under a predetermined condition · An activity of extracting a value from the table · An activity of outputting the value to an output destination (table, web page, email address, etc.) · An activity of accessing a predetermined web page · An activity of obtaining an image or text from a web page Various specific examples can be given. Furthermore, by arranging the activities in a desired order using UI24, the user can create a scenario in which those activities are executed in that order.

[0018] Figure 2 is a schematic block diagram showing an example of the functions configured when the calculation unit executes the scenario management program. When the calculation unit 21 executes the scenario management program G, the automatic creation unit 3, the editor 4, and the violation check unit 5 are configured in the calculation unit 21. The automatic creation unit 3 includes a search information creation unit 31, a search result display unit 32, a scenario information creation unit 33, and a creation result display unit 34. The editor 4 includes an editing operation unit 41, an automatic check / comment information creation unit 42, and an automatic check / comment display unit 43.

[0019] Figure 3 is a flowchart showing the scenario creation assistance performed by the calculation unit according to the scenario management program, and Figures 4A, 4B, and 4C schematically show the screens displayed on the display by the scenario creation assistance in Figure 3. The screens in Figures 4A, 4B, and 4C are displayed on the display 244 by the calculation unit 21 controlling the display 244.

[0020] In step S101, the search information creation unit 31 checks whether it has obtained the user's natural language input L from the UI 24. Here, natural language input L is the natural language input from the user received by the UI 24, and consists of a string representing that natural language. For example, the UI 24 receives natural language input L based on the user's operation on the UI 24's keyboard 241 or mouse 242. Alternatively, the UI 24 receives natural language input L by detecting the user's voice with the UI 24's microphone 243. When the UI 24 receives natural language input L, it transmits the natural language input L to the search information creation unit 31 and the storage unit 22. The storage unit 22 stores the natural language input L received from the UI 24.

[0021] When the search information creation unit 31 obtains natural language input L from the UI 24 (if "YES" is selected in step S101), it creates search information I1 based on the natural language input L (step S102). Specifically, the search information creation unit 31 analyzes the segments contained in the natural language input L. If the natural language input L contains multiple segments, the search information creation unit 31 divides the natural language input L into multiple segments. For example, if the natural language input L obtained is "Extract a table from a document file and write it to a spreadsheet file", the search information creation unit 31 divides the natural language input L into the segment "Extract a table from a document file" and the segment "Write it to a spreadsheet file". In this way, search information I1 is created that shows the natural language input L divided into segments.

[0022] Then, the search information creation unit 31 transmits the search information I1 (input information Ii) to the search unit 13 via the communication unit 25 (step S102). In the above example, the search information I1, which includes the phrases "extract a table from a document file" and "write to a spreadsheet file," is transmitted to the search unit 13.

[0023] The search unit 13 searches for an activity that performs the task indicated by the segment indicated by the search information I1. This search unit 13 has pre-learned the correspondence between natural language and activities, and searches for an activity that corresponds to the natural language indicated by the phrase. Specifically, the search unit 13 has a search engine that searches for activity A. This search engine has pre-registered indexes such as information about activity A and keywords related to activity A. Various specific search methods are conceivable. Therefore, various methods that can perform highly accurate searches on natural language input L, such as vector search and semantic search, can be employed. The search unit 13 then transmits search activity information I2 (output information Io), which shows the correspondence between the phrase and the activity corresponding to that phrase, to the communication unit 25.

[0024] In step S103, the search results display unit 32 checks whether the communication unit 25 has received the search activity information I2. If the communication unit 25 has received the search activity information I2 (YES in step S103), the search results display unit 32 creates a search results display screen 6 (Figure 4A) showing the search activity information I2 and displays it on the display 244 (step S104).

[0025] As shown in Figure 4A, the search results display screen 6 has a natural language input display unit 61. In step S101, the natural language input display unit 61 displays the natural language input L obtained from the UI 24 by the search information creation unit 31. Specifically, the search results display unit 32 displays the natural language input L read from the storage unit 22 on the natural language input display unit 61.

[0026] Furthermore, the search results display screen 6 has a tab selection section 62. The tab selection section 62 includes multiple tabs ("Basic Tab", "AI Search Tab", "All Tab"), and the search results display screen 6 displays the screen corresponding to one of the tabs selected from among the multiple tabs of the tab selection section 62. In the example in Figure 4A, the "AI Search Tab" is selected. This "AI Search Tab" displays the search activity information I2, which is the activity searched in response to the natural language input L.

[0027] The "AI Search Tab" on the search results display screen 6 has a search results display unit 63 that displays the search activity information I2 received by the search results display unit 32 in step S103. This search results display unit 63 has phrase-corresponding activity display units 64 and 65. The phrase-corresponding activity display units 64 and 65 are created according to each phrase separated from the natural language input L in step S102. The phrase-corresponding activity display units 64 and 65 each display the corresponding phrase and the type of activity searched for that phrase. In the example in Figure 4A, a phrase-corresponding activity display unit 64 corresponding to the phrase "extract a table from a document file" and a phrase-corresponding activity display unit 65 corresponding to the phrase "write to a spreadsheet file" are created and displayed on the "AI Search Tab" of the search results display screen 6.

[0028] The phrase-corresponding activity display unit 64 comprises a phrase display unit 641 and an activity display unit 642. The phrase-corresponding activity display unit 64 displays the phrase corresponding to the phrase-corresponding activity display unit 64 on the phrase display unit 641. In the example in Figure 4A, the phrase display unit 641 displays the phrase "Extract a table from a document file." The phrase-corresponding activity display unit 64 also displays the activity A11 found for the phrase corresponding to the phrase-corresponding activity display unit 64 on the activity display unit 642. In particular, the activity display unit 642 displays activity A11 using activity type information C, which indicates the type of activity. In the example in Figure 4A, the activity A11 corresponding to the phrase "Extract a table from a document file" is included in the search activity information I2. Therefore, the activity display unit 642 displays activity type information C, which indicates the type of activity A11.

[0029] The phrase-corresponding activity display unit 65 has a phrase display unit 651 and an activity display unit 652. The phrase-corresponding activity display unit 65 displays the phrase corresponding to the phrase-corresponding activity display unit 65 on the phrase display unit 651. In the example in Figure 4A, the phrase display unit 651 displays the phrase "write to a spreadsheet file". The phrase-corresponding activity display unit 65 also displays the activities A21 to A24 found for the phrase corresponding to the phrase-corresponding activity display unit 65 on the activity display unit 652. In particular, the activity display unit 652 displays activities A21 to A24 using activity type information C, which indicates the type of activity. In the example in Figure 4A, for the phrase "write to a spreadsheet file", the search activity information I2 includes the activity A21 to open the spreadsheet file, the activity A22 to write values, the activity A23 to save the spreadsheet file, and the activity A24 to close the spreadsheet file. Therefore, the activity display unit 652 displays activity type information C, which indicates the type of these activities A21 to A24.

[0030] The search results display unit 32 accepts user input from the UI 24 to select an activity to use for creating a scenario from among the activities A11, A21-A24 displayed on the search results display unit 63. For example, if there is no need to close the spreadsheet file, the user can perform an operation on the UI 24 to delete the activity A24 that closes the spreadsheet file, and the search results display unit 32 will delete activity A24 from the search results display unit 63 in response to this operation. In this way, activities A11, A21-A23 can be selected from among the activities A11, A21-A24 displayed on the search results display unit 63. Note that the selection of an activity includes selecting all activities A11, A21-A24 displayed on the search results display unit 63.

[0031] Furthermore, the search results display screen 6 has a scenario creation button 69. When the user performs the operation of pressing the scenario creation button 69 on the UI 24, a scenario creation instruction is sent from the UI 24 to the scenario information creation unit 33 (YES in step S105). The scenario information creation unit 33 decides to use the activity selected at the time of receiving the scenario creation instruction (in other words, the activity displayed on the search results display unit 63) for scenario creation.

[0032] In other words, the scenario information creation unit 33 creates scenario creation information I3 which includes the activities decided to be used for scenario creation and the natural language input L used to search for those activities (step S106). This scenario creation information I3 indicates that a scenario Sm, which performs the task indicated by the natural language input L included in the scenario creation information I3, will be created using the activities included in the scenario creation information I3. At this time, the scenario information creation unit 33 creates the scenario creation information I3 using the natural language input L read from the storage unit 22. Furthermore, the scenario information creation unit 33 creates the scenario creation information I3 so as to include the system prompt Ps shown in Figure 5.

[0033] Figure 5 schematically shows an example of a system prompt. This system prompt Ps includes natural language information Psa, function definition information Psb, and sample code Psc. The natural language information Psa describes the LLM12 role "RPA Tool Assistant" and the rules for creating scenario Sm in natural language. The function definition information Psb describes the methods and enums of the general-purpose programming language supported by the scenario management program G (in other words, terminal device 2 on which the scenario management program G is installed). The sample code Psc shows how to read the methods and enums described in the function definition information Psb using the general-purpose programming language. In this way, the system prompt Ps shows the rules for describing scenario Sm using the general-purpose programming language. The scenario information creation unit 33 then transmits the scenario creation information I3 (input information Ii) created in this way to the LLM12 from the communication unit 25 (step S106).

[0034] In response to the scenario creation information I3, LLM12 outputs a scenario Sm created based on the scenario creation information I3. In other words, LLM12 has already learned a general-purpose programming language. In contrast, the scenario creation information I3 input to LLM12 includes a system prompt Ps, which indicates the rules for describing scenario Sm using the general-purpose programming language. Therefore, LLM12 creates the source code for scenario Sm indicated by the scenario creation information I3 according to the rules indicated by the system prompt Ps. This source code is then output from LLM12 as scenario Sm.

[0035] The scenario Sm output from LLM12 is checked by the violation check unit 5 and then passed to the creation result display unit 34. The violation check unit 5 checks whether the scenario Sm received from LLM12 violates the rules indicated by the system prompt Ps. Then, the scenario Sm and the check result of the violation check unit 5 for the scenario Sm are passed from the violation check unit 5 to the creation result display unit 34. When the creation result display unit 34 obtains the scenario Sm (creation result) created by LLM12 (if "YES" is selected in step S107), it displays the creation result display screen 7 (Figure 4B) showing this scenario Sm on the display 244 (step S108). The details are as follows.

[0036] The creation result display unit 34 converts the code representing each activity included in the source code describing scenario Sm into an activity icon Ac representing that activity, based on the conversion table. This creates a creation result display screen 7 (Figure 4B) that shows each activity A11, A21~A24 constituting scenario Sm as an activity icon Ac. The creation result display unit 34 then displays the creation result display screen 7 on the display 244. If the check result received from the violation check unit 5 indicates a rule violation, the creation result display unit 34 displays information indicating that scenario Sm violates the rule on the creation result display screen 7. This information indicating a violation can be shown, for example, by flashing the relevant section.

[0037] As shown in Figure 4B, the creation result display screen 7 has a task display unit 711 and a scenario display unit 72 located below the message, "A sample scenario has been created for the following task." In the task display unit 711, the natural language input for creating the scenario Sm is displayed following the string "Task". Specifically, the task display unit 711 displays the natural language input L read from the storage unit 22.

[0038] In the scenario display unit 72, the activity icons Ac of activities A11 and A21-A24 included in scenario Sm are displayed in the order in which they are executed. Each of activities A11 and A21-A24 is shown in the scenario display unit 72 by an activity icon Ac that represents a combination of activity type information C, which indicates the type of activity, and activity definition information D, which defines the details of the activity.

[0039] Activity A11 is an activity that extracts a table from a document file. This Activity A11 creates a variable V11 and extracts the table to be entered into variable V11. Activity definition information D11 of Activity A11 includes activity definition information D111 which specifies the name of variable V11 (Table 1), and activity definition information D112, D113, and D114 which specify the value to be obtained as the actual value of variable V11. Activity definition information D112 specifies the path of the document file from which the table will be extracted. Activity definition information D113 specifies the page in the document file from which the table will be extracted. Activity definition information D114 specifies the order of the tables to be extracted from the tables contained in the page.

[0040] Correspondingly, the activity icon Ac of activity A11 is provided with input areas R112, R113, and R114 for inputting values ​​into the activity definition information D112, D113, and D114, respectively. The creation result display unit 34 creates a creation result display screen 7 showing each of the input areas R112, R113, and R114 in their default state and displays it on the display 244. The user can then input values ​​into each of the input areas R112, R113, and R114 by operating the UI 24. Therefore, when activity A11 is executed, the table specified by the actual values ​​entered into the activity definition information D112, 113, and 114 is extracted and entered into the variable V11 (Table 1).

[0041] Activity A21 is an activity that opens a spreadsheet file. It creates a variable V21 and opens the spreadsheet file specified by the path entered in variable V21. Activity definition information D21 of Activity A21 includes activity definition information D211, which specifies the name (string1) of variable V21, and activity definition information D212, which specifies the value to be obtained as the actual value of variable V21. Activity definition information D212 specifies the path to the spreadsheet file.

[0042] In response to this, the activity icon Ac of activity A21 is provided with an input area R212 for entering values ​​into the activity definition information D212. The creation result display unit 34 creates a creation result display screen 7 showing the input area R212 in its default state and displays it on the display 244. The user can then enter values ​​into the input area R212 by operating the UI 24. Therefore, when activity A21 is executed, the path specified by the actual value entered into the activity definition information D212 is entered into the variable V21 (string1), and the spreadsheet file for that path is opened.

[0043] Activity A22 writes a table to a sheet in the spreadsheet file that is active at the time Activity A22 is executed, according to Activity Definition Information D22. Specifically, the spreadsheet file is opened and made active by Activity A21, which is executed before Activity A22. Therefore, a table is written to a sheet in that spreadsheet file. Activity Definition Information D22 for Activity A22 includes Activity Definition Information D221, which specifies the number of cells to write values ​​to; Activity Definition Information D222, which specifies the format in which to write values; Activity Definition Information D223, which specifies the spreadsheet file; and Activity Definition Information D224, which specifies the table to write.

[0044] Correspondingly, the activity icon Ac of activity A22 is provided with input areas R221, R222, R223, and R224 for inputting values ​​into activity definition information D221, D222, D223, and D224, respectively. The creation result display unit 34 creates a creation result display screen 7 showing each of the input areas R221, R222, R223, and R224 in their default state and displays it on the display 244. The user can then input values ​​into each of the input areas R221, R222, R223, and R224 by operating the UI 24. In the example in Figure 4B, "Single Cell" is selected as the value of activity definition information D221, and "A1 Format Specified" is selected as the value of activity definition information D222. In addition, the value of the predefined variable V21 can be selected as the value of activity definition information D223, and the value of the predefined variable V11 can be selected as the value of activity definition information D224. Therefore, when Activity A22 is executed, the table specified in Activity Definition Information D224 is written to the spreadsheet file specified in Activity Definition Information D223, in the format specified in Activity Definition Information D222, and in the number of cells specified in Activity Definition Information D221.

[0045] Furthermore, the activity definition information D22 includes activity definition information D225, which indicates whether or not to output column names. Correspondingly, the activity icon Ac of activity A22 is provided with an input area R225 (checkbox) for entering a value into the activity definition information D225. The creation result display unit 34 creates a creation result display screen 7 showing the input area R225 in its default state and displays it on the display 244. The user can then enter a value into the input area R225 (i.e., check the box) by operating the UI 24. Therefore, if the activity definition information D225 specifies the output of column names, when activity A22 is executed, the column names will be output and displayed on the display.

[0046] Activity A23 is an activity that saves the active spreadsheet file at the time of its execution, according to the activity definition information D23. Specifically, the spreadsheet file is opened and made active by Activity A21, which is executed before Activity A23. Therefore, the spreadsheet file is saved. Activity A23 creates a variable V23 and saves the spreadsheet file in the format entered into variable V23. The activity definition information D23 of Activity A23 includes activity definition information D231, which specifies the name (string2) of variable V23. Activity definition information D23 also includes activity definition information D232, which specifies how to save the spreadsheet file. Correspondingly, the activity icon Ac of Activity A23 is provided with an input area R232 for entering a value into activity definition information D232. The creation result display unit 34 creates a creation result display screen 7 showing the input area R232 in its default state and displays it on the display 244. The user can then enter a value into the input area R232 by operating the UI 24. In this example, "Overwrite Save" is selected as the value specified in activity definition information D232. Therefore, when activity A23 is executed, the active spreadsheet file is overwritten and saved.

[0047] Activity A24 is an activity that closes the spreadsheet file that is active at the time of its execution, according to the activity definition information D24. Specifically, the spreadsheet file is opened and made active by Activity A21, which is executed before Activity A24. Therefore, when Activity A24 is executed, the spreadsheet file is closed.

[0048] A creation result display screen 7 showing the scenario Sm created in this way is displayed on the display 244 (step S108). This creation result display screen 7 has a recreate button 712 for receiving instructions from the user to recreate the scenario Sm. In response, in step S109, the scenario information creation unit 33 checks whether the user has pressed the recreate button 712 on the UI 24. If the operation of pressing the recreate button 712 is confirmed (if "YES" is given in step S109), steps S106 to S108 are executed again and the scenario Sm is created again. If the operation of pressing the recreate button 712 is not confirmed (if "NO" is given in step S109), the process proceeds to step S110.

[0049] The creation result display screen 7 displays a copy icon 713. In response, in step S110, the editing operation unit 41 checks whether the user has pressed the copy icon 713 on the UI 24. If the operation of pressing the copy icon 713 is not confirmed (if "NO" is the answer in step S110), the process returns to step S109. If the operation of pressing the copy icon 713 is confirmed (if "YES" is the answer in step S110), the editing operation unit 41 displays the parameter setting screen 73 (Figure 4C) on the display 244. This parameter setting screen 73 has a parameter setting unit 731, and the scenario Sm displayed on the scenario display unit 72 is copied to the parameter setting unit 731 when the operation of pressing the copy icon 713 is performed.

[0050] Then, the editing operation unit 41 of the editor 4 checks whether a parameter has been entered into the parameter setting unit 731 (step S111). In other words, the activity definition information D displayed in the parameter setting unit 731 includes input areas R (R112, R113, R114, R212, R221, R222, R223, R224, R232) into which the parameter values ​​are entered in response to the user's operations on the UI 24. Therefore, the editing operation unit 41 checks whether a parameter has been entered into the input area R of the activity definition information D. If a parameter has been entered into the input area R (YES in step S111), the parameter entered into that input area R is set in the activity definition information D (step S112).

[0051] Furthermore, the parameter setting screen 73 has a confirmation button 732. In response to this, in step S113, the editing operation unit 41 checks whether the user has pressed the confirmation button 732 on the UI 24. If the operation of pressing the confirmation button 732 is not confirmed (if "NO" is the answer in step S113), the process returns to step S109. On the other hand, if the operation of pressing the confirmation button 732 is confirmed (if "YES" is the answer in step S113), the process proceeds to step S114. In step S114, the editing operation unit 41 saves the scenario Sm, which is composed of the contents (activity A and parameters) displayed on the parameter setting unit 731 at the time the operation of pressing the confirmation button 732 was confirmed, as a completed scenario Sm in the storage unit 22. This scenario Sm is saved in the storage unit 22 in association with the natural language input L used to create the scenario Sm.

[0052] Furthermore, the creation result display screen 7 has a close button 714 for ending the display of scenario Sm. When the creation result display unit 34 confirms that the close button 714 has been pressed, it closes the creation result display screen 7.

[0053] Figure 6 is a flowchart showing the natural language output executed by the arithmetic unit according to the scenario management program, and Figures 7A, 7B, 7C, 8A, and 8B schematically show the screens displayed on the display by the natural language output of Figure 6. The screens in Figures 7A, 7B, 7C, 8A, and 8B are displayed on the display 244 by the arithmetic unit 21 controlling the display 244. In the natural language output of Figure 6, comments or suggestions for improvement for scenario Sm are shown in natural language in response to user instructions input into the UI 24.

[0054] In step S201, the automatic check and comment information creation unit 42 checks whether the user has performed an operation on the UI 24 to specify a scenario Sm to be output in natural language. For example, if a list of multiple created scenarios Sm is displayed on the display 244, and the user performs an operation on the UI 24 to select one scenario Sm from among the multiple scenarios Sm, the automatic check and comment information creation unit 42 determines that the one scenario Sm has been specified. An example of this list is the list 862 displayed on the scenario list display unit 86, which will be described later. Once the target scenario Sm has been specified (YES in step S201), the automatic check and comment information creation unit 42 displays the target scenario display screen 8 (Figure 7A) showing the target scenario Sm on the display 244 (step S202).

[0055] As shown in Figure 7A, the target scenario display screen 8 has a scenario display unit 81 that displays scenario Sm. In the scenario display unit 81, the activity icons Ac of activities A31 to A37 included in scenario Sm are displayed in the order in which they are executed. Each of activities A31 to A37 is shown in the scenario display unit 81 by an activity icon Ac that represents a combination of activity type information C indicating the type of activity and activity definition information D defining the details of the activity.

[0056] Activity A31 is an activity that retrieves information from a folder as a table. Activity A31 creates a variable V31 and retrieves the information entered into variable V31 as a table. Activity definition information D31 of Activity A31 includes activity definition information D311 which specifies the name of variable V31 (Table 1), and activity definition information D312~D319 which specifies the value to be retrieved as the actual value of variable V31. Activity definition information D312 specifies the path to which the information to be retrieved is to be retrieved. Activity definition information D313 specifies the type of information to be retrieved. Activity definition information D314 specifies the order in which the information to be retrieved is to be Activity definition information D317 to D319 specify the period of update date and time to be acquired. Activity definition information D317 specifies the length of the period, activity definition information D318 specifies the unit of the period, and activity definition information D319 specifies the range of the period.

[0057] Correspondingly, the activity icon Ac of activity A31 is provided with input areas R312 to R319 for entering values ​​into activity definition information D312 to D319. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing each of the input areas R312 to R319 in their default state and displays it on the display 244. The user can then input values ​​into each of the input areas R312 to R319 by operating the UI 24. Therefore, when activity A31 is executed, the table specified by the actual values ​​entered into activity definition information D312 to D319 is obtained and entered into variable V31 (Table 1).

[0058] Activity A32 is an activity that retrieves a value (string) from a table. This Activity A32 creates a variable V32 and retrieves the information entered into variable V32 as a string. Activity definition information D32 of Activity A32 includes Activity definition information D321 which specifies the name of variable V32 (string1), and Activity definition information D322~D324 which specifies the value to be retrieved as the actual value of variable V32. Activity definition information D322 specifies the row from which to retrieve the string. Activity definition information D323 specifies the column name from which to retrieve the string. Activity definition information D324 specifies the full path from which to retrieve the string.

[0059] Correspondingly, the activity icon Ac of activity A32 is provided with input areas R322 to R324 for entering values ​​into activity definition information D322 to D324. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing each of the input areas R322 to R324 in their default state and displays it on the display 244. The user can then input values ​​into each of the input areas R322 to R324 by operating the UI 24. Therefore, when activity A32 is executed, the string specified by the actual values ​​entered into activity definition information D322 to D324 is obtained and entered into the variable V32 (string1).

[0060] Activity A33 is an activity that moves a file. Activity A33 creates a variable V33 and moves the file indicated by variable string1 to the path indicated by the information entered into variable V33. Activity definition information D33 of Activity A33 includes activity definition information D331 which specifies the name of variable V33 (string2), and activity definition information D332~D333 which specifies the value to be obtained as the actual value of variable V33. Activity definition information D332 specifies the path to which the file will be moved. Activity definition information D333 specifies the method of moving to the destination file (whether to overwrite or not).

[0061] Accordingly, the activity icon Ac of activity A33 is provided with input areas R332 to R333 for entering values ​​into activity definition information D332 to D333. The automatic check and comment information creation unit 42 creates a target scenario display screen 8 showing each of the input areas R332 to R333 in their default state and displays it on the display 244. The user can then enter values ​​into each of the input areas R332 to R333 by operating the UI 24. Therefore, when activity A33 is executed, the file is moved using the path and method specified by the actual values ​​entered into activity definition information D332 to D333.

[0062] Activity A34 is an activity that retrieves a value (string) from a table. This Activity A34 creates a variable V34 and retrieves the information entered into variable V34 as a string. Activity definition information D34 of Activity A34 includes Activity definition information D341 which specifies the name of variable V34 (string3), and Activity definition information D342~D344 which specifies the value to be retrieved as the actual value of variable V34. Activity definition information D342 specifies the row from which to retrieve the string. Activity definition information D343 specifies the column name from which to retrieve the string. Activity definition information D344 specifies the full path from which to retrieve the string.

[0063] Correspondingly, the activity icon Ac of activity A34 is provided with input areas R342 to R344 for entering values ​​into activity definition information D342 to D344. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing each of the input areas R342 to R344 in their default state and displays it on the display 244. The user can then input values ​​into each of the input areas R342 to R344 by operating the UI 24. Therefore, when activity A34 is executed, the string specified by the actual values ​​entered into activity definition information D342 to D344 is obtained and entered into the variable V34 (string3).

[0064] Activity A35 is an activity that moves a file. Activity A35 creates a variable V35 and moves the file indicated by the variable string3 to the path indicated by the information entered into variable V35. Activity definition information D35 of Activity A35 includes activity definition information D351 which specifies the name of variable V35 (string4), and activity definition information D352~D353 which specifies the value to be obtained as the actual value of variable V35. Activity definition information D352 specifies the path to which the file will be moved. Activity definition information D353 specifies the method of moving to the destination file (whether to overwrite or not).

[0065] In response to this, the activity icon Ac of activity A35 is provided with input areas R352 to R353 for entering values ​​into activity definition information D352 to D353. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing each of the input areas R352 to R353 in their default state and displays it on the display 244. The user can then enter values ​​into each of the input areas R352 to R353 by operating the UI 24. Therefore, when activity A35 is executed, the file is moved using the path and method specified by the actual values ​​entered into activity definition information D352 to D353.

[0066] Activity A36 is an activity that retrieves a value (string) from a table. This Activity A36 creates a variable V36 and retrieves the information entered into variable V36 as a string. Activity definition information D34 of Activity A36 includes Activity definition information D361 which specifies the name of variable V36 (string5), and Activity definition information D362~D364 which specifies the value to be retrieved as the actual value of variable V36. Activity definition information D362 specifies the row from which to retrieve the string. Activity definition information D363 specifies the column name from which to retrieve the string. Activity definition information D364 specifies the full path from which to retrieve the string.

[0067] Correspondingly, the activity icon Ac of activity A36 is provided with input areas R362 to R364 for entering values ​​into activity definition information D362 to D364. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing each of the input areas R362 to R364 in their default state and displays it on the display 244. The user can then input values ​​into each of the input areas R362 to R364 by operating the UI 24. Therefore, when activity A36 is executed, the string specified by the actual value entered into activity definition information D362 to D364 is obtained and entered into the variable V36 (string5).

[0068] Activity A37 is an activity that moves a file. Activity A37 creates a variable V37 and moves the file indicated by variable string5 to the path indicated by the information entered into variable V37. Activity definition information D37 of Activity A37 includes activity definition information D371 which specifies the name of variable V37 (string6), and activity definition information D372~D373 which specifies the value to be obtained as the actual value of variable V37. Activity definition information D372 specifies the path to which the file will be moved. Activity definition information D373 specifies the method of moving to the destination file (whether to overwrite or not).

[0069] In response to this, the activity icon Ac of activity A37 is provided with input areas R372 to R373 for entering values ​​into activity definition information D372 to D373. The automatic check and comment information creation unit 42 creates a target scenario display screen 8 showing each of the input areas R372 to R373 in their default state and displays it on the display 244. The user can then enter values ​​into each of the input areas R372 to R373 by operating the UI 24. Therefore, when activity A37 is executed, the file is moved using the path and method specified by the actual values ​​entered into activity definition information D372 to D373.

[0070] In step S203, the automatic check / comment information creation unit 42 confirms whether the user has performed an operation to request a check or comment on the UI 24. In other words, when the UI 24 receives a right-click operation on the target scenario display screen 8, the automatic check / comment information creation unit 42 displays the context menu 82 (Figure 7B) overlaid on the target scenario display screen 8.

[0071] Among the context menu 82, menu 821, "Insert block with comment," is a menu for instructing the system to block an activity displayed on the target scenario display screen 8 and display a comment on the display 244 that explains the operation of that activity. When menu 821 is selected while all of activities A31 to A37 displayed on the target scenario display screen 8 are selected, the automatic check and comment information creation unit 42 performs comment display on all of them. When menu 821 is selected while some of the activities A31 to A37 displayed on the target scenario display screen 8 are selected, the automatic check and comment information creation unit 42 performs comment display on the selected part.

[0072] Of the context menu 82, menu 822, "Check for Scenario Improvements," is a menu for instructing the system to display improvements to scenario Sm, which is displayed on the target scenario display screen 8, on the display 244. When menu 822 is selected while all of activities A31 to A37 displayed on the target scenario display screen 8 are selected, the automatic check / comment information creation unit 42 performs improvement display for all of them. When menu 821 is selected while some of the activities A31 to A37 displayed on the target scenario display screen 8 are selected, the automatic check / comment information creation unit 42 performs improvement display for the selected part.

[0073] For example, when the operation to select menu 822 is confirmed ("YES" in step S203), the automatic check / comment information creation unit 42 sends check / comment information I4, which includes the selected activity and a request for improvement of that activity, to the LLM 12 (step S204). This check / comment information I4 includes perspectives (review perspectives) for considering improvements. Examples of these review perspectives include avoiding repeating the same work. Upon receiving this check / comment information I4, the LLM 12 creates response information I5, which shows proposed improvements to the activity based on the review perspectives, and outputs it to the automatic check / comment display unit 43. When the automatic check / comment display unit 43 receives response information I5 from the LLM 12, which shows the response to the check / comment information I4 ("YES" in step S205), it displays a response result display screen 83 (Figure 7C) showing the response information I5 (check / comment information result) on the display 244. This response information I5 shows the improvement scenario Smr, which will be described later, in a text-based general-purpose programming language.

[0074] The response result display screen 83 includes an improvement point explanation display unit 84, an improvement scenario display unit 85, and a scenario list display unit 86. The improvement point explanation display unit 84 displays text in natural language that explains the improvements made to the selected activity. In the example in Figure 7C, This scenario can be improved in terms of readability and stability by reviewing it from the following perspectives: (1) The same process is being duplicated. (2) The writing style is dependent on the PC on which it was created. (3) Variable names are not properly assigned. (4) Parameters that are likely to be changed later are written directly. (5) Unable to handle increases or decreases in the number of files This is displayed on the improvement explanation display unit 84.

[0075] Furthermore, below the text "The revised scenario is as follows," an improved scenario display section 85 is provided. As shown in Figure 7C, the improved scenario display section 85 displays the improved scenario Smr, which is a modified version of scenario Sm (Figure 7A). Specifically, the activity icons Ac of activities A41 to A46 included in the improved scenario Smr are displayed in the order in which they are executed. Each of activities A41 to A46 is shown in the scenario display section 81 by an activity icon Ac that represents a combination of activity type information C, which indicates the type of activity, and activity definition information D, which defines the details of the activity.

[0076] Activity A41 is an activity that retrieves a special folder path. This Activity A41 creates a variable V41 and retrieves the path that will be entered into variable V41. The activity definition information D41 of Activity A41 includes activity definition information D411, which specifies the name of variable V41 (download folder), and activity definition information D412, which specifies the path to be retrieved as the actual value of variable V41. Activity definition information D412 specifies the path to be retrieved.

[0077] In response to this, the activity icon Ac of activity A41 is provided with an input area R412 for entering a value into the activity definition information D412. The automatic check / comment display unit 43 creates an answer result display screen 83 showing the input area R412 in its default state and displays it on the display 244. The user can then enter a value into the input area R412 by operating the UI 24. Therefore, when activity A41 is executed, the path specified by the actual value entered into the activity definition information D412 is obtained and entered into the variable V41 (download folder).

[0078] Activity A42 is an activity that creates a variable (string). This Activity A42 creates a variable V42 and retrieves the information entered into variable V42 as a string. Activity definition information D42 of Activity A42 includes activity definition information D421, which specifies the name of variable V42 (the folder to which the file will be moved), and activity definition information D422, which specifies the value to be retrieved as the actual value of variable V42. Activity definition information D422 specifies the path.

[0079] In response to this, the activity icon Ac of activity A42 is provided with an input area R422 for entering a value into the activity definition information D422. The automatic check / comment display unit 43 creates an answer result display screen 83 showing the input area R422 in its default state and displays it on the display 244. The user can then enter a value into the input area R422 by operating the UI 24. Therefore, when activity A42 is executed, the string specified by the actual value entered into the activity definition information D422 is obtained and entered into the variable V42 (file destination folder).

[0080] Activity A43 is an activity that retrieves information from a folder as a table. Activity A43 creates a variable V43 and retrieves the information entered into variable V43 as a table. Activity definition information D43 of Activity A43 includes Activity definition information D431 which specifies the name (file list) of variable V43, and Activity definition information D432~D438 which specifies the value to be retrieved as the actual value of variable V43. Activity definition information D432 specifies the type of information to be retrieved. Activity definition information D433 specifies the order in which the information will be retrieved. Activity definition information D434 specifies the file names to be extracted. Activity definition information D435 specifies whether or not to include items in subfolders. Activity definition information D436~D438 specifies the period of update dates and times for the information to be retrieved, Activity definition information D436 specifies the length of the period, Activity definition information D437 specifies the unit of the period, and Activity definition information D438 specifies the range of the period.

[0081] Correspondingly, the activity icon Ac of activity A43 is provided with input areas R432 to R438 for entering values ​​into activity definition information D432 to D438. The automatic check / comment display unit 43 creates an answer result display screen 83 showing each of the input areas R432 to R438 in their default state and displays it on the display 244. The user can then input values ​​into each of the input areas R432 to R438 by operating the UI 24. Therefore, when activity A43 is executed, the table specified by the actual values ​​entered into activity definition information D432 to D438 is obtained and entered into the variable V43 (file list).

[0082] Activity A44 is an activity that repeats the target activities A45 and A46. The activity icon Ac of Activity A44 has a bar Acb that extends across Activities A45 and A46 to the left of the activities being repeated. The user can visually confirm which activities A45 and A46 are being repeated by this bar Acb. Activity A44 creates a variable V44 and repeats Activities A45 and A46 for the information entered into variable V44. The activity definition information D44 of Activity A44 includes activity definition information D441 which specifies the name of variable V44 (file list). The file list, which is variable V43, is entered into this activity definition information D441. In other words, Activity A44 repeatedly executes Activities A45 and A46 for each file and folder included in the file list.

[0083] Activity A45 is an activity that retrieves a value (string) from a table. This Activity A45 creates a variable V45 and retrieves the information entered into variable V45 as a string. Activity definition information D45 of Activity A45 includes Activity definition information D451, which specifies the name (file path) of variable V45, and Activity definition information D452~D453, which specifies the value to be retrieved as the actual value of variable V45. Activity definition information D452 specifies the column name from which to retrieve the string. Activity definition information D453 specifies the full path from which to retrieve the string.

[0084] Correspondingly, the activity icon Ac of activity A45 is provided with input areas R452 to R453 for entering values ​​into activity definition information D452 to D453. The automatic check / comment display unit 43 creates an answer result display screen 83 showing each of the input areas R452 to R453 in their default state and displays it on the display 244. The user can then input values ​​into each of the input areas R452 to R453 by operating the UI 24. Therefore, when activity A45 is executed, the string specified by the actual value entered into activity definition information D452 to D453 is obtained and entered into the variable V45 (file path).

[0085] Activity A46 is an activity that moves a file. Activity A46 creates a variable V46 and moves the file indicated by variable V45 (file path) to the path indicated by the information entered into variable V46. Activity definition information D46 of Activity A46 includes activity definition information D461 which specifies the name of variable V46 (destination file path) and activity definition information D462 which specifies the value obtained as the actual value of variable V46. Activity definition information D462 specifies the method of moving to the destination file (whether to overwrite or not).

[0086] In response to this, the activity icon Ac of activity A46 is provided with an input area R462 for entering a value into the activity definition information D462. The automatic check / comment display unit 43 creates an answer result display screen 83 showing the input area R462 in its default state and displays it on the display 244. The user can then enter a value into the input area R462 by operating the UI 24. Therefore, when activity A46 is executed, the file is moved in the manner specified by the actual value entered into the activity definition information D462.

[0087] Furthermore, a copy icon 831 is displayed on the answer result display screen 83. When the operation of pressing the copy icon 831 is confirmed, the editing operation unit 41 displays the parameter setting screen 73 (Figure 4C) on the display 244. The parameter setting unit 731 of this parameter setting screen 73 has the improvement scenario Smr, which is displayed in the improvement scenario display unit 85 of the answer result display screen 83, copied to the parameter setting unit 731 at the time the operation of pressing the copy icon 831 is performed. Therefore, parameter settings can be performed for the improvement scenario Smr, just as in the case of scenario Sm described above.

[0088] Furthermore, the scenario list display unit 86 displays the history of created improvement scenarios Smr in list format. Specifically, the scenario list display unit 86 shows the date 861 on which the improvement scenario Smr was created and a list 862 of the improvement scenario Smr created on that date 861. When the automatic check / comment display unit 43 receives the response information I5, it saves the response information I5 to the storage unit 22. In other words, the response information I5 is saved to the storage unit 22 with the improvement scenario Smr, the improvements made to the improvement scenario Smr, and the creation date of the improvement scenario Smr associated with it. The automatic check / comment display unit 43 then creates and displays the scenario list display unit 86 based on the response information I5 read from the storage unit 22. In addition, the history of response information I5 stored in the storage unit 22 can be read as appropriate, and the response information I5 can be output to the outside of the terminal device 2 from the communication unit 25.

[0089] Thus, Scenario Sm, shown in the target scenario display screen 8 of Figure 7A, is improved to the improved scenario Smr, shown in the response result display screen 83 of Figure 7C. Specifically, the repetition of the same processes such as Activities A32, A33, Activities A34, A35, and Activities A36, A37 is resolved. The use of a computer-dependent path in Activity Definition Information D312 is resolved. The names of variables V31 to V37 used in Scenario Sm are made more appropriate. The direct inclusion of paths that are easily changed after the fact in Activity Definition Information D332, D352, and D372 is resolved. The inability of Activity Definition Information D322, D342, and D362 to handle increases or decreases in the number of files is resolved. Note that the results created by executing Scenario Sm and the results created by executing the improved scenario Smr are the same.

[0090] As described above, when menu 822, which indicates "Check for improvements to the scenario," is selected, the improvement display, as explained using Figures 7A to 7C, is executed. On the other hand, when menu 821, which indicates "Insert block with comments," is selected, the comment display, as explained using Figures 8A to 8B, is executed. Next, we will explain this point. Here, Figure 8A shows the display 244 before menu 821 is selected, and Figure 8B shows the display 244 after menu 821 is selected.

[0091] In the target scenario display screen 8 shown in Figure 8A, the activity icons Ac of activities A51 to A61 included in scenario Sm are displayed in the order in which they are executed. Each of activities A51 to A61 is shown in the scenario display unit 81 by an activity icon Ac that represents a combination of activity type information C indicating the type of activity and activity definition information D defining the details of the activity.

[0092] Activity A51 is an activity that creates a variable (string). This Activity A51 creates a variable V51 and retrieves the information to be entered into variable V51. Activity definition information D51 of Activity A51 includes activity definition information D511 which specifies the name of variable V51 (overtime calculation file), and activity definition information D512 which specifies the value to be retrieved as the actual value of variable V51. Activity definition information D512 specifies the path to which the information will be retrieved.

[0093] In response to this, the activity icon Ac of activity A51 is provided with an input area R512 for entering values ​​into the activity definition information D512. The automatic check and comment information creation unit 42 creates a target scenario display screen 8 showing the input area R512 in its default state and displays it on the display 244. The user can then enter values ​​into the input area R512 by operating the UI 24. Therefore, when activity A51 is executed, the information specified by the actual value entered into the activity definition information D512 is acquired and entered into the variable V51 (overtime work schedule calculation file).

[0094] Activity A52 is an activity that creates a variable (string). This Activity A52 creates a variable V52 and retrieves the information to be entered into variable V52. Activity definition information D52 of Activity A52 includes activity definition information D521, which specifies the name (login ID) of variable V52, and activity definition information D522, which specifies the value to be retrieved as the actual value of variable V52. Activity definition information D522 specifies the value of the login ID.

[0095] In response to this, the activity icon Ac of activity A52 is provided with an input area R522 for entering values ​​into the activity definition information D522. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing the input area R522 in its default state and displays it on the display 244. The user can then enter values ​​into the input area R522 by operating the UI 24. Therefore, when activity A52 is executed, the information specified by the actual value entered into the activity definition information D522 is acquired and entered into the variable V52 (login ID).

[0096] Activity A53 is an activity that creates a variable (string). This Activity A53 creates a variable V53 and retrieves the information to be entered into variable V53. Activity definition information D53 of Activity A53 includes activity definition information D531, which specifies the name (destination address) of variable V53, and activity definition information D532, which specifies the value to be retrieved as the actual value of variable V53. Activity definition information D532 specifies the email address.

[0097] In response to this, the activity icon Ac of activity A53 is provided with an input area R532 for entering a value into the activity definition information D532. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing the input area R532 in its default state and displays it on the display 244. The user can then enter a value into the input area R532 by operating the UI 24. Therefore, when activity A53 is executed, the information specified by the actual value entered into the activity definition information D532 is acquired and entered into the variable V53 (destination address).

[0098] Activity A54 is an activity that retrieves a password from credentials. This activity A54 creates a variable V54 and retrieves the information to be entered into variable V54. Activity definition information D54 of Activity A54 includes activity definition information D541 which specifies the name (password) of variable V54, and activity definition information D542 which specifies the value to be retrieved as the actual value of variable V54. Activity definition information D542 specifies the credentials.

[0099] In response to this, the activity icon Ac of activity A54 is provided with an input area R542 for entering a value into the activity definition information D542. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing the input area R542 in its default state and displays it on the display 244. The user can then enter a value into the input area R542 by operating the UI 24. Therefore, when activity A54 is executed, the information specified by the actual value entered into the activity definition information D542 is acquired and entered into the variable V54 (password).

[0100] Activity A55 is an activity that opens a spreadsheet file. It creates a variable V55 and opens the spreadsheet file specified by the information entered into variable V55. Activity definition information D55 of Activity A55 includes activity definition information D551, which specifies the name of the value entered into variable V55 (overtime hours spreadsheet file, i.e., variable V51). Therefore, when Activity A55 is executed, the overtime hours spreadsheet file is opened.

[0101] Activity A56 activates the elements of the spreadsheet file that are active at the time Activity A56 is executed. Specifically, the spreadsheet file is opened and activated by Activity A55, which is executed before Activity A56. Therefore, the elements of that spreadsheet file are activated. Activity definition information D56 of Activity A56 includes activity definition information D562, which specifies the type of element to activate, and activity definition information D563, which specifies the name of that element.

[0102] Correspondingly, the activity icon Ac of activity A56 is provided with input areas R562 and R563, respectively, for entering values ​​into activity definition information D562 and D563. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing input areas R562 and R563 in their default state and displays it on the display 244. The user can then input values ​​into input areas R562 and R563 by operating the UI 24. In the example in Figure 8A, "Sheet Name" is selected as the value for activity definition information D562, and "Overtime Calculation" is selected as the value for activity definition information D563. Therefore, when activity A56 is executed, the sheet whose name is "Overtime Calculation" in the spreadsheet file opened by activity A55 becomes active.

[0103] Activity A57 retrieves values ​​from the active spreadsheet file at the time of its execution, according to the activity definition information D57. Specifically, the spreadsheet file is opened and made active by Activity A56, which is executed before Activity A57. Therefore, values ​​are retrieved from this spreadsheet file. Activity A57 creates a variable V57 and retrieves the information to be entered into variable V57. The activity definition information D57 of Activity A57 includes activity definition information D571, which specifies the name (year) of variable V57. Furthermore, the activity definition information D57 of Activity A57 includes activity definition information D572, which specifies the format of the value to be retrieved, and activity definition information D573, which specifies the column of the value to be retrieved.

[0104] Correspondingly, the activity icon Ac of activity A57 is provided with input areas R572 and R573, respectively, for entering values ​​into activity definition information D572 and D573. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing input areas R572 and R573 in their default states and displays it on the display 244. The user can then input values ​​into input areas R572 and R573 by operating the UI 24. In the example in Figure 8A, "A1 format specification" is selected as the value of activity definition information D572, and "C10" is selected as the value of activity definition information D573. Therefore, when activity A57 is executed, the value of column C10 specified in activity definition information D573 is obtained in the format specified in activity definition information D572.

[0105] Activity A58 retrieves values ​​from the active spreadsheet file at the time of its execution, according to the activity definition information D58. Specifically, the spreadsheet file is opened and made active by Activity A56, which is executed before Activity A58. Therefore, values ​​are retrieved from this spreadsheet file. Activity A58 creates a variable V58 and retrieves the information to be entered into variable V58. The activity definition information D58 of Activity A58 includes activity definition information D581, which specifies the name (month) of variable V58. Furthermore, the activity definition information D58 of Activity A58 includes activity definition information D582, which specifies the format of the value to be retrieved, and activity definition information D583, which specifies the column of the value to be retrieved.

[0106] Correspondingly, the activity icon Ac of activity A58 is provided with input areas R582 and R583, respectively, for entering values ​​into activity definition information D582 and D583. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing input areas R582 and R583 in their default state and displays it on the display 244. The user can then input values ​​into input areas R582 and R583 by operating the UI 24. In the example in Figure 8A, "A1 format specification" is selected as the value of activity definition information D582, and "B7" is selected as the value of activity definition information D583. Therefore, when activity A58 is executed, the value of column B7 specified in activity definition information D583 is obtained in the format specified in activity definition information D582.

[0107] Activity A59 is an activity that launches a web browser in web drive mode. Activity A59 creates a variable V59 and retrieves the information entered into variable V59. Activity definition information D59 of Activity A59 includes activity definition information D591, which specifies the name of variable V59 (attendance system), and activity definition information D592, which specifies the value to be retrieved as the actual value of variable V59. Activity definition information D592 specifies the URL.

[0108] In response to this, the activity icon Ac of activity A59 is provided with an input area R592 for entering a value into the activity definition information D592. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing the input area R592 in its default state and displays it on the display 244. The user can then enter a value into the input area R592 by operating the UI 24. Therefore, when activity A59 is executed, the URL specified by the actual value entered into the activity definition information D592 is opened by the web browser in web drive mode and entered into the variable V59 (attendance system).

[0109] Activity A60 is an activity that performs input into a text field according to the activity definition information D60. The activity definition information D60 for Activity A60 includes activity definition information D602 and D603, which specify the text field on the page opened by the attendance system (variable V59), and activity definition information D604, which specifies the value to be entered.

[0110] Correspondingly, the activity icon Ac of activity A60 is provided with input areas R602, R603, and R604, respectively, for entering values ​​into the activity definition information D602, D603, and D604. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing each of the input areas R602, R603, and R604 in their default state and displays it on the display 244. The user can then input values ​​into each of the input areas R602, R603, and R604 by operating the UI 24. In the example in Figure 8A, "Xpath" is selected as the value of activity definition information D602, and " / / td[2] / input" is selected as the value of activity definition information D603. In addition, the numerical value "1934" is entered as the value of activity definition information D604. Therefore, when Activity A60 is executed, the login ID (variable V52) is entered into the HTML element described in Activity Definition Information D602 and D603, the input text is cleared, and the number "1934" is entered.

[0111] Activity A61 is an activity that performs input into a text field according to the activity definition information D61. The activity definition information D61 for Activity A61 includes activity definition information D612 and D613, which specify the text field on the page opened by the attendance system (variable V59), and activity definition information D614, which specifies the value to be entered.

[0112] Correspondingly, the activity icon Ac of activity A61 is provided with input areas R612, R613, and R614, respectively, for entering values ​​into the activity definition information D612, D613, and D614. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing each of the input areas R612, R613, and R614 in their default state and displays it on the display 244. The user can then input values ​​into each of the input areas R612, R613, and R614 by operating the UI 24. In the example in Figure 8A, "Xpath" is selected as the value for activity definition information D612, and " / / td[2] / td[2] / input" is selected as the value for activity definition information D613. In addition, the numerical value "1934" is entered as the value for activity definition information D614. Therefore, when Activity A61 is executed, the login ID (variable V52) is entered into the HTML element described in Activity Definition Information D612 and D613, the input text is cleared, and the number "1934" is entered.

[0113] With the target scenario display screen 8 of Figure 8A displayed on the display 244, when the operation to select menu 821 indicating "Insert block with comments" is confirmed ("YES" in step S203), the automatic check / comment information creation unit 42 sends check / comment information I4, which includes the selected activity and a request for a description of the activity, to the LLM 12 (step S204). Upon receiving this check / comment information I4, the LLM 12 creates response information I5, which shows comments describing the operation of the activity, and outputs it to the automatic check / comment display unit 43. When the automatic check / comment display unit 43 receives the response information I5, which shows the response to the check / comment information I4 ("YES" in step S205), it displays a response result display screen 87 (Figure 8B) showing the response information I5 (check / comment information result) on the display 244. This response information I5 indicates the commented scenario Smc, which will be described later, using a text-based general-purpose programming language.

[0114] The response result display screen 87 has a commented scenario display section 88. The commented scenario Smc displayed in the commented scenario display section 88 has a configuration in which comment blocks B (comment blocks B11 to B13 in Figure 8B) are inserted into the scenario Sm. Each of the comment blocks B11, B12, and B13 shows a comment for the corresponding activity A. That is, comment block B11 shows a comment that explains the operation of the corresponding activities A51 to A54. Comment block B12 shows a comment that explains the operation of the corresponding activities A55 to A58. Comment block B13 shows a comment that explains the operation of the corresponding activities A59 to A61.

[0115] Each of the comment blocks B11, B12, and B13 is displayed in the commented scenario display unit 88 by a block icon Bc. The block icon Bc has a comment display unit Bcc, a parameter display unit Bcp, and a bar Bcb.

[0116] The comment display section Bcc is displayed adjacent to the activity type information C indicated by the activity icon Ac of the corresponding activity A, from above. This comment display section Bcc has a comment display area Bcr, which displays a comment (text) that describes the operation of the corresponding activity A. In other words, the comment display area Bcr of the comment display section Bcc of comment block B11 displays the comment "Set the parameters required for execution" which describes the operation of activities A51 to A54 corresponding to comment block B11. The comment display area Bcr of the comment display section Bcc of comment block B12 displays the comment "Get the year and month" which describes the operation of activities A55 to A58 corresponding to comment block B12. The comment display area Bcr of the comment display section Bcc of comment block B13 displays the comment "Log in to the attendance system and get overtime hours" which describes the operation of activities A59 to A61 corresponding to comment block B13.

[0117] The parameter display section Bcp is displayed adjacent to the activity definition information D indicated by the activity icon Ac of the corresponding activity A, from above. This parameter display section Bcp shows the input and output parameters used in the corresponding activity A. In other words, the parameter display section Bcp of comment block B11 shows the parameters (overtime calculation file, login ID, destination address, password) output from activities A51 to A54 corresponding to comment block B11. The parameter display section Bcp of comment block B12 shows the parameters (overtime calculation file) input to activities A55 to A58 corresponding to comment block B12, and the parameters (year, month) output from activities A55 to A58. The parameter display section Bcp of comment block B13 shows the parameters (login ID, password, year, month) input to activities A59 to A16 corresponding to comment block B13, and the parameters (attendance system, overtime hours) output from activities A59 to A61.

[0118] Bar Bcb extends to the left of the corresponding activity A and across that activity A. In other words, the bar Bcb for comment block B11 extends to the left of activities A51-A54 that correspond to comment block B11 and across those activities A51-A54. The bar Bcb for comment block B12 extends to the left of activities A55-A58 that correspond to comment block B12 and across those activities A55-A58. The bar Bcb for comment block B13 extends to the left of activities A59-A61 that correspond to comment block B13 and across those activities A59-A61. The user can visually confirm activities A51-A54, A55-A58, and A59-A61 that correspond to comment blocks B11, B12, and B13, respectively, by this bar Bcb.

[0119] According to the embodiment described above, when a user inputs natural language indicating the task to be automated (step S101), activity A corresponding to the computer execution process indicated by the natural language input L is obtained (step S103). Then, search activity information I2 indicating this activity A is displayed to the user on the search results display screen 6 (step S104). Therefore, the user can easily confirm activity A corresponding to the task to be automated simply by inputting natural language. Furthermore, when the user selects activity A from the search information I1 displayed on the search results display screen 6, a scenario creation instruction including the selected activity A based on the search information I1 is received (step S105). Then, a scenario Sm is obtained based on the scenario creation information I3 including the selected activity A (selection information) and the natural language input L at the time the scenario creation instruction is received (steps S106, S107). Then, the scenario Sm (automatic scenario creation result) consisting of activity icons Ac (activity GUI) for which parameter settings can be configured is displayed on the creation result display screen 7 (GUI) indicating the scenario Sm. In this way, the user is shown the searched activity A for the automation target task indicated by the user's natural language input L (steps S104, S105) for confirmation, and then a scenario Sm using that activity A is created. Therefore, the options presented to the user for confirmation of activity A can be narrowed down. As a result, the user can easily adjust the course of scenario creation by making a selection from a limited number of options. Furthermore, since the scenario Sm is created based on activity A that has been confirmed by the user, a highly accurate scenario Sm can be created stably. As a result, it is possible to assist the user in creating scenarios so that they can easily create scenarios Sm for a variety of tasks.

[0120] Furthermore, in the above example, the task to be automated indicated by the natural language input L consists of a first step, "extracting a table from a document file," and a second step, "writing to a spreadsheet file." Therefore, the search information creation unit 31 divides it into a first description, "extracting a table from a document file," which corresponds to the first step, and a second description, "writing to a spreadsheet file," which corresponds to the second step, to create search information I1. The search results display screen 6, which shows the search activity information I2, then distinguishes between activity A11 (first activity), which corresponds to the first description, "extracting a table from a document file," and activities A21 to A24 (second activities), which correspond to the second description, "writing to a spreadsheet file." With this configuration, the user can easily check the search activity information I2 for the natural language they have entered.

[0121] Furthermore, the Activity Icon Ac (Activity GUI) includes an area (Type area) that displays Activity Type Information C, which shows the type of Activity A, and an area (Parameter area) that displays Activity Definition Information D, which allows parameter settings to define the operation of the activity. In contrast, the search results display screen 6, which displays Search Activity Information I2, shows Activity A through a display corresponding to the area that displays Activity Type Information C. In this configuration, the user can easily confirm the type of Activity A by the Search Activity Information I2 displayed on the search results display screen 6.

[0122] Furthermore, the activity icon Ac (activity GUI) included in scenario Sm displayed on the parameter setting screen 73 has an area (parameter area) that shows activity definition information D, which allows for parameter setting to define the operation of activity A. In addition, the activity icon Ac has a default input area R within the area that shows activity definition information D. In this configuration, the user can easily set parameters according to their requirements by entering them into the input area R. Here, the default state of the input area R, where parameters are entered in a text box, is, for example, empty.

[0123] Furthermore, the creation result display screen 7 simultaneously displays the natural language input L and the scenario Sm (the result of automatic scenario creation) (task display unit 711, scenario display unit 72). In this configuration, the user can set parameters while confirming the automation target task (natural language input L) that they entered in natural language and the scenario Sm.

[0124] Furthermore, the creation result display screen 7 displays the natural language input L, the scenario Sm, and a recreate button 712 that accepts instructions to recreate the scenario Sm. In this configuration, the user can check the automation target task (natural language input L) that they entered in natural language and the scenario Sm, and decide whether or not to recreate the scenario Sm.

[0125] Furthermore, the editing operation unit 41 accepts the operation of pressing the copy icon 713 as an instruction to reflect the scenario Sm (step S110). Then, when the editing operation unit 41 accepts the operation of pressing the copy icon 713, it accepts the parameter setting. In this configuration, the parameter setting can be accepted after confirming the user's intention to reflect the scenario Sm.

[0126] Furthermore, the natural language input L and the scenario Sm obtained in response to the scenario creation instruction are stored in association with each other. In this configuration, the user can retrospectively check the history by, for example, performing an operation on the UI 24 to read the natural language input L and scenario Sm from the storage unit 22 and display them on the display 244.

[0127] As described above, in the embodiments shown in Figures 7A to 7C, when a user provides a check / comment instruction (natural language output instruction) for a scenario Sm (automation scenario) (step S201), the improved scenario Smr output from the LLM12 in response to the check / comment instruction is displayed in the improved scenario display unit 85, and text (natural language output) indicating the improvements in the improved scenario Smr is displayed in the improvement point explanation display unit 84. Therefore, the user can easily understand information about the RPA scenario Sm by checking the displayed text (natural language output).

[0128] Furthermore, in the embodiments shown in Figures 8A to 8B, when a check / comment instruction (natural language output instruction) for scenario Sm (automation scenario) is received from the user (step S201), the commented scenario Smc output from LLM12 in response to the check / comment instruction is displayed in the commented scenario display unit 88, and text (natural language output) explaining the operation of activity A included in the commented scenario Smc is displayed in the comment display area Bcr. Therefore, the user can easily understand the information regarding the RPA scenario Sm by checking the displayed text (natural language output).

[0129] Furthermore, the improved scenario Smr (Figure 7C) is modified based on the improvements (natural language output) that are output to the selected scenario Sm. In this configuration, users can easily understand information about the RPA scenario Sm by checking the improved scenario Smr (modified scenario).

[0130] Furthermore, the commented scenario Smc (Figure 8B) is modified based on the comments (natural language output) that the selected scenario Sm outputs to that scenario Sm (i.e., comment block B is inserted). In this configuration, users can easily understand information about the RPA scenario Sm by checking the commented scenario Smc.

[0131] Furthermore, the scenario Sm is stored as a text-based general-purpose programming language. Improvements and comments (natural language output) are output when the check / comment information I4 (input information) containing the scenario Sm is input to LLM12 (steps S204-205). In this configuration, improvements and comments (natural language output) can be obtained using LLM12.

[0132] Furthermore, in the examples shown in Figures 7A to 7C, the improvements resulting from the review of scenario Sm are displayed in the improvement explanation display unit 84. The improved scenario Smr is a scenario that reflects the improvement suggestions based on the review results. With this configuration, the user can easily understand how scenario Sm is improved based on the improvements (review results) shown in the improvement explanation display unit 84.

[0133] Furthermore, the improvements (review results) and the improvement scenario Smr are associated and stored in the memory unit 22. In this configuration, the user can easily understand retrospectively what modifications were made to the improvement scenario Smr by referring to the improvements.

[0134] Furthermore, in the examples in Figures 8A and 8B, comments explaining the actions performed by scenario Sm are displayed in the comment display area Bcr. The commented scenario Smc (modified scenario) includes comment blocks B11, B12, and B13 (activity GUI) containing the comments. In this configuration, the user can easily understand the actions of scenario Sm based on the comments contained in comment blocks B11, B12, and B13. The comments included in the response information I5 from LLM12 are displayed in the comment display area Bcr. In this case, it is not necessary to display all comments included in the response information I5 in the comment display area Bcr; some comments may be displayed in the comment display area Bcr.

[0135] Furthermore, the automatic check and comment information generation unit 42 has pre-stored review points for considering improvements to scenario Sm, and creates check and comment information I4 including these review points and sends it to LLM12. Therefore, even users who do not have knowledge of such review points can easily obtain an improved scenario Smr based on appropriate review points.

[0136] It should be noted that the present invention is not limited to the embodiments described above, and various modifications can be made to those described above without departing from the spirit of the invention. For example, it is not essential to configure the system to display the parameter setting screen 73. Therefore, the scenario display unit 72 of the creation result display screen 7 may be configured to allow parameter setting.

[0137] Furthermore, the specific display method of Scenario Sm on the creation result display screen 7 can be changed in various ways. In other words, parameter settings for Scenario Sm are performed using the parameter setting screen 73. Therefore, it is not necessary to be able to set parameters on the creation result display screen 7. Thus, Scenario Sm may be displayed using image data that constitutes the screen shown in Figure 4B.

[0138] Furthermore, the activity A displayed in the scenario display unit 72 of the creation result display screen 7 is not limited to the activity A included in the search activity information I2 from the search unit 13. Therefore, other activity A that is frequently used together with the activity A included in the search activity information I2 may also be displayed as search results in the phrase-corresponding activity display unit 65. Specifically, the search result display unit 32 has a table or the like that associates one activity A with other activity A that is frequently used together with that activity A. Then, the search result display unit 32 displays the activity A that is associated with the activity A included in the search activity information I2 by the table. In other words, the search results showing the activity A obtained from the search unit 13 and the activity A related to that activity are displayed in the phrase-corresponding activity display unit 65. With this configuration, the user can broadly search for and confirm the activities necessary to create a scenario Sm for automating the automation target business.

[0139] Furthermore, in steps S101 to S102, the specific content of the search information I1 created in response to the natural language input L can be modified as appropriate. For example, the system can be configured to adjust the strictness of the search for activity A in response to the natural language input L. In this modified example, the search information creation unit 31 accepts input to the UI 24 that specifies the strictness of activity A (strictness specification input). This strictness specification may be in natural language, such as "search with high strictness" or "search with low strictness," or it may be specified by operating a bar displayed on the display 244 that accepts operations to change the strictness.

[0140] In response, the search information creation unit 31 creates search information I1 including the strictness specification and sends it to the search unit 13. The search unit 13 adjusts the number of activity A included in the search activity information I2 according to the strictness included in the search information I1. As a result, when the strictness is high, the number of activity A included in the search activity information I2 is less than when the strictness is low. In this configuration, the user can adjust the number of activity A displayed on the search results display screen 6 according to their requirements by changing the strictness.

[0141] Furthermore, the type of Activity A searched for in a single phrase is not limited to one type as in the example above; there may be multiple types. For example, for the phrase "send an email," there may be multiple types of applications that can perform the task indicated by that phrase, "send an email." In this case, the search unit 13 creates search activity information I2, which includes Activity A corresponding to each of the multiple types of applications, and sends it to the search results display unit 32. The search results display unit 32 then displays the activity type information C of Activity A corresponding to each of the multiple types of applications on the search results display screen 6.

[0142] Furthermore, in the above embodiment, the setting of parameters for the creation result display screen 7, which displays the result of creating scenario Sm, is restricted, while the setting of parameters for the parameter setting screen 73, to which scenario Sm has been copied by an operation on the copy icon 713, is permitted. This allows the user to perform an operation on the copy icon 713, confirm the user's intention to adopt scenario Sm, and then permit the setting of parameters for scenario Sm. In other words, it is possible to avoid the problem of parameters being set for scenario Sm against the user's will. When focusing on this function, the specific method for creating scenario Sm is not limited to the above example. Therefore, scenario Sm may be created by a method other than having the search unit 13 search for activity A for natural language input L.

[0143] Furthermore, the search results display unit 32 may display points to note when creating a scenario Sm on the search results display screen 6. For example, when extracting a table from a document file, an announcement such as "The document file must contain string data. Please try copying it with the mouse beforehand." can be displayed on the search results display screen 6. Alternatively, an announcement such as "This process may take some time, and you may encounter errors such as 'file does not exist' when you run it. In that case, please try adding a wait activity." can be displayed on the search results display screen 6. Alternatively, a button to ask the AI ​​for points to note may be provided on the search results display screen 6.

[0144] Furthermore, if a rule violation is confirmed as a result of the check by the violation check unit 5, the violation check unit 5 may be configured to instruct the LLM 12 to recreate the scenario Sm without passing it on to the creation result display unit 34. In this way, when the violation check unit 5 receives the scenario Sm with the rule violation resolved from the LLM 12, it can pass the scenario Sm on to the creation result display unit 34.

[0145] Furthermore, various specific configurations are possible for the response information I5 received in step S205 of Figure 6. Therefore, in the examples of Figures 8A and 8B, the line number corresponding to the comment (explanatory result) included in the response information I5 may be specified. Specifically, it is as follows.

[0146] Scenario Sm is written in a general-purpose programming language. In response, the automatic check and comment information creation unit 42 inserts identification text to identify line numbers in the general-purpose programming language that describes Scenario Sm, at the locations corresponding to Activity A, and creates check and comment information I4. Therefore, the automatic check and comment display unit 43 receives answer information I5 from LLM12, which has line numbers attached to the locations of Activity A described in Scenario Sm. In addition, the comments included in the answer information I5 are attached to the line numbers of Activity A corresponding to the comments. When the automatic check and comment display unit 43 displays the answer information I5 on the answer result display screen 87, it adjusts the display location of comment block B according to the line numbers included in the answer information I5. In other words, comment block B is inserted at a position corresponding to a predetermined number of lines prior to the line number of Activity A corresponding to the comment indicated by comment block B.

[0147] In this modified version, the response information I5 (explanation result) includes an identification text (specification information) that specifies the line number of the activity icon Ac (activity GUI) included in scenario Sm, and a comment (operation description information) that describes the operation performed by the activity icon Ac specified by the identification text. The commented scenario Smc (modified scenario) shown by the response information I5 includes the comment and a block icon Bc (activity GUI) that has a shape (bar Bcb) based on the comment. In this configuration, the user can easily understand the operation of scenario Sm based on a portion of the comment (operation description information) included in the block icon Bc.

[0148] Furthermore, the specific display methods for improvement points and comments are not limited to those provided by the improvement point explanation display unit 84 or the comment display area Bcr described above. Therefore, improvement points or comments may be displayed in a chat format, and the user's natural language input regarding improvement points or comments may be accepted. Such natural language input is transmitted to the LLM 12 by the automatic check / comment information creation unit 42, and when the automatic check / comment display unit 43 receives a response from the LLM 12, it displays this response in a chat format. Here, the chat format refers to a format in which the user's input and the response from the LLM 12 are displayed on a single screen in chronological order. This makes it possible for the user to easily check improvement points or comments in a chat format. In addition, the history of this chat can be stored, for example, in the storage unit 22. Furthermore, the chat history stored in the storage unit 22 can be read as appropriate, and the response information I5 can be output from the communication unit 25 to the outside of the terminal device 2.

[0149] Furthermore, it is not essential to have a function to perform scenario creation assistance as shown in Figure 3, and the automatic creation unit 3 does not necessarily need to be provided. [Industrial applicability]

[0150] This invention is applicable to all RPA (Robotic Process Automation) technologies that aim to reduce the burden on users by automating tasks that users previously performed using computers. [Explanation of Symbols]

[0151] 1…Scenario Management System 11… Server 2…Terminal device 111...Storage section 12…LLM 13…Search section 21...Arithmetic section 22...Storage section 24…UI 25… Communications Department 26... Bus 221...Memory section 222...Storage section 241... Keyboard 242…Mouse 243... Mike 244…Display II... Input Information Io…Output Information G... Scenario Management Program 3...Automatic creation section 4…Editor 5…Violation Check Department 31…Search Information Creation Department 32... Search Results Display Section 33…Scenario Information Creation Department 34…Display section for creation results 41…Editing Operations Department 42...Automatic Checking and Comment Information Creation Department 43...Automatic check and comment display section S101...Step L...Natural Language Input I1… Search Information S102...Step A... Activity I2…Search Activity Information S103...Step 6…Search results display screen S104...Step 61...Natural language input display section 62... Tab selection section 63... Search Results Display Section 64... Segment-corresponding activity display section 65... Segment-corresponding activity display section 641... Sentence segment display 642... Activity display section A11…Activities C... Activity type information 651... Sentence segment display 652... Activity display section A21…Activities A22…Activity A23…Activity A24…Activities 69... Scenario creation button S105...Step I3...Scenario creation information S106...Step Sm... Scenario Ps... System prompt Psa... Natural Language Information Psb... Function definition information Psc... Sample Code S107...Step 7…Screen displaying the creation results S108...Step Ac... Activity icon 711... Task display section 72...Scenario display section D...Activity definition information V11...Variable D11...Activity definition information D111...Activity definition information D112...Activity definition information D113...Activity definition information D114...Activity definition information R112...Input area V21...Variable D21...Activity definition information D211...Activity definition information D212...Activity definition information R212...Input area D22...Activity definition information D221...Activity definition information D222...Activity definition information D223...Activity definition information D224...Activity definition information R221...Input area D225...Activity definition information R225...Input area D23...Activity definition information V23...Variable D231...Activity definition information D232...Activity definition information R232... Input area D24... Activity definition information 712... Recreate button S109...Step S110...Step 713... Copy icon 73...Parameter setting screen 731...Parameter setting section S111...Step R...Input area S112...Step 732...Confirm button S113...Step S114...Step 714... button S201...Step 86...Scenario List Display Section 862... List 8…Screen display screen for the target scenario S202...Step 81...Scenario display section A31…Activity V31...Variable D31...Activity definition information D311...Activity definition information D312...Activity definition information D313... Activity definition information D314... Activity definition information D315...Activity definition information D316...Activity definition information D317...Activity definition information D318... Activity definition information D319... Activity definition information R312...Input area A32…Activities V32...Variable D32...Activity definition information D321...Activity definition information D322...Activity definition information D323...Activity definition information D324... Activity definition information R322...Input area A33…Activity V33...Variable D33... Activity definition information D331...Activity definition information D332...Activity definition information D333... Activity definition information R332...Input area A34…Activities V34...Variable D34... Activity definition information D341...Activity definition information D342...Activity definition information D343... Activity definition information D344... Activity definition information R342...Input area A35…Activities V35...Variable D35...Activity definition information D351...Activity definition information D352...Activity definition information D353... Activity definition information R352...Input area A36…Activities V36...Variable D361...Activity definition information D362...Activity definition information D363... Activity definition information D364... Activity definition information R362...Input area A37…Activities V37...Variable D37...Activity definition information D371...Activity definition information D372...Activity definition information D373...Activity definition information R372...Input area S203...Step 82...Context menu 821... Menu 822... Menu I4…Comment Information S204...Step I5…Answer information S205...Step 83…Answer result display screen Smr... Improvement Scenario 84…Display section explaining improvements 85...Improvement Scenario Display Section A41…Activities V41...Variable D41...Activity definition information D411...Activity definition information D412...Activity definition information R412...Input area A42…Activities V42...Variable D42...Activity definition information D421...Activity definition information D422...Activity definition information R422...Input area A43…Activity V43...Variable D43...Activity definition information D431...Activity definition information D432...Activity definition information D433... Activity definition information D434... Activity definition information D435...Activity definition information D436...Activity definition information D437...Activity definition information D438...Activity definition information R432...Input area A44…Activity A45…Activities Acb... Bar V44...Variable D44... Activity definition information D441...Activity definition information V45...Variable D45...Activity definition information D451...Activity definition information D452...Activity definition information D453...Activity definition information R452...Input area A46…Activity V46...Variable D46...Activity definition information D461...Activity definition information D462...Activity definition information R462...Input area 831... Copy icon 861…Date A51…Activity V51...Variable D51...Activity definition information D511...Activity definition information D512...Activity definition information R512...Input area A52…Activity V52... Variable D52...Activity definition information D521...Activity definition information D522...Activity definition information R522...Input area A53...Activity V53...Variable D53...Activity definition information D531...Activity definition information D532...Activity definition information R532...Input area A54…Activity V54... Variable D54...Activity definition information D541...Activity definition information D542...Activity definition information R542...Input area A55…Activity V55...Variable D55...Activity definition information D551...Activity definition information A56…Activity D56...Activity definition information D562...Activity definition information D563...Activity definition information R562...Input area A57…Activities D57...Activity definition information V57...Variable D571...Activity definition information D572...Activity definition information D573...Activity definition information R572...Input area A58...Activity D58...Activity definition information V58... Variable D581...Activity definition information D582...Activity definition information D583...Activity definition information R582...Input area A59…Activity V59...Variable D59...Activity definition information D591...Activity definition information D592...Activity definition information R592...Input area A60…Activity D60…Activity definition information D602...Activity definition information D604...Activity definition information R602...Input area D603...Activity definition information A61…Activity D61...Activity definition information D612...Activity definition information D614...Activity definition information R612...Input area D613...Activity definition information 87…Answer result display screen Smc...Scenario with comments 88...Scenario display section with comments B...Comment Block B11...Comment Block B12... Comment Block B13... Comment Block Bc... Block icon Bcc... Comment display section Bcp...Parameter display section Bcb... Bar Bcr... Comment display area

Claims

1. A method performed by a computing system, We accept selections of automation scenarios to automate the target tasks. The system accepts instructions for natural language output for the selected automation scenario. The natural language output that is output for the aforementioned automation scenario is obtained, The system displays the scenario output result, which consists of the acquired natural language output and an activity GUI that indicates an output scenario corresponding to the content of the natural language output. method.

2. The method according to claim 1, wherein the output scenario is a modified scenario in which the selected automation scenario is modified based on the natural language output output for the automation scenario.

3. The aforementioned automation scenario is stored as a text-based general-purpose programming language. The method according to claim 1, wherein the natural language output is produced when the input information including the automation scenario is input to a machine learning model.

4. The method according to claim 3, wherein the machine learning model is LLM.

5. The aforementioned natural language output is the review result for the automation scenario, The method according to claim 2, wherein the modified scenario is a scenario in which the improvement suggestions based on the review results are reflected.

6. The method according to claim 5, wherein the review results and the modified scenario are stored in association.

7. The aforementioned natural language output is an explanation of the operation realized by the automation scenario, The method according to claim 2, wherein the modified scenario includes the activity GUI which includes part of the described results.

8. The above explanation results include specification information that specifies the row number of the activity GUI included in the automation scenario, and operation explanation information that describes the operation to be performed by the activity GUI specified by the specification information, The method according to claim 7, wherein the modified scenario includes a portion of the operation description information and includes the activity GUI having a shape based on the specified information.

9. The method according to claim 7, wherein the explanation results are displayed in a chat format and natural language input is accepted for the explanation results.

10. A method performed by a computing system, We accept selections of automation scenarios to automate the target tasks. Accepts natural language output instructions for multiple activities included in the selected automation scenario, The natural language output that is output for the aforementioned multiple activities is obtained, The system displays the scenario output result, which consists of the acquired natural language output and an activity GUI that indicates an output scenario corresponding to the content of the natural language output. method.

Images