Method executed by computing system

Abstract

[Problem] To enable a user to easily create scenarios for various jobs. [Solution] When a user inputs natural language (step S101), an activity A corresponding to execution processing by a computer indicated by a natural language input L is acquired (step S103). Search activity information I2 indicating the activity A is displayed on a search result display screen 6 for the user (step S104). When the user selects the activity A from search information I1 displayed on the search result display screen 6, a scenario creation instruction is received, including the information that the activity A was selected based on the search information I1 (step S105). Then, a scenario Sm is acquired, which is based on scenario creation information I3 including the natural language input L and the activity A (selection information) selected at the time the scenario creation instruction was received (steps S106, S107).

Description

Methods performed by a computing system

[0001] The present invention relates to RPA (Robotic Process Automation) technology that aims to reduce the burden on users by automating tasks that users have previously performed using computers.

[0002] RPA can be used to automate tasks performed by users by operating applications run by a computer. This RPA automates tasks by executing a scenario that indicates the procedure for executing processing by a computer. As shown in Patent Document 1, this scenario is created by combining multiple activities, each of which indicates processing to be executed by the computer. Therefore, even a user with no programming knowledge can create a scenario by arranging the activities in the order of execution and setting values ​​such as numerical values ​​and paths for the activities as necessary.

[0003] In particular, Patent Document 1 proposes a technology that supports users in creating scenarios. Specifically, options corresponding to typical tasks that the user wishes to automate are provided. When an option is selected by the user, a GUI is displayed that guides the user through the steps of creating a scenario that executes the task corresponding to the selected option. Therefore, the user can create a scenario by following this guidance.

[0004] Japanese Patent Application Laid-Open No. 2023-54409

[0005] In the above technology, in order to create scenarios for various tasks according to user requests, a large number of options are prepared to correspond to the various tasks, but it is difficult for users to select an appropriate option from the large number of options.

[0006] The present invention has been made in consideration of the above-mentioned problems, and has as its object to assist users in creating scenarios so that they can easily create scenarios for a variety of tasks.

[0007] The method according to the present invention accepts natural language input indicating a task to be automated, acquires an activity corresponding to the computer-executed processing indicated by the natural language input, displays search results indicating the acquired activity, accepts a scenario creation instruction including activity selection information based on the search results, acquires a scenario based on the natural language input and the selection information in response to the scenario creation instruction, and displays the results of automatic scenario creation configured by an activity GUI that allows parameters to be set on a GUI indicating the acquired scenario.

[0008] According to the present invention configured as described above, when a user inputs a natural language indicating a task to be automated, an activity corresponding to the computer-executed process indicated by the natural language input is obtained. Then, search results indicating this activity are displayed to the user. Therefore, the user can easily confirm the activity corresponding to the task to be automated based on the search results, simply by inputting natural language. Furthermore, when the user selects an activity from the search results, a scenario creation instruction including selection information for the activity based on the search results is accepted. Then, a scenario based on the natural language input and the selection information is obtained, and the result of automatic scenario creation, configured by an activity GUI that allows parameter setting on a GUI indicating the scenario, is displayed. In this way, the user is prompted to confirm the activity searched for the task to be automated indicated by the user's natural language input, and then a scenario using the activity is created. Therefore, the options presented to the user for activity confirmation can be narrowed down. Therefore, the user can easily correct the course of scenario creation by selecting from limited options. Furthermore, because a scenario is created based on an activity confirmed by the user, highly accurate scenarios can be created reliably. As a result, it is possible to assist users in scenario creation, allowing them to easily create scenarios for a variety of tasks.

[0009] As described above, according to the present invention, it is possible to assist users in creating scenarios so that they can easily create scenarios for a variety of tasks.

[0010] 6 is a block diagram showing an example of a scenario management system including a scenario management device according to the present invention. FIG. 6 is a block diagram showing an example of functions configured in association with execution of a scenario management program by a calculation unit. FIG. 7 is a flowchart showing scenario creation assistance executed by a calculation unit in accordance with the scenario management program. FIG. 7 is a diagram showing a screen displayed on a display in accordance with the scenario creation assistance of FIG. 3. FIG. 8 is a diagram showing a screen displayed on a display in accordance with the scenario creation assistance of FIG. 3. FIG. 9 is a diagram showing a screen displayed on a display in accordance with the scenario creation assistance of FIG. 3. FIG. 10 is a diagram showing a system prompt. FIG. 11 is a flowchart showing natural language output executed by a calculation unit in accordance with the scenario management program. FIG. 12 is a diagram showing a screen displayed on a display in accordance with the natural language output of FIG. 1. FIG. 13 is a diagram showing a screen displayed on a display in accordance with the natural language output of FIG. 1. FIG. 14 is a diagram showing a screen displayed on a display in accordance with the natural language output of FIG. 1. FIG. 15 is a diagram showing a screen displayed on a display in accordance with the natural language output of FIG. 1.

[0011] FIG. 1 is a block diagram illustrating an example of a scenario management system including a scenario management device according to the present invention. The scenario management system 1 includes a server 11 and a terminal device 2 functioning as a client of the server 11. The server 11 is a computer and includes a storage unit 111 configured with a hard disk drive (HDD) or a solid state drive (SSD). The storage unit 111 stores a large language model (LLM) 12 and a search unit 13. The LLM 12 is a machine learning model that has previously trained natural language and has also previously trained general-purpose programming languages ​​such as C#. A specific example of the LLM 12 is ChatGPT (Generative Pretrained Transformer) (chatgpt is a registered trademark). The search unit 13 is a machine learning model that has previously trained activities that can be used to execute tasks indicated by natural language.

[0012] The terminal device 2 is a computer for managing scenarios used in RPA. The terminal device 2 includes a calculation unit 21, a storage unit 22, a UI (User Interface) 24, a communication unit 25, and a bus 26. The storage unit 22 is composed of a memory unit 221 and a storage unit 222. Signals are transmitted and received between the calculation unit 21, the memory unit 221, the storage unit 222, the UI 24, and the communication unit 25 via the bus 26.

[0013] The calculation unit 21 is a processor such as a CPU (Central Processing Unit), and controls the memory unit 221, the storage unit 222, the UI 24, and the communication unit 25. The memory unit 221 has a main memory, a cache memory, etc., and stores data in a volatile manner based on instructions from the calculation unit 21, and the calculation unit 21 executes calculations using data read from the memory unit 221.

[0014] The storage unit 222 includes an HDD, an SSD, etc., and stores data in a nonvolatile manner. The UI 24 includes input devices such as a keyboard 241, a mouse 242, and a microphone 243, and an output device such as a display 244. Therefore, a user can input data to the terminal device 2 by operating the keyboard 241, the mouse 242, or the microphone 243, and can check various data stored in the memory unit 221 or the storage unit 222 by checking the display 244. The input and output devices do not need to be configured separately; they may be integrated into a touch panel display. The communication unit 25 communicates with the server 11. The communication unit 25 transmits input information Ii to the server 11 in response to a user input operation received by the UI 24, and receives output information Io from the server 11, which is a response from the LLM 12 or the search unit 13 to the input information Ii.

[0015] The storage unit 222 also stores a scenario management program G. This scenario management program G is downloaded, for example, from an external server via the communication unit 25 and stored in the storage unit 222. However, the manner in which the scenario management program G is provided to the terminal device 2 is not limited to downloading from an external server. Therefore, the scenario management program G may be provided by other recording media such as an optical disc such as a DVD (Digital Versatile Disc) or a USB (Universal Serial Bus) memory. The terminal device 2 can read the scenario management program G from these recording media and store it in the storage unit 222. Furthermore, when the calculation unit 21 executes the scenario management program G, the functional units shown in FIG. 2 for executing scenario management are configured in the calculation unit 21.

[0016] In this embodiment, the scenarios used in RPA and managed by the terminal device 2 are scenarios for automating operations performed by the user of the terminal device 2 or other humans on application programs other than the scenario management program G. These operations include operations to obtain values ​​from application programs other than the scenario management program G, operations to process values, and operations to input values ​​into application programs other than the scenario management program G. The operations to obtain values ​​from application programs other than the scenario management program G include humans operating application programs other than the scenario management program G to output referenced information from an output device such as the display 244. The operations to input values ​​into application programs other than the scenario management program G include humans operating input devices such as the keyboard 241 and mouse 242 to input values ​​into application programs other than the scenario management program G. For example, these operations include directly inputting values ​​using the keyboard 241 and selecting values ​​to be input from options displayed by the application program using an input device.

[0017] As shown later in FIG. 4B , for example, a scenario is composed of multiple activities, and each activity specifies an operation to be executed by a computer. Specific examples of activities include: an activity for retrieving a table written in CSV (Comma-Separated Values) format or the like; an activity for filtering the values ​​in the table using specified conditions; an activity for extracting values ​​from the table; an activity for outputting the values ​​to an output destination (e.g., a table, a web page, an email address); an activity for accessing a specified web page; and an activity for retrieving images or text from a web page. A user can then arrange the activities in a desired order using UI 24 to create a scenario in which the activities are executed in that order.

[0018] 2 is a block diagram showing an example of functions configured in association with the execution of a scenario management program by a calculation unit. When the calculation unit 21 executes the scenario management program G, an automatic creation unit 3, an editor 4, and a violation check unit 5 are configured in the calculation unit 21. The automatic creation unit 3 has a search information creation unit 31, a search result display unit 32, a scenario information creation unit 33, and a creation result display unit 34. The editor 4 has an editing operation unit 41, an automatic check / comment information creation unit 42, and an automatic check / comment display unit 43.

[0019] Fig. 3 is a flowchart showing the scenario creation assistance executed by the calculation unit in accordance with the scenario management program, and Figs. 4A, 4B, and 4C are diagrams schematically showing screens that are displayed on the display by the scenario creation assistance of Fig. 3. The screens of Figs. 4A, 4B, and 4C are displayed on the display 244 by the calculation unit 21 controlling the display 244.

[0020] In step S101, the search information creation unit 31 confirms whether a user's natural language input L has been acquired from the UI 24. Here, the natural language input L is a natural language input by the user accepted by the UI 24 and is composed of a character string representing the natural language. For example, the UI 24 accepts the natural language input L based on the user's operation on the keyboard 241 or mouse 242 of the UI 24. Alternatively, the UI 24 accepts the natural language input L by detecting the user's voice with the microphone 243 of the UI 24. Upon accepting the natural language input L, the UI 24 transmits the natural language input L to the search information creation unit 31 and the storage unit 22. The storage unit 22 stores the natural language input L received from the UI 24.

[0021] When the search information creation unit 31 acquires a natural language input L from the UI 24 ("YES" in step S101), it creates search information I1 based on the natural language input L (step S102). Specifically, the search information creation unit 31 analyzes the segments included in the natural language input L. If the natural language input L contains multiple phrases, the search information creation unit 31 divides the natural language input L into multiple phrases. For example, if the natural language input L is "extract a table from a document file and write it in a spreadsheet file," the search information creation unit 31 divides the natural language input L into the phrase "extract a table from a document file" and the phrase "write it in a spreadsheet file." In this way, search information I1 is created, which shows the natural language input L divided into each phrase.

[0022] Then, the search information creation unit 31 transmits the search information I1 (input information Ii) to the search unit 13 via the communication unit 25 (step S102). In the above example, the search information I1 indicating the phrases "extract a table from a document file" and "write it into a spreadsheet file" is transmitted to the search unit 13.

[0023] The search unit 13 searches for an activity that performs the work indicated by the segment indicated by the search information I1. The search unit 13 has previously learned the correspondence between natural language and activities, and searches for an activity that corresponds to the natural language indicated by the phrase. Specifically, the search unit 13 has a search engine that searches for activity A. This search engine has pre-registered indexes such as information about activity A and keywords related to activity A. Various specific search methods are conceivable. Therefore, various methods that can perform highly accurate searches for natural language input L, such as vector search and semantic search, can be adopted. The search unit 13 then transmits search activity information I2 (output information Io) that indicates the phrases and the activities corresponding to the phrases in association with each other to the communication unit 25.

[0024] In step S103, the search result display unit 32 checks whether the communication unit 25 has received the search activity information I2. When the communication unit 25 receives the search activity information I2 (YES in step S103), the search result display unit 32 creates a search result display screen 6 ( FIG. 4A ) showing the search activity information I2 and displays it on the display 244 (step S104).

[0025] 4A , the search result display screen 6 has a natural language input display unit 61. The natural language input display unit 61 displays the natural language input L acquired by the search information creation unit 31 from the UI 24 in step S101. Specifically, the search result display unit 32 displays the natural language input L read from the storage unit 22 on the natural language input display unit 61.

[0026] The search result display screen 6 also has a tab selection section 62. The tab selection section 62 includes multiple tabs ("Basic tab," "AI search tab," and "All tab"), and the search result display screen 6 displays a screen corresponding to one tab selected from the multiple tabs in the tab selection section 62. In the example of Fig. 4A, the "AI search tab" is selected. This "AI search tab" displays the activity searched for in response to the natural language input L, i.e., search activity information I2.

[0027] The "AI search tab" on the search result display screen 6 has a search result display section 63 that displays the search activity information I2 received by the search result display unit 32 in step S103. This search result display section 63 has phrase-corresponding activity display sections 64 and 65. The phrase-corresponding activity display sections 64 and 65 are created in accordance with each phrase divided from the natural language input L in step S102. The phrase-corresponding activity display sections 64 and 65 display the corresponding phrase and the type of activity searched for that phrase. In the example of FIG. 4A , a phrase-corresponding activity display section 64 corresponding to the phrase "extract a table from a document file" and a phrase-corresponding activity display section 65 corresponding to the phrase "write to a spreadsheet file" are created and displayed in the "AI search tab" on the search result display screen 6.

[0028] The phrase-corresponding activity display unit 64 has a phrase display unit 641 and an activity display unit 642. The phrase-corresponding activity display unit 64 displays a phrase corresponding to the phrase-corresponding activity display unit 64 in the phrase display unit 641. In the example of FIG. 4A , the phrase display unit 641 displays the phrase "extract a table from a document file." The phrase-corresponding activity display unit 64 also displays an activity A11 searched for in the phrase corresponding to the phrase-corresponding activity display unit 64 in the activity display unit 642. In particular, the activity display unit 642 displays the activity A11 based on activity type information C indicating the type of the activity. In the example of FIG. 4A , the activity A11 corresponding to the phrase "extract a table from a document file" is included in the search activity information I2. Therefore, the activity display unit 642 displays the activity type information C indicating the type of this activity A11.

[0029] The phrase-corresponding activity display unit 65 has a phrase display unit 651 and an activity display unit 652. The phrase-corresponding activity display unit 65 displays a phrase corresponding to the phrase-corresponding activity display unit 65 in the phrase display unit 651. In the example of FIG. 4A , the phrase display unit 651 displays the phrase "write to a spreadsheet file." The phrase-corresponding activity display unit 65 also displays activities A21 to A24 searched for the phrase corresponding to the phrase-corresponding activity display unit 65 in the activity display unit 652. In particular, the activity display unit 652 displays the activities A21 to A24 according to activity type information C indicating the type of activity. In the example of FIG. 4A , for the phrase "write to a spreadsheet file," the search activity information I2 includes the activity A21 that opens a spreadsheet file, the activity A22 that writes a value, the activity A23 that saves the spreadsheet file, and the activity A24 that closes the spreadsheet file. Therefore, the activity display section 652 displays activity type information C indicating the types of these activities A21 to A24.

[0030] The search result display unit 32 accepts a user operation on the UI 24 to select an activity to be used in creating a scenario from among the activities A11, A21 to A24 displayed in the search result display unit 63. For example, if there is no need to close a spreadsheet file, the user can execute an operation on the UI 24 to delete activity A24, which closes the spreadsheet file, and the search result display unit 32 deletes activity A24 from the search result display unit 63 in response to this operation. In this way, activities A11, A21 to A23 can be selected from among the activities A11, A21 to A24 displayed in the search result display unit 63. Note that selecting an activity includes selecting all of the activities A11, A21 to A24 displayed in the search result display unit 63.

[0031] The search result display screen 6 also has a scenario creation button 69. When the user presses the scenario creation button 69 on the UI 24, a scenario creation instruction is sent from the UI 24 to the scenario information creation unit 33 ("YES" in step S105). The scenario information creation unit 33 determines that the activity selected at the time of receiving the scenario creation instruction (in other words, the activity displayed in the search result display unit 63) will be used to create a scenario.

[0032] That is, the scenario information creation unit 33 creates scenario creation information I3 that includes the activity decided to be used in scenario creation and the natural language input L used to search for the activity (step S106). This scenario creation information I3 indicates that a scenario Sm that executes the work indicated by the natural language input L included in the scenario creation information I3 is to be created using the activity included in the scenario creation information I3. At this time, the scenario information creation unit 33 creates the scenario creation information I3 using the natural language input L read out from the storage unit 22. Furthermore, the scenario information creation unit 33 creates the scenario creation information I3 so as to include the system prompt Ps shown in FIG. 5.

[0033] FIG. 5 is a diagram illustrating an example of a system prompt. This system prompt Ps includes natural language information Psa, function definition information Psb, and sample code Psc. The natural language information Psa describes the role of the LLM 12, "RPA Tool Assistant," and the rules for creating the scenario Sm, written in natural language. The function definition information Psb describes methods and enums in a general-purpose programming language supported by the scenario management program G (in other words, the terminal device 2 on which the scenario management program G is installed). The sample code Psc indicates how to read the methods and enums described in the function definition information Psb using a general-purpose programming language. In this way, the system prompt Ps indicates the rules for writing the scenario Sm in a general-purpose programming language. The scenario information creation unit 33 then transmits the scenario creation information I3 (input information Ii) created in this way to the LLM 12 via the communication unit 25 (step S106).

[0034] In response to the scenario creation information I3, the LLM 12 outputs a scenario Sm created based on the scenario creation information I3. In other words, the LLM 12 has learned a general-purpose programming language. In response to this, the scenario creation information I3 input to the LLM 12 includes a system prompt Ps, which indicates the rules for writing the scenario Sm in a general-purpose programming language. Therefore, the LLM 12 creates source code for the scenario Sm indicated by the scenario creation information I3 in accordance with the rules indicated by the system prompt Ps. This source code is then output from the LLM 12 as the scenario Sm.

[0035] The scenario Sm output from the LLM 12 is checked by the violation check unit 5 and then passed to the creation result display unit 34. The violation check unit 5 checks whether the scenario Sm received from the LLM 12 violates the rules indicated by the system prompt Ps. The scenario Sm and the check results of the scenario Sm by the violation check unit 5 are then passed from the violation check unit 5 to the creation result display unit 34. When the creation result display unit 34 acquires the scenario Sm (creation result) created by the LLM 12 ("YES" in step S107), it displays the creation result display screen 7 (FIG. 4B) showing this scenario Sm on the display 244 (step S108). The details of this are as follows.

[0036] Based on the conversion table, the creation result display unit 34 converts the code representing each activity included in the source code describing the scenario Sm into an activity icon Ac representing that activity. This creates a creation result display screen 7 ( FIG. 4B ) in which each of the activities A11, A21 to A24 constituting the scenario Sm is represented by an activity icon Ac. The creation result display unit 34 then displays the creation result display screen 7 on the display 244. If the check result received from the violation check unit 5 indicates a violation of a rule, the creation result display unit 34 displays information indicating that the scenario Sm violates the rule on the creation result display screen 7. The information indicating the violation can be displayed, for example, by blinking the relevant portion.

[0037] As shown in FIG. 4B , the creation result display screen 7 has a task display section 711 and a scenario display section 72 provided below the message, "A sample scenario has been created for the following tasks." In the task display section 711, the natural language input for creating the scenario Sm is displayed following the character string "task." Specifically, the task display section 711 displays the natural language input L read from the storage unit 22.

[0038] Activity icons Ac for the activities A11, A21 to A24 included in the scenario Sm are arranged in the order of their execution and displayed in the scenario display section 72. Each of the activities A11, A21 to A24 is displayed in the scenario display section 72 by an activity icon Ac that indicates a combination of activity type information C that indicates the type of the activity and activity definition information D that defines the details of the activity.

[0039] Activity A11 is an activity that extracts a table from a document file. This activity A11 creates a variable V11 and extracts the table to be input to the variable V11. Activity definition information D11 of activity A11 includes activity definition information D111 that specifies the name of variable V11 (Table 1), and activity definition information D112, D113, and D114 that specify the value to be acquired as the entity value of variable V11. Activity definition information D112 specifies the path of the document file from which the table is to be extracted. Activity definition information D113 specifies the page of the document file from which the table is to be extracted. Activity definition information D114 specifies the order of the tables to be extracted from among the tables included on the page.

[0040] Correspondingly, the activity icon Ac of activity A11 is provided with input fields R112, R113, and R114 for inputting values ​​into activity definition information D112, D113, and D114, respectively. The creation result display unit 34 creates a creation result display screen 7 showing input fields R112, R113, and R114 in their default states, and displays it on the display 244. In response, the user can input values ​​into each of input fields R112, R113, and R114 by operating the UI 24. Therefore, when activity A11 is executed, the table specified by the entity values ​​entered into activity definition information D112, D113, and D114 is extracted and input into variable V11 (Table 1).

[0041] Activity A21 is an activity that opens a spreadsheet file, creates a variable V21, and opens the spreadsheet file specified by the path entered in variable V21. Activity definition information D21 for activity A21 includes activity definition information D211 that specifies the name of variable V21 (string1), and activity definition information D212 that specifies the value to be obtained as the entity value of variable V21. Activity definition information D212 specifies the path to the spreadsheet file.

[0042] Correspondingly, the activity icon Ac of activity A21 is provided with an input area R212 for inputting values ​​into the activity definition information D212. The creation result display unit 34 creates a creation result display screen 7 showing the input area R212 in a default state and displays it on the display 244. In response to this, the user can input values ​​into the input area R212 by operating the UI 24. Therefore, when activity A21 is executed, the path specified by the entity value entered into the activity definition information D212 is entered into variable V21 (string1), and the spreadsheet file at that path is opened.

[0043] Activity A22 writes a table in a sheet of a spreadsheet file that is active at the time that activity A22 is executed, in accordance with activity definition information D22. Specifically, activity A21, which is executed before activity A22, opens and activates the spreadsheet file. Therefore, the table is written in a sheet of the spreadsheet file. The activity definition information D22 for activity A22 includes activity definition information D221 that specifies the number of cells into which values ​​are to be written, activity definition information D222 that specifies the format in which the values ​​are to be written, activity definition information D223 that specifies the spreadsheet file, and activity definition information D224 that specifies the table into which to write.

[0044] Correspondingly, the activity icon Ac of activity A22 is provided with input fields R221, R222, R223, and R224 for inputting values ​​into activity definition information D221, D222, D223, and D224, respectively. The creation result display unit 34 creates a creation result display screen 7 showing the input fields R221, R222, R223, and R224 in their default states and displays it on the display 244. In response to this, the user can input values ​​into the input fields R221, R222, R223, and R224 by operating the UI 24. In the example of FIG. 4B , "single cell" is selected as the value of the activity definition information D221, and "A1 format specification" is selected as the value of the activity definition information D222. Furthermore, the value of the predefined variable V21 can be selected as the value of the activity definition information D223, and the value of the predefined variable V11 can be selected as the value of the activity definition information D224. Therefore, when activity A22 is executed, the table specified by activity definition information D224 is written in the spreadsheet file specified by activity definition information D223, in the format specified by activity definition information D222, and in the number of cells specified by activity definition information D221.

[0045] The activity definition information D22 also includes activity definition information D225 that indicates whether or not to output a column name. Correspondingly, the activity icon Ac of activity A22 is provided with an input area R225 (check box) for inputting a value into the activity definition information D225. The creation result display unit 34 creates a creation result display screen 7 showing the input area R225 in a default state and displays it on the display 244. In response, the user can input a value into the input area R225 (i.e., check a box) by operating the UI 24. Therefore, if the activity definition information D225 specifies output of a column name, when activity A22 is executed, the column name is output and displayed on the display.

[0046] Activity A23 saves the active spreadsheet file at the time of its execution in accordance with activity definition information D23. Specifically, activity A21, which executes before activity A23, opens and activates the spreadsheet file. This saves the spreadsheet file. Activity A23 creates variable V23 and saves the spreadsheet file in the format entered in variable V23. The activity definition information D23 for activity A23 includes activity definition information D231 that specifies the name (string2) of variable V23. The activity definition information D23 also includes activity definition information D232 that specifies the method for saving the spreadsheet file. Correspondingly, the activity icon Ac for activity A23 includes an input area R232 for inputting values ​​into the activity definition information D232. The creation result display unit 34 creates a creation result display screen 7 showing the input area R232 in a default state and displays it on the display 244. The user can then input values ​​into the input area R232 by operating the UI 24. In this example, "overwrite save" is selected as the value specified in the activity definition information D232. Therefore, when activity A23 is executed, the active spreadsheet file is overwritten and saved.

[0047] Activity A24 is an activity that closes a spreadsheet file that is active at the time that activity A24 is executed, in accordance with activity definition information D24. Specifically, a spreadsheet file is opened and made active by activity A21, which is executed before activity A24. Therefore, when activity A24 is executed, the spreadsheet file is closed.

[0048] A creation result display screen 7 showing the scenario Sm created in this way is displayed on the display 244 (step S108). This creation result display screen 7 has a recreate button 712 for accepting an instruction from the user to recreate the scenario Sm. In response to this, in step S109, the scenario information creation unit 33 checks whether the user has pressed the recreate button 712 on the UI 24. If the operation of pressing the recreate button 712 is confirmed (if "YES" in step S109), steps S106 to S108 are executed again, and the scenario Sm is created again. If the operation of pressing the recreate button 712 is not confirmed (if "NO" in step S109), the process proceeds to step S110.

[0049] A copy icon 713 is displayed on the creation result display screen 7. In response to this, in step S110, the editing operation unit 41 confirms whether the operation of pressing the copy icon 713 has been performed on the UI 24 by the user. If the operation of pressing the copy icon 713 is not confirmed (in the case of "NO" in step S110), the process returns to step S109. If the operation of pressing the copy icon 713 is confirmed (in the case of "YES" in step S110), the editing operation unit 41 displays a parameter setting screen 73 ( FIG. 4C ) on the display 244. This parameter setting screen 73 has a parameter setting section 731, and at the time the operation of pressing the copy icon 713 is performed, the scenario Sm displayed in the scenario display section 72 is copied to the parameter setting section 731.

[0050] Then, the editing operation unit 41 of the editor 4 checks whether parameters have been input to the parameter setting unit 731 (step S111). That is, the activity definition information D displayed in the parameter setting unit 731 includes input areas R (R112, R113, R114, R212, R221, R222, R223, R224, R232) into which parameter values ​​are input in response to user operations on the UI 24. The editing operation unit 41 then checks whether parameters have been input to the input areas R of the activity definition information D. Then, when parameters have been input to the input areas R ("YES" in step S111), the parameters input to the input areas R are set in the activity definition information D (step S112).

[0051] The parameter setting screen 73 also has a decision button 732. In response to this, in step S113, the editing operation unit 41 confirms whether the user has pressed the decision button 732 on the UI 24. If the decision button 732 has not been pressed (if "NO" in step S113), the process returns to step S109. On the other hand, if the decision button 732 has been pressed (if "YES" in step S113), the process proceeds to step S114. In step S114, the editing operation unit 41 stores the scenario Sm, which is configured based on the content (activity A and parameters) displayed in the parameter setting unit 731 at the time the decision button 732 is pressed, in the storage unit 22 as a completed scenario Sm. This scenario Sm is stored in the storage unit 22 in association with the natural language input L used to create the scenario Sm.

[0052] The creation result display screen 7 also has a close button 714 for ending the display of the scenario Sm. When the creation result display unit 34 confirms that the close button 714 has been pressed, it closes the creation result display screen 7.

[0053] Fig. 6 is a flowchart showing the natural language output executed by the calculation unit in accordance with the scenario management program, and Figs. 7A, 7B, 7C, 8A, and 8B are diagrams schematically showing screens displayed on the display by the natural language output of Fig. 6. The screens of Fig. 7A, 7B, 7C, 8A, and 8B are displayed on the display 244 by the calculation unit 21 controlling the display 244. In the natural language output of Fig. 6, comments or improvements on the scenario Sm are displayed in natural language in accordance with user instructions input to the UI 24.

[0054] In step S201, the automatic check / comment information creation unit 42 checks whether the user has performed an operation on the UI 24 to specify a scenario Sm to be output in natural language. For example, when a list of multiple scenarios Sm that have already been created is displayed on the display 244 and an operation to select one scenario Sm from the multiple scenarios Sm is performed on the UI 24, the automatic check / comment information creation unit 42 determines that the selected scenario Sm has been specified. An example of this list is the list 862 displayed in the scenario list display unit 86, which will be described later. When the target scenario Sm is specified in this way ("YES" in step S201), the automatic check / comment information creation unit 42 displays the target scenario display screen 8 (FIG. 7A) indicating the target scenario Sm on the display 244 (step S202).

[0055] 7A, the target scenario display screen 8 has a scenario display section 81 that displays the scenario Sm. In the scenario display section 81, activity icons Ac for the activities A31 to A37 included in the scenario Sm are displayed arranged in the order in which they are to be executed. Each of the activities A31 to A37 is displayed in the scenario display section 81 by an activity icon Ac that indicates a combination of activity type information C that indicates the type of the activity and activity definition information D that defines the details of the activity.

[0056] Activity A31 is an activity that acquires information in a folder as a table. This activity A31 creates a variable V31 and acquires the information to be input to the variable V31 as a table. The activity definition information D31 of activity A31 includes activity definition information D311 that specifies the name of the variable V31 (Table 1), and activity definition information D312 to D319 that specify the value to be acquired as the entity value of the variable V31. The activity definition information D312 specifies the path of the information acquisition target. The activity definition information D313 specifies the type of information acquisition target. The activity definition information D314 specifies the order in which the information is acquired. The activity definition information D315 specifies the file name to be extracted. The activity definition information D316 specifies whether or not to include items from subfolders. Activity definition information D317 to D319 specify the period of update dates and times to be acquired, activity definition information D317 specifies the length of the period, activity definition information D318 specifies the unit of the period, and activity definition information D319 specifies the range of the period.

[0057] Correspondingly, the activity icon Ac of activity A31 is provided with input fields R312 to R319 for inputting values ​​into activity definition information D312 to D319. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing each of input fields R312 to R319 in a default state, and displays this on the display 244. In response, the user can input values ​​into each of input fields R312 to R319 by operating the UI 24. Therefore, when activity A31 is executed, the table specified by the entity values ​​entered into activity definition information D312 to D319 is obtained and input into variable V31 (Table 1).

[0058] Activity A32 is an activity that obtains a value (character string) from a table. This activity A32 creates a variable V32 and obtains the information to be input to variable V32 as a character string. Activity definition information D32 for activity A32 includes activity definition information D321 that specifies the name (string1) of variable V32, and activity definition information D322 to D324 that specify the value to be obtained as the entity value of variable V32. Activity definition information D322 specifies the row from which the character string is to be obtained. Activity definition information D323 specifies the column name from which the character string is to be obtained. Activity definition information D324 specifies the full path from which the character string is to be obtained.

[0059] Correspondingly, the activity icon Ac of activity A32 is provided with input fields R322 to R324 for inputting values ​​into activity definition information D322 to D324. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing each of input fields R322 to R324 in a default state, and displays this on the display 244. In response, the user can input values ​​into each of input fields R322 to R324 by operating the UI 24. Therefore, when activity A32 is executed, the character string specified by the entity values ​​input into activity definition information D322 to D324 is obtained and input into variable V32 (string1).

[0060] Activity A33 is an activity that moves a file. This activity A33 creates a variable V33 and moves the file indicated by variable string1 to the path indicated by the information input to variable V33. The activity definition information D33 of activity A33 includes activity definition information D331 that specifies the name (string2) of variable V33, and activity definition information D332 to D333 that specify the value to be acquired as the entity value of variable V33. Activity definition information D332 specifies the path to which the file will be moved. Activity definition information D333 specifies the method of moving the file to the destination (whether to overwrite or not).

[0061] Correspondingly, the activity icon Ac of activity A33 is provided with input fields R332 to R333 for inputting values ​​into activity definition information D332 to D333. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing each of input fields R332 to R333 in their default state, and displays this on the display 244. In response, the user can input values ​​into each of input fields R332 to R333 by operating the UI 24. Therefore, when activity A33 is executed, the file is moved using the path and method specified by the entity values ​​entered into activity definition information D332 to D333.

[0062] Activity A34 is an activity that obtains a value (character string) from a table. This activity A34 creates a variable V34 and obtains the information to be input to variable V34 as a character string. Activity definition information D34 of activity A34 includes activity definition information D341 that specifies the name of variable V34 (string3), and activity definition information D342 to D344 that specify the value to be obtained as the entity value of variable V34. Activity definition information D342 specifies the row from which the character string is to be obtained. Activity definition information D343 specifies the column name from which the character string is to be obtained. Activity definition information D344 specifies the full path from which the character string is to be obtained.

[0063] Correspondingly, the activity icon Ac of activity A34 is provided with input fields R342 to R344 for inputting values ​​into activity definition information D342 to D344, respectively. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing each of input fields R342 to R344 in a default state, and displays this on the display 244. In response, the user can input values ​​into each of input fields R342 to R344 by operating the UI 24. Therefore, when activity A34 is executed, the character string specified by the entity values ​​input into activity definition information D342 to D344 is obtained and input into variable V34 (string3).

[0064] Activity A35 is an activity that moves a file. This activity A35 creates a variable V35 and moves the file indicated by variable string3 to the path indicated by the information input to variable V35. The activity definition information D35 of activity A35 includes activity definition information D351 that specifies the name (string4) of variable V35, and activity definition information D352 to D353 that specify the value to be acquired as the entity value of variable V35. Activity definition information D352 specifies the path to which the file will be moved. Activity definition information D353 specifies the method of moving the file to the destination (whether to overwrite or not).

[0065] Correspondingly, the activity icon Ac of activity A35 is provided with input fields R352 to R353 for inputting values ​​into activity definition information D352 to D353. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing each of input fields R352 to R353 in their default state, and displays this on the display 244. In response, the user can input values ​​into each of input fields R352 to R353 by operating the UI 24. Therefore, when activity A35 is executed, the file is moved using the path and method specified by the entity values ​​entered into activity definition information D352 to D353.

[0066] Activity A36 is an activity that obtains a value (character string) from a table. This activity A36 creates variable V36 and obtains the information to be input to variable V36 as a character string. Activity definition information D34 of activity A36 includes activity definition information D361 that specifies the name of variable V36 (string5), and activity definition information D362 to D364 that specify the value to be obtained as the entity value of variable V36. Activity definition information D362 specifies the row from which the character string is to be obtained. Activity definition information D363 specifies the column name from which the character string is to be obtained. Activity definition information D364 specifies the full path from which the character string is to be obtained.

[0067] Correspondingly, the activity icon Ac of activity A36 is provided with input fields R362 to R364 for inputting values ​​into activity definition information D362 to D364, respectively. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing each of input fields R362 to R364 in a default state, and displays this on the display 244. In response, the user can input values ​​into each of input fields R362 to R364 by operating the UI 24. Therefore, when activity A36 is executed, the character string specified by the entity values ​​entered into activity definition information D362 to D364 is obtained and entered into variable V36 (string5).

[0068] Activity A37 is an activity that moves a file. This activity A37 creates a variable V37 and moves the file indicated by variable string5 to the path indicated by the information input to variable V37. The activity definition information D37 of activity A37 includes activity definition information D371 that specifies the name (string6) of variable V37, and activity definition information D372 to D373 that specify the value to be acquired as the entity value of variable V37. Activity definition information D372 specifies the path to which the file will be moved. Activity definition information D373 specifies the method of moving the file to the destination (whether to overwrite or not).

[0069] Correspondingly, the activity icon Ac of activity A37 is provided with input fields R372 to R373 for inputting values ​​into activity definition information D372 to D373. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing each of input fields R372 to R373 in their default state, and displays this on the display 244. In response, the user can input values ​​into each of input fields R372 to R373 by operating the UI 24. Therefore, when activity A37 is executed, the file is moved using the path and method specified by the entity values ​​entered into activity definition information D372 to D373.

[0070] In step S203, the automatic check / comment information creation unit 42 checks whether the user has performed an operation requesting a check or comment on the UI 24. In other words, when the UI 24 receives a right-click operation on the target scenario display screen 8, the automatic check / comment information creation unit 42 displays a context menu 82 (FIG. 7B) superimposed on the target scenario display screen 8.

[0071] Among the context menus 82, menu 821 indicates "Insert block with comment," which is a menu for instructing comment display, which divides the activities displayed on the target scenario display screen 8 into blocks and displays comments explaining the behavior of those activities on the display 244. When menu 821 is selected while selecting all of the activities A31 to A37 displayed on the target scenario display screen 8, the automatic check / comment information creation unit 42 executes comment display for all of those activities. When menu 821 is selected while selecting some of the activities A31 to A37 displayed on the target scenario display screen 8, the automatic check / comment information creation unit 42 executes comment display for those parts of those activities.

[0072] Among the context menus 82, menu 822 indicates "Check improvements in scenario," which is a menu for instructing an improvement point display that displays improvements to the scenario Sm displayed on the target scenario display screen 8 on the display 244. When menu 822 is selected while selecting all of the activities A31 to A37 displayed on the target scenario display screen 8, the automatic check / comment information creation unit 42 executes an improvement point display for all of the activities. When menu 821 is selected while selecting a portion of the activities A31 to A37 displayed on the target scenario display screen 8, the automatic check / comment information creation unit 42 executes an improvement point display for that portion.

[0073] For example, when the operation to select the menu 822 is confirmed ("YES" in step S203), the automatic check and comment information creation unit 42 transmits check and comment information I4, which includes the selected activity and an improvement request for that activity, to the LLM 12 (step S204). This check and comment information I4 includes a perspective (review perspective) for considering improvements. Examples of such review perspectives include avoiding repetitive work. In response to this check and comment information I4, the LLM 12 creates answer information I5, which indicates an improvement proposal for the activity based on the review perspective, and outputs it to the automatic check and comment display unit 43. When the automatic check and comment display unit 43 receives answer information I5 indicating a response to the check and comment information I4 from the LLM 12 ("YES" in step S205), it displays an answer result display screen 83 (FIG. 7C) showing the answer information I5 (check and comment information result) on the display 244. This answer information I5 indicates an improvement scenario Smr, described later, written in a text-based general-purpose programming language.

[0074] The answer result display screen 83 has an improvement explanation display section 84, an improvement scenario display section 85, and a scenario list display section 86. The improvement explanation display section 84 displays text in natural language explaining the improvements made to the selected activity. In the example of FIG. 7C, the readability and stability of this scenario can be improved by reviewing it from the following perspectives: (1) the same process is duplicated; (2) it is written in a way that depends on the PC on which it was created; (3) variable names are not assigned appropriately; (4) parameters that are likely to be changed later are written directly; and (5) it does not accommodate increases or decreases in the number of files.

[0075] In addition, an improvement scenario display section 85 is provided below the character string "The revised scenario is as follows." As shown in FIG. 7C, the improvement scenario display section 85 displays an improvement scenario Smr obtained by revising the scenario Sm (FIG. 7A). Specifically, activity icons Ac for activities A41 to A46 included in the improvement scenario Smr are displayed arranged in the order in which they are to be executed. Each of the activities A41 to A46 is displayed in the scenario display section 81 by an activity icon Ac that indicates a combination of activity type information C indicating the type of the activity and activity definition information D that defines the details of the activity.

[0076] Activity A41 is an activity that acquires a special folder path. This activity A41 creates a variable V41 and acquires the path to be input to the variable V41. The activity definition information D41 of activity A41 includes activity definition information D411 that specifies the name of the variable V41 (download folder), and activity definition information D412 that specifies the path to be acquired as the entity value of the variable V41. The activity definition information D412 specifies the path to be acquired.

[0077] Correspondingly, the activity icon Ac of activity A41 is provided with an input area R412 for inputting a value into activity definition information D412. The automatic check / comment display unit 43 creates an answer result display screen 83 showing the input area R412 in a default state and displays it on the display 244. In response to this, the user can input a value into the input area R412 by operating the UI 24. Therefore, when activity A41 is executed, the path specified by the entity value input into the activity definition information D412 is obtained and input into variable V41 (download folder).

[0078] Activity A42 is an activity that creates a variable (character string). This activity A42 creates variable V42 and acquires information to be input to variable V42 as a character string. Activity definition information D42 for activity A42 includes activity definition information D421 that specifies the name of variable V42 (file destination folder), and activity definition information D422 that specifies the value to be acquired as the entity value of variable V42. Activity definition information D422 specifies a path.

[0079] Correspondingly, the activity icon Ac of activity A42 is provided with an input area R422 for inputting a value into activity definition information D422. The automatic check / comment display unit 43 creates an answer result display screen 83 showing input area R422 in a default state and displays it on the display 244. In response to this, the user can input a value into input area R422 by operating the UI 24. Therefore, when activity A42 is executed, the character string specified by the entity value input into activity definition information D422 is obtained and input into variable V42 (file destination folder).

[0080] Activity A43 is an activity that acquires information in a folder as a table. This activity A43 creates a variable V43 and acquires the information to be input to the variable V43 as a table. The activity definition information D43 of activity A43 includes activity definition information D431 that specifies the name of the variable V43 (file list), and activity definition information D432 to D438 that specify the value to be acquired as the entity value of the variable V43. Activity definition information D432 specifies the type of information to be acquired. Activity definition information D433 specifies the order in which the information is to be acquired. Activity definition information D434 specifies the file name to be extracted. Activity definition information D435 specifies whether or not items in subfolders are included. Activity definition information D436 to D438 specify the update date and time period to be acquired, activity definition information D436 specifies the length of the period, activity definition information D437 specifies the unit of the period, and activity definition information D438 specifies the range of the period.

[0081] Correspondingly, the activity icon Ac of activity A43 is provided with input fields R432 to R438 for inputting values ​​into activity definition information D432 to D438. The automatic check / comment display unit 43 creates an answer result display screen 83 showing each of the input fields R432 to R438 in a default state, and displays this on the display 244. In response, the user can input values ​​into each of the input fields R432 to R438 by operating the UI 24. Therefore, when activity A43 is executed, the table specified by the entity values ​​entered into the activity definition information D432 to D438 is obtained and input into variable V43 (file list).

[0082] Activity A44 is an activity that repeats target activities A45 and A46. The activity icon Ac of activity A44 has a bar Acb extending across activities A45 and A46 to the left of the activities A45 and A46 to be repeated. This bar Acb allows the user to visually confirm the repeated activities A45 and A46. This activity A44 creates a variable V44 and repeats activities A45 and A46 for the information input to the variable V44. The activity definition information D44 of activity A44 includes activity definition information D441 that specifies the name (file list) of the variable V44. The file list, which is variable V43, is input to this activity definition information D441. In other words, activity A44 repeatedly executes activities A45 and A46 for each file and folder included in the file list.

[0083] Activity A45 is an activity that obtains a value (character string) from a table. This activity A45 creates a variable V45 and obtains the information to be input to the variable V45 as a character string. The activity definition information D45 of activity A45 includes activity definition information D451 that specifies the name (file path) of the variable V45, and activity definition information D452 to D453 that specify the value to be obtained as the entity value of the variable V45. The activity definition information D452 specifies the column name from which the character string is obtained. The activity definition information D453 specifies the full path from which the character string is obtained.

[0084] Correspondingly, the activity icon Ac of activity A45 is provided with input fields R452 to R453 for inputting values ​​into activity definition information D452 to D453. The automatic check / comment display unit 43 creates an answer result display screen 83 showing each of input fields R452 to R453 in a default state and displays it on the display 244. In response, the user can input values ​​into each of input fields R452 to R453 by operating the UI 24. Therefore, when activity A45 is executed, the character string specified by the entity values ​​entered into activity definition information D452 to D453 is obtained and input into variable V45 (file path).

[0085] Activity A46 is an activity that moves a file. This activity A46 creates a variable V46 and moves the file indicated by variable V45 (file path) to the path indicated by the information input to variable V46. Activity definition information D46 of activity A46 includes activity definition information D461 that specifies the name of variable V46 (destination file path), and activity definition information D462 that specifies the value to be acquired as the entity value of variable V46. Activity definition information D462 specifies the method of moving the file to the destination (whether to overwrite or not).

[0086] Correspondingly, the activity icon Ac of activity A46 is provided with an input field R462 for inputting a value into activity definition information D462. The automatic check / comment display unit 43 creates an answer result display screen 83 showing the input field R462 in a default state and displays it on the display 244. In response to this, the user can input a value into input field R462 by operating the UI 24. Therefore, when activity A46 is executed, the file is moved in the manner specified by the entity value input into activity definition information D462.

[0087] Furthermore, a copy icon 831 is displayed on the answer result display screen 83. When the operation of pressing the copy icon 831 is confirmed, the editing operation unit 41 displays the parameter setting screen 73 ( FIG. 4C ) on the display 244. The improvement scenario Smr displayed in the improvement scenario display section 85 of the answer result display screen 83 at the time the operation of pressing the copy icon 831 is executed is copied to the parameter setting section 731 of this parameter setting screen 73. Therefore, parameter setting can be performed for the improvement scenario Smr in the same way as in the case of the above-mentioned scenario Sm.

[0088] The scenario list display unit 86 also displays a list of the history of the creation of improvement scenarios Smr. Specifically, the scenario list display unit 86 shows the date 861 on which the improvement scenario Smr was created and a list 862 of the improvement scenarios Smr created on that date 861. Upon receiving answer information I5, the automatic check / comment display unit 43 stores the answer information I5 in the storage unit 22. That is, the answer information I5 is stored in the storage unit 22 in a state in which the improvement scenario Smr, the improvements in the improvement scenario Smr, and the creation date of the improvement scenario Smr are associated with each other. The automatic check / comment display unit 43 then creates and displays the scenario list display unit 86 based on the answer information I5 read from the storage unit 22. The history of answer information I5 stored in the storage unit 22 can also be read as needed, and the answer information I5 can be output from the communication unit 25 to the outside of the terminal device 2.

[0089] In this way, the scenario Sm shown on the target scenario display screen 8 in FIG. 7A is improved to the improved scenario Smr shown on the answer result display screen 83 in FIG. 7C. Specifically, the repetition of the same processing, such as activities A32, A33, A34, A35, and A36, A37, is eliminated. The activity definition information D312 is eliminated from being written using paths that are dependent on the computer it was created in. The names of the variables V31 to V37 used in the scenario Sm are optimized. The activity definition information D332, D352, and D372 are eliminated from directly describing paths that are likely to be changed later. The activity definition information D322, D342, and D362 are eliminated from being written in a way that cannot accommodate increases or decreases in the number of files. Note that the results produced by executing scenario Sm are the same as the results produced by executing improved scenario Smr.

[0090] In this way, when menu 822 indicating "Check for improvements in scenario" is selected, the improvement display described using Figures 7A to 7C is executed. On the other hand, when menu 821 indicating "Insert block with comment" is selected, the comment display described using Figures 8A to 8B is executed. This point will be explained next. Here, Figure 8A shows the display on display 244 before menu 821 is selected, and Figure 8B shows the display on display 244 after menu 821 is selected.

[0091] 8A, activity icons Ac for activities A51 to A61 included in scenario Sm are displayed arranged in the order of their execution. Each of the activities A51 to A61 is displayed in the scenario display section 81 by an activity icon Ac that indicates a combination of activity type information C that indicates the type of activity and activity definition information D that defines the details of the activity.

[0092] Activity A51 is an activity that creates a variable (character string). This activity A51 creates variable V51 and acquires information to be input into variable V51. Activity definition information D51 for activity A51 includes activity definition information D511 that specifies the name of variable V51 (overtime hours spreadsheet file), and activity definition information D512 that specifies the value to be acquired as the entity value of variable V51. Activity definition information D512 specifies the path of the target from which information is to be acquired.

[0093] Correspondingly, the activity icon Ac of activity A51 is provided with an input area R512 for inputting values ​​into activity definition information D512. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing input area R512 in a default state and displays it on the display 244. In response, the user can input values ​​into input area R512 by operating the UI 24. Therefore, when activity A51 is executed, the information specified by the entity value entered into activity definition information D512 is obtained and input into variable V51 (overtime hours spreadsheet file).

[0094] Activity A52 is an activity that creates a variable (character string). This activity A52 creates variable V52 and acquires information to be input into variable V52. Activity definition information D52 for activity A52 includes activity definition information D521 that specifies the name (login ID) of variable V52, and activity definition information D522 that specifies the value to be acquired as the entity value of variable V52. Activity definition information D522 specifies the value of the login ID.

[0095] Correspondingly, the activity icon Ac of activity A52 is provided with an input area R522 for inputting a value into activity definition information D522. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing input area R522 in a default state and displays it on the display 244. In response, the user can input a value into input area R522 by operating the UI 24. Therefore, when activity A52 is executed, the information specified by the entity value input into activity definition information D522 is obtained and input into variable V52 (login ID).

[0096] Activity A53 is an activity that creates a variable (character string). This activity A53 creates variable V53 and acquires information to be input into variable V53. Activity definition information D53 for activity A53 includes activity definition information D531 that specifies the name (destination address) of variable V53, and activity definition information D532 that specifies the value to be acquired as the entity value of variable V53. Activity definition information D532 specifies an email address.

[0097] Correspondingly, the activity icon Ac of activity A53 is provided with an input area R532 for inputting values ​​into activity definition information D532. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing input area R532 in a default state and displays it on the display 244. In response, the user can input values ​​into input area R532 by operating the UI 24. Therefore, when activity A53 is executed, the information specified by the entity value input into activity definition information D532 is obtained and input into variable V53 (destination address).

[0098] Activity A54 is an activity that obtains a password from the qualification information. This activity A54 creates a variable V54 and obtains information to be input into the variable V54. The activity definition information D54 of activity A54 includes activity definition information D541 that specifies the name (password) of the variable V54, and activity definition information D542 that specifies the value to be obtained as the entity value of the variable V54. The activity definition information D542 specifies the qualification information.

[0099] Correspondingly, the activity icon Ac of activity A54 is provided with an input area R542 for inputting a value into activity definition information D542. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing input area R542 in a default state and displays it on the display 244. In response, the user can input a value into input area R542 by operating the UI 24. Therefore, when activity A54 is executed, the information specified by the entity value input into activity definition information D542 is obtained and input into variable V54 (password).

[0100] Activity A55 is an activity that opens a spreadsheet file; it creates a variable V55 and opens the spreadsheet file specified by the information entered into variable V55. Activity definition information D55 for activity A55 includes activity definition information D551 that specifies the name of the value entered into variable V55 (overtime hours spreadsheet file, i.e., variable V51). Therefore, when activity A55 is executed, the overtime hours spreadsheet file is opened.

[0101] Activity A56 activates an element of a spreadsheet file that is active at the time that activity A56 is executed. Specifically, a spreadsheet file is opened and activated by activity A55, which is executed before activity A56. Thus, the element of the spreadsheet file is activated. Activity definition information D56 of activity A56 includes activity definition information D562 that specifies the type of element to be activated, and activity definition information D563 that specifies the name of the element.

[0102] Correspondingly, the activity icon Ac of activity A56 is provided with input fields R562 and R563 for inputting values ​​into activity definition information D562 and D563, respectively. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing input fields R562 and R563 in their default states and displays it on the display 244. In response, the user can input values ​​into input fields R562 and R563 by operating the UI 24. In the example of FIG. 8A , "Sheet Name" is selected as the value of activity definition information D562, and "Overtime Calculation" is selected as the value of activity definition information D563. Therefore, when activity A56 is executed, the sheet named "Overtime Calculation" in the spreadsheet file opened by activity A55 becomes active.

[0103] Activity A57 obtains a value from a spreadsheet file that is active at the time activity A57 is executed, in accordance with activity definition information D57. Specifically, activity A56, which is executed before activity A57, opens and activates the spreadsheet file. Therefore, a value is obtained from the spreadsheet file. Activity A57 creates variable V57 and obtains information to be input to variable V57. The activity definition information D57 for activity A57 includes activity definition information D571 that specifies the name (year) of variable V57. Furthermore, the activity definition information D57 for activity A57 includes activity definition information D572 that specifies the format of the value to be obtained, and activity definition information D573 that specifies the column of the value to be obtained.

[0104] Correspondingly, the activity icon Ac of activity A57 is provided with input fields R572 and R573 for inputting values ​​into activity definition information D572 and D573, respectively. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing input fields R572 and R573 in their default states and displays it on the display 244. In response to this, the user can input values ​​into input fields R572 and R573 by operating the UI 24. In the example of FIG. 8A , "A1 format specification" is selected as the value of activity definition information D572, and "C10" is selected as the value of activity definition information D573. Therefore, when activity A57 is executed, the value of column C10 specified in activity definition information D573 is acquired in the format specified in activity definition information D572.

[0105] Activity A58 obtains a value from a spreadsheet file that is active at the time activity A58 is executed, in accordance with activity definition information D58. Specifically, activity A56, which is executed before activity A58, opens and activates the spreadsheet file. Therefore, a value is obtained from the spreadsheet file. Activity A58 creates variable V58 and obtains information to be input to variable V58. The activity definition information D58 for activity A58 includes activity definition information D581 that specifies the name (month) of variable V58. Furthermore, the activity definition information D58 for activity A58 includes activity definition information D582 that specifies the format of the value to be obtained, and activity definition information D583 that specifies the column of the value to be obtained.

[0106] Correspondingly, the activity icon Ac of activity A58 is provided with input fields R582 and R583 for inputting values ​​into activity definition information D582 and D583, respectively. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing input fields R582 and R583 in their default states and displays it on the display 244. In response to this, the user can input values ​​into input fields R582 and R583 by operating the UI 24. In the example of FIG. 8A , "A1 format specification" is selected as the value of activity definition information D582, and "B7" is selected as the value of activity definition information D583. Therefore, when activity A58 is executed, the value of column B7 specified in activity definition information D583 is acquired in the format specified in activity definition information D582.

[0107] Activity A59 is an activity that launches a web browser in web drive mode. This activity A59 creates a variable V59 and obtains information to be entered into the variable V59. The activity definition information D59 of activity A59 includes activity definition information D591 that specifies the name of the variable V59 (time attendance system) and activity definition information D592 that specifies the value to be obtained as the entity value of the variable V59. The activity definition information D592 specifies a URL.

[0108] Correspondingly, the activity icon Ac of activity A59 has an input area R592 for inputting values ​​into activity definition information D592. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing input area R592 in a default state and displays it on the display 244. In response, the user can input values ​​into input area R592 by operating the UI 24. Therefore, when activity A59 is executed, the URL specified by the entity value entered into activity definition information D592 is opened by a web browser in web drive mode and entered into variable V59 (time attendance system).

[0109] Activity A60 is an activity that inputs data into text fields in accordance with activity definition information D60. The activity definition information D60 for activity A60 includes activity definition information D602 and D603 that specify the text fields of the page opened by the attendance system (variable V59), and activity definition information D604 that specifies the value to be input.

[0110] Correspondingly, the activity icon Ac of activity A60 is provided with input fields R602, R603, and R604 for inputting values ​​into activity definition information D602, D603, and D604, respectively. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing input fields R602, R603, and R604 in their default states, and displays the screen on the display 244. In response to this, the user can input values ​​into each of input fields R602, R603, and R604 by operating the UI 24. In the example of FIG. 8A , "Xpath" is selected as the value of activity definition information D602, and " / / td[2] / input" is selected as the value of activity definition information D603. Furthermore, the numerical value "1934" is entered as the value of activity definition information D604. Therefore, when activity A60 is executed, the login ID (variable V52) is input to the HTML element described in activity definition information D602 and D603, the input text is cleared, and the number "1934" is input.

[0111] Activity A61 is an activity that inputs data into text fields in accordance with activity definition information D61. The activity definition information D61 for activity A61 includes activity definition information D612 and D613 that specify the text fields of the page opened by the attendance system (variable V59), and activity definition information D614 that specifies the value to be input.

[0112] Correspondingly, the activity icon Ac of activity A61 is provided with input fields R612, R613, and R614 for inputting values ​​into activity definition information D612, D613, and D614, respectively. The automatic check / comment information creation unit 42 creates a target scenario display screen 8 showing input fields R612, R613, and R614 in their default states, and displays the screen on the display 244. In response to this, the user can input values ​​into each of input fields R612, R613, and R614 by operating the UI 24. In the example of FIG. 8A , "Xpath" is selected as the value of activity definition information D612, and " / / td[2] / td[2] / input" is selected as the value of activity definition information D613. Furthermore, the numerical value "1934" is entered as the value of activity definition information D614. Therefore, when activity A61 is executed, the login ID (variable V52) is input to the HTML element described in activity definition information D612 and D613, the input text is cleared, and the number "1934" is input.

[0113] When the target scenario display screen 8 in FIG. 8A is displayed on the display 244, and the user confirms the selection of the menu 821 indicating "Insert Block with Comment" ("YES" in step S203), the automatic check / comment information creation unit 42 transmits check / comment information I4, which includes the selected activity and a request for an explanation of the activity, to the LLM 12 (step S204). In response to this check / comment information I4, the LLM 12 creates answer information I5 indicating a comment explaining the operation of the activity and outputs it to the automatic check / comment display unit 43. When the automatic check / comment display unit 43 receives answer information I5 indicating a response to the check / comment information I4 ("YES" in step S205), it displays an answer result display screen 87 ( FIG. 8B ) indicating the answer information I5 (check / comment information result) on the display 244. This answer information I5 indicates a commented scenario Smc, described later, written in a text-based general-purpose programming language.

[0114] The answer result display screen 87 has a comment-attached scenario display section 88. The comment-attached scenario Smc displayed in the comment-attached scenario display section 88 has a configuration in which comment blocks B (comment blocks B11 to B13 in FIG. 8B) are inserted into the scenario Sm. Each of the comment blocks B11, B12, and B13 indicates a comment for the corresponding activity A. That is, the comment block B11 indicates a comment that explains the operation of the corresponding activities A51 to A54. The comment block B12 indicates a comment that explains the operation of the corresponding activities A55 to A58. The comment block B13 indicates a comment that explains the operation of the corresponding activities A59 to A61.

[0115] Each of the comment blocks B11, B12, and B13 is displayed by a block icon Bc in the comment-added scenario display section 88. The block icon Bc has a comment display section Bcc, a parameter display section Bcp, and a bar Bcb.

[0116] The comment display section Bcc is displayed adjacent to the activity type information C indicated by the activity icon Ac of the corresponding activity A from above. This comment display section Bcc has a comment display area Bcr, which displays a comment (text) explaining the operation of the corresponding activity A. That is, the comment display area Bcr of the comment display section Bcc of the comment block B11 displays the comment "Set the parameters required for execution," which explains the operation of the activities A51 to A54 corresponding to the comment block B11. The comment display area Bcr of the comment display section Bcc of the comment block B12 displays the comment "Get the Gregorian calendar year and month," which explains the operation of the activities A55 to A58 corresponding to the comment block B12. The comment display area Bcr of the comment display section Bcc of the comment block B13 displays the comment "Log in to the attendance system to obtain overtime hours," which explains the operation of the activities A59 to A61 corresponding to the comment block B13.

[0117] The parameter display section Bcp is displayed adjacent to the upper side of the activity definition information D indicated by the activity icon Ac of the corresponding activity A. This parameter display section Bcp shows the input / output parameters used in the corresponding activity A. In other words, the parameter display section Bcp of comment block B11 shows the parameters (overtime hours spreadsheet file, login ID, destination address, password) output from the activities A51 to A54 corresponding to that comment block B11. The parameter display section Bcp of comment block B12 shows the parameters (overtime hours spreadsheet file) input to the activities A55 to A58 corresponding to that comment block B12 and the parameters (year, month) output from the activities A55 to A58. The parameter display section Bcp of comment block B13 shows the parameters (login ID, password, year, month) input to the activities A59 to A16 corresponding to that comment block B13 and the parameters (time attendance system, overtime hours) output from the activities A59 to A61.

[0118] The bar Bcb extends across the corresponding activity A on the left side of the activity A. In other words, the bar Bcb of the comment block B11 extends across the activities A51 to A54 corresponding to the comment block B11 on the left side of the activities A51 to A54. The bar Bcb of the comment block B12 extends across the activities A55 to A58 corresponding to the comment block B12 on the left side of the activities A55 to A58. The bar Bcb of the comment block B13 extends across the activities A59 to A61 corresponding to the comment block B13 on the left side of the activities A59 to A61. The bar Bcb allows the user to visually confirm the activities A51 to A54, A55 to A58, and A59 to A61 corresponding to the comment blocks B11, B12, and B13, respectively.

[0119] According to the embodiment described above, when a user inputs a natural language input indicating a task to be automated (step S101), an activity A corresponding to the computer-executed process indicated by the natural language input L is acquired (step S103). Then, search activity information I2 indicating this activity A is displayed to the user on the search result display screen 6 (step S104). Therefore, the user can easily confirm the activity A corresponding to the task to be automated simply by inputting natural language. When the user selects an activity A from the search information I1 displayed on the search result display screen 6, a scenario creation instruction including selection information for the activity A based on the search information I1 is accepted (step S105). Then, a scenario Sm is acquired based on the activity A (selection information) selected at the time the scenario creation instruction was accepted and the scenario creation information I3 including the natural language input L (steps S106 and S107). Then, a scenario Sm (automatic scenario creation result) consisting of an activity icon Ac (activity GUI) for which parameters can be set is displayed on the creation result display screen 7 (GUI) indicating the scenario Sm. In this way, after the user is prompted to confirm the activity A found for the task to be automated indicated by the user's natural language input L (steps S104 and S105), a scenario Sm is created using the activity A. This narrows down the options presented to the user for confirmation of activity A. Therefore, the user can easily correct the course of scenario creation by selecting from limited options. Furthermore, since the scenario Sm is created based on the activity A that has been confirmed by the user, it is possible to stably create highly accurate scenarios Sm. As a result, it is possible to assist the user in scenario creation so that the user can easily create scenarios Sm for a variety of tasks.

[0120] In the above example, the task to be automated indicated by the natural language input L consists of a first step, "Extract a table from a document file," and a second step, "Write it into a spreadsheet file." The search information creation unit 31 then creates search information I1 by dividing the task into a first statement, "Extract a table from a document file," corresponding to the first step, and a second statement, "Write it into a spreadsheet file," corresponding to the second step. The search result display screen 6, which displays the search activity information I2, distinguishes between the activity A11 (first activity) corresponding to the first statement, "Extract a table from a document file," and the activities A21 to A24 (second activities) corresponding to the second statement, "Write it into a spreadsheet file." This configuration allows the user to easily confirm the search activity information I2 corresponding to the natural language input by the user.

[0121] Furthermore, the activity icon Ac (activity GUI) includes an area (type area) showing activity type information C that displays the type of activity A, and an area (parameter area) showing activity definition information D that allows parameters to be set for defining the operation of the activity. In contrast, on the search result display screen 6 that shows the search activity information I2, activity A is displayed by a display corresponding to the area showing the activity type information C. With this configuration, the user can easily confirm the type of activity A from the search activity information I2 shown on the search result display screen 6.

[0122] Furthermore, the activity icon Ac (activity GUI) included in the scenario Sm displayed on the parameter setting screen 73 has an area (parameter area) showing activity definition information D in which parameters for defining the operation of activity A can be set. Furthermore, the activity icon Ac has a default input area R in the area showing the activity definition information D. With this configuration, the user can easily set parameters according to their own requirements by inputting parameters into the input area R. Here, the default state of the input area R in which parameters are input using a text box is, for example, empty.

[0123] The creation result display screen 7 simultaneously displays the natural language input L and the scenario Sm (automatic scenario creation result) (task display section 711, scenario display section 72). In this configuration, the user can set parameters while checking the task to be automated (natural language input L) and the scenario Sm that the user input in natural language.

[0124] The creation result display screen 7 also displays the natural language input L, the scenario Sm, and a recreate button 712 for receiving an instruction to recreate the scenario Sm. With this configuration, the user can determine whether or not to recreate the scenario Sm while checking the automation target task (natural language input L) that the user input in natural language and the scenario Sm.

[0125] Furthermore, the editing operation unit 41 accepts the operation of pressing the copy icon 713 as a reflection instruction to reflect the scenario Sm (step S110). Then, upon accepting the operation of pressing the copy icon 713, the editing operation unit 41 accepts parameter setting. With this configuration, it is possible to accept parameter setting after confirming the user's intention to reflect the scenario Sm.

[0126] Furthermore, the natural language input L and the scenario Sm acquired in response to the scenario creation instruction are stored in association with each other. In this configuration, the user can check the history afterward by, for example, reading the natural language input L and the scenario Sm from the storage unit 22 and displaying them on the display 244 on the UI 24.

[0127] 7A to 7C, when a check and comment instruction (instruction to output natural language) for the scenario Sm (automation scenario) is received from the user (step S201), the improvement scenario Smr output from the LLM 12 in response to the check and comment instruction is displayed in the improvement scenario display unit 85, and text (natural language output) indicating improvements to the improvement scenario Smr is displayed in the improvement explanation display unit 84. Therefore, the user can easily understand information about the RPA scenario Sm by checking the displayed text (natural language output).

[0128] 8A and 8B, when a check / comment instruction (instruction to output natural language) for the scenario Sm (automation scenario) is received from the user (step S201), the commented scenario Smc output from the LLM 12 in response to the check / comment instruction is displayed in the commented scenario display section 88, and text (natural language output) explaining the operation of activity A included in the commented scenario Smc is displayed in the comment display area Bcr. Therefore, the user can easily understand information about the RPA scenario Sm by checking the displayed text (natural language output).

[0129] Furthermore, the improved scenario Smr (FIG. 7C) is modified based on the improvements (natural language output) that are output for the selected scenario Sm. With this configuration, the user can easily understand information about the RPA scenario Sm by checking the improved scenario Smr (modified scenario).

[0130] Furthermore, the commented scenario Smc (FIG. 8B) is modified based on the comments (natural language output) output for the selected scenario Sm (i.e., comment block B is inserted). In this configuration, the user can easily understand information about the RPA scenario Sm by checking the commented scenario Smc.

[0131] The scenario Sm is stored in a text-based general-purpose programming language. Improvements and comments (natural language output) are output by inputting check and comment information I4 (input information) including the scenario Sm into the LLM 12 (steps S204-205). In this configuration, improvements and comments (natural language output) can be obtained using the LLM 12.

[0132] 7A to 7C, improvements that are the review results for the scenario Sm are displayed in the improvement explanation display section 84. The improved scenario Smr is a scenario that reflects improvement suggestions based on the review results. With this configuration, the user can easily understand how the scenario Sm will be improved based on the improvements (review results) shown in the improvement explanation display section 84.

[0133] Furthermore, the improvements (review results) and the improved scenario Smr are associated with each other and stored in the storage unit 22. With this configuration, the user can easily understand after the fact what changes have been made to the improved scenario Smr by referring to the improvements.

[0134] 8A and 8B, comments that explain the operation realized by the scenario Sm are displayed in the comment display area Bcr. The comment-added scenario Smc (modified scenario) includes comment blocks B11, B12, and B13 (activity GUI) that contain comments. This configuration allows the user to easily understand the operation of the scenario Sm based on the comments contained in the comment blocks B11, B12, and B13. The comment display area Bcr displays comments contained in the answer information I5 from the LLM 12. It is not necessary to display all of the comments contained in the answer information I5 in the comment display area Bcr; only some of the comments may be displayed in the comment display area Bcr.

[0135] The automatic check / comment information creation unit 42 also stores in advance review perspectives for examining improvements to the scenario Sm, creates check / comment information I4 including these review perspectives, and transmits the created information to the LLM 12. Therefore, even a user who has no knowledge of such review perspectives can easily obtain an improved scenario Smr that has been improved based on an appropriate review perspective.

[0136] The present invention is not limited to the above embodiment, and various modifications can be made to the above without departing from the spirit of the invention. For example, it is not essential to configure the parameter setting screen 73 to be displayed. Therefore, the scenario display section 72 of the creation result display screen 7 may be configured to allow parameter setting.

[0137] Furthermore, the specific display mode of the scenario Sm on the creation result display screen 7 can be changed in various ways. That is, parameter setting for the scenario Sm is performed using the parameter setting screen 73. Therefore, it is not necessary to be able to set parameters on the creation result display screen 7. Therefore, the scenario Sm may be displayed using image data that constitutes the screen shown in FIG. 4B.

[0138] Furthermore, the activity A displayed in the scenario display section 72 of the creation result display screen 7 is not limited to the activity A included in the search activity information I2 from the search unit 13. Therefore, other activities A that are frequently used together with the activity A included in the search activity information I2 may also be displayed as search results in the phrase-associated activity display section 65. Specifically, the search result display section 32 previously stores a table or the like that associates one activity A with other activities A that are frequently used together with the activity A. Then, the search result display section 32 displays the activity A associated with the activity A included in the search activity information I2 in the table. In other words, the search results showing the activity A obtained from the search unit 13 and activities A related to the activity A are displayed in the phrase-associated activity display section 65. This configuration allows the user to search for and check a wide range of activities necessary for creating a scenario Sm that automates a task to be automated.

[0139] Furthermore, in steps S101 and S102, the specific content of the search information I1 created in response to the natural language input L can be modified as appropriate. For example, the search information creation unit 31 can be configured to be adjustable in terms of the strictness with which activity A is searched for in response to the natural language input L. In this modification, the search information creation unit 31 receives an input (strictness specification input) to the UI 24 that specifies the strictness of activity A. This strictness specification may be specified in natural language, such as "search with high strictness" or "search with low strictness," or may be specified by operating a bar displayed on the display 244 that accepts operations to change the strictness.

[0140] In response to this, the search information creation unit 31 creates search information I1 to include a strictness specification and sends it to the search unit 13. The search unit 13 adjusts the number of activities A included in the search activity information I2 according to the strictness included in the search information I1. As a result, the number of activities A included in the search activity information I2 when the strictness is high is less than the number of activities A included in the search activity information I2 when the strictness is low. In this configuration, the user can change the strictness to appropriately adjust the number of activities A displayed on the search result display screen 6 according to their own requirements.

[0141] Furthermore, the type of activity A searched for for one phrase is not limited to one type as in the above example, but may be multiple types. For example, for the phrase "send an email," there may be multiple types of applications that can execute the task of "send an email" indicated by the phrase. In this case, the search unit 13 creates search activity information I2 including activity A corresponding to each of the multiple types of applications and transmits it to the search result display unit 32. Furthermore, the search result display unit 32 displays activity type information C of activity A corresponding to each of the multiple types of applications on the search result display screen 6.

[0142] Furthermore, in the above embodiment, parameter setting for the creation result display screen 7 that displays the results of creating the scenario Sm is restricted, and parameter setting for the parameter setting screen 73 to which the scenario Sm is copied by operating the copy icon 713 is permitted. This allows the user to operate the copy icon 713 and confirm the user's intention to adopt the scenario Sm before permitting parameter setting for the scenario Sm. In other words, it is possible to avoid the problem of parameters being set for the scenario Sm against the user's will. In light of this function, the specific method for creating the scenario Sm is not limited to the above example. Therefore, the scenario Sm may be created by a method other than the method of having the search unit 13 search for activity A for the natural language input L.

[0143] The search result display unit 32 may also display on the search result display screen 6 important points to note when creating the scenario Sm. For example, when extracting a table from a document file, the search result display screen 6 may display a message such as, "The document file must contain character string data. Please try copying it with your mouse before using it." Alternatively, the search result display screen 6 may display a message such as, "This operation includes processing that may take time, so an error such as 'File does not exist' may occur upon execution. In that case, please try adding a wait activity." Alternatively, the search result display screen 6 may include a button for inquiring about important points to note. Furthermore, the search result display unit 32 may display the search result display screen 6 in a collapsed state and, upon receiving a user operation, display the phrase-corresponding activity display unit 64 and the phrase-corresponding activity display unit 65.

[0144] Furthermore, if a rule violation is confirmed as a result of the check by the violation checking unit 5, the violation checking unit 5 may be configured to instruct the LLM 12 to recreate the scenario Sm without passing the scenario Sm to the creation result display unit 34. In this way, when the violation checking unit 5 receives the scenario Sm from the LLM 12 in which the rule violation has been resolved, it can pass the scenario Sm to the creation result display unit 34.

[0145] Furthermore, various specific configurations of the answer information I5 received in step S205 in Fig. 6 are conceivable. Therefore, in the examples of Fig. 8A and Fig. 8B, the line number corresponding to the comment (explanation result) included in the answer information I5 may be specified. Specifically, it is as follows.

[0146] The scenario Sm is written in a general-purpose programming language. The automatic check / comment information creation unit 42 creates check / comment information I4 by inserting identification text for identifying line numbers into the general-purpose programming language that writes the scenario Sm at locations corresponding to activity A. Therefore, the automatic check / comment display unit 43 receives answer information I5 from the LLM 12, in which line numbers are assigned to the descriptions of activity A included in the scenario Sm. Furthermore, the comments included in the answer information I5 are assigned the line numbers of the activity A that correspond to the comments. When displaying the answer information I5 on the answer result display screen 87, the automatic check / comment display unit 43 adjusts the display location of the comment block B according to the line numbers included in the answer information I5. In other words, the comment block B is inserted at a position corresponding to a line that is a predetermined number of lines before the line number of activity A that corresponds to the comment indicated by the comment block B.

[0147] In this modified example, answer information I5 (explanation result) includes identification text (specification information) that specifies the line number of an activity icon Ac (activity GUI) included in scenario Sm, and a comment (operation explanation information) that explains the operation achieved by the activity icon Ac specified by the identification text. The comment-added scenario Smc (modified scenario) indicated by answer information I5 includes a block icon Bc (activity GUI) that includes the comment and has a shape (bar Bcb) based on the comment. This configuration allows the user to easily understand the operation of scenario Sm based on a portion of the comment (operation explanation information) included in the block icon Bc.

[0148] Furthermore, the specific display format of the improvements and comments is not limited to the format described above using the improvement explanation display unit 84 or the comment display area Bcr. Therefore, the improvements or comments may be displayed in a chat format, and natural language input from the user regarding the improvements or comments may be accepted. Such natural language input is transmitted to the LLM 12 by the automatic check / comment information creation unit 42. When the automatic check / comment display unit 43 receives a response from the LLM 12, the response is displayed in a chat format. Here, the chat format refers to a format in which the user's input and the response from the LLM 12 are displayed in chronological order on a single screen. This allows the user to easily check the improvements or comments in a chat format. Furthermore, this chat history can be stored, for example, in the memory unit 22. Furthermore, the chat history stored in the memory unit 22 can be read as needed, and response information I5 can be output from the communication unit 25 to an external device 2.

[0149] Furthermore, it is not essential to have the function of outputting natural language as shown in FIG. 6, and the automatic check / comment information creating unit 42 and the automatic check / comment display unit 43 do not have to be provided.

[0150] The present invention can be applied to RPA technology in general, which aims to reduce the burden on users by automating tasks that users have previously performed using computers.

[0151]

Claims

1. A method executed by a computing system, comprising: accepting natural language input indicating a task to be automated; acquiring an activity corresponding to the computer-executed processing indicated by the natural language input; displaying search results indicating the acquired activity; accepting a scenario creation instruction including selection information for the activity based on the search results; acquiring a scenario based on the natural language input and the selection information in response to the scenario creation instruction; and displaying the result of automatic scenario creation consisting of an activity GUI that allows parameters to be set on a GUI indicating the acquired scenario.

2. The method according to claim 1, wherein the natural language input is divided into a first description corresponding to a first step constituting the business to be automated and a second description corresponding to a second step constituting the business to be automated, and the search results are displayed with a distinction between a first activity corresponding to the first description and a second activity corresponding to the second description.

3. The method according to claim 1, wherein the activity GUI includes a type area that displays the type of the activity and a parameter area that allows parameters to be set to define the operation of the activity, and the search results are displayed in accordance with the type area.

4. The method according to claim 1, wherein the search results include search results showing the acquired activity and activities related to the acquired activity.

5. The method of claim 1, further comprising: accepting a strictness for retrieving the activities corresponding to the natural language input; and wherein the number of the activities shown in the search results when the strictness is high is smaller than the number of the activities shown in the search results when the strictness is low.

6. The method according to claim 1, wherein the activity GUI included in the automatic scenario creation result has a parameter area in which parameters for defining the behavior of the activity can be set, and the parameter area has an input area in a default state.

7. The method according to claim 1, wherein the natural language input and the result of the automatic scenario creation are displayed simultaneously.

8. The method according to claim 1, further comprising displaying the natural language input, the automatically generated scenario result, and a button for receiving an instruction to regenerate the automatically generated scenario result.

9. The method according to claim 1, further comprising receiving a reflection instruction for reflecting the results of the automatic scenario creation, and upon receiving the reflection instruction, the parameter setting becomes available for acceptance.

10. The method according to claim 1, wherein the natural language input and the scenario acquired in response to the scenario creation instruction are stored in association with each other.

11. A method executed by a computing system, comprising: accepting natural language input indicating a task to be automated; acquiring an activity corresponding to the computer-executed processing indicated by the natural language input; displaying a screen capable of displaying search results indicating the acquired activity; accepting a scenario creation instruction including selection information for the activity based on the search results; acquiring a scenario based on the natural language input and the selection information in response to the scenario creation instruction; and displaying the results of automatic scenario creation configured by an activity GUI that allows parameters to be set on a GUI indicating the acquired scenario.

Images