Information processing device, method, program and system

Abstract

The purpose of this disclosure is to utilize generative AI to reduce the effort required to create test scripts. [Solution] A program for operating a computer having a processor and memory, the program causing the processor to execute the following steps: accepting specification of information related to a test from a user; reading WAI-ARIA roles and labels from a page expressed in HTML as summary information about the page on which the function to be tested is executed; creating a first prompt including information related to the test, summary information, and an instruction statement instructing the output of test procedure information; inputting the first prompt into a generation AI and causing the generation AI to output the test procedure information; and creating a test script based on the procedure information.

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, a method, a program, and a system. [Background technology]

[0002] To ensure the quality of software, its functionality is tested before launch. Tests are designed based on the software specifications to ensure the desired quality within the development schedule and budget set by the software development company. Currently, the use of generative AI is expanding in various fields, and its use in software testing is also being considered.

[0003] Patent Document 1 describes an automatic response device that automatically responds to messages from users in various network services. In Patent Document 1, a request parameter acquisition unit inputs at least a message to an AI chatbot that has been trained to respond when natural language is input, thereby acquiring request parameters to be input to a response model. At this time, the request parameter acquisition unit specifies candidate request parameters in a format that can be input to the API (Application Programming Interface) of the response model, and inputs them to the AI ​​chatbot.

[0004] [Patent Document 1] Patent No. 7436734 Summary of the Invention [Problem to be solved by the invention]

[0005] In software testing, it takes a lot of effort to create a test script for executing a test on a predetermined function.

[0006] The purpose of this disclosure is to utilize generative AI to reduce the effort required to create test scripts. [Means for solving the problem]

[0007] A program for operating a computer having a processor and a memory, the program causing the processor to execute the following steps: accepting specification of test-related information from a user; reading WAI-ARIA roles and labels from a page expressed in HTML as summary information for the page on which the function to be tested is executed; creating a first prompt including instructions to output information about the test, the summary information, and test procedure information; inputting the first prompt to a generation AI and causing the generation AI to output the test procedure information; and creating a test script based on the procedure information. [Effects of the Invention]

[0008] According to the present disclosure, the effort required to create test scripts can be reduced by utilizing generative AI. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram showing an example of the overall configuration of a system 1. FIG. [Figure 2] 2 is a block diagram showing an example of the functional configuration of a terminal device 10. FIG. [Figure 3] 2 is a block diagram showing an example of the functional configuration of a server 20. FIG. [Figure 4] FIG. 2 is a diagram illustrating a data structure of a table. [Figure 5] FIG. 2 is a diagram illustrating a data structure of a table. [Figure 6] FIG. 2 is a diagram illustrating a data structure of a table. [Figure 7] FIG. 2 is a diagram illustrating an example of a processing flow in the system 1. [Figure 8] FIG. 2 is a diagram illustrating an example of a processing flow in the system 1. [Figure 9] FIG. 10 is a diagram illustrating an example screen of the present disclosure. [Figure 10]FIG. 2 is a diagram illustrating an example of a processing flow in the system 1. [Figure 11] FIG. 2 is a diagram illustrating an example of a processing flow in the system 1. [Figure 12] FIG. 9 is a block diagram showing the basic hardware configuration of a computer 90. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In all drawings describing the embodiments, common components are designated by the same reference numerals, and repeated description will be omitted. Note that the following embodiments do not unduly limit the content of the present disclosure described in the claims. Furthermore, not all components shown in the embodiments are necessarily essential components of the present disclosure. Furthermore, each drawing is a schematic diagram and is not necessarily a precise illustration.

[0011] In the following description, a "processor" refers to one or more processors. The at least one processor is typically a microprocessor such as a CPU (Central Processing Unit), but may also be another type of processor such as a GPU (Graphics Processing Unit). The at least one processor may be single-core or multi-core.

[0012] Furthermore, the at least one processor may be a processor in the broad sense, such as a hardware circuit (for example, a field-programmable gate array (FPGA) or an application-specific integrated circuit (ASIC)) that performs part or all of the processing.

[0013] In the following explanation, information that produces an output for an input may be described using expressions such as "xxx table," but this information may be data of any structure, or may be a learning model such as a neural network that produces an output for an input. Therefore, an "xxx table" may be referred to as "xxx information."

[0014] Furthermore, in the following description, the configuration of each table is an example, and one table may be divided into two or more tables, or all or part of two or more tables may be one table.

[0015] In addition, in the following explanation, processing may be described using the "program" as the subject, but since a program is executed by a processor to perform specified processing while appropriately using a memory unit and / or an interface unit, etc., the subject of the processing may also be the processor (or a device such as a controller that has that processor).

[0016] The program may be installed in a device such as a computer, or may be stored in, for example, a program distribution server or a computer-readable (e.g., non-transitory) recording medium. Also, in the following description, two or more programs may be realized as one program, or one program may be realized as two or more programs.

[0017] Furthermore, in the following description, identification numbers are used as identification information for various objects, but other types of identification information (for example, identifiers including alphabetic characters or symbols) may also be used.

[0018] In addition, in the following description, when describing elements of the same type without distinguishing between them, reference symbols (or common symbols among the reference symbols) may be used, and when describing elements of the same type with distinction between them, the identification numbers (or reference symbols) of the elements may be used.

[0019] In the following description, the control lines and information lines are those that are considered necessary for the description, and do not necessarily represent all the control lines and information lines in the product. All components may be interconnected.

[0020] Each information processing device is configured by a computer equipped with an arithmetic unit and a storage device. The basic hardware configuration of the computer and the basic functional configuration of the computer realized by the hardware configuration will be described later. For each of the server 20 and the terminal device 10, descriptions that overlap with the basic hardware configuration and basic functional configuration of the computer will be omitted.

[0021] <Summary> The system according to this embodiment creates a test script for automated testing by inputting test-related information into a generative AI (large-scale language model). Specifically, for example, the system inputs a prompt to the generative AI, the prompt including the test scenario and prerequisites included in the test-related information, summary information of the page related to the test scenario, and an instruction to output procedure information according to the test scenario, and causes the generative AI to output the procedure information. The system creates a test script based on the procedure information.

[0022] In this embodiment, a test scenario represents a series of operation procedures under a predetermined situation, defined to verify whether a specific function or a series of functions realized by software or the like operates as expected from a user's perspective. A test scenario, for example, combines individual detailed test items (test cases) to mimic and represent a series of actions that a user would take when actually using a system. A test scenario may be based on, for example, a test design document. A test design document is, for example, data in which tests are designed to verify the functions of a test target. In the test design document, test cases are specified by, for example, test category, major function, medium function, minor function, pattern, test perspective, confirmation item, expected value, factor, level, etc. Prerequisites, for example, specify the conditions that are assumed when a test scenario is executed.

[0023] In this embodiment, the summary information of the page related to the test scenario represents, for example, the roles and states of UI components in an HTML page. In this embodiment, the summary information of the page is, for example, WAI-ARIA (Web Accessibility Initiative Accessible Rich Internet Applications) roles and labels. WAI-ARIA defines attributes for HTML that can improve the accessibility of user interfaces in web pages (especially dynamic web pages). The WAI-ARIA roles and labels are obtained from, for example, HTML information.

[0024] The person who provides the system according to this embodiment is called an administrator. The person who uses the system according to this embodiment is called a user. The relationship between the administrator and the user corresponds to, for example, the relationship between a vendor and a customer, and this system may be a system for providing a service. Furthermore, the relationship between the administrator and the user corresponds to, for example, the relationship within the same business organization (for example, the information systems department and the technology department), and this system may be an in-house system.

[0025] <1. Overall system configuration> Fig. 1 is a block diagram showing an example of the overall configuration of a system 1. As shown in Fig. 1, the system 1 includes, for example, a terminal device 10 and a server 20. The terminal device 10 and the server 20 are connected for communication via, for example, a network 80.

[0026] 1 shows an example in which the system 1 includes two terminal devices 10, but the number of terminal devices 10 included in the system 1 is not limited to two. The number of terminal devices 10 included in the system 1 may be one, or three or more.

[0027] In the present embodiment, an example is shown in which the system 1 includes one server 20, but the number of servers 20 included in the system 1 is not limited to one. The server 20 may be composed of multiple servers depending on the functions it has. Furthermore, the server 20 may be a collection of multiple devices. The way in which the multiple functions required to realize the server 20 according to the present embodiment are allocated to one or multiple pieces of hardware can be determined appropriately in consideration of the processing capacity of each piece of hardware and / or the specifications required for the server 20.

[0028] The terminal device 10 is an information processing device used by a user. The user, for example, operates the terminal device 10 to create a test script based on a test scenario. The terminal device 10 is realized, for example, by a desktop personal computer (PC), a laptop PC, or the like. The terminal device 10 may also be a smartphone, a tablet terminal, or a portable computer such as a head-mounted display.

[0029] The terminal device 10 includes a communication IF (Interface) 12, an input device 13, an output device 14, a memory 15, a storage 16, and a processor 19. The communication IF 12 is an interface for inputting and outputting signals so that the terminal device 10 can communicate with devices in the system 1, such as the server 20. The input device 13 is a device for receiving input operations from a user (e.g., a touch panel, a touchpad, a pointing device such as a mouse, a keyboard, etc.). The output device 14 is a device for presenting information to a user (e.g., a display, a speaker, etc.). The memory 15 is for temporarily storing programs and data processed by the programs, etc., and is a volatile memory such as a DRAM (Dynamic Random Access Memory). The storage 16 is for saving data, and is, for example, a flash memory or an HDD (Hard Disc Drive). The processor 19 is hardware for executing an instruction set written in a program, and is composed of an arithmetic unit, registers, peripheral circuits, etc.

[0030] The server 20 is, for example, an information processing device that supports the creation of test prompts based on test scenarios for the terminal device 10. The server 20 is, for example, an information processing device realized by a computer connected to a network 80.

[0031] The server 20 includes a communication IF 22, an input / output IF 23, a memory 25, a storage 26, a processor 29, and a generation AI system 30. The communication IF 22 is an interface for inputting and outputting signals so that the server 20 can communicate with devices within the system 1, such as the terminal device 10. The input / output IF 23 functions as an interface with an input device for accepting input operations from a user and an output device for outputting information to the user. The memory 25 is for temporarily storing programs and data processed by the programs, and is a volatile memory such as a DRAM. The storage 26 is for saving data, and is a flash memory or HDD, for example. The processor 29 is hardware for executing an instruction set written in a program, and is composed of an arithmetic unit, registers, peripheral circuits, etc.

[0032] Each information processing device is configured by a computer equipped with an arithmetic unit and a storage device. The basic hardware configuration of the computer and the basic functional configuration of the computer realized by the hardware configuration will be described later. For each of the terminal device 10 and the server 20, descriptions that overlap with the basic hardware configuration and basic functional configuration of the computer will be omitted.

[0033] <2. Terminal device configuration> Fig. 2 is a block diagram showing an example of the functional configuration of the terminal device 10. As shown in Fig. 2, the terminal device 10 includes a communication unit 120, an input device 13, an output device 14, an audio processing unit 17, a microphone 171, a speaker 172, a camera 160, a position information sensor 150, a storage unit 180, and a control unit 190. The blocks included in the terminal device 10 are electrically connected by, for example, a bus or the like.

[0034] The communication unit 120 performs processing such as modulation and demodulation for the terminal device 10 to communicate with other devices. The communication unit 120 performs transmission processing on the signal generated by the control unit 190 and transmits it to the outside (for example, the server 20). The communication unit 120 performs reception processing on the signal received from the outside and outputs it to the control unit 190.

[0035] The input device 13 is a device for inputting instructions or information by a user operating the terminal device 10. The input device 13 is realized, for example, by a touch-sensitive device 131 or the like, which inputs instructions by touching an operation surface. When the terminal device 10 is a PC or the like, the input device 13 may be realized by a reader, keyboard, mouse, or the like. The input device 13 converts instructions input by the user into electrical signals and outputs the electrical signals to the control unit 190. The input device 13 may include, for example, a receiving port that receives electrical signals input from an external input device.

[0036] The output device 14 is a device for presenting information to a user operating the terminal device 10. The output device 14 is realized, for example, by a display 141 or the like. The display 141 displays data according to the control of the control unit 190. The display 141 is realized, for example, by an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display or the like.

[0037] The audio processing unit 17 performs, for example, digital-to-analog conversion processing of an audio signal. The audio processing unit 17 converts a signal provided from the microphone 171 into a digital signal and provides the converted signal to the control unit 190. The audio processing unit 17 also provides the audio signal to the speaker 172. The audio processing unit 17 is realized, for example, by a processor for audio processing. The microphone 171 receives audio input and provides an audio signal corresponding to the audio input to the audio processing unit 17. The speaker 172 converts the audio signal provided from the audio processing unit 17 into audio and outputs the audio to the outside of the terminal device 10.

[0038] The camera 160 is a device that receives light with a light receiving element and outputs the light as an image capturing signal.

[0039] The position information sensor 150 is a sensor that detects the position of the terminal device 10, and is, for example, a GPS (Global Positioning System) module. The GPS module is a receiving device used in a satellite positioning system. In the satellite positioning system, signals are received from at least three or four satellites, and the current position of the terminal device 10 equipped with the GPS module is detected based on the received signals. The position information sensor 150 may detect the current position of the terminal device 10 from the position of the wireless base station to which the terminal device 10 is connected.

[0040] The storage unit 180 is realized by, for example, the memory 15, the storage 16, etc., and stores data and programs used by the terminal device 10. The storage unit 180 stores, for example, user information 181.

[0041] The user information 181 includes, for example, information about the user who uses the terminal device 10. The information about the user includes, for example, the user's name, age, address, date of birth, contact information, and the like.

[0042] The control unit 190 is realized by the processor 19 reading a program stored in the storage unit 180 and executing instructions included in the program. The control unit 190 controls the operation of the terminal device 10. The control unit 190 functions as an operation reception unit 191, a transmission / reception unit 192, and a presentation control unit 193 by operating in accordance with the program.

[0043] The operation reception unit 191 performs processing for receiving instructions or information input from the input device 13. Specifically, for example, the operation reception unit 191 receives instructions or information input from the touch-sensitive device 131 or the like.

[0044] Furthermore, the operation reception unit 191 receives voice instructions input from the microphone 171. Specifically, for example, the operation reception unit 191 receives a voice signal that is input from the microphone 171 and converted into a digital signal by the voice processing unit 17. For example, the operation reception unit 191 analyzes the received voice signal and extracts a predetermined noun, thereby acquiring an instruction from the user.

[0045] The transmitting / receiving unit 192 performs processing for the terminal device 10 to transmit and receive data to and from an external device such as the server 20 in accordance with a communication protocol. Specifically, for example, the transmitting / receiving unit 192 transmits information input by a user or instructions from a user to the server 20. In addition, the transmitting / receiving unit 192 receives information provided by the server 20.

[0046] The presentation control unit 193 controls the output device 14 to present information provided from the server 20 to the user. Specifically, for example, the presentation control unit 193 causes the information transmitted from the server 20 to be displayed on the display 141. In addition, the presentation control unit 193 causes the information transmitted from the server 20 to be output from the speaker 172.

[0047] <3. Functional configuration of the server> 3 is a diagram illustrating an example of the functional configuration of the server 20. As illustrated in FIG. 3, the server 20 includes a communication unit 201, a storage unit 202, a control unit 203, and functions as a generation AI system 30.

[0048] The communication unit 201 performs processing for the server 20 to communicate with external devices.

[0049] The storage unit 202 includes, for example, a user table 2021, a prerequisite table 2022, and a test scenario table 2023. The tables stored in the storage unit 202 are not limited to these.

[0050] The user table 2021 is a table that stores information related to users.

[0051] The precondition table 2022 is a table that stores information related to the preconditions of a test.

[0052] The test scenario table 2023 is a table that stores information related to test scenarios.

[0053] Furthermore, the storage unit 202 stores a generative AI model 2024. While FIG. 3 shows an example in which the storage unit 202 stores one generative AI model 2024, the number of generative AI models stored in the storage unit 202 is not limited to one. The storage unit 202 may store two or more generative AI models. Furthermore, while FIG. 3 shows an example in which the server 20 operates as a generative AI system, the generative AI system may be an external system constructed independently of the server 20.

[0054] The generative AI model 2024 is, for example, a large-scale language model (LLM). A large-scale language model is a natural language model designed to perform multiple tasks in natural language processing. A large-scale language model is an example of a trained model, which is a model trained using a large number of parameters (e.g., billions to hundreds of billions) and high levels of computational resources. A natural language model is, for example, a computer program or algorithm designed to perform a task in natural language processing. For example, natural language processing involves processes such as morphological analysis, syntactic analysis, information extraction, and sentence generation, allowing a computer to analyze language used by humans (i.e., natural language) and perform predetermined processing. When a prompt (command sentence) is input, the large-scale language model generates an output based on the text, image, etc. of the prompt. The prompt can be specified in natural language.

[0055] When the generative AI model 2024 is a large-scale language model, examples include the GPT series (Generative Pre-trained Transformer) developed by OPEN AI, BERT (Bidirectional Encoder Representations from Transformers) developed by Google, StableLM developed by StableAI, or Llama2, Palm2 (registered trademark), and LamDA2 (registered trademark) developed by Meta.

[0056] A prompt is a query that is primarily input to the generation AI. The query may include, for example, text, character strings, images, videos, audio, etc. The prompt may also include gestures. By inputting a prompt to the generation AI, the user instructs the generation AI to process information. The user includes in the prompt information that causes the generation AI to output the desired output result.

[0057] The prompt may be input, for example, by a user's input operation via the terminal device 10. The prompt may also be input by uploading a document file, an image, a video, audio, or the like. The server 20 may create the prompt by combining, for example, an instruction statement input via the operation of the terminal device 10 with uploaded data, etc. The prompt may include one or more instruction statements. The prompt may also include one or more data. The prompt may also include one or more instruction statements and one or more data.

[0058] The server 20 may create a prompt by including other instructions or data, etc., in a predetermined instruction. The server 20 may also create a prompt by inserting other instructions or data, etc., into a predetermined instruction. The server 20 may also create a prompt by combining other instructions or data, etc., with a predetermined instruction. The server 20 may also create a prompt by combining a predetermined instruction with other instructions or data, etc. The server 20 may also create a prompt by adding other instructions or data, etc., to a predetermined instruction.

[0059] The server 20 may also create a prompt by including other instructions or data, etc. in the predetermined data, etc. The server 20 may also create a prompt by inserting other instructions or data, etc. into the predetermined data, etc. The server 20 may also create a prompt by combining other instructions or data, etc. with the predetermined data, etc. The server 20 may also create a prompt by combining the predetermined data, etc. with other instructions or data, etc. The server 20 may also create a prompt by adding other instructions or data, etc. to the predetermined data, etc.

[0060] In this embodiment, expressions such as "include," "insert," "combine," "combine," and "append," which are used when creating a prompt from a predetermined instruction, data, and the like, may be used as terms indicating the same information processing. In other words, when creating the same prompt based on one or more instruction, data, and the like, these may be treated as the same information processing. For example, the term "include" includes information processing such as "insert," "combine," "combine," and "append." Similarly, "insert," "combine," "combine," and "append" also include information processing such as "include," "insert," "combine," "combine," and "append," respectively.

[0061] The control unit 203 is realized by the processor 29 reading a program stored in the storage unit 202 and executing instructions included in the program. The program includes an application such as a web browser application. The program includes a programming language such as JavaScript (registered trademark) that is executed on the web browser application stored in the terminal device 10. The control unit 203 operates in accordance with the program to perform functions shown as a reception control module 2031, a transmission control module 2032, a service processing module 2033, and a presentation control module 2034.

[0062] The reception control module 2031 controls the process by which the server 20 receives signals from external devices in accordance with a communication protocol.

[0063] The transmission control module 2032 controls the process in which the server 20 transmits signals to external devices in accordance with a communication protocol.

[0064] The service processing module 2033 controls a series of processes related to test script creation. Specifically, for example, the service processing module 2033 creates a prompt including information about the test (test scenario, prerequisites), summary information about the page, and an instruction statement instructing the output of test procedure information. The service processing module 2033 inputs the created prompt to the generative AI model 2024 and causes the generative AI model 2024 to output the test procedure information in JSON format. The procedure information in JSON format is machine-readable test design information including, for example, individual test steps, operation targets, input data, expected results, etc.

[0065] The service processing module 2033 determines whether the operation steps (procedures) included in the output procedure information satisfy predetermined requirements. The predetermined requirements are, for example, requirements for creating a test script based on the procedure information. In this embodiment, the predetermined requirement is, for example, that the operation steps (procedures) included in the procedure information have one component to be operated. If all operation steps included in the procedure information satisfy the predetermined requirements, the service processing module 2033 creates a test script based on the procedure information in JSON format. If at least one of the operation steps included in the procedure information does not satisfy the predetermined requirements, the service processing module 2033 includes in a prompt a message indicating that the predetermined processing step does not satisfy the requirements, and causes the generative AI model 2024 to create new procedure information.

[0066] The presentation control module 2034 controls the process of presenting information to the user.

[0067] <4. Data Structure> The data structure of the tables stored in the server 20 will be described. Note that the data structure described is an example and does not exclude data that is not described. Furthermore, even data that is described in the same table may be stored in separate storage areas in the storage unit 202. Each table may have columns other than the columns described in that table. Each table may not have any of the columns described in that table.

[0068] Fig. 4 is a diagram showing the data structure of the user table 2021. As shown in Fig. 4, the user table 2021 has columns such as name, date of birth, email address, and affiliation, with the user ID as a key. Note that the columns included in the user table 2021 are not limited to these. The user table 2021 may not have any of these columns, or may have columns other than these.

[0069] User ID is a column that stores an identifier for uniquely identifying a user.

[0070] Name is a column that stores the name of the user.

[0071] The date of birth is a column that stores the user's date of birth.

[0072] The email address is a column that stores the email address of the terminal device 10 owned by the user.

[0073] The affiliation is a column that stores the organization to which the user belongs.

[0074] Fig. 5 is a diagram showing the data structure of the precondition table 2022. As shown in Fig. 5, the precondition table 2022 has columns such as content, scenario ID, creator, and creation date and time, with a precondition ID as a key. Note that the columns that the precondition table 2022 has are not limited to these. The precondition table 2022 may not have any of these columns, or may have columns other than these.

[0075] The precondition ID is a column that stores an identifier for uniquely identifying a precondition.

[0076] The content is a column that stores the content of the prerequisites. For example, the content may include the URL of the test target, the user name and password for performing the test, information about the test environment, and restrictions on operation.

[0077] The scenario ID is a column that stores the identifier of the test scenario with which the precondition is associated.

[0078] The creator is a column for storing the creator of the prerequisite. The creator may be a user or a business operator.

[0079] The creation date and time is a column that stores the date and time when the prerequisite was created.

[0080] FIG. 6 is a diagram showing the data structure of the test scenario table 2023. As shown in FIG. 6, the test scenario table 2023 has columns such as scenario name, content, creator, and creation date and time, with a scenario ID as a key. Note that the columns included in the test scenario table 2023 are not limited to these. The test scenario table 2023 may not include any of these columns, or may include columns other than these. For example, the test scenario table 2023 may store preconditions. In this case, for example, the precondition table 2022 may become unnecessary.

[0081] The scenario ID is a column that stores an identifier for uniquely identifying a test scenario.

[0082] The scenario name is a column that stores the name of the test scenario, which briefly indicates the purpose of the scenario, the content to be tested, or a combination thereof.

[0083] The "Content" column stores the content of the test scenario. For example, the "Content" column includes test procedures, expected results, and various information required to execute the test scenario. The test procedures specifically describe, for example, the operations performed by the user and the processes executed by the system in chronological order.

[0084] The creator is a column for storing the creator of the test scenario. The creator may be a user or a business operator.

[0085] The creation date and time is a column that stores the date and time when the test scenario was created.

[0086] <5. Operation> An example of the flow of operations performed by the server 20 will be described.

[0087] FIG. 7 is a flowchart showing an example of the operation of the server 20 when creating a test script.

[0088] First, the user accesses the server 20 using the terminal device 10. The user logs in to a website that provides a test script creation service, for example, by entering their user ID and password. The server 20 provides the test script creation service on the website as SaaS (Software as a Service).

[0089] In step S1001, the server 20 accepts a designation of information related to a test from a user. Specifically, for example, the presentation control module 2034 presents a list of prerequisites stored in the prerequisite table 2022 and a list of test scenarios stored in the test scenario table 2023 to the user on a website as information related to the test, and accepts the designation from the user. The user, for example, designates the test scenario and prerequisites displayed in the list via the terminal device 10. The user may operate the terminal device 10 to upload the test scenario and prerequisites to the server 20. If the test scenario and the prerequisite are associated with each other, the associated prerequisite may be designated by designating the test scenario. The terminal device 10 transmits information related to the test designated by the user to the server 20. The reception control module 2031 receives the test scenario and prerequisites designated by the user from the terminal device 10 as information related to the test.

[0090] In step S1002, the server 20 acquires summary information of the page related to the test scenario. Specifically, for example, the service processing module 2033 reads out WAI-ARIA roles and labels as summary information of the page from the page expressed in HTML on which the function to be tested is executed.

[0091] In step S1003, the server 20 creates a prompt to be input to the generative AI model 2024. Specifically, for example, the service processing module 2033 creates a prompt including information about the test, summary information about UI components included in the page, and an instruction statement instructing output of test procedure information. The instruction statement may be, for example, "You are a professional AI assistant who generates detailed procedure information for automating the testing of web applications. Based on the information I will provide, please output the test procedure information in JSON format for each step: [Test scenario], [Preconditions], [WAI-ARIA role and label of the target component]."

[0092] In step S1004, the server 20 causes the generating AI model 2024 to output procedure information in JSON format. Specifically, for example, the service processing module 2033 inputs the created prompt into the generating AI model 2024 and causes the generating AI model 2024 to output procedure information. The JSON format procedure information includes, for example, a description of the procedure, the operation content of each step, information identifying the element to be operated, input data, expected results, etc.

[0093] In step S1005, the server 20 determines whether the operation steps included in the procedure information satisfy predetermined requirements. Specifically, for example, the service processing module 2033 performs the process shown in Fig. 8 to determine whether the operation steps included in the procedure information satisfy predetermined requirements.

[0094] FIG. 8 is a flowchart showing an example of the operation of the control unit 203 when determining whether or not the operation steps included in the procedure information satisfy predetermined requirements.

[0095] In step S10051, the service processing module 2033 determines whether or not one component is to be operated in one operation step (procedure) included in the procedure information. For example, if multiple components are to be operated in an operation step, the service processing module 2033 determines "No." On the other hand, for example, if there is one component to be operated in an operation step, the service processing module 2033 determines "Yes." If the determination is "Yes," the service processing module 2033 shifts the processing to step S10052. If the determination is "No," the service processing module 2033 shifts the processing to step S10053.

[0096] In step S10052, the service processing module 2033 resets the count of the number of times.

[0097] In step S10053, the service processing module 2033 counts up the number of times, that is, the service processing module 2033 counts the number of times that a predetermined operation step in the procedure information includes multiple operation targets.

[0098] In step S10054, the service processing module 2033 determines whether or not there are any other operation steps remaining in the procedure information. If there are no other operation steps remaining in the procedure information, the service processing module 2033 shifts the process to step S1006. That is, if there is only one component to be operated in all operation steps included in the procedure information, the service processing module 2033 shifts the process to step S1006. On the other hand, if there are other operation steps remaining in the procedure information, the service processing module 2033 shifts the process to step S10055.

[0099] In step S10055, the service processing module 2033 selects the next operation step included in the procedure information, transitions to step S10051, and repeats the same process for the newly selected operation step. The next operation step refers to, for example, the next operation step in descending order included in the procedure information.

[0100] In step S10056, the service processing module 2033 determines whether the number of times has reached a predetermined number. The predetermined number is, for example, a number that is determined to be more efficient when set by a person. If the predetermined number of times has been reached, the service processing module 2033 shifts the processing to step S10057. If the predetermined number of times has not been reached, the service processing module 2033 shifts the processing to step S10058.

[0101] In step S10057, the service processing module 2033 receives a designation of an operation step from the user. Specifically, for example, the service processing module 2033 receives a designation of a component to be operated for an operation step determined to have multiple operation targets.

[0102] In step S10059, the service processing module 2033 creates supplemental information about the specified operation target for a given operation step (for example, a WAI-ARIA role and label for the specified UI component). The service processing module 2033 transitions the process to step S1003. In step S1003, the service processing module 2033 creates a new prompt including, for example, information about the test, summary information about the UI components included in the page, supplemental information about the specified operation target, and an instruction statement instructing the output of test procedure information. The service processing module 2033 uses the newly created prompt to repeat the processes of steps S1004 and S1005.

[0103] In step S10058, the service processing module 2033 creates supplemental information indicating that two or more operation targets were included in the specified operation step. The service processing module 2033 transitions the process to step S1003. In step S1003, the service processing module 2033 creates a new prompt including, for example, information about the test, summary information about the UI components included in the page, supplemental information indicating that two or more operation targets were included in the specified operation step, and an instruction statement instructing output of test procedure information. The service processing module 2033 uses the newly created prompt to repeat the processes of steps S1004 and S1005.

[0104] 7, in step S1006, the server 20 creates a test script based on the procedure information. Specifically, the service processing module 2033 converts the operation steps included in the procedure information into specific commands or program code that can be understood and executed by a specific test automation framework.

[0105] <6. Screen Examples> An example of a screen on the display 141 of the terminal device 10 in the present disclosure will be described.

[0106] FIG. 9 shows an example of a screen that displays a list of test prerequisites and a list of test scenarios in step S1001 and accepts designations from the user.

[0107] Area 3001 displays a list of test preconditions stored in the precondition table 2022 and is an area for accepting designations from the user. The test preconditions are displayed in a list format. The user designates a test precondition by clicking or tapping a radio button located next to each test precondition on the terminal device 10. In the example of FIG. 9, the user designates a precondition with a precondition ID of C001.

[0108] Area 3002 displays a list of test scenarios stored in the test scenario table 2023 and is an area for accepting designations from the user. Test scenarios are displayed in a list format. The user designates a test scenario by clicking or tapping the radio button next to each test scenario on the terminal device 10. In the example of FIG. 9, the user designates a test scenario with a scenario ID of S001.

[0109] <7.Summary> As described above, in the above embodiment, the control unit 203 receives a user's specification of information related to a test. The control unit 203 reads WAI-ARIA roles and labels from a page expressed in HTML as summary information about the page on which the function to be tested is executed. The control unit 203 creates a prompt including information about the test, summary information about the page on which the function to be tested is executed, and an instruction statement instructing output of test procedure information. The control unit 203 inputs the prompt to the generative AI model 2024 and causes the generative AI model 2024 to output the test procedure information. The control unit 203 creates a test script based on the procedure information. At this time, the information about the test is a prerequisite and a test scenario. This enables the control unit 203 to accurately grasp the elements to be operated on the page on which the function to be tested is executed, and then cause the generative AI model 2024 to create procedure information.

[0110] Therefore, the server 20 according to this embodiment can utilize the generation AI to reduce the effort required to create a test script.

[0111] In the above embodiment, the control unit 203 determines whether the procedure included in the procedure information satisfies predetermined requirements. If the procedure does not satisfy the predetermined requirements, the control unit 203 creates a prompt including information indicating that the predetermined requirements are not satisfied, and recreates the procedure information. This enables the control unit 203 to create procedure information that can be used to create a test script with high accuracy, based on information about the test.

[0112] In the above embodiment, the control unit 203 counts the number of times the requirements are not satisfied, and when the count reaches a predetermined value, it accepts from the user a designation for the element to be operated. The control unit 203 creates a prompt including the element designated by the user, and recreates the procedure information. In other words, the control unit 203 accepts a designation from the user for the operation step in which an error occurs repeatedly. This allows the control unit 203 to create procedure information with high accuracy even for test scenarios that include operations that are difficult to define.

[0113] <8. Variations> In the above embodiment, an example has been described in which it is determined whether or not the operation steps included in the procedure information output from the generation AI model 2024 satisfy predetermined requirements, and if so, a test script is created based on the procedure information. However, the operation of the server 20 is not limited to the above embodiment. For example, the server 20 may determine whether or not the operation steps that satisfy predetermined requirements can be executed by Playwright, and if so, create a test script based on the procedure information.

[0114] FIG. 10 is a flowchart showing another example of the operation of the server 20 when creating a test script.

[0115] In steps S1001 to S1004, the server 20 executes the same processes as those in FIG.

[0116] In step S2001, the server 20 determines whether the operation steps included in the procedure information satisfy predetermined requirements, and determines whether the operation steps that satisfy the predetermined requirements can be executed by Playwright. Specifically, for example, the service processing module 2033 performs the process shown in Fig. 11 to determine whether the operation steps included in the procedure information satisfy predetermined requirements, and determines whether the operation steps that satisfy the predetermined requirements can be executed by Playwright.

[0117] FIG. 11 is a flowchart showing an example of the operation of the control unit 203 when checking the procedure information.

[0118] In step S10051, the service processing module 2033 determines whether or not one component is to be operated in one operation step (procedure) included in the procedure information. For example, if multiple components are to be operated in an operation step, the service processing module 2033 determines "No." On the other hand, for example, if there is one component to be operated in an operation step, the service processing module 2033 determines "Yes." If the determination is "Yes," the service processing module 2033 shifts the process to step S20011. If the determination is "No," the service processing module 2033 shifts the process to step S20012.

[0119] In step S20011, the service processing module 2033 executes the operation step with Playwright. Specifically, the service processing module 2033 reads, for example, the operation content, information identifying the element to be operated, input data, expected results, etc. for the corresponding operation step. The service processing module 2033 creates a test script for Playwright based on the read information. The service processing module 2033 executes the created test script with Playwright.

[0120] In step S20013, the service processing module 2033 determines whether the operation by Playwright was successful. If the operation by Playwright has ended, the service processing module 2033 shifts the process to step S10052. On the other hand, if the operation by Playwright has not ended (for example, if a predetermined error occurs before ending), the service processing module 2033 shifts the process to step S20012.

[0121] In step S10052, the service processing module 2033 resets the count of the number of times.

[0122] In step S20012, the service processing module 2033 counts up the number of times. That is, the service processing module 2033 counts the number of times that multiple operation targets are included in a predetermined operation step in the procedure information, and the number of times that an operation in Playwright was unsuccessful. That is, the service processing module 2033 counts the number of times that an error occurred in a predetermined operation step in the procedure information.

[0123] In step S10054, the service processing module 2033 determines whether or not there are any other operation steps remaining in the procedure information. If there are no other operation steps remaining in the procedure information, the service processing module 2033 transitions the process to step S1006. That is, if there is only one component to be operated in all operation steps included in the procedure information and the processing is executed normally in Playwright, the service processing module 2033 transitions the process to step S1006. On the other hand, if there are other operation steps remaining in the procedure information, the service processing module 2033 transitions the process to step S10055.

[0124] In step S10055, the service processing module 2033 selects the next operation step included in the procedure information, transitions to step S10051, and repeats the same process for the newly selected operation step. The next operation step refers to, for example, the next operation step in descending order included in the procedure information.

[0125] In step S20014, the service processing module 2033 determines whether the number of times has reached a predetermined number. The predetermined number is, for example, a number that is determined to be more efficient if set by a person. If the predetermined number of times has been reached, the service processing module 2033 shifts the processing to step S20015. If the predetermined number of times has not been reached, the service processing module 2033 shifts the processing to step S20016.

[0126] In step S20015, the service processing module 2033 receives a designation of an operation step from the user. Specifically, for example, the service processing module 2033 receives a designation of a component to be operated for an operation step that has multiple operation targets, that has not been successfully operated in Playwright, or that is determined to be a combination of these.

[0127] In step S10059, the service processing module 2033 creates supplemental information about the specified operation target for a given operation step (for example, a WAI-ARIA role and label for the specified UI component). The service processing module 2033 transitions the process to step S1003. In step S1003, the service processing module 2033 creates a new prompt including, for example, information about the test, summary information about the UI components included in the page, supplemental information about the specified operation target, and an instruction statement instructing the output of test procedure information. The service processing module 2033 uses the newly created prompt to repeat the processes of steps S1004 and S1005.

[0128] In step S20016, the service processing module 2033 creates supplemental information indicating that an error occurred in a specified operation step. Specifically, the service processing module 2033 creates supplemental information indicating that there are multiple operation targets, that the operation in Playwright was not successful, or a combination of these was determined. The service processing module 2033 transitions the process to step S1003. In step S1003, the service processing module 2033 creates a new prompt including, for example, information about the test, summary information about UI components included in the page, supplemental information about the specified operation step, and an instruction statement instructing the output of test procedure information. The service processing module 2033 uses the newly created prompt to repeat the processes of steps S1004 and S1005.

[0129] 10, in step S1006, the server 20 creates a test script based on the procedure information. Specifically, the service processing module 2033 converts the operation steps included in the procedure information into specific commands or program code that can be understood and executed by a specific test automation framework.

[0130] As described above, in the above embodiment, the service processing module 2033 determines whether the operations related to the procedures included in the procedure information are executable using Playwright. If the operations related to at least one of the procedures included in the procedure information are not executable using Playwright, the service processing module 2033 creates a new prompt including information about the test, summary information, information indicating that the operations related to at least one of the procedures included in the procedure information are not executable, and an instruction statement instructing the output of test procedure information. The service processing module 2033 inputs the new prompt to the generative AI model 2024 and causes the generative AI 2024 to output test procedure information. This makes it possible to use Playwright to confirm whether the procedure information output from the generative AI model 2024 is normally executable. Therefore, the control unit 203 can create procedure information that allows a test script to be created with high accuracy based on the information about the test.

[0131] In the above embodiment, the control unit 203 counts the number of times the requirements are not satisfied, and when the count reaches a predetermined value, it accepts from the user a designation for the element to be operated. The control unit 203 creates a prompt including the element designated by the user, and recreates the procedure information. In other words, the control unit 203 accepts a designation from the user for the operation step in which an error occurs repeatedly. This allows the control unit 203 to create procedure information with high accuracy even for test scenarios that include operations that are difficult to define.

[0132] In the above embodiment, the control unit 203 executes the processes shown in FIG. 7 or FIG. 10. However, the processes of steps S1004 to S1006 shown in FIG. 7 may be executed by the generative AI model 2024 without the control unit 203. Furthermore, the processes of steps S1004, S2001, and S1006 shown in FIG. 10 may be executed by the generative AI model 2024 without the control unit 203. That is, these processes may be executed by, for example, a so-called AI agent using the generative AI model 2024. The AI ​​agent may be, for example, an autonomous AI agent such as AutoGPT (Generative Pre-trained Transformer). Furthermore, the AI ​​agent may be an autonomous AI agent created specifically for creating test scripts based on test scenarios.

[0133] For example, when an autonomous AI agent is given a goal, it has a generating AI generate a task to achieve that goal, collects information to have the generating AI execute the generated task, and outputs information to achieve the goal by repeating the process of having the generating AI execute the task.

[0134] Furthermore, the above embodiment illustrates an example in which the server 20 stores the generative AI model 2024. The generative AI model may not be stored in the server 20 but may be stored in an external system. In other words, the server 20 may use an externally constructed generative AI system.

[0135] Furthermore, in the above embodiment, the procedure information does not refer to the type of terminal on which the test is to be performed. In this embodiment, the terminal to be tested may be a desktop PC, a laptop PC, a smartphone, a tablet terminal, a head-mounted display, or the like. In other words, the instruction included in the prompt may be an instruction to output test procedure information on a personal computer, an instruction to output test procedure information on a tablet terminal, an instruction to output test procedure information on a smartphone, or an instruction to output test procedure information on a head-mounted display.

[0136] <9. Basic Computer Hardware Configuration> 12 is a block diagram showing the basic hardware configuration of a computer 90. The computer 90 includes at least a processor 901, a main memory device 902, an auxiliary memory device 903, and a communication IF 991 (interface), which are electrically connected to one another by a communication bus 921.

[0137] The processor 901 is hardware for executing an instruction set written in a program, and is composed of an arithmetic unit, registers, peripheral circuits, and the like.

[0138] The main memory device 902 is used to temporarily store programs, data to be processed by the programs, etc. For example, it is a volatile memory such as a DRAM (Dynamic Random Access Memory).

[0139] The auxiliary storage device 903 is a storage device for saving data and programs, such as a flash memory, a hard disk drive (HDD), a magneto-optical disk, a CD-ROM, a DVD-ROM, or a semiconductor memory.

[0140] The communication IF 991 is an interface for inputting and outputting signals for communicating with other computers via a network using wired or wireless communication standards. The network is composed of the Internet, a LAN, various mobile communication systems constructed by wireless base stations, etc. For example, the network includes 3G, 4G, and 5G mobile communication systems, LTE (Long Term Evolution), and wireless networks (e.g., Wi-Fi (registered trademark)) that can connect to the Internet via a predetermined access point. In the case of a wireless connection, communication protocols include, for example, Z-Wave (registered trademark), ZigBee (registered trademark), and Bluetooth (registered trademark). In the case of a wired connection, the network also includes a direct connection using a USB (Universal Serial Bus) cable, etc.

[0141] It should be noted that the computer 90 can be virtually realized by distributing all or part of each hardware configuration across multiple computers 90 and interconnecting them via a network. In this way, the computer 90 is a concept that includes not only a computer 90 housed in a single housing or case, but also a virtualized computer system.

[0142] <Basic functional configuration of computer 90> A description will now be given of the functional configuration of the computer realized by the basic hardware configuration of the computer 90. The computer comprises at least the functional units of a control unit, a storage unit, and a communication unit.

[0143] The functional units of the computer 90 can also be realized by distributing all or part of the functional units among multiple computers 90 interconnected via a network. The computer 90 is a concept that includes not only a single computer 90 but also a virtualized computer system.

[0144] The control unit is realized by the processor 901 reading out various programs stored in the auxiliary storage device 903, expanding them in the main storage device 902, and executing processing in accordance with the programs. The control unit can realize functional units that perform various types of information processing depending on the type of program. In this way, the computer is realized as an information processing device that performs information processing.

[0145] The storage unit is realized by a main storage device 902 and an auxiliary storage device 903. The storage unit stores data, various programs, and various databases. Furthermore, the processor 901 can allocate a storage area corresponding to the storage unit in the main storage device 902 or the auxiliary storage device 903 in accordance with the programs. Furthermore, the control unit can cause the processor 901 to execute processes for adding, updating, and deleting data stored in the storage unit in accordance with the various programs.

[0146] A database refers to a relational database, which manages data sets called masters and tables in a tabular format structurally defined by rows and columns, by relating them to each other. In a database, a table is called a table, a master, a column in a table is called a column, and a row in a table is called a record. In a relational database, relationships between tables and masters can be set and associated. Typically, each table and each master has a column set as a primary key to uniquely identify a record, but setting a primary key to a column is not essential. The control unit can cause the processor 901 to add, delete, or update records in specific tables and masters stored in the storage unit according to various programs. Furthermore, by storing data, various programs, and various databases in the storage unit, it can be considered that the information processing device and information processing system according to the present disclosure have been manufactured.

[0147] Note that the databases and masters in this disclosure may include any data structure in which information is structurally defined (such as a list, dictionary, associative array, or object). The data structure also includes data that can be considered as a data structure by combining data with functions, classes, methods, etc. written in any programming language.

[0148] The communication unit is realized by the communication IF 991. The communication unit realizes a function of communicating with other computers 90 via a network. The communication unit can receive information transmitted from other computers 90 and input the information to the control unit. The control unit can cause the processor 901 to execute information processing on the received information in accordance with various programs. In addition, the communication unit can transmit information output from the control unit to other computers 90.

[0149] Furthermore, the above-described configurations, functions, processing units, processing means, etc. may be partially or entirely implemented in hardware, for example, by designing them as integrated circuits. The present invention can also be realized by software program code that implements the functions of the embodiments. In this case, a storage medium on which the program code is recorded is provided to a computer, and a processor included in the computer reads the program code stored in the storage medium. In this case, the program code itself read from the storage medium implements the functions of the above-described embodiments, and the program code itself and the storage medium on which it is stored constitute the present invention. Examples of storage media for providing such program code include flexible disks, CD-ROMs, DVD-ROMs, hard disks, SSDs, optical disks, magneto-optical disks, CD-Rs, magnetic tape, non-volatile memory cards, and ROMs.

[0150] Furthermore, the program code that realizes the functions described in this embodiment can be implemented in a wide range of program or script languages, such as assembler, C / C++, perl, Shell, PHP, and Java (registered trademark).

[0151] Furthermore, the program code of the software that realizes the functions of the embodiments may be distributed via a network and stored in a storage means such as a computer's hard disk or memory, or in a storage medium such as a CD-RW or CD-R, and the processor of the computer may read and execute the program code stored in the storage means or storage medium.

[0152] The functions performed by the components described herein may be implemented in circuitry or processing circuitry, including general-purpose processors, application-specific processors, integrated circuits, ASICs (Application Specific Integrated Circuits), a CPU (a Central Processing Unit), conventional circuits, and / or combinations thereof, programmed to perform the described functions. A processor includes transistors and other circuits and is considered to be circuitry or processing circuitry. A processor may also be a programmed processor that executes programs stored in memory. In this specification, a circuitry, unit, or means is hardware that is programmed to realize or performs the described functions, which may be any hardware disclosed herein or any hardware known to be programmed to realize or perform the described functions. If the hardware is a processor considered to be a type of circuitry, the circuitry, means, or unit is a combination of the hardware and software used to configure the hardware and / or processor.

[0153] Although several embodiments of the present disclosure have been described above, these embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and modifications are intended to be included in the scope of the inventions and their equivalents as defined in the claims, as well as in the scope and spirit of the inventions.

[0154] (Addendum) The matters described in the above embodiments will be supplemented below. (Appendix 1) A program to be executed by a computer having a processor and a memory, the program causing the processor to: receiving from a user designation of information regarding the test; A step of reading WAI-ARIA (Web Accessibility Initiative Accessible Rich Internet Applications) roles and labels from a page expressed in HTML as summary information about the page on which the function to be tested is executed; creating a first prompt including an instruction to output information about the test, the summary information, and test procedure information; inputting the first prompt to a generation AI and causing the generation AI to output procedure information for the test; creating a test script based on the procedure information; A program that executes the following. (Appendix 2) 2. The program of claim 1, wherein the information about the test is a test scenario and prerequisites. (Appendix 3) determining whether the procedure included in the procedure information satisfies predetermined requirements; If at least one of the procedures included in the procedure information does not satisfy a predetermined requirement, a second prompt is generated, the second prompt including information about the test, the summary information, information indicating that at least one of the procedures included in the procedure information does not satisfy a predetermined requirement, and an instruction to output procedure information of the test. causing the processor to execute A program described in any of Appendixes 1 to 2, wherein in the step of outputting the procedure information, the second prompt is input to the generation AI, causing the generation AI to output the test procedure information. (Appendix 4) When at least one of the procedures included in the procedure information does not satisfy a predetermined requirement, counting the number of times that at least one of the procedures included in the procedure information does not satisfy the predetermined requirement; When the number of times reaches a predetermined number, accepting a designation from the user for an element to be operated in a procedure that does not satisfy the requirements; When the number of times reaches a predetermined number, generating a third prompt including an instruction to output information about the test, the summary information, summary information representing an element specified by the user, and test procedure information; causing the processor to execute A program as described in Appendix 3, wherein in the step of outputting the procedure information, the third prompt is input to the generation AI, causing the generation AI to output the procedure information for the test. (Appendix 5) determining whether an operation related to a procedure included in the procedure information is executable; if an operation related to at least one of the procedures included in the procedure information is not executable, creating a second prompt including information about the test, the summary information, information indicating that an operation related to at least one of the procedures included in the procedure information is not executable, and an instruction to output procedure information of the test; causing the processor to execute A program described in any of Appendices 1 to 4, wherein in the step of outputting the procedure information, the second prompt is input to the generation AI, causing the generation AI to output the test procedure information. (Appendix 6) When an operation related to at least one of the procedures included in the procedure information is not executable, counting the number of times that an operation related to at least one of the procedures included in the procedure information is not executable; When the number of times reaches a predetermined number, accepting a designation from the user for an element that is a target of an operation that cannot be executed; When the number of times reaches a predetermined number, generating a third prompt including an instruction to output information about the test, the summary information, summary information representing an element specified by the user, and test procedure information; causing the processor to execute A program as described in Appendix 5, wherein in the step of outputting the procedure information, the third prompt is input to the generation AI, causing the generation AI to output the procedure information for the test. (Appendix 7) a step of determining whether or not an operation related to a procedure included in the procedure information is executable when all procedures included in the procedure information satisfy predetermined requirements; If an operation related to at least one of the procedures included in the procedure information is not executable, creating a third prompt including information about the test, the summary information, information indicating that an operation related to at least one of the procedures included in the procedure information is not executable, and an instruction to output procedure information of the test; causing the processor to execute A program as described in Appendix 3, wherein in the step of outputting the procedure information, the third prompt is input to the generation AI, causing the generation AI to output the procedure information for the test. (Appendix 8) When at least one of the procedures included in the procedure information does not satisfy a predetermined requirement, counting a first number of times that at least one of the procedures included in the procedure information does not satisfy a predetermined requirement, and when an operation related to at least one of the procedures included in the procedure information is not executable, counting a second number of times that an operation related to at least one of the procedures included in the procedure information is not executable; When the sum of the first number of times and the second number of times reaches a predetermined number, accepting a designation from the user for an element to be operated in a corresponding procedure; generating a fourth prompt including an instruction to output information about the test, the summary information, summary information representing an element specified by the user, and test procedure information when the sum of the first number of times and the second number of times reaches a predetermined number; causing the processor to execute A program as described in Appendix 7, wherein in the step of outputting the procedure information, the fourth prompt is input to the generation AI, causing the generation AI to output the procedure information for the test. (Appendix 9) A program described in any of Appendices 1 to 8, wherein in the step of creating the first prompt, the instruction statement is an instruction statement instructing the output of test procedure information on a personal computer, an instruction statement instructing the output of test procedure information on a tablet terminal, or an instruction statement instructing the output of test procedure information on a smartphone. (Appendix 10) The program described in Appendix 3 or Appendix 5, wherein in the step of creating the second prompt, the instruction statement is an instruction statement instructing the output of test procedure information on a personal computer, an instruction statement instructing the output of test procedure information on a tablet terminal, or an instruction statement instructing the output of test procedure information on a smartphone. (Appendix 11) The program described in any one of Appendix 4, Appendix 6, and Appendix 7, wherein in the step of creating the third prompt, the instruction statement is an instruction statement instructing the output of test procedure information on a personal computer, an instruction statement instructing the output of test procedure information on a tablet terminal, or an instruction statement instructing the output of test procedure information on a smartphone. (Appendix 12) The program described in Appendix 8, wherein in the step of creating the fourth prompt, the instruction statement is an instruction statement instructing the output of test procedure information on a personal computer, an instruction statement instructing the output of test procedure information on a tablet terminal, or an instruction statement instructing the output of test procedure information on a smartphone. (Appendix 13) 1. A computer-implemented method comprising a processor and a memory, the processor: receiving from a user designation of information regarding the test; A step of reading WAI-ARIA (Web Accessibility Initiative Accessible Rich Internet Applications) roles and labels from a page expressed in HTML as summary information about the page on which the function to be tested is executed; creating a first prompt including an instruction to output information about the test, the summary information, and test procedure information; inputting the first prompt to a generation AI and causing the generation AI to output procedure information for the test; creating a test script based on the procedure information; How to do it. (Appendix 14) An information processing device comprising a processor and a memory, wherein the processor: receiving from a user designation of information regarding the test; A step of reading WAI-ARIA (Web Accessibility Initiative Accessible Rich Internet Applications) roles and labels from a page expressed in HTML as summary information about the page on which the function to be tested is executed; creating a first prompt including an instruction to output information about the test, the summary information, and test procedure information; inputting the first prompt to a generation AI and causing the generation AI to output procedure information for the test; creating a test script based on the procedure information; An information processing device that executes the above. (Appendix 15) means for receiving from a user designation of information regarding the test; means for reading out WAI-ARIA (Web Accessibility Initiative Accessible Rich Internet Applications) roles and labels from a page expressed in HTML as summary information about the page on which the function to be tested is executed; means for generating a prompt including instructions for outputting the information about the test, the summary information, and test procedure information; a means for inputting the prompt to a generation AI and causing the generation AI to output procedure information for the test; means for creating a test script based on the procedure information; A system comprising: [Explanation of symbols]

[0155] 1. System 10...Terminal device 12...Communication IF 13...Input device 14...Output device 15...Memory 16…Storage 19...Processor 20...Server 22...Communication IF 23...Input / output interface 25…Memory 26…Storage 29...Processor 80…Network

Claims

1. A program to be executed by a computer having a processor and a memory, the program causing the processor to: receiving from a user designation of information regarding the test; A step of reading WAI-ARIA (Web Accessibility Initiative Accessible Rich Internet Applications) roles and labels from a page expressed in HTML as summary information about the page on which the function to be tested is executed; creating a first prompt including an instruction statement instructing output of information about the test, the summary information, and test procedure information; inputting the first prompt to a generation AI and causing the generation AI to output procedure information for the test; creating a test script based on the procedure information; Execute determining whether the procedure included in the procedure information satisfies predetermined requirements; If at least one of the procedures included in the procedure information does not satisfy a predetermined requirement, a second prompt is generated, the second prompt including information about the test, the summary information, information indicating that at least one of the procedures included in the procedure information does not satisfy a predetermined requirement, and an instruction to output procedure information about the test; inputting the second prompt to the generating AI and causing the generating AI to output procedure information for the test; Then run In the step of outputting the procedure information, the second prompt is input to the generation AI, and the generation AI is caused to output the procedure information of the test. program.

2. The program according to claim 1 , wherein the information about the test is a test scenario and a prerequisite.

3. When at least one of the procedures included in the procedure information does not satisfy a predetermined requirement, counting the number of times that at least one of the procedures included in the procedure information does not satisfy the predetermined requirement; When the number of times reaches a predetermined number, accepting a designation from the user for an element to be operated in a procedure that does not satisfy the requirements; When the number of times reaches a predetermined number, a third prompt is generated, the third prompt including an instruction to output information about the test, the summary information, summary information representing an element designated by the user, and test procedure information. causing the processor to execute 2. The program according to claim 1, wherein in the step of outputting procedure information, the third prompt is input to the generation AI, causing the generation AI to output the test procedure information.

4. A program to be executed by a computer having a processor and a memory, the program causing the processor to: receiving from a user designation of information regarding the test; A step of reading WAI-ARIA (Web Accessibility Initiative Accessible Rich Internet Applications) roles and labels from a page expressed in HTML as summary information about the page on which the function to be tested is executed; creating a first prompt including an instruction statement instructing output of information about the test, the summary information, and test procedure information; inputting the first prompt to a generation AI and causing the generation AI to output procedure information for the test; creating a test script based on the procedure information; Execute determining whether an operation related to a procedure included in the procedure information is executable; if an operation related to at least one of the procedures included in the procedure information is not executable, creating a second prompt including information about the test, the summary information, information indicating that an operation related to at least one of the procedures included in the procedure information is not executable, and an instruction statement instructing to output procedure information of the test; Then run In the step of outputting the procedure information, the second prompt is input to the generation AI, and the generation AI is caused to output the procedure information of the test. program.

5. When an operation related to at least one of the procedures included in the procedure information is not executable, counting the number of times that an operation related to at least one of the procedures included in the procedure information is not executable; When the number of times reaches a predetermined number, accepting a designation from the user for an element that is a target of an operation that cannot be executed; When the number of times reaches a predetermined number, a third prompt is generated, the third prompt including an instruction to output information about the test, the summary information, summary information representing an element designated by the user, and test procedure information. causing the processor to execute 5. The program according to claim 4, wherein in the step of outputting procedure information, the third prompt is input to the generation AI, causing the generation AI to output the test procedure information.

6. a step of determining whether or not an operation related to a procedure included in the procedure information is executable when all procedures included in the procedure information satisfy predetermined requirements; if an operation related to at least one of the procedures included in the procedure information is not executable, creating a third prompt including information about the test, the summary information, information indicating that an operation related to at least one of the procedures included in the procedure information is not executable, and an instruction statement instructing to output procedure information of the test; causing the processor to execute 2. The program according to claim 1, wherein in the step of outputting procedure information, the third prompt is input to the generation AI, causing the generation AI to output the test procedure information.

7. counting a first number of times that at least one of the procedures included in the procedure information does not satisfy a predetermined requirement, when at least one of the procedures included in the procedure information does not satisfy a predetermined requirement, and counting a second number of times that at least one of the procedures included in the procedure information does not satisfy an operation related to at least one of the procedures not included in the procedure information, when an operation related to at least one of the procedures not included in the procedure information is not executable; When the sum of the first number of times and the second number of times reaches a predetermined number, accepting a designation from the user for an element to be operated in a corresponding procedure; generating a fourth prompt including an instruction sentence instructing output of information about the test, the summary information, summary information representing an element designated by the user, and test procedure information when the sum of the first number of times and the second number of times reaches a predetermined number; causing the processor to execute 7. The program according to claim 6, wherein in the step of outputting procedure information, the fourth prompt is input to the generation AI, causing the generation AI to output the test procedure information.

8. 2. The program of claim 1, wherein in the step of creating the first prompt, the instruction statement is an instruction statement instructing the output of test procedure information on a personal computer, an instruction statement instructing the output of test procedure information on a tablet terminal, or an instruction statement instructing the output of test procedure information on a smartphone.

9. The program described in claim 1 or claim 4, wherein in the step of creating the second prompt, the instruction statement is an instruction statement instructing the output of test procedure information on a personal computer, an instruction statement instructing the output of test procedure information on a tablet terminal, or an instruction statement instructing the output of test procedure information on a smartphone.

10. A program as described in any one of claims 3, 5, or 6, wherein in the step of creating the third prompt, the instruction statement is an instruction statement instructing the output of test procedure information on a personal computer, an instruction statement instructing the output of test procedure information on a tablet terminal, or an instruction statement instructing the output of test procedure information on a smartphone.

11. 8. The program of claim 7, wherein in the step of creating the fourth prompt, the instruction statement is an instruction statement instructing the output of test procedure information on a personal computer, an instruction statement instructing the output of test procedure information on a tablet terminal, or an instruction statement instructing the output of test procedure information on a smartphone.

12. 1. A computer-implemented method comprising a processor and a memory, the processor: receiving from a user designation of information regarding the test; A step of reading WAI-ARIA (Web Accessibility Initiative Accessible Rich Internet Applications) roles and labels from a page expressed in HTML as summary information about the page on which the function to be tested is executed; creating a first prompt including an instruction statement instructing output of information about the test, the summary information, and test procedure information; inputting the first prompt to a generation AI and causing the generation AI to output procedure information for the test; creating a test script based on the procedure information; Run determining whether the procedure included in the procedure information satisfies predetermined requirements; If at least one of the procedures included in the procedure information does not satisfy a predetermined requirement, a second prompt is generated, the second prompt including information about the test, the summary information, information indicating that at least one of the procedures included in the procedure information does not satisfy a predetermined requirement, and an instruction to output procedure information about the test; inputting the second prompt to the generating AI and causing the generating AI to output procedure information for the test; Further execute In the step of outputting the procedure information, the second prompt is input to the generation AI, and the generation AI is caused to output the procedure information of the test. method.

13. An information processing device comprising a processor and a memory, wherein the processor: receiving from a user designation of information regarding the test; A step of reading WAI-ARIA (Web Accessibility Initiative Accessible Rich Internet Applications) roles and labels from a page expressed in HTML as summary information about the page on which the function to be tested is executed; creating a first prompt including an instruction statement instructing output of information about the test, the summary information, and test procedure information; inputting the first prompt to a generation AI and causing the generation AI to output procedure information for the test; creating a test script based on the procedure information; Run determining whether the procedure included in the procedure information satisfies predetermined requirements; If at least one of the procedures included in the procedure information does not satisfy a predetermined requirement, a second prompt is generated, the second prompt including information about the test, the summary information, information indicating that at least one of the procedures included in the procedure information does not satisfy a predetermined requirement, and an instruction to output procedure information about the test; inputting the second prompt to the generating AI and causing the generating AI to output procedure information for the test; Further execute In the step of outputting the procedure information, the second prompt is input to the generation AI, and the generation AI is caused to output the procedure information of the test. Information processing device.

14. means for receiving from a user designation of information regarding the test; means for reading out WAI-ARIA (Web Accessibility Initiative Accessible Rich Internet Applications) roles and labels from a page expressed in HTML as summary information about the page on which a function to be tested is executed; means for generating a first prompt including an instruction statement for instructing output of the information about the test, the summary information, and test procedure information; means for inputting the first prompt to a generating AI and causing the generating AI to output procedure information for the test; means for creating a test script based on the procedure information; Equipped with means for determining whether a procedure included in the procedure information satisfies predetermined requirements; means for generating a second prompt including, when at least one of the procedures included in the procedure information does not satisfy a predetermined requirement, information about the test, the summary information, information indicating that at least one of the procedures included in the procedure information does not satisfy a predetermined requirement, and an instruction to output procedure information of the test; means for inputting the second prompt to the generating AI and causing the generating AI to output procedure information for the test; Furthermore, The means for outputting procedure information inputs the second prompt to the generation AI and causes the generation AI to output procedure information for the test. system.

15. A method implemented on a computer having a processor and a memory, wherein the processor: receiving from a user designation of information regarding the test; A step of reading WAI-ARIA (Web Accessibility Initiative Accessible Rich Internet Applications) roles and labels from a page expressed in HTML as summary information about the page on which the function to be tested is executed; creating a first prompt including an instruction statement instructing output of information about the test, the summary information, and test procedure information; inputting the first prompt to a generation AI and causing the generation AI to output procedure information for the test; creating a test script based on the procedure information; Run determining whether an operation related to a procedure included in the procedure information is executable; if an operation related to at least one of the procedures included in the procedure information is not executable, creating a second prompt including information about the test, the summary information, information indicating that an operation related to at least one of the procedures included in the procedure information is not executable, and an instruction statement instructing to output procedure information of the test; Further execute In the step of outputting the procedure information, the second prompt is input to the generation AI, and the generation AI is caused to output the procedure information of the test. method.

16. An information processing device comprising a processor and a memory, wherein the processor: receiving from a user designation of information regarding the test; A step of reading WAI-ARIA (Web Accessibility Initiative Accessible Rich Internet Applications) roles and labels from a page expressed in HTML as summary information about the page on which the function to be tested is executed; creating a first prompt including an instruction statement instructing output of information about the test, the summary information, and test procedure information; inputting the first prompt to a generation AI and causing the generation AI to output procedure information for the test; creating a test script based on the procedure information; Run determining whether an operation related to a procedure included in the procedure information is executable; if an operation related to at least one of the procedures included in the procedure information is not executable, creating a second prompt including information about the test, the summary information, information indicating that an operation related to at least one of the procedures included in the procedure information is not executable, and an instruction statement instructing to output procedure information of the test; Further execute In the step of outputting the procedure information, the second prompt is input to the generation AI, and the generation AI is caused to output the procedure information of the test. program.

17. A means for receiving designation of information regarding a test from a user; means for reading out WAI-ARIA (Web Accessibility Initiative Accessible Rich Internet Applications) roles and labels from a page expressed in HTML as summary information about the page on which a function to be tested is executed; means for generating a first prompt including an instruction statement for instructing output of the information about the test, the summary information, and test procedure information; means for inputting the first prompt to a generating AI and causing the generating AI to output procedure information for the test; means for creating a test script based on the procedure information; Equipped with means for determining whether an operation related to a procedure included in the procedure information is executable; means for generating a second prompt including, when an operation related to at least one of the procedures included in the procedure information is not executable, information related to the test, the summary information, information indicating that an operation related to at least one of the procedures included in the procedure information is not executable, and an instruction statement instructing to output procedure information of the test; Furthermore, The means for outputting procedure information inputs the second prompt to the generation AI and causes the generation AI to output procedure information for the test. system.

Images