Program, method, information processor, and system

Abstract

To reduce the burden of test design while maintaining test quality.SOLUTION: A program of the present disclosure is a program to be executed by a computer provided with a processor and a memory. The program causes the processor to execute the steps of: receiving specification of a test design document; receiving specification of at least one of multiple test items included in a predetermined function in the test design document of which the specification is received; storing, as a test set, information for conducting a test of the specified test item so as to allow any user to access; and, in response to a request from any user, reading the stored test set and inserting the read test set into a predetermined area of the test design document that is being created by the user.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present disclosure relates to a program, a method, an information processing device, and a system. [Background technology]

[0002] An invention has been proposed that develops high-quality software by appropriately extracting test items before the start of the testing process, thereby preventing extension of development time and the occurrence of additional costs (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-018373 A Summary of the Invention [Problem to be solved by the invention]

[0004] In Patent Document 1, previously developed functional units, tests performed, and priorities indicating the priority of each test are stored in association with each other. In Patent Document 1, for example, bug information about identified past functional units is referenced, bugs are identified in order of severity according to the feature quantities of the past functional units, and test items corresponding to the bugs are extracted as test items to be executed. However, although Patent Document 1 extracts test items, it does not describe reducing the burden of test design while maintaining the quality of the test.

[0005] An object of the present disclosure is to reduce the burden of test design while maintaining the quality of the tests. [Means for solving the problem]

[0006] In order to solve the above problem, the program of the present disclosure is a program to be executed by a computer having a processor and a memory. The program causes the processor to execute the steps of accepting a designation of a test design document, accepting a designation of at least one test item among a plurality of test items included in a predetermined function in the test design document for which the designation has been accepted, storing information for conducting a test of the designated test item as a test set so as to be accessible to any user, and reading out the stored test set in response to a request from any user, and inserting the read test set into a predetermined area of ​​the test design document created by the any user. Effect of the Invention

[0007] According to the present disclosure, it is possible to reduce the burden of test design while maintaining the quality of the test. [Brief description of the drawings]

[0008] [Figure 1] 1 is a diagram showing an overall configuration of a system 1 according to an embodiment of the present invention. [Diagram 2] 2 is a block diagram illustrating an example of the configuration of an information processing device 10 shown in FIG. [Diagram 3] 2 is a block diagram showing a functional configuration of a server 20 included in the system 1 of the present embodiment. [Figure 4] FIG. 2 is a diagram showing the data structure of a test design document table 2021. [Diagram 5] FIG. 2 shows the data structure of a test set table 2022. [Figure 6] FIG. 2 shows the data structure of a pattern table 2023. [Figure 7] FIG. 2 is a diagram for explaining an example of the operations of the terminal device 10 and the server 20 when storing a test set. [Figure 8] FIG. 13 is a schematic diagram illustrating an example of a screen for creating a test design document. [Figure 9]13 is a schematic diagram illustrating an example of a test design document creation screen when a test item is specified. FIG. [Figure 10] FIG. 13 is a schematic diagram illustrating an example of a screen for inputting an instruction to store a test set. [Figure 11] 2 is a schematic diagram showing an example of a display screen of a test set stored in the server 20. FIG. [Figure 12] FIG. 13 is a schematic diagram illustrating another example of a screen for inputting an instruction to store a test set. [Figure 13] FIG. 13 is a schematic diagram illustrating an example of a screen for comparing test sets. [Figure 14] 11 is a flow chart illustrating an example of the operation of the server 20 in performing an analysis on a test set. [Figure 15] FIG. 2 is a diagram for explaining an example of the operation of the terminal device 10 and the server 20 when a test set is used in creating a test design document. [Figure 16] FIG. 13 is a schematic diagram illustrating another example of the test design document creation screen. [Figure 17] FIG. 13 is a schematic diagram illustrating an example of a selection screen for a test set. [Figure 18] FIG. 2 is a block diagram showing the basic hardware configuration of a computer 90. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment will be described with reference to the drawings. Note that the embodiment described below does not unduly limit the contents of the present disclosure described in the claims. In addition, not all of the configurations described in the embodiment are necessarily essential components of the present disclosure.

[0010] <Summary> The system 1 according to the present embodiment sets and accumulates test sets from past test design documents within a range designated by the user. When a user creates a test design document, the system 1 accepts a designation from the user regarding one of the accumulated test sets, and inserts the designated test set into the test design document being created.

[0011] In this embodiment, the test design document is data in which tests are designed to test the functions of the test object. The test object represents the object of the test, and is, for example, hardware or software developed in a specific project. The test object includes, for example, a prototype, an intermediate product, and a final product.

[0012] In this embodiment, a test set is a set of information for conducting tests related to multiple test items. Information for conducting tests related to multiple test items includes, for example, a test perspective, confirmation items, expected values, factors, levels, patterns, etc. A test perspective represents a viewpoint (way of thinking) on ​​which a test is based. A confirmation item represents information for identifying a test to be conducted. An expected value represents a behavior expected to occur during confirmation. A factor represents a factor that may affect a change in the state of a computer. A level represents a specific element of a factor. A pattern represents information in which an actual test case is specified.

[0013] <1 Overall composition> Fig. 1 is a diagram showing an overall configuration of a system 1 of the present embodiment. As shown in Fig. 1, the system 1 includes a terminal device 10 and a server 20. The terminal device 10 and the server 20 are connected to each other via a network 80 using a wired or wireless communication standard so as to be able to communicate with each other. The network 80 is realized by, for example, the Internet and / or a communication network provided by a communication carrier. In the illustrated example, a plurality of terminal devices 10 are included in the system 1.

[0014] Although FIG. 1 shows a case where the server 20 is one computer, the server 20 may be realized by combining a plurality of computers.

[0015] The terminal device 10 is an information processing device used by a user who uses the service provided by the server 20. For example, the terminal device 10 is an information processing device used by a test designer who creates a test design document. Also, for example, the terminal device 10 is an information processing device used by a developer who develops software. Also, the terminal device 10 is an information processing device used by a tester who performs tests based on a test design document.

[0016] The terminal device 10 is realized, for example, by a desktop PC (Personal Computer), a laptop PC, a head mounted display, etc. The terminal device 10 may also be a portable computer such as a smartphone or a tablet terminal.

[0017] 1, the terminal device 10 includes a communication IF (Interface) 12, an input device 13, an output device 14, a memory 15, a storage 16, and a processor 19. The communication IF 12, the input device 13, the output device 14, the memory 15, the storage 16, and the processor 19 are connected to each other so as to be able to communicate with each other via a bus, for example.

[0018] The communication IF 12 is an interface for transmitting and receiving signals so that the terminal device 10 can communicate with external devices. The input device 13 is an input device for receiving input operations from a user (employee). The input device 13 includes, for example, a touch panel, a touch pad, a pointing device such as a mouse, a keyboard, etc. The output device 14 is an output device for presenting information to a user. The output device 14 includes, for example, a display, a speaker, etc.

[0019] The memory 15 is for temporarily storing programs and data processed by the programs, and is realized by a volatile memory such as a dynamic random access memory (DRAM). The storage 16 is a storage device for saving data and is realized by a non-volatile memory such as a flash memory or a hard disk drive (HDD). The processor 19 is hardware for executing an instruction set described in a program, and is configured by an arithmetic unit, a register, peripheral circuits, and the like.

[0020] The server 20 is an information processing device that supports the creation of a test design document. The server 20 is also an information processing device that manages the implementation status and implementation results of tests defined based on the test design document. The server 20 is, for example, a computer connected to a network 80.

[0021] 1, the server 20 includes a communication IF 22, an input / output IF 23, a memory 25, a storage 26, and a processor 29. The communication IF 22, the input / output IF 23, the memory 25, the storage 26, and the processor 29 are communicatively connected to each other via, for example, a bus.

[0022] The communication IF 22 is an interface for transmitting and receiving signals so that the server 20 can communicate with an external device. The input / output IF 23 functions as an interface with an input device for receiving input operations from a user and an output device for presenting information to the user. The memory 25 is for temporarily storing programs and data processed by the programs, etc., and is realized by a volatile memory such as a DRAM.

[0023] The storage 26 is a storage device for saving data, and is realized by a non-volatile memory such as a flash memory or a HDD. The storage 26 does not necessarily have to be realized by a single circuit. The storage 26 may be realized by, for example, a plurality of storage circuits. The processor 29 is hardware for executing an instruction set described in a program, and is configured by an arithmetic unit, a register, peripheral circuits, etc.

[0024] <1.1 Terminal device configuration> Fig. 2 is a block diagram showing a configuration example of the information processing device 10 shown in Fig. 1. As shown in Fig. 2, the information processing device 10 includes a communication unit 120, an input device 13, an output device 14, an audio processing unit 17, a microphone 171, a speaker 172, a camera 160, a position information sensor 150, a storage unit 180, and a control unit 190. The blocks included in the information processing device 10 are electrically connected to each other, for example, by a bus or the like.

[0025] The communication unit 120 performs processing for the terminal device 10 to communicate with other devices. The communication unit 120 performs transmission processing on a signal generated by the control unit 190 and transmits the signal to the outside (for example, the server 20). The communication unit 120 performs reception processing on a signal received from the outside and outputs the signal to the control unit 190.

[0026] The input device 13 is a device for inputting instructions or information by a user who operates the terminal device 10. The input device 13 is realized, for example, by a touch-sensitive device 131 or the like in which an instruction is input by touching an operation surface. When the information processing device 10 is a PC or the like, the input device 13 may be realized by a reader, a keyboard, a mouse, or the like. The input device 13 converts an instruction input by a user into an electrical signal, and outputs the electrical signal to the control unit 190. Note that the input device 13 may include, for example, a receiving port that receives an electrical signal input from an external input device.

[0027] The output device 14 is a device for presenting information to a user who operates the terminal device 10. The output device 14 is realized, for example, by a display 141 or the like. The display 141 displays data according to the control of the control unit 190. The display 141 is realized, for example, by an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display or the like.

[0028] The audio processing unit 17 performs, for example, digital-analog conversion processing of an audio signal. The audio processing unit 17 converts a signal provided from the microphone 171 into a digital signal and provides the converted signal to the control unit 190. The audio processing unit 17 also provides the audio signal to the speaker 172. The audio processing unit 17 is realized, for example, by a processor for audio processing. The microphone 171 accepts audio input and provides an audio signal corresponding to the audio input to the audio processing unit 17. The speaker 172 converts the audio signal provided from the audio processing unit 17 into audio and outputs the audio to the outside of the terminal device 10.

[0029] The camera 160 is a device for receiving light with a light receiving element and outputting the received light as an image capturing signal.

[0030] The position information sensor 150 is a sensor that detects the position of the terminal device 10, and is, for example, a GPS (Global Positioning System) module. The GPS module is a receiving device used in a satellite positioning system. In the satellite positioning system, signals are received from at least three or four satellites, and the current position of the terminal device 10 equipped with the GPS module is detected based on the received signals. The position information sensor 150 may detect the current position of the terminal device 10 from the position of the wireless base station to which the terminal device 10 is connected.

[0031] The storage unit 180 is realized by, for example, the memory 15, the storage 16, etc., and stores data and programs used by the information processing device 10. The storage unit 180 stores, for example, user information 181. The user information 181 includes information about a user who uses the terminal device 10.

[0032] The control unit 190 is realized by the processor 19 reading a program stored in the storage unit 180 and executing instructions included in the program. The control unit 190 controls the operation of the terminal device 10. The control unit 190 performs functions as an operation reception unit 191, a transmission / reception unit 192, and a presentation control unit 193 by operating according to the program.

[0033] The operation reception unit 191 performs processing for receiving instructions or information input from the input device 13. Specifically, for example, the operation reception unit 191 receives instructions or information input from the touch-sensitive device 131 or the like.

[0034] Furthermore, the operation reception unit 191 receives voice instructions input from the microphone 171. Specifically, for example, the operation reception unit 191 receives a voice signal input from the microphone 171 and converted into a digital signal by the voice processing unit 17. For example, the operation reception unit 191 analyzes the received voice signal and extracts a predetermined noun, thereby acquiring an instruction from the user.

[0035] The transmitting / receiving unit 192 performs processing for the terminal device 10 to transmit and receive data to and from an external device such as the server 20 in accordance with a communication protocol. Specifically, for example, the transmitting / receiving unit 192 transmits instructions or information input by a user to the server 20. In addition, the transmitting / receiving unit 192 receives information provided by the server 20.

[0036] The presentation control unit 193 controls the output device 14 to present information output from the server 20 to the user. Specifically, for example, the presentation control unit 193 causes the display 141 to display an image for a test designer to create a test design document. Also, for example, the presentation control unit 193 causes the display 141 to display an image for a tester to carry out a test based on the test design document.

[0037] <1.2 Functional configuration of the server> 3 is a block diagram showing a functional configuration of the server 20 included in the system 1 of the present embodiment. As shown in FIG. 3, the server 20 fulfills the functions of a communication unit 201, a storage unit 202, and a control unit 203.

[0038] The communication unit 201 performs processing for the server 20 to communicate with external devices.

[0039] The storage unit 202 stores data and programs used by the server 20. For example, the storage unit 202 has a test design document table 2021, a test set table 2022, a pattern table 2023, etc. The tables stored in the storage unit 202 are not limited to these.

[0040] The test design document table 2021 is a table for storing test design documents. The details will be described later.

[0041] The test set table 2022 is a table for storing test sets, the details of which will be described later.

[0042] The pattern table 2023 is a table for storing patterns. The test design document includes, for example, information that specifies items whose behaviors are to be confirmed in a test, and information that specifies actual test cases that are set based on the contents to be confirmed and the conditions of the behaviors to be manifested. A pattern represents information that specifies actual test cases. Specifically, a pattern specifies the contents to be confirmed, the conditions of the behaviors to be manifested by the confirmation process, and specific test cases that are a combination of the confirmation contents and conditions. The pattern table 2023 will be described in detail later.

[0043] The control unit 203 is realized by the processor 29 reading a program stored in the storage unit 202 and executing instructions included in the program. The control unit 203 controls the operation of the server 20. Specifically, for example, the control unit 203 operates according to the program to perform functions shown as a reception control module 2031, a transmission control module 2032, a management module 2033, an assistance module 2034, an analysis module 2035, and a presentation control module 2036.

[0044] The reception control module 2031 controls the process in which the server 20 receives a signal from an external device in accordance with a communication protocol.

[0045] The transmission control module 2032 controls the process in which the server 20 transmits signals to external devices in accordance with a communication protocol.

[0046] The management module 2033 manages information stored in the table of the storage unit 202. Specifically, for example, when a request is made to write information to the test design document table 2021, the management module 2033 writes the requested information to the test design document table 2021. When a request is made to read information from the test design document table 2021, the management module 2033 reads the requested information from the test design document table 2021. When a request is made to write information to the test set table 2022, the management module 2033 writes the requested information to the test set table 2022. When a request is made to read information from the test set table 2022, the management module 2033 reads the requested information from the test set table 2022. When a request is made to write information to the pattern table 2023, the management module 2033 writes the requested information to the pattern table 2023. When a request is made to read information from the pattern table 2023 , the management module 2033 reads the requested information from the pattern table 2023 .

[0047] The management module 2033 also manages the results of the test cases performed by the tester. Specifically, for example, the management module 2033 stores in the storage unit 202 the results of the tests performed on the test cases.

[0048] The support module 2034 supports the creation of a test design document. Specifically, for example, the support module 2034 outputs information that can reduce the burden on a test designer when the test designer creates a test design document. More specifically, the support module 2034 outputs a test set required by the test designer when the test designer creates a test design document. The support module 2034 also supports the storage of the test set.

[0049] The analysis module 2035 analyzes the test results of the test cases related to the test set. For example, the analysis module 2035 analyzes the test results for the test set. Specifically, for example, the analysis module 2035 analyzes the test results stored in the storage unit 202 and calculates the bug occurrence rate in the test set.

[0050] The analysis module 2035 may analyze test results for the test cases included in the test set. For example, the analysis module 2035 analyzes the test results and extracts test cases that are likely to cause defects.

[0051] The analysis module 2035 also tallies the number of times the test set is used.

[0052] The presentation control module 2036 presents information regarding the creation of a test design document to the test designer. Specifically, for example, the presentation control module 2036 displays an image including information for creating a test design document to the test designer via the terminal device 10. The information for creating a test design document includes, for example, information stored in the test design document table 2021, the test set table 2022, and the pattern table 2023.

[0053] In addition, the presentation control module 2036 presents information for conducting a test to the tester. Specifically, for example, the presentation control module 2036 displays an image including information for conducting a test to the tester via the terminal device 10. The information for conducting a test includes, for example, information stored in the test design document table 2021.

[0054] <2 Data Structure> 4 to 6 are diagrams showing the data structures of tables stored in the server 20. Note that Fig. 4 to 6 are merely examples and do not exclude data that is not listed. In addition, data that is listed in the same table may be stored in separate storage areas in the storage unit 202.

[0055] Fig. 4 is a diagram showing the data structure of the test design document table 2021. The test design document table 2021 shown in Fig. 4 is a table having columns such as status, version, update date and time, person in charge, and test set ID, with the file name as a key.

[0056] The file name is an item that stores the name of the test design document. The status is an item that stores the current state of the test design document. For example, the item "status" stores one of "Working", which indicates that work is being started, "Reviewing", which indicates that work is being reviewed, and "Done", which indicates that work is completed. The version is an item that stores the updated or revised version of the test design document. The update date and time is an item that stores the date and time when the test design document was updated. The person in charge is an item that stores the person who creates the test design document. The information stored in the item "person in charge" may be the name of the person in charge, or a specified ID for identifying the person in charge. The test set ID is an item that stores the test set ID of the test set used when the test design document was created.

[0057] 5 is a diagram showing the data structure of the test set table 2022. The test set table 2022 shown in FIG. 5 is a table having columns for information on the test set name, creator, creation date, number of reuses, bug occurrence rate, tags, and test items included in the test set, with the test set ID as a key. In addition to these, the test set table 2022 may have a column for storing, for example, an explanatory text entered by a test designer about the test set. In addition to these, the test set table 2022 may have a column for storing, for example, a note (comment) entered by a tester about the test set.

[0058] The test set ID is an item for storing an ID for uniquely identifying a test set. The test set name is an item for storing the name of the test set. The creator is an item for storing the person who created the test set. The information stored in the item "creator" may be the name of the creator or a predetermined ID for identifying the creator. The creation date is an item for storing the date and time when the test set was created. The number of times of reuse is an item for storing the number of times it was reused to create a test design document. Instead of or in addition to the number of times of reuse, there may be a column for storing the number of times the contents of the test set were confirmed. The bug occurrence rate is an item for storing the probability that a defect (bug) occurred in a test case related to the test set. The item "bug occurrence rate" stores, for example, the results of analysis by the analysis module 2035. The tag is an item for storing, for example, information that succinctly or conceptually represents the characteristics of the test set. The tag can be set, for example, by the creator of the test set.

[0059] Information on the test items included in the test set includes, for example, a test division, division 1, division 2, a test target, a pattern, a test viewpoint, and a check item. The test division, division 1, and division 2 are, for example, items that store the division to which the test item belongs. The range of the division is, for example, the widest for the test division, and the narrowest for division 2. The test target is an item that stores the target of the test. The test target can be rephrased as, for example, storing the function to be the target of the test. The pattern is an item that stores an ID for identifying the pattern. The test viewpoint is an item that stores a viewpoint (way of thinking) on ​​which the test is based. The check item is an item that stores the contents to be checked in the test to be performed. The information stored in the item "test viewpoint" and the information stored in the item "check item" are associated with each other.

[0060] In the example shown in FIG. 5, the following are stored: item "test category": front login, item "category 1": login screen, item "category 2": authentication, item "test subject": ID / PW authentication, item "pattern": P1, item "test perspective": normal authentication, item "confirmation item": verification of normal behavior, etc.

[0061] Fig. 6 is a diagram showing the data structure of the pattern table 2023. The pattern table 2023 shown in Fig. 6 is a table having columns such as pattern name, factor, level, check item, expected value, etc., with a pattern number as a key. The pattern table 2023 includes a pattern table (not shown) in which actual test cases are specified.

[0062] The pattern number is an item that stores an ID for identifying a pattern. The pattern name is an item that stores the name of the pattern. The factor is an item that stores factors that can affect changes in the computer's state. The level is an item that stores specific elements of a factor. The confirmation item is an item that stores the content that should be confirmed in the test to be performed. The expected value is an item that stores the behavior that is expected to be discovered during confirmation.

[0063] <3 operations> The operations of the terminal device 10 and the server 20 will be described.

[0064] (Test set memory) FIG. 7 is a diagram for explaining an example of the operation of the terminal device 10 and the server 20 when storing a test set. First, the test designer creates a test design document. The test designer determines that a set of predetermined test items in the test design document being created can be reused in other test design documents, or that reuse of the set of test items will be effective in creating other test design documents. The test designer specifies information related to the predetermined test items in the test design document being created. Note that the person who creates the test set is not limited to the test designer, and may be any user related to testing.

[0065] In step S11, the control unit 190 of the terminal device 10 receives, via the operation reception unit 191, an instruction to store a test set from the test designer.

[0066] Fig. 8 is a schematic diagram showing an example of a test design document creation screen. The control unit 190 causes the display 141 to display a test design document creation screen 1411 by the presentation control unit 193. The creation screen 1411 includes, for example, an area 14111 that displays a list of check items and an area 14112 that displays a list of patterns. The creation screen 1411 shown in Fig. 8 is displayed in a tree format. The creation screen 1411 may be displayed in a table format.

[0067] The test designer specifies test items that are considered to be applicable to other test design documents in the area 14111 via the input device 13. The test item group that is considered to be applicable to other test design documents is, for example, test items for testing a predetermined function.

[0068] Fig. 9 is a schematic diagram showing an example of a screen for creating a test design document when test items are specified. In Fig. 9, the following items are specified by the test designer in the test design document: item "test category": front login, item "category 1": login screen, item "category 2": authentication, item "test target": ID / PW authentication, item "pattern": P1, item "test viewpoint": normal authentication, item "check item": behavior verification under normal conditions, etc.

[0069] After designating the test items, the test designer presses button 14113. Button 14113 is a button for inputting an instruction to store the test set.

[0070] When the button 14113 is pressed, the presentation control unit 193 causes the display 141 to display a screen for inputting an instruction to store a test set.

[0071] Fig. 10 is a schematic diagram showing an example of a screen for inputting an instruction to store a test set. In Fig. 10, the presentation control unit 193 displays, for example, a window 14114 on the display 141. The window 14114 is a window for inputting an instruction to finalize the registration of the test set. The window 14114 includes an area 141141 for inputting a test set name and a button 141142 for inputting an instruction to finalize the registration of the test set.

[0072] When registering a test set, the test designer inputs the test set name in area 141141 and presses button 141142. The test designer may attach a tag to the test set. For example, the test designer may set the tag from a tag setting indicator, an input screen for tag input, or the like.

[0073] The test designer may also input a description of the test set for the test set. For example, the test designer may input the description of the test set from an input screen for inputting the description of the test set. The input description may include, for example, points to note about the test set that cannot be fully expressed by the test set name, characteristics of the tests included in the test set, and the like.

[0074] When the button 141142 is pressed, the control unit 190 causes the transmitting / receiving unit 192 to transmit to the server 20 the name of the test set, information on the test items designated by the test designer, and the like.

[0075] In step S12, the server 20 stores the test set specified by the test designer. Specifically, the control unit 203 of the server 20 receives, for example, the test set name, information on the test items specified by the test designer, and the like, via the reception control module 2031. The control unit 203 creates a new record in the test set table 2022, for example, via the management module 2033. The management module 2033 stores, in the created record, the test set name, creator, creation date, tags, and information on the test items included in the test set. This allows any user, including any test designer, to use the test set.

[0076] FIG. 11 is a schematic diagram showing an example of a display screen of a test set stored in the server 20. In FIG. 11, the presentation control unit 193 causes the display 141 to display a display screen 1412 displaying a test set stored in a test set table 2022 in response to an instruction from a user such as a test designer. The user can edit the test set from the display screen 1412. The operation reception unit 191 receives a button 14121 pressed by the user to start editing. The transmission / reception unit 192 transmits the received content of the edit to the server 20. The server 20 updates the test set table 2022 based on the edit content.

[0077] In step S12, the management module 2033 may determine whether or not there is a test set similar to the test set to be registered. Specifically, for example, the presentation control unit 193 displays an indicator for inputting an instruction to check a similar test set on a screen for inputting an instruction to store a test set.

[0078] Fig. 12 is a schematic diagram showing another example of a screen for inputting an instruction to store a test set. In Fig. 12, the presentation control unit 193 displays, for example, a button 141143 in a window 14114 for inputting an instruction to check the existence of a similar test set.

[0079] When the test designer checks for the existence of a similar test set, the test designer inputs the test set name in area 141141 and presses button 141143. When button 141143 is pressed, control unit 190 causes transmission / reception unit 192 to transmit to server 20 the test set name, information on the test items specified by the test designer, and the like.

[0080] The management module 2033 refers to the input information and determines whether a similar test set exists. Specifically, for example, the management module 2033 extracts test set names similar to the input test set name from the test set table 2022. The extraction of similar test set names may use any existing method. For example, the management module 2033 calculates the similarity between the test set name of the test set desired to be registered and the test set name of the test set stored in the test set table 2022 by a predetermined method, and reads out a test set that exceeds a preset similarity from the test set table 2022. The transmission control module 2032 transmits the read out information to the terminal device 10. The presentation control module 2036 causes the terminal device 10 to display the test set desired to be registered by the test designer and the test set about which the information has been received in a comparable manner.

[0081] The presentation control unit 193 displays the test set that the test designer wishes to register and the test set about which the information has been received on the display 141 so that they can be compared. When there are multiple test sets with similar test set names, the presentation control unit 193 displays the test sets on the display 141 in descending order of similarity, for example. The presentation control unit 193 accepts the selection of a test set from the test designer, and displays on the display 141 a comparison image of the test set selected by the test designer with the test set that the test designer wishes to register.

[0082] FIG. 13 is a schematic diagram showing an example of a screen for comparing test sets. In FIG. 13, the presentation control unit 193 causes the display 141 to display, for example, an area 14131 and an area 14132. The area 14131 is an area for displaying information about a test set that the test designer wishes to register. The area 14132 is an area for displaying information about a received test set. In FIG. 13, the presentation control unit 193 causes the display 141 to display, for example, a button 14133 for inputting an instruction to change the test set name, and a button 14134 for inputting an instruction to confirm the registration of the test set. Note that the presentation control unit 193 may display a button for inputting an instruction to cancel the registration of the test set.

[0083] The test designer compares the test sets displayed in areas 14131 and 14132, and confirms the contents of the test set to be registered and the test set name. If the test set name needs to be changed, the test designer presses, for example, button 14133. When button 14133 is pressed, presentation control unit 193 displays, for example, an area for accepting input of a new test set name. The test designer inputs the new test set name in the displayed area.

[0084] The presentation control unit 193 may display a button for inputting an instruction to reset the test set. When it is necessary to change the contents of the test set, the test set name, or both, the test designer, for example, presses this button. When the button is pressed, the presentation control unit 193 causes the display 141 to display, for example, a screen shown in FIG. 8. The test designer re-specifies test items and gives a new test set name to the test set consisting of the specified test items.

[0085] That is, if a similar test set has already been stored, the management module 2033 accepts again the setting of the test set name, the specification of the test items, or both.

[0086] The presentation control module 2036 may cause the terminal device 10 to display a message suggesting changing the test set name when the test set name has a higher similarity than a preset similarity and the contents of the test sets are different.

[0087] If there is no need to change the contents of the test set or the test set name, the test designer presses button 14134. When button 14134 is pressed, the transmitting / receiving unit 192 transmits to the server 20 the test set name, information on the test items specified by the test designer, and the like.

[0088] The search for similar test sets is not limited to a search based on the test set name. The management module 2033 may search for similar test sets based on information other than the test set name stored in the test set table 2022, such as test perspectives and check items. The management module 2033 calculates the similarity between the contents of the test set desired to be registered and the contents of the test sets stored in the test set table 2022 by a predetermined method, and reads out test sets that exceed a preset similarity from the test set table 2022. The transmission control module 2032 transmits information on the read out test sets to the terminal device 10. The presentation control module 2036 causes the terminal device 10 to display the test set desired to be registered by the test designer and the test set about which the information has been received so as to be comparable.

[0089] The presentation control unit 193 displays the test set that the test designer wishes to register and the test set about which the information has been received on the display 141 so that they can be compared. When there are multiple test sets whose contents are similar to each other, the presentation control unit 193 displays the test sets on the display 141 in descending order of similarity, for example. The presentation control unit 193 accepts the selection of a test set from the test designer, and displays on the display 141 a comparison image of the test set selected by the test designer and the test set that the test designer wishes to register.

[0090] (Test set analysis and compilation) FIG. 14 is a flow chart illustrating an example of the operation of the server 20 in performing an analysis on a test set.

[0091] First, the management module 2033 manages the test results of tests performed by a tester. The tests performed by a tester are specified based on a test design document created by a test designer. When a test set stored in the test set table 2022 is used to create a test design document, it is possible to identify that the test items originate from the test set in the created test design document. For example, when a test based on this test design document is performed, the management module 2033 manages the test results in association with the test set.

[0092] In step S21, the analysis module 2035 acquires test results related to the test set. Specifically, the analysis module 2035 acquires test results related to the test set at a predetermined timing. For example, the analysis module 2035 acquires the test results at the following timing. When testing for the corresponding test cases specified in the specified test design document is completed When testing is completed for the specified test cases specified in the specified test design document -Predetermined period When the specified time arrives When a command is entered by the user

[0093] In step S22, the analysis module 2035 analyzes the test results acquired for the test set. Specifically, the analysis module 2035 analyzes, for example, the acquired test results and calculates a bug occurrence rate (fault rate) of the test set. Note that information acquired by the analysis is not limited to the bug occurrence rate. Parameters other than the bug occurrence rate may be calculated. The management module 2033 stores the calculated bug occurrence rate in the item "bug occurrence rate" of the test set table 2022.

[0094] The management module 2033 also manages the number of times a test set has been reused in a test design document. When a test set stored in the test set table 2022 is used to create a test design document, the management module 2033 increments, for example, the number of times the test set has been used (number of reuses). The analysis module 2035 analyzes, for example, the number of times the test set has been reused at a predetermined timing. The predetermined timing is, for example, as follows. -Predetermined period When the specified time arrives When a command is entered by the user

[0095] Specifically, the analysis module 2035, for example, analyzes the number of diversions and calculates the number of diversions in a predetermined period (the most recent week). Note that the information acquired by the analysis is not limited to the number of diversions in the predetermined period. Other parameters such as the average number of diversions may be calculated in addition to the number of diversions in the predetermined period. The management module 2033, for example, stores the calculated analysis results in the test set table 2022.

[0096] (Utilizing the test set) FIG. 15 is a diagram for explaining an example of the operation of the terminal device 10 and the server 20 when a test set is used in creating a test design document.

[0097] First, the test designer inputs an instruction to create a test design document and starts creating the test design document. If there is a test design document in the middle of being created, the test designer may select the test design document in the middle of being created and resume the creation of the selected test design document.

[0098] In step S31, the terminal device 10 accepts a request to present a test set. Specifically, the test designer inputs information about test items in a predetermined area on, for example, a test design document creation screen. The transmission / reception unit 192 transmits the information about the test items to the server 20 as a request to present a test set. After the information about the test items is input, the transmission / reception unit 192 may transmit the request to present a test set to the server 20 in response to an instruction to request the presentation of a test set. Also, the test designer inputs an instruction to request the presentation of a test set on, for example, a test design document creation screen. The transmission / reception unit 192 transmits the request to present a test set to the server 20.

[0099] 16 is a schematic diagram showing another example of the creation screen of the test design document. The presentation control unit 193 displays, for example, a button 14115 for inputting an instruction to insert a test set on the creation screen 1411. The presentation control unit 193 displays an area 14116 for inputting information about a test item. Note that the position where the area 14116 is displayed is not limited to that shown in FIG.

[0100] The test designer inputs information about the test item, for example, "certification test" in the area 14116. The transceiver 192 transmits a request to the server 20 to present a test set related to the "certification test".

[0101] Also, the test designer selects the insertion position of the test set on the test design document creation screen 1411, for example, and presses the button 14115. When the button 14115 is pressed, the transmitter / receiver 192 transmits a request to present the test set to the server 20. Note that a box for receiving input of a search keyword related to the test set may be provided near the button 14115. The test designer may input the search keyword in the box and then press the button 14115. This causes a request for a test set corresponding to the search keyword to be transmitted.

[0102] In step S32, the server 20 reads the requested test set from the test set table 2022. Specifically, when there is a request to present a test set related to the information input in the area 14116, the assistance module 2034 searches for a corresponding test set from the test set table 2022. For example, the assistance module 2034 reads a test set that includes the input information in the test set name or the contents of the test set (information on the test item, description of the test) from the test set table 2022. The assistance module 2034 may search for a test set, for example, by using a trained model.

[0103] Furthermore, when the support module 2034 receives a request transmitted by pressing the button 14115, it reads out a test set stored in the test set table 2022.

[0104] The transmission control module 2032 transmits the read information on the test set to the terminal device 10. The presentation control module 2036 causes the terminal device 10 to display the read information on the test set.

[0105] In step S33, the terminal device 10 presents information about the test set to the test designer. Specifically, for example, the presentation control unit 193 causes the display 141 to display the information about the test set based on the information received from the server 20.

[0106] 17 is a schematic diagram showing an example of a selection screen for a test set. The presentation control unit 193 displays a selection screen 1414 for a test set on the display 141. The selection screen 1414 includes, for example, an area 14141 for displaying a list of test sets and an area 14142 for displaying the contents of the test set.

[0107] For example, the presentation control unit 193 displays the test sets in an order based on a predetermined priority in the area 14141. For example, the presentation control unit 193 sets the priority based on the following information. · Recent creation date -The number of test items included High bug occurrence rate -High frequency of diversion · Word order of test set names

[0108] The presentation control module 2036 may display the creator of the test set, the creation date of the test set, the number of times the test set has been reused, the bug occurrence rate of the test set, a description of the test set, a comment from the tester, or a combination of at least two of these on the terminal device 10. For example, the presentation control unit 193 displays the creator of the test set, the creation date of the test set, the number of times the test set has been reused, the bug occurrence rate of the test set, a description of the test set, a comment from the tester, or a combination of at least two of these on the display 141 in the area 14142. Specifically, the presentation control unit 193 displays, for example, in the area 14142, boxes that display the creator, the creation date, the number of times the test set has been reused, the bug occurrence rate of the test set, a description of the test set, a comment from the tester, or a button for displaying this information.

[0109] The test designer selects a test set in area 14141 while displaying the contents of the test set in area 14142 via input device 13. For the test set whose contents are displayed in area 14142, the test designer presses button 14143 to register the test set.

[0110] When the button 14143 is pressed, the transmitting / receiving unit 192 transmits to the server 20 information related to the test set selected by the test designer.

[0111] The support module 2034 inserts information about the test set selected by the test designer into the test design document being created. For example, the support module 2034 inserts information about the test items included in the test set into the record for the test design document being created in the test design document table 2021.

[0112] As described above, in the above embodiment, the control unit 203 of the server 20 accepts the designation of a test design document through the reception control module 2031. The reception control module 2031 accepts the designation of at least one of a plurality of test items included in a predetermined function in the test design document for which the designation has been accepted. The control unit 203 stores information for carrying out a test of the designated test item as a test set accessible to any user through the management module 2033. In response to a request from any user, the management module 2033 reads out the stored test set and inserts the read test set into a predetermined area of ​​the test design document created by the any user. This enables the server 20 to set test items for a predetermined task that the user considers useful within a range desired by the user, and to store (register) them as a test set. In addition, the server 20 can store a test set suitable for each client. In addition, the server 20 can allow the user to reuse the stored test set in response to a request from the user.

[0113] Therefore, according to the program, server 20, and system 1 of the present embodiment, it is possible to reduce the burden of test design while maintaining the quality of the test.

[0114] In the above embodiment, the management module 2033 includes test viewpoints, check items, expected values, factors, levels, and patterns as information for implementing tests of test items. This enables the server 20 to store test sets so that they can be reused in the test design document.

[0115] In the above embodiment, the management module 2033 stores the sentences related to the test set in association with the test set, which allows the server 20 to improve the convenience when reusing the test set.

[0116] In the above embodiment, the management module 2033 stores, as text related to the test set, an explanation of the test set or a comment from a tester who performed a test based on the test set. This reduces the burden on the user when finding a desired test set. In addition, the user can grasp points to note related to the test set when reusing the test set.

[0117] In the above embodiment, when a similar test set has already been stored, the management module 2033 accepts the designation of the test item, the setting of the name of the test set, or both of them again, which enables the server 20 to prevent a similar test set from being stored.

[0118] In the above embodiment, when a similar test set has already been stored, the presentation control module 2036 presents the content of the test set related to the specified test item to the user who specified the test item so that the content of the test set related to the specified test item can be compared with the content of the already stored test set, thereby enabling the server 20 to prevent similar test sets from being stored.

[0119] In the above embodiment, when the contents of the test set related to the specified test item are different from the contents of the already stored test set but the names of these test sets are similar, the presentation control module 2036 proposes storing the test set under a name different from that of the already stored test set, thereby enabling the server 20 to prevent similar test sets from being stored.

[0120] In the above embodiment, when the support module 2034 receives character input from a user in an area for inputting information when creating a test design document, the support module 2034 presents test sets related to the input character to the user. This enables the server 20 to reduce the burden on the user in searching for test sets.

[0121] In the above embodiment, when there are multiple test sets related to the input characters, the support module 2034 presents the multiple test sets in an order based on the creation date of the test design document, the number of test items included, the frequency of defect occurrence, the number of times reused, or the order of the test set names. This allows the server 20 to further reduce the burden on the user in searching for a test set.

[0122] In the above embodiment, the management module 2033 stores the test results of the test cases based on the test design document created using the test set. The analysis module 2035 analyzes the test results of the test cases related to the test set. When a user creates a test design document, the presentation control module 2036 presents the test sets available to the user together with the analysis results of the test results of the test cases related to the test set. This allows the server 20 to allow the user to select a test set taking into account the analysis results. Therefore, the user can grasp the man-hours required when reusing a test set. In addition, the user can select a test set based on the bug occurrence rate, making it possible to adjust the quality of the test design document.

[0123] In the above embodiment, when there are multiple available test sets, the presentation control module 2036 presents the multiple test sets in an order based on the analysis results, which allows the server 20 to further reduce the burden on the user in selecting a test set.

[0124] In the above embodiment, the management module 2033 counts the number of times the test set has been used. The analysis module 2035 analyzes the counting result. When a user creates a test design document, the presentation control module 2036 presents test sets available to the user along with the analysis result of the number of times the test set has been used. This allows the server 20 to allow the user to select a test set taking into consideration the number of times it has been reused. Therefore, the user can select a test set while understanding how much the test set has been reused. This makes it easier to select a good test set, which contributes to standardizing the quality of test design documents.

[0125] In the above embodiment, when there are multiple available test sets, the presentation control module 2036 presents the multiple test sets in an order based on the analysis results, which allows the server 20 to further reduce the burden on the user in selecting a test set.

[0126] <Modification> In the above embodiment, an example has been described in which any user can access the test set. However, restrictions may be placed on users who can access the test set. For example, access authority may be set for each test set. Also, a plurality of databases (tables) with different access authority may be set, and test sets available for each database may be stored. Examples of databases with different access authority include a database for each project, a database for each company, a database for each specific business type, and a database that covers the entire system.

[0127] In the above embodiment, a reward may be given to the creator of a test set that is frequently used.

[0128] In a higher level embodiment, it is also possible to create test items in advance for test items that are expected to be widely reused. For example, in a certain field, such as the entertainment field, the test items to be defined may be similar. If a test set for test items that are commonly used in such a field is registered in advance, it is possible to reduce the labor of the test designer when creating a test design document.

[0129] In addition, in the above embodiment, the server 20 may extract a test design document created using a test set. For example, when a specific function is upgraded, the upgraded function may need to be retested. Also, when a defect in a specific function is corrected, the corrected function may need to be retested. The test design document is managed in association with the test set used when the test set was created. Also, the test set stores a statement related to the target function in the test set name, the test set description, or the test set comment. The server 20 searches for a test set based on the statement related to the function, and searches for a test design document created using the test set. When a test set has been created for a function before the upgrade, and a test design document created using the test set exists, the user can grasp the test design document to be retested by searching for the corresponding test set. This makes it possible to easily find a target that needs to be retested.

[0130] Also, for example, there are cases where additional testing is required for a given test set. The server 20 searches for a test design document created using the test set based on the test set for which additional testing is required. By searching for the corresponding test set, the user can grasp the test design document for which additional testing is required. This makes it possible to easily find targets for which additional testing is required.

[0131] In the above embodiment, the server 20 may classify the test sets by any category, such as industry, usage scenario, or device used, and store, use, and provide them as a test knowledge database. For example, the server 20 may store test sets specific to the game industry in a game industry database, and provide the stored test sets in response to a user request. This makes it possible for the knowledge stored in a specific industry to be useful when creating test design documents for other projects in the same industry. In other words, it becomes possible to reduce the burden on test designers.

[0132] Also, for example, the server 20 stores test sets that are often used in usage scenarios where map functions are linked in a database related to map function linkage, and provides the stored test sets in response to a user's request. This makes it possible for knowledge stored in a specific usage scenario to be useful when creating test design documents for other projects in similar scenarios. In other words, it is possible to reduce the burden on test designers.

[0133] Also, for example, the server 20 stores test sets specific to devices used, such as iPhone (registered trademark) and Xperia (registered trademark), in a database of the devices used, and provides the stored test sets in response to a user's request. This makes it possible for the knowledge stored in a specific device to be useful when creating test design documents in other projects related to similar devices (new version devices). In other words, it becomes possible to reduce the burden on test designers.

[0134] <4 Basic hardware configuration of computer> 18 is a block diagram showing the basic hardware configuration of a computer 90. The computer 90 includes at least a processor 91, a main storage device 92, an auxiliary storage device 93, and a communication IF (interface) 99. These are electrically connected to each other by a bus.

[0135] The processor 91 is hardware for executing an instruction set described in a program, and is composed of an arithmetic unit, a register, a peripheral circuit, and the like.

[0136] The main storage device 92 is for temporarily storing programs, data to be processed by the programs, etc. For example, it is a volatile memory such as a DRAM (Dynamic Random Access Memory).

[0137] The auxiliary storage device 93 is a storage device for saving data and programs, such as a flash memory, a hard disk drive (HDD), a magneto-optical disk, a CD-ROM, a DVD-ROM, or a semiconductor memory.

[0138] The communication IF 99 is an interface for inputting and outputting signals for communicating with other computers via a network using a wired or wireless communication standard. The network is composed of the Internet, a LAN, various mobile communication systems constructed by wireless base stations, etc. For example, the network includes 3G, 4G, 5G mobile communication systems, LTE (Long Term Evolution), wireless networks that can connect to the Internet via a specified access point (e.g., Wi-Fi (registered trademark)), etc. In the case of wireless connection, communication protocols include, for example, Z-Wave (registered trademark), ZigBee (registered trademark), Bluetooth (registered trademark), etc. In the case of wired connection, the network also includes a network that is directly connected by a USB (Universal Serial Bus) cable or the like.

[0139] It should be noted that the computer 90 can be virtually realized by distributing all or part of each hardware configuration among multiple computers 90 and connecting them together via a network. In this way, the computer 90 is a concept that includes not only a computer 90 housed in a single housing or case, but also a virtualized computer system.

[0140] <Basic functional configuration of computer 90> A description will now be given of the functional configuration of a computer realized by the basic hardware configuration of a computer 90 shown in Fig. 18. The computer includes at least the functional units of a control unit, a storage unit, and a communication unit.

[0141] The functional units of the computer 90 can also be realized by distributing all or part of the functional units among multiple computers 90 connected to each other via a network. The computer 90 is a concept that includes not only a single computer 90 but also a virtualized computer system.

[0142] The control unit is realized by the processor 91 reading out various programs stored in the auxiliary storage device 93, expanding the programs in the main storage device 92, and executing processes according to the programs. The control unit can realize functional units that perform various information processing depending on the type of program. In this way, the computer is realized as an information processing device that performs information processing.

[0143] The storage unit is realized by a main storage device 92 and an auxiliary storage device 93. The storage unit stores data, various programs, and various databases. Furthermore, the processor 91 can secure a storage area corresponding to the storage unit in the main storage device 92 or the auxiliary storage device 93 in accordance with a program. Furthermore, the control unit can cause the processor 91 to execute processes of adding, updating, and deleting data stored in the storage unit in accordance with the various programs.

[0144] A database refers to a relational database, which is used to manage data sets called tables, which are structured according to rows and columns, by relating them to each other. In a database, a table is called a table, a column in a table is called a column, and a row in a table is called a record. In a relational database, it is possible to set relationships between tables and associate them. Usually, a column is set in each table as a key for uniquely identifying a record, but setting a key in the column is not essential. The control unit can cause the processor 91 to add, delete, or update records in a specific table stored in the storage unit according to various programs.

[0145] The communication unit is realized by the communication IF 99. The communication unit realizes a function of communicating with other computers 90 via a network. The communication unit can receive information transmitted from other computers 90 and input the information to the control unit. The control unit can cause the processor 91 to execute information processing on the received information in accordance with various programs. In addition, the communication unit can transmit information output from the control unit to other computers 90.

[0146] Although several embodiments of the present disclosure have been described above, these embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and modifications are within the scope of the invention and its equivalents as described in the claims, as well as the scope and spirit of the invention.

[0147] <Additional Notes> The matters described in the above embodiments will be supplemented below.

[0148] (Appendix 1) A program to be executed by a computer having a processor and a memory, the program causing the processor to execute the following steps: accepting a designation of a test design document; accepting, in the test design document for which the designation has been accepted, a designation for at least one test item among a plurality of test items included in a specified function; storing information for conducting tests of the specified test items as a test set accessible to any user; and, in response to a request from any user, reading out the stored test set and inserting the read test set into a specified area of ​​the test design document being created by the any user. (Appendix 2) In the storing step, the information for conducting testing of the test items includes a test perspective, a confirmation item, an expected value, a factor, a level, and a pattern (Supplementary Note 1). (Appendix 3) A program according to (Appendix 1) or (Appendix 2), wherein in the storing step, a sentence relating to the test set is stored in association with the test set. (Appendix 4) The program according to claim 3, wherein in the storing step, the text about the test set is an explanation about the test set or a comment from a tester who performed a test based on the test set. (Appendix 5) A program described in any one of (Appendix 1) to (Appendix 4), in which, in the storing step, if a similar test set has already been stored, the specification of test items, the setting of a name for the test set, or both are accepted again. (Appendix 6) A program described in any one of (Appendix 1) to (Appendix 5), in which, in the storing step, if a similar test set has already been stored, the contents of the test set related to the specified test item are presented to a user who has specified the test item so that the contents of the test set related to the specified test item can be compared with the contents of the already stored test set. (Appendix 7) A program described in any one of (Appendix 1) to (Appendix 6), which suggests storing the test set with a name different from that of the already stored test set when, in the storing step, the contents of the test set related to the specified test item are different from the contents of the already stored test set but the names of these test sets are similar. (Appendix 8) A program described in any one of (Appendix 1) to (Appendix 7), which causes a processor to execute a step of, when accepting character input from a user in an area for inputting information when creating a test design document, presenting a test set associated with the input characters to the user. (Appendix 9) In the presenting step, if there are multiple test sets associated with the input characters, the program presents the multiple test sets in an order based on the date of creation of the test design document, the number of test items included, the frequency of defect occurrence, the number of times the test set has been reused, or the word order of the test set names (Appendix 8). (Appendix 10) A program described in any of (Appendix 1) to (Appendix 9) that causes a processor to execute the steps of storing test results of test cases based on a test design document created using a test set, analyzing the test results of the test cases related to the test set, and presenting test sets that can be used by any user when the user creates a test design document, together with the results of analyzing the test results of the test cases related to the test sets. (Appendix 11) The program according to claim 10, wherein in the presenting step, if there are multiple available test sets, the multiple test sets are presented in an order based on the results of the analysis. (Appendix 12) A program described in any one of (Appendix 1) to (Appendix 11), which causes a processor to execute the steps of tallying the number of times a test set has been used, analyzing the tallying results, and presenting test sets that can be used by any user when the user creates a test design document, along with the results of an analysis of the number of times the test set has been used. (Appendix 13) The program according to claim 12, wherein in the presenting step, if there are multiple available test sets, the multiple test sets are presented in an order based on the results of the analysis. (Appendix 14) A method executed by a computer having a processor and a memory, the method including the steps of: receiving a designation of a test design document; receiving, in the test design document for which the designation has been received, a designation for at least one of a plurality of test perspectives included in a specified function; storing information for conducting a test of the specified test perspective as a test set so as to be accessible to any user; and reading out the stored test set in response to a request from any user, and inserting the read test set into a specified area of ​​the test design document being created by the any user. (Appendix 15) An information processing device having a control unit and a memory unit, wherein the control unit executes the steps of: accepting a designation of a test design document; accepting a designation for at least one of a plurality of test perspectives included in a specified function in the test design document for which the designation has been accepted; storing information for conducting a test of the specified test perspective as a test set so that it is accessible to any user; and reading out the stored test set in response to a request from any user, and inserting the read test set into a specified area of ​​the test design document being created by the any user. (Appendix 16) A system comprising: means for accepting a designation of a test design document; means for accepting, in the test design document for which the designation has been accepted, designation of at least one of a plurality of test perspectives included in a specified function; means for storing information for conducting a test of the specified test perspective as a test set so as to be accessible to any user; and means for reading out the stored test set in response to a request from any user, and inserting the read test set into a specified area of ​​the test design document being created by the any user. [Explanation of symbols]

[0149] 1. System 10...Terminal device 121…Communications Department 13...Input device 131…Mouse 132…Keyboard 133…Touch-sensitive devices 14...Output device 141…Display 15…Memory 16…Storage 180...Storage section 190...Control unit 191...Operation reception section 192...Transmitter / receiver 193...Presentation control unit 19…Processor 20…Server 201…Communications Department 202...Storage section 203...Control section 25…Memory 26…Storage 29…Processor 80…Network

Claims

1. A program to be executed by a computer having a processor and a memory, the program causing the processor to: receiving a designation for a test design document; receiving designations for two or more test aspects from among a plurality of test aspects included in a predetermined function in the test design document for which designations have been received; storing information for executing tests of the two or more specified test aspects as a test set so that the test set can be accessed by any user; reading the stored test set in response to a request from any of the users, and presenting the read test set to the any of the users; A program that executes the following.

2. 2. The program according to claim 1, wherein said storing step stores the sentences relating to the test set in association with the test set.

3. 3. The program according to claim 2, wherein in the storing step, the text relating to the test set is an explanation of the test set or a comment from a tester who performed a test based on the test set.

4. 2. The program according to claim 1, wherein, in the storing step, if a similar test set has already been stored, the specification of the test viewpoint, the setting of the test set name, or both of them are accepted again.

5. 2. The program according to claim 1, wherein, in the storing step, if a similar test set has already been stored, the contents of the test set relating to the specified test perspective are presented to the user who specified the test perspective so that they can be compared with the contents of the already stored test set.

6. 2. The program of claim 1, wherein the program causes the processor to execute a step of, when accepting character input from any of the users in an area for inputting information when creating the test design document, presenting to the any of the users a test set associated with the input character.

7. 7. The program of claim 6, wherein, in the presenting step, if there are multiple test sets associated with the input characters, the multiple test sets are presented in an order based on the creation date of the test design document, the number of test perspectives included, the frequency of defect occurrence, the number of times they have been reused, or the order of the test set names.

8. storing test results of test cases based on a test design document created using the test set; analyzing test results of the test cases associated with the test set and calculating a failure rate; When any of the users creates a test design document, a test set available to the user is presented together with a defect rate calculated based on test results of test cases related to the test set; The program according to claim 1, which causes the processor to execute the following steps.

9. 9. The program according to claim 8, wherein, in the presenting step, if there are multiple available test sets, the multiple test sets are presented in an order based on the failure rate.

10. tallying the number of times the test set has been used; analyzing the counted results and calculating a parameter related to the number of times of diversion; When any of the users creates a test design document, the user presents a test set available to the user together with the parameter regarding the number of times the test set can be reused; The program according to claim 1, which causes the processor to execute the following steps.

11. 11. The program according to claim 10, wherein, in the presenting step, if there are multiple available test sets, the multiple test sets are presented in an order based on the parameter.

12. 1. A computer-implemented method comprising a processor and a memory, the processor: receiving a designation for a test design document; receiving designations for two or more test aspects from among a plurality of test aspects included in a predetermined function in the test design document for which designations have been received; storing information for executing tests of the two or more specified test aspects as a test set so that the test set can be accessed by any user; reading the stored test set in response to a request from any of the users, and presenting the read test set to the any of the users; How to do it.

13. An information processing device including a control unit and a storage unit, wherein the control unit: receiving a designation for a test design document; receiving designations for two or more test aspects from among a plurality of test aspects included in a predetermined function in the test design document for which designations have been received; storing information for executing tests of the two or more specified test aspects as a test set so that the test set can be accessed by any user; reading the stored test set in response to a request from any of the users, and presenting the read test set to the any of the users; An information processing device that executes the above.

14. a means for accepting a test specification; means for accepting designations for two or more test aspects among a plurality of test aspects included in a predetermined function in the test design document for which designations have been accepted; a means for storing information for executing tests of two or more specified test aspects as a test set in a manner accessible to any user; means for reading out the stored test set in response to a request from any of the users and presenting the read test set to the user; A system comprising:

Images