server

Abstract

Easily manage test environments and test results. [Solution] A server for controlling software testing, comprising: a virtual test environment for performing software testing using test input data; a management unit for managing the virtual test environment in a list; and a test result storage unit for storing the results of tests performed in the virtual test environment, wherein the management unit searches for an available virtual test environment from the list, and if there is no available virtual test environment in the list, it duplicates the virtual test environment to generate a new virtual test environment, adds the generated virtual test environment to the list, associates the test request with the generated virtual test environment, and the test result storage unit, after the test using the virtual test environment associated with the test request is completed, does not delete the virtual test environment but retains it in the list.

Description

Technical Field

[0005] , , ,

[0006]

[0001] The present invention relates to a server for managing tests in a virtual test environment.

Background Art

[0002] In recent years, in-vehicle software has become large-scale, the communication volume between ECUs (Electronic Control Units) has increased, and in-vehicle systems have become more complex. Then, it is necessary to conduct tests on whether the increasingly complex in-vehicle systems are operating normally.

[0003] In the future, the scale of in-vehicle software is expected to expand, the development period is expected to be shortened, and software updates in SDV (Software Defined Vehicle) will continue to occur. As a problem surrounding the current tests, there is a shortage of actual machines. Since actual machines are expensive, it is necessary to share them with other testers and project teams for testing. However, in such a shared environment, it is difficult to cope with the rapid increase in test verification in the future.

[0004] Even if the test environment is cloudified, due to license limits and the like, there is an upper limit to the number of tests that can be run in parallel. When the number of virtual test environments reaches the upper limit, it is necessary to cede virtual test environments with other testers and project teams.

[0005] By simultaneously conducting multiple tests in a virtual test environment on the cloud and sharing test situations and results, etc., the development period can be shortened. Also, presenting multiple virtual test environments on the cloud to testers makes it easier to select multiple test environments and can reduce human resources by conducting tests simultaneously. Furthermore, having a test environment on the cloud can reduce the cost of actual machines.

[0006] The following prior art exists as background technology for this field. For example, Patent Document 1 (Japanese Patent Application Publication No. 2016-206828) describes an information processing device that, in order to verify the operation of an application program, receives notification from a connection unit included in the execution environment for operation verification that a connection request to an external service has been detected, replicates the execution environment according to the number of external services to be verified, sets connection information to the external service corresponding to the replicated execution environment in the connection unit included in the replicated execution environment, and continues operation verification for the corresponding external service connected by the connection unit included in the replicated execution environment for each replicated execution environment. [Prior art documents] [Patent Documents]

[0007] [Patent Document 1] Japanese Patent Publication No. 2016-206828 [Overview of the project] [Problems that the invention aims to solve]

[0008] The aforementioned background technology reduces the computing resources of information processing devices used for building applications and verifying the operation of applications that utilize services such as databases and microservices. To achieve this, when the results up to a certain point are the same in replicated test environments, the results that serve as input data are shared, and testing is started from that point, thereby reducing the computing resources used for operation verification. However, when another tester searches for past test results, it is difficult to determine which test environment the results belong to because the replicated test environment is deleted immediately after the test is performed and the test results are obtained. Therefore, there is a possibility that tests that have been performed in the past may be performed again.

[0009] Therefore, the present invention aims to provide a technology that makes it easy for multiple testers to manage replicated test environments, test results, etc. [Means for solving the problem]

[0010] A representative example of the invention disclosed in this application is as follows: In other words, the server for controlling software testing is comprised of a computer having a computing device that performs predetermined arithmetic processing and a storage device connected to the computing device, wherein the computing device comprises a request receiving unit that receives test requests and test input data, a virtual test environment in which the computing device performs software testing using the received test input data, a management unit that manages the virtual test environments in a list, and a test result storage unit that stores the results of tests performed in the virtual test environment, wherein the management unit searches the list for a virtual test environment that matches the test request and is available, and if there is no available virtual test environment in the list, it duplicates the virtual test environment to generate a new virtual test environment, adds the generated virtual test environment to the list, associates the test request with the generated virtual test environment, and if there is an available virtual test environment in the list, it associates the test request with the available virtual test environment, and the test result storage unit retains the virtual test environment in the list without deleting it after the test using the virtual test environment associated with the test request is completed. [Effects of the Invention]

[0011] According to one aspect of the present invention, when a previously used test environment needs to be reused, it can be found in a list and reused. Other issues, configurations, and effects not mentioned above will be clarified by the following description of the embodiments. [Brief explanation of the drawing]

[0012] [Figure 1] This figure shows the configuration of a server, which is an information processing device according to an embodiment of the present invention. [Figure 2] This diagram shows the configuration of the lists held by each part of the server in an embodiment of the present invention. [Figure 3] This diagram shows the operation of the request receiving unit in an embodiment of the present invention. [Figure 4] This figure shows the data managed by the I / O management unit in an embodiment of the present invention. [Figure 5] This figure shows the operation of the test request list in an embodiment of the present invention. [Figure 6] This diagram shows the operation of the test unit in an embodiment of the present invention. [Modes for carrying out the invention]

[0013] Embodiments of the present invention will be described below with reference to the drawings. The configurations of the following embodiments are illustrative, and the present invention is not limited to the configurations of these embodiments. This embodiment relates to an information processing device that can verify the operation of a real-world test environment on the cloud.

[0014] Figure 1 shows the configuration of a server 111, which is an information processing device according to an embodiment of the present invention. The server 111 in this embodiment is a computer having a arithmetic processing unit (CPU) that performs arithmetic processing, and a storage device connected to the arithmetic processing unit that stores programs and data.

[0015] First, the tester uploads the test input data 101 to be used to the I / O (Input / Output) management unit 102. The test input data 101 includes test input values ​​103 used in the test and specification information that specifies the virtual test environment to be used. The I / O management unit 102 selects one of the uploaded test input data 101, sends the test input values ​​103 of the selected test input data 101 to the request reception unit 104, and sends the virtual test environment information (e.g., identification information of the virtual test environment) 105 of the selected test input data to the management unit 106. The test environments are preferably managed in a virtual test environment name list 201, including usage status indicating availability / unavailability, as shown in Figure 2.

[0016] After that, when the management unit 106 matches the specified information included in the received test input data 101 and a usable test environment exists in the virtual test environment name list 201, the management unit 106 sends the virtual test environment information 105 of the selected test input data 101 to the request reception unit 104. On the other hand, when the management unit 106 matches the specified information included in the received test input data 101 and a usable test environment does not exist in the virtual test environment name list 201, the management unit 106 copies the original virtual test environment, sends the virtual test environment information 105 of the newly generated virtual test environment by the copy to the request reception unit 104, and adds the virtual test environment information 105 of the copied virtual test environment to the virtual test environment name list 201.

[0017] Note that the tester may add the virtual test environment changed by making arrangements in the newly generated virtual test environment by copy to the virtual test environment name list 201.

[0018] Triggered by the reception of the test input value 103 and the virtual test environment information 105 to be used, the request reception unit 104 requests the test execution unit 601 to execute the test (108). The test execution unit 601 will be described later with reference to FIG. 6. After the test is completed, the request reception unit 104 sends the test result to the I / O management unit 102 (109).

[0019] The I / O management unit 102 manages the test result. Also, the I / O management unit 102 outputs the test result to the tester (110).

[0020] The server 111 holds the virtual test environment copied for test execution and the test result. The server 111 may be constructed on the cloud or on a physical computer, and the computing resources may be provided outside the company or inside the company.

[0021] FIG. 2 is a diagram showing the configuration of the lists held by each part of the server 111.

[0022] The management unit 106 manages the identification information of virtual test environments, including copied virtual test environments, and a virtual test environment name list 201 that describes the usage status of said virtual test environments. In the virtual test environment name list 201, the usage status is as follows: "〇" means available, "×" means unavailable, and "-" means for copying.

[0023] When the management unit 106 requests an available virtual test environment (202), it is managed as an active / scheduled virtual test environment in the test request list 203. Information about the virtual test environments handled in the test request list 203 is sent to the management unit 106 as availability / unavailability information 204.

[0024] The management unit 106 changes the usage status of the virtual test environment to unavailable (205) based on the unavailable information 204 indicating that the virtual test environment is unavailable.

[0025] If all desired virtual test environments are in use, the management unit 106 copies a virtual test environment whose usage status is "-" and requests the virtual test environment generated by the copy. The copied virtual test environment is then registered in the test request list 203 and managed as in use in the virtual test environment name list 201. The test request list 203 holds all virtual test environments in the design, including the copied virtual test environment.

[0026] After the test is completed, the management unit 106 receives the test completion information and sends the information of the completed virtual test environment to the test request list 203, and then removes the virtual test environment information from the test request list 203. Then, when it receives the availability information of the completed virtual test environment from the test request list 203, it updates the availability status of the virtual test environment in the virtual test environment name list 201 to available.

[0027] Figure 3 shows the operation of the request receiving unit 104.

[0028] The request receiving unit 104 receives test input values ​​103 from the I / O management unit 102. The test input values ​​103 include information on changes to the virtual test environment settings. The request receiving unit 104 receives the test input values ​​103 from the I / O management unit 102, receives the virtual test environment information 301 to be used from the test request list 203, and associates the test input values ​​103 with the virtual test environment. The information of the virtual test environment changed by the test input values ​​103 is managed in the test request list 203 on the server 111 and also in the virtual test environment name list 201. The setting information changed by the test input values ​​103 includes functions for measuring the test data processing speed, functions for adding dummy data to the input data and performing stress tests, and functions for adding a window to display measurement signals. Furthermore, once the request receiving unit 104 obtains test completion information, it sends the test environment information 302 of the virtual test environment whose test has been completed to the test request list 203.

[0029] The management unit 106 monitors the time elapsed since the last use of a virtual test environment in the virtual test environment name list 201 and the availability information (usage status) became ○. If a virtual test environment has not been used for a predetermined period since its last use, the management unit 106 should remove the corresponding virtual test environment from the virtual test environment name list 201.

[0030] The request receiving unit 104 can accept multiple test input values ​​103 and multiple corresponding virtual test environments at once, and as shown in Figure 3, the input test input values ​​103 and virtual test environments are appropriately associated. For example, test input data A_1 is associated with one test request. If test input data A_1 contains multiple test input values ​​103, the test may be performed by associating a different virtual test environment for each of the multiple input values, or by associating a single virtual test environment for all of the multiple test input values ​​103. As mentioned above, when managing multiple test input values ​​103 with a single test request, it is good practice to manage the test input values ​​103 by writing a sequential number after the name of the test input value 103 in a single test input data 101. Alternatively, test input data 101 may associate different virtual test environments with different test requests and perform multiple tests simultaneously.

[0031] Figure 4 shows the data managed by the I / O management unit 102.

[0032] The I / O management unit 102 functions as a test result storage unit for saving test results and includes a test input data management unit 401 that manages the test input data 101 used in the test, a virtual test environment name management unit 402 that manages the names of the virtual test environments used in the test, and a test result management unit 403 that manages the test results. The I / O management unit 102 records the test input data 101, the virtual test environment, and the test results in association with each other. Testers can view and download the data managed by the I / O management unit 102 (for example, test results).

[0033] Furthermore, since the virtual test environment, test input data 101, and test results of previously conducted tests are recorded in association with each other, testers can select the test input data 101 and virtual test environment to check the results of previously conducted tests.

[0034] Figure 5 shows the operation of test request list 203.

[0035] The test request list 203 manages the virtual test environments requested by the management unit 106 and sends information 501 of the virtual test environment selected by the tester to the request reception unit 104. When the request reception unit 104 receives the virtual test environment information 501 from the test request list 203, it performs the test and, after the test is completed, sends information 502 of the virtual test environment's end of use to the test request list 203. When the test request list 203 receives the virtual test environment's end of use information 502 from the request reception unit 104, it removes the virtual test environment from the test request list 203 and sends information 503 of the virtual test environment's availability to the management unit 106. The availability information 503 of the virtual test environment allows the management unit 106 and the test request list 203 to manage consistent information.

[0036] Figure 6 shows the operation of the test execution unit 601.

[0037] The test execution unit 601 receives test combination information 602 from the request reception unit 104 and executes the test triggered by the receipt of the test combination information 602. The test combination information 602 includes test input values ​​103 and virtual test environment information. The test input values ​​103 included in the test combination information 602 are the test input values ​​103 sent from the I / O management unit 102 to the management unit 106, and the test environment information included in the test combination information 602 is the information of the virtual test environment selected by the management unit 106.

[0038] After the test is completed, the test execution unit 601 sends the combination of the test result and the virtual test environment name 603 to the I / O management unit 102, and sends the test completion information 604 to the request reception unit 104.

[0039] As described above, according to the embodiment of the present invention, if you want to use a virtual test environment that was previously created by copying, you can select it from the virtual test environment name list 201 and reuse the desired virtual test environment without copying it. Furthermore, since the virtual test environment created by copying is automatically deleted from the server 111 after a predetermined period of time has elapsed, the workload of the tester can be reduced.

[0040] Furthermore, if a newly generated virtual test environment created through copying and modified with additional arrangements is saved in the virtual test environment name list 201, testers can reuse the modified virtual test environment, reducing the effort required to arrange the virtual test environment.

[0041] Furthermore, since the original virtual test environment and the copied virtual test environment are recorded in the virtual test environment name list 201, testers can see at a glance the usage status of existing virtual test environments by viewing the virtual test environment name list 201. When viewing the virtual test environment name list 201, testers can select and use the virtual test environment they want to use if it is not in use, or if the desired virtual test environment is in use, they can copy the original virtual test environment and use the newly generated virtual test environment created by the copy, thereby improving the convenience for testers.

[0042] It should be noted that the present invention is not limited to the embodiments described above, but includes various modifications and equivalent configurations within the spirit of the attached claims. For example, the embodiments described above are described in detail for the purpose of clearly illustrating the present invention, and the present invention is not necessarily limited to having all the described configurations. Furthermore, some of the configurations of one embodiment may be replaced with those of another embodiment. Furthermore, configurations of other embodiments may be added to the configuration of one embodiment. Furthermore, some of the configurations of each embodiment may be added, deleted, or replaced with those of other embodiments.

[0043] Furthermore, each of the aforementioned configurations, functions, processing units, and processing means may be implemented in hardware, for example, by designing them as integrated circuits, or they may be implemented in software by having a processor interpret and execute programs that realize each function.

[0044] Information such as programs, tables, and files that implement each function can be stored in memory, hard disks, SSDs (Solid State Drives), or other storage media such as IC cards, SD cards, and DVDs.

[0045] Furthermore, the control lines and information lines shown are those deemed necessary for explanation purposes and do not necessarily represent all control lines and information lines required for implementation. In reality, it can be assumed that almost all components are interconnected. [Explanation of Symbols]

[0046] 101 Test Input Data 102 I / O Management Department 103 Test Input Values 104 Request Reception Department 105 Virtual Test Environment Information 106 Management Department 111 Server 201 Virtual Test Environment Name List 203 Test Requirements List 204 Usable / unusable information 301 Virtual Test Environment Information 302 Usage Test Environment Information 401 Test Input Data Management Department 402 Virtual Test Environment Name Management Department 403 Test Results Management Department 501 Information on the virtual test environment selected by the tester 502 Virtual Test Environment End-of-Service Information 503 Virtual Test Environment Availability Information 601 Test Implementation Department 602 Combination Information 603 Test Results / Virtual Test Environment Name 604 Test Complete Information

Claims

1. A server that controls software testing, It is composed of a computer having an arithmetic unit that performs predetermined arithmetic processing and a storage device connected to the arithmetic unit, The aforementioned computing device includes a request receiving unit that receives test requests and test input data, The aforementioned computing device provides a virtual test environment in which it performs software testing using the received test input data, The aforementioned computing unit includes a management unit that manages the virtual test environment in a list, The computing device includes a test result storage unit that stores the results of tests performed in the virtual test environment, The aforementioned management department, Search the list for a virtual test environment that meets the aforementioned test requirements and is available, If the available virtual test environment is not in the list, a new virtual test environment is created by duplicating the virtual test environment, the created virtual test environment is added to the list, and the test request is associated with the created virtual test environment. If the available virtual test environment is in the list, associate the test request with the available virtual test environment. The test result storage unit is a server that, after a test using the virtual test environment associated with the test request is completed, retains the virtual test environment in the list without deleting it.

2. A server according to claim 1, The aforementioned list includes availability information indicating whether the virtual test environment is available or unavailable. The aforementioned management department, Search the list for a virtual test environment that meets the aforementioned test requirements and whose availability information indicates it is available. The availability information for the virtual test environment associated with the aforementioned test request is set to unavailable. A server that sets the availability information of the virtual test environment associated with the test request for which the aforementioned tests have been completed to "available".

3. A server according to claim 1, The aforementioned test input data includes configuration information for the virtual test environment, The request receiving unit further receives the configuration information for the virtual test environment, The management unit is a server that modifies the settings of the virtual test environment associated with the test request based on the setting information of the virtual test environment.

4. The server according to claim 2, The aforementioned management department, The availability information for the virtual test environments included in the aforementioned list is monitored, and the elapsed time since they became available is monitored. A server that removes virtual test environments from the list if the elapsed time is greater than a predetermined value.

5. A server according to claim 1, The test input data includes a plurality of test input values ​​associated with the test request, The management unit is a server that associates the test request with the virtual test environment for each of the multiple test input values.

6. A server according to claim 1, The test result storage unit is a server that stores the test input data used in the test, the identification information of the virtual test environment, and the test results in association with each other.

7. A server according to claim 1, The aforementioned test input data includes specification information that specifies the virtual test environment, The aforementioned management unit is a server that associates the virtual test environment specified in the specified information with the test request.

Images