Program, method, and system for assisting in correction of system architecture information

Abstract

Provided is a technology for providing assistance in the safe correction of system architecture information of a computer system. A system for assisting in correction of system architecture information according to the present invention stores an executed test database in which data related to executed tests is accumulated, inputs, into a computer system, a system to be tested in which corrected system architecture information is applied, a test environment corresponding to the system to be tested, and an initial test, which is for confirming that the purpose of correcting the system architecture information has been achieved, executes the initial test in the test environment, acquires the difference between a test result of the initial test and a test result obtained when a test corresponding to the initial test is executed in the computer system, extracts, on the basis of the difference and as a first additional test from among executed tests, a test in which degradation from the computer system to the system to be tested satisfies a test selection condition, and outputs information representing the first additional test.

Description

System construction information correction support system, method, and program

[0001] The present disclosure relates to a technique for supporting the modification of system configuration information of a computer system.

[0002] There is a technique for efficiently building a computer system (hereinafter simply referred to as a "system") by converting the infrastructure settings of the system into source code (hereinafter also referred to as "IaC source code") using Infrastructure as Code (IaC) and executing the IaC source code. Various events that occur during the operation of a system built using this technique can make it necessary to modify the IaC source code. When the IaC source code is modified, testing is performed to ensure the normality of the system after the IaC source code is modified.

[0003] Patent Document 1 discloses a technology for measuring the effects of changes to system parameters. The system parameter setting support device disclosed in Patent Document 1 performs tests sequentially in chronological order, and when tuning parameters taking into account the test results of each test, compares the test results of each test performed sequentially in chronological order with the previous test to calculate the changes, extracts tests that do not achieve an effect greater than a predetermined index based on the changes in the test results, and extracts parameters that were changed during the extracted tests. This makes it possible to extract parameter changes that did not achieve the predetermined effect.

[0004] International Patent Application No. 2013 / 018376

[0005] The technology of Patent Document 1 can extract parameters that are not effective through testing and support parameter tuning. However, since the technology of Patent Document 1 does not take into consideration the sufficiency of testing, it cannot support sufficient testing itself.

[0006] One objective of the present disclosure is to provide a technique for supporting the safe modification of system configuration information of a computer system.

[0007] A system configuration information correction support system according to one aspect of the present invention is a system configuration information correction support system that supports the correction of system configuration information for setting up the infrastructure of a computer system, and includes: a memory unit that stores an executed test database in which data related to executed tests, which are tests executed on the computer system, is accumulated; an input unit that inputs a test target system, which is the computer system to which the corrected system configuration information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test for confirming that the purpose of correcting the system configuration information has been achieved; a test selection unit that executes the initial test in the test environment, obtains a difference between the test result obtained thereby and the test result obtained when a test corresponding to the initial test was executed on the computer system, and extracts, from the executed tests, a test that satisfies a predetermined test selection condition for degradation from the computer system to the test target system, as a first additional test, based on the difference; and an output unit that outputs information representing the first additional test.

[0008] A system configuration information correction support method according to one aspect of the present invention is a method for supporting the correction of system configuration information for setting up the infrastructure of a computer system, using an information processing device including at least one processor and at least one memory. The memory stores an executed test database in which data related to executed tests, which are tests executed on the computer system, is accumulated. The processor inputs a test target system, which is the computer system to which the corrected system configuration information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test for confirming that the purpose of correcting the system configuration information has been achieved, executes the initial test in the test environment, obtains a difference between the test result obtained thereby and the test result obtained when a test corresponding to the initial test was executed on the computer system, and, based on the difference, extracts, from the executed tests, a test that satisfies a predetermined test selection condition for degradation from the computer system to the test target system, as a first additional test, and outputs information representing the first additional test.

[0009] A system configuration information correction support program according to one aspect of the present invention is a system configuration information correction support program that supports the correction of system configuration information for setting up the infrastructure of a computer system, by an information processing device including at least one processor and at least one memory. The memory stores an executed test database in which data on executed tests, which are tests executed on the computer system, is accumulated. The system configuration information correction support program causes the processor to input a test target system, which is the computer system to which the corrected system configuration information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test for confirming that the purpose of correcting the system configuration information has been achieved, execute the initial test in the test environment, obtain a difference between the test result obtained thereby and a test result obtained when a test corresponding to the initial test was executed on the computer system, and, based on the difference, extract, from the executed tests, a test that satisfies a predetermined test selection condition for degradation from the computer system to the test target system, as a first additional test, and output information representing the first additional test.

[0010] According to one aspect of the present disclosure, it is possible to provide a technique for supporting the safe modification of system configuration information of a computer system.

[0011] 1 is a block diagram of a system construction information correction support system according to the present embodiment. FIG. 2 is a flowchart illustrating system construction information correction support processing according to the present embodiment. FIG. 3 is a flowchart illustrating test selection processing by metrics comparison according to the present embodiment. FIG. 4 is a conceptual diagram illustrating test information stored in an executed test database according to the present embodiment. FIG. 5 is a conceptual diagram illustrating the contents described in a test result, which is an information item in the executed test database according to the present embodiment. FIG. 6 is a flowchart illustrating system construction information correction support processing according to the present embodiment. FIG. 7 is a flowchart illustrating system construction information correction support processing according to the present embodiment. FIG. 8 is a block diagram of a system construction information correction support system according to the present embodiment. FIG. 9 is a flowchart illustrating system construction information correction support processing according to the present embodiment. FIG. 10 is a flowchart illustrating test plan generation processing according to the present embodiment. FIG. 11 is a block diagram of a system construction information correction support system according to the present embodiment. FIG. 12 is a flowchart illustrating system construction information correction support processing according to the present embodiment.

[0012] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0013] FIG. 1 is a block diagram of a system construction information revision support system according to this embodiment.

[0014] The construction information revision support system 1 is a system construction information revision support system that supports the revision of system construction information for setting up the infrastructure of a computer system.

[0015] The construction information revision support system 1 is an information processing device that includes at least one processor and at least one memory.

[0016] The processor may be configured with, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field-Programmable Gate Array), etc. The processor functionally realizes an input unit 11, a test selection unit 12, and an output unit 14 by reading and executing a construction information correction support program stored in memory. These functional blocks may be connected to each other so as to be able to communicate with each other. In addition, a memory unit 13 having the function of storing information is connected to each functional block so as to be able to communicate with each other. In the example of FIG. 1, the test selection unit 12 and the memory unit 13 are shown connected to each other, but other functional blocks may also be connected to the memory unit 13.

[0017] The storage unit 13 stores an executed test database 131 in which data relating to executed tests, which are tests executed on the computer system, is accumulated.

[0018] The input unit 11 has the function of inputting a test target system, which is a computer system to which the modified system construction information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test to confirm that the purpose of modifying the system construction information has been achieved.

[0019] System construction information refers to information that allows a system to be constructed by applying the information to a computer system. System construction information refers to IaC source code, etc. The IaC source code may be implemented in a format known to those skilled in the art, such as a JSON file, and a system is constructed by deploying based on the IaC source code.

[0020] The system under test is, for example, the production environment of a computer system. The test environment, which corresponds to the system under test, is, for example, an environment separate from the production environment. Because it is risky to make modifications to the production environment from the start, tests are first performed in the test environment before the system is built in the production environment.

[0021] When a modification is made to the system configuration information, the initial test may be a test that is directly linked to the modified part. As an example, if a computer system includes three subsystems A to C and the system configuration information for the CPU of subsystem C is modified, the initial test may be a test that verifies the operation of subsystem C.

[0022] The test selection unit 12 has a function of obtaining a difference between the test result obtained by the initial test executed in the test environment and the test result obtained when a test equivalent to the initial test is executed in the computer system. Based on the difference, the test selection unit 12 has a function of extracting, as a first additional test, from the executed tests, a test that satisfies a test selection condition that specifies a predetermined degradation from the computer system to the system under test.

[0023] If the initial test cannot be executed in the test environment, the test selection unit 12 extracts the infrastructure related to the initial test from the infrastructure to be modified in the system construction information as related infrastructure, and extracts the test related to the related infrastructure from the executed tests as a second additional test.

[0024] The test selection unit 12 further has a function of executing the first additional test or the second additional test in the test environment.

[0025] The output unit 14 has a function of outputting information representing the first additional test. The output unit 14 further has a function of outputting information representing the test results of the first additional test or the second additional test executed in the test environment.

[0026] FIG. 2 is a flowchart illustrating a system construction information correction support process according to this embodiment.

[0027] The input unit 11 inputs a test target system, which is a computer system to which the modified system construction information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test to confirm that the purpose of modifying the system construction information has been achieved (S101).

[0028] Note that inputting a target may mean inputting information for identifying the target. For example, inputting a system under test may mean inputting information for identifying the system under test (e.g., an identification ID for the system under test). It may also mean inputting the data for the target itself. For example, inputting a system under test may mean deploying the system under test to a production environment or a test environment. The meaning of input is similar for inputting other targets. The same applies to other embodiments described below.

[0029] The test selection unit 12 executes the initial test in the test environment (S102). Note that the execution here may mean loading the initial test information into the test environment and then sending a command to execute the test. The same applies to the other embodiments described below.

[0030] The test selection unit 12 selects tests by comparing metrics (S103). Test selection by comparing metrics will be described later with reference to Fig. 3. The output unit 14 outputs information representing the selected tests (S104).

[0031] FIG. 3 is a flowchart illustrating a test selection process based on metrics comparison according to this embodiment.

[0032] The test selection unit 12 performs a numerical metric judgment (S201). The judgment here refers to comparing the numerical metrics included in the results of tests conducted in the past with the numerical metrics included in the results of the current test.

[0033] The test selection unit 12 performs an event metrics judgment (S202). The judgment here refers to comparing the event metrics included in the results of past tests with the event metrics included in the results of the current test.

[0034] The test selection unit 12 determines whether or not there are any items whose performance has degraded in the metrics judgment (S203). If there are any items whose performance has degraded (S203: Yes), the process proceeds to step S204. If there are no items whose performance has degraded (S203: No), the process shown in FIG. 3 ends.

[0035] In step S204, the test selection unit 12 extracts a group of tests from the executed test database 131 that are intended to verify the target item, that is, the item whose performance has deteriorated.

[0036] The test selection unit 12 selects, from the extracted test group, the test that is most likely to cause a decrease in performance for the target item (S205).

[0037] FIG. 4 is a conceptual diagram illustrating test information stored in the executed test database according to this embodiment.

[0038] The information stored in the executed test database 131 includes the test name, the test type, the purpose of the test, the phenomenon to be reproduced, and the test result as information items.

[0039] The test name is information that indicates the name of the test. The test type is information that indicates the type of test, such as a performance test or a security test. The test purpose is information that indicates the purpose of conducting the test. The reproduced event is an event on the system that is reproduced by executing the test. For example, since the function A-load test is a performance test, it reproduces the event of 100 people accessing function A per second. By reproducing this event, a performance test is performed to check whether processing delays occur. The test result is information that indicates the results of the test that was conducted.

[0040] FIG. 5 is a conceptual diagram illustrating the contents described in the test result, which is an information item of the executed test database, according to this embodiment.

[0041] The test results 20 are stored in the test result column, which is an information item of the executed test database 131. The test results 20 include numerical metrics 21, event metrics 22, and infrastructure 23 that is likely to be related.

[0042] Metrics refer to observable information about a system, such as average response time, CPU usage, memory usage, disk usage, data I / O, and number of accesses. Numeric metrics 21 refer to metrics that are expressed numerically. Event metrics 22 are information that represent events that occur during test execution, such as an exception error that occurs when a GET search / id request is issued.

[0043] The likely related infrastructure 23 is information indicating infrastructure that is likely to be related to the target test. In the example of Fig. 5, since a load test of function A is being performed, infrastructure such as Azure App Service that is related to function A is recorded as the likely related infrastructure 23.

[0044] FIG. 6 is a flowchart illustrating a system configuration information correction support process according to this embodiment.

[0045] The input unit 11 inputs a test target system, which is a computer system to which the modified system construction information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test to confirm that the purpose of modifying the system construction information has been achieved (S301).

[0046] The test selection unit 12 executes the initial tests in the test environment (S302). The test selection unit 12 selects tests by comparing metrics (S303). Test selection by comparing metrics is similar to that described in the first embodiment, so a detailed description will be omitted. The test selection unit 12 executes the tests selected in step S303 in the test environment (S304). The output unit 14 outputs information representing the selected tests and the execution results of the tests (S305).

[0047] FIG. 7 is a flowchart illustrating a system configuration information correction support process according to this embodiment.

[0048] The input unit 11 inputs a test target system, which is a computer system to which the modified system construction information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test to confirm that the purpose of modifying the system construction information has been achieved (S401).

[0049] The test selection unit 12 executes an initial test in the test environment (S402).

[0050] The test selection unit 12 determines whether the test was successfully executed (S403). If the test was successful, the process proceeds to step S404. If the test failed, the process proceeds to step S405.

[0051] In step S404, the test selection unit 12 performs test selection by comparing metrics. The test selection by comparing metrics is the same as that described in the first embodiment, and therefore a detailed description thereof will be omitted.

[0052] In step S405, the test selection unit 12 acquires the infrastructure to be modified. The infrastructure to be modified refers to infrastructure such as servers and storage devices included in the computer system. For example, if the system configuration information is to be modified to upgrade the CPU specifications of Server A and Server B included in the system, Server A and Server B correspond to the infrastructure to be modified.

[0053] The test selection unit 12 extracts, from the infrastructures defined before the modification, those that are highly relevant to the infrastructure that is the target of the failed test (S406). The degree of relevance is as follows: In the above example, if the failed test was a load test on server A and the system was constructed so that server B waits for processing on server A before performing processing, both server A and server B would be highly relevant to the infrastructure that is the target of the failed test. If the failed test was a load test on server A and server A and server B perform processing independently of each other and have little mutual dependency, only server A would be highly relevant to the infrastructure that is the target of the failed test.

[0054] The test selection unit 12 extracts tests corresponding to the relevant infrastructure from the executed test database 131 (S407). Note that multiple tests corresponding to the relevant infrastructure may be extracted.

[0055] The test selection unit 12 selects tests that are highly relevant to the failed test (S408). For example, if log data or metrics can be acquired in response to the execution of the initial test executed in step S402, tests that, when executed, obtain log data or metrics similar to such log data or metrics based on predetermined criteria are selected in step S408 as tests that are highly relevant to the failed test.

[0056] The output unit 14 outputs information representing the selected test (S409).

[0057] FIG. 8 is a flowchart illustrating a system configuration information correction support process according to this embodiment.

[0058] The input unit 11 inputs a test target system, which is a computer system to which the modified system construction information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test to confirm that the purpose of modifying the system construction information has been achieved (S501).

[0059] The test selection unit 12 executes an initial test in the test environment (S502).

[0060] The test selection unit 12 determines whether the test was successfully executed (S503). If the test was successful, the process proceeds to step S504. If the test failed, the process proceeds to step S506.

[0061] In step S504, the test selection unit 12 performs test selection by comparing metrics. The test selection by comparing metrics is the same as that described in the first embodiment, and therefore a detailed description thereof will be omitted.

[0062] The test selection unit 12 executes the selected tests in the test environment (S505).

[0063] In step S506, the test selection unit 12 acquires the infrastructure to be modified. The infrastructure to be modified is the same as that in the third embodiment, and therefore a detailed description thereof will be omitted.

[0064] The test selection unit 12 extracts, from the infrastructures defined before the correction, those that are highly related to the infrastructure that is the target of the failed test (S507). The degree of relatedness is the same as in the third embodiment, so a detailed explanation will be omitted.

[0065] The test selection unit 12 extracts tests corresponding to the relevant infrastructure from the executed test database 131 (S508). Note that multiple tests corresponding to the relevant infrastructure may be extracted.

[0066] The test selection unit 12 selects tests that are highly relevant to the failed test (S509). High relevance may mean that the log data or metrics that can be acquired in response to the execution of the test are similar based on a predetermined criterion.

[0067] The test selection unit 12 executes the selected tests (S510).

[0068] The test selection unit 12 determines whether the cause of the failure of the test executed in step S502 has been identified (S511). This determination may be made by comparing the log data and metrics between the initial test executed in step S502 and the test executed in step S510. If the cause of the failure of the test executed in step S502 has been identified, the process proceeds to step S512. If the cause of the failure of the test executed in step S502 has not been identified, the process returns to step S509, where a test highly related to the failed test is again selected. That is, the next test that has not yet been executed in step S510 is selected from the multiple tests extracted in step S508.

[0069] The output unit 14 outputs information representing the selected test and the execution result of the test (S512).

[0070] FIG. 9 is a block diagram of a system configuration information revision support system according to this embodiment.

[0071] Of the configuration of the construction information correction support system 1 shown in FIG. 9, detailed explanation of the same parts as those shown in FIG. 1 will be omitted, and only the differences will be explained.

[0072] The construction information revision support system 1 shown in FIG. 9 further includes a test plan generation unit 15. The processor functionally realizes an input unit 11, a test selection unit 12, an output unit 14, and a test plan generation unit 15 by reading and executing a construction information revision support program stored in memory. These functional blocks are connected to each other so that they can communicate with each other. In addition, a storage unit 13 having a function of storing information may be connected to each functional block so that they can communicate with each other. In the example of FIG. 9, the test plan generation unit 15 and the test selection unit 12 are connected to the storage unit 13, but other functional blocks may also be connected to the storage unit 13.

[0073] The test plan generation unit 15 has a function of extracting a test that reproduces an event that has occurred in the test target system from the executed test database 131 if the executed test database 131 contains a test that reproduces the event, and creating a test that reproduces the event if the executed test database 131 does not contain a test that reproduces the event.

[0074] FIG. 10 is a flowchart illustrating a system configuration information correction support process according to this embodiment.

[0075] The input unit 11 inputs a test target system, which is a computer system to which the corrected system configuration information has been applied, and a test environment corresponding to the test target system (S601).

[0076] The test plan generation unit 15 generates a test plan (S602). Details of the test plan generation process will be described later with reference to FIG.

[0077] The test selection unit 12 executes tests in the test environment according to the test plan (S603). The test selection unit 12 selects tests by comparing metrics (S604). The test selection by comparing metrics is the same as that described in the first embodiment, so a detailed description will be omitted.

[0078] FIG. 11 is a flowchart illustrating a test plan generation process according to this embodiment.

[0079] The test plan generation unit 15 detects an event that has occurred in the system (S701). An event that has occurred in the system means some event, such as a processing delay occurring in server A included in the system, or a CPU usage rate or memory usage rate exceeding a predetermined threshold.

[0080] The test plan generation unit 15 investigates the cause of the event that occurred in the system (S702). The algorithm for investigating the cause is not particularly limited. For example, the test plan generation unit 15 may acquire information such as the numerical metrics 21, the event metrics 22, and the infrastructure 23 that is likely to be related, and may infer the cause on a rule-based basis. The cause may also be inferred by inputting information based on this information into a trained model.

[0081] The test plan generation unit 15 determines whether or not a test that reproduces the event exists in the executed test database 131 (S703). If a test that reproduces the event exists in the executed test database 131, the process proceeds to step S704. If a test that reproduces the event does not exist in the executed test database 131, the process proceeds to step S705.

[0082] In step S704, the test plan generation unit 15 extracts a test that reproduces the event from the executed test database 131.

[0083] In step S705, the test plan generator 15 extracts tests related to the event from the executed test database 131. Multiple tests may be extracted. The association of the tests related to the event may be determined in advance. For example, a load test may be determined in advance as a test related to the event of CPU usage exceeding a predetermined threshold.

[0084] The test plan generator 15 then creates a test that reproduces the event based on the test extracted in step S705 (S706).

[0085] The creation of a test that reproduces the event may be performed using AI. For example, a process of creating a test by combining the multiple tests extracted in step S705 can be implemented using rule-based AI.

[0086] 11 can reduce the load during test plan generation and execution compared to when test plans are always generated using AI. This is because if a test that reproduces an event exists in the executed test database 131, the test plan can be generated by extracting data from the executed test database 131 without creating a new test plan.

[0087] FIG. 12 is a block diagram of a system construction information revision support system according to this embodiment.

[0088] Of the configuration of the construction information correction support system 1 shown in FIG. 12, detailed explanations of the same parts as those shown in FIG. 1 will be omitted, and only the differences will be explained.

[0089] The construction information revision support system 1 shown in Figure 12 further includes a system construction information revision unit 16. The processor reads and executes a construction information revision support program stored in memory, thereby functionally realizing an input unit 11, a test selection unit 12, an output unit 14, and a system construction information revision unit 16. These functional blocks are connected to each other so that they can communicate with each other. In addition, a memory unit 13 having a function of storing information is connected to each functional block so that it can communicate with each other. In the example of Figure 12, the test selection unit 12 and the memory unit 13 are connected, but other functional blocks may also be connected to the memory unit 13.

[0090] The system construction information correction unit 16 has a function of receiving from the user whether or not the corrected system construction information is acceptable based on the test results output by the output unit 14, and if it is not acceptable, receiving from the user a request to correct the corrected system construction information again.

[0091] FIG. 13 is a flowchart illustrating a system configuration information correction support process according to this embodiment.

[0092] The input unit 11 inputs a test target system, which is a computer system to which the modified system construction information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test to confirm that the purpose of modifying the system construction information has been achieved (S801).

[0093] The test selection unit 12 executes an initial test in the test environment (S802). The test selection unit 12 performs test selection by metrics comparison (S803). The test selection by metrics comparison is the same as that described in the first embodiment, so a detailed description will be omitted.

[0094] The test selection unit 12 executes the tests selected in step S803 in the test environment (S804). The output unit 14 outputs information representing the selected tests and the execution results of the tests (S805).

[0095] The system configuration information corrector 16 determines whether the corrected system configuration information is acceptable based on the test results output by the output unit 14 (S806). Typically, the system configuration information corrector 16 receives information from the user indicating whether the corrected system configuration information is acceptable based on the test results output by the output unit 14. If the corrected system configuration information is acceptable, the process shown in Fig. 13 ends. If the corrected system configuration information is not acceptable, the process proceeds to step S807.

[0096] In step S807, the system configuration information correcting unit 16 corrects the system configuration information based on the test results, and the process returns to step S802.

[0097] FIG. 14 is a block diagram of a system configuration information revision support system according to this embodiment.

[0098] Of the configuration of the construction information correction support system 1 shown in FIG. 14, detailed explanations of the same parts as those shown in FIG. 1 will be omitted, and only the differences will be explained.

[0099] 14 further includes a metrics verification result database 132. The storage unit 13 stores the metrics verification result database 132, which is data that associates performed initial tests, which are initial tests that have been performed on the computer system, with metrics, which are index values ​​acquired in the performed initial tests.

[0100] The information stored in the metrics verification result database 132 is used, for example, to narrow down the metrics to be compared when there are a large number of metrics.

[0101] The test selection unit 12 has the function of extracting from the metrics verification result database 132 previously conducted initial tests that have a test purpose similar to that of the current initial test, which is the current initial test; the function of calculating the frequency of each of the metrics in the extracted previously conducted initial tests; the function of selecting metrics whose frequency meets predetermined metrics selection conditions; the function of obtaining the differences between the selected metrics; and the function of extracting a first additional test based on the differences.

[0102] The purpose of the test means the purpose of the test, which is an information item shown in Fig. 4. The similarity of the verification purpose means that it is the same as or similar to the purpose of the test shown in Fig. 4.

[0103] FIG. 15 is a flowchart illustrating a system configuration information correction support process according to this embodiment.

[0104] The input unit 11 inputs a test target system, which is a computer system to which the modified system construction information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test to confirm that the purpose of modifying the system construction information has been achieved (S901).

[0105] The test selection unit 12 executes an initial test in the test environment (S902).

[0106] The test selection unit 12 extracts tests similar to the purpose of the initial test from the metrics verification result database 132 (S903).

[0107] Tests similar to the objective of the initial test may be tests with the same objective. Alternatively, objectives may be recorded in the metrics validation result database 132 with information indicating predetermined criteria such as inclusion relationships or similarities added, and tests similar to the objective of the initial test may be extracted based on the predetermined criteria.

[0108] The test selection unit 12 selects metrics to be compared based on the frequency of the metrics (S904).

[0109] The frequency of a metric refers to a numerical value indicating how often that metric appears in the data stored in the metrics verification result database 132. For example, if there are many records in these databases in which CPU utilization, which is one of the metrics, appears, the test selection unit 12 selects CPU utilization as the metric to be compared. Note that the test selection unit 12 may select multiple types of metrics as the metrics to be compared. For example, the test selection unit 12 selects the top three metrics by frequency.

[0110] The test selection unit 12 selects tests by comparing metrics (S905). The test selection by comparing metrics is the same as that described in the first embodiment, so a detailed description will be omitted. The output unit 14 outputs information representing the selected tests (S906).

[0111] The above-described embodiments of the present invention are examples for explaining the present invention, and are not intended to limit the scope of the present invention to only these embodiments. Those skilled in the art can implement the present invention in various other forms without departing from the scope of the present invention. Furthermore, the technical scope of the above-described embodiments includes the matters set forth in the following appendices. However, the present invention is not limited to the following appendices. However, the matters included in the above-described embodiments are not limited to the appendices.

[0112] (Supplementary Note 1) A system for supporting the modification of system configuration information for setting up the infrastructure of a computer system includes: a storage unit for storing an executed test database that accumulates data on executed tests that are tests performed on the computer system; an input unit for inputting a test target system obtained by applying modified system configuration information to the computer system, a test environment corresponding to the test target system, and an initial test that is a test for confirming that the purpose of modifying the system configuration information has been achieved; a test selection unit for executing the initial test in the test environment, obtaining a difference between the test result obtained thereby and a test result obtained when a test corresponding to the initial test is performed on the computer system, and extracting, from the executed tests, as first additional tests, tests that satisfy a predetermined test selection condition for degradation from the computer system to the test target system based on the difference; and an output unit for outputting information representing the first additional tests. As a result, tests that are expected to cause system degradation based on the difference in test results resulting from the modification of the system configuration information are presented as additional tests, thereby supporting the safe modification of the system configuration information by performing appropriate tests.

[0113] (Supplementary Note 2) In the system configuration information correction support system described in Supplementary Note 1, the test selection unit further executes a first additional test in the test environment, and the output unit further outputs information representing the test results of the first additional test executed in the test environment. This allows tests that are expected to cause system degradation to be executed as additional tests based on differences in the test results caused by the correction of the system configuration information, thereby enabling more appropriate testing to be performed.

[0114] (Supplementary Note 3) In the system configuration information correction support system described in Supplementary Note 1, if the initial test cannot be executed in the test environment, the test selection unit extracts, as related infrastructure, infrastructure related to the initial test from among the infrastructure to be corrected in the system configuration information, and extracts, as second additional tests, tests related to the related infrastructure from among the executed tests. This makes it possible to extract more appropriate tests when the initial test cannot be executed.

[0115] (Supplementary Note 4) In the system configuration information revision support system described in Supplementary Note 3, the test selection unit further executes a second additional test in the test environment, and the output unit further outputs information representing the test results of the second additional test executed in the test environment. This makes it possible to extract and execute a more appropriate test as the second additional test when the initial test cannot be executed.

[0116] (Supplementary Note 5) The system configuration information revision support system described in Supplementary Note 1 further includes a test plan generation unit that extracts a test that reproduces an event that occurred in the test target system from the executed test database if the executed test database contains a test that reproduces the event, and creates a test that reproduces the event if the executed test database does not contain a test that reproduces the event. This eliminates the need to create a new test plan if the executed test database contains a test that reproduces the event, thereby reducing the load when generating and executing a test plan.

[0117] (Supplementary Note 6) The system for supporting revision of system construction information described in Supplementary Note 2 further comprises a system construction information revision unit that receives from the user whether or not the revised system construction information is acceptable based on the test results output by the output unit, and if not acceptable, receives from the user a request to re-revise the revised system construction information. This allows the system construction information to be revised step by step to improve it with the user's involvement.

[0118] (Supplementary Note 7) In the system construction information revision support system described in Supplementary Note 1, the storage unit stores a metrics verification result database that is data that associates conducted initial tests, which are initial tests that have been conducted on the computer system, with metrics, which are index values ​​obtained in the conducted initial tests. The test selection unit extracts conducted initial tests that have a test purpose similar to that of the current initial test from the metrics verification result database, calculates the frequency of each of the metrics in the extracted conducted initial tests, selects metrics whose frequency meets predetermined metrics selection conditions, obtains differences between the selected metrics, and extracts first additional tests based on the differences. This makes it possible to reduce processing effort by narrowing down the metrics to be compared when there are a large number of metrics.

[0119] (Supplementary Note 8) In the system construction information revision support system described in Supplementary Note 1, the system construction information is Infrastructure as Code. This makes it possible to efficiently build a system by executing IaC source code.

[0120] (Supplementary Note 9) A system configuration information revision support method for supporting revision of system configuration information for setting up the infrastructure of a computer system, using an information processing device including at least one processor and at least one memory, wherein the memory stores an executed test database storing data on executed tests that are tests executed on the computer system, the processor inputs a test target system obtained by applying revised system configuration information to the computer system, a test environment corresponding to the test target system, and an initial test that is a test for confirming that the purpose of modifying the system configuration information has been achieved, executes the initial test in the test environment, obtains a difference between the test result obtained thereby and a test result obtained when a test corresponding to the initial test is executed on the computer system, and, based on the difference, extracts, from the executed tests, a test that satisfies a predetermined test selection condition that causes degradation from the computer system to the test target system as a first additional test, and outputs information representing the first additional test. In this way, tests that are expected to cause system degradation based on the difference in test results caused by the modification of the system configuration information are presented as additional tests, thereby supporting safe revision of the system configuration information by executing appropriate tests.

[0121] (Supplementary Note 10) A system configuration information correction support program for supporting the correction of system configuration information for setting up the infrastructure of a computer system, using an information processing device including at least one processor and at least one memory, wherein the memory stores an executed test database storing data on executed tests that are tests executed on the computer system, the system configuration information correction support program causing the processor to input a test target system obtained by applying the corrected system configuration information to the computer system, a test environment corresponding to the test target system, and an initial test that is a test for confirming that the purpose of correcting the system configuration information has been achieved, execute the initial test in the test environment, obtain a difference between the test result obtained thereby and a test result obtained when a test corresponding to the initial test was executed on the computer system, extract, from the executed tests based on the difference, a test that satisfies a predetermined test selection condition for causing degradation from the computer system to the test target system as a first additional test, and output information representing the first additional test. As a result, tests that are expected to cause system degradation based on the difference in test results resulting from the correction of the system configuration information are presented as additional tests, thereby supporting safe correction of the system configuration information by executing appropriate tests.

[0122] 1... Construction information correction support system, 11... Input unit, 12... Test selection unit, 13... Storage unit, 131... Executed test database, 132... Metrics verification result database, 14... Output unit, 15... Test plan generation unit, 16... System construction information correction unit, 20... Test results, 21... Numerical metrics, 22... Event metrics, 23... Infrastructure

Claims

1. A system construction information correction support system that supports the correction of system construction information for setting up the infrastructure of a computer system, comprising: a storage unit that stores an executed test database in which data on executed tests, which are tests executed on the computer system, is accumulated; an input unit that inputs a test target system, which is the computer system to which the corrected system construction information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test for confirming that the purpose of correcting the system construction information has been achieved; a test selection unit that executes the initial test in the test environment, obtains a difference between the test result obtained thereby and a test result obtained when a test equivalent to the initial test was executed on the computer system, and extracts, from the executed tests, a test that satisfies a predetermined test selection condition for degradation from the computer system to the test target system, as a first additional test, based on the difference; and an output unit that outputs information representing the first additional test.

2. The system construction information revision support system according to claim 1, wherein the test selection unit further executes the first additional test in the test environment, and the output unit further outputs information representing the test results of the first additional test executed in the test environment.

3. The system construction information correction support system according to claim 1, wherein, if the initial test cannot be executed in the test environment, the test selection unit extracts, from the infrastructure to be corrected in the system construction information, infrastructure related to the initial test as related infrastructure, and extracts, from the executed tests, tests related to the related infrastructure as second additional tests.

4. The system construction information correction support system according to claim 3, wherein the test selection unit further executes the second additional test in the test environment, and the output unit further outputs information representing the test results of the second additional test executed in the test environment.

5. The system construction information revision support system according to claim 1, further comprising a test plan generation unit that, if a test that reproduces an event that occurred in the system under test is in the executed test database, extracts a test that reproduces the event from the executed test database, and, if a test that reproduces the event is not in the executed test database, creates a test that reproduces the event.

6. The system construction information correction support system according to claim 2, further comprising a system construction information correction unit that receives from a user whether or not the corrected system construction information is acceptable based on the test results output by said output unit, and if not acceptable, receives from said user a request to correct the corrected system construction information again.

7. The system construction information correction support system described in claim 1, wherein the memory unit stores a metrics verification result database which is data that associates performed initial tests, which are initial tests that have been performed on the computer system, with metrics, which are index values ​​obtained in the performed initial tests, and the test selection unit extracts performed initial tests from the metrics verification result database that have a test purpose similar to that of the current initial test, which is the current initial test, calculates the frequency of each of the metrics in the extracted performed initial tests, selects metrics whose frequency meets predetermined metrics selection conditions, obtains the difference for the selected metrics, and extracts the first additional test based on the difference.

8. The system construction information correction support system according to claim 1, wherein the system construction information is infrastructure as code.

9. A system configuration information correction support method for supporting the correction of system configuration information for setting up the infrastructure of a computer system, using an information processing device including at least one processor and at least one memory, wherein the memory stores an executed test database in which data on executed tests, which are tests executed on the computer system, is accumulated, and the processor inputs a test target system, which is the computer system to which the corrected system configuration information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test for confirming that the purpose of correcting the system configuration information has been achieved, executes the initial test in the test environment, obtains a difference between the test result obtained thereby and a test result obtained when a test equivalent to the initial test was executed on the computer system, and based on the difference, extracts, from the executed tests, a test that satisfies a predetermined test selection condition for degradation from the computer system to the test target system, as a first additional test, and outputs information representing the first additional test.

10. A system construction information correction support program that supports the correction of system construction information for setting up the infrastructure of a computer system, using an information processing device including at least one processor and at least one memory, wherein the memory stores an executed test database in which data on executed tests that are tests executed on the computer system are accumulated, and the system construction information correction support program causes the processor to execute the following operations: input a test target system obtained by applying the corrected system construction information to the computer system, a test environment corresponding to the test target system, and an initial test that is a test for confirming that the purpose of correcting the system construction information has been achieved; execute the initial test in the test environment, obtain a difference between the test result obtained thereby and a test result obtained when a test equivalent to the initial test was executed on the computer system; extract, from the executed tests, a test that satisfies a predetermined test selection condition for degradation from the computer system to the test target system, as a first additional test, based on the difference; and output information representing the first additional test.

Images