System architecture information correction support system, method, and program

Abstract

To provide a technique for supporting safe correction of system architecture information of a computer system.SOLUTION: A system architecture information correction support system stores an executed test database in which data related to executed tests is accumulated, inputs, into a computer system, a system to be tested in which corrected system architecture information is applied, a test environment corresponding to the system to be tested, and an initial test, which is a test for confirming that the purpose of correcting the system architecture information has been achieved, executes the initial test in the test environment, acquires the difference between a test result of the initial test and a test result obtained when a test corresponding to the initial test is executed in the computer system, extracts, on the basis of the difference and as a first additional test from among executed tests, a test in which degradation from the computer system to the system to be tested satisfies a test selection condition, and outputs information representing the first additional test.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to a technique for supporting the modification of system configuration information of a computer system. [Background technology]

[0002] There is a method for efficiently building a computer system (hereinafter simply referred to as "system") by converting the infrastructure settings of the system into source code (hereinafter also referred to as "IaC source code") using Infrastructure as Code (IaC), and then executing the IaC source code. During the operation of a system built using this method, various issues can arise that require modifications to the IaC source code. When the IaC source code is modified, testing is performed to ensure the system remains functional after the modifications are made.

[0003] Patent Document 1 discloses a technology for measuring the effects of changes to system parameters. The system parameter setting support device disclosed in Patent Document 1 performs tests sequentially in chronological order, and when tuning parameters taking into account the test results of each test, compares the test results of each test performed sequentially in chronological order with the previous test to calculate the changes, extracts tests that do not achieve an effect greater than a predetermined index based on the changes in the test results, and extracts parameters that were changed during the extracted tests. This makes it possible to extract parameter changes that did not achieve the predetermined effect. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] International Patent Application No. 2013 / 018376 Summary of the Invention [Problem to be solved by the invention]

[0005] The technology in Patent Document 1 can extract parameters that are not effective through testing and support parameter tuning. However, since the technology in Patent Document 1 does not consider the sufficiency of testing, it cannot support sufficient testing itself.

[0006] One objective of the present disclosure is to provide a technique for supporting the safe modification of system configuration information of a computer system. [Means for solving the problem]

[0007] A system configuration information correction support system according to one embodiment of the present invention is a system configuration information correction support system that supports the correction of system configuration information for setting up the infrastructure of a computer system, and includes: a memory unit that stores an executed test database in which data related to executed tests, which are tests executed on the computer system, is accumulated; an input unit that inputs a test target system, which is the computer system to which the corrected system configuration information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test for confirming that the purpose of correcting the system configuration information has been achieved; a test selection unit that executes the initial test in the test environment, obtains a difference between the test result obtained thereby and the test result obtained when a test corresponding to the initial test was executed on the computer system, and extracts, from the executed tests, a test that satisfies a predetermined test selection condition for degradation from the computer system to the test target system, as a first additional test, based on the difference; and an output unit that outputs information representing the first additional test.

[0008] A system configuration information correction support method according to one aspect of the present invention is a system configuration information correction support method that supports the correction of system configuration information for setting up the infrastructure of a computer system by an information processing device including at least one processor and at least one memory, in which the memory stores an executed test database in which data related to executed tests, which are tests executed on the computer system, and the processor inputs a test target system, which is the computer system to which the corrected system configuration information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test for confirming that the purpose of correcting the system configuration information has been achieved, executes the initial test in the test environment, obtains a difference between the test result obtained thereby and the test result obtained when a test corresponding to the initial test was executed on the computer system, and, based on the difference, extracts, from the executed tests, a test that satisfies a predetermined test selection condition for degradation from the computer system to the test target system, as a first additional test, and outputs information representing the first additional test.

[0009] A system configuration information correction support program according to one embodiment of the present invention is a system configuration information correction support program that supports the correction of system configuration information for setting up the infrastructure of a computer system by an information processing device including at least one processor and at least one memory, wherein the memory stores an executed test database in which data on executed tests, which are tests executed on the computer system, are accumulated. The system configuration information correction support program causes the processor to input a test target system, which is the computer system to which the corrected system configuration information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test for confirming that the purpose of correcting the system configuration information has been achieved, execute the initial test in the test environment, obtain a difference between the test result obtained thereby and a test result obtained when a test corresponding to the initial test was executed on the computer system, and, based on the difference, extract, from the executed tests, a test that satisfies a predetermined test selection condition for degradation from the computer system to the test target system as a first additional test, and output information representing the first additional test. [Effects of the Invention]

[0010] According to one aspect of the present disclosure, it is possible to provide a technique for supporting the safe modification of system configuration information of a computer system. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a block diagram of a system construction information revision support system according to an embodiment of the present invention. [Figure 2] 10 is a flowchart illustrating a system configuration information correction support process according to the present embodiment. [Figure 3] 10 is a flowchart illustrating a test selection process based on metrics comparison according to the present embodiment. [Figure 4] FIG. 10 is a conceptual diagram illustrating test information stored in an executed test database according to the present embodiment. [Figure 5] FIG. 10 is a conceptual diagram illustrating the contents described in a test result, which is an information item of an executed test database, according to this embodiment. [Figure 6] 10 is a flowchart illustrating a system configuration information correction support process according to the present embodiment. [Figure 7] 10 is a flowchart illustrating a system configuration information correction support process according to the present embodiment. [Figure 8] 10 is a flowchart illustrating a system configuration information correction support process according to the present embodiment. [Figure 9] 1 is a block diagram of a system construction information revision support system according to an embodiment of the present invention. [Figure 10] 10 is a flowchart illustrating a system configuration information correction support process according to the present embodiment. [Figure 11] 1 is a flowchart illustrating a test plan generation process according to an embodiment. [Figure 12] 1 is a block diagram of a system construction information revision support system according to an embodiment of the present invention. [Figure 13] 10 is a flowchart illustrating a system configuration information correction support process according to the present embodiment. [Figure 14] 1 is a block diagram of a system construction information revision support system according to an embodiment of the present invention. [Figure 15] 10 is a flowchart illustrating a system configuration information correction support process according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. [Example]

[0013] FIG. 1 is a block diagram of a system construction information revision support system according to this embodiment.

[0014] The construction information revision support system 1 is a system construction information revision support system that supports the revision of system construction information for setting up the infrastructure of a computer system.

[0015] The construction information revision support system 1 is an information processing device that includes at least one processor and at least one memory.

[0016] The processor may be configured with, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field-Programmable Gate Array), etc. The processor functionally realizes an input unit 11, a test selection unit 12, and an output unit 14 by reading and executing a construction information correction support program stored in memory. These functional blocks may be communicably connected to each other. In addition, a memory unit 13 having a function of storing information is communicably connected to each functional block. In the example of FIG. 1, the test selection unit 12 and the memory unit 13 are shown connected, but other functional blocks may also be connected to the memory unit 13.

[0017] The storage unit 13 stores an executed test database 131 that accumulates data on executed tests, which are tests that have been executed on the computer system.

[0018] The input unit 11 has a function for inputting a test target system, which is a computer system to which the modified system construction information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test for confirming that the purpose of modifying the system construction information has been achieved.

[0019] System construction information refers to information that allows a system to be constructed by applying the information to a computer system. System construction information also refers to IaC source code, etc. The IaC source code may be implemented in a format known to those skilled in the art, such as a JSON file, and a system is constructed by deploying the IaC source code.

[0020] The system under test is, for example, the production environment of a computer system. The test environment, which corresponds to the system under test, is, for example, an environment separate from the production environment. Because it is risky to make modifications to the production environment from the start, tests are first performed in the test environment before the system is built in the production environment.

[0021] When a modification is made to the system configuration information, the initial test may be a test that is directly linked to the modified part. As an example, if a computer system includes three subsystems A to C and the system configuration information for the CPU of subsystem C is modified, the initial test may be a test that verifies the operation of subsystem C.

[0022] The test selection unit 12 has a function of obtaining the difference between the test result obtained by the initial test executed in the test environment and the test result obtained when a test equivalent to the initial test is executed in the computer system. Based on the difference, the test selection unit 12 has a function of extracting, as a first additional test, from the executed tests, a test that satisfies a predetermined test selection condition for degradation from the computer system to the system under test.

[0023] If the initial test cannot be executed in the test environment, the test selection unit 12 extracts the infrastructure related to the initial test from the infrastructure to be modified in the system construction information as related infrastructure, and extracts the test related to the related infrastructure from the executed tests as a second additional test.

[0024] The test selection unit 12 further has a function of executing the first additional test or the second additional test in the test environment.

[0025] The output unit 14 has a function of outputting information representing the first additional test. The output unit 14 further has a function of outputting information representing the test results of the first additional test or the second additional test executed in the test environment.

[0026] FIG. 2 is a flowchart illustrating a system construction information correction support process according to this embodiment.

[0027] The input unit 11 inputs a test target system, which is a computer system to which the modified system construction information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test to confirm that the purpose of modifying the system construction information has been achieved (S101).

[0028] Note that inputting a target may mean inputting information for identifying the target. For example, inputting a system under test may mean inputting information for identifying the system under test (for example, an identification ID for the system under test). It may also mean inputting the target data itself. For example, inputting a system under test may mean deploying the system under test to a production environment or a test environment. The meaning of input is similar for inputting other targets. The same applies to other embodiments described below.

[0029] The test selection unit 12 executes the initial test in the test environment (S102). Note that the execution here may mean loading the initial test information into the test environment and then sending a command to execute the test. The same applies to the other embodiments described below.

[0030] The test selection unit 12 selects tests by comparing metrics (S103). Test selection by comparing metrics will be described later with reference to Fig. 3. The output unit 14 outputs information representing the selected tests (S104).

[0031] FIG. 3 is a flowchart illustrating a test selection process based on metrics comparison according to this embodiment.

[0032] The test selection unit 12 performs a numerical metric judgment (S201). The judgment here refers to comparing the numerical metrics included in the results of tests conducted in the past with the numerical metrics included in the results of the current test.

[0033] The test selection unit 12 performs an event metrics judgment (S202). The judgment here refers to comparing the event metrics included in the results of the past tests with the event metrics included in the results of the current test.

[0034] The test selection unit 12 determines whether or not there are any items whose performance has degraded in the above metrics judgment (S203). If there are any items whose performance has degraded (S203: Yes), the process proceeds to step S204. If there are no items whose performance has degraded (S203: No), the process shown in FIG. 3 ends.

[0035] In step S204, the test selection unit 12 extracts from the executed test database 131 a group of tests aimed at verifying the target item, that is, the item whose performance has deteriorated.

[0036] The test selection unit 12 selects, from the extracted test group, the test that is most likely to cause a decrease in performance for the target item (S205).

[0037] FIG. 4 is a conceptual diagram illustrating test information stored in the executed test database according to this embodiment.

[0038] The information stored in the executed test database 131 includes the test name, the test type, the purpose of the test, the phenomenon to be reproduced, and the test result as information items.

[0039] The test name is information that indicates the name of the test. The test type is information that indicates the type of test, such as a performance test or a security test. The test purpose is information that indicates the purpose of conducting the test. The reproduced event is an event on the system that is reproduced by executing the test. For example, since the Function A-Load Test is a performance test, it reproduces the event of 100 people accessing Function A per second. By reproducing this event, a performance test is performed to check whether processing delays occur. The test result is information that indicates the results of the test that was conducted.

[0040] FIG. 5 is a conceptual diagram illustrating the contents described in the test result, which is an information item of the executed test database, according to this embodiment.

[0041] The test results 20 are stored in the test result column, which is an information item of the executed test database 131. The test results 20 include numerical metrics 21, event metrics 22, and likely related infrastructure 23.

[0042] Metrics refer to observable information about a system, such as average response time, CPU usage, memory usage, disk usage, data I / O, and number of accesses. Numeric metrics 21 refer to metrics that are expressed numerically. Event metrics 22 are information that represents events that occurred during test execution, such as an exception error occurring when issuing a GET search / id request.

[0043] The "highly related infrastructure 23" is information that indicates infrastructure that is likely to be related to the target test. In the example of Figure 5, since a load test is being performed on function A, infrastructure such as Azure App Service that is related to function A is recorded as the "highly related infrastructure 23." [Example]

[0044] FIG. 6 is a flowchart illustrating a system configuration information correction support process according to this embodiment.

[0045] The input unit 11 inputs a test target system, which is a computer system to which the modified system configuration information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test to confirm that the purpose of modifying the system configuration information has been achieved (S301).

[0046] The test selection unit 12 executes an initial test in the test environment (S302). The test selection unit 12 performs test selection by comparing metrics (S303). Test selection by comparing metrics is the same as that described in the first embodiment, so a detailed description will be omitted. The test selection unit 12 executes the tests selected in step S303 in the test environment (S304). The output unit 14 outputs information representing the selected tests and the execution results of the tests (S305). [Example]

[0047] FIG. 7 is a flowchart illustrating a system configuration information correction support process according to this embodiment.

[0048] The input unit 11 inputs a test target system, which is a computer system to which the modified system configuration information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test to confirm that the purpose of modifying the system configuration information has been achieved (S401).

[0049] The test selection unit 12 executes an initial test in the test environment (S402).

[0050] The test selection unit 12 determines whether the test was successfully executed (S403). If the test was successful, the process proceeds to step S404. If the test was unsuccessful, the process proceeds to step S405.

[0051] In step S404, the test selection unit 12 performs test selection by comparing metrics. The test selection by comparing metrics is the same as that described in the first embodiment, and therefore a detailed description thereof will be omitted.

[0052] In step S405, the test selection unit 12 acquires the infrastructure to be modified. The infrastructure to be modified refers to infrastructure such as servers and storage devices included in the computer system. For example, if the system configuration information is to be modified to upgrade the CPU specifications of Server A and Server B included in the system, Server A and Server B correspond to the infrastructure to be modified.

[0053] The test selection unit 12 extracts infrastructures that are highly relevant to the infrastructure that is the target of the failed test from the infrastructures that were defined before the modification (S406). The degree of relevance is as follows: In the above example, if the failed test was a load test on server A and the system was constructed so that server B waits for processing on server A before performing processing, both server A and server B would be highly relevant to the infrastructure that is the target of the failed test. If the failed test was a load test on server A and server A and server B perform processing independently of each other and have little mutual dependency, only server A would be highly relevant to the infrastructure that is the target of the failed test.

[0054] The test selection unit 12 extracts tests corresponding to the relevant infrastructure from the executed test database 131 (S407). Note that multiple tests corresponding to the relevant infrastructure may be extracted.

[0055] The test selection unit 12 selects tests that are highly relevant to the failed test (S408). For example, if log data or metrics can be acquired in response to the execution of the initial test executed in step S402, tests that, when executed, obtain log data or metrics similar to such log data or metrics based on predetermined criteria are selected in step S408 as tests that are highly relevant to the failed test.

[0056] The output unit 14 outputs information representing the selected test (S409). [Example]

[0057] FIG. 8 is a flowchart illustrating a system configuration information correction support process according to this embodiment.

[0058] The input unit 11 inputs a test target system, which is a computer system to which the modified system configuration information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test to confirm that the purpose of modifying the system configuration information has been achieved (S501).

[0059] The test selection unit 12 executes an initial test in the test environment (S502).

[0060] The test selection unit 12 determines whether the test was successfully executed (S503). If the test was successful, the process proceeds to step S504. If the test failed, the process proceeds to step S506.

[0061] In step S504, the test selection unit 12 performs test selection by comparing metrics. Test selection by comparing metrics is the same as that described in the first embodiment, so a detailed description will be omitted.

[0062] The test selection unit 12 executes the selected tests in the test environment (S505).

[0063] In step S506, the test selection unit 12 acquires the infrastructure to be corrected. The infrastructure to be corrected is the same as that in the third embodiment, and therefore a detailed description thereof will be omitted.

[0064] The test selection unit 12 extracts the infrastructure that is highly related to the target infrastructure of the failed test from the infrastructures that were defined before the correction (S507). The degree of relatedness is the same as in the third embodiment, so a detailed explanation will be omitted.

[0065] The test selection unit 12 extracts tests corresponding to the relevant infrastructure from the executed test database 131 (S508). Note that multiple tests corresponding to the relevant infrastructure may be extracted.

[0066] The test selection unit 12 selects tests that are highly relevant to the failed test (S509). High relevance may mean that the log data or metrics that can be acquired in response to the execution of the test are similar based on a predetermined criterion.

[0067] The test selection unit 12 executes the selected tests (S510).

[0068] The test selection unit 12 determines whether the cause of the failure of the test executed in step S502 has been identified (S511). This determination may be made by comparing the log data and metrics between the initial test executed in step S502 and the test executed in step S510. If the cause of the failure of the test executed in step S502 has been identified, the process proceeds to step S512. If the cause has not been identified, the process returns to step S509, where a test highly related to the failed test is again selected. That is, the next test that has not yet been executed in step S510 is selected from the multiple tests extracted in step S508.

[0069] The output unit 14 outputs information representing the selected test and the execution result of the test (S512). [Example]

[0070] FIG. 9 is a block diagram of a system construction information revision support system according to this embodiment.

[0071] Of the configuration of the construction information correction support system 1 shown in FIG. 9, detailed explanations of the same parts as those shown in FIG. 1 will be omitted, and only differences will be explained.

[0072] The construction information revision support system 1 shown in FIG. 9 further includes a test plan generation unit 15. The processor functionally realizes an input unit 11, a test selection unit 12, an output unit 14, and a test plan generation unit 15 by reading and executing a construction information revision support program stored in memory. These functional blocks are connected to each other so that they can communicate with each other. In addition, a storage unit 13 having a function of storing information may be connected to each functional block so that it can communicate with each other. In the example of FIG. 9, the test plan generation unit 15 and the test selection unit 12 are connected to the storage unit 13, but other functional blocks may also be connected to the storage unit 13.

[0073] The test plan generation unit 15 has a function of extracting a test that reproduces an event that occurred in the test target system from the executed test database 131 if the executed test database 131 contains a test that reproduces the event, and creating a test that reproduces the event if the executed test database 131 does not contain a test that reproduces the event.

[0074] FIG. 10 is a flowchart illustrating a system configuration information correction support process according to this embodiment.

[0075] The input unit 11 inputs a test target system, which is a computer system to which the modified system configuration information has been applied, and a test environment corresponding to the test target system (S601).

[0076] The test plan generation unit 15 generates a test plan (S602). Details of the test plan generation process will be described later with reference to FIG.

[0077] The test selection unit 12 executes tests in the test environment according to the test plan (S603). The test selection unit 12 selects tests by comparing metrics (S604). The test selection by comparing metrics is the same as that described in the first embodiment, so a detailed description will be omitted.

[0078] FIG. 11 is a flowchart illustrating a test plan generation process according to this embodiment.

[0079] The test plan generation unit 15 detects an event that has occurred in the system (S701). An event that has occurred in the system means some event, such as a processing delay occurring in server A included in the system, or a CPU usage rate or memory usage rate exceeding a predetermined threshold.

[0080] The test plan generation unit 15 investigates the cause of the event that occurred in the system (S702). The algorithm for investigating the cause is not particularly limited. For example, the test plan generation unit 15 may acquire information such as numerical metrics 21, event metrics 22, and infrastructure 23 that is likely to be related, and infer the cause on a rule-based basis. The cause may also be inferred by inputting information based on this information into a trained model.

[0081] The test plan generation unit 15 determines whether or not a test that reproduces the event exists in the executed test database 131 (S703). If a test that reproduces the event exists in the executed test database 131, the process proceeds to step S704. If a test that reproduces the event does not exist in the executed test database 131, the process proceeds to step S705.

[0082] In step S704, the test plan generation unit 15 extracts a test that reproduces the event from the executed test database 131.

[0083] In step S705, the test plan generator 15 extracts tests related to the event from the executed test database 131. Multiple tests may be extracted. The association of the tests related to the event may be determined in advance. For example, a load test may be determined in advance as a test related to the event that the CPU usage rate exceeds a predetermined threshold.

[0084] Then, the test plan generation unit 15 creates a test that reproduces the event based on the test extracted in step S705 (S706).

[0085] The creation of a test to reproduce the event may be performed using AI. For example, a process of creating a test by combining the multiple tests extracted in step S705 can be implemented using rule-based AI.

[0086] Here, compared to always generating test plans using AI, the test plan generation process shown in Fig. 11 can reduce the load during test plan generation and execution. This is because if a test that reproduces an event is in the executed test database 131, the test plan can be generated by extracting data from the executed test database 131 without creating a new test plan. [Example]

[0087] FIG. 12 is a block diagram of a system construction information revision support system according to this embodiment.

[0088] Of the configuration of the construction information correction support system 1 shown in FIG. 12, detailed explanations of the same parts as those shown in FIG. 1 will be omitted, and only differences will be explained.

[0089] The construction information correction support system 1 shown in FIG. 12 further includes a system construction information correction unit 16. The processor functionally realizes an input unit 11, a test selection unit 12, an output unit 14, and a system construction information correction unit 16 by reading and executing a construction information correction support program stored in memory. These functional blocks are connected to each other so that they can communicate with each other. In addition, a memory unit 13 having a function of storing information is connected to each functional block so that it can communicate with each other. In the example of FIG. 12, the test selection unit 12 and the memory unit 13 are connected, but other functional blocks may also be connected to the memory unit 13.

[0090] The system construction information correction unit 16 has a function of receiving from the user whether or not the corrected system construction information is acceptable based on the test results output by the output unit 14, and if it is not acceptable, receiving from the user a request to correct the corrected system construction information again.

[0091] FIG. 13 is a flowchart illustrating a system configuration information correction support process according to this embodiment.

[0092] The input unit 11 inputs a test target system, which is a computer system to which the modified system configuration information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test to confirm that the purpose of modifying the system configuration information has been achieved (S801).

[0093] The test selection unit 12 executes an initial test in the test environment (S802). The test selection unit 12 performs test selection by metrics comparison (S803). The test selection by metrics comparison is the same as that described in the first embodiment, so a detailed description will be omitted.

[0094] The test selection unit 12 executes the tests selected in step S803 in the test environment (S804). The output unit 14 outputs information representing the selected tests and the execution results of the tests (S805).

[0095] The system configuration information corrector 16 determines whether the corrected system configuration information is acceptable based on the test results output by the output unit 14 (S806). Typically, the system configuration information corrector 16 receives information from the user indicating whether the corrected system configuration information is acceptable based on the test results output by the output unit 14. If the corrected system configuration information is acceptable, the process shown in Fig. 13 ends. If the corrected system configuration information is not acceptable, the process proceeds to step S807.

[0096] In step S807, the system configuration information corrector 16 corrects the system configuration information based on the test results, and the process returns to step S802. [Example]

[0097] FIG. 14 is a block diagram of a system construction information revision support system according to this embodiment.

[0098] Of the configuration of the construction information correction support system 1 shown in FIG. 14, detailed explanations of the same parts as those shown in FIG. 1 will be omitted, and only differences will be explained.

[0099] 14 further includes a metrics verification result database 132. The storage unit 13 stores the metrics verification result database 132, which is data that associates executed initial tests, which are initial tests that have been executed on the computer system, with metrics, which are index values ​​acquired in the executed initial tests.

[0100] The information stored in the metrics validation result database 132 is used to narrow down the metrics to be compared when there are a large number of metrics.

[0101] The test selection unit 12 has the functions of extracting from the metrics verification result database 132 previously conducted initial tests that have a test purpose similar to that of the current initial test, which is the current initial test; calculating the frequency of each of the metrics in the extracted previously conducted initial tests; selecting metrics whose frequency meets predetermined metrics selection conditions; obtaining the differences between the selected metrics; and extracting a first additional test based on the differences.

[0102] The purpose of the test refers to the purpose of the test, which is an information item shown in Figure 4. The similarity of the verification purpose means that it is the same as or similar to the purpose of the test shown in Figure 4.

[0103] FIG. 15 is a flowchart illustrating a system configuration information correction support process according to this embodiment.

[0104] The input unit 11 inputs a test target system, which is a computer system to which the modified system configuration information has been applied, a test environment corresponding to the test target system, and an initial test, which is a test to confirm that the purpose of modifying the system configuration information has been achieved (S901).

[0105] The test selection unit 12 executes an initial test in the test environment (S902).

[0106] The test selection unit 12 extracts tests similar to the purpose of the initial test from the metrics verification result database 132 (S903).

[0107] Tests similar to the objective of the initial test may be tests with the same objective. Alternatively, objectives may be recorded in the metrics validation result database 132 with information indicating predetermined criteria such as inclusion relationships or similarities added, and tests similar to the objective of the initial test may be extracted based on the predetermined criteria.

[0108] The test selection unit 12 selects metrics to be compared based on the frequency of the metrics (S904).

[0109] The frequency of a metric refers to a numerical value indicating how often that metric appears in the data stored in the metrics verification result database 132. For example, if there are many records in these databases in which CPU usage, which is one of the metrics, appears, the test selection unit 12 selects CPU usage as the metric to be compared. Note that the test selection unit 12 may select multiple types of metrics as the metrics to be compared. For example, the test selection unit 12 selects the top three metrics by frequency.

[0110] The test selection unit 12 selects tests by comparing metrics (S905). The test selection by comparing metrics is the same as that described in the first embodiment, so a detailed description will be omitted. The output unit 14 outputs information representing the selected tests (S906).

[0111] The above-described embodiments of the present invention are examples for explaining the present invention, and are not intended to limit the scope of the present invention to only these embodiments. Those skilled in the art can implement the present invention in various other forms without departing from the scope of the present invention. Furthermore, the technical scope of the above-described embodiments includes the matters set forth in the following appendices. However, the present invention is not limited to the following appendices. However, the matters included in the above-described embodiments are not limited to the appendices.

[0112] (Appendix 1) A system configuration information revision support system for supporting the revision of system configuration information for setting up the infrastructure of a computer system includes: a storage unit for storing an executed test database in which data on executed tests, which are tests executed on the computer system, is accumulated; an input unit for inputting a test target system obtained by applying revised system configuration information to the computer system, a test environment corresponding to the test target system, and an initial test, which is a test for confirming that the purpose of updating the system configuration information has been achieved; a test selection unit for executing the initial test in the test environment, obtaining a difference between the test result obtained thereby and a test result obtained when a test corresponding to the initial test was executed on the computer system, and extracting, from the executed tests, as first additional tests, tests that satisfy a predetermined test selection condition for degradation from the computer system to the test target system based on the difference; and an output unit for outputting information representing the first additional tests. As a result, tests that are expected to cause system degradation based on the difference in test results resulting from the revision of the system configuration information are presented as additional tests, thereby supporting the safe revision of the system configuration information by executing appropriate tests.

[0113] (Appendix 2) In the system configuration information correction support system described in Supplementary Note 1, the test selection unit further executes a first additional test in the test environment, and the output unit further outputs information representing the test results of the first additional test executed in the test environment. This allows tests that are expected to cause system degradation to be executed as additional tests based on differences in the test results caused by the correction of the system configuration information, thereby enabling more appropriate testing to be performed.

[0114] (Appendix 3) In the system configuration information correction support system described in Supplementary Note 1, if the initial test cannot be executed in the test environment, the test selection unit extracts infrastructure related to the initial test from the infrastructure to be corrected in the system configuration information as related infrastructure, and extracts tests related to the related infrastructure from the executed tests as second additional tests. This makes it possible to extract more appropriate tests when the initial test cannot be executed.

[0115] (Appendix 4) In the system configuration information correction support system described in Supplementary Note 3, the test selection unit further executes a second additional test in the test environment, and the output unit further outputs information representing the test result of the second additional test executed in the test environment. This makes it possible to extract and execute a more appropriate test as the second additional test when the initial test cannot be executed.

[0116] (Appendix 5) The system construction information revision support system described in Appendix 1 further includes a test plan generation unit that extracts a test that reproduces an event that occurred in the test target system from the executed test database if the executed test database contains a test that reproduces the event, and creates a test that reproduces the event if the executed test database does not contain a test that reproduces the event.This eliminates the need to create a new test plan if the executed test database contains a test that reproduces the event, thereby reducing the load when generating and executing a test plan.

[0117] (Appendix 6) The system configuration information revision support system described in Appendix 2 further comprises a system configuration information revision unit that receives from the user whether the revised system configuration information is acceptable based on the test results output by the output unit, and if not acceptable, receives from the user a request to re-revise the revised system configuration information. This allows the system configuration information to be revised step by step to improve it with the user's involvement.

[0118] (Appendix 7) In the system configuration information revision support system described in Supplementary Note 1, the storage unit stores a metrics verification result database that is data that associates conducted initial tests, which are initial tests that have been conducted on the computer system, with metrics, which are index values ​​obtained in the conducted initial tests, and the test selection unit extracts conducted initial tests that have a test purpose similar to that of the current initial test from the metrics verification result database, calculates the frequency of each of the metrics in the extracted conducted initial tests, selects metrics whose frequency meets predetermined metrics selection conditions, obtains differences between the selected metrics, and extracts first additional tests based on the differences. This makes it possible to reduce processing effort by narrowing down the metrics to be compared when there are a large number of metrics.

[0119] (Appendix 8) In the system construction information revision support system described in Appendix 1, the system construction information is Infrastructure as Code. This makes it possible to efficiently build a system by executing IaC source code.

[0120] (Appendix 9) A system configuration information revision support method for supporting revision of system configuration information for setting up the infrastructure of a computer system, using an information processing device including at least one processor and at least one memory, wherein the memory stores an executed test database in which data on executed tests that are tests executed on the computer system is accumulated, the processor inputs a test target system obtained by applying revised system configuration information to the computer system, a test environment corresponding to the test target system, and an initial test that is a test for confirming that the purpose of revising the system configuration information has been achieved, executes the initial test in the test environment, obtains a difference between the test result obtained thereby and a test result obtained when a test corresponding to the initial test is executed on the computer system, and, based on the difference, extracts, from the executed tests, a test that satisfies a predetermined test selection condition that causes degradation from the computer system to the test target system as a first additional test, and outputs information representing the first additional test. In this way, tests that are expected to cause system degradation based on the difference in test results caused by the revision of the system configuration information are presented as additional tests, thereby supporting safe revision of the system configuration information by executing appropriate tests.

[0121] (Appendix 10) A system configuration information revision support program for supporting revision of system configuration information for setting up the infrastructure of a computer system, using an information processing device including at least one processor and at least one memory, wherein the memory stores an executed test database storing data on executed tests that are tests executed on the computer system, the system configuration information revision support program causing the processor to input a test target system obtained by applying the revised system configuration information to the computer system, a test environment corresponding to the test target system, and an initial test that is a test for confirming that the purpose of updating the system configuration information has been achieved, execute the initial test in the test environment, obtain a difference between the test result obtained thereby and a test result obtained when a test corresponding to the initial test was executed on the computer system, extract, from the executed tests based on the difference, a test that satisfies a predetermined test selection condition for degradation from the computer system to the test target system as a first additional test, and output information representing the first additional test. As a result, tests that are expected to cause system degradation based on the difference in test results resulting from the revision of the system configuration information are presented as additional tests, thereby supporting safe revision of the system configuration information by executing appropriate tests. [Explanation of symbols]

[0122] 1... Construction information correction support system, 11... Input section, 12... Test selection section, 13... Memory section, 131... Executed test database, 132... Metrics verification result database, 14... Output section, 15... Test plan generation section, 16... System construction information correction section, 20... Test results, 21... Numerical metrics, 22... Event metrics, 23... Infrastructure

Claims

1. A system construction information modification support system for supporting modification of system construction information for setting infrastructure of a computer system, comprising: a storage unit that stores an executed test database in which data related to executed tests that are tests executed on the computer system is accumulated; an input unit for inputting a test target system obtained by applying the modified system configuration information to the computer system, a test environment corresponding to the test target system, and an initial test for confirming that the purpose of modifying the system configuration information has been achieved; a test selection unit that executes the initial test in the test environment, obtains a difference between the test result obtained thereby and the test result obtained when a test equivalent to the initial test is executed in the computer system, and extracts, from the executed tests based on the difference, a test that satisfies a predetermined test selection condition in which degradation from the computer system to the system under test occurs, as a first additional test; an output unit that outputs information representing the first additional test; A system construction information correction support system having the above.

2. The test selection unit further executes the first additional test in the test environment; The output unit further outputs information representing a test result of executing the first additional test in the test environment.

2. The system construction information correction support system according to claim 1.

3. If the initial test cannot be executed in the test environment, the test selection unit extracts, as related infrastructure, infrastructure related to the initial test from among the infrastructures to be modified in the system configuration information, and extracts, as second additional tests, tests related to the related infrastructure from among the executed tests.

2. The system construction information correction support system according to claim 1.

4. The test selection unit further executes the second additional test in the test environment; The output unit further outputs information representing a test result of executing the second additional test in the test environment.

4. The system construction information correction support system according to claim 3.

5. a test plan generation unit that, if a test that reproduces an event that occurred in the system under test is in the executed test database, extracts a test that reproduces the event from the executed test database, and, if a test that reproduces the event is not in the executed test database, creates a test that reproduces the event; 2. The system construction information correction support system according to claim 1.

6. a system configuration information correction unit that receives from a user whether the corrected system configuration information is acceptable based on the test results output by the output unit, and if the corrected system configuration information is not acceptable, receives from the user a request to correct the corrected system configuration information again.

3. The system construction information correction support system according to claim 2.

7. the storage unit stores a metrics verification result database, which is data associating executed initial tests, which are initial tests that have been executed on the computer system, with metrics, which are index values ​​acquired in the executed initial tests; The test selection unit Extracting from the metrics verification result database previously conducted initial tests that have a test purpose similar to that of the current initial test, Calculating the frequency of each of the extracted metrics in the performed initial test; selecting metrics whose frequency meets predetermined metric selection conditions; obtaining the difference for the selected metrics, and extracting the first additional test based on the difference; 2. The system construction information correction support system according to claim 1.

8. The system construction information is Infrastructure as Code, 2. The system construction information correction support system according to claim 1.

9. 1. A system configuration information modification support method for supporting modification of system configuration information for setting an infrastructure of a computer system by an information processing device including at least one processor and at least one memory, comprising: The memory stores an executed test database in which data relating to executed tests that are tests executed on the computer system is accumulated, the processor: inputting a test target system in which the modified system configuration information has been applied to the computer system, a test environment corresponding to the test target system, and an initial test for confirming that the purpose of modifying the system configuration information has been achieved; Execute the initial test in the test environment, obtain a difference between the test result obtained thereby and the test result obtained when a test equivalent to the initial test was executed in the computer system, and extract, from the executed tests based on the difference, a test that satisfies a predetermined test selection condition for degradation from the computer system to the system under test as a first additional test; outputting information representative of the first additional test; A method for supporting system construction information correction.

10. 1. A system construction information modification support program for supporting modification of system construction information for setting infrastructure of a computer system by an information processing device including at least one processor and at least one memory, comprising: The memory stores an executed test database in which data relating to executed tests that are tests executed on the computer system is accumulated, The system construction information revision support program causes the processor to: inputting a test target system in which the modified system configuration information has been applied to the computer system, a test environment corresponding to the test target system, and an initial test for confirming that the purpose of modifying the system configuration information has been achieved; Execute the initial test in the test environment, obtain a difference between the test result obtained thereby and the test result obtained when a test equivalent to the initial test was executed in the computer system, and extract, from the executed tests based on the difference, a test that satisfies a predetermined test selection condition for degradation from the computer system to the system under test as a first additional test; outputting information representative of the first additional test; This is a system construction information correction support program that allows you to do the following.

Images