System verification device, system verification method, and system verification program

Abstract

A system verification device 1 is provided with: a management unit 11 that, by using log data of a processing system constructed in a verification environment, manages a function status regarding an execution situation of a function of the processing system; a determination unit 12 that determines whether or not a value based on the function status satisfies a condition value for application to an actual performance environment; and a renewal unit 13 that, when the value based on the function status satisfies the condition value for application to the actual performance environment, switches the function of the processing system to the actual performance environment.

Description

[Technical field]

[0001] The present invention relates to a system verification device, a system verification method, and a system verification program. [Background technology]

[0002] When upgrading a system, the system is usually verified in a verification environment before being applied to a production environment. Non-Patent Document 1 discloses a technology for migrating a system from a test environment to a production environment. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] “20 Migrating from a Test Environment to a Production Environment”, Oracle, Oracle Fusion Middleware Administering Oracle Fusion Middleware, 12c (12.2.1.1), E77326-02, [online], [retrieved April 8, 2021], Internet<URL : https: / / docs.oracle.com / cd / E80149_01 / lcm / ASADM / testprod.htm> Summary of the Invention [Problem to be solved by the invention]

[0004] However, the required technology and human and material resources differ between the validation and production environments, and in many cases the organizations in charge of the validation and production environments are also different. In such cases, the process of upgrading from the validation environment to the production environment requires coordination and operation for the transfer of the development system between the different organizations, and it is expected that the operation and time will be longer than the pure amount of work. In particular, when an agile development method or a similar method is adopted, cumulative operation will occur each time the upgrade cycle is repeated. Therefore, a mechanism is needed that allows the production environment to be upgraded in a timely manner with the developed and modified system.

[0005] The present invention has been made in consideration of the above circumstances, and an object of the present invention is to provide a technique that enables easy updating of a system in a production environment. [Means for solving the problem]

[0006] A system verification device of one embodiment of the present invention includes a management unit that uses log data of a processing system constructed in a verification environment to manage function statuses related to the execution status of functions of the processing system, a determination unit that determines whether a value based on the function status satisfies a condition value for application to a production environment, and a renewal unit that switches the functions of the processing system to the production environment if the value based on the function status satisfies the condition value for application to the production environment.

[0007] A system verification device of one embodiment of the present invention includes a management unit that uses log data of a processing system constructed in a production environment to manage function statuses related to the execution status of functions of the processing system, a determination unit that determines whether a value based on the function status satisfies a non-continuous use condition value in the production environment, and a renewal unit that reverts the function of the processing system to an older version of the function if the value based on the function status satisfies the non-continuous use condition value in the production environment.

[0008] A system verification method of one embodiment of the present invention includes a step in which a system verification device uses log data of a processing system constructed in a verification environment to manage function statuses related to the execution status of functions of the processing system, a step in which a value based on the function status satisfies a condition value for application to a production environment, and a step in which, if the value based on the function status satisfies the condition value for application to the production environment, the function of the processing system is switched to the production environment.

[0009] A system verification method of one embodiment of the present invention includes the steps of: a system verification device managing function status related to the execution status of functions of a processing system constructed in a production environment using log data of the processing system; determining whether a value based on the function status satisfies a non-continuous use condition value in the production environment; and, if the value based on the function status satisfies the non-continuous use condition value in the production environment, reverting the function of the processing system to an older version of the function.

[0010] A system verification program according to one aspect of the present invention causes a computer to function as the system verification device. Effect of the Invention

[0011] According to the present invention, a technique is provided that enables easy updating of a system in a production environment. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is an overall view. [Diagram 2] FIG. 2 is a diagram showing an example of a functional block configuration of the system verification device 1. As shown in FIG. [Diagram 3] FIG. 3 is a diagram illustrating a first operational example of the system verification device 1. As shown in FIG. [Figure 4] FIG. 4 is a diagram showing a processing image of the first operation example. [Diagram 5] FIG. 5 is a diagram showing an example of a notification in the first operation example. [Figure 6] FIG. 6 is a diagram illustrating a second operational example of the system verification device 1. In FIG. [Figure 7] FIG. 7 is a diagram showing a processing image of the second operation example. [Figure 8] FIG. 8 is a diagram showing an example of a notification in the second operation example. [Figure 9] FIG. 9 illustrates an example of management of the function status. [Figure 10] FIG. 10 is a diagram illustrating an example of a hardware configuration of the system verification device 1. As shown in FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the description of the drawings, the same parts are given the same reference numerals and the description will be omitted.

[0014] [Summary of the Invention] The present invention discloses a system verification device that accumulates and manages the processing contents of a system and the results of execution in a verification environment (such as the impact on other devices and the normal execution rate), and performs pre-defined processing when the results meet pre-defined conditions (such as the conditions that the development organization considers the verification to be OK). For example, by registering a process for updating the system by applying it to a production environment (Patent No. 5052472, etc.) as the pre-defined processing, the system can be automatically updated when the conditions are met.

[0015] The present invention also discloses a system verification device that accumulates and manages the results (normal execution rate, processing time, etc.) of a system executed in a production environment, and performs a predetermined operation when the results meet a predefined condition (such as a condition that the development organization does not allow continued use). For example, by registering a system recovery process as the predefined operation, the system can be automatically restored when the condition is met.

[0016] By using the above system verification device, operators can easily check the quality of the system and automatically apply it to the production environment. In addition, the system can be automatically restored if there is an abnormality in the quality. This eliminates the need for coordination between the development and operation organizations every time a system is updated, and is expected to reduce the workload of verification and operation.

[0017] [whole] The system verification device according to this embodiment has a function for managing the status of each function in the verification environment of a processing system having one or more functions developed and modified by a developer, and a function for managing the status of each function in the production environment of the system. The status of each function is the normal execution rate of each function, etc.

[0018] As shown in FIG. 1, users of the system verification device 1 (developers in the development organization, verifiers in the verification organization, operators in the operation organization, etc.) run the system appropriately in the verification environment. For example, operations for familiarizing themselves with the system are assumed. At this time, a log file is generated in the system in the verification environment as a history of function execution of the system. The system verification device 1 calculates and manages the success rate of each function of the system based on the log file and code file of the system. Then, when the success rate of each function satisfies a predetermined conditional expression (when sufficient quality is guaranteed), the system verification device 1 applies and updates the function that satisfies the conditional expression to the production environment by executing a predefined process.

[0019] Also, as shown in FIG. 1, a user of the system verification device 1 executes the system appropriately in a production environment. For example, normal operation of the system is assumed. At this time, a log file is generated in the system in the production environment as a history of function execution of the system. The system verification device 1 calculates and manages the normal execution rate and processing time of each function in the production environment based on the log file and code file of the system. Then, when the normal execution rate and processing time of each function satisfy a predetermined conditional expression (when abnormal deterioration of quality is observed), the system verification device 1 executes a predefined process to recover the function that satisfies the conditional expression.

[0020] [System verification device configuration example] 2 is a diagram showing an example of the functional block configuration of the system verification device 1 according to this embodiment. The system verification device 1 includes a system status management unit 10. The system status management unit 10 has a function of managing the status of each function of a processing system in a verification environment developed and modified by a developer. The system status management unit 10 also has a function of managing the status of each function of a processing system in a production environment where a service is actually being operated.

[0021] In order to manage the status of each function of the system, the system status management unit 10 includes, for example, a management unit 11, a determination unit 12, a renewal unit 13, a message definition file DB 14, a function status DB 15, and a conditional expression DB 16. The names of these function units may be expressed as a processing unit, an execution unit, a control unit, a processing execution unit, a storage unit, etc. Multiple function units may be consolidated into one function unit, or one function unit may be divided into multiple function units.

[0022] The management unit 11 has a function of managing a function status related to the execution status of the functions of the system built in the verification environment, using a log file and a code file of the system. The management unit 11 also has a function of managing a function status related to the execution status of the functions of the system, using a log file and a code file of the system built in the production environment.

[0023] The determination unit 12 has a function of determining whether or not a value based on the function status satisfies an application condition value for the production environment. The determination unit 12 also has a function of determining whether or not a value based on the function status satisfies a non-continuous use condition value in the production environment.

[0024] The updating unit 13 has a function of switching the system functions to the production environment by executing a predefined process when the value based on the function status satisfies the application condition value for the production environment. Also, the updating unit 13 has a function of returning (restoring) the system functions to the functions of the old version by executing a predefined process when the value based on the function status satisfies the discontinuous use condition value in the production environment.

[0025] The message definition file DB 14 has a function of storing a message definition file in which key information for retrieving a predetermined message or the like from a log file or a code file is defined.

[0026] The function status DB 15 has a function of storing function statuses relating to the execution status of functions of the system.

[0027] The condition formula DB 16 has a function of storing application condition values ​​for the production environment and non-continuous use condition values ​​in the production environment.

[0028] [Example of system verification device operation] [Example 1] 3 is a diagram showing an operation example 1 of the system verification device 1. It is assumed that the user of the system verification device 1 is appropriately executing the system in the verification environment. For example, operations for familiarizing the user with the system are assumed.

[0029] Step S101; First, the operator of the system verification device 1 creates and determines application conditions (application condition values ​​for the production environment) that will be application standards for the production environment in advance. Then, the system verification device 1 registers the determined application conditions in the condition expression DB 16 as a condition expression list.

[0030] For example, as shown in FIG. 4, the operator of the system verification device 1 registers the degree of impact on the production environment, which is automatically calculated by scanning the code of the function, and the successful execution rate of the function, which is calculated from the execution result of the function, as a conditional expression list.

[0031] The impact level is set to "low" if the function code is read-only, such as HTTP GET only. On the other hand, if the function code includes write operations such as "register," "delete," and "update," such as HTTP POST, the impact level is set to "high." The successful execution rate is set to a value according to the impact level. For example, if the impact level is "low," the impact level is set to "90% or more." If the impact level is "high," the impact level is set to "95% or more."

[0032] Step S102; Next, the system verification device 1 judges whether or not a function of the system in the verification environment has been executed. For example, the system verification device 1 refers to a log file generated by the system, and judges that the function has been executed if a log indicating the execution of the function has been newly added to the log file. If the function has been executed, the system verification device 1 proceeds to step S103, and if the function has not been executed, the system verification device 1 repeats step S102 until the function is executed.

[0033] Step S103; Each time a function of the system is executed in the verification environment, the system verification device 1 obtains, calculates, and updates values ​​corresponding to the application conditions in the conditional expression list.

[0034] For example, the management unit 11 of the system verification device 1 acquires a log file of the system in the verification environment and a code file of the executed function. Then, the management unit 11 acquires the target message defined in the message definition file from the log file and code file. After that, the management unit 11 updates the value corresponding to the application condition of the conditional expression list based on the target message. For example, when function A is executed, the number of executions and the number of successful executions included in the function status of function A are updated as shown in FIG. 4.

[0035] In this way, each time each function of the system is executed in the verification environment, the management unit 11 updates the function status of each executed function, and accumulates and manages each updated function status in the function status DB 15.

[0036] Step S104; Every time the function status is updated, the system verification device 1 checks whether the updated function status satisfies the application conditions in the conditional expression list.

[0037] For example, the judgment unit 12 of the system verification device 1 calculates the current normal execution rate [%] of function A by dividing the normal execution count included in the updated function status of function A by the execution count. Then, as shown in Fig. 4, the judgment unit 12 compares the current normal execution rate EX1 of function A with the normal execution rate EX2 of function A registered in the conditional expression list.

[0038] Then, if the normal execution rate EX1 is equal to or greater than the normal execution rate EX2, the determination unit 12 determines that the function A satisfies the application condition serving as the criterion for application to the production environment, and proceeds to step S104. On the other hand, if the normal execution rate EX1 is less than the normal execution rate EX2, the determination unit 12 determines that the function A does not satisfy the application condition serving as the criterion for application to the production environment, and returns to step S102.

[0039] Step S105; If the adaptation conditions are met, the system verification device 1 introduces the system into the operational environment.

[0040] For example, if the current normal execution rate EX1 of function A is equal to or higher than the normal execution rate EX2 of function A registered in the conditional expression list, the updating unit 13 of the system verification device 1 applies / updates the function that satisfies the application conditions to the production environment by executing a predefined process such as a process for switching the setting information of the program disclosed in Patent No. 5052472.

[0041] For example, the verification environment is constructed on a LAN environment common to the production environment, and the updating unit 13 applies and updates the functions that satisfy the application conditions to the production environment by rewriting the address settings of the system to the address settings of the production environment.

[0042] In addition, the update unit 13 may display a switching confirmation message as shown in FIG. 5 on the display of the system verification device 1 to notify the user of the switching to the production environment, and perform the application to the production environment only if the user selects OK.

[0043] [Example 2] 6 is a diagram showing a second operation example of the system verification device 1. It is assumed that a user of the system verification device 1 is appropriately executing the system in a production environment. For example, normal operation of the system is assumed.

[0044] Step S201; First, the operator of the system verification device 1 creates and determines in advance the application conditions (discontinued use condition values ​​in the production environment) that will be the application criteria for functional recovery in the production environment. Then, the system verification device 1 registers the determined application conditions in the conditional expression DB 16 as a conditional expression list.

[0045] For example, as shown in FIG. 7, the operator of the system verification device 1 registers, as a conditional expression list, a processing time deviation value or the like that indicates how much the latest processing time of a function exceeds the average processing time up to now.

[0046] Step S202; Next, the system verification device 1 judges whether or not a function of the system in the production environment has been executed. For example, the system verification device 1 refers to a log file generated by the system, and judges that the function has been executed if a log indicating the execution of the function has been newly added to the log file. If the function has been executed, the system verification device 1 proceeds to step S203, and if the function has not been executed, the system verification device 1 repeats step S202 until the function is executed.

[0047] Step S203; Each time a function of the system is executed in the production environment, the system verification device 1 acquires, calculates, and updates values ​​corresponding to the application conditions in the conditional expression list.

[0048] For example, the management unit 11 of the system verification device 1 acquires a log file of the system and a code file of the executed function from the system in the production environment. Then, the management unit 11 acquires the target message defined in the message definition file from the log file and code file. After that, the management unit 11 updates the value corresponding to the application condition of the conditional expression list based on the target message. For example, when function A is executed, the average processing time and the latest processing time included in the function status of function A are updated as shown in FIG. 7.

[0049] In this way, each time each function of the system is executed in the production environment, the management unit 11 updates the function status of each executed function, and accumulates and manages each updated function status in the function status DB 15.

[0050] Step S204; Every time the function status is updated, the system verification device 1 checks whether the updated function status satisfies the application conditions in the conditional expression list.

[0051] For example, the determination unit 12 of the system verification device 1 calculates the deviation value [%] of the processing time of function A at the current time by dividing the latest processing time included in the updated function status of function A by the average processing time. Then, as shown in Fig. 7, the determination unit 12 compares the deviation value DI1 of the processing time of function A at the current time with the deviation value DI2 of the processing time of function A registered in the conditional expression list.

[0052] Then, if the processing time deviation value DI1 is equal to or greater than the processing time deviation value DI2, the determination unit 12 determines that function A meets the application condition serving as the application criterion for function recovery of the production environment, and proceeds to step S204. On the other hand, if the processing time deviation value DI1 is less than the processing time deviation value DI2, the determination unit 12 determines that function A does not meet the application condition serving as the application criterion for function recovery of the production environment, and returns to step S202.

[0053] Step S205; If the adaptation conditions are met, the system verification device 1 introduces the system into the operational environment.

[0054] For example, if the deviation value DI1 of the processing time of function A at the current time is equal to or greater than the deviation value DI2 of the processing time of function A registered in the conditional expression list, the update unit 13 of the system verification device 1 executes a predefined process to restore the function that satisfies the applicable conditions.

[0055] For example, the function of the old version is held, and the updating unit 13 inputs a command to switch the connection destination of the function to the function of the old version, thereby restoring the function that satisfies the application conditions.

[0056] In addition, the updating unit 13 may display a switching confirmation message as shown in FIG. 8 on the display of the system verification device 1 to notify the user of the switching of the production environment, and perform function recovery only if the user selects OK.

[0057] [How to manage your feature status] [How to get the message to be retrieved] The method of acquiring the target message from the log file or the code file in steps S103 and S203 will be described below.

[0058] The operator of the system verification device 1 predefines character strings to be included in execution messages, end messages, etc. in the log file or code file in order to determine whether the execution or end of execution of a function is included in the log file or code file. The system verification device 1 records the predefined character strings in a message definition file and registers the message definition file in the message definition file DB 14.

[0059] For example, the operator of the system verification device 1 records in the message definition file character strings such as "executed" as an execution message, a processing ID as linking information, "normal termination" or "abnormal termination" as an end message, "normal termination" as a normal termination message, and "post" as an impact assessment message, as shown in FIG.

[0060] When the management unit 11 of the system verification device 1 scans the log data in log files or the code data in code files within the system, it interprets them based on the character strings recorded in the message definition file, and depending on whether or not the character strings are included, it detects information necessary for managing the functional status in the log file or code file, such as "executed," "completed," or "normally completed."

[0061] For example, when a log file contains a character string identical to a character string recorded in a message definition file, the management unit 11 acquires the target message, such as the ID of the executed function, the result of the execution (successful or abnormal termination), the start time of execution, and the end time of execution, from the log information in the log file linked to the process ID contained before or after the string or before or after the string.

[0062] [How to update feature status] The method of updating the function status in steps S103 and S203 will be described.

[0063] As shown in FIG. 9, the function status includes, for example, the number of times the function was executed, the number of times it was executed normally, the most recent execution time, the impact level, the average processing time, the most recent processing time, and the accumulated processing time.

[0064] The number of executions and the number of successful executions are calculated for each unit of function execution, each unit of function update, or each unit of system update. Specifically, if the execution end time of a function included in a log file acquired by periodic execution is newer than the latest time stored in the function status of that function, 1 is added to the number of executions of that function status. Also, if the execution of that function ended normally, 1 is added to the number of successful executions.

[0065] For example, if a message "Function A was executed" is searched for in the log file, and the execution time of the function A has not been checked, it is added to the number of executions. Also, if the result code corresponding to the message is normal completion, it is added to the number of normal executions.

[0066] The latest execution time is the end time of the function execution included in the log file.

[0067] The impact is also calculated for each unit of function execution, each unit of function update, or each unit of system update. Specifically, the code file of the executed function is searched, and if it has registration, update, or deletion functions, it is rated "high", and if it does not, it is rated "low". For example, in the case of REST format, if the code file contains "POST", it is rated "high", and if it does not contain POST, it is rated "low". The impact of each function is updated when the execution time of the executed function is updated. Note that a code file is, for example, the source code of a function before compilation, or the source code included in the file of the function if the function can be executed without compilation.

[0068] The average processing time, latest processing time, and cumulative processing time are also calculated for each execution unit of the function, each update unit of the function, or each update unit of the system. Specifically, if the execution end time of a function included in a log file acquired by regular execution is newer than the latest time stored in the function status of the function, the execution end time and the execution start time associated with the execution end time are acquired, and the latest processing time is determined by subtracting the execution start time from the execution end time. The latest processing time is also added to the cumulative processing time in the function status to update the cumulative processing time. The average processing time is also determined by dividing the cumulative processing time by the number of executions.

[0069] [Variation: Another example of the method for calculating the normal execution rate] In step S104, the normal execution rate was calculated by dividing the normal execution count by the execution count. However, when the normal execution rate is calculated using this calculation method, if one execution is performed and one success occurs, the normal execution rate is 100%, which makes it easier to satisfy the conditional expression when the track record is insufficient. Therefore, the normal execution rate may be calculated using the normal execution count assuming that the next execution fails. In other words, the normal execution rate is calculated by subtracting a predetermined number from the normal execution count and dividing the value by the execution count. For example, after nine executions are performed and nine successes are achieved, the normal execution rate is set to 90% (=9÷10) by assuming that the tenth execution will fail even if it is successful. This makes it easier to eliminate cases where the track record is insufficient.

[0070] [effect] According to this embodiment, the system verification device 1 includes a management unit 11 that uses log data of a processing system constructed in a verification environment to manage a function status related to the execution status of functions of the processing system, a determination unit 12 that determines whether a value based on the function status satisfies a condition value for application to a production environment, and a renewal unit 13 that switches the functions of the processing system to the production environment when the value based on the function status satisfies the condition value for application to the production environment.

[0071] Furthermore, according to this embodiment, the system verification device 1 includes a management unit 11 that uses log data of a processing system constructed in a production environment to manage a function status related to the execution status of functions of the processing system, a determination unit 12 that determines whether a value based on the function status satisfies a non-continuous use condition value in the production environment, and a renewal unit 13 that reverts the function of the processing system to the function of an older version when the value based on the function status satisfies the non-continuous use condition value in the production environment.

[0072] By using the above system verification device, the operator can easily check the quality of the system and automatically apply it to the production environment. In other words, as long as the user (operator) of the system verification device performs the familiarization operation, the system verification device will automatically apply the system to the production environment.

[0073] Furthermore, by using the above-mentioned system verification device, it is possible to automatically restore the system in the production environment if an abnormality in quality is found.

[0074] In addition, by using the above system verification device, there is no longer a need for coordination between the development and operation organizations every time a system is updated, and this is expected to reduce the workload of verification and operation. In particular, in agile development, this can simplify collaboration between the development and operation organizations. Developers simply need to release the functional files of the system they have developed or modified, and then accumulate knowledge in the form of conditional expressions, eliminating the need for adjustments during updates.

[0075] [others] The present invention is not limited to the above-described embodiment, and various modifications are possible within the scope of the present invention.

[0076] The system verification device 1 of the present embodiment described above can be realized, for example, by using a general-purpose computer system including a CPU 901, a memory 902, a storage 903, a communication device 904, an input device 905, and an output device 906, as shown in Fig. 10. The memory 902 and the storage 903 are storage devices. In the computer system, the CPU 901 executes a predetermined program loaded on the memory 902, thereby realizing each function of the system verification device 1.

[0077] The system verification apparatus 1 may be implemented by one computer. The system verification apparatus 1 may be implemented by multiple computers. The system verification apparatus 1 may be a virtual machine implemented in a computer. The program for the system verification apparatus 1 may be stored in a computer-readable recording medium such as an HDD, SSD, USB memory, CD, or DVD. The program for the system verification apparatus 1 may also be distributed via a communication network. [Explanation of symbols]

[0078] 1: System verification device 10: System status management section 11: Management Department 12: Judgment section 13: Renewal Department 14: Message definition file DB 15: Function status DB 16: Conditional expression DB 901:CPU 902: Memory 903: Storage 904: Communication equipment 905: Input device 906: Output device

Claims

1. a management unit that manages a function status regarding the execution status of a function of a processing system built in a verification environment by using log data and code data of the processing system; a determination unit that determines whether a value based on the function status satisfies a condition value for application to a production environment; a updating unit that applies / updates a function of the processing system to a production environment when a value based on the function status satisfies a condition value for application to the production environment, The management unit The system verification device refers to a message definition file in which a character string is recorded, obtains data corresponding to the character string from the log data and the code data, and updates the function status using the obtained data.

2. a management unit that manages a function status related to the execution status of a function of a processing system constructed in a production environment by using log data and code data of the processing system; a determination unit that determines whether a value based on the function status satisfies a non-continuous use condition value in a production environment; a renewal unit that reverts a function of the processing system to a function of an older version when a value based on the function status satisfies a discontinuance use condition value in the production environment, The management unit The system verification device refers to a message definition file in which a character string is recorded, obtains data corresponding to the character string from the log data and the code data, and updates the function status using the obtained data.

3. The updating unit, 2 . The system verification device according to claim 1 , wherein when a normal execution rate of the function based on the function status satisfies the application condition value to the production environment, the function of the processing system is switched to the production environment.

4. The updating unit, 3. The system verification device according to claim 2, wherein when a deviation value between a latest processing time and an average processing time of a function based on the function status satisfies a non-continuous use condition value in the production environment, the function of the processing system is restored to an older version of the function.

5. The success rate of the function is 4. The system verification device according to claim 3, wherein the value is obtained by subtracting a predetermined number from the number of normal executions and dividing the result by the number of executions.

6. A system verification device managing a function status regarding the execution status of a function of the processing system using log data and code data of the processing system constructed in a verification environment; determining whether a value based on the function status satisfies a condition value for application to a production environment; applying / updating the function of the processing system to a production environment if the value based on the function status satisfies the application condition value to the production environment; In the managing step, A system verification method comprising: referencing a message definition file in which a character string is recorded; obtaining data corresponding to the character string from the log data and the code data; and updating the function status using the obtained data.

7. A system verification device managing a function status regarding the execution status of a function of a processing system constructed in a production environment by using log data and code data of the processing system; determining whether a value based on the feature status satisfies a non-continuous use condition value in a production environment; and if the value based on the function status satisfies the discontinuation use condition value in the production environment, reverting the function of the processing system to a previous version of the function; In the managing step, A system verification method comprising: referencing a message definition file in which a character string is recorded; obtaining data corresponding to the character string from the log data and the code data; and updating the function status using the obtained data.

8. 6. A system verification program that causes a computer to function as the system verification device according to claim 1.

Images