Change management method, device, medium, electronic equipment and program product

Abstract

A change management method, apparatus, medium, electronic device, and program product, relating to the field of computer technology, is disclosed. The method, in response to a release operation, executes a corresponding change operation on the change object indicated by the release operation. Then, in response to the completion of the change operation, it displays first quality inspection decision information for the change operation. This first quality inspection decision information is obtained based on change information associated with the change operation and diagnostic information associated with the first error log statement affected by the change operation. The first quality inspection decision information can be obtained by analyzing multi-dimensional change information and diagnostic information, thereby ensuring the accuracy of the quality inspection decision information and effectively reducing the invalid interference caused to users by the quality inspection decision information.

Description

Technical Field

[0001] The technical solution relates to the field of computer technology, specifically to a change management method, device, medium, electronic equipment, and program product. Background Technology

[0002] When making changes to an application, these changes introduce new code paths, parameter combinations, or resource topologies, potentially posing stability risks. Related technologies can assess whether the changes meet expectations by observing the metrics generated during the change process, thus enabling timely detection and interception of problems. However, using single-dimensional metrics for change quality inspection is inaccurate, frequently leading to misjudgments. Summary of the Invention

[0003] This summary section is provided to briefly introduce the concepts, which will be described in detail in the detailed description section below. This summary section is not intended to identify key or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0004] Firstly, a change management method is provided, including: In response to a release operation, a corresponding change operation is performed on the changed object, wherein the changed object and the change operation are indicated by the release operation. In response to the completion of the change operation, first quality inspection decision information is displayed; wherein, the first quality inspection decision information is obtained based on change information and diagnostic information, the change information is related to the change operation, and the diagnostic information is related to the first error log statement corresponding to the change operation.

[0005] Secondly, a change management device is provided, comprising: An execution module is used to perform corresponding change operations on a changed object in response to a release operation, wherein the changed object and the change operation are indicated by the release operation; The display module is used to display first quality inspection decision information in response to the completion of the change operation; wherein the first quality inspection decision information is obtained based on change information and diagnostic information, the change information is related to the change operation, and the diagnostic information is related to the first error log statement corresponding to the change operation.

[0006] Thirdly, a computer-readable medium is provided having a computer program stored thereon, wherein the computer program, when executed by a processing device, implements the steps of the method described in the first aspect.

[0007] Fourthly, an electronic device is provided, comprising: A storage device on which computer programs are stored; A processing device for executing the computer program in the storage device to implement the steps of the method described in the first aspect.

[0008] Fifthly, a computer program product is provided, comprising a computer program, wherein the computer program, when executed by a processor, implements the steps of the method described in the first aspect.

[0009] Based on the above technical solution, in response to the release operation, the corresponding change operation is executed on the object to be changed as indicated by the release operation. Then, in response to the completion of the change operation, the first quality inspection decision information for the change operation is displayed. The first quality inspection decision information is obtained based on the change information associated with the change operation and the diagnostic information associated with the first error log statement affected by the change operation. The first quality inspection decision information can be obtained by analyzing multi-dimensional change information and diagnostic information, thereby ensuring the accuracy of the quality inspection decision information and effectively reducing the invalid interference caused by the quality inspection decision information to users.

[0010] Other features and advantages of the technical solution will be described in detail in the following detailed implementation section. Attached Figure Description

[0011] The above and other features, advantages, and aspects of the technical solution will become more apparent when taken in conjunction with the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale. In the drawings: Figure 1 This is a schematic diagram illustrating application scenarios of change management methods based on certain situations.

[0012] Figure 2 This is a flowchart illustrating change management methods based on certain scenarios.

[0013] Figure 3 This is a flowchart illustrating the process of obtaining initial quality inspection decision information based on certain scenarios.

[0014] Figure 4 This is a schematic diagram illustrating how a first intelligent agent obtains first quality inspection decision information based on certain scenarios.

[0015] Figure 5 This is a flowchart illustrating how to determine the first error log statement based on certain conditions.

[0016] Figure 6 This is a logical diagram of a second intelligent agent shown under certain circumstances.

[0017] Figure 7This is a logical diagram of the change management system shown under certain circumstances.

[0018] Figure 8 This is a schematic diagram of the change management device shown under certain circumstances.

[0019] Figure 9 This is a schematic diagram of the structure of an electronic device shown under certain circumstances. Detailed Implementation

[0020] The technical solution will now be described in more detail with reference to the accompanying drawings. Although certain scenarios are shown in the drawings, it should be understood that the technical solution can be implemented in various forms and should not be construed as limited to the scenarios described herein. Rather, these scenarios are provided to provide a more thorough and complete understanding of the technical solution. It should be understood that the accompanying drawings and the scenarios described are for illustrative purposes only and are not intended to limit the scope of protection of the technical solution.

[0021] It should be understood that the steps described in the method implementation may be performed in different orders and / or in parallel. Furthermore, the method implementation may include additional steps and / or omit the steps shown. The scope of the technical solution is not limited in this respect.

[0022] The term "comprising" and its variations as used herein can be open-ended, meaning "including but not limited to". The term "based on" can mean "at least partially based on". The term "one case" means "at least one case"; the term "another case" means "at least one additional case"; the term "some cases" means "at least some cases". Definitions of other terms will be given in the following description.

[0023] It should be noted that the concepts of "first" and "second" mentioned here are only used to distinguish different devices, modules or units, and are not used to limit the order of the functions performed by these devices, modules or units or their interdependencies.

[0024] It should be noted that the terms "one" and "more" used here are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0025] The names of the messages or information exchanged between the multiple devices in the implementation are for illustrative purposes only and are not intended to limit the scope of these messages or information.

[0026] In some cases, the change management methods provided herein can be performed via electronic devices, which can be at least one of terminal devices and servers. Figure 1These are schematic diagrams illustrating application scenarios of change management methods based on various situations. For example... Figure 1 As shown, the application scenario may include terminal device 101, operation and maintenance platform 102, and application server 103. Terminal device 101 and operation and maintenance platform 102 can communicate and connect via wired or wireless network. Similarly, operation and maintenance platform 102 and application server 103 can communicate and connect via wired or wireless network. It should be understood that operation and maintenance platform 102 can be a server.

[0027] The operation and maintenance platform 102 is responsible for processing user requests from the terminal device 101, managing change processes (such as change requests, approval processes, and scheduling execution), and integrating with other systems to achieve automated operations. For example, the operation and maintenance platform 102 may include a user interface for submitting change requests and viewing status updates, a workflow engine for defining and executing the various steps in the change process, a database for storing all change-related data, and integration interfaces for interacting with third-party systems and services. The user interface of the operation and maintenance platform 102 can be displayed on the terminal device 101. Users can submit change requests, view change status, view quality inspection results, and receive alarm information through the user interface displayed on the terminal device 101. The application server 103 is responsible for the actual running application, supports the application's runtime environment, and can respond to instructions from the operation and maintenance platform 102 to execute corresponding change operations.

[0028] In some cases, a user interface can be displayed on terminal device 101, allowing users to trigger a release operation for publishing change tasks. In response to the release operation, the operations and maintenance platform 102 executes the change task, performing change operations on the indicated change objects in application server 103. When the change operation on the change objects is completed, first quality inspection decision information for the change operation can be displayed on terminal device 101. The operations and maintenance platform 102 can obtain the first quality inspection decision information based on the change information and diagnostic information associated with the change operation.

[0029] Figure 2 This is a flowchart illustrating change management methods based on certain scenarios. For example... Figure 2 As shown, a change management method is provided, which can be executed through a change management device, which can be implemented by software and / or hardware. For example... Figure 2 As shown, the method may include the following steps.

[0030] In step 210, in response to the release operation, the corresponding change operation is performed on the changed object, and the changed object and change operation are indicated by the release operation.

[0031] Here, "change" can refer to modifications made to an already running application system, service, configuration, infrastructure, or dependent components, which may affect the system's behavior, performance, availability, or security. A release operation can be triggered by a user or by a timed event from an end device; this operation instructs the execution of a change operation on the changed object. A release operation can be used to specify the corresponding changed object and the change operation performed on that object.

[0032] In this context, a changed object refers to a specific entity or component that is modified, replaced, added, or deleted during the change management process. For example, a changed object can refer to an application system, service, configuration, infrastructure, and dependent components. Specifically, an application system can include application code, application logic, and application architecture; a service can include service instances, structures, and endpoints; a configuration can include parameters, switches, and policies; infrastructure can include servers, networks, storage, and cloud resources; and dependent components can include libraries, middleware, and databases.

[0033] Performing corresponding change operations on the object to be changed in the release operation instruction can be actions such as upgrading, restarting, modifying parameters, deploying a new version, pushing configurations, releasing applications, scaling up or down applications, etc., to change the object to be changed in the instruction.

[0034] For example, a user can create a change task to perform a specified change operation on a specified object. By triggering a publish operation to initiate the change task, the corresponding change operation is executed on the object indicated by the publish operation.

[0035] It should be understood that the objects of the published operation instructions can be at least a portion of the services that need to be changed. For example, if a service has 10 clusters, the first change might target one cluster. After the change operation is completed on that cluster, a quality check is performed. If a problem is found, the user can intercept the change and be prompted to investigate. If no problem is found, the change can continue to the other three clusters, until all ten clusters have been changed. In other words, the technical solution can use incremental changes, where each change targets a portion of the services that need to be changed.

[0036] In step 220, in response to the completion of the change operation, the first quality inspection decision information is displayed; wherein, the first quality inspection decision information is obtained based on the change information and the diagnostic information, the change information is related to the change operation, and the diagnostic information is related to the first error log statement corresponding to the change operation.

[0037] Here, "completion of change operation" can refer to the completion of changes to the object being changed. For example, when performing a configuration push change operation on the object being changed, "completion of change operation" can be understood as the configuration being pushed to the object being changed. Upon completion of the change operation, the first quality control decision information for the change operation can be displayed.

[0038] The first quality inspection decision information can include the decision conclusion regarding the change operation. For example, the decision conclusion can include one of the following: continue the change, delay observation, intercept, or rollback. Continuing the change indicates that the fluctuation in metric data is not caused by the current change operation, or the degree of fluctuation and impact are within the acceptable range for the business, the change operation is as expected, and the next stage of change can proceed. Delaying observation indicates that the quality inspection time is short, and based on historical similar changes, it may be a short-term fluctuation in metric data caused by the change deployment, requiring a delayed observation period. Intercepting indicates that based on existing information, it is judged that the change operation may have an unexpected impact on the business, but it cannot be determined whether it meets the user's change expectations, requiring user intervention or the provision of more information. Rollback indicates that the fluctuation in metric data is an unexpected abnormal fluctuation introduced by the change, requiring a rollback of the changed object.

[0039] Different types of decision conclusions can be displayed in different ways. For example, for the decision to continue the change, the text message "Continue the change" can be displayed. For the decision to delay observation, the text message "It is recommended to continue the change for N minutes and observe whether the fluctuation of the indicator data returns to the normal level" can be displayed. For the decision to block, a list of anomalies that need to be excluded can be displayed to instruct the user to complete the anomaly confirmation and attribution process. For the decision to roll back, the change code associated with the anomaly and the remediation plan can be displayed.

[0040] It should be understood that if the quality inspection passes or there are no abnormalities, the corresponding first quality inspection decision information may include the decision conclusion of continuing to change. If the quality inspection fails or there are abnormalities, the corresponding first quality inspection decision information may include the decision conclusion of delaying observation, interception, or rollback.

[0041] The first quality control decision information can be understood as the conclusive inspection result used to characterize the change operation. After the change operation is completed, a quality check is run, and the resulting first quality control decision information is displayed to guide the user in executing the next stage of the change. For example, if the first quality control decision information includes the decision conclusion of "continue the change," then based on this decision conclusion, the user can proceed with the next stage of the change.

[0042] The first quality control decision information can be obtained based on change information and diagnostic information associated with the change operation. The change information associated with the change operation can include contextual information related to the change operation. For example, the change information can include technical documents related to the change operation, product requirement documents (PRDs) related to the change operation, and code diff comparisons.

[0043] Diagnostic information can include diagnostic information associated with the first error logging statement affected by the change operation. An error logging statement refers to a line of code used to print error logs; when an error occurs during code execution, the corresponding error logging statement is called to print the error. Each error logging statement in the code can correspond to a unique identifier, which can be represented as an error logging template. Error logging templates can be represented using a filename and line number format. For example, an error logging template like "eg"main.go:60" indicates that the error logging statement corresponding to this template is located on line 60 of the code file named "eg"main.go".

[0044] The diagnostic information associated with the first error log statement can be the diagnostic information corresponding to the error log statements in the changed object affected by the change operation. For example, assuming the changed object includes 100 error log statements, and the change operation affects 5 of them, then these 5 error log statements are the first error log statements affected by the change operation. Of course, in other cases, the first error log statement can also refer to the abnormal error log statements among the error log statements affected by the change operation. For example, if the change operation affects 5 error log statements, and 3 of these 5 error log statements are abnormal, then these 3 error log statements are the first error log statements.

[0045] For example, the diagnostic information associated with the first error log statement may include, but is not limited to, the summary information of the first error log statement, the code context information of the first error log statement, and the error log instance output by the first error log statement. The summary information of the first error log statement describes a general overview of the error log output by the first error log statement. For example, the summary information could be: "The error log template corresponding to the first error log statement appeared 21 times within 4 minutes after the change operation, accounting for 4.34% of all error logs." The code context information of the first error log statement may include the code statement of the first error log statement and the code segment within the preset range of the first error log statement. The error log instance output by the first error log statement may include the log content of the error log containing variable values ​​actually output by the first error log statement.

[0046] In some cases, change information and diagnostic information can be input into the agent, and the agent will output the corresponding first quality inspection decision information. The agent can be implemented based on a large language model, and the technical solution does not specifically limit the type of the large language model. Moreover, the reasoning logic of the agent is not specifically limited; the agent can use arbitrary reasoning logic.

[0047] It should be understood that through change information, the agent can understand the context of the change operation; through diagnostic information, the agent can understand the detailed information of the affected first error log statement, thereby analyzing the diagnosis of the first error log statement. By utilizing change and diagnostic information, multi-dimensional information can be provided to the agent for decision-making, making the agent's output of the first quality inspection decision more accurate.

[0048] Therefore, by responding to the release operation, the corresponding change operation is executed on the object to be changed as indicated by the release operation. Then, in response to the completion of the change operation, the first quality inspection decision information for the change operation is displayed. The first quality inspection decision information is obtained based on the change information associated with the change operation and the diagnostic information associated with the first error log statement affected by the change operation. The first quality inspection decision information can be obtained by analyzing multi-dimensional change information and diagnostic information, thereby ensuring the accuracy of the quality inspection decision information and effectively reducing the invalid interference caused by the quality inspection decision information to users.

[0049] In some cases, a toolkit can be provided, which may include multiple tools. These tools can refer to external capabilities or functions that the agent can invoke during the inference process. By providing these tools, the limitations of large language models in directly acting or obtaining real-time information can be compensated for.

[0050] For example, the tool library may include a first tool for obtaining product requirement documents, a second tool for obtaining technical documents, a third tool for obtaining information such as the purpose and scope of registered changes, a fourth tool for obtaining metadata (including name, deployment scale, service level, etc.) of the changed object, a fifth tool for obtaining code difference comparison information corresponding to the change operation, a sixth tool for obtaining the code content of a specified file from the code library based on the file path, a seventh tool for locating the file path in the code library based on the error log template, an eighth tool for finding the external service interface associated with the call chain where the specified code location is located, a ninth tool for querying business knowledge from the business knowledge base, a tenth tool for querying historical experience of similar change operations from the experience knowledge base, and an eleventh tool for obtaining indicator data of error log statements.

[0051] When the agent obtains the first quality inspection decision information, it can use different tools in the tool library to obtain change information and diagnostic information, and generate the first quality inspection decision information based on the change information and diagnostic information obtained by calling the tools.

[0052] Figure 3 This is a flowchart illustrating the process of obtaining initial quality control decision information, based on various scenarios. For example... Figure 3 As shown, in some cases, the first quality inspection decision information can be obtained through the following steps.

[0053] In step 310, diagnostic information is obtained.

[0054] Here, having obtained the first quality inspection decision information through the first intelligent agent, the first intelligent agent can invoke tools from the tool library to obtain diagnostic information. The diagnostic information is associated with the first error log statement, and may include a summary of the first error log statement, the code context information of the first error log statement, and the error log instance output by the first error log statement. Accordingly, the first intelligent agent can obtain the summary information, code context information, and error log instance by invoking tools from the tool library.

[0055] In step 320, the first intelligent agent analyzes the diagnostic information to obtain the error semantic information corresponding to the diagnostic information.

[0056] Here, after the first intelligent agent obtains diagnostic information by calling the tool, it can analyze the obtained diagnostic information to obtain the corresponding error semantic information. This error semantic information describes the meaning, type, and business impact of the error log output by the first error log statement. The first intelligent agent can use a large language model to analyze and obtain the corresponding error semantic information based on the obtained diagnostic information.

[0057] For example, the meaning information could be "Application A failed to call the RPC (Remote Procedure Call) interface of service B when retrieving information C, specifically due to an RPC communication exception." The type information could be "RPC call failed (remote service communication exception)." The business impact could be "The system will continue to process the request according to the default state, but the processing result will be downgraded due to the inability to obtain information C, resulting in a decrease in accuracy."

[0058] In step 330, the associated code is determined based on the change information.

[0059] Here, the associated code includes the code within the modified object that causes the first error logging statement to print an error log. Specifically, the associated code can refer to the code within the modified object that triggers the first error logging statement to print a log after the change operation has been performed.

[0060] For example, change information is associated with change operations. Change information may include code difference comparison information corresponding to this change. The corresponding associated code can be determined through code difference comparison information.

[0061] For example, semantic similarity matching or logical reasoning based on a large model can be used to locate the associated code that caused the first error log statement to be abnormal in the code difference comparison information.

[0062] It should be understood that the associated code can be determined by the first intelligent agent based on the change information associated with the change operation. For example, the change information is input into the first intelligent agent, and the associated code output by the first intelligent agent is obtained.

[0063] In step 340, the first quality inspection decision information is obtained based on the error semantic information, the associated code, and the change intent information.

[0064] Here, the change intent information is related to the change operation. For example, the change intent information can include the change purpose, change background, and change method corresponding to the change operation. For instance, the change background describes the problem, scenario, or requirement driving this change operation. The change purpose describes the expected goal and effect of this change operation. The change method describes the modifications made at the code level in this change operation.

[0065] For example, change intent information can be obtained through change information. In some cases, change information related to the change operation can be obtained, and the change intent information can be obtained by analyzing the change information through a second intelligent agent.

[0066] It should be understood that the second agent can obtain change information by invoking tools in the tool library. By analyzing and processing the change information, the second agent can construct an initial, structured set of context information associated with the change operation. The second agent can then use a built-in sub-agent to reason based on the change information and generate corresponding change intent information. This change intent information can refer to a structured description of the change operation, describing the change's purpose, background, and method.

[0067] The first intelligent agent can obtain the first quality inspection decision information based on error semantic information, associated codes, and change intent information corresponding to the change operation. The first intelligent agent obtains diagnostic information by calling tools, analyzes the obtained diagnostic information, and obtains the corresponding error semantic information. Alternatively, the first intelligent agent can obtain change information by calling tools, analyzes the change information, and obtains the corresponding associated codes. After obtaining the associated codes and error semantic information, the first intelligent agent combines them with the change intent information generated by the second intelligent agent to perform logical reasoning and obtain the first quality inspection decision information.

[0068] Specifically, if the first agent determines that the error log count is within the expected range or has no substantial impact, the corresponding first quality inspection decision can be to continue the change. If the first agent cannot definitively determine whether the change operation is abnormal based on the current information, the corresponding first quality inspection decision can be to extend the observation period. If the first agent determines that there is an unexpected impact but user intervention is required for confirmation, the corresponding first quality inspection decision can be to block the change. If the first agent determines that the fluctuation in the indicator data is an unexpected anomaly introduced by the change operation, the corresponding first quality inspection decision can be to roll back the change.

[0069] Therefore, through steps 310 to 340 above, the first intelligent agent can obtain the first quality inspection decision information corresponding to the change operation through multi-dimensional information analysis, thereby ensuring the accuracy of the first quality inspection decision information.

[0070] In other cases, first knowledge can be obtained from the knowledge base based on the log type, and first quality inspection decision information can be obtained based on error semantic information, associated code, change intent information and first knowledge.

[0071] Here, the knowledge base can include a business knowledge base and an experience knowledge base. The business knowledge base is used to store business knowledge corresponding to different businesses, which describes the functions and normal status of the business. The experience knowledge base is used to store solutions corresponding to different historical change operations.

[0072] The log type belongs to the log type corresponding to the first error log statement, and the first knowledge matches the log type. The first knowledge can include business knowledge and / or experiential knowledge obtained from the knowledge base. Business knowledge and / or experiential knowledge matching the log type can be retrieved from the business knowledge base and experiential knowledge base using the log type corresponding to the first error log statement. The log type refers to the type of error log output by the first error log statement; different error log statements are used to output different types of error logs.

[0073] Continuing with the example above, the first agent can invoke tools from the tool library to retrieve first knowledge from the knowledge base based on the log type corresponding to the first error log statement. The first agent determines first quality inspection decision information based on error semantic information, associated codes, change intent information, and first knowledge. The first agent outputs first quality inspection decision information by performing logical reasoning on the error semantic information, associated codes, change intent information, and first knowledge. For example, if the first agent cannot definitively determine whether the change operation is abnormal based on the current information, but the first knowledge indicates that the abnormality may be a temporary fluctuation, then the corresponding first quality inspection decision information could be to extend the observation period.

[0074] Therefore, the first quality inspection decision information can be obtained by combining the first knowledge obtained from the knowledge base, which can ensure that the first quality inspection decision information is more accurate.

[0075] Figure 4 This is a schematic diagram illustrating how a first intelligent agent obtains first quality inspection decision information, based on certain scenarios. For example... Figure 4 As shown, the first intelligent agent can obtain the required information by calling tools in the tool library. For example, it can obtain the required information from the information repository by calling tools in the tool library, and it can also obtain the required information from the knowledge base by calling tools in the tool library. The information repository can be used to store the obtained information related to the change operation. For example, the change information obtained by the second intelligent agent can be updated to the information repository, constituting the context information of the change operation. The knowledge base can include a business knowledge base and an experience knowledge base; the first intelligent agent can obtain business knowledge from the business knowledge base and experience knowledge from the experience knowledge base as needed.

[0076] In some cases, a first intelligent agent can analyze diagnostic information based on pre-configured business rules. Then, in response to a mismatch between the diagnostic information and the filtering conditions included in the business rules, the first intelligent agent analyzes the diagnostic information to obtain the error semantic information corresponding to the diagnostic information. In response to a match between the diagnostic information and the filtering conditions included in the business rules, the first quality inspection decision information is obtained based on the second quality inspection decision information associated with the business rules.

[0077] Here, business rules can be pre-configured by the user and may include analysis strategies and corresponding filtering conditions. Secondary quality inspection decision information is associated with business rules; for example, different business rules can be associated with different secondary quality inspection decision information. These business rules can be configured through the skills of the primary agent.

[0078] Before the first intelligent agent analyzes the diagnostic information to obtain the corresponding error semantic information, it can analyze the diagnostic information based on the analysis strategy included in the business rules. If the diagnostic information does not match the filtering conditions included in the business rules, the first intelligent agent is triggered to analyze the diagnostic information to obtain the corresponding error semantic information. If the diagnostic information matches the filtering conditions included in the business rules, the second quality inspection decision information associated with the business rules is determined as the first quality inspection decision information.

[0079] In other words, the first intelligent agent can use the analysis strategies included in the pre-configured business rules to analyze the diagnostic information. If it meets the corresponding filtering conditions, the first intelligent agent directly determines the second quality inspection decision information associated with the business rules as the first quality inspection decision information. If it does not meet the corresponding filtering conditions, the first intelligent agent continues to conduct in-depth analysis to obtain the first quality inspection decision information.

[0080] For example, pre-configured business rules may include a first business rule and a second business rule. The analysis strategy corresponding to the first business rule may include analyzing the indicator data corresponding to the diagnostic information, and the corresponding filtering conditions may include a first filtering condition indicating that even if the indicator data suddenly increases, the indicator data shows a significant downward trend in a short period of time. Accordingly, if the analysis result meets the first filtering condition, it indicates that the indicator data is a temporary fluctuation, and the corresponding second quality inspection decision information can be to continue to change. The analysis strategy corresponding to the second business rule may include performing multi-dimensional drill-down analysis on the diagnostic information. For example, drilling down at the level of instances (such as Pods (container groups)) and clusters, the corresponding filtering conditions may include a second filtering condition indicating that the anomaly occurs on a small number of instances and does not meet specific diffusion conditions, and the corresponding second quality inspection decision information can be to continue to change.

[0081] Therefore, by pre-configuring business rules, the decision-making efficiency of the first intelligent agent can be greatly improved, and corresponding business rules can be configured according to the needs of different businesses, thereby adapting to different business requirements.

[0082] Figure 5 This is a flowchart illustrating how to determine the first error log statement based on certain conditions. For example... Figure 5 As shown, in some cases, the first error log statement can be determined by following these steps.

[0083] In step 510, based on the change information, a second error log statement and detection strategy are obtained.

[0084] Here, the second error log statement includes the error log statements affected by the change operation. It should be understood that the identified first error log statement can be the second error log statement that exhibits an exception among all the second error log statements affected by the change operation.

[0085] Each second error log statement has a corresponding detection strategy. The change information may include code difference comparison information. For example, a second agent can obtain the second error log statement based on the code difference comparison information included in the change information, and obtain a detection strategy for the second error log statement based on its impact type.

[0086] The second agent can acquire all change information. Based on understanding the change information, the second agent can further analyze the code difference comparison information included in the change information and identify the second error log statement affected by this change operation.

[0087] Furthermore, a second agent can plan a corresponding detection strategy for the identified second error log statement. For example, the second agent can determine the detection strategy corresponding to the second error log statement based on the impact type to which the second error log statement belongs.

[0088] The detection strategy determines a reference metric for the second error log statement, which is used to detect abnormal second error log statements. In other words, the reference metric can be a threshold used to determine whether a second error log statement is abnormal. For example, if the actual count of the second error log statement is greater than the reference metric, then the second error log statement is considered abnormal.

[0089] Different detection strategies can be applied to different impact types. For example, impact types can include first impact type, second impact type, and third impact type. First impact type indicates that the second error log statement includes newly added error log statements in the modified object. For example, if a second error log statement is introduced into the code of the modified object by a change operation, then the impact type of this second error log statement is first impact type. Second impact type indicates that the second error log statement is obtained by modifying an existing error log statement in the modified object. For example, if a second error log statement is obtained by modifying the content or triggering condition of an existing error log statement in the code of the modified object, then the impact type of this second error log statement is second impact type. Third impact type indicates that the second error log statement is generated by a change in the line number of an existing error log statement in the modified object. For example, if a second error log statement is obtained because the line number of the original error log statement changes due to the addition or deletion of code in the modified object, then the impact type of this second error log statement is third impact type.

[0090] Different detection strategies can be used for different types of impacts. For example, the first type of impact corresponds to the first detection strategy, the second type of impact corresponds to the second detection strategy, and the third type of impact corresponds to the third detection strategy.

[0091] For example, the first detection strategy could be: determining a reference indicator based on the relationship type between the second error log statement and the existing third error log statement of the changed object, where the third error log statement includes existing error log statements of the changed object that are related to the second error log statement. The second detection strategy could be: determining whether the second error log statement was generated through a line number change caused by a fourth error log statement; if the second error log statement was not generated through a line number change caused by a fourth error log statement, then determining a reference indicator based on the relationship type between the second error log statement and the existing third error log statement of the changed object; if the second error log statement was generated through a line number change caused by a fourth error log statement, then determining a reference indicator based on the historical indicator data corresponding to the existing fourth error log statement of the changed object. The third detection strategy could be: determining a reference indicator based on the historical indicator data corresponding to the existing fourth error log statement of the changed object.

[0092] In step 520, for each second error log statement, a reference indicator corresponding to the second error log statement is obtained based on the corresponding detection strategy.

[0093] Here, for each identified second error log statement, a reference indicator can be calculated based on the determined detection strategy. This reference indicator can be a threshold used to determine whether a second error log statement is abnormal. For example, if the actual count of a second error log statement is greater than the reference indicator, then the second error log statement is considered abnormal.

[0094] The indicator quality inspection module can determine the reference indicators corresponding to the second error log statements based on the detection strategies they employ. For example, the detection strategies for each second error log statement identified by the second agent can be distributed to the indicator quality inspection module, which then determines the reference indicators for each second error log statement based on these strategies.

[0095] As some examples, reference metrics can be derived based on the relationship between the second and third error log statements. As other examples, reference metrics can be derived based on historical metric data corresponding to the fourth error log statement.

[0096] Following the example above, in response to a detection strategy including a first detection strategy, a reference indicator is determined based on the relationship type between the second error log statement and the existing third error log statement of the changed object. The third error log statement includes existing error log statements of the changed object that are related to the second error log statement.

[0097] In other words, for the first type of impact, reference indicators can be determined based on the relationship between the second error log statement and the existing third error log statement of the changed object. For example, assuming the second error log statement is a newly added error log statement in the change operation, reference indicators can be determined based on the relationship between the second error log statement and the existing third error log statement of the changed object.

[0098] Different relationship types can correspond to different indicator calculation strategies. For example, if the second error log statement A is a newly added error log statement in a change operation, and it is associated with an existing third error log statement B, and the relationship type is equivalence, then the historical indicator data of the third error log statement B can be determined as a reference indicator. As another example, if the relationship type between the second and third error log statements is linear, then an agent can perform static analysis and logical reasoning on the code related to both the second and third error log statements to obtain the corresponding reference indicator. A linear relationship indicates that there is a cross-file relationship and involves multiple error log statements between the second and third error log statements. For example, the triggering of the second error log statement A is equivalent to the sum of the triggering of the third error log statements C and D. Accordingly, the reference indicator for the second error log statement A can be the sum of the historical indicator data of the third error log statement C and the historical indicator data of the third error log statement D, or the reference indicator for the second error log statement A can be the historical indicator data of the third error log statement C or the historical indicator data of the third error log statement D.

[0099] The detection strategy can respond to the third detection strategy by using historical indicator data corresponding to the existing fourth error log statement of the changed object. The fourth error log statement is generated by a change in line number. In other words, the fourth error log statement is an existing error log statement in the changed object, obtained by changing the line number to derive the second error log statement.

[0100] If the second error log statement belongs to the third impact type, then the second error log statement and the fourth error log statement are essentially the same error log statement. Accordingly, the historical indicator data corresponding to the existing fourth error log statement of the changed object can be directly determined as the reference indicator corresponding to the second error log statement.

[0101] In response to a detection strategy including a second detection strategy, it can determine whether the second error log statement was generated by a line number change through the fourth error log statement. If the second error log statement was not generated by a line number change through the fourth error log statement, then a reference indicator is determined based on the relationship type between the second error log statement and the existing third error log statement of the changed object. If the second error log statement was generated by a line number change through the fourth error log statement, then a reference indicator is determined based on the historical indicator data corresponding to the existing fourth error log statement of the changed object.

[0102] In other words, for the second error log statement of the second impact type, it can be further determined whether the second error log statement of the second impact type belongs to the third impact type. If it belongs to the third impact type, the reference indicator can be determined through the third detection strategy. If it is deployed in the first impact type, the reference indicator can be determined through the first detection strategy corresponding to the first impact type.

[0103] Based on this, different detection strategies can be used to obtain reference indicators for the second error log statement for different impact types, thereby tailoring a corresponding detection strategy for each affected second error log statement and ensuring the accuracy of the reference indicators for each second error log statement.

[0104] It's worth noting that historical metric data can refer to the metric data corresponding to error log statements within a historical time period. For example, historical metric data can include metric data for error log statements at a preset duration before any changes were made.

[0105] In step 530, the first error log statement is obtained by filtering from the second error log statement based on the reference index and the corresponding count index.

[0106] Here, each second error log statement has a corresponding count indicator. The count indicator for the second error log statement represents the number of error logs printed by the second error log statement per unit time. The reference indicator represents the number of error logs printed by the second error log statement per unit time under normal conditions.

[0107] The indicator quality inspection module can compare the count indicator corresponding to the second error log statement with the corresponding reference indicator. If the count indicator corresponding to the second error log statement is greater than the corresponding reference indicator, the second error log statement is identified as the first error log statement.

[0108] It should be understood that the first error log statement identified can be the second error log statement that is abnormal among all the second error log statements affected by the change operation.

[0109] Therefore, by determining the second error log statement and the detection strategy for the second error log statement, and based on the detection strategy corresponding to the second error log statement, determining the reference index corresponding to the second error log statement, and based on the counting index corresponding to the second error log statement and the corresponding reference index, determining the first error log statement from the second error log statement, the first error log statement that has an anomaly can be accurately located, thereby improving the accuracy of quality inspection.

[0110] Figure 6 This is a logical diagram of a second intelligent agent shown under certain circumstances. For example... Figure 6As shown, the second agent can obtain the necessary change information by calling tools in the tool library. Then, the second agent analyzes the change information, generates change intent information, and updates the change intent information to the information database, which is then used by the first agent to obtain the first quality inspection decision information. The second agent can also obtain code difference comparison information by calling tools, and use this information to determine the second error log statement and the detection strategy for it.

[0111] In some cases, a third intelligent agent can generate training samples based on contextual information related to the change operation. These training samples are then used to train a fourth intelligent agent, which in turn obtains the first quality inspection decision information.

[0112] Here, in response to a discrepancy between the user's action and the initial quality inspection decision, a third-party agent can generate training samples based on the contextual information related to the change operation. This discrepancy means that the user's final change action does not match the decision conclusion corresponding to the initial quality inspection decision. For example, if the initial quality inspection decision is "continue the change," but the user's final change action is a rollback, then the user's action is inconsistent with the initial quality inspection decision.

[0113] The contextual information related to the change operation can include information generated during the execution of the change operation and information generated after the change operation is completed. For example, the contextual information related to the change operation can include the aforementioned change information, diagnostic information, error semantic information, change intent information, associated code, the decision-making process of the first intelligent agent, the decision-making process of the second intelligent agent, the first quality inspection decision information, and the actions actually performed by the user after displaying the first quality inspection decision information.

[0114] The third agent can generate structured training samples based on contextual information related to the change operation. These training samples can be contextual information carrying labels, which can be the actual actions performed by the user. The training samples generated by the third agent can then be used to train the fourth agent. The fourth agent is used to obtain the first quality inspection decision information; continuing the example above, the fourth agent can be the first agent and / or the second agent provided in the example.

[0115] By fine-tuning and optimizing the first and / or second agents using generated training samples, a feedback loop of decision information between them can be achieved, enabling the first and / or second agents to continuously evolve and making the output quality inspection decision information more accurate.

[0116] In other cases, a third agent can adjust the prompts used by a fourth agent based on contextual information related to the change operation.

[0117] Here, in response to a discrepancy between the user's action and the first quality inspection decision information, the third agent can adjust the prompts used by the fourth agent based on the context information related to the change operation. The fourth agent may include the first agent and / or the second agent.

[0118] The third agent can adjust the prompts of the first and / or second agents based on contextual information, so that the adjusted first and / or second agents can obtain more accurate quality inspection decision information.

[0119] In some other cases, a third intelligent agent can generate second knowledge based on contextual information related to the change operation. This second knowledge is then used by a fourth intelligent agent to obtain the first quality inspection decision information.

[0120] Here, in response to a discrepancy between the user's action and the first quality inspection decision information, a third intelligent agent can generate second knowledge based on contextual information related to the change operation. This second knowledge is then used by a fourth intelligent agent to obtain the first quality inspection decision information. The fourth intelligent agent may include the third intelligent agent.

[0121] The third agent can generate a summary of the change operation based on contextual information. This summary can include the purpose of the change, key modifications, any anomalies encountered, the decision-making process, the first quality control decision, and the final label. This summary is stored as second knowledge in an experience knowledge base. When the first agent encounters a new change operation similar to this one, it can use this second knowledge as a reference for decision-making and output the corresponding quality control decision for the new change operation, thereby achieving the accumulation and reuse of experience.

[0122] In some cases, the first quality inspection decision information can be obtained through the following steps: The second intelligent agent is used to obtain change information related to the change operation; The change information is analyzed by a second intelligent agent to obtain the change intent information; The second intelligent agent determines the second error log statement and the detection strategy for the second error log statement based on the change information. The second error log statement includes error log statements affected by the change operation. For each second error log statement, a reference indicator is determined based on the detection strategy corresponding to the second error log statement. The first error log statement is determined from the second error log statement based on the counting index and the corresponding reference index. The first intelligent agent obtains the diagnostic information associated with the first error log statement; The first intelligent agent analyzes the diagnostic information to obtain the error semantic information corresponding to the diagnostic information; Based on the change information, the first intelligent agent determines the associated code, which includes the code in the changed object that causes the first error log statement to print a log. The first intelligent agent determines the first quality inspection decision information based on error semantic information, associated codes, and change intent information corresponding to the change operation.

[0123] Of course, following the example above, the first intelligent agent can determine the first quality inspection decision information based on error semantic information, associated code, change intent information, and first knowledge.

[0124] Furthermore, a third intelligent agent can generate training samples based on contextual information related to the change operation, and these training samples can be used to train the first and / or second intelligent agents; and / or the third intelligent agent can adjust the prompt words used by the first and / or second intelligent agents based on contextual information related to the change operation; and / or the third intelligent agent can generate second knowledge based on contextual information related to the change operation, and this second knowledge can be used by the first and / or second intelligent agents to obtain first quality inspection decision information.

[0125] Figure 7 This is a logical diagram of the change management system shown under certain circumstances. For example... Figure 7 As shown, a change management system is provided, which can be provided by an operations and maintenance platform. In the change management system, a second intelligent agent obtains the required information (including change information) by calling tools from a tool library. Based on the obtained change information, the second intelligent agent generates change intent information. Based on the obtained code difference comparison information, the second intelligent agent determines a second error log statement and a detection strategy for the second error log statement. It should be understood that the second intelligent agent can update the information database with the obtained and generated information. For example, the second intelligent agent can update the information database with the obtained change information and the generated change intent information.

[0126] The indicator quality inspection module, based on the detection strategy for the second error log statement identified by the second agent, determines the reference indicator corresponding to the second error log statement. Then, based on the corresponding count indicator and the reference indicator, the indicator quality inspection module identifies the first error log statement from the second error log statements. Alternatively, the first error log statement identified by the indicator quality inspection module can also be updated in the information database as context information for change operations.

[0127] The first intelligent agent, upon receiving the first error log statement identified by the indicator quality inspection module, retrieves diagnostic information and change information from the information database by invoking tools included in the tool library. The first intelligent agent analyzes the diagnostic information to obtain the corresponding error semantic information. Based on the change information, the first intelligent agent determines the associated code. Then, based on the error semantic information, the associated code, and the change intent information corresponding to the change operation, the first intelligent agent determines the first quality inspection decision information. Alternatively, the first intelligent agent can also retrieve first knowledge from the knowledge base by invoking tools in the tool library. Based on the error semantic information, the associated code, the change intent information, and the first knowledge, the first intelligent agent determines the first quality inspection decision information. Furthermore, the first intelligent agent can also determine quality inspection decision information based on pre-configured business rules, as described in the above example.

[0128] It should be understood that the information generated by the first intelligent agent can also be updated in the information base as context information for change operations. For example, the first intelligent agent can update the information base with diagnostic information, error semantic information, associated codes, initial knowledge, and initial quality inspection decision information.

[0129] The third agent, by invoking tools included in its toolkit, retrieves contextual information related to change operations from the knowledge base. Based on this contextual information, it provides feedback optimization to the first and / or third agents. For example, the third agent can generate training samples based on the contextual information and use these samples to optimize the first and / or third agents. Another example is that the third agent can optimize the prompts used by the first and / or third agents based on the contextual information. Of course, the third agent can also optimize business rules based on contextual information. In other cases, the third agent can generate second knowledge based on contextual information and update the knowledge base with this second knowledge.

[0130] Figure 8 This is a schematic diagram of the change management device shown under certain circumstances. For example... Figure 8 As shown, a change management device 800 is provided, which may include: The execution module 801 is used to perform a corresponding change operation on the changed object in response to the release operation, wherein the changed object and the change operation are indicated by the release operation; Display module 802 is used to display first quality inspection decision information in response to the completion of the change operation; wherein the first quality inspection decision information is obtained based on change information and diagnostic information, the change information is related to the change operation, and the diagnostic information is related to the first error log statement corresponding to the change operation.

[0131] In some cases, the change management device 800 may include: The first acquisition module is used to acquire the diagnostic information; The first obtaining module is used to analyze the diagnostic information through the first intelligent agent to obtain the error semantic information corresponding to the diagnostic information; The first determining module is used to determine the associated code based on the change information, wherein the associated code includes the code in the changed object that causes the first error log statement to print an error log; The second determining module is used to obtain the first quality inspection decision information based on the error semantic information, the associated code, and the change intention information, wherein the change intention information is related to the change operation.

[0132] In some cases, the second determining module is used to: Based on the log type, first knowledge is obtained from the knowledge base, wherein the log type belongs to the log type corresponding to the first error log statement, and the first knowledge matches the log type; Based on the error semantic information, the associated code, the change intent information, and the first knowledge, the first quality inspection decision information is obtained.

[0133] In some cases, the change management device 800 may further include: The second acquisition module is used to acquire the change information; The second obtaining module is used to analyze the change information through the second intelligent agent to obtain the change intention information.

[0134] In some cases, the first obtaining module is used for: The first intelligent agent analyzes the diagnostic information based on pre-configured business rules, including filtering conditions. In response to the mismatch between the diagnostic information and the filtering conditions, the first intelligent agent analyzes the diagnostic information to obtain the error semantic information; In response to the diagnostic information matching the filtering conditions, the first quality inspection decision information is obtained based on the second quality inspection decision information, and the second quality inspection decision information is associated with the business rule.

[0135] In some cases, the change management device 800 may further include: The third determining module is used to obtain a second error log statement and a detection strategy based on the change information. The second error log statement includes error log statements affected by the change operation, and each second error log statement has a corresponding detection strategy. The fourth determining module is used to obtain a reference index corresponding to each of the second error log statements based on the corresponding detection strategy. The fifth determining module is used to filter the first error log statement from the second error log statement according to the reference index and the corresponding counting index, wherein each second error log statement has a corresponding counting index.

[0136] In some cases, the change information includes code difference comparison information, and the third determining module is used for: The second intelligent agent obtains the second error log statement based on the code difference comparison information. Based on the impact type of the second error log statement, the corresponding detection strategy is obtained.

[0137] In some cases, the fourth determining module is used to: The reference index is obtained based on the relationship type between the second error log statement and the third error log statement, wherein the third error log statement includes existing error log statements of the changed object that are associated with the second error log statement; or The reference indicator is obtained based on the historical indicator data corresponding to the fourth error log statement, wherein the second error statement is generated by a change in the line number of the fourth error log statement.

[0138] In some cases, the change management device 800 may include: The first generation module is configured to generate training samples using a third intelligent agent based on contextual information related to the change operation. These training samples are used to train a fourth intelligent agent, which is then used to obtain the first quality inspection decision information; and / or The adjustment module is used to adjust the prompt words used by the fourth agent through the third agent, based on context information related to the change operation; and / or The second generation module is used to generate second knowledge based on the context information related to the change operation through the third intelligent agent. The second knowledge is used by the fourth intelligent agent to obtain the first quality inspection decision information based on the second knowledge.

[0139] In some cases, the change management device 800 may include a sixth determining module for: The second intelligent agent obtains the change information related to the change operation; The change intention information is obtained by analyzing the change information through the second intelligent agent; The second intelligent agent determines a second error log statement and a detection strategy for the second error log statement based on the change information. The second error log statement includes error log statements affected by the change operation. For each of the second error log statements, a reference indicator corresponding to the second error log statement is determined based on the detection strategy corresponding to the second error log statement. The first error log statement is determined from the second error log statement based on the counting index corresponding to the second error log statement and the corresponding reference index. The first intelligent agent obtains the diagnostic information associated with the first error log statement; The first intelligent agent analyzes the diagnostic information to obtain the error semantic information corresponding to the diagnostic information; Based on the change information, the first intelligent agent determines the associated code, which includes the code in the changed object that causes the first error log statement to print a log. The first intelligent agent determines the first quality inspection decision information based on the error semantic information, the associated code, and the change intent information corresponding to the change operation.

[0140] It should be understood that the execution logic of each functional module in the change management device 800 has been explained in detail in the section on change management methods, and can be referred to in the relevant description of change management methods.

[0141] The following is for reference. Figure 9 It shows an electronic device suitable for implementing the above-mentioned technical solution (e.g. Figure 1The diagram below shows the structure of the terminal equipment or operation and maintenance platform (900). The terminal equipment may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablet Personal Computers), PMPs (Portable Media Players), in-vehicle terminals (such as in-vehicle navigation terminals), and fixed terminals such as digital TVs (Televisions), desktop computers, etc. Figure 9 The electronic device shown is merely an example and should not be construed as limiting its functionality or scope of use.

[0142] like Figure 9 As shown, the electronic device 900 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 into a random access memory (RAM) 903. The RAM 903 also stores various programs and data required for the operation of the electronic device 900. The processing unit 901, the ROM 902, and the RAM 903 are interconnected via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0143] Typically, the following devices can be connected to the input / output interface 905: input devices 906 including, for example, a touchscreen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 907 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 908 including, for example, magnetic tape, hard disk, etc.; and communication devices 909. Communication device 909 allows electronic device 900 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 9 An electronic device 900 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0144] In particular, depending on certain circumstances, the processes described in the flowchart above can be implemented as computer software programs. For example, a computer program product is provided, comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowchart. This computer program can be downloaded and installed from a network via a communication device 909, or installed from a storage device 908, or installed from a read-only memory 902. When the computer program is executed by a processing device 901, it performs the functions defined in the above-described methods.

[0145] It should be noted that the aforementioned computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium may be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM, or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In one case, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In another case, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. The transmitted data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (Radio Frequency), etc., or any suitable combination thereof.

[0146] In some implementations, terminal devices and operation and maintenance platforms can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol), and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (LANs), wide area networks (WANs), the internet (e.g., the Internet), and end-to-end networks (e.g., ad-hoc end-to-end networks), as well as any currently known or future-developed networks.

[0147] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0148] The aforementioned computer-readable medium carries one or more programs. When the aforementioned one or more programs are executed by the electronic device, the electronic device causes the electronic device to: perform a corresponding change operation on a change object in response to a release operation, wherein the change object and the change operation are indicated by the release operation; and display first quality inspection decision information in response to the completion of the change operation; wherein the first quality inspection decision information is obtained based on change information and diagnostic information, the change information is related to the change operation, and the diagnostic information is related to a first error log statement corresponding to the change operation.

[0149] Computer program code for performing the above operations can be written in one or more programming languages ​​or a combination thereof. These programming languages ​​include, but are not limited to, object-oriented programming languages, as well as conventional procedural programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0150] The flowcharts and block diagrams in the accompanying figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products under various scenarios. In this respect, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the figures. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0151] The modules mentioned above can be implemented in software or hardware. In some cases, the name of a module does not necessarily limit the functionality of that module.

[0152] The functions described above can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field-Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application-Specific Standard Parts (ASSPs), Systems on Chips (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0153] In this context, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0154] The above description is merely illustrative and explains the technical principles employed. Those skilled in the art should understand that the scope of the technical solution is not limited to specific combinations of the above-described technical features, but also includes other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above concept. For example, technical solutions formed by substituting the above-described features with (but not limited to) technical features provided herein that have similar functions.

[0155] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. Multitasking and parallel processing may be advantageous in certain environments. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limitations on the scope of the technical solution. Certain features described in the context of a single example can also be implemented in combination in a single example. Conversely, various features described in the context of a single example can also be implemented individually or in any suitable sub-combination in multiple examples.

[0156] Although the technical solution has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims. Regarding the aforementioned apparatus, the specific manner in which each module performs its operation has already been described in detail in the section concerning the method, and will not be elaborated upon here.

Claims

1. A change management method, comprising: In response to a release operation, a corresponding change operation is performed on the changed object, wherein the changed object and the change operation are indicated by the release operation. In response to the completion of the change operation, first quality inspection decision information is displayed; wherein, the first quality inspection decision information is obtained based on change information and diagnostic information, the change information is related to the change operation, and the diagnostic information is related to the first error log statement corresponding to the change operation.

2. The method according to claim 1, wherein, The first quality inspection decision information is obtained through the following steps: Obtain the diagnostic information; The first intelligent agent analyzes the diagnostic information to obtain the error semantic information corresponding to the diagnostic information; Based on the change information, the associated code is determined, and the associated code includes the code in the changed object that causes the first error log statement to print an error log; Based on the error semantic information, the associated code, and the change intent information, the first quality inspection decision information is obtained, wherein the change intent information is related to the change operation.

3. The method according to claim 2, wherein, The process of obtaining the first quality inspection decision information based on the error semantic information, the associated code, and the change intent information includes: Based on the log type, first knowledge is obtained from the knowledge base, wherein the log type belongs to the log type corresponding to the first error log statement, and the first knowledge matches the log type; Based on the error semantic information, the associated code, the change intent information, and the first knowledge, the first quality inspection decision information is obtained.

4. The method according to claim 2, wherein, The change intent information is obtained through the following steps: Obtain the change information; The change information is analyzed by a second intelligent agent to obtain the change intention information.

5. The method according to claim 2, wherein, The step of analyzing the diagnostic information through a first intelligent agent to obtain the error semantic information corresponding to the diagnostic information includes: The first intelligent agent analyzes the diagnostic information based on pre-configured business rules, including filtering conditions. In response to the mismatch between the diagnostic information and the filtering conditions, the first intelligent agent analyzes the diagnostic information to obtain the error semantic information; In response to the diagnostic information matching the filtering conditions, the first quality inspection decision information is obtained based on the second quality inspection decision information, and the second quality inspection decision information is associated with the business rule.

6. The method according to any one of claims 1-5, wherein, The first error log statement is determined through the following steps: Based on the change information, a second error log statement and a detection strategy are obtained. The second error log statement includes error log statements affected by the change operation, and each second error log statement has a corresponding detection strategy. For each of the second error log statements, a reference indicator corresponding to the second error log statement is obtained based on the corresponding detection strategy; Based on the reference index and the corresponding counting index, the first error log statement is obtained by filtering from the second error log statements, and each second error log statement has a corresponding counting index.

7. The method according to claim 6, wherein, The change information includes code difference comparison information. Based on the change information, the second error log statement and detection strategy are obtained, including: The second intelligent agent obtains the second error log statement based on the code difference comparison information. Based on the impact type of the second error log statement, the corresponding detection strategy is obtained.

8. The method according to claim 6, wherein, The reference index is determined through the following steps: The reference index is obtained based on the relationship type between the second error log statement and the third error log statement. The third error log statement includes existing error log statements of the changed object that are related to the second error log statement. or The reference indicator is obtained based on the historical indicator data corresponding to the fourth error log statement, wherein the second error statement is generated by a change in the line number of the fourth error log statement.

9. The method according to any one of claims 1-5, wherein, The method further includes: A third agent generates training samples based on contextual information related to the change operation. These training samples are used to train a fourth agent, which is then used to obtain the first quality inspection decision information; and / or The prompt words used by the fourth agent are adjusted by the third agent based on the context information related to the change operation; and / or The third intelligent agent generates second knowledge based on the context information related to the change operation. The second knowledge is used by the fourth intelligent agent to obtain the first quality inspection decision information.

10. A change management device, comprising: An execution module is used to perform corresponding change operations on a changed object in response to a release operation, wherein the changed object and the change operation are indicated by the release operation; The display module is used to display first quality inspection decision information in response to the completion of the change operation; wherein the first quality inspection decision information is obtained based on change information and diagnostic information, the change information is related to the change operation, and the diagnostic information is related to the first error log statement corresponding to the change operation.

11. A computer-readable medium having a computer program stored thereon, wherein, When the computer program is executed by the processing device, it implements the steps of the method according to any one of claims 1-9.

12. An electronic device, comprising: A storage device on which computer programs are stored; A processing device for executing the computer program in the storage device to implement the steps of the method according to any one of claims 1-9.

13. A computer program product comprising a computer program, wherein, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1-9.

Images