Operation and maintenance method and training method and device of operation and maintenance prediction model

Abstract

According to the operation and maintenance method and the training method and device of the operation and maintenance prediction model provided by the invention, the monitoring data and the log data of the target server are obtained under the condition that the alarm information for the target server is obtained; inputting the monitoring data, the log data and the alarm information into an operation and maintenance prediction model, and determining an operation and maintenance scheme of the target server by the operation and maintenance prediction model; and the target server is maintained based on the operation and maintenance scheme, analysis processing can be performed through the operation and maintenance prediction model, and then the server is operated and maintained, so that the operation and maintenance efficiency can be improved.

Description

Technical Field

[0001] The present application belongs to the field of server operation and maintenance technology, and in particular, relates to an operation and maintenance method, and a training method and device for an operation and maintenance prediction model. Background Art

[0002] In the field of computer operation and maintenance, in the traditional operation and maintenance process, after receiving an alarm notification, the operation and maintenance personnel need to go to the monitoring system to view the status information of the corresponding server and application system according to the content of the alarm notification, understand the abnormal status of the server, or go to the server and log collection system to view the system operation log. The operation and maintenance engineer needs to find out the specific location of the system failure through the status data and log information, judge and infer the root cause of the failure, and then take corresponding treatment methods to solve the problem after determining the cause of the system failure. From fault discovery to problem solving, it takes a long time to go through the stages of troubleshooting, analysis, and processing. Moreover, for more complex system failures, manual processing usually requires a detailed understanding of the system structure, reference to documents, and search for solutions during the troubleshooting and analysis process. This process requires a lot of time, energy, and manpower costs. Summary of the invention

[0003] The embodiments of the present application provide an operation and maintenance method, device, electronic device and storage medium, which can perform analysis and processing through an operation and maintenance prediction model, and then operate and maintain the server, thereby improving the efficiency of operation and maintenance.

[0004] According to the first aspect of the present application, an embodiment of the present application provides an operation and maintenance method, including:

[0005] When alarm information for a target server is obtained, monitoring data and log data of the target server are obtained;

[0006] Inputting the monitoring data, the log data and the alarm information into an operation and maintenance prediction model, and determining an operation and maintenance plan for the target server by the operation and maintenance prediction model;

[0007] Maintain the target server based on the operation and maintenance plan.

[0008] In some embodiments, the operation and maintenance solution includes: repairing code, and maintaining the target server based on the operation and maintenance solution includes:

[0009] Upload the repair code to the code repository;

[0010] A repair instruction is sent to the target server, so that the target server downloads the repair code from the code repository through a repair tool, and executes the repair code on the target server.

[0011] In some embodiments, the operation and maintenance plan includes: alarm information, fault cause, solution and technical documents, and the target server is maintained based on the operation and maintenance plan, wherein the technical documents include: repair code, including:

[0012] Generate alarm notification information based on the repair code, the alarm information, the cause of the fault, the solution and the technical document;

[0013] Outputting the alarm notification information to an operation and maintenance personnel so that the operation and maintenance personnel can determine whether to perform maintenance on the target server;

[0014] When it is obtained that the operation and maintenance personnel determine to perform maintenance on the target server, the server is maintained based on the repair code.

[0015] In some embodiments, the method further comprises:

[0016] Obtain monitoring indicators of the target server;

[0017] Determine whether an alarm is required based on the monitoring indicators and alarm rules;

[0018] When it is determined that an alarm is required, an alarm message is generated.

[0019] In some embodiments, the alarm rule includes: whether the monitoring indicator exceeds a set threshold, and determining whether to issue an alarm based on the monitoring indicator and the alarm rule includes:

[0020] Determine whether the monitoring indicator exceeds a set threshold;

[0021] Whether an alarm needs to be issued is determined based on whether the monitoring indicator exceeds a set threshold, wherein if the monitoring indicator exceeds the set threshold, it is determined that an alarm needs to be issued.

[0022] In some embodiments, the method further comprises:

[0023] When it is determined that an alarm is required, alarm information is generated, and the alarm information is deduplicated, aggregated, and classified to obtain alarm information for the target server.

[0024] A second aspect of the present application provides a training method for an operation and maintenance prediction model, comprising:

[0025] Acquire a sample data set, wherein each sample data in the sample data set includes: sample monitoring data, sample log data, sample alarm information and a corresponding sample operation and maintenance plan;

[0026] Inputting the sample monitoring data, sample log data, and sample alarm information of each sample data into an operation and maintenance prediction model, and using the operation and maintenance prediction model to determine a predicted operation and maintenance solution corresponding to the sample data;

[0027] The parameters of the operation and maintenance prediction model are adjusted based on the sample operation and maintenance solution and the predicted operation and maintenance solution corresponding to each sample data in the sample data set to obtain a trained operation and maintenance prediction model.

[0028] According to a third aspect of the present application, an embodiment of the present application provides an operation and maintenance device, including:

[0029] An acquisition module, used to acquire monitoring data and log data of a target server when alarm information for the target server is acquired;

[0030] A determination module, used to input the monitoring data, the log data and the alarm information into an operation and maintenance prediction model, and determine the operation and maintenance plan of the target server by the operation and maintenance prediction model;

[0031] An operation and maintenance module is used to maintain the target server based on the operation and maintenance solution.

[0032] According to a fourth aspect of the present application, a training device for an operation and maintenance prediction model is provided, comprising:

[0033] A sample data acquisition module is used to acquire a sample data set, wherein each sample data in the sample data set includes: sample monitoring data, sample log data, sample alarm information and a corresponding sample operation and maintenance plan;

[0034] The training module is used to input the sample monitoring data, sample log data, and sample alarm information of each sample data into the operation and maintenance prediction model, and the operation and maintenance prediction model determines the predicted operation and maintenance plan corresponding to the sample data; based on the sample operation and maintenance plan and the predicted operation and maintenance plan corresponding to each sample data in the sample data set, the parameters of the operation and maintenance prediction model are adjusted to obtain the trained operation and maintenance prediction model.

[0035] According to the fifth aspect of the present application, an embodiment of the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements any of the methods described above when executing the computer program.

[0036] According to the sixth aspect of the present application, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described in any one of the above items is implemented.

[0037] According to the seventh aspect of the present application, an embodiment of the present application provides a computer program product, which, when executed on a terminal device, enables the electronic device to execute any of the methods described above.

[0038] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0039] The operation and maintenance method provided in the embodiment of the present application obtains monitoring data and log data of the target server when alarm information for the target server is obtained; the monitoring data, the log data and the alarm information are input into an operation and maintenance prediction model, and the operation and maintenance plan of the target server is determined by the operation and maintenance prediction model; the target server is maintained based on the operation and maintenance plan, and analysis and processing can be performed through the operation and maintenance prediction model, and then the server is operated and maintained, thereby improving the efficiency of operation and maintenance.

[0040] It can be understood that the beneficial effects of the second to seventh aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0042] Figure 1 A schematic diagram of the implementation process of an operation and maintenance method provided for the implementation of this application;

[0043] Figure 2 A schematic diagram of an implementation flow of a training method for an operation and maintenance prediction model provided in an embodiment of the present application;

[0044] Figure 3 A schematic diagram of the structure of the operation and maintenance device provided in an embodiment of the present application;

[0045] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0046] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0047] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0048] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0049] As used in the specification of this application and the appended claims, the term "if" can be interpreted as "when" or "once" or "in response to determination" or "in response to operation" according to the context. Similarly, the phrase "if it is determined" or "if it is operated" can be interpreted as meaning "once it is determined" or "in response to determination" or "once it is operated" or "in response to operation" according to the context.

[0050] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0051] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways.

[0052] Based on the technical problems of the related technology, the embodiments of the present application provide an operation and maintenance method that can be applied to electronic devices such as mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPC), netbooks, personal digital assistants (PDA), etc. The embodiments of the present application do not impose any restrictions on the specific types of electronic devices.

[0053] The functions implemented by the operation and maintenance method provided in the embodiment of the present application can be implemented by calling program codes by a processor of an electronic device, wherein the program codes can be stored in a computer storage medium.

[0054] Figure 1 A schematic diagram of the implementation process of an operation and maintenance method provided for the implementation of this application, such as Figure 1 As shown, the operation and maintenance methods include:

[0055] Step S101, when alarm information for a target server is obtained, monitoring data and log data of the target server are obtained.

[0056] In an embodiment of the present application, the electronic device can receive alarm information from the monitoring system of the server in real time, wherein the alarm information can be generated by a preset threshold trigger mechanism. As an example, when a monitoring indicator of the target server (such as CPU usage, memory usage, disk space, etc.) exceeds the preset threshold, the monitoring system will generate corresponding alarm information and send the alarm information to the electronic device. In this case, the electronic device can obtain the alarm information for the target server. The alarm information includes the trigger time, type, level, description of the alarm and the associated target server information. The alarm information provides operation and maintenance personnel with clues to the occurrence of problems.

[0057] In the embodiment of the present application, optionally, after receiving the alarm information, the electronic device can perform certain verification to ensure the authenticity and accuracy of the alarm information. The verification includes checking whether the source of the alarm information is reliable, whether the alarm content is clear and unambiguous, and whether the alarm level is consistent with the actual problem.

[0058] In an embodiment of the present application, the alarm information includes a server IP address, a host name, etc. In this case, the electronic device can determine the target server based on the alarm information.

[0059] In the embodiment of the present application, after the target server is determined, the electronic device can obtain the monitoring data of the target server before and after the alarm occurs from the monitoring system. Among them, the monitoring data will be used for subsequent problem analysis and solution formulation, and the monitoring data includes various performance indicator data of the target server before and after the alarm occurs, such as CPU usage, memory usage, network traffic, disk I / O, etc. These data reflect the operating status and potential problems of the server.

[0060] In the embodiment of the present application, in addition to monitoring data, the electronic device can also obtain the log data of the target server during the alarm occurrence period from the log system. The log data records various events and error information during the operation of the server, which is an important basis for problem analysis and location. The log data may include information such as timestamp, log level, log content, etc.

[0061] In the embodiment of the present application, optionally, a step of preprocessing the acquired data is included. After acquiring the monitoring data and log data, the electronic device can preprocess the data. The preprocessing includes steps such as removing duplicate data, cleaning noise data, and formatting data, so that the subsequent operation and maintenance prediction model can more conveniently perform data analysis and processing.

[0062] In the embodiment of the present application, the electronic device obtains the monitoring data and log data of the target server when the alarm occurs, which can lay the foundation for subsequent problem analysis and formulation of operation and maintenance plans.

[0063] Step S102: input the monitoring data, the log data and the alarm information into an operation and maintenance prediction model, and determine the operation and maintenance plan of the target server by the operation and maintenance prediction model.

[0064] In the embodiment of the present application, the prepared monitoring data, log data and alarm information are input into the operation and maintenance prediction model according to a certain format and protocol. The operation and maintenance prediction model usually has powerful data processing and analysis capabilities, can process multiple types of data at the same time, and extract valuable information from them.

[0065] In the embodiment of the present application, after receiving the input data, the operation and maintenance prediction model will use its built-in algorithms and models to perform intelligent analysis. Based on the analysis results of the operation and maintenance prediction model, the electronic device can automatically or manually generate an operation and maintenance plan for the target server.

[0066] In the embodiments of the present application, the operation and maintenance plan may include clearly indicating the root cause and specific location of the problem, such as a service process crash, insufficient space on a disk partition, etc., specific operation steps, configuration parameters that need to be adjusted, recommended repair measures, etc. The operation and maintenance plan is intended to quickly and accurately solve the problems faced by the target server and restore it to normal operation.

[0067] In the embodiment of the present application, by utilizing the intelligent analysis capability of the operation and maintenance prediction model, monitoring data, log data and alarm information are converted into specific operation and maintenance plans, which can provide strong support for operation and maintenance personnel.

[0068] Step S103: Maintain the target server based on the operation and maintenance plan.

[0069] In the embodiment of the present application, after the operation and maintenance plan is determined, it needs to be executed according to the steps in the plan. During the execution process, it is necessary to continuously monitor the status of the target server to ensure that the problem is solved and prevent new problems from arising. At the same time, it is also necessary to collect feedback information during the execution process in order to continuously optimize and improve the operation and maintenance plan.

[0070] The operation and maintenance method provided in the embodiment of the present application obtains monitoring data and log data of the target server when alarm information for the target server is obtained; the monitoring data, log data and alarm information are input into an operation and maintenance prediction model to determine the operation and maintenance plan of the target server; the target server is maintained based on the operation and maintenance plan, and analysis and processing can be performed through the operation and maintenance prediction model, and then the server is operated and maintained, thereby improving the efficiency of operation and maintenance.

[0071] According to the operation and maintenance method of the present application, by introducing an operation and maintenance prediction model and automation tools, the operation and maintenance method can be automated and intelligent, reducing manual intervention and errors, and improving operation and maintenance efficiency and accuracy. After the alarm information is triggered, the electronic equipment can quickly collect data, analyze problems, and output operation and maintenance solutions, thereby achieving rapid response and processing of problems. The operation and maintenance prediction model can deeply analyze monitoring data and log data, accurately locate the root cause and nature of the problem, and provide strong support for operation and maintenance personnel. With the continuous learning and optimization of the operation and maintenance prediction model, its analysis ability and accuracy will continue to improve, which can bring greater convenience and benefits to operation and maintenance work. This operation and maintenance method is not only suitable for the maintenance of a single target server, but can also be extended to the operation and maintenance management of the entire IT infrastructure, which can provide strong guarantees for the digital transformation and business development of enterprises.

[0072] According to the present application, the operation and maintenance solution includes repair code. In an embodiment that includes the repair code as part of the operation and maintenance solution, the management and execution of the code will be involved.

[0073] In some embodiments, the operation and maintenance solution includes repairing the code. Step S103, maintaining the target server based on the operation and maintenance solution, includes:

[0074] Step S1031, uploading the repair code to the code repository.

[0075] In this step, you can upload the fix code to the code repository using a version control tool (such as Git). This usually involves pushing the code to a specific branch of the remote repository (such as a fix branch, development branch, etc.).

[0076] In this step, when you commit your code, you should include a clear commit message that explains what was fixed, what issues were fixed, and any relevant references (such as a link to an issue tracking system).

[0077] Step S1032, sending a repair instruction to the target server, so that the target server downloads the repair code from the code repository through the repair tool, and executes the repair code on the target server.

[0078] This step involves sending repair instructions to the target server to trigger a series of automated actions, which include downloading the repair code from the code repository and executing the code on the target server to resolve the problem.

[0079] In this step, through direct communication with the remote server, or indirect communication through an intermediate management system or automation tool, the electronic device can remotely trigger the automated process on the target server by sending repair instructions to obtain the latest repair code from the code repository and execute them to resolve known issues.

[0080] In this step, once the target server receives the repair instruction, it will trigger a series of automated processes. For example, it may include: Downloading the specified repair code from the code repository (such as GitHub, GitLab, etc.). Verifying the integrity and correctness of the downloaded code. Executing the repair code on the target server may involve stopping services, replacing files, updating configurations, restarting services, etc. Monitoring the execution process to ensure that no errors occur and recording necessary log information.

[0081] In these embodiments, the electronic device can include in the operation and maintenance solution: repairing the code to execute corresponding steps to complete the operation and maintenance of the server.

[0082] According to the present application, in an embodiment in which the operation and maintenance plan includes alarm information, causes of failures, solutions and technical documents, there are corresponding maintenance steps to ensure the accuracy and efficiency of maintenance operations, and to ensure that operation and maintenance personnel have sufficient information support before performing maintenance operations and can make wise decisions.

[0083] In some embodiments, the operation and maintenance plan includes: alarm information, fault cause, solution and technical documents, wherein the technical documents include: repair code. Step S103, maintaining the target server based on the operation and maintenance plan includes:

[0084] Step S1033, generating alarm notification information based on the repair code, alarm information, fault cause, solution and technical documentation;

[0085] In this step, key information in the operation and maintenance plan is integrated into alarm notification information so that operation and maintenance personnel can quickly understand the severity and cause of the problem and the recommended solution.

[0086] This step includes collecting repair codes, alarm information, fault causes, solutions, and technical documents. The repair code is obtained from the operation and maintenance plan or technical documents for the current problem. Alarm information is the alarm information that triggers the maintenance process. The alarm information includes the time, source, type, and any related description of the alarm. The root cause of the problem is analyzed in detail and determined. Based on the cause of the fault, a detailed solution is formulated, including repair steps, expected results, and any necessary precautions. Technical documents are to consult relevant technical documents.

[0087] In this step, templates or automated tools can be used to generate alarm notification information based on the above key information to ensure the consistency and accuracy of the format of the alarm notification information. This is of great significance in improving operation and maintenance efficiency, ensuring information accuracy, providing clear guidance, promoting team collaboration, recording and tracking the problem solving process, and enhancing security.

[0088] Step S1034: output the alarm notification information to the operation and maintenance personnel so that the operation and maintenance personnel can determine whether to perform maintenance on the target server.

[0089] In this step, the operation and maintenance personnel can evaluate whether maintenance of the target server is required based on the information provided.

[0090] In this step, the electronic device can output the alarm notification information to the operation and maintenance personnel through notification channels (such as email, SMS, instant messaging, operation and maintenance management system, etc.), and the operation and maintenance personnel can determine whether maintenance of the target server is required based on experience.

[0091] Step S1035: When the operation and maintenance personnel determines to perform maintenance on the target server, the server is maintained based on the repair code.

[0092] In this step, after the operation and maintenance personnel confirm that maintenance is needed, they perform actual maintenance operations according to the repair code in the operation and maintenance plan to maintain the server.

[0093] According to this application, the operation and maintenance method includes real-time monitoring of the target server, rule-based alarm judgment, and generation of alarm information, providing timely feedback and decision support for the operation and maintenance personnel, so that the entire operation and maintenance process can become more comprehensive and automated. The following is a detailed explanation of these steps:

[0094] In some embodiments, the method further comprises:

[0095] Step S104, obtaining monitoring indicators of the target server.

[0096] In this step, key performance indicators (KPIs) and status information of the target server are collected for subsequent analysis and alarm judgment.

[0097] In this step, you can use monitoring tools or systems (such as Zabbix, Prometheus, Nagios, etc.) to collect data from the target server periodically or in real time.

[0098] In this step, the monitored data may include CPU usage, memory usage, disk space, network bandwidth, application response time, error logs, etc. The collected data is stored in a database or time series database for subsequent query and analysis.

[0099] Step S105: determine whether an alarm is required based on the monitoring indicators and alarm rules.

[0100] In this step, the monitoring indicator data is analyzed according to the predefined alarm rules to determine whether there are any abnormal conditions and whether alarm information needs to be generated.

[0101] In this step, set alarm rules, which define which monitoring indicators are considered abnormal under what conditions (such as CPU usage exceeding 80%, memory usage exceeding 90%, etc.). Compare the monitoring indicator data with the alarm rules in real time or regularly. If the data is found to meet the conditions of an alarm rule, the alarm logic is triggered.

[0102] Step S106: if it is determined that an alarm is required, generate alarm information.

[0103] In this step, when an abnormal situation is detected, the electronic equipment will generate an alarm message so that the operation and maintenance personnel can quickly understand the problem and take appropriate actions.

[0104] In this step, extract relevant monitoring indicator data and context information (such as alarm time, target server name, specific value of abnormal indicators, etc.) according to the triggered alarm rules. Use templates or automated tools to generate alarm information to ensure that the information content is clear, accurate and easy to understand. The alarm information should contain enough details so that the operation and maintenance personnel can quickly locate the cause of the problem and assess its impact on the system. Send the generated alarm information to the operation and maintenance personnel through channels such as email, SMS, instant messaging, phone call or dedicated operation and maintenance management platform.

[0105] In these embodiments, the electronic device can monitor the status of the target server in real time or periodically, and automatically generate alarm information when an abnormality is found, and then generate alarm notification information based on the alarm information (as well as possible repair codes, fault causes, etc.), and finally send the alarm notification information to the operation and maintenance personnel for maintenance decisions. In this way, the efficiency and accuracy of operation and maintenance can be significantly improved, and the risk of human error can be reduced.

[0106] According to the present application, the core of the alarm rule is to compare the monitoring indicator with the preset threshold to determine whether an alarm needs to be triggered. In some embodiments, the alarm rule includes: whether the monitoring indicator exceeds the set threshold, step S105, based on the monitoring indicator and the alarm rule, determines whether to issue an alarm, including:

[0107] Step S1051, determining whether the monitoring indicator exceeds a set threshold.

[0108] In this step, any indicators that may indicate system anomalies or performance issues are identified by comparing real-time or historical monitoring indicator data with preset thresholds.

[0109] In this step, the monitoring system collects monitoring indicator data of the target server periodically or in real time, compares the actual value of each monitoring indicator with the corresponding threshold, and records all monitoring indicators that exceed the threshold and the degree of excess.

[0110] Step S1052, determining whether an alarm is required based on whether the monitoring indicator exceeds a set threshold, wherein if the monitoring indicator exceeds the set threshold, determining that an alarm is required.

[0111] In this step, the electronic device can decide whether to trigger the alarm mechanism based on the comparison result of step S1051 so that the operation and maintenance team can respond in time.

[0112] In this step, the comparison result between the monitoring indicator recorded in step S1051 and the threshold is checked. If it is found that the actual value of any monitoring indicator exceeds the threshold set, it is determined that an alarm message needs to be generated and sent. If all monitoring indicators do not exceed the threshold set, no alarm is triggered.

[0113] In these embodiments, in the overall operation and maintenance process, step S105 is usually located between monitoring data collection (such as step S104) and alarm processing (such as step S106, including the generation, sending and subsequent processing of alarm information). In this way, it can be ensured that the alarm is triggered only when it is really needed, thereby avoiding unnecessary interference and ensuring the accuracy and timeliness of the alarm decision. At the same time, it can also provide the operation and maintenance team with timely and accurate problem feedback, which helps to quickly locate and solve system anomalies or performance problems.

[0114] In some embodiments, the method further comprises:

[0115] Step S107, when it is determined that an alarm is required, alarm information is generated, and the alarm information is deduplicated, aggregated and classified to obtain alarm information for the target server.

[0116] In this step, first, based on the monitoring indicators in the monitoring indicator repository and the preset alarm rules, the electronic device has been able to determine which servers have exceeded a threshold or reached an alarm condition for a certain indicator, so it is determined that an alarm is needed. Once it is determined that an alarm is needed, the electronic device will automatically generate an alarm message based on the triggered alarm rule. In large systems, due to the high granularity and frequency of monitoring, it may sometimes happen that the same problem triggers multiple alarms in a short period of time. In order to prevent the operation and maintenance personnel from being overwhelmed by repeated alarm information, the system needs to deduplicate the generated alarm information. Deduplication can be achieved by comparing the key fields of the alarm information (such as alarm type, target server, monitoring indicators, etc.) to ensure that the same problem only generates one alarm. For multiple alarm messages for the same target server in the same time period, the system can perform summary processing. The purpose of the summary is to integrate multiple related alarm messages into a more comprehensive alarm message so that the operation and maintenance personnel can understand the overall status of the target server at a glance. When summarizing, the key information of each alarm can be retained, and the main aspects of the problem can be highlighted in the summary information. In order to further improve the processing efficiency of alarm information, the electronic device can also classify the alarm information. Classification can be based on factors such as the nature of the alarm, the scope of impact, and the degree of urgency. For example, alarms that affect the key business of the system can be classified as "high priority", and alarms with less impact can be classified as "low priority". The classified alarm information can be sorted and displayed according to different priorities to help operation and maintenance personnel prioritize more urgent issues. After the above deduplication, aggregation and classification processing, the electronic device will eventually generate accurate alarm information for the target server. This information will more clearly and accurately reflect the current status and problems of the target server, providing strong support for operation and maintenance personnel.

[0117] In these embodiments, the effectiveness and processing efficiency of the alarm information are effectively improved through deduplication, aggregation and classification of the alarm information, providing important support for the implementation of the automated operation and maintenance method.

[0118] According to the operation and maintenance method of the present application, the monitoring indicator repository collects the monitoring indicators of the storage system, the log repository collects the operation logs of the storage system, and a log collector for the computer or business system is installed on the server. The log collector can read the logs generated by the computer or business system by itself and upload them to the log repository. A monitoring indicator collector for the computer or business system is installed on the server. The indicator repository regularly accesses the indicator collector installed on each server, collects the status data (monitoring indicators) of the server or business system, and stores it. The monitoring indicator repository stores the pre-configured alarm rules. The monitoring indicator repository judges the stored monitoring indicators based on the alarm rules. When an indicator of a system exceeds the threshold set in the alarm rule (or reaches the state specified in the alarm rule), the monitoring indicator repository will issue an alarm, and the alarm information will be sent to the alarm manager.

[0119] Based on the above embodiments, the steps of the operation and maintenance method of the present invention include the following:

[0120] The maintenance method according to the present application is highly integrated and automated, aiming to improve the efficiency and accuracy of system operation and maintenance. The following is an illustration using electronic equipment as an intelligent operation and maintenance platform as an example.

[0121] 1. The monitoring indicator repository collects storage system monitoring indicators, and the log repository collects storage system operation logs.

[0122] A log collector for computers or business systems is installed on the server. The log collector can read the logs generated by computers or business systems and upload them to the log repository.

[0123] A monitoring indicator collector for computers or business systems is installed on the server. The indicator repository periodically accesses the indicator collector installed on each server to collect and store the status data (monitoring indicators) of the server or business system.

[0124] The monitoring indicator repository stores pre-configured alarm rules. The monitoring indicator repository judges the stored monitoring indicators based on the alarm rules. When an indicator of a system exceeds the threshold set in the alarm rule (or reaches the state specified in the alarm rule), the monitoring indicator repository will issue an alarm, and the alarm information will be sent to the alarm manager.

[0125] 2. The alarm manager sends the alarm information to the core of the intelligent operation and maintenance platform.

[0126] The alarm manager aggregates and categorizes the received alarms, and sends different alarms to different recipients according to the configured routing rules. In this system, the alarm manager receives alarms from the monitoring indicator repository, deduplicates, aggregates, and categorizes them, and finally sends them to the core module of the intelligent operation and maintenance platform.

[0127] 3. The core module of the intelligent operation and maintenance platform receives alarm notifications from the alarm manager.

[0128] The intelligent operation and maintenance platform includes a webhook server that is dedicated to receiving and processing real-time data or event notifications from other systems or services.

[0129] 4. After receiving the alarm, the core of the intelligent operation and maintenance platform queries the monitoring data and log data.

[0130] Based on the received alarm notifications, the core of the intelligent operation and maintenance platform queries the monitoring indicator data and log data of the monitored object (server or business system) over a period of time from the monitoring indicator repository and log repository.

[0131] 5. The core of the intelligent operation and maintenance platform sends alarm notifications, monitoring indicators, and log data to the operation and maintenance prediction model inference service.

[0132] Deploy an open source operation and maintenance prediction model on a GPU server to provide inference services, referred to as the operation and maintenance prediction model inference service.

[0133] The core of the intelligent operation and maintenance platform uses the received alarm notifications, queried monitoring indicators and log data as problem descriptions, which are sent as requests to the operation and maintenance prediction model inference service, asking the operation and maintenance prediction model about the cause, solution, and relevant technical knowledge of the alarm, and requiring it to output the content in a fixed format.

[0134] 6. The core of the intelligent operation and maintenance platform receives the output from the operation and maintenance prediction model inference service.

[0135] The core of the intelligent operation and maintenance platform receives output from the operation and maintenance prediction model reasoning service, including cause analysis, solutions, preventive measures, and technical documents. The solutions may include relevant problem repair codes.

[0136] 7. The intelligent operation and maintenance platform pushes the received output to the code repository.

[0137] The intelligent operation and maintenance platform divides alarm notifications, fault causes, solutions, repair codes, and technical documents according to content types and stores them in different files. A code project is created and the above files are added to the code project. Finally, the newly created code project is uploaded to the code repository.

[0138] 8. The core of the intelligent operation and maintenance platform notifies the operation and maintenance personnel.

[0139] After completing step 7, the core module of the intelligent operation and maintenance platform sends a notification to the operation and maintenance personnel, which contains the alarm notification, the cause of the fault, the solution, and the technical documentation, and asks the operation and maintenance personnel whether to perform the repair procedure. If the operation and maintenance personnel feedback does not perform the repair, the system does not perform additional operations. If the operation and maintenance personnel feedback performs the repair, continue to step 9.

[0140] 9. The intelligent operation and maintenance platform sends execution and repair instructions to the automation engine or operation and maintenance tool.

[0141] An automation engine is a software system or tool that automates a series of tasks or processes to reduce manual intervention and improve efficiency and consistency. The automation engine can save multiple credentials configured in advance by operation and maintenance personnel, and the automation engine can use these credentials to access servers, business systems, code repositories and other systems.

[0142] Operation and maintenance tools are software that can perform functions such as configuration management, application deployment, and task automation.

[0143] 10. The automation engine pulls the repair code from the code repository.

[0144] The automation engine can pull (download) code from the code repository based on the installed code repository plug-in and pre-configured access credentials.

[0145] 11. The automation engine executes code on each server.

[0146] The automation engine uses the functions installed by the plug-in to connect to the faulty server or business system, execute the fault repair code on the server or business system, and repair the fault.

[0147] In some embodiments, the automation engine can be replaced by an operations tool

[0148] Using operation and maintenance tools can also connect to servers or business systems and perform corresponding repair procedures. Operation and maintenance tools are software that can perform functions such as configuration management, application deployment, and task automation. Ansible is such an operation and maintenance tool.

[0149] In some embodiments, the Jenkins automation engine can be used to replace the core of the intelligent operation and maintenance platform.

[0150] You can use Jenkins to replace the core module of the intelligent operation and maintenance platform, create a pipeline project in Jenkins, which contains a pipeline, and configure a webhook trigger for the project. After configuring the trigger, you will get a Webhook URL. Set it in Alertmanager, and when an alarm is issued, access the Webhook URL. That is, the Alertmanager alarm notification triggers the Jenkins project pipeline.

[0151] In an embodiment of the present application, the Jenkins environment variables can be used to obtain the alarm notification content sent in the webhook request, and the alarm notification can be parsed to obtain the server (for example, an IP) and business system (for example, an IP+service name) where the alarm occurs.

[0152] Query monitoring data (within a period of time, such as 2 hours) from the monitoring indicator repository, and query logs (within a period of time) from the log repository; send alarm notifications, monitoring indicators, and log data as requests to the operation and maintenance prediction model inference service, and specify the format of the returned content.

[0153] Receive the processing results returned by the operation and maintenance prediction model inference service, divide the content and write it into different files.

[0154] Create a git project, add the generated files to the git project, and push the newly created git project to the Gitlab code repository for storage.

[0155] Send an operation and maintenance event notification to the operation and maintenance personnel through email, SMS, etc., and wait for the operation and maintenance personnel's input confirmation, and determine whether to continue to execute the subsequent steps based on the input. If the operation and maintenance personnel confirm to perform the repair, connect to the server with the alarm in step 1, and generate the code file (or repair program). Or use git to pull the code file pushed to gitlab and execute the repair program.

[0156] In some embodiments, while retaining the core of the intelligent operation and maintenance platform, the core module of the intelligent operation and maintenance platform directly calls Jenkins to execute the pipeline (pull code, connect to the server, and execute repair code).

[0157] According to this application, the operation and maintenance method can realize the full automation process of the server from fault discovery to fault resolution by integrating multiple links such as monitoring, alarm, intelligent analysis and automated execution, which greatly reduces the burden of operation and maintenance personnel and improves operation and maintenance efficiency and system stability.

[0158] Based on the above embodiments, the present invention provides a method for training an operation and maintenance prediction model. Figure 2A schematic diagram of the implementation flow of a training method for an operation and maintenance prediction model provided in an embodiment of the present application is shown in FIG. Figure 2 As shown, including:

[0159] Step S201, obtaining a sample data set, wherein each sample data in the sample data set includes: sample monitoring data, sample log data, sample alarm information and a corresponding sample operation and maintenance plan.

[0160] Step S202: input the sample monitoring data, sample log data, and sample alarm information of each sample data into an operation and maintenance prediction model, and use the operation and maintenance prediction model to determine a predicted operation and maintenance solution corresponding to the sample data.

[0161] Step S203, adjusting the parameters of the operation and maintenance prediction model based on the sample operation and maintenance solution and the predicted operation and maintenance solution corresponding to each sample data in the sample data set to obtain a trained operation and maintenance prediction model.

[0162] In an embodiment of the present application, the sample data set can be divided into a training set and a test set, the initial operation and maintenance prediction model is trained with the training set, and the model parameters are adjusted using appropriate loss functions and optimization algorithms.

[0163] After training is completed, use the test set to evaluate the model and calculate indicators such as precision, recall, and F1-score to understand the performance of the model.

[0164] In the embodiment of the present application, when the operation and maintenance prediction model obtained through training is evaluated to meet the requirements, the trained model is deployed to the production environment.

[0165] The method provided in the embodiment of the present application establishes an effective operation and maintenance prediction model, thereby improving the efficiency and accuracy of operation and maintenance management.

[0166] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0167] According to the aforementioned embodiments, the embodiments of the present application provide an operation and maintenance device, and the modules included in the device and the units included in the modules can be implemented by a processor in a computer device; of course, they can also be implemented by a specific logic circuit; in the implementation process, the processor can be a central processing unit (CPU, Central Processing Unit), a microprocessor (MPU, Microprocessor Unit), a digital signal processor (DSP, Digital Signal Processing) or a field programmable gate array (FPGA, Field Programmable Gate Array), etc.

[0168] The present application embodiment provides an operation and maintenance device, Figure 3 A schematic diagram of the structure of an operation and maintenance device provided in an embodiment of the present application is shown in FIG. Figure 3 As shown, the operation and maintenance device 400 includes:

[0169] The acquisition module 401 is used to acquire monitoring data and log data of the target server when alarm information for the target server is acquired;

[0170] A determination module 402, configured to input the monitoring data, the log data and the alarm information into an operation and maintenance prediction model, and determine an operation and maintenance plan for the target server by the operation and maintenance prediction model;

[0171] The operation and maintenance module 403 is used to maintain the target server based on the operation and maintenance solution.

[0172] In some embodiments, the operation and maintenance solution includes: repairing code, and maintaining the target server based on the operation and maintenance solution includes:

[0173] Upload the repair code to the code repository;

[0174] A repair instruction is sent to the target server, so that the target server downloads the repair code from the code repository through a repair tool, and executes the repair code on the target server.

[0175] In some embodiments, the operation and maintenance plan includes: alarm information, fault cause, solution and technical documents, and the target server is maintained based on the operation and maintenance plan, wherein the technical documents include: repair code, including:

[0176] Generate alarm notification information based on the repair code, the alarm information, the cause of the fault, the solution and the technical document;

[0177] Outputting the alarm notification information to an operation and maintenance personnel so that the operation and maintenance personnel can determine whether to perform maintenance on the target server;

[0178] When it is obtained that the operation and maintenance personnel determine to perform maintenance on the target server, the server is maintained based on the repair code.

[0179] In some embodiments, the method further comprises:

[0180] Obtain monitoring indicators of the target server;

[0181] Determine whether an alarm is required based on the monitoring indicators and alarm rules;

[0182] When it is determined that an alarm is required, an alarm message is generated.

[0183] In some embodiments, the alarm rule includes: whether the monitoring indicator exceeds a set threshold, and determining whether to issue an alarm based on the monitoring indicator and the alarm rule includes:

[0184] Determine whether the monitoring indicator exceeds a set threshold;

[0185] Whether an alarm needs to be issued is determined based on whether the monitoring indicator exceeds a set threshold, wherein if the monitoring indicator exceeds the set threshold, it is determined that an alarm needs to be issued.

[0186] In some embodiments, the method further comprises:

[0187] When it is determined that an alarm is required, alarm information is generated, and the alarm information is deduplicated, aggregated, and classified to obtain alarm information for the target server.

[0188] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0189] in addition, Figure 3 The operation and maintenance device shown may be a software unit, a hardware unit, or a combination of software and hardware units built into an existing electronic device, or may be integrated into the electronic device as an independent pendant, or may exist as an independent terminal device.

[0190] The present application embodiment further provides a training device for an operation and maintenance prediction model, comprising:

[0191] A sample data acquisition module is used to acquire a sample data set, wherein each sample data in the sample data set includes: sample monitoring data, sample log data, sample alarm information and a corresponding sample operation and maintenance plan;

[0192] A training module is used to input the sample monitoring data, sample log data, and sample alarm information of each sample data into the operation and maintenance prediction model, and the operation and maintenance prediction model determines the predicted operation and maintenance scheme corresponding to the sample data; and adjusts the parameters of the operation and maintenance prediction model based on the sample operation and maintenance scheme and the predicted operation and maintenance scheme corresponding to each sample data in the sample data set, so as to obtain the trained operation and maintenance prediction model. A person skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit, and the above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of each functional unit and module are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working processes of the units and modules in the above system can refer to the corresponding processes in the above method embodiments, which will not be repeated here.

[0193] Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 4 As shown, the electronic device 4 of this embodiment may include: at least one processor 30 ( Figure 4 Only one processor 30 is shown in the figure), a memory 31, and a computer program 32 stored in the memory 31 and executable on at least one processor 30. When the processor 30 executes the computer program 32, the steps in any of the above-mentioned method embodiments are implemented. For example, Figure 1 Steps S101 to S103 in the illustrated embodiment, or, Figure 2 Alternatively, when the processor 30 executes the computer program 32, the functions of each module / unit in the above-mentioned device embodiments are realized, for example Figure 3 Functions of modules 401 to 403 are shown.

[0194] Exemplarily, the computer program 32 may be divided into one or more modules / units, one or more modules / units are stored in the memory 31, and are executed by the processor 30 to complete the present application. One or more modules / units may be a series of computer program 32 instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program 32 in the electronic device 3.

[0195] The embodiment of the present application further provides a computer-readable storage medium, which stores a computer program 32. When the computer program 32 is executed by the processor 30, the steps in the above-mentioned method embodiments can be implemented.

[0196] An embodiment of the present application provides a computer program product. When the computer program product runs on an electronic device, the electronic device can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0197] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. According to this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program 32, and the computer program 32 can be stored in a computer-readable storage medium, and the computer program 32 can implement the steps of the above-mentioned various method embodiments when executed by the processor 30. Among them, the computer program 32 includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device capable of carrying the computer program code to the terminal, a recording medium, a computer memory, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), an electric carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0198] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0199] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0200] In the embodiments provided in the present application, it should be understood that the disclosed devices / network equipment and methods can be implemented in other ways. For example, the device / network equipment embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0201] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0202] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. An operation and maintenance method, characterized in that: include: When alarm information for a target server is obtained, monitoring data and log data of the target server are obtained; Inputting the monitoring data, the log data and the alarm information into an operation and maintenance prediction model, and determining an operation and maintenance plan for the target server by the operation and maintenance prediction model; Maintain the target server based on the operation and maintenance plan.

2. The method according to claim 1, characterized in that: The operation and maintenance plan includes: repairing code, and maintaining the target server based on the operation and maintenance plan includes: Upload the repair code to the code repository; A repair instruction is sent to the target server, so that the target server downloads the repair code from the code repository through a repair tool, and executes the repair code on the target server.

3. The method according to claim 1, characterized in that: The operation and maintenance plan includes: alarm information, fault cause, solution and technical documents, wherein the technical documents include: repair code, and the maintenance of the target server based on the operation and maintenance plan includes: Generate alarm notification information based on the repair code, the alarm information, the cause of the fault, the solution and the technical document; Outputting the alarm notification information to an operation and maintenance personnel so that the operation and maintenance personnel can determine whether to perform maintenance on the target server; When it is obtained that the operation and maintenance personnel determine to perform maintenance on the target server, the server is maintained based on the repair code.

4. The method according to claim 1, characterized in that: The method further comprises: Obtain monitoring indicators of the target server; Determine whether an alarm is required based on the monitoring indicators and alarm rules; When it is determined that an alarm is required, an alarm message is generated.

5. The method according to claim 4, characterized in that The alarm rule includes: whether the monitoring indicator exceeds a set threshold, and determining whether to issue an alarm based on the monitoring indicator and the alarm rule includes: Determine whether the monitoring indicator exceeds a set threshold; Whether an alarm needs to be issued is determined based on whether the monitoring indicator exceeds a set threshold, wherein if the monitoring indicator exceeds the set threshold, it is determined that an alarm needs to be issued.

6. The method according to claim 5, characterized in that The method further comprises: When it is determined that an alarm is required, alarm information is generated, and the alarm information is deduplicated, aggregated, and classified to obtain alarm information for the target server.

7. A training method for an operation and maintenance prediction model, characterized in that: include: Acquire a sample data set, wherein each sample data in the sample data set includes: sample monitoring data, sample log data, sample alarm information and a corresponding sample operation and maintenance plan; Inputting the sample monitoring data, sample log data, and sample alarm information of each sample data into an operation and maintenance prediction model, and using the operation and maintenance prediction model to determine a predicted operation and maintenance solution corresponding to the sample data; The parameters of the operation and maintenance prediction model are adjusted based on the sample operation and maintenance solution and the predicted operation and maintenance solution corresponding to each sample data in the sample data set to obtain a trained operation and maintenance prediction model.

8. An operation and maintenance device, characterized in that: include: An acquisition module, used to acquire monitoring data and log data of a target server when alarm information for the target server is acquired; A determination module, used to input the monitoring data, the log data and the alarm information into an operation and maintenance prediction model, and determine the operation and maintenance plan of the target server by the operation and maintenance prediction model; An operation and maintenance module is used to maintain the target server based on the operation and maintenance solution.

9. A training device for an operation and maintenance prediction model, characterized in that: include: A sample data acquisition module is used to acquire a sample data set, wherein each sample data in the sample data set includes: sample monitoring data, sample log data, sample alarm information and a corresponding sample operation and maintenance plan; A training module, used to input the sample monitoring data, sample log data, and sample alarm information of each sample data into an operation and maintenance prediction model, and the operation and maintenance prediction model determines a prediction operation and maintenance solution corresponding to the sample data; and The parameters of the operation and maintenance prediction model are adjusted based on the sample operation and maintenance solution and the predicted operation and maintenance solution corresponding to each sample data in the sample data set to obtain a trained operation and maintenance prediction model.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the method according to any one of claims 1 to 7 is implemented.

11. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images