Analysis method, device, equipment and storage medium for operation and maintenance tasks

Abstract

The present application relates to an analysis method, device, equipment and storage medium for operation and maintenance tasks, the method comprising: obtaining status information of the operation and maintenance tasks in operation, filtering out target operation and maintenance tasks with abnormal current operation status according to the status information and obtaining log information related to the target operation and maintenance tasks, matching the log information related to the target operation and maintenance tasks with the log set corresponding to the feedback content in the preset rule base to obtain a matching result, wherein the feedback content includes cause analysis content and processing suggestion content, if the matching result indicates a successful match, sending the target feedback content in the matching result to the target user, so that the target user can analyze the target operation and maintenance task based on the target feedback content, if the matching result indicates a failed match, generating feedback content corresponding to the target operation and maintenance task and storing it in the rule base. The present application can improve the analysis efficiency of abnormal tasks.

Description

Technical Field

[0001] The present application relates to the technical field of task analysis, and in particular to an analysis method, device, equipment and storage medium for operation and maintenance tasks. Background Art

[0002] During the operation of tasks submitted by operation and maintenance personnel, abnormalities may occur due to hardware, resources, task parameters or task syntax. When an operation and maintenance task has an abnormality, the operation and maintenance personnel need to view the log and analyze the cause of the abnormality during task operation through the log. This requires the operation and maintenance personnel to view a large amount of log information through jump operations. Moreover, for operation and maintenance personnel who lack analysis experience, it is difficult to quickly analyze the cause of the abnormality during task operation, resulting in low analysis efficiency of abnormal tasks.

[0003] Therefore, how to improve the analysis efficiency of abnormal tasks has become a technical problem that needs to be solved urgently by technical personnel in this field. Summary of the invention

[0004] In view of the above, the present application provides an analysis method, device, equipment and storage medium for operation and maintenance tasks, which aims to solve the above technical problems.

[0005] In a first aspect, the present application provides a method for analyzing an operation and maintenance task, the method comprising:

[0006] Get the status information of the running operation and maintenance tasks;

[0007] According to the status information, filter out target operation and maintenance tasks with abnormal current operation status and obtain log information related to the target operation and maintenance tasks;

[0008] Matching the log information related to the target operation and maintenance task with the log set corresponding to the feedback content in the preset rule base to obtain a matching result, wherein the feedback content includes cause analysis content and processing suggestion content;

[0009] If the matching result indicates a successful match, the target feedback content in the matching result is sent to the target user, so that the target user can analyze the target operation and maintenance task based on the target feedback content;

[0010] If the matching result indicates a matching failure, feedback content corresponding to the target operation and maintenance task is generated and stored in the rule base.

[0011] In a second aspect, the present application provides an analysis device for operation and maintenance tasks, the device comprising:

[0012] Acquisition module: used to obtain the status information of the running operation and maintenance tasks;

[0013] A screening module is used to screen out target operation and maintenance tasks with abnormal current operation status according to the status information and obtain log information related to the target operation and maintenance tasks;

[0014] Matching module: used to match the log information related to the target operation and maintenance task with the log set corresponding to the feedback content in the preset rule base to obtain a matching result, wherein the feedback content includes cause analysis content and processing suggestion content;

[0015] The first processing module is used for sending the target feedback content in the matching result to the target user if the matching result indicates that the matching is successful, so that the target user can analyze the target operation and maintenance task based on the target feedback content;

[0016] The second processing module is used to generate feedback content corresponding to the target operation and maintenance task and store it in the rule base if the matching result indicates a matching failure.

[0017] In a third aspect, the present application provides an electronic device, including a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus;

[0018] Memory, used to store computer programs;

[0019] The processor is used to implement the analysis method of the operation and maintenance tasks described in any one of the embodiments of the first aspect when executing the program stored in the memory.

[0020] In a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the method for analyzing operation and maintenance tasks as described in any embodiment of the first aspect is implemented.

[0021] The above technical solution provided by the embodiment of the present application has the following advantages compared with the prior art:

[0022] This application obtains the status information of the operation and maintenance tasks in operation, and according to the status information, screens out the target operation and maintenance tasks with abnormal current operation status and obtains the log information related to the target operation and maintenance tasks, and matches the log information related to the target operation and maintenance tasks with the log set corresponding to the feedback content in the preset rule base to obtain the matching result, wherein the feedback content includes the cause analysis content and the processing suggestion content. If the matching result indicates that the match is successful, the target feedback content in the matching result is sent to the target user, so that the target user can analyze the target operation and maintenance task based on the target feedback content. If the matching result indicates that the match fails, the feedback content corresponding to the target operation and maintenance task is generated and stored in the rule base. When an abnormality occurs in the task during operation, the cause analysis content and the processing suggestion content can be matched from the rule base, which reduces the learning cost of the operation and maintenance personnel in analyzing the task and improves the analysis efficiency of abnormal tasks. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0024] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0025] Figure 1 This is a flowchart of an embodiment of an analysis method for operation and maintenance tasks of this application;

[0026] Figure 2 A schematic diagram of a module of an embodiment of an analysis device for operation and maintenance tasks of this application;

[0027] Figure 3 A schematic diagram of an electronic device embodiment of the present application;

[0028] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0029] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0030] The disclosure below provides many different embodiments or examples to realize the different structures of the present application. In order to simplify the disclosure of the present application, the parts and settings of specific examples are described below. Of course, they are only examples, and the purpose is not to limit the present application. In addition, the present application can repeat reference numbers and / or letters in different examples. This repetition is for the purpose of simplification and clarity, and does not itself indicate the relationship between the various embodiments and / or settings discussed.

[0031] This application provides an analysis method for operation and maintenance tasks. Figure 1 The figure is a schematic diagram of a method flow of an embodiment of the method for analyzing operation and maintenance tasks of the present application. The method can be executed by an electronic device, and the electronic device can be implemented by software and / or hardware. The method for analyzing operation and maintenance tasks includes:

[0032] Step S10: Obtaining status information of the running operation and maintenance tasks;

[0033] Step S20: According to the status information, filter out target operation and maintenance tasks whose current operation status is abnormal and obtain log information related to the target operation and maintenance tasks;

[0034] Step S30: matching the log information related to the target operation and maintenance task with the log set corresponding to the feedback content in the preset rule base to obtain a matching result, wherein the feedback content includes cause analysis content and processing suggestion content;

[0035] Step S40: If the matching result indicates a successful match, the target feedback content in the matching result is sent to the target user, so that the target user can analyze the target operation and maintenance task based on the target feedback content;

[0036] Step S50: If the matching result indicates a matching failure, feedback content corresponding to the target operation and maintenance task is generated and stored in the rule base.

[0037] In this embodiment, the operation and maintenance tasks can be various tasks submitted by the operation and maintenance personnel. For example, the operation and maintenance tasks can be tasks of frameworks such as spark, hive, and flink. When an operation and maintenance task is abnormal, the operation and maintenance personnel need to check the logs and analyze the problems existing during the task operation, resulting in low efficiency of task analysis. To this end, this embodiment provides a method for automatically analyzing operation and maintenance tasks to improve the analysis efficiency of operation and maintenance tasks.

[0038] Specifically, based on the unique identifier of the operation and maintenance task (for example, the ID number), the status information of the running operation and maintenance task is obtained, and based on the obtained status information of the operation and maintenance task, it is determined whether the current running status of the operation and maintenance task is normal or abnormal. For the operation and maintenance task whose current running status is normal, its running information is recorded normally.

[0039] For an operation and maintenance task whose current running status is abnormal (recorded as a target operation and maintenance task), it is necessary to obtain log information related to the target operation and maintenance task, and match the log information of the target operation and maintenance task with the log set of the pre-configured rule base to determine the cause of the abnormality for relevant user information analysis. Among them, the rule base stores a large number of pre-defined log sets and feedback content, and the feedback content includes cause analysis content and processing suggestion content. The log set and the feedback content have a corresponding relationship. For example, log set 1 has corresponding feedback content 1, and log set n has corresponding feedback content n.

[0040] The step of "screening out target operation and maintenance tasks whose current running status is abnormal according to the status information and obtaining log information related to the target operation and maintenance tasks" includes:

[0041] Analyze the status information to obtain the current running status of the operation and maintenance task;

[0042] Filter out the operation and maintenance tasks with abnormal current running status as target operation and maintenance tasks;

[0043] According to the identification information of the target operation and maintenance task, log information related to the target operation and maintenance task is obtained.

[0044] By parsing the status information of the running operation and maintenance tasks, the current running status of the operation and maintenance tasks can be obtained, and the operation and maintenance tasks with abnormal current running status can be filtered out as the target operation and maintenance tasks. Since the identification information can uniquely identify the operation and maintenance tasks, all log information related to the target operation and maintenance tasks can be obtained based on the identification information of the target operation and maintenance tasks.

[0045] The log information related to the target operation and maintenance task is matched with the log set corresponding to the feedback content in the preset rule base to obtain the matching result. If the matching result indicates that the match is successful (i.e., the target feedback content is matched), the target feedback content in the matching result is sent to the target user (e.g., the operation and maintenance personnel) so that the target user can analyze the operation and maintenance task with abnormal current running status based on the target feedback content. Since the feedback content includes the cause analysis content and the processing suggestion content, it can be judged that the cause of the task abnormality is a hardware problem, resource, task parameter, or syntax problem of the task itself. For example, if the running status of a Hive on YARN task is failed, all the log information of the task is obtained through the API interface according to the task ID, and the target feedback content is matched through the log information and the rule base. The cause analysis content in the target feedback content may be the information that the underlying machine hardware failure causes the abnormality, causing the connection to the machine to time out. The target user can also score the effectiveness of the cause analysis content and processing suggestion content obtained by matching, so as to continuously optimize the matching rules.

[0046] If the matching result indicates a match failure (i.e., the target feedback content is not matched), feedback content corresponding to the target operation and maintenance task can be generated and stored in the rule base. For example, the ID, ERROR and WARN level log information of the target operation and maintenance task is recorded in the database, and the task is marked as not matching the target feedback content. Subsequent users can provide feedback content corresponding to the task and store it in the rule base. Specifically, the above step of "generating feedback content corresponding to the target operation and maintenance task and storing it in the rule base" includes:

[0047] The target operation and maintenance task is sent to a target user, so that the target user can analyze the feedback content corresponding to the target operation and maintenance task based on the target operation and maintenance task, and the feedback content corresponding to the target operation and maintenance task is associated with the target operation and maintenance task and stored in the rule base.

[0048] The target operation and maintenance tasks that do not match the target feedback content are sent to the target user. The user can analyze the abnormal feedback content (i.e., the cause analysis content and the processing suggestion content) according to the log information of the task, establish a mapping relationship between the feedback content corresponding to the task and the task, and store it in the rule base. When the subsequent tasks encounter the same abnormal situation during operation, the cause analysis content and the processing suggestion content can be matched from the rule base, which reduces the learning cost of the operation and maintenance personnel and improves the efficiency of abnormal task analysis.

[0049] In one embodiment, the above step of "matching the log information related to the target operation and maintenance task with the log set corresponding to the feedback content in the preset rule library to obtain a matching result" includes:

[0050] Encoding the log information to obtain a coding feature of the log information;

[0051] Encoding each log set in the rule base to obtain encoding features of each log set;

[0052] The encoding features of the log information are matched with the encoding features of each log set to obtain matching results.

[0053] A log usually contains a timestamp, a log level, and an event description. Feature values ​​(e.g., year, month, day, hour, minute, etc.) can be extracted from the timestamp. The log levels INFO, WARN, and ERROR are converted into integer values ​​as feature values. The event description in the log information is aggregated to obtain the feature value of the log information. The event description can also be mapped to a feature value of a fixed dimension using a pre-trained word vector model (e.g., Word2Vec model). The timestamp, log level, and feature values ​​of the event description of the log information are then concatenated and combined as the encoding feature of the log. The encoding features of each log set in the rule base are generated in a similar manner. The encoding features of each log set in the rule base can be pre-generated so that they can be quickly matched later. The encoding features of the log information are matched with the encoding features of each log set in the rule base respectively. For example, the similarity value between the encoding features of the log information and the encoding features of the log set is calculated using the cosine similarity algorithm as the matching value. The log set with the highest matching value and the feedback content corresponding to the log set can be used as the matching result.

[0054] Furthermore, since there may be multiple log sets with high matching values, or there may not be any log set with high matching values, when there are multiple log sets with high matching values, the matching results can be further screened out from the multiple log sets with high matching values, or when there is no log set with high matching values, the matching results can be obtained by matching in other ways. Specifically, the above step of "matching the encoding features of the log information with the encoding features of each log set to obtain the matching results" includes:

[0055] Matching the encoding features of the log information with the encoding features of each log set respectively to obtain a matching value between the log information and each log set;

[0056] Determine whether there is a matching value greater than a preset value;

[0057] If it exists, score the target log set corresponding to the matching value greater than the preset value to obtain the matching result;

[0058] If not, the keywords of the log information are matched with the keywords of each log set to obtain a matching result.

[0059] Match the encoding features of the log information with the encoding features of each log set respectively, obtain the matching value between the log information and each log set, and determine whether there is a matching value greater than a preset value. The preset value can be set according to actual needs. If so, score the log set (referred to as the target log set) corresponding to the matching value greater than the preset value according to the matching value, the number of common keywords and the matched time to obtain the matching result.

[0060] If there is no matching value greater than the preset value, the matching result is obtained by matching the keywords of the log information with the keywords of each log set. For example, the words with higher frequency in the log information and the log set are used as keywords and converted into word vectors for matching. If there is still no match, it means that the matching result indicates that the matching failed.

[0061] Furthermore, the above “scoring the target log set corresponding to the matching degree value greater than the preset value to obtain the matching result” includes:

[0062] Scoring the target log sets corresponding to the matching values ​​greater than the preset value according to the preset formula to obtain the scoring value of each target log set;

[0063] The score value of each target log set is sorted from large to small to obtain a sorting result, and a preset number of target log sets are selected from the sorting result as the matching result.

[0064] After calculating the score value of each target log set, sort the score value of each target log set from large to small to obtain a sorting result, and select a preset number of target log sets from the sorting result as the final matching result. The preset number can be set according to actual needs. For example, if the preset number is 2 and there are 5 target log sets in the sorting result, the two target log sets with the highest score values ​​are selected from the sorting result as the matching results.

[0065] The preset formulas include:

[0066]

[0067] Wherein, S represents the score value of the target log set, K xy represents the matching value between the target log set and the log information, M represents the number of common keywords between the target log set and the log information, W represents the preset matching weight, a Indicates the preset heat coefficient, which represents the frequency of the target log set being used as a matching result. D Indicates the time when the target log set was last used as a matching result from the current time. D 0 Indicates the current time.

[0068] Reference Figure 2 As shown, it is a schematic diagram of the functional modules of the analysis device 100 for the operation and maintenance tasks of this application.

[0069] The analysis device 100 for the operation and maintenance task described in the present application can be installed in an electronic device. According to the functions implemented, the analysis device 100 for the operation and maintenance task may include an acquisition module 110, a screening module 120, a matching module 130, a first processing module 140 and a second processing module 150. The module described in the present application may also be referred to as a unit, which refers to a series of computer program segments that can be executed by an electronic device processor and can complete fixed functions, which are stored in the memory of the electronic device.

[0070] In this embodiment, the functions of each module / unit are as follows:

[0071] Acquisition module 110: used to obtain status information of the running operation and maintenance tasks;

[0072] Screening module 120: used to screen out target operation and maintenance tasks whose current running status is abnormal according to the status information and obtain log information related to the target operation and maintenance tasks;

[0073] Matching module 130: used to match the log information related to the target operation and maintenance task with the log set corresponding to the feedback content in the preset rule base to obtain a matching result, wherein the feedback content includes cause analysis content and processing suggestion content;

[0074] The first processing module 140 is configured to send the target feedback content in the matching result to the target user if the matching result indicates a successful match, so that the target user can analyze the target operation and maintenance task based on the target feedback content;

[0075] The second processing module 150 is configured to generate feedback content corresponding to the target operation and maintenance task and store it in the rule base if the matching result indicates a matching failure.

[0076] In one embodiment, the filtering out target operation and maintenance tasks whose current running status is abnormal according to the status information and obtaining log information related to the target operation and maintenance tasks includes:

[0077] Analyze the status information to obtain the current running status of the operation and maintenance task;

[0078] Filter out the operation and maintenance tasks with abnormal current running status as target operation and maintenance tasks;

[0079] According to the identification information of the target operation and maintenance task, log information related to the target operation and maintenance task is obtained.

[0080] In one embodiment, the matching result obtained by matching the log information related to the target operation and maintenance task with the log set corresponding to the feedback content in the preset rule base includes:

[0081] Encoding the log information to obtain a coding feature of the log information;

[0082] Encoding each log set in the rule base to obtain encoding features of each log set;

[0083] The encoding features of the log information are matched with the encoding features of each log set to obtain matching results.

[0084] In one embodiment, matching the encoding features of the log information with the encoding features of each log set to obtain a matching result includes:

[0085] Matching the encoding features of the log information with the encoding features of each log set respectively to obtain a matching value between the log information and each log set;

[0086] Determine whether there is a matching value greater than a preset value;

[0087] If it exists, score the target log set corresponding to the matching value greater than the preset value to obtain the matching result;

[0088] If not, the keywords of the log information are matched with the keywords of each log set to obtain a matching result.

[0089] In one embodiment, scoring the target log set corresponding to the matching degree value greater than the preset value to obtain the matching result includes:

[0090] Scoring the target log sets corresponding to the matching values ​​greater than the preset value according to the preset formula to obtain the scoring value of each target log set;

[0091] The score value of each target log set is sorted from large to small to obtain a sorting result, and a preset number of target log sets are selected from the sorting result as the matching result.

[0092] In one embodiment, the preset formula includes:

[0093]

[0094] Wherein, S represents the score value of the target log set, K xy represents the matching value between the target log set and the log information, M represents the number of common keywords between the target log set and the log information, W represents the preset matching weight, a Indicates the preset heat coefficient, D Indicates the time when the target log set was last used as a matching result from the current time. D 0 Indicates the current time.

[0095] In one embodiment, generating feedback content corresponding to the target operation and maintenance task and storing it in the rule base includes:

[0096] The target operation and maintenance task is sent to a target user, so that the target user can analyze the feedback content corresponding to the target operation and maintenance task based on the target operation and maintenance task, and the feedback content corresponding to the target operation and maintenance task is associated with the target operation and maintenance task and stored in the rule base.

[0097] Reference Figure 3 , which is a schematic diagram of a preferred embodiment of the electronic device of the present application.

[0098] The electronic device includes a processor 111, a communication interface 112, a memory 113 and a communication bus 114, wherein the processor 111, the communication interface 112, and the memory 113 communicate with each other via the communication bus 114;

[0099] Memory 113, used to store computer programs, for example, analysis programs for operation and maintenance tasks;

[0100] In some embodiments, the processor 111 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other data processing chips. The processor 111 is generally used to control the overall operation of the electronic device, such as performing control and processing related to data interaction or communication. In this embodiment, the processor 111 is used to run the program code stored in the memory 113 or process data, such as running the program code of the analysis program of the operation and maintenance task.

[0101] The communication interface 112 may optionally include a standard wired interface, a wireless interface (such as a WI-FI interface), and the communication interface 112 may also be used to establish a communication connection between the electronic device and other electronic devices.

[0102] The memory 113 includes at least one type of readable storage medium, and the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, disk, optical disk, etc. In some embodiments, the memory 113 may be an internal storage unit of the electronic device, such as a hard disk or memory of the electronic device. In other embodiments, the memory 113 may also be an external storage device of the electronic device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped with the electronic device. Of course, the memory 113 may also include both the internal storage unit of the electronic device and its external storage device. In this embodiment, the memory 11 is generally used to store the operating system and various computer programs installed in the electronic device, such as the program code of the analysis program of the operation and maintenance task, etc. In addition, the memory 113 may also be used to temporarily store various types of data that have been output or are to be output.

[0103] In one embodiment of the present application, the processor 111 is used to implement the analysis method of the operation and maintenance task provided by any one of the aforementioned method embodiments when executing the program stored in the memory 113, including:

[0104] Get the status information of the running operation and maintenance tasks;

[0105] According to the status information, filter out target operation and maintenance tasks with abnormal current operation status and obtain log information related to the target operation and maintenance tasks;

[0106] Matching the log information related to the target operation and maintenance task with the log set corresponding to the feedback content in the preset rule base to obtain a matching result, wherein the feedback content includes cause analysis content and processing suggestion content;

[0107] If the matching result indicates a successful match, the target feedback content in the matching result is sent to the target user, so that the target user can analyze the target operation and maintenance task based on the target feedback content;

[0108] If the matching result indicates a matching failure, feedback content corresponding to the target operation and maintenance task is generated and stored in the rule base.

[0109] For a detailed description of the above steps, please refer to the above Figure 1 Description of a flowchart of an embodiment of an analysis method for operation and maintenance tasks.

[0110] In addition, the embodiment of the present application also proposes a computer-readable storage medium, which may be non-volatile or volatile. The computer-readable storage medium includes a data storage area and a program storage area, and the program storage area stores an analysis program for operation and maintenance tasks. When the analysis program for operation and maintenance tasks is executed by a processor, the following operations are implemented:

[0111] Get the status information of the running operation and maintenance tasks;

[0112] According to the status information, filter out target operation and maintenance tasks with abnormal current operation status and obtain log information related to the target operation and maintenance tasks;

[0113] Matching the log information related to the target operation and maintenance task with the log set corresponding to the feedback content in the preset rule base to obtain a matching result, wherein the feedback content includes cause analysis content and processing suggestion content;

[0114] If the matching result indicates a successful match, the target feedback content in the matching result is sent to the target user, so that the target user can analyze the target operation and maintenance task based on the target feedback content;

[0115] If the matching result indicates a matching failure, feedback content corresponding to the target operation and maintenance task is generated and stored in the rule base.

[0116] The specific implementation of the computer-readable storage medium of the present application is roughly the same as the specific implementation of the analysis method of the above-mentioned operation and maintenance tasks, and will not be repeated here.

[0117] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0118] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a general hardware platform, and of course, by hardware. Based on this understanding, the above technical solution, in essence, or the part that contributes to the relevant technology, can be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiment.

[0119] It should be noted that the descriptions involving "first", "second", etc. in this application are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in this field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0120] It should be understood that the terms used herein are only for the purpose of describing specific example embodiments and are not intended to be limiting. Unless the context clearly indicates otherwise, the singular forms "one", "an" and "said" as used herein may also be meant to include plural forms. The terms "include", "comprise", "contain", and "have" are inclusive, and therefore specify the existence of stated features, steps, operations, elements and / or parts, but do not exclude the existence or addition of one or more other features, steps, operations, elements, parts, and / or combinations thereof. The method steps, processes, and operations described herein are not interpreted as necessarily requiring them to be performed in the specific order described or illustrated, unless the execution order is clearly indicated. It should also be understood that additional or alternative steps may be used.

[0121] The above description is only a specific implementation of the present application, so that those skilled in the art can understand or implement the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest range consistent with the principles and novel features applied for herein.

Claims

1. A method for analyzing operation and maintenance tasks, characterized in that: The method comprises: Obtain status information of running operation and maintenance tasks, where the operation and maintenance tasks include tasks of the spark framework, hive framework, and flink framework; According to the status information, filter out target operation and maintenance tasks with abnormal current operation status and obtain log information related to the target operation and maintenance tasks; Matching the log information related to the target operation and maintenance task with the log set corresponding to the feedback content in the preset rule base to obtain a matching result, wherein the feedback content includes cause analysis content and processing suggestion content; If the matching result indicates a successful match, the target feedback content in the matching result is sent to the target user, so that the target user can analyze the target operation and maintenance task based on the target feedback content; If the matching result indicates a matching failure, generating feedback content corresponding to the target operation and maintenance task and storing it in the rule base; The matching result obtained by matching the log information related to the target operation and maintenance task with the log set corresponding to the feedback content in the preset rule base includes: Encoding the log information to obtain a coding feature of the log information, wherein the coding feature of the log information is obtained by combining a timestamp, a log level, and a feature value of an event description of the log information; Encoding each log set in the rule base to obtain encoding features of each log set; Match the encoding features of the log information with the encoding features of each log set respectively to obtain matching results; The coding features of the log information are matched with the coding features of each log set to obtain matching results, including: Matching the encoding features of the log information with the encoding features of each log set respectively to obtain a matching value between the log information and each log set; Determine whether there is a matching value greater than a preset value; If it exists, score the target log set corresponding to the matching value greater than the preset value to obtain the matching result; If not, matching is performed based on the keywords of the log information and the keywords of each log set to obtain a matching result; Scoring the target log set corresponding to the matching degree value greater than the preset value to obtain the matching result includes: Scoring the target log sets corresponding to the matching values ​​greater than the preset value according to the preset formula to obtain the scoring value of each target log set; Sorting the score value of each target log set from large to small to obtain a sorting result, and selecting a preset number of target log sets from the sorting result as the matching result; The preset formula includes: Wherein, S represents the score value of the target log set, K xy represents the matching value between the target log set and the log information, M represents the number of common keywords between the target log set and the log information, W represents the preset matching weight, Indicates the preset heat coefficient, which represents the frequency of the target log set being used as a matching result. D Indicates the time when the target log set was last used as a matching result from the current time. D 0 means the current time; The generating feedback content corresponding to the target operation and maintenance task and storing it in the rule base includes: The target operation and maintenance task is sent to a target user, so that the target user can analyze the feedback content corresponding to the target operation and maintenance task based on the target operation and maintenance task, and the feedback content corresponding to the target operation and maintenance task is associated with the target operation and maintenance task and stored in the rule base.

2. The method for analyzing operation and maintenance tasks according to claim 1, characterized in that: The step of filtering out target operation and maintenance tasks with abnormal current operation status according to the status information and obtaining log information related to the target operation and maintenance tasks includes: Analyze the status information to obtain the current running status of the operation and maintenance task; Filter out the operation and maintenance tasks with abnormal current running status as target operation and maintenance tasks; According to the identification information of the target operation and maintenance task, log information related to the target operation and maintenance task is obtained.

3. An analysis device for operation and maintenance tasks, characterized in that: The device comprises: Acquisition module: used to obtain the status information of the running operation and maintenance tasks, where the operation and maintenance tasks include tasks of the spark framework, hive framework, and flink framework; A screening module is used to screen out target operation and maintenance tasks with abnormal current operation status according to the status information and obtain log information related to the target operation and maintenance tasks; Matching module: used to match the log information related to the target operation and maintenance task with the log set corresponding to the feedback content in the preset rule base to obtain a matching result, wherein the feedback content includes cause analysis content and processing suggestion content; The first processing module is used for sending the target feedback content in the matching result to the target user if the matching result indicates that the matching is successful, so that the target user can analyze the target operation and maintenance task based on the target feedback content; The second processing module is used for generating feedback content corresponding to the target operation and maintenance task and storing it in the rule base if the matching result indicates a matching failure; The matching result obtained by matching the log information related to the target operation and maintenance task with the log set corresponding to the feedback content in the preset rule base includes: Encoding the log information to obtain a coding feature of the log information, wherein the coding feature of the log information is obtained by combining a timestamp, a log level, and a feature value of an event description of the log information; Encoding each log set in the rule base to obtain encoding features of each log set; Match the encoding features of the log information with the encoding features of each log set respectively to obtain matching results; The coding features of the log information are matched with the coding features of each log set to obtain matching results, including: Matching the encoding features of the log information with the encoding features of each log set respectively to obtain a matching value between the log information and each log set; Determine whether there is a matching value greater than a preset value; If it exists, score the target log set corresponding to the matching value greater than the preset value to obtain the matching result; If not, matching is performed based on the keywords of the log information and the keywords of each log set to obtain a matching result; Scoring the target log set corresponding to the matching degree value greater than the preset value to obtain the matching result includes: Scoring the target log sets corresponding to the matching values ​​greater than the preset value according to the preset formula to obtain the scoring value of each target log set; Sorting the score value of each target log set from large to small to obtain a sorting result, and selecting a preset number of target log sets from the sorting result as the matching result; The preset formula includes: Wherein, S represents the score value of the target log set, K xy represents the matching value between the target log set and the log information, M represents the number of common keywords between the target log set and the log information, W represents the preset matching weight, Indicates the preset heat coefficient, which represents the frequency of the target log set being used as a matching result. D Indicates the time when the target log set was last used as a matching result from the current time. D 0 means the current time; The generating feedback content corresponding to the target operation and maintenance task and storing it in the rule base includes: The target operation and maintenance task is sent to a target user, so that the target user can analyze the feedback content corresponding to the target operation and maintenance task based on the target operation and maintenance task, and the feedback content corresponding to the target operation and maintenance task is associated with the target operation and maintenance task and stored in the rule base.

4. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; Memory, used to store computer programs; A processor, for implementing the analysis method of the operation and maintenance task described in any one of claims 1 to 2 when executing a program stored in a memory.

5. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the analysis method for operation and maintenance tasks according to any one of claims 1 to 2 is implemented.

Images