Cloud platform fault diagnosis method, device, computer equipment and storage medium
By utilizing the voting mechanism of multiple large models in cloud platform fault diagnosis and processing the accuracy of their diagnostic results, the problem of inconsistent diagnostic results of large models is solved, and more efficient and accurate fault diagnosis is achieved.
Patent Information
- Application Number
- CN202411336666.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-24
- Publication Date
- 2025-09-16
- Estimated Expiration
- 2044-09-24
AI Technical Summary
In cloud platform fault diagnosis, multiple large models produce inconsistent diagnostic results for the same fault, resulting in low accuracy of fault diagnosis results.
By inputting the log data to be diagnosed into multiple error log diagnosis models, the diagnosis results of each model are obtained, and voting is performed based on these results. The accuracy of each result is calculated, and the fault diagnosis results of the cloud platform are finally determined.
The accuracy and efficiency of fault diagnosis results are improved, and the uniqueness and accuracy of diagnosis results are ensured.
Smart Images

Figure CN119322695B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of artificial intelligence technology, and in particular to a cloud platform fault diagnosis method, device, computer equipment and storage medium. Background Art
[0002] The vigorous development of cloud computing technology has promoted the scale and complexity of cloud platforms, and fault diagnosis has become a key link in maintaining their stability.
[0003] In the related art, fault diagnosis is performed by analyzing error logs through manual experience. However, in the face of increasingly complex system architectures, the fault diagnosis efficiency and accuracy of this method cannot meet the requirements.
[0004] The integration of artificial intelligence (AI) technology has brought about a shift in this area. In particular, intelligent agents built using large models have shown great potential in error log analysis. These agents can automatically parse error logs, improving the efficiency and accuracy of fault diagnosis.
[0005] However, when using intelligent agents for fault diagnosis in related technologies, when multiple large models constituting the intelligent agent give inconsistent diagnostic results for the same fault, there is no effective mechanism to resolve this contradiction, resulting in low accuracy of the fault diagnosis results. Summary of the Invention
[0006] In view of this, the present invention provides a cloud platform fault diagnosis method, device, computer equipment and storage medium to solve the problem in related technologies that when using intelligent agents for fault diagnosis, when multiple large models constituting the intelligent agent have inconsistent diagnosis results for the same fault, there is no effective mechanism to resolve this contradiction, resulting in low accuracy of the fault diagnosis results.
[0007] In a first aspect, the present invention provides a cloud platform fault diagnosis method, the method comprising:
[0008] Obtain error log data from the cloud platform in real time;
[0009] Dividing the error log data into a plurality of log data to be diagnosed;
[0010] For any log data to be diagnosed, input the log data to be diagnosed into multiple error log diagnosis models to obtain an error log diagnosis result output by each error log diagnosis model;
[0011] Inputting the log data to be diagnosed and the error log diagnosis results output by each error log diagnosis model into multiple error log diagnosis models, and obtaining voting results of the multiple error log diagnosis results output by each error log diagnosis model;
[0012] Based on the voting results of the multiple error log diagnosis results output by each error log diagnosis model, the error log diagnosis results output by the multiple error log diagnosis models are aggregated to obtain the accuracy of each error log diagnosis result;
[0013] Based on the accuracy of each error log diagnosis result, the fault diagnosis result of the cloud platform is determined.
[0014] The cloud platform fault diagnosis method provided by this embodiment inputs any log data to be diagnosed into multiple error log diagnosis models to obtain the error log diagnosis result output by each error log diagnosis model, inputs the log data to be diagnosed and the error log diagnosis result output by each error log diagnosis model into multiple error log diagnosis models to obtain the voting results of the multiple error log diagnosis results output by each error log diagnosis model, summarizes the error log diagnosis results output by the multiple error log diagnosis models based on the voting results of the multiple error log diagnosis results output by each error log diagnosis model to obtain the accuracy of each error log diagnosis result, determines the fault diagnosis result of the cloud platform based on the accuracy of each error log diagnosis result, and in the case where an intelligent agent constructed by multiple large models performs fault diagnosis on the cloud platform, the fault diagnosis result of the cloud platform is determined by the above mechanism, which combines the error log diagnosis results output by multiple large models to improve the accuracy of the fault diagnosis result.
[0015] In an optional implementation, the real-time acquisition of error log data from the cloud platform includes:
[0016] Collect operation logs and fault logs from different server nodes in real time;
[0017] The error log data is filtered out from the operation log and the fault log.
[0018] The cloud platform fault diagnosis method provided in this embodiment improves the efficiency of cloud platform fault diagnosis by automatically filtering error log data from operation logs and fault logs.
[0019] In an optional implementation, dividing the error log data into a plurality of log data to be diagnosed includes:
[0020] Obtaining timestamp information of the error log data;
[0021] Based on the timestamp information, the error log data is divided into a plurality of log data to be diagnosed according to a preset time window;
[0022] The segment log data corresponding to the preset time period before other preset time windows except the first preset time window overlaps with the segment log data corresponding to the preset time period after the previous preset time window.
[0023] The cloud platform fault diagnosis method provided in this embodiment divides the error log data into multiple log data to be diagnosed by setting a preset time window, performs cloud platform fault diagnosis based on the multiple log data to be diagnosed, and improves the accuracy of cloud platform fault diagnosis results.
[0024] In some optional implementations, inputting the log data to be diagnosed into multiple error log diagnosis models to obtain an error log diagnosis result output by each error log diagnosis model includes:
[0025] For any error log diagnosis model, obtaining a fault diagnosis template of the error log diagnosis model;
[0026] Inputting the log data to be diagnosed into the fault diagnosis template to obtain an instantiated fault diagnosis template;
[0027] The instantiated fault diagnosis template is input into the corresponding error log diagnosis model to obtain the error log diagnosis result output by the error log diagnosis model.
[0028] The cloud platform fault diagnosis method provided in this embodiment uses the log data to be diagnosed to instantiate the fault diagnosis template of the error log diagnosis model, so that the error log diagnosis model can perform fault diagnosis on the instantiated fault diagnosis template, thereby ensuring the accuracy of the error log diagnosis results.
[0029] In some optional implementations, inputting the log data to be diagnosed and the error log diagnosis results output by each error log diagnosis model into multiple error log diagnosis models, and obtaining a voting result of the multiple error log diagnosis results output by each error log diagnosis model, includes:
[0030] For any error log diagnosis model, obtain a diagnosis result voting template of the error log diagnosis model;
[0031] Inputting the log data to be diagnosed and the error log diagnosis results output by each error log diagnosis model into the diagnosis result voting template to obtain an instantiated diagnosis result voting template;
[0032] Inputting the instantiated diagnosis result voting template into the corresponding error log diagnosis model to obtain multiple error log diagnosis results output by the error log diagnosis model and sorted in descending order of correctness;
[0033] The voting results of the plurality of error log diagnosis results include a plurality of error log diagnosis results sorted from high to low in terms of correctness.
[0034] The cloud platform fault diagnosis method provided in this embodiment instantiates the diagnosis result voting template of the error log diagnosis model by utilizing the log data to be diagnosed and the error log diagnosis results output by each error log diagnosis model, so that the error log diagnosis model can sort the error log diagnosis results output by each error log diagnosis model for correctness, thereby obtaining the accuracy of each error log diagnosis result, determining the fault diagnosis result of the cloud platform, and ensuring the accuracy of the cloud platform fault diagnosis.
[0035] In some optional embodiments, the voting results of the multiple error log diagnosis results include multiple error log diagnosis results sorted from high to low according to correctness, and the voting results of the multiple error log diagnosis results output by each error log diagnosis model are aggregated to obtain the accuracy of each error log diagnosis result, including:
[0036] Determining, based on the multiple error log diagnosis results output by each error log diagnosis model and sorted in descending order of correctness, the correctness scores of the multiple error log diagnosis results output by each error log diagnosis model, wherein an error log diagnosis result with a higher correctness has a higher corresponding correctness score;
[0037] For any error log diagnosis model, determine the weight of the error log diagnosis result output by the error log diagnosis model based on the historical diagnosis accuracy of the error log diagnosis model, wherein the higher the historical diagnosis accuracy, the greater the weight;
[0038] For any error log diagnosis result, obtain the correctness score and weight corresponding to the error log diagnosis result under each error log diagnosis model;
[0039] For any error log diagnosis model, based on the weight corresponding to the error log diagnosis result under the error log diagnosis model, weighted processing is performed on the correctness score corresponding to the error log diagnosis result under the error log diagnosis model to obtain the target correctness score corresponding to the error log diagnosis result under the error log diagnosis model;
[0040] Summing target correctness scores corresponding to the error log diagnosis result under multiple error log diagnosis models to obtain the accuracy of the error log diagnosis result;
[0041] Among them, the sum of the weights of the error log diagnosis results output by multiple error log diagnosis models is a preset value.
[0042] The cloud platform fault diagnosis method provided in this embodiment determines the target correctness score corresponding to the error log diagnosis result under the error log diagnosis model by determining the correctness scores of multiple error log diagnosis results output by each error log diagnosis model and determining the weight of the error log diagnosis results output by the error log diagnosis model. The target correctness scores corresponding to the error log diagnosis results under multiple error log diagnosis models are summed to obtain the accuracy of the error log diagnosis result, and then the fault diagnosis result of the cloud platform is determined. By combining the error log diagnosis results output by multiple large models, the accuracy of the fault diagnosis result of the cloud platform is improved.
[0043] In some optional implementations, determining the fault diagnosis result of the cloud platform based on the accuracy of each error log diagnosis result includes:
[0044] Based on the accuracy of each error log diagnosis result, filter out the error log diagnosis result with the highest accuracy;
[0045] Determine whether the accuracy of the error log diagnosis result with the highest accuracy is greater than a preset accuracy threshold;
[0046] When the accuracy of the error log diagnosis result with the highest accuracy is greater than a preset accuracy threshold, an alarm is issued, and the error log diagnosis result with the highest accuracy is fed back as the fault diagnosis result of the cloud platform;
[0047] When the accuracy of the error log diagnosis result with the highest accuracy is not greater than the preset accuracy threshold, the error log diagnosis result with the highest accuracy is fed back to the maintenance personnel so that the maintenance personnel can determine the fault diagnosis result of the cloud platform based on the error log diagnosis result with the highest accuracy.
[0048] The cloud platform fault diagnosis method provided in this embodiment sets a preset accuracy threshold and compares the accuracy of the error log diagnosis result with the highest accuracy with the preset accuracy threshold. When the accuracy of the error log diagnosis result with the highest accuracy is not greater than the preset accuracy threshold, maintenance personnel access the method to determine the fault diagnosis result of the cloud platform. When the accuracy of the error log diagnosis result with the highest accuracy is greater than the preset accuracy threshold, the error log diagnosis result with the highest accuracy is used as the fault diagnosis result of the cloud platform, thereby ensuring the accuracy of the cloud platform fault diagnosis.
[0049] In a second aspect, the present invention provides a cloud platform fault diagnosis device, the device comprising:
[0050] The first acquisition module is used to obtain error log data of the cloud platform in real time;
[0051] A division module, used for dividing the error log data into a plurality of log data to be diagnosed;
[0052] A second acquisition module is configured to input any log data to be diagnosed into multiple error log diagnosis models to obtain an error log diagnosis result output by each error log diagnosis model;
[0053] a third acquisition module, configured to input the log data to be diagnosed and the error log diagnosis results output by each error log diagnosis model into multiple error log diagnosis models, and obtain voting results of the multiple error log diagnosis results output by each error log diagnosis model;
[0054] a fourth acquisition module, configured to aggregate the error log diagnosis results output by the plurality of error log diagnosis models based on the voting results of the plurality of error log diagnosis results output by each error log diagnosis model, and obtain the accuracy of each error log diagnosis result;
[0055] The determination module is used to determine the fault diagnosis result of the cloud platform based on the accuracy of each error log diagnosis result.
[0056] In a third aspect, the present invention provides a computer device comprising: a memory and a processor, the memory and the processor being communicatively connected to each other, computer instructions being stored in the memory, and the processor executing the cloud platform fault diagnosis method of the first aspect or any corresponding embodiment thereof by executing the computer instructions.
[0057] In a fourth aspect, the present invention provides a computer-readable storage medium having computer instructions stored thereon, the computer instructions being used to enable a computer to execute the cloud platform fault diagnosis method of the above-mentioned first aspect or any corresponding embodiment thereof.
[0058] In a fifth aspect, the present invention provides a computer program product, comprising computer instructions, which are used to enable a computer to execute the cloud platform fault diagnosis method of the above-mentioned first aspect or any corresponding embodiment thereof. BRIEF DESCRIPTION OF THE DRAWINGS
[0059] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in related technologies, the following briefly introduces the drawings required for use in the specific embodiments or related technical descriptions. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0060] Figure 1 is a flowchart of a cloud platform fault diagnosis method according to an embodiment of the present invention;
[0061] Figure 2 is a flowchart of another cloud platform fault diagnosis method according to an embodiment of the present invention;
[0062] Figure 3 is a schematic diagram of a process for obtaining a fault diagnosis result according to an embodiment of the present invention;
[0063] Figure 4 is a schematic diagram of a process for obtaining voting results according to an embodiment of the present invention;
[0064] Figure 5 is a flow chart of another cloud platform fault diagnosis method according to an embodiment of the present invention;
[0065] Figure 6 is a schematic diagram of the structure of a cloud platform fault diagnosis system according to an embodiment of the present invention;
[0066] Figure 7 is a structural block diagram of a cloud platform fault diagnosis device according to an embodiment of the present invention;
[0067] Figure 8 Schematic diagram of the hardware structure of a computer device according to an embodiment of the present invention. DETAILED DESCRIPTION
[0068] To make the purpose, technical solutions, and advantages of the embodiments of the present invention more clear, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative efforts shall fall within the scope of protection of the present invention.
[0069] The continuous development of cloud computing technology has led to the increasing scale and complexity of cloud platforms. Fault diagnosis has become the key to ensuring the stable operation of cloud platforms.
[0070] As cloud platforms become increasingly complex, system stability and reliability face severe challenges. Error logs are a crucial basis for cloud platform fault diagnosis. Related technologies rely on manual error log analysis for cloud platform fault diagnosis, but this method is inefficient and inaccurate. Furthermore, it's difficult to pinpoint the cause of complex system failures.
[0071] The development of artificial intelligence technology has brought a turning point for cloud platform fault diagnosis. Using large models to build intelligent agents for error log diagnosis shows great potential. Intelligent agents built from a single large model may also produce inconsistent diagnostic results for the same fault, leading to instability in fault diagnosis. The collaboration of multiple large models can simulate the interactions and evolution of complex systems, providing high adaptability and robustness. Large models are large language models, which are machine learning models with a large parameter scale and complexity. In the field of deep learning, large models typically refer to neural network models with millions to billions of parameters. An artificial intelligence (AI) agent is a machine or software created by humans that can perform various tasks and is designed to mimic human intelligent behavior, such as learning, reasoning, perception, understanding language, and recognizing patterns. AI systems are designed to act independently or in collaboration with humans to solve problems and perform tasks.
[0072] However, when using intelligent agents for fault diagnosis in related technologies, when multiple large models constituting the intelligent agent have inconsistent diagnostic results for the same fault, there is no effective mechanism to resolve this contradiction, resulting in low accuracy of fault diagnosis.
[0073] An embodiment of the present invention provides a cloud platform fault diagnosis method, which includes inputting any log data to be diagnosed into multiple error log diagnosis models to obtain the error log diagnosis result output by each error log diagnosis model, inputting the log data to be diagnosed and the error log diagnosis result output by each error log diagnosis model into multiple error log diagnosis models to obtain the voting results of the multiple error log diagnosis results output by each error log diagnosis model, summarizing the error log diagnosis results output by the multiple error log diagnosis models based on the voting results of the multiple error log diagnosis results output by each error log diagnosis model to obtain the accuracy of each error log diagnosis result, and determining the fault diagnosis result of the cloud platform based on the accuracy of each error log diagnosis result to achieve the effect of improving the accuracy of the fault diagnosis result and improving the efficiency of fault diagnosis.
[0074] According to an embodiment of the present invention, an embodiment of a cloud platform fault diagnosis method is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.
[0075] In this embodiment, a cloud platform fault diagnosis method is provided, which can be used for cloud platforms. Figure 1 FIG. 1 is a flow chart of a cloud platform fault diagnosis method according to an embodiment of the present invention. Figure 1 As shown, the process includes the following steps:
[0076] Step S101: Obtain error log data from the cloud platform in real time.
[0077] The cloud platform builds a cloud platform fault diagnosis agent through multiple large models. The log receiving module of the cloud platform fault diagnosis agent collects all error log data in real time, including system error log data, cloud platform error log data, application error log data, etc.
[0078] Step S102: Divide the error log data into a plurality of log data to be diagnosed.
[0079] After the error log data of the cloud platform is obtained, it is parsed and structured according to the format and content of the error log data for subsequent analysis and query, and the error log data is divided into multiple log data to be diagnosed.
[0080] That is, the error log data is sliced to obtain a plurality of log data to be diagnosed.
[0081] Step S103 : for any log data to be diagnosed, input the log data to be diagnosed into multiple error log diagnosis models to obtain the error log diagnosis result output by each error log diagnosis model.
[0082] Among them, for any log data to be diagnosed, the log data to be diagnosed is input into multiple error log diagnosis models in the cloud platform fault diagnosis agent to obtain the error log diagnosis results output by each error log diagnosis model.
[0083] It should be noted that the error log diagnosis model is a large model, and the multiple error log diagnosis models in the cloud platform fault diagnosis agent are multiple large models that constitute the diagnosis agent.
[0084] The embodiment of the present invention selects a suitable big model for the error log diagnosis scenario to build a cloud platform fault diagnosis agent. Generally, three types are used: open source general big models, such as the llama series, open source coding big models, such as codellama and wizardcoder, and self-training big models. These three big models are downloaded to the cloud environment to build a cloud platform fault diagnosis agent. For cloud environments with less stringent Internet security requirements, the big model can also be called by directly calling a third-party big model API service to build a cloud platform fault diagnosis agent. Among them, the self-training big model is a big model obtained by fine-tuning instructions based on the open source big model and its own logs and knowledge.
[0085] Step S104 : input the log data to be diagnosed and the error log diagnosis results output by each error log diagnosis model into multiple error log diagnosis models to obtain a voting result of the multiple error log diagnosis results output by each error log diagnosis model.
[0086] After obtaining the error log diagnosis results output by each error log diagnosis model for the log data to be diagnosed, the log data to be diagnosed and the error log diagnosis results output by each error log diagnosis model for the log data to be diagnosed are input into multiple error log diagnosis models of the cloud platform fault diagnosis agent to obtain the voting results of the multiple error log diagnosis results output by each error log diagnosis model.
[0087] Exemplarily, the cloud platform fault diagnosis agent includes three error log diagnosis models. After obtaining the error log diagnosis results output by each error log diagnosis model for the log data to be diagnosed, the log data to be diagnosed and the three error log diagnosis results are input into the three error log diagnosis models respectively to obtain the voting results of the three error log diagnosis results output by each error log diagnosis model.
[0088] Step S105 , based on the voting results of the multiple error log diagnosis results output by each error log diagnosis model, the error log diagnosis results output by the multiple error log diagnosis models are aggregated to obtain the accuracy of each error log diagnosis result.
[0089] Among them, after obtaining the voting results of multiple error log diagnosis results output by each error log diagnosis model, the error log diagnosis results output by multiple error log diagnosis models are summarized and processed according to the voting results of multiple error log diagnosis results output by each error log diagnosis model to obtain the accuracy of each error log diagnosis result.
[0090] Step S106: Determine the fault diagnosis result of the cloud platform based on the accuracy of each error log diagnosis result.
[0091] After obtaining the accuracy of each error log diagnosis result, the fault diagnosis result of the cloud platform is determined according to the accuracy of each error log diagnosis result.
[0092] The cloud platform fault diagnosis method provided by this embodiment inputs any log data to be diagnosed into multiple error log diagnosis models to obtain the error log diagnosis result output by each error log diagnosis model, inputs the log data to be diagnosed and the error log diagnosis result output by each error log diagnosis model into multiple error log diagnosis models to obtain the voting results of the multiple error log diagnosis results output by each error log diagnosis model, summarizes the error log diagnosis results output by the multiple error log diagnosis models based on the voting results of the multiple error log diagnosis results output by each error log diagnosis model to obtain the accuracy of each error log diagnosis result, determines the fault diagnosis result of the cloud platform based on the accuracy of each error log diagnosis result, and in the case where an intelligent agent constructed by multiple large models performs fault diagnosis on the cloud platform, the fault diagnosis result of the cloud platform is determined by the above mechanism, which combines the error log diagnosis results output by multiple large models to improve the accuracy of the fault diagnosis result.
[0093] The cloud platform fault diagnosis method provided in this embodiment constructs a cloud platform fault diagnosis intelligent entity through multiple large models. These large models share error log data and diagnose each section of log data to be diagnosed. Then, each large model votes on the diagnosis results of the same section of log data to be diagnosed, and finally forms a unified diagnosis result, which ensures the uniqueness of the fault diagnosis result and improves the accuracy of the fault diagnosis result.
[0094] In this embodiment, a cloud platform fault diagnosis method is provided, which can be used for cloud platforms. Figure 2 FIG. 1 is a flow chart of a cloud platform fault diagnosis method according to an embodiment of the present invention. Figure 2 As shown, the process includes the following steps:
[0095] Step S201: Obtain error log data from the cloud platform in real time.
[0096] Specifically, the above step S201 includes:
[0097] Step S2011: collect operation logs and fault logs from different server nodes in real time.
[0098] The log receiving module is used to receive the operation logs and fault logs collected in real time from different server nodes by collection tools (such as Fluentd and Logstash).
[0099] Step S2012: Filter out error log data from the operation log and the fault log.
[0100] Here, error log data extraction is performed for different types of logs, namely, operation logs and fault logs. In other words, error log data is filtered out from the operation logs and fault logs.
[0101] It should be noted that after filtering out the error log data, data cleaning and formatting are performed to remove noise data and standardize the log format.
[0102] At the same time, the log receiving module temporarily stores the received error log data in the cache to ensure reliable collection and processing of error log data.
[0103] Step S202: Divide the error log data into a plurality of log data to be diagnosed.
[0104] Specifically, the above step S202 includes:
[0105] Step S2021, obtaining the timestamp information of the error log data.
[0106] Among them, after collecting operation logs and fault logs from different server nodes, for different types of logs, key information such as timestamps are extracted according to the log type, and the timestamps of all logs are converted into a unified format to ensure the consistency of subsequent log processing.
[0107] After filtering out the error log data, obtain timestamp information of the error log data.
[0108] Step S2022: Based on the timestamp information, the error log data is divided into a plurality of log data to be diagnosed according to a preset time window.
[0109] The size of the preset time window can be set by a technician. For example, the size of the preset time window is 5 minutes.
[0110] Develop an appropriate sharding strategy, that is, divide the error log data into multiple log data to be diagnosed according to the preset time window according to the chronological order and the timestamp information of the error log data. It should be noted that in order to ensure the integrity of the shards, each log data to be diagnosed can have a small amount of overlap.
[0111] That is, the segmented log data corresponding to the preset time period before other preset time windows, except the first preset time window, overlaps with the segmented log data corresponding to the preset time period after the previous preset time window. It should be noted that the preset time period is set by the technician and can generally be set to 1 minute.
[0112] It is understandable that the overlapping time length of each preset time window is 1 minute.
[0113] This embodiment uses a sliding window mechanism. Each time window begins with a portion of the data from the previous window to ensure data overlap between time windows. The step size of the time window is equal to the time window size minus the length of the overlap.
[0114] After generating a plurality of log data to be diagnosed, a label is generated for each log data to be diagnosed, marking its time window and overlapping part.
[0115] It should be noted that each log data to be diagnosed is assigned one or more fault diagnosis tasks, and the goal of the fault diagnosis task is to analyze the log data to be diagnosed and identify any possible faults or problems.
[0116] Step S203 : for any log data to be diagnosed, input the log data to be diagnosed into multiple error log diagnosis models to obtain an error log diagnosis result output by each error log diagnosis model.
[0117] Specifically, the above step S203 includes:
[0118] Step S2031: For any error log diagnosis model, obtain a fault diagnosis template of the error log diagnosis model.
[0119] Each error log diagnosis model is provided with a different fault diagnosis template. For any error log diagnosis model, the fault diagnosis template corresponding to the error log diagnosis model is obtained. The fault diagnosis template is a fault diagnosis prompt template.
[0120] Step S2032: input the log data to be diagnosed into the fault diagnosis template to obtain an instantiated fault diagnosis template.
[0121] Figure 3 FIG. 1 is a flow chart of obtaining fault diagnosis results according to an embodiment of the present invention. Figure 3 As shown, the shard log is the log data to be diagnosed. This embodiment is explained by taking three error log diagnosis models to constitute a cloud platform fault diagnosis agent as an example. The three error log diagnosis models are model 1, model 2, and model 3.
[0122] After obtaining the fault diagnosis template corresponding to the error log diagnosis model, the log data to be diagnosed is brought into the fault diagnosis template corresponding to the error log diagnosis model to implement instantiation of the fault diagnosis template.
[0123] Step S2033: input the instantiated fault diagnosis template into the corresponding error log diagnosis model to obtain the error log diagnosis result output by the error log diagnosis model.
[0124] Among them, after obtaining the instantiated fault diagnosis template, the instantiated fault diagnosis template is input into the corresponding error log diagnosis model to obtain the error log diagnosis result output by the error log diagnosis model, and then the error log diagnosis result output by each error log diagnosis model for the log data to be diagnosed can be obtained.
[0125] Each error log diagnosis model, i.e., each large model, will analyze the log data to be diagnosed according to its own algorithm and model parameters, and diagnose the fault diagnosis result of the cloud platform based on its own analysis result.
[0126] Exemplarily, the fault diagnosis template can be as follows:
[0127] """
[0128] <Instruction>You are a senior software engineer, and you need to help me locate various platform faults and analyze the root causes. Please answer the questions concisely and professionally. If you are not sure, please say "Unable to answer this question"< / Instruction>
[0129] <Question>The log information is as follows {{log}}, and there may be multiple faults in the log. Please give the fault information that appears first, analyze the cause of the fault, and give a repair suggestion< / Question>
[0130] """
[0131] log is the log in the current time window, and the prompt template needs to be instantiated through the log.
[0132] In step S204, the log data to be diagnosed and the error log diagnosis results output by each error log diagnosis model are input into multiple error log diagnosis models to obtain the voting result of the multiple error log diagnosis results output by each error log diagnosis model. For details, please refer to Figure 1 Step S104 of the embodiment shown, which will not be elaborated here.
[0133] In step S205, based on the voting result of the multiple error log diagnosis results output by each error log diagnosis model, the error log diagnosis results output by the multiple error log diagnosis models are aggregated to obtain the accuracy rate of each error log diagnosis result. For details, please refer to Figure 1 Step S105 of the embodiment shown, which will not be elaborated here.
[0134] In step S206, based on the accuracy rate of each error log diagnosis result, the fault diagnosis result of the cloud platform is determined. For details, please refer to Figure 1 Step S106 of the embodiment shown, which will not be elaborated here.
[0135] The cloud platform fault diagnosis method provided in this embodiment improves the efficiency of cloud platform fault diagnosis by automatically screening error log data from operation logs and fault logs.
[0136] By setting a preset time window, the error log data is divided into multiple log data to be diagnosed, and the fault diagnosis of the cloud platform is performed according to the multiple log data to be diagnosed, improving the accuracy of the cloud platform fault diagnosis result.
[0137] By using the log data to be diagnosed to instantiate the fault diagnosis template of the error log diagnosis model, the error log diagnosis model can perform fault diagnosis on the instantiated fault diagnosis template, thereby ensuring the accuracy of the error log diagnosis result.
[0138] In some optional implementations, the above step S204 includes:
[0139] Step a1: for any error log diagnosis model, obtain a diagnosis result voting template of the error log diagnosis model.
[0140] Different error log diagnosis models are provided with different diagnosis result voting templates. For any error log diagnosis model, the diagnosis result voting template of the error log diagnosis model, ie, the diagnosis result prompt voting template, is obtained.
[0141] Step a2: input the log data to be diagnosed and the error log diagnosis results output by each error log diagnosis model into the diagnosis result voting template to obtain an instantiated diagnosis result voting template.
[0142] The log data to be diagnosed and the error log diagnosis results output by each error log diagnosis model for the log data to be diagnosed are input into the diagnosis result voting template to obtain an instantiated diagnosis result voting template.
[0143] In step a3, the instantiated diagnosis result voting template is input into the corresponding error log diagnosis model to obtain a plurality of error log diagnosis results output by the error log diagnosis model and sorted in descending order of correctness.
[0144] The voting results of the multiple error log diagnosis results include the multiple error log diagnosis results sorted from high to low in terms of correctness.
[0145] Figure 4 FIG. 1 is a flow chart of obtaining voting results according to an embodiment of the present invention. Figure 4 As shown, after obtaining the instantiated diagnostic result voting template, the instantiated diagnostic result voting template is input into the corresponding error log diagnostic model to obtain multiple error log diagnostic results output by the error log diagnostic model and sorted from high to low according to correctness, and then multiple error log diagnostic results output by each error log diagnostic model and sorted from high to low according to correctness can be obtained.
[0146] For example, the diagnosis result voting template may be as follows:
[0147] """
[0148] <Instruction>You are a senior software engineer. Analyze the following diagnostic results based on the logs and answer the questions concisely and professionally. The format is as follows: "Model 1; Model 2", and no other output is allowed.< / Instruction>
[0149] <Question>The log information is as follows {{log}}, Model 1 {{Diagnosis 1}}, Model 2 {{Diagnosis 2}}, Model 3 {{Diagnosis 3}}. Please determine whether the diagnostic results of the three models are correct, output the correct diagnostic results and their rankings, and do not output the models with inaccurate results.< / Question>
[0150] """
[0151] It should be noted that the diagnostic summary includes summarizing the log data to be diagnosed and the error log diagnostic results output by each error log diagnostic model.< /
[0152] For the error log diagnostic results output by each error log diagnostic model for the log data to be diagnosed, a consensus mechanism is used for large model voting to obtain the voting results of the multiple error log diagnostic results output by each error log diagnostic model.< /
[0153] The cloud platform fault diagnosis method provided in this embodiment instantiates the diagnostic result voting template of the error log diagnostic model by using the log data to be diagnosed and the error log diagnostic results output by each error log diagnostic model, enabling the error log diagnostic model to sort the error log diagnostic results output by each error log diagnostic model according to correctness, and then obtaining the accuracy rate of each error log diagnostic result to determine the fault diagnosis result of the cloud platform, ensuring the accuracy of the cloud platform fault diagnosis.< /
[0154] In some optional implementation manners, the above step S205 includes:
[0155] Step b1, based on the multiple error log diagnostic results output by each error log diagnostic model and sorted from high to low according to correctness, determine the correctness scores of the multiple error log diagnostic results output by each error log diagnostic model, where the error log diagnostic results with higher correctness correspond to higher correctness scores.< /
[0156] Suppose there are n error log diagnostic models. For any error log diagnostic model, obtain the n error log diagnostic results output by it and sorted from high to low according to correctness, and assign corresponding correctness scores to the n error log diagnostic results according to the correctness levels of the n error log diagnostic results.< /
[0157] Exemplarily, the error log diagnostic result with the first correctness ranking has a correctness score of 1 point, the error log diagnostic result with the second correctness ranking has a correctness score of 0.8 points, and the error log diagnostic results not included have a correctness score of 0 points.< /
[0158] Step b2: for any error log diagnosis model, based on the historical diagnosis accuracy of the error log diagnosis model, determine the weight of the error log diagnosis result output by the error log diagnosis model, wherein the higher the historical diagnosis accuracy, the greater the weight.
[0159] The weight of each error log diagnosis model is dynamically adjusted based on its historical diagnosis accuracy, which means that error log diagnosis models that performed better in the past will have greater weights.
[0160] Assume there are n error log diagnosis models. Each error log diagnosis model Mi is assigned a weight Wi. The weight assignment can be based on the historical diagnosis accuracy of the error log diagnosis model and can be manually modified. The sum of the weights should be 1.
[0161] Step b3: for any error log diagnosis result, obtain the correctness score and weight corresponding to the error log diagnosis result under each error log diagnosis model.
[0162] For any error log diagnosis result among multiple error log diagnosis results output by multiple error log diagnosis models, obtain the correctness score and weight corresponding to the error log diagnosis result under each error log diagnosis model.
[0163] Step b4, for any error log diagnosis model, based on the weight corresponding to the error log diagnosis result under the error log diagnosis model, weighted processing is performed on the correctness score corresponding to the error log diagnosis result under the error log diagnosis model to obtain the target correctness score corresponding to the error log diagnosis result under the error log diagnosis model.
[0164] Among them, for any error log diagnosis model, based on the weight corresponding to the error log diagnosis result under the error log diagnosis model, the correctness score corresponding to the error log diagnosis result under the error log diagnosis model is weighted, including: multiplying the weight corresponding to the error log diagnosis result under the error log diagnosis model and the correctness score corresponding to the error log diagnosis result under the error log diagnosis model to obtain the target correctness score corresponding to the error log diagnosis result under the error log diagnosis model, and then obtaining the target correctness scores corresponding to the error log diagnosis results under multiple error log diagnosis models.
[0165] Step b5: summing the target correctness scores corresponding to the error log diagnosis results under multiple error log diagnosis models to obtain the accuracy of the error log diagnosis results.
[0166] Among them, through the above method, the target correctness scores corresponding to the error log diagnosis results under multiple error log diagnosis models are obtained, and the target correctness scores corresponding to the error log diagnosis results under multiple error log diagnosis models are summed to obtain the accuracy of the error log diagnosis results.
[0167] Specifically, summing the target correctness scores corresponding to the error log diagnosis results under multiple error log diagnosis models includes: Among them, Ri is the target correctness score corresponding to the error log diagnosis result under the i-th error log diagnosis model.
[0168] The sum of the weights of the error log diagnosis results output by the multiple error log diagnosis models is a preset value, which is 1.
[0169] like Figure 4 As shown, the voting aggregation is based on the voting results of the multiple error log diagnosis results output by each error log diagnosis model, and the error log diagnosis results output by multiple error log diagnosis models are aggregated, including the above steps b1 to b5.
[0170] The cloud platform fault diagnosis method provided in this embodiment determines the target correctness score corresponding to the error log diagnosis result under the error log diagnosis model by determining the correctness scores of multiple error log diagnosis results output by each error log diagnosis model and determining the weight of the error log diagnosis results output by the error log diagnosis model. The target correctness scores corresponding to the error log diagnosis results under multiple error log diagnosis models are summed to obtain the accuracy of the error log diagnosis result, and then the fault diagnosis result of the cloud platform is determined. By combining the error log diagnosis results output by multiple large models, the accuracy of the fault diagnosis result of the cloud platform is improved.
[0171] In some optional implementations, the above step S206 includes:
[0172] Step c1: based on the accuracy of each error log diagnosis result, filter out the error log diagnosis result with the highest accuracy.
[0173] After obtaining the accuracy of each error log diagnosis result, the error log diagnosis result with the highest accuracy is screened out from the multiple error log diagnosis results.
[0174] The code for obtaining the accuracy of each error log diagnosis result and filtering the error log diagnosis result with the highest accuracy can be as follows:
[0175]
[0176] Step c2: determine whether the accuracy of the error log diagnosis result with the highest accuracy is greater than a preset accuracy threshold.
[0177] The preset accuracy threshold is set by technical personnel based on experience. Generally, the preset accuracy threshold is 0.8. It should be noted that the preset accuracy threshold needs to be adjusted according to the actual situation of the cloud platform to avoid misdiagnosis and potential risks.
[0178] In step c3, when the accuracy of the error log diagnosis result with the highest accuracy is greater than a preset accuracy threshold, an alarm is issued, and the error log diagnosis result with the highest accuracy is fed back as the fault diagnosis result of the cloud platform.
[0179] Among them, the accuracy of the error log diagnosis result with the highest accuracy is greater than the preset accuracy threshold, indicating that the error log diagnosis result is accurate enough, a cloud platform failure occurs, and an alarm needs to be issued. The error log diagnosis result with the highest accuracy is the fault diagnosis result of the cloud platform, and the error log diagnosis result with the highest accuracy is fed back to the maintenance personnel of the cloud platform.
[0180] In step c4, when the accuracy of the error log diagnosis result with the highest accuracy is not greater than the preset accuracy threshold, the error log diagnosis result with the highest accuracy is fed back to the maintenance personnel, so that the maintenance personnel can determine the fault diagnosis result of the cloud platform based on the error log diagnosis result with the highest accuracy.
[0181] If the error log diagnosis result with the highest accuracy is not greater than the preset accuracy threshold, it means that the error log diagnosis result is not accurate enough. Then, the error log diagnosis result with the highest accuracy is fed back to the maintenance personnel so that the maintenance personnel can determine the fault diagnosis result of the cloud platform based on the error log diagnosis result with the highest accuracy.
[0182] It should be noted that the final result obtained by the voting summary is based on the accuracy of the diagnosis result of each error log to determine the fault diagnosis result of the cloud platform.
[0183] The cloud platform fault diagnosis method provided in this embodiment sets a preset accuracy threshold and compares the accuracy of the error log diagnosis result with the highest accuracy with the preset accuracy threshold. When the accuracy of the error log diagnosis result with the highest accuracy is not greater than the preset accuracy threshold, maintenance personnel access the method to determine the fault diagnosis result of the cloud platform. When the accuracy of the error log diagnosis result with the highest accuracy is greater than the preset accuracy threshold, the error log diagnosis result with the highest accuracy is used as the fault diagnosis result of the cloud platform, thereby ensuring the accuracy of the cloud platform fault diagnosis.
[0184] In some optional implementations, the cloud platform fault diagnosis method further includes:
[0185] When the cloud platform stability requirement is the first requirement, the preset accuracy threshold is set as the first threshold.
[0186] When the cloud platform stability requirement is the second requirement, the preset accuracy threshold is set as the second threshold.
[0187] The first required stability level is greater than the second required stability level, and the first threshold is greater than the second threshold.
[0188] In other words, during periods when cloud platform stability is highly critical, the preset accuracy threshold can be set to a higher threshold to reduce false alarms. During routine maintenance periods, when cloud platform stability is less critical, the preset accuracy threshold can be set to a lower threshold to catch more potential problems and faults.
[0189] The cloud platform fault diagnosis method provided in this embodiment can better adapt to different operating conditions and maintenance needs by dynamically adjusting the preset accuracy threshold according to the different stability requirements of the cloud platform. It ensures accurate monitoring during high-stability periods and improves the sensitivity of problem detection in maintenance devices, effectively improving the overall operation and maintenance efficiency and user experience of the cloud platform.
[0190] This embodiment also provides a cloud platform fault diagnosis method. Figure 5 FIG. 1 is a flow chart of a cloud platform fault diagnosis method according to an embodiment of the present invention. Figure 5 As shown, the cloud platform fault diagnosis method includes log collection, sharding process, fault diagnosis process, voting process and feedback process.
[0191] The log collection and sharding processes correspond to the aforementioned steps S201 and S202 . For detailed descriptions, please refer to the aforementioned steps S201 and S202 , which will not be repeated here.
[0192] The fault diagnosis process corresponds to the aforementioned step S203. For detailed description, please refer to the aforementioned step S203 and will not be repeated here.
[0193] The voting process corresponds to the aforementioned step S204 and step S205. For detailed description, please refer to the aforementioned step S204 and step S205, which will not be repeated here.
[0194] The feedback process corresponds to the aforementioned step S206. For detailed description, please refer to the aforementioned step S206 and will not be repeated here.
[0195] The cloud platform fault diagnosis method provided in this embodiment constructs a cloud platform fault diagnosis agent through multiple large models. These large models share error log data and diagnose each segment of error log data. Then, each large model votes on the diagnosis results for the same segment of error log data, and finally forms a consistent diagnosis result, which can quickly locate cloud platform faults and reduce maintenance costs.
[0196] This embodiment also provides a cloud platform fault diagnosis system. Figure 6 Schematic diagram of the structure of the cloud platform fault diagnosis system according to an embodiment of the present invention. Figure 6 As shown, the cloud platform fault diagnosis system includes a log receiving module, a log sharding distribution module, a large model diagnosis module, a large model voting module and a processing module.
[0197] The log receiving module is used to execute step S201 above, the log sharding distribution module is used to execute step S202 above, the large model diagnosis module is used to execute step S203 above, the large model voting module is used to execute steps S204 and S205 above, and the processing module is used to execute step S206 above. For detailed descriptions, please refer to the corresponding sections of the aforementioned embodiments and will not be repeated here.
[0198] The cloud platform fault diagnosis system provided in this embodiment integrates multiple large models into a single system. Each large model may focus on a different type of fault or have a different diagnostic algorithm. This collaborative mechanism can improve the accuracy and coverage of cloud platform fault diagnosis. By having each large model vote on multiple diagnostic results and assigning different weights to each large model, its influence in the final decision can be adjusted based on its reliability.
[0199] It should be noted that the cloud platform fault diagnosis system provided in this embodiment allows users to customize and integrate a new large model, namely the error log diagnosis model, according to their own needs, thereby increasing the flexibility and scalability of the system.
[0200] Moreover, the cloud platform fault diagnosis agent in this embodiment is deeply integrated with the cloud platform's log system, enabling seamless access to cloud services and infrastructure, thus simplifying the deployment and maintenance process.
[0201] In this embodiment, a cloud platform fault diagnosis device is also provided, which is used to implement the above-mentioned embodiments and preferred embodiments. The details that have been described will not be repeated here. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and contemplated.
[0202] This embodiment provides a cloud platform fault diagnosis device, such as Figure 7 Shown, including:
[0203] The first acquisition module 701 is used to acquire error log data of the cloud platform in real time.
[0204] The division module 702 is configured to divide the error log data into a plurality of log data to be diagnosed.
[0205] The second acquisition module 703 is used to input any log data to be diagnosed into multiple error log diagnosis models to obtain the error log diagnosis result output by each error log diagnosis model.
[0206] The third acquisition module 704 is used to input the log data to be diagnosed and the error log diagnosis results output by each error log diagnosis model into multiple error log diagnosis models to obtain voting results of the multiple error log diagnosis results output by each error log diagnosis model.
[0207] The fourth acquisition module 705 is used to aggregate the error log diagnosis results output by multiple error log diagnosis models based on the voting results of the multiple error log diagnosis results output by each error log diagnosis model to obtain the accuracy of each error log diagnosis result.
[0208] The determination module 706 is configured to determine the fault diagnosis result of the cloud platform based on the accuracy of each error log diagnosis result.
[0209] In some optional implementations, the first acquisition module 701 includes:
[0210] The collection unit is used to collect operation logs and fault logs from different server nodes in real time.
[0211] The first screening unit is used to screen out error log data from the operation log and the fault log.
[0212] In some optional implementations, the partitioning module 702 includes:
[0213] The first acquiring unit is configured to acquire timestamp information of the error log data.
[0214] The first dividing unit is configured to divide the error log data into a plurality of log data to be diagnosed according to a preset time window based on the timestamp information.
[0215] The segment log data corresponding to the preset time period before other preset time windows except the first preset time window overlaps with the segment log data corresponding to the preset time period after the previous preset time window.
[0216] In some optional implementations, the second acquisition module 703 includes:
[0217] The second acquisition unit is configured to acquire a fault diagnosis template of an error log diagnosis model for any error log diagnosis model.
[0218] The first instantiation unit is configured to input the log data to be diagnosed into the fault diagnosis template to obtain an instantiated fault diagnosis template.
[0219] The third acquisition unit is configured to input the instantiated fault diagnosis template into the corresponding error log diagnosis model to obtain the error log diagnosis result output by the error log diagnosis model.
[0220] In some optional implementations, the third obtaining module 704 includes:
[0221] The fourth acquisition unit is configured to acquire, for any error log diagnosis model, a diagnosis result voting template of the error log diagnosis model.
[0222] The second instantiation unit is used to input the log data to be diagnosed and the error log diagnosis results output by each error log diagnosis model into the diagnosis result voting template to obtain an instantiated diagnosis result voting template.
[0223] The fifth acquisition unit is used to input the instantiated diagnosis result voting template into the corresponding error log diagnosis model to obtain multiple error log diagnosis results output by the error log diagnosis model and sorted in descending order of correctness.
[0224] The voting results of the multiple error log diagnosis results include the multiple error log diagnosis results sorted from high to low in terms of correctness.
[0225] In some optional implementations, the fourth obtaining module 705 includes:
[0226] The first determination unit is used to determine the correctness scores of multiple error log diagnosis results output by each error log diagnosis model based on multiple error log diagnosis results output by each error log diagnosis model, which are sorted from high to low according to correctness, wherein an error log diagnosis result with high correctness has a corresponding high correctness score.
[0227] The second determination unit is used to determine the weight of the error log diagnosis result output by the error log diagnosis model for any error log diagnosis model based on the historical diagnosis accuracy of the error log diagnosis model, wherein the higher the historical diagnosis accuracy, the greater the weight.
[0228] The sixth obtaining unit is configured to obtain, for any error log diagnosis result, a correctness score and a weight corresponding to the error log diagnosis result under each error log diagnosis model.
[0229] The seventh acquisition unit is used to perform weighted processing on the correctness score corresponding to the error log diagnosis result under any error log diagnosis model based on the weight corresponding to the error log diagnosis result under the error log diagnosis model, and obtain the target correctness score corresponding to the error log diagnosis result under the error log diagnosis model.
[0230] The eighth acquisition unit is configured to sum the target correctness scores corresponding to the error log diagnosis results under multiple error log diagnosis models to obtain the accuracy of the error log diagnosis results.
[0231] Among them, the sum of the weights of the error log diagnosis results output by multiple error log diagnosis models is a preset value.
[0232] In some optional implementations, the determining module 706 includes:
[0233] The second screening unit is configured to screen out the error log diagnosis result with the highest accuracy based on the accuracy of each error log diagnosis result.
[0234] The judgment unit is used to judge whether the accuracy of the error log diagnosis result with the highest accuracy is greater than a preset accuracy threshold.
[0235] The alarm unit is used to issue an alarm when the accuracy of the error log diagnosis result with the highest accuracy is greater than a preset accuracy threshold, and to feed back the error log diagnosis result with the highest accuracy as the fault diagnosis result of the cloud platform.
[0236] The feedback unit is used to feed back the error log diagnosis result with the highest accuracy to the maintenance personnel when the accuracy of the error log diagnosis result with the highest accuracy is not greater than the preset accuracy threshold, so that the maintenance personnel can determine the fault diagnosis result of the cloud platform based on the error log diagnosis result with the highest accuracy.
[0237] The further functional description of each of the above modules and units is the same as that of the above corresponding embodiments and will not be repeated here.
[0238] The cloud platform fault diagnosis device in this embodiment is presented in the form of a functional unit, where the unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and memory that executes one or more software or fixed programs, and / or other devices that can provide the above functions.
[0239] The embodiment of the present invention also provides a computer device having the above Figure 7 The cloud platform fault diagnosis device shown.
[0240] See also Figure 8 , Figure 8 is a structural diagram of a computer device provided by an optional embodiment of the present invention, such as Figure 8 As shown, the computer device includes: one or more processors 801, memory 802, and the interface for connecting each component, including high-speed interface and low-speed interface. Each component utilizes different buses to communicate with each other and can be installed on a common mainboard or installed in other ways as needed. The processor can process the instruction executed in the computer device, including being stored in the memory or on the memory to display the graphic information of the GUI on an external input / output device (such as, being coupled to the display device of the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Equally, multiple computer devices can be connected, and each device provides the necessary operation of part (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 8 A processor 801 is taken as an example.
[0241] Processor 801 may be a central processing unit, a network processor, or a combination thereof. Processor 801 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit, a programmable logic device, or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic, or any combination thereof.
[0242] The memory 802 stores instructions that can be executed by at least one processor 801, so as to enable the at least one processor 801 to execute the method shown in the above embodiment.
[0243] The memory 802 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and application programs required for at least one function; the data storage area may store data created based on the use of the computer device, etc. In addition, the memory 802 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 802 may optionally include a memory remotely located relative to the processor 801, and these remote memories may be connected to the computer device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0244] The memory 802 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid-state drive; the memory 802 may also include a combination of the above types of memory.
[0245] The computer device further includes a communication interface 803 for the computer device to communicate with other devices or a communication network.
[0246] The embodiment of the present invention also provides a computer-readable storage medium. The above-mentioned method according to the embodiment of the present invention can be implemented in hardware, firmware, or implemented as a computer code that can be recorded in a storage medium, or implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and downloaded through a network and will be stored in a local storage medium, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state drive, etc.; further, the storage medium can also include a combination of the above-mentioned types of memory. It can be understood that a computer, a processor, a microprocessor controller or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor or hardware, the method shown in the above embodiment is implemented.
[0247] A portion of the present invention may be applied as a computer program product, such as a computer program instruction, which, when executed by a computer, can call or provide the method and / or technical solution according to the present invention through the operation of the computer. Those skilled in the art should understand that the form in which the computer program instruction exists in a computer-readable medium includes, but is not limited to, a source file, an executable file, an installation package file, etc. Accordingly, the way in which the computer program instruction is executed by the computer includes, but is not limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding installed program. Here, the computer-readable medium may be any available computer-readable storage medium or communication medium that can be accessed by the computer.
[0248] Although the embodiments of the present invention have been described with reference to the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present invention. Such modifications and variations are all within the scope defined by the appended claims.
Claims
1. A cloud platform fault diagnosis method, characterized in that: The method comprises: Obtain error log data from the cloud platform in real time; Dividing the error log data into a plurality of log data to be diagnosed; For any log data to be diagnosed, input the log data to be diagnosed into multiple error log diagnosis models to obtain an error log diagnosis result output by each error log diagnosis model, where the error log diagnosis model is a large model; Inputting the log data to be diagnosed and the error log diagnosis results output by each error log diagnosis model into multiple error log diagnosis models, and obtaining voting results of the multiple error log diagnosis results output by each error log diagnosis model; Based on the voting results of the multiple error log diagnosis results output by each error log diagnosis model, the error log diagnosis results output by the multiple error log diagnosis models are aggregated to obtain the accuracy of each error log diagnosis result; Determine the cloud platform's fault diagnosis results based on the accuracy of each error log diagnosis result; Inputting the log data to be diagnosed into multiple error log diagnosis models to obtain an error log diagnosis result output by each error log diagnosis model includes: For any error log diagnosis model, obtaining a fault diagnosis template of the error log diagnosis model; Inputting the log data to be diagnosed into the fault diagnosis template to obtain an instantiated fault diagnosis template; Inputting the instantiated fault diagnosis template into the corresponding error log diagnosis model to obtain the error log diagnosis result output by the error log diagnosis model; The step of inputting the log data to be diagnosed and the error log diagnosis results output by each error log diagnosis model into multiple error log diagnosis models to obtain voting results of the multiple error log diagnosis results output by each error log diagnosis model includes: For any error log diagnosis model, obtain a diagnosis result voting template of the error log diagnosis model; Inputting the log data to be diagnosed and the error log diagnosis results output by each error log diagnosis model into the diagnosis result voting template to obtain an instantiated diagnosis result voting template; Inputting the instantiated diagnosis result voting template into the corresponding error log diagnosis model to obtain multiple error log diagnosis results output by the error log diagnosis model and sorted in descending order of correctness; The voting results of the plurality of error log diagnosis results include a plurality of error log diagnosis results sorted from high to low in terms of correctness.
2. The method according to claim 1, characterized in that The real-time acquisition of error log data from the cloud platform includes: Collect operation logs and fault logs from different server nodes in real time; The error log data is filtered out from the operation log and the fault log.
3. The method according to claim 1, characterized in that The step of dividing the error log data into a plurality of log data to be diagnosed includes: Obtaining timestamp information of the error log data; Based on the timestamp information, the error log data is divided into a plurality of log data to be diagnosed according to a preset time window; The segment log data corresponding to the preset time period before other preset time windows except the first preset time window overlaps with the segment log data corresponding to the preset time period after the previous preset time window.
4. The method according to claim 1, wherein The voting results of the multiple error log diagnosis results include multiple error log diagnosis results sorted from high to low according to correctness, and the voting results of the multiple error log diagnosis results output by each error log diagnosis model are summarized and processed on the error log diagnosis results output by the multiple error log diagnosis models to obtain the accuracy of each error log diagnosis result, including: Determining, based on the multiple error log diagnosis results output by each error log diagnosis model and sorted in descending order of correctness, the correctness scores of the multiple error log diagnosis results output by each error log diagnosis model, wherein an error log diagnosis result with a higher correctness has a higher corresponding correctness score; For any error log diagnosis model, determine the weight of the error log diagnosis result output by the error log diagnosis model based on the historical diagnosis accuracy of the error log diagnosis model, wherein the higher the historical diagnosis accuracy, the greater the weight; For any error log diagnosis result, obtain the correctness score and weight corresponding to the error log diagnosis result under each error log diagnosis model; For any error log diagnosis model, based on the weight corresponding to the error log diagnosis result under the error log diagnosis model, weighted processing is performed on the correctness score corresponding to the error log diagnosis result under the error log diagnosis model to obtain the target correctness score corresponding to the error log diagnosis result under the error log diagnosis model; Summing target correctness scores corresponding to the error log diagnosis result under multiple error log diagnosis models to obtain the accuracy of the error log diagnosis result; Among them, the sum of the weights of the error log diagnosis results output by multiple error log diagnosis models is a preset value.
5. The method according to claim 1, characterized in that Determining the cloud platform fault diagnosis result based on the accuracy of each error log diagnosis result includes: Based on the accuracy of each error log diagnosis result, filter out the error log diagnosis result with the highest accuracy; Determine whether the accuracy of the error log diagnosis result with the highest accuracy is greater than a preset accuracy threshold; When the accuracy of the error log diagnosis result with the highest accuracy is greater than a preset accuracy threshold, an alarm is issued, and the error log diagnosis result with the highest accuracy is fed back as the fault diagnosis result of the cloud platform; When the accuracy of the error log diagnosis result with the highest accuracy is not greater than the preset accuracy threshold, the error log diagnosis result with the highest accuracy is fed back to the maintenance personnel so that the maintenance personnel can determine the fault diagnosis result of the cloud platform based on the error log diagnosis result with the highest accuracy.
6. A cloud platform fault diagnosis device, characterized in that: The device comprises: The first acquisition module is used to obtain error log data of the cloud platform in real time; A division module, used for dividing the error log data into a plurality of log data to be diagnosed; A second acquisition module is configured to input any log data to be diagnosed into multiple error log diagnosis models to obtain an error log diagnosis result output by each error log diagnosis model, wherein the error log diagnosis model is a large model; a third acquisition module, configured to input the log data to be diagnosed and the error log diagnosis results output by each error log diagnosis model into multiple error log diagnosis models, and obtain voting results of the multiple error log diagnosis results output by each error log diagnosis model; a fourth acquisition module, configured to aggregate the error log diagnosis results output by the plurality of error log diagnosis models based on the voting results of the plurality of error log diagnosis results output by each error log diagnosis model, and obtain the accuracy of each error log diagnosis result; A determination module is used to determine the fault diagnosis result of the cloud platform based on the accuracy of each error log diagnosis result; The second acquisition module includes: A second acquiring unit is configured to acquire a fault diagnosis template of any error log diagnosis model; A first instantiation unit, configured to input the log data to be diagnosed into the fault diagnosis template to obtain an instantiated fault diagnosis template; a third acquiring unit, configured to input the instantiated fault diagnosis template into a corresponding error log diagnosis model, and obtain an error log diagnosis result output by the error log diagnosis model; The third acquisition module includes: a fourth acquiring unit, configured to acquire, for any error log diagnostic model, a diagnostic result voting template of the error log diagnostic model; A second instantiation unit is configured to input the log data to be diagnosed and the error log diagnosis result output by each error log diagnosis model into the diagnosis result voting template to obtain an instantiated diagnosis result voting template; A fifth acquisition unit is configured to input the instantiated diagnosis result voting template into a corresponding error log diagnosis model to obtain a plurality of error log diagnosis results output by the error log diagnosis model and sorted in descending order of correctness; The voting results of the plurality of error log diagnosis results include a plurality of error log diagnosis results sorted from high to low in terms of correctness.
7. A computer device, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the cloud platform fault diagnosis method according to any one of claims 1 to 5 by executing the computer instructions.
8. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the cloud platform fault diagnosis method according to any one of claims 1 to 5.
Citation Information
Patent Citations
System log intelligent analysis method and device based on large language model
CN117873979A
Electric drive assembly fault diagnosis method and device based on large language model
CN118035757A