Server hardware fault diagnosis method, electronic equipment and storage medium

Abstract

The invention discloses a server hardware fault diagnosis method, electronic equipment and a storage medium, and relates to the technical field of server fault diagnosis, and the method comprises the steps: carrying out the time-space alignment processing of hardware fault feature information and hardware fault correlation feature information, the aligned hardware fault feature information and the aligned hardware fault associated feature information are obtained; then, according to the aligned hardware fault feature information and the aligned hardware fault association feature information, querying in a hardware fault association diagnosis rule base to obtain a query result; and finally, in response to the query result as a target hardware fault correlation diagnosis rule, performing hardware fault diagnosis according to the aligned hardware fault feature information, the aligned hardware fault correlation feature information and the target hardware fault correlation diagnosis rule to obtain a first server hardware fault diagnosis result. The technical problem of low efficiency or low accuracy is solved, and the technical effect of improving the accuracy of server hardware fault diagnosis is achieved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of server fault diagnosis, and in particular to a server hardware fault diagnosis method, an electronic device and a storage medium. BACKGROUND

[0002] Servers have been widely used in various fields of social life, and are mainly used for processing critical businesses. System data loss or server abnormal shutdown will cause serious consequences to related fields. Therefore, high availability is required for servers, and high availability requires efficient fault monitoring, fault diagnosis, fault recovery and other technologies to achieve.

[0003] However, the current server hardware fault diagnosis has problems such as low efficiency or low accuracy. SUMMARY

[0004] The present application provides a server hardware fault diagnosis method, an electronic device and a storage medium to at least solve the problem of low efficiency or low accuracy in related technologies.

[0005] In a first aspect, the present application provides a server hardware fault diagnosis method, comprising: Obtaining hardware fault feature information monitored by a baseboard management controller and hardware fault association feature information monitored by an operating system; Performing space-time alignment processing on the hardware fault feature information and the hardware fault association feature information to obtain aligned hardware fault feature information and aligned hardware fault association feature information; According to the aligned hardware fault feature information and the aligned hardware fault association feature information, querying in a hardware fault association diagnosis rule library to obtain a query result; In response to the query result being a target hardware fault association diagnosis rule, performing hardware fault diagnosis according to the aligned hardware fault feature information, the aligned hardware fault association feature information and the target hardware fault association diagnosis rule to obtain a first server hardware fault diagnosis result.

[0006] In one of the embodiments, obtaining the hardware fault feature information monitored by the baseboard management controller and the hardware fault association feature information monitored by the operating system comprises: obtaining hardware sensor data, system event logs and hardware error codes of the baseboard management controller; performing feature extraction processing on the hardware sensor data, the system event logs and the hardware error codes to obtain the hardware fault feature information.

[0007] In one of the embodiments, the obtaining the hardware fault feature information monitored by the baseboard management controller and the hardware fault correlation feature information monitored by the operating system further comprises: in response to receiving the fault event reporting request sent by the operating system, sending the receiving fault event data feedback to the operating system according to the fault event reporting request; in response to receiving the fault event data sent by the operating system, sending the fault event data has been received feedback to the operating system according to the fault event data; and performing log structured processing on the fault event data according to a preset data format to obtain the hardware fault correlation feature information.

[0008] In one of the embodiments, before the sending the receiving fault event data feedback to the operating system according to the fault event reporting request in response to receiving the fault event reporting request sent by the operating system, the method further comprises: In response to the construction operation of the data transmission channel of the baseboard management controller and the operating system, establishing a virtual universal serial bus data transmission channel between the baseboard management controller and the operating system according to the result of the construction operation.

[0009] In one of the embodiments, the first server hardware fault diagnosis result comprises a hardware fault component, a hardware fault time and a hardware fault type; and the method further comprises: inputting the hardware fault component, the hardware fault time and the hardware fault type into a fault grading engine to obtain a hardware fault level; in response to the hardware fault level being less than a level threshold, querying the hardware fault type in a hardware fault repair strategy library to obtain a target hardware fault repair strategy; and performing an automatic repair operation according to the target hardware fault repair strategy.

[0010] In one of the embodiments, the method further comprises: in response to the hardware fault level being greater than or equal to the level threshold, generating a hardware fault repair prompt information according to the hardware fault component, the hardware fault time, the hardware fault type and the hardware fault level; and performing a fault repair prompt according to the hardware fault repair prompt.

[0011] In one of the embodiments, the method further comprises: in response to the query result being empty, inputting the aligned hardware fault feature information and the aligned hardware fault correlation feature information into a pre-trained hardware fault diagnosis time sequence model to output a second server hardware fault diagnosis result and a confidence of the second server hardware fault diagnosis result; and the second server hardware fault diagnosis result comprises a hardware fault component, a hardware fault time and a hardware fault type.

[0012] In one of the embodiments, the hardware fault correlation feature information comprises hardware state information, hardware component information, system log information, hardware performance index information and hardware process state information.

[0013] In one of the embodiments, the method further comprises: In response to the construction operation on the hardware fault correlation diagnosis rule library, a hardware fault correlation diagnosis rule library is generated according to a result of the construction operation; In response to the setting operation on the hardware fault correlation diagnosis rule, a hardware fault correlation diagnosis rule is generated according to a result of the setting operation, and the hardware fault correlation diagnosis rule is stored into the hardware fault correlation diagnosis rule library.

[0014] In a second aspect, a server hardware fault diagnosis apparatus is provided, and the apparatus comprises a feature information acquisition module, a space-time alignment processing module, a diagnosis rule query module, and a fault diagnosis module.

[0015] The feature information acquisition module is configured to acquire hardware fault feature information monitored by a baseboard management controller and hardware fault correlation feature information monitored by an operating system. The space-time alignment processing module is configured to perform space-time alignment processing on the hardware fault feature information and the hardware fault correlation feature information, to obtain aligned hardware fault feature information and aligned hardware fault correlation feature information. The diagnosis rule query module is configured to perform a query in a hardware fault correlation diagnosis rule library according to the aligned hardware fault feature information and the aligned hardware fault correlation feature information, to obtain a query result. The fault diagnosis module is configured to, in response to the query result being a target hardware fault correlation diagnosis rule, perform hardware fault diagnosis according to the aligned hardware fault feature information, the aligned hardware fault correlation feature information, and the target hardware fault correlation diagnosis rule, to obtain a first server hardware fault diagnosis result.

[0016] In a third aspect, the present application further provides an electronic device, which comprises a memory configured to store a computer program, and a processor configured to execute the computer program to implement the steps of any of the server hardware fault diagnosis methods.

[0017] In a fourth aspect, the present application further provides a computer readable storage medium, which stores a computer program, wherein the computer program is executed by a processor to implement the steps of any of the server hardware fault diagnosis methods.

[0018] With the server hardware fault diagnosis method, the electronic device and the storage medium provided in the present application, the hardware fault feature information monitored by the baseboard management controller and the hardware fault correlation feature information monitored by the operating system are acquired; then, the hardware fault feature information and the hardware fault correlation feature information are subjected to spatio-temporal alignment processing to obtain the aligned hardware fault feature information and the aligned hardware fault correlation feature information; then, the aligned hardware fault feature information and the aligned hardware fault correlation feature information are queried in the hardware fault correlation diagnosis rule library to obtain a query result; finally, in response to the query result being a target hardware fault correlation diagnosis rule, the hardware fault is diagnosed according to the aligned hardware fault feature information, the aligned hardware fault correlation feature information and the target hardware fault correlation diagnosis rule to obtain a first server hardware fault diagnosis result, so that the technical problem of low efficiency or low accuracy can be solved, the data fragmentation of different hardware fault feature information is avoided, the OS and the BMC are prevented from processing their respective fault feature information to cause a lack of deep perception of the hardware fault feature information at the OS level in the server hardware fault diagnosis process, the dimension of the server hardware fault diagnosis is widened, the efficiency, accuracy and convenience of the server hardware fault diagnosis are improved, and the predictability of the server hardware fault diagnosis is improved. BRIEF DESCRIPTION OF DRAWINGS

[0019] In order to more clearly illustrate the embodiments of the present application, the drawings required to be used in the embodiments will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0020] Figure 1 An application environment diagram of the server hardware fault diagnosis method in an embodiment; Figure 2 A first flowchart of the server hardware fault diagnosis method in an embodiment; Figure 3 A first flowchart of acquiring the hardware fault feature information monitored by the baseboard management controller and the hardware fault correlation feature information monitored by the operating system in an embodiment; Figure 4 A second flowchart of acquiring the hardware fault feature information monitored by the baseboard management controller and the hardware fault correlation feature information monitored by the operating system in an embodiment; Figure 5 A second flowchart of the server hardware fault diagnosis method in an embodiment; Figure 6 A third flowchart of the server hardware fault diagnosis method in an embodiment; Figure 7 Figure 1 is a structural block diagram of a server hardware fault diagnosis device in one embodiment. DETAILED DESCRIPTION

[0021] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

[0022] It should be noted that, in the description of the present application, the terms "comprise", "contain" or any other variants thereof are intended to cover non-exclusive inclusion, so that the process, method, article or equipment comprising a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or equipment. The terms "first", "second" and the like in the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence.

[0023] The server hardware fault diagnosis method provided by the present application can be applied to an application environment as shown in Figure 1 . The terminal 102 communicates with the server 104 through the network. The terminal 102 can be, but is not limited to, various personal computers, notebook computers, smart phones, tablet computers and portable wearable devices, and the server 104 can be implemented by an independent server or a server cluster composed of multiple servers. The server 104 is configured with a baseboard management controller (BMC), an operating system (OS), a central processing unit (CPU), a basic input / output system (BIOS), a complex programmable logic device (CPLD) and a field programmable gate array (FPGA).

[0024] In a first aspect, as shown in Figure 2 , a server hardware fault diagnosis method is provided. Taking the baseboard management controller in the server 104 in Figure 1 as an example, the method includes the following steps 201 to 204.

[0025] Step 201: Obtain hardware fault characteristic information monitored by the baseboard management controller and hardware fault association characteristic information monitored by the operating system.

[0026] Among them, the hardware fault characteristic information is the hardware characteristic information required for hardware fault diagnosis. The hardware fault association characteristic information is the hardware association characteristic information required for hardware fault diagnosis. Specifically, the baseboard management controller in server 104 obtains the hardware fault characteristic information monitored by the baseboard management controller and the hardware fault association characteristic information monitored by the operating system.

[0027] In one embodiment, such as Figure 3 As shown, the process of obtaining hardware fault characteristic information monitored by the baseboard management controller and hardware fault related characteristic information monitored by the operating system includes steps 301 to 302.

[0028] Step 301: Obtain hardware sensor data, system event logs, and hardware error codes from the baseboard management controller.

[0029] Step 302: Perform feature extraction processing on hardware sensor data, system event logs, and hardware error codes to obtain hardware fault feature information.

[0030] Specifically, the baseboard management controller in server 104 acquires hardware sensor data, system event logs, and hardware error codes from the baseboard management controller; then, it performs feature extraction processing on the hardware sensor data, system event logs, and hardware error codes to obtain hardware fault feature information, thereby improving the accuracy, efficiency, and convenience of acquiring hardware fault feature information.

[0031] In a specific example, hardware sensor data may include, but is not limited to, temperature, power consumption, and ECC errors. The baseboard management controller may, but is not limited to, employ wavelet transform feature extraction algorithms to extract features from hardware sensor data, system event (SEL) logs, and hardware error codes to obtain hardware fault feature information. The above is only a specific example, and in actual applications, it can be flexibly configured according to user needs, without any restrictions.

[0032] In this embodiment, hardware sensor data, system event logs, and hardware error codes of the baseboard management controller are acquired. Then, feature extraction processing is performed on the hardware sensor data, system event logs, and hardware error codes to obtain hardware fault feature information, thereby improving the accuracy and efficiency of acquiring hardware fault feature information.

[0033] In one embodiment, such as Figure 4 As shown, obtaining hardware fault characteristic information monitored by the baseboard management controller and hardware fault related characteristic information monitored by the operating system also includes steps 401 to 403.

[0034] Step 401, in response to receiving the fault event reporting request sent by the operating system, sending the received fault event data feedback to the operating system according to the fault event reporting request.

[0035] Specifically, the baseboard management controller in the server 104, in response to receiving the fault event reporting request sent by the operating system, sends the received fault event data feedback to the operating system according to the fault event reporting request, so as to timely inform the baseboard management controller that it has prepared to receive the fault event data according to the received fault event data feedback.

[0036] In one of the embodiments, as shown in Figure 4 Before the step of sending the received fault event data feedback to the operating system according to the fault event reporting request in response to receiving the fault event reporting request sent by the operating system, the step 400 is further included.

[0037] Step 400, in response to the construction operation of the data transmission channel between the baseboard management controller and the operating system, establishing a virtual Universal Serial Bus (USB) data transmission channel between the baseboard management controller and the operating system according to the result of the construction operation.

[0038] Specifically, the baseboard management controller in the server 104, in response to the construction operation of the data transmission channel between the baseboard management controller and the operating system, establishes a virtual Universal Serial Bus (USB) data transmission channel between the baseboard management controller and the operating system according to the result of the construction operation, so as to facilitate the data transmission between the BMC and the OS, and avoid the mutual fragmentation of fault diagnosis data between the BMC and the OS.

[0039] In one specific example, the virtual Universal Serial Bus (USB) data transmission channel can be, but is not limited to, an encrypted data transmission link established by the Redfish API and the OS agent. The above is only a specific example, and in actual application, it is flexibly set according to user demand, which is not limited here.

[0040] In this embodiment, in response to the construction operation of the data transmission channel between the baseboard management controller and the operating system, a virtual Universal Serial Bus (USB) data transmission channel is established between the baseboard management controller and the operating system according to the result of the construction operation, so as to facilitate the data transmission between the BMC and the OS, and avoid the mutual fragmentation of fault diagnosis data between the BMC and the OS.

[0041] At step 402, in response to receiving the fault event data sent by the operating system, the fault event data has been received feedback is sent to the operating system according to the fault event data.

[0042] At step 403, the fault event data is log structured according to the preset data format, and the hardware fault associated feature information is obtained.

[0043] Specifically, the baseboard management controller in the server 104 responds to receiving the fault event data sent by the operating system, and sends the fault event data has been received feedback to the operating system according to the fault event data; and then, the fault event data is log structured according to the preset data format, and the hardware fault associated feature information is obtained, which improves the accuracy and efficiency of obtaining the hardware fault associated feature information.

[0044] In this embodiment, in response to receiving the fault event reporting request sent by the operating system, the fault event data receiving feedback is sent to the operating system according to the fault event reporting request; then, in response to receiving the fault event data sent by the operating system, the fault event data has been received feedback is sent to the operating system according to the fault event data; and then, the fault event data is log structured according to the preset data format, and the hardware fault associated feature information is obtained, which improves the accuracy and efficiency of obtaining the hardware fault associated feature information.

[0045] In one of the embodiments, the hardware fault associated feature information includes hardware state information, hardware component information, system log information, hardware performance index information and hardware process state information; the accuracy of server hardware fault diagnosis is improved through the above-mentioned rich hardware fault associated feature information.

[0046] In one specific example, the hardware state information can include but is not limited to DMA transmission error and hardware interrupt frequency obtained in real time based on eBPF technology; the hardware component information can include but is not limited to PCIE information and raid information; the system log information can include but is not limited to / var / log / messages log file in Linux system; the hardware performance index information can include but is not limited to CPU utilization and memory utilization; the hardware process state information can include but is not limited to running state, blocking state and suspension state, which are only specific examples, and are flexibly set according to user demand in actual application, which is not limited here.

[0047] At step 202, the hardware fault feature information and the hardware fault associated feature information are processed by time and space alignment, and the aligned hardware fault feature information and the aligned hardware fault associated feature information are obtained.

[0048] Specifically, the baseboard management controller in the server 104 performs spatio-temporal alignment processing on the hardware fault feature information and the hardware fault correlation feature information, to obtain aligned hardware fault feature information and aligned hardware fault correlation feature information, so that the hardware fault feature information and the hardware fault correlation feature information are synchronized in milliseconds, thereby solving the problem of time inconsistency between the hardware fault feature information and the hardware fault correlation feature information, facilitating subsequent hardware fault diagnosis and analysis, and improving the accuracy and efficiency of hardware fault analysis.

[0049] In one specific example, the baseboard management controller in the server 104 adopts a spatio-temporal alignment algorithm with an attention mechanism to perform spatio-temporal alignment processing on the hardware fault feature information and the hardware fault correlation feature information, to obtain aligned hardware fault feature information and aligned hardware fault correlation feature information. The spatio-temporal alignment processing process is based on the NTP protocol. The above is only a specific example, and in actual application, it is flexibly set according to user needs, which is not limited here.

[0050] In step 203, a query is performed in the hardware fault correlation diagnosis rule library according to the aligned hardware fault feature information and the aligned hardware fault correlation feature information, to obtain a query result.

[0051] The query result includes a target hardware fault correlation diagnosis rule or null. It can be understood that the target hardware fault correlation diagnosis rule is a hardware fault correlation diagnosis rule that takes the aligned hardware fault feature information and the aligned hardware fault correlation feature information as rule conditions. When the query result is the target hardware fault correlation diagnosis rule, it indicates that the target hardware fault correlation diagnosis rule exists in the hardware fault correlation diagnosis rule library. When the query result is null, it indicates that the target hardware fault correlation diagnosis rule does not exist in the hardware fault correlation diagnosis rule library.

[0052] Specifically, the baseboard management controller in the server 104 performs a query in the hardware fault correlation diagnosis rule library according to the aligned hardware fault feature information and the aligned hardware fault correlation feature information, to obtain a query result.

[0053] In one of the embodiments, the method further includes: In response to the construction operation on the hardware fault correlation diagnosis rule library, generating the hardware fault correlation diagnosis rule library according to the result of the construction operation; In response to the setting operation on the hardware fault correlation diagnosis rule, generating the hardware fault correlation diagnosis rule according to the result of the setting operation, and storing the hardware fault correlation diagnosis rule to the hardware fault correlation diagnosis rule library.

[0054] The above is only a specific example, and in actual application, it is flexibly set according to user needs, which is not limited here.

[0055] In one specific example, the specific content of the hardware fault correlation diagnosis rule of the disk failure includes: “if BMC.SMART_Error == "MediaError" and OS.dmesg.contains("I / O timeout"): return FaultType.DISK_HARD_FAILURE”, which is only a specific example, and in actual application, it is flexibly set according to user needs, and is not limited here.

[0056] In step 204, in response to the query result being the target hardware fault correlation diagnosis rule, hardware fault diagnosis is performed according to the aligned hardware fault feature information, the aligned hardware fault correlation feature information, and the target hardware fault correlation diagnosis rule, to obtain a first server hardware fault diagnosis result.

[0057] Specifically, the baseboard management controller in the server 104, in response to the query result being the target hardware fault correlation diagnosis rule, performs hardware fault diagnosis according to the aligned hardware fault feature information, the aligned hardware fault correlation feature information, and the target hardware fault correlation diagnosis rule, to obtain a first server hardware fault diagnosis result, avoids data fragmentation of different hardware fault feature information, avoids the lack of deep perception of hardware fault feature information at the OS level in the server hardware fault diagnosis process due to the separate processing of respective fault feature information by the OS and the BMC, widens the dimension of server hardware fault diagnosis, improves the efficiency, accuracy, and convenience of fault diagnosis, and also improves the predictability of server hardware fault diagnosis.

[0058] The server hardware fault diagnosis method obtains hardware fault feature information monitored by a baseboard management controller and hardware fault correlation feature information monitored by an operating system, then performs space-time alignment processing on the hardware fault feature information and the hardware fault correlation feature information to obtain aligned hardware fault feature information and aligned hardware fault correlation feature information, then queries the aligned hardware fault feature information and the aligned hardware fault correlation feature information in a hardware fault correlation diagnosis rule library to obtain a query result, and finally, in response to the query result being a target hardware fault correlation diagnosis rule, performs hardware fault diagnosis according to the aligned hardware fault feature information, the aligned hardware fault correlation feature information, and the target hardware fault correlation diagnosis rule to obtain a first server hardware fault diagnosis result. This avoids data fragmentation of different hardware fault feature information, avoids a lack of deep perception of hardware fault feature information at an OS level in a server hardware fault diagnosis process due to the OS and the BMC processing their respective fault feature information, widens the dimension of server hardware fault diagnosis, improves the efficiency, accuracy, and convenience of fault diagnosis, improves the predictability of server hardware fault diagnosis, and saves human cost and server resources.

[0059] In one of the embodiments, the first server hardware fault diagnosis result includes a hardware fault component, a hardware fault time, and a hardware fault type; and as shown in Figure 5 The method further includes steps 501 to 503.

[0060] In step 501, the hardware fault component, the hardware fault time, and the hardware fault type are input to a fault grading engine to obtain a hardware fault level.

[0061] In step 502, in response to the hardware fault level being less than a level threshold, a target hardware fault repair strategy is obtained by querying a hardware fault repair strategy library according to the hardware fault type.

[0062] In step 503, an automatic repair operation is performed according to the target hardware fault repair strategy.

[0063] Specifically, the baseboard management controller in the server 104 inputs the hardware fault component, the hardware fault time, and the hardware fault type to the fault grading engine to obtain a hardware fault level, then in response to the hardware fault level being less than a level threshold, a target hardware fault repair strategy is obtained by querying a hardware fault repair strategy library according to the hardware fault type, and finally, an automatic repair operation is performed according to the target hardware fault repair strategy, which improves the convenience of server hardware fault diagnosis and the automatic repair capability of the server.

[0064] In the embodiment, the hardware fault component, the hardware fault time and the hardware fault type are input to the fault grading engine to obtain a hardware fault level; then, in response to the hardware fault level being less than a level threshold, a target hardware fault repair strategy is obtained by querying the hardware fault repair strategy library according to the hardware fault type; and then, automatic repair operation is performed according to the target hardware fault repair strategy, thereby improving the convenience of server hardware fault diagnosis and the automatic repair capability of the server.

[0065] In one of the embodiments, as shown in Figure 5 the method further includes steps 504 and 505.

[0066] Step 504: in response to the hardware fault level being greater than or equal to the level threshold, hardware fault repair prompt information is generated according to the hardware fault component, the hardware fault time, the hardware fault type and the hardware fault level.

[0067] Step 505: fault repair prompting is performed according to the hardware fault repair prompt.

[0068] Specifically, the baseboard management controller in the server 104 generates hardware fault repair prompt information according to the hardware fault component, the hardware fault time, the hardware fault type and the hardware fault level in response to the hardware fault level being greater than or equal to the level threshold; and then, fault repair prompting is performed according to the hardware fault repair prompt, thereby improving the convenience of server hardware fault diagnosis and the operation safety of the server.

[0069] In the embodiment, in response to the hardware fault level being greater than or equal to the level threshold, hardware fault repair prompt information is generated according to the hardware fault component, the hardware fault time, the hardware fault type and the hardware fault level; and then, fault repair prompting is performed according to the hardware fault repair prompt, thereby improving the convenience of server hardware fault diagnosis and the operation safety of the server.

[0070] In one of the embodiments, as shown in Figure 6 the method further includes step 601.

[0071] Step 601: in response to the query result being empty, the aligned hardware fault feature information and the aligned hardware fault associated feature information are input to the pre-trained hardware fault diagnosis time sequence model to output a second server hardware fault diagnosis result and a confidence of the second server hardware fault diagnosis result.

[0072] The second server hardware fault diagnosis result includes a hardware fault component, a hardware fault time and a hardware fault type. Specifically, the baseboard management controller in the server 104, in response to the query result being empty, indicates that there is no target hardware fault correlation diagnosis rule in the hardware fault correlation diagnosis rule library at this time, so the aligned hardware fault feature information and the aligned hardware fault correlation feature information are input into the pre-trained hardware fault diagnosis time sequence model, and the second server hardware fault diagnosis result and the confidence of the second server hardware fault diagnosis result are output, improving the comprehensiveness, accuracy and convenience of the server hardware fault diagnosis.

[0073] In the embodiment, in response to the query result being empty, it is indicated that there is no target hardware fault correlation diagnosis rule in the hardware fault correlation diagnosis rule library at this time, so the aligned hardware fault feature information and the aligned hardware fault correlation feature information are input into the pre-trained hardware fault diagnosis time sequence model, and the second server hardware fault diagnosis result and the confidence of the second server hardware fault diagnosis result are output, improving the comprehensiveness, accuracy and convenience of the server hardware fault diagnosis.

[0074] In one specific example, the obtained hardware sensor data of the baseboard management controller includes memory voltage fluctuation and error correction count of error checking and correcting (ECC); the obtained data of the operating system includes CE / UE technology reported by an error detection and correction (EDAC) unit and memory controller load rate captured based on eBPF technology; at the same time, the obtained hardware fault feature information monitored by the baseboard management controller includes time domain feature information and frequency domain feature information; the time domain feature information includes ECC error growth rate and voltage fluctuation amplitude; the frequency domain feature information includes FFT analysis voltage ripple main frequency; and the obtained hardware fault correlation feature information monitored by the operating system includes error time and temperature / load correlation. By performing spatiotemporal alignment processing on the aforementioned hardware fault feature information and hardware fault association feature information, aligned hardware fault feature information and aligned hardware fault association feature information can be obtained. Then, a query is performed in the hardware fault association diagnosis rule base based on the aligned hardware fault feature information and aligned hardware fault association feature information to obtain the query results. Next, in response to an empty query result, the aligned hardware fault feature information and aligned hardware fault association feature information are input into a pre-trained hardware fault diagnosis time series model, outputting the second server hardware fault diagnosis result and the confidence level of the second server hardware fault diagnosis result. Specifically, the hardware fault type in the second server hardware fault diagnosis result is server memory degradation, and the faulty component in the second server hardware fault diagnosis result is DIMM3; the confidence level of the second server hardware fault diagnosis result is 92%; in addition, the hardware fault repair prompt message is "Migrate critical data, replace within 72 hours". The above is only a specific example; in actual applications, it can be flexibly set according to user needs, and no restrictions are imposed here.

[0075] From the above description of the embodiments, those skilled in the art can clearly understand that the methods according to the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. It should be understood that, although... Figures 2-6 The steps in the flowchart are shown sequentially as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order in which these steps are executed, and they can be performed in other orders. Figures 2-6 At least some of the steps in the process may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least some of the sub-steps or stages of other steps.

[0076] Secondly, such as Figure 7 As shown, a server hardware fault diagnosis device is provided. The device includes a feature information acquisition module 710, a spatiotemporal alignment processing module 720, a diagnosis rule query module 730, and a fault diagnosis module 740.

[0077] The characteristic information acquisition module 710 is configured to acquire hardware fault characteristic information monitored by a baseboard management controller and hardware fault correlation characteristic information monitored by an operating system.

[0078] In one of the embodiments, the characteristic information acquisition module 710 comprises a first characteristic information acquisition unit.

[0079] The first characteristic information acquisition unit is configured to acquire hardware sensor data, system event logs and hardware error codes of the baseboard management controller, and to perform feature extraction processing on the hardware sensor data, the system event logs and the hardware error codes to obtain the hardware fault characteristic information.

[0080] In one of the embodiments, the characteristic information acquisition module 710 comprises a second characteristic information acquisition unit.

[0081] The second characteristic information acquisition unit is configured to, in response to receiving a fault event reporting request sent by the operating system, send a fault event data receiving feedback to the operating system according to the fault event reporting request, to, in response to receiving fault event data sent by the operating system, send a fault event data received feedback to the operating system according to the fault event data, and to perform log structuring processing on the fault event data according to a preset data format to obtain the hardware fault correlation characteristic information.

[0082] In one of the embodiments, the second characteristic information acquisition unit is further configured to, in response to a construction operation of a data transmission channel of the baseboard management controller and the operating system, establish a virtual universal serial bus data transmission channel between the baseboard management controller and the operating system according to a result of the construction operation.

[0083] In one of the embodiments, the first server hardware fault diagnosis result comprises a hardware fault component, a hardware fault time and a hardware fault type, and the apparatus further comprises an automatic repair module.

[0084] The automatic repair module is configured to input the hardware fault component, the hardware fault time and the hardware fault type into the fault grading engine to obtain a hardware fault level; the automatic repair module is configured to, in response to the hardware fault level being less than a level threshold, query the hardware fault repair strategy library according to the hardware fault type to obtain a target hardware fault repair strategy; and the automatic repair module is configured to perform an automatic repair operation according to the target hardware fault repair strategy.

[0085] In one of the embodiments, the apparatus further includes a repair prompt module.

[0086] The repair prompt module is configured to, in response to the hardware fault level being greater than or equal to the level threshold, generate hardware fault repair prompt information according to the hardware fault component, the hardware fault time, the hardware fault type and the hardware fault level; and the repair prompt module is configured to perform a fault repair prompt according to the hardware fault repair prompt.

[0087] In one of the embodiments, the fault diagnosis module 740 is further configured to, in response to the query result being empty, input the aligned hardware fault feature information and the aligned hardware fault associated feature information into a pre-trained hardware fault diagnosis time sequence model to output a second server hardware fault diagnosis result and a confidence degree of the second server hardware fault diagnosis result; wherein the second server hardware fault diagnosis result includes a hardware fault component, a hardware fault time and a hardware fault type.

[0088] In one of the embodiments, the hardware fault associated feature information includes hardware state information, hardware component information, system log information, hardware performance index information and hardware process state information.

[0089] The specific limitations of the server hardware fault diagnosis apparatus can be referred to the limitations of the server hardware fault diagnosis method in the foregoing, which will not be described herein. Each module in the server hardware fault diagnosis apparatus can be realized by software, hardware and combinations thereof in whole or in part. Each module can be embedded in or independent of a processor in a computer device in hardware form, or can be stored in a memory in a computer device in software form, so as to be called and executed by a processor to perform the operations corresponding to each module.

[0090] From the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be realized by means of software and necessary general hardware platform, of course, it can also be realized by hardware, but in many cases, the former is a better embodiment.

[0091] In a third aspect, the present application further provides an electronic device, including: a memory configured to store a computer program; and a processor configured to execute the computer program to implement the steps of any of the above server hardware fault diagnosis methods.

[0092] In a fourth aspect, the present application also provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program, and the computer program is executed by a processor to implement the steps of any of the server hardware fault diagnosis methods.

[0093] In an example embodiment, the computer readable storage medium can include, but is not limited to, a U disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and various media that can store computer programs.

[0094] In a fifth aspect, the embodiments of the present application also provide a computer program product, which includes a computer program, and the computer program is executed by a processor to implement the steps in any of the server hardware fault diagnosis method embodiments.

[0095] In a sixth aspect, the embodiments of the present application also provide another computer program product, which includes a non-volatile computer readable storage medium, and the non-volatile computer readable storage medium stores a computer program, and the computer program is executed by a processor to implement the steps in any of the server hardware fault diagnosis method embodiments.

[0096] The skilled in the art can further realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be realized by electronic hardware, computer software or combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the components and steps of the examples have been described in general in the above description. Whether the functions are realized in hardware or software depends on the specific application and design constraints of the technical solution. The skilled in the art can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0097] The above describes in detail a server hardware fault diagnosis method, an electronic device and a storage medium provided by the present application. The principles and implementation manners of the present application are described by applying specific examples in this paper, and the above example descriptions are only used to help understand the method and its core idea of the present application. It should be pointed out that for the ordinary skilled in the art, some improvements and modifications can be made to the present application without departing from the principles of the present application, and these improvements and modifications also fall within the protection scope of the present application.

Claims

1. A method for diagnosing server hardware faults, characterized in that, The method includes: Acquire hardware fault characteristic information monitored by the baseboard management controller and hardware fault correlation characteristic information monitored by the operating system; The hardware fault feature information and the hardware fault association feature information are spatiotemporally aligned to obtain aligned hardware fault feature information and aligned hardware fault association feature information. Based on the aligned hardware fault feature information and the aligned hardware fault association feature information, a query is performed in the hardware fault association diagnosis rule base to obtain the query results; In response to the query result being a target hardware fault association diagnosis rule, hardware fault diagnosis is performed based on the aligned hardware fault feature information, the aligned hardware fault association feature information, and the target hardware fault association diagnosis rule to obtain a first server hardware fault diagnosis result.

2. The method according to claim 1, characterized in that, The acquisition of hardware fault characteristic information monitored by the baseboard management controller and hardware fault correlation characteristic information monitored by the operating system includes: Acquire the hardware sensor data, system event logs, and hardware error codes of the baseboard management controller; Feature extraction processing is performed on the hardware sensor data, the system A event log, and the hardware error code to obtain the hardware fault feature information.

3. The method according to claim 1, characterized in that, The step of acquiring the hardware fault characteristic information monitored by the baseboard management controller and the hardware fault correlation characteristic information monitored by the operating system further includes: In response to receiving a fault event reporting request from the operating system, the system sends a feedback message of received fault event data to the operating system based on the fault event reporting request. In response to receiving fault event data sent by the operating system, a feedback message indicating that the fault event data has been received is sent to the operating system based on the fault event data. The fault event data is processed into a log structure according to a preset data format to obtain the hardware fault association feature information.

4. The method according to claim 1, characterized in that, In response to receiving a fault event reporting request from the operating system, before sending feedback on receiving fault event data to the operating system according to the fault event reporting request, the process further includes: In response to the data transmission channel construction operation between the baseboard management controller and the operating system, a virtual universal serial bus data transmission channel between the baseboard management controller and the operating system is established based on the result of the construction operation.

5. The method according to claim 1, characterized in that, The first server hardware fault diagnosis result includes the faulty hardware component, the time of the hardware failure, and the type of hardware failure; wherein, the method further includes: The hardware faulty component, the hardware fault time, and the hardware fault type are input into the fault classification engine to obtain the hardware fault level. In response to the hardware fault level being less than the level threshold, a query is performed in the hardware fault repair strategy library according to the hardware fault type to obtain the target hardware fault repair strategy. Automatic repair operations are performed based on the target hardware fault repair strategy.

6. The method according to claim 5, characterized in that, The method further includes: In response to the hardware fault level being greater than or equal to the level threshold, a hardware fault repair prompt message is generated based on the hardware fault component, the hardware fault time, the hardware fault type, and the hardware fault level; Follow the hardware fault repair prompts to perform fault repair.

7. The method according to claim 1, characterized in that, The method further includes: In response to an empty query result, the aligned hardware fault feature information and the aligned hardware fault association feature information are input into a pre-trained hardware fault diagnosis time series model, and the second server hardware fault diagnosis result and the confidence level of the second server hardware fault diagnosis result are output; wherein, the second server hardware fault diagnosis result includes the hardware fault component, the hardware fault time, and the hardware fault type.

8. The method according to claim 1, characterized in that, The hardware fault-related feature information includes hardware status information, hardware component information, system log information, hardware performance index information, and hardware process status information.

9. The method according to claim 1, characterized in that, The method further includes: In response to the construction operation of the hardware fault association diagnosis rule base, the hardware fault association diagnosis rule base is generated based on the result of the construction operation; In response to the setting operation of hardware fault association diagnosis rules, the hardware fault association diagnosis rules are generated according to the result of the setting operation, and the hardware fault association diagnosis rules are stored in the hardware fault association diagnosis rule library.

10. An electronic device, characterized in that, include: Memory, used to store computer programs; A processor, configured to implement the steps of the server hardware fault diagnosis method as described in any one of claims 1 to 9 when executing the computer program.

Images