Storage system fault monitoring method, device, medium and computer program product
By monitoring the link status of the expansion chip and detecting heartbeat signals by the controller, the problem of inability to effectively predict storage system failures in the prior art is solved, and rapid fault location and high-reliability storage devices are achieved.
Patent Information
- Application Number
- CN202411537031.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-31
- Publication Date
- 2025-02-25
- Estimated Expiration
- 2044-10-31
AI Technical Summary
The prior art cannot effectively predict storage system failures, and the fault location process takes a long time, affecting the high reliability of the storage device.
The controller sends control signals to the expansion chip, monitors its uplink and downlink status, and detects the heartbeat signal of the expansion chip through the backplane programmable logic device to predict faults in advance and quickly locate.
It realizes the pre-predicting of storage failures in advance, reduces the fault detection time, ensures the high reliability of storage devices, and reduces the impact on business operations.
Smart Images

Figure CN119065932B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of computer technology, and in particular to a storage system fault monitoring method, device, medium and computer program product. Background Art
[0002] As cloud computing continues to develop, the scale of storage systems is getting larger and larger. For storage system failures, the log files of each storage component are usually collected first, and the corresponding fault features are extracted from the log files. Then, the extracted fault features are matched with the preset feature database, and the location of the fault is located according to the matching results. Finally, the corresponding fault handling solution is given. The above method cannot predict the failure of the storage system, and requires log extraction and feature matching, which is time-consuming. Summary of the invention
[0003] The purpose of the present invention is to provide a storage system fault monitoring method, device, medium and computer program product, which can predict storage type faults in advance, quickly locate faults, avoid extracting logs and feature matching operations, save fault detection time, and ensure the high reliability of storage devices.
[0004] In order to solve the above technical problems, the present invention provides a storage system fault monitoring method, which is used in a controller and includes:
[0005] Sending a first control signal to the extension chip to control the extension chip to monitor the uplink state and downlink state of the extension chip; the controller is connected to the extension chip;
[0006] According to the uplink state and the downlink state of the extension chip, acquiring fault information in the uplink and the downlink of the extension chip;
[0007] Sending a second control signal to a backplane programmable logic device to control the backplane programmable logic device to detect the heartbeat signal of the extension chip; the controller and the extension chip are both connected to the backplane programmable logic device;
[0008] The heartbeat signal of the extension chip is read. If the heartbeat signal of the extension chip is not within a set range, it is confirmed that the extension chip is in a hung state.
[0009] In a first aspect, the storage system fault monitoring method provided by the present invention further includes:
[0010] Sending a third control signal to the extension chip to control the extension chip to sense the main body information;
[0011] The register in the extension chip is polled to obtain the entity information perceived by the extension chip, and the entity unhealthy state of the extension chip is extracted from the entity information perceived by the extension chip.
[0012] On the other hand, in the above storage system fault monitoring method provided by the present invention, the expansion chip is upstream connected to the expansion card; the expansion card is connected to the processor;
[0013] Correspondingly, acquiring fault information in the uplink of the extension chip according to the uplink state of the extension chip includes:
[0014] The link failure information between the extension chip and the extension card is obtained from the uplink status of the extension chip.
[0015] On the other hand, in the storage system fault monitoring method provided by the present invention, obtaining the link fault information between the extension chip and the extension card from the uplink status of the extension chip includes:
[0016] Polling the register in the extension chip to obtain the link rate information and link bandwidth reduction information between the extension chip and the extension card from the uplink status of the extension chip;
[0017] The link rate information and the link bandwidth reduction information between the extension chip and the extension card are analyzed to obtain the link fault information between the extension chip and the extension card.
[0018] On the other hand, in the above storage system fault monitoring method provided by the present invention, the expansion chip is downstream connected to at least one hard disk;
[0019] Correspondingly, acquiring fault information in the downlink of the extension chip according to the downlink status of the extension chip includes:
[0020] The unhealthy status of each of the hard disks downstream connected to the extension chip is obtained from the downlink status of the extension chip.
[0021] On the other hand, in the storage system fault monitoring method provided by the present invention, obtaining the unhealthy status of each hard disk downstream connected to the extension chip from the downlink status of the extension chip includes:
[0022] Polling the register in the expansion chip, and obtaining the status information of each hard disk connected to the expansion chip in the downlink state of the expansion chip;
[0023] Parsing the status information of each hard disk to obtain the self-monitoring analysis and report status results of each hard disk;
[0024] According to the self-monitoring analysis and reported status results of each hard disk, it is determined whether the remapped sector count in the attribute is greater than a set threshold. If so, it is determined that the sector is damaged.
[0025] On the other hand, in the storage system fault monitoring method provided by the present invention, controlling the extension chip to sense the main body information includes:
[0026] Control the extension chip to sense the information of the clock module, the integrated circuit bus module, and the port physical layer module in the extension chip and store the information in the register;
[0027] Correspondingly, obtaining the entity information perceived by the extension chip, and extracting the entity unhealthy state of the extension chip from the entity information perceived by the extension chip, includes:
[0028] The information of the clock module, the integrated circuit bus module, and the port physical layer module in the extension chip is obtained, and the information of the clock module, the integrated circuit bus module, and the port physical layer module in the extension chip is parsed to extract the unhealthy state of the extension chip.
[0029] On the other hand, in the storage system fault monitoring method provided by the present invention, reading the heartbeat signal of the expansion chip includes:
[0030] Polling the register of the backplane programmable logic device and analyzing the register information corresponding to the backplane programmable logic device;
[0031] According to the analysis result, the heartbeat signal of the extension chip is obtained.
[0032] On the other hand, in the storage system fault monitoring method provided by the present invention, it also includes:
[0033] Monitoring a signal in the expansion card for detecting the stability of the power supply output voltage, so as to detect the power supply status of the expansion card in real time;
[0034] At least one signal in the expansion chip for detecting the stability of the power supply output voltage is monitored to detect the power supply status of the expansion chip in real time.
[0035] On the other hand, in the storage system fault monitoring method provided by the present invention, it also includes:
[0036] Monitoring the signal used to detect the stability of the power supply output voltage in each hard disk to detect the power supply status of each hard disk in real time;
[0037] At the same time, it monitors whether the link between each hard disk and the expansion chip is disconnected, so as to locate the hard disk corresponding to the disconnected link.
[0038] On the other hand, in the above storage system fault monitoring method provided by the present invention, the expansion chip is connected to the backplane programmable logic device through a general input and output port;
[0039] The general input and output port is a pin with a heartbeat function in the expansion chip.
[0040] On the other hand, in the above storage system fault monitoring method provided by the present invention, the expansion chip is connected to the controller via an integrated circuit bus; or,
[0041] The expansion chip is connected to the controller via a universal asynchronous receiver / transmitter.
[0042] In order to solve the above technical problems, the present invention also provides a storage system fault monitoring device, the device comprising: a controller, an expansion chip connected to the controller, and a backplane programmable logic device connected to the controller and the expansion chip respectively;
[0043] The controller is used to send a first control signal to the extension chip to control the extension chip to monitor the uplink status and downlink status of the extension chip; obtain fault information in the uplink and downlink of the extension chip according to the uplink status and downlink status of the extension chip; send a second control signal to the backplane programmable logic device to control the backplane programmable logic device to detect the heartbeat signal of the extension chip; read the heartbeat signal of the extension chip, and if the heartbeat signal of the extension chip is not within a set range, confirm that the extension chip is in a hung state.
[0044] In order to solve the above technical problem, the present invention also provides a non-volatile storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above storage system fault monitoring method are implemented.
[0045] In order to solve the above technical problem, the present invention also provides a computer program product, including a computer program / instruction, which implements the steps of the above storage system fault monitoring method when executed by a processor.
[0046] It can be seen from the above technical scheme that a storage system fault monitoring method provided by the present invention is used for a controller, including: sending a first control signal to an extension chip to control the extension chip to monitor the uplink state and downlink state of the extension chip; connecting the controller to the extension chip; acquiring fault information in the uplink and downlink of the extension chip according to the uplink state and downlink state of the extension chip; sending a second control signal to a backplane programmable logic device to control the backplane programmable logic device to detect the heartbeat signal of the extension chip; both the controller and the extension chip are connected to the backplane programmable logic device; reading the heartbeat signal of the extension chip, and confirming that the extension chip is in a hung state if the heartbeat signal of the extension chip is not within a set range.
[0047] The beneficial effect of the present invention lies in that the above-mentioned storage system fault monitoring method provided by the present invention connects the controller to the expansion chip, and both the controller and the expansion chip are connected to the backplane programmable logic device, controls the expansion chip to monitor its uplink and downlink status, and controls the backplane programmable logic device to detect the heartbeat signal of the expansion chip, thereby obtaining the fault information in the uplink and downlink of the expansion chip, and confirming whether the expansion chip is in a hung state. In this way, through the fault information in the uplink and downlink of the expansion chip, and the hung state of the expansion chip, storage-related faults can be predicted in advance, which is helpful for business unloading and maintenance before the fault occurs, and the fault can be quickly located after the fault occurs. In addition, it can avoid collecting log files of various storage components, extracting fault features from log files, and matching with a preset feature database to locate the fault location, saving fault detection time, thereby ensuring the high reliability of storage devices and reducing the impact on business operations.
[0048] In addition, the present invention also provides corresponding devices, equipment, non-volatile storage media and computer program products for the storage system fault monitoring method, which have the same or corresponding technical features as the above-mentioned storage system fault monitoring method and have the same effects as above. BRIEF DESCRIPTION OF THE DRAWINGS
[0049] In order to more clearly illustrate the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0050] Figure 1 A flowchart of a storage system fault monitoring method provided by an embodiment of the present invention;
[0051] Figure 2 A schematic diagram of the connection of a baseboard management controller, an expansion chip, a backplane programmable logic device, and hardware provided in an embodiment of the present invention;
[0052] Figure 3 A schematic diagram of the relationship between the components corresponding to the storage system fault monitoring method provided by an embodiment of the present invention;
[0053] Figure 4 A schematic diagram of voltage detection of an expansion chip, an expansion card, and a hard disk by a monitoring module provided in an embodiment of the present invention;
[0054] Figure 5 A schematic diagram of the structure of a storage system fault monitoring device provided by an embodiment of the present invention;
[0055] Figure 6 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0056] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0057] In order to enable those skilled in the art to better understand the solution of the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific implementation methods. Figure 1 A flowchart of a storage system fault monitoring method provided by an embodiment of the present invention is shown in FIG. Figure 1 As shown, the method is used in a controller and includes:
[0058] S101, sending a first control signal to the extension chip to control the extension chip to monitor the uplink state and downlink state of the extension chip; the controller is connected to the extension chip.
[0059] It should be noted that the storage system can be a server or device with storage function. The expansion chip (expander) can convert and expand the upstream signal, and the downstream can support hard disks, such as hard disks with Serial Attached SCSI (SAS) or hard disks with hard disk interface specifications (Serial Advanced Technology Attachment, SATA).
[0060] When the present invention is applied to a server, the controller may be a baseboard management controller (BMC), which is a microcontroller used for server management. Of course, the controller may also be other controllers, depending on the actual application situation, which is not limited here. The following mainly describes the baseboard management controller as an example.
[0061] Figure 2 The following is a schematic diagram of the connection of the baseboard management controller, expansion chip, backplane programmable logic device, and hardware provided in the embodiment of the present invention. Figure 2 As shown, the baseboard management controller of the present invention can be directly connected to the expansion chip expander, and the baseboard management controller can send a first control signal to the expansion chip expander. After receiving the first control signal, the expansion chip expander can monitor the uplink state and downlink state of the expansion chip expander.
[0062] S102: Acquire fault information in the uplink and downlink of the extension chip according to the uplink state and downlink state of the extension chip.
[0063] In implementation, the present invention can obtain the uplink of the expansion chip expander according to the uplink status of the expansion chip expander monitored in step S101; and obtain the fault information in the downlink of the expansion chip expander according to the downlink status of the expansion chip expander monitored in step S101. After obtaining the fault information in the uplink and downlink of the expansion chip, the present invention can alarm and light up the fault at the corresponding position of the fault information, further enabling the staff to discover the corresponding fault in time and predict the risk in advance.
[0064] S103, sending a second control signal to the backplane programmable logic device to control the backplane programmable logic device to detect the heartbeat signal of the extension chip; the controller and the extension chip are both connected to the backplane programmable logic device.
[0065] It should be noted that the heartbeat signal of the expansion chip expander is a periodic signal used to monitor and feedback the working status of the expansion chip expander. The heartbeat signal can be a digital signal, such as the periodic switching of high level and low level, or a specific data frame, pulse sequence, etc. When the expansion chip expander works normally, the heartbeat signal is automatically sent at a certain time interval. Just like the human heartbeat can reflect the health of the body, the heartbeat signal of the expansion chip expander can reflect whether its own working status is normal.
[0066] In implementation, the backplane programmable logic device of the present invention can be a complex programmable logic device (CPLD) or other programmable logic devices. Figure 2 As shown, the backplane programmable logic device can be directly connected to the baseboard management controller, or directly connected to the expansion chip expander. The baseboard management controller can send a second control signal to the backplane programmable logic device, and after receiving the second control signal, the backplane programmable logic device can detect the heartbeat signal of the expansion chip expander to detect the fault information that the expansion chip cannot self-check.
[0067] S104, reading the heartbeat signal of the expansion chip. If the heartbeat signal of the expansion chip is not within the set range, it is confirmed that the expansion chip is in a dead state.
[0068] It should be noted that the controller can read the heartbeat signal of the expansion chip expander detected by the backplane programmable logic device, and can understand in real time whether the expansion chip expander is operating normally. When the expansion chip expander fails or an abnormal situation occurs, the heartbeat signal may be interrupted, become irregular, or stop sending. The above-mentioned setting range can be understood as the health status signal of the heartbeat signal, and does not include interrupted, irregular, or stopped sending signals. The heartbeat signal of the expansion chip expander can be set to 1 when it is within the set range, and can be set to 0 when it is not within the set range. When the heartbeat signal of the expansion chip expander read is 0, it is directly determined that the expansion chip expander is in a dead state, and an alarm is prompted. The backplane programmable logic device can record the dead state of the expansion chip. In this way, by monitoring the heartbeat signal, the abnormality of the expansion chip expander can be discovered in time for troubleshooting and repair.
[0069] In the above-mentioned storage system fault monitoring method provided by the embodiment of the present invention, the controller is connected to the expansion chip expander, and the controller and the expansion chip expander are both connected to the backplane programmable logic device. The expansion chip expander is controlled to monitor its uplink and downlink status, and the backplane programmable logic device is controlled to detect the heartbeat signal of the expansion chip expander, thereby obtaining the fault information in the uplink and downlink of the expansion chip expander, and confirming whether the expansion chip expander is in a hung state. In this way, through the fault information in the uplink and downlink of the expansion chip expander, and the hung state of the expansion chip expander, storage-related faults can be predicted in advance, which is helpful for business unloading and maintenance before the fault occurs. The fault can be quickly located after the fault occurs, and the operation of collecting log files of various storage components, extracting fault features from the log files, and matching with a preset feature database to locate the fault location can be avoided, saving fault detection time, thereby ensuring the high reliability of the storage device and reducing the impact on business operations.
[0070] Furthermore, in a specific implementation, the above-mentioned storage system fault monitoring method provided in an embodiment of the present invention may also include: sending a third control signal to the extension chip to control the extension chip to perceive the main body information; polling the register in the extension chip to obtain the main body information perceived by the extension chip, and extracting the main body unhealthy state of the extension chip from the main body information perceived by the extension chip.
[0071] In implementation, the expansion chip expander of the present invention can realize self-checking. The baseboard management controller can send a third control signal to the expansion chip expander. After receiving the third control signal, the expansion chip expander can sense its own information and save it to the relevant register. The baseboard management controller can poll the registers in the expansion chip expander to obtain the self information sensed by the expansion chip expander. The baseboard management controller can extract the abnormal state of the expansion chip expander from the obtained information.
[0072] In specific implementation, the above steps of controlling the extended chip to sense the main body information may specifically include: controlling the extended chip to sense the information of the clock module, the integrated circuit bus module, and the port physical layer module in the extended chip and storing them in the register.
[0073] Correspondingly, the above steps obtain the entity information perceived by the extension chip, and extract the entity unhealthy state of the extension chip from the entity information perceived by the extension chip, which can specifically include: obtaining information of the clock module, the integrated circuit bus module, and the port physical layer module in the extension chip, and parsing the information of the clock module, the integrated circuit bus module, and the port physical layer module in the extension chip to extract the entity unhealthy state of the extension chip.
[0074] In implementation, the expansion chip expander can sense the information of the clock module, the Inter-Integrated Circuit (I2C) module, and the port physical layer (PHY) module in the expansion chip expander and store them in the corresponding registers. The controller can obtain the information of the clock module, the integrated circuit bus module, and the port physical layer module in the expansion chip expander from the interactive register and parse it. When at least one module has an abnormality, the abnormality is extracted to obtain the unhealthy state of the expansion chip expander.
[0075] Furthermore, in a specific implementation, in the storage system fault monitoring method provided in the embodiment of the present invention, the expansion chip may be upstream connected to the expansion card; and the expansion card may be connected to the processor.
[0076] In implementation, the expansion card may be a host bus adapter (HBA), which is an expansion card plugged into a server and used to connect the server to a storage network. The HBA card enables the server to exchange data with an external storage device at high speed. The expansion card HBA of the present invention can convert the high-speed serial computer expansion bus standard (Peripheral Component Interconnect Express, PCIE) protocol and the SAS protocol to achieve expansion functions. The controller of the present invention does not obtain relevant information from the expansion card.
[0077] Correspondingly, step S102 acquires fault information in the uplink of the extension chip according to the uplink status of the extension chip, which may specifically include: acquiring link fault information between the extension chip and the extension card from the uplink status of the extension chip.
[0078] Figure 3 A schematic diagram of the relationship between the components corresponding to the storage system fault monitoring method provided by the embodiment of the present invention. Figure 3 As shown, the baseboard management controller of the present invention can obtain the link failure information between the expansion chip expander and the expansion card HBA from the uplink status of the expansion chip expander. It should be noted that Figure 3The thick lines in the figure represent the storage topology, and the thin lines represent the monitoring topology.
[0079] Furthermore, in the above steps, obtaining the link fault information between the extension chip and the extension card from the uplink status of the extension chip may specifically include: polling the register in the extension chip to obtain the link rate information and the link bandwidth reduction information between the extension chip and the extension card from the uplink status of the extension chip; and analyzing the link rate information and the link bandwidth reduction information between the extension chip and the extension card to obtain the link fault information between the extension chip and the extension card.
[0080] In implementation, the controller of the present invention can poll the register in the expansion chip expander, and extract the link rate information and link bandwidth reduction information between the expansion chip expander and the expansion card HBA from the uplink status of the expansion chip expander. The controller can analyze the extracted link rate information and link bandwidth reduction information between the expansion chip expander and the expansion card HBA, and obtain the link fault information between the expansion chip expander and the expansion card HBA according to the analysis result. That is, the present invention can use the interactive registers of the expansion chip expander and the controller to obtain fault information such as uplink rate abnormality, uplink bandwidth abnormality or uplink error exceeding the standard.
[0081] In specific implementation, in the above storage system fault monitoring method provided by the embodiment of the present invention, if Figure 3 As shown, the expansion chip expander can be connected to at least one hard disk downstream, thus forming a multi-level storage system.
[0082] Correspondingly, step S102 obtains fault information in the downlink of the extension chip according to the downlink status of the extension chip, which may specifically include: obtaining the unhealthy status of each hard disk downstream connected to the extension chip from the downlink status of the extension chip.
[0083] In implementation, the controller of the present invention can obtain the abnormal status of each hard disk hung under the expansion chip expander from the downlink status of the expansion chip expander, realize hard disk failure prediction, further support early risk prediction, and improve positioning accuracy.
[0084] Furthermore, in the above steps, the unhealthy status of each hard disk connected downstream to the expansion chip is obtained from the downlink status of the expansion chip, which may specifically include: polling the register in the expansion chip, and obtaining the status information of each hard disk connected downstream to the expansion chip from the downlink status of the expansion chip; parsing the status information of each hard disk to obtain the self-monitoring analysis and report status results of each hard disk; judging whether the remapped sector count in the attribute is greater than the set threshold value according to the self-monitoring analysis and report status results of each hard disk, and if so, judging that the sector is damaged.
[0085] In implementation, the controller of the present invention can poll the register in the expansion chip expander, and obtain the status information of each hard disk attached to the expansion chip expander from the downlink status of the expansion chip expander. Afterwards, the controller can parse the status information of each hard disk and obtain the self-monitoring analysis and reporting status results (Self-Monitoring Analysis and Reporting Technology, SMART) of each hard disk. According to the SMART result, it is judged whether the remapped sector count in the attribute is greater than the set threshold to judge whether the sector is damaged.
[0086] It should be noted that the remapped sector count (Reallocated Sector Count) is used to record the number of reallocated sectors. Each hard disk has a certain number of spare sectors, which are used to replace the sector when a read or write error occurs in a normal sector to maintain the stability of the hard disk and data. The present invention can enable spare sectors to replace damaged sectors (i.e., remapping) according to SMART. Before the number of remapped sectors reaches the set threshold, hard disk manufacturers recommend that data backup be done to avoid data loss due to physical damage to the hard disk. The initial value of the remapped sector count is 0, and it will gradually increase and will not decrease. If a brand new hard disk continuously increases the number of remapped sectors in a short period of time, it means that the quality of this hard disk is low and there are hidden dangers in stability.
[0087] In addition, the present invention can also utilize the interactive registers between the expansion chip expander and the controller to obtain fault information such as abnormal downlink rate, downlink disconnection, and abnormal health status of the attached hard disk. It can be understood that the expansion chip expander of the present invention can monitor the status of the link between the expansion card HBA and the expansion chip expander, the downlink status, the self-test status, and the status of the attached hard disk through in-band link analysis. The faults that can be monitored by the present invention include link speed reduction, link bandwidth reduction, link disconnection, self-test abnormality, unhealthy hard disk status, etc. The expansion chip expander continuously monitors the link status and self-test status, and records them in the interactive register with the controller.
[0088] Table 1 Detection of the expansion chip uplink, downlink and attached hard disk
[0089]
[0090] As can be seen from Table 1, the expansion chip expander and the baseboard management controller of the present invention are designed with interactive registers. The baseboard management controller can poll the expansion chip expander related registers to confirm whether a storage fault occurs, 1=no problem, 0=abnormal. After polling an abnormality, the baseboard management controller needs to record an alarm and can also turn on a fault light as needed.
[0091] Furthermore, in a specific implementation, in the above-mentioned storage system fault monitoring method provided in an embodiment of the present invention, step S104 reads the heartbeat signal of the expansion chip, which may specifically include: polling the registers of the backplane programmable logic device, analyzing the register information corresponding to the backplane programmable logic device; and obtaining the heartbeat signal of the expansion chip based on the analysis results.
[0092] In implementation, the expander heartbeat signal of the expansion chip of the present invention is connected to the backplane programmable logic device. After the backplane programmable logic device is powered on, the controller can poll the register of the backplane programmable logic device, and then analyze the register information corresponding to the backplane programmable logic device, and obtain the expander heartbeat signal of the expansion chip according to the analysis result. If the backplane programmable logic device detects that the expander heartbeat signal of the expansion chip is abnormal, the interactive register of the backplane programmable logic device and the baseboard management control can be set.
[0093] Table 2 Detection of extended chip
[0094]
[0095] As can be seen from Table 2, the backplane programmable logic device and the baseboard management controller are designed with interactive registers. The baseboard management controller can poll the relevant registers of the backplane programmable logic device to obtain the status of the expansion chip expander. The expansion chip expander will send a heartbeat when it works normally. When the backplane programmable logic device normally obtains the heartbeat, it is recorded as 1. When the backplane programmable logic device cannot detect the heartbeat signal of the expansion chip expander or the detected heartbeat signal is abnormal, it is recorded as 0. When the baseboard management controller reads the record of 0, it means that after polling the abnormality, the baseboard management controller needs to record an alarm, and can also turn on the fault light as needed.
[0096] Furthermore, in a specific implementation, the above storage system fault monitoring method provided in the embodiment of the present invention may also include: monitoring a signal (power good) in the expansion card for detecting the stability of the power supply output voltage, so as to detect the power supply status of the expansion card in real time; monitoring at least one signal in the expansion chip for detecting the stability of the power supply output voltage, so as to detect the power supply status of the expansion chip in real time.
[0097] Figure 4 The monitoring module provided in the embodiment of the present invention detects the voltage of the expansion chip, expansion card and hard disk. Figure 4 As shown, the present invention can use a monitoring module to monitor the power good signal 01 of the front-end electronic fuse (efuse) of the expansion card HBA to detect the power supply of the expansion card HBA card in real time. The present invention can also use a monitoring module to monitor the power good signal 02 of the expansion chip expander power supply. The power good signal 02 can be monitored separately for each voltage, or it can be the power good signal of the last level pushed step by step by the power supply to monitor the power supply status of the expansion chip expander.
[0098] Furthermore, in a specific implementation, the above-mentioned storage system fault monitoring method provided in the embodiment of the present invention may also include: monitoring the signal in each hard disk for detecting the stability of the power supply output voltage, so as to detect the power supply status of each hard disk in real time; and monitoring whether the link between each hard disk and the expansion chip is disconnected, so as to locate the hard disk corresponding to the disconnected link.
[0099] In implementation, the present invention can also use a monitoring module to monitor the power good signal of each hard disk front end efuse to monitor whether each hard disk power supply is abnormal or the hard disk body is short-circuited. Figure 4 As shown, the power good signal 03 of the efuse at the front end of hard disk 1 is monitored to monitor whether the power supply of hard disk 1 is abnormal or the hard disk 1 body is short-circuited; the power good signal 04 of the efuse at the front end of hard disk 2 is monitored to monitor whether the power supply of hard disk 2 is abnormal or the hard disk 2 body is short-circuited; similarly, the power good signal 05 of the efuse at the front end of hard disk n is monitored to monitor whether the power supply of hard disk n is abnormal or the hard disk n body is short-circuited.
[0100] In addition, the present invention can also use a voltage detection module to monitor the hard disk input voltage, further improving the fault location of hard disk drop and other phenomena. The voltage detection module can include an analog to digital converter (ADC) or a voltage comparator.
[0101] Furthermore, in a specific implementation, in the above-mentioned storage system fault monitoring method provided in an embodiment of the present invention, the expansion chip can be connected to the backplane programmable logic device through a general-purpose input / output (GPIO) port; wherein the general-purpose input / output port is a pin with a heartbeat function in the expansion chip.
[0102] Furthermore, in a specific implementation, in the above storage system fault monitoring method provided by an embodiment of the present invention, the expansion chip is connected to the controller via an integrated circuit bus; or, the expansion chip is connected to the controller via a universal asynchronous receiver / transmitter.
[0103] In implementation, the controller can read the register corresponding to the expansion chip expander through the I2C link. The controller can also be connected to the backplane programmable logic device through I2C. Similarly, the controller can read the register corresponding to the backplane programmable logic device through the I2C link, and then obtain whether the corresponding expansion chip expander is abnormal.
[0104] In the above embodiments, the storage system fault monitoring method is described in detail, and the present invention also provides a storage system fault monitoring device and a storage system fault monitoring device corresponding to the embodiments. It should be noted that the present invention describes the embodiments of the device part from two perspectives, one is based on the functional module perspective, and the other is based on the hardware perspective.
[0105] Figure 5 This is a structural diagram of a storage system fault monitoring device provided by an embodiment of the present invention. This embodiment is based on the perspective of functional modules. The device is used in a controller and includes:
[0106] The first control module 10 is used to send a first control signal to the extension chip to control the extension chip to monitor the uplink state and downlink state of the extension chip; the controller is connected to the extension chip;
[0107] A fault information acquisition module 11 is used to acquire fault information in the uplink and downlink of the extension chip according to the uplink state and downlink state of the extension chip;
[0108] A second control module 12 is used to send a second control signal to the backplane programmable logic device to control the backplane programmable logic device to detect the heartbeat signal of the extension chip; the controller and the extension chip are both connected to the backplane programmable logic device;
[0109] The heartbeat signal reading module 13 is used to read the heartbeat signal of the extension chip. If the heartbeat signal of the extension chip is not within a set range, it is confirmed that the extension chip is in a dead state.
[0110] In the above-mentioned storage system fault monitoring device provided in the embodiment of the present invention, the interaction of the above-mentioned four modules can be used to control the expansion chip to monitor its uplink and downlink status, and control the backplane programmable logic device to detect the heartbeat signal of the expansion chip, thereby obtaining the fault information in the uplink and downlink of the expansion chip, and confirming whether the expansion chip is in a hung state. In this way, through the fault information in the uplink and downlink of the expansion chip, and the hung state of the expansion chip, storage-related faults can be predicted in advance, which is helpful for business unloading and maintenance before the fault occurs. After the fault occurs, the fault can be quickly located, the operation and maintenance location time can be shortened, the high reliability of the storage device can be guaranteed, and the impact on business operations can be reduced.
[0111] Since the embodiments of the device part correspond to the embodiments of the method part, the embodiments of the device part refer to the description of the embodiments of the method part, which will not be described here. And it has the same beneficial effects as the storage system fault monitoring method mentioned above.
[0112] Furthermore, in a specific implementation, the storage system fault monitoring device provided in the embodiment of the present invention further includes:
[0113] The third control module is used to send a third control signal to the extension chip to control the extension chip to perceive the main body information; poll the register in the extension chip to obtain the main body information perceived by the extension chip, and extract the main body unhealthy state of the extension chip from the main body information perceived by the extension chip.
[0114] During implementation, the third control module can send a third control signal to the extension chip to control the extension chip to sense the information of the clock module, the integrated circuit bus module, and the port physical layer module in the extension chip and store it in the register; poll the register in the extension chip to obtain the information of the clock module, the integrated circuit bus module, and the port physical layer module in the extension chip, and parse the information of the clock module, the integrated circuit bus module, and the port physical layer module in the extension chip to extract the unhealthy state of the extension chip.
[0115] Furthermore, in the specific implementation, in the storage system fault monitoring device provided in the embodiment of the present invention, the expansion chip can be connected to the expansion card in an uplink manner; the expansion card can be connected to the processor. Correspondingly, the fault information acquisition module 11 can be specifically used to obtain the link fault information between the expansion chip and the expansion card from the uplink status of the expansion chip.
[0116] In implementation, the fault information acquisition module 11 can poll the registers in the extension chip, obtain the link rate information and link bandwidth reduction information between the extension chip and the extension card from the uplink status of the extension chip; analyze the link rate information and link bandwidth reduction information between the extension chip and the extension card, and obtain the link fault information between the extension chip and the extension card.
[0117] Furthermore, in the specific implementation, in the storage system fault monitoring device provided by the embodiment of the present invention, the expansion chip is connected to at least one hard disk downstream. Correspondingly, the fault information acquisition module 11 can be specifically used to obtain the unhealthy status of each hard disk connected to the expansion chip downstream from the downlink status of the expansion chip.
[0118] In implementation, the fault information acquisition module 11 can poll the registers in the expansion chip, obtain the status information of each hard disk connected to the expansion chip from the downlink status of the expansion chip; parse the status information of each hard disk to obtain the self-monitoring analysis and report status results of each hard disk; based on the self-monitoring analysis and report status results of each hard disk, determine whether the remapped sector count in the attribute is greater than the set threshold, and if so, determine that the sector is damaged.
[0119] Furthermore, in a specific implementation, in the above-mentioned storage system fault monitoring device provided in an embodiment of the present invention, the heartbeat signal reading module 13 can be specifically used to poll the registers of the backplane programmable logic device and analyze the register information corresponding to the backplane programmable logic device; based on the analysis results, the heartbeat signal of the expansion chip is obtained.
[0120] Furthermore, in a specific implementation, the storage system fault monitoring device provided in the embodiment of the present invention may further include:
[0121] The monitoring module can be used to monitor the signal of the front-end electronic fuse of the expansion card for detecting the stability of the power supply output voltage, so as to detect the power supply status of the expansion card in real time; monitor at least one signal in the expansion chip for detecting the stability of the power supply output voltage, so as to detect the power supply status of the expansion chip in real time.
[0122] The monitoring module can also be used to monitor the signal of the electronic fuse at the front end of each hard disk to detect the stability of the power supply output voltage, so as to detect the power supply status of each hard disk in real time; at the same time, it can monitor whether the link between each hard disk and the expansion chip is disconnected, so as to locate the hard disk corresponding to the disconnected link.
[0123] In this embodiment, from a hardware perspective, the storage system fault monitoring device includes: a controller, an expansion chip connected to the controller, and a backplane programmable logic device connected to the controller and the expansion chip respectively;
[0124] The controller is used to send a first control signal to the extension chip to control the extension chip to monitor the uplink state and downlink state of the extension chip; obtain fault information in the uplink and downlink of the extension chip according to the uplink state and downlink state of the extension chip; send a second control signal to the backplane programmable logic device to control the backplane programmable logic device to detect the heartbeat signal of the extension chip; read the heartbeat signal of the extension chip, and if the heartbeat signal of the extension chip is not within a set range, confirm that the extension chip is in a hung state.
[0125] Based on the same inventive concept, an embodiment of the present invention further provides an electronic device. Figure 6 The structure diagram of the electronic device provided by the embodiment of the present invention. Figure 6 As shown, the electronic device includes:
[0126] A memory 20, used for storing computer programs;
[0127] The processor 21 is used to implement the steps of the storage system fault monitoring method mentioned in the above embodiment when executing the computer program.
[0128] Among them, the processor 21 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 21 can be implemented in at least one hardware form of a digital signal processor (DSP), a field-programmable gate array (FPGA), and a programmable logic array (PLA). The processor 21 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU; the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 21 may be integrated with a graphics processing unit (GPU), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 21 may also include an artificial intelligence (AI) processor, which is used to process computing operations related to machine learning.
[0129] The memory 20 may include one or more non-volatile storage media, which may be non-transitory. The memory 20 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In this embodiment, the memory 20 is at least used to store the following computer program 201, wherein, after the computer program is loaded and executed by the processor 21, it can implement the relevant steps of the storage system fault monitoring method disclosed in any of the aforementioned embodiments. In addition, the resources stored in the memory 20 may also include an operating system 202 and data 203, etc., and the storage method may be temporary storage or permanent storage. Among them, the operating system 202 may include Windows, Unix, Linux, etc. The data 203 may include, but is not limited to, the data involved in the storage system fault monitoring method mentioned above, etc.
[0130] In some embodiments, the electronic device may further include a display screen 22, an input / output interface 23, a communication interface 24, a power supply 25, and a communication bus 26. Those skilled in the art will appreciate that Figure 6 The structure shown in the figure does not constitute a limitation on the electronic device, and may include more or fewer components than shown in the figure. The electronic device provided by the embodiment of the present invention includes a memory and a processor, and when the processor executes the program stored in the memory, it can implement the following method: a storage system fault monitoring method, the effect is the same as above.
[0131] In addition, the present invention also provides an embodiment corresponding to a non-volatile storage medium. The non-volatile storage medium stores a computer program, and when the computer program is executed by a processor, the steps recorded in the above method embodiment are implemented.
[0132] It is understandable that if the method in the above embodiment is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and executes all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code. The non-volatile storage medium provided by the present invention can implement the above-mentioned storage system fault monitoring method, and the effect is the same as above.
[0133] Finally, the present invention also provides an embodiment corresponding to a computer program product. The computer program product includes a computer program / instruction, and when the computer program / instruction is executed by a processor, the steps described in the above storage system fault monitoring method embodiment are implemented. The computer program product provided by the present invention can implement the above-mentioned storage system fault monitoring method, and the effect is the same as above.
[0134] It should also be noted that, in this specification, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element.
[0135] The storage system fault monitoring method, device, medium and computer program product provided by the present invention are introduced in detail above. The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same and similar parts between the various embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part description. It should be pointed out that for ordinary technicians in this technical field, without departing from the principle of the present invention, several improvements and modifications can be made to the present invention, and these improvements and modifications also fall within the scope of protection of the present invention.
Claims
1. A storage system fault monitoring method, characterized in that: The method is used in a controller, comprising: A first control signal is sent to the extension chip to control the extension chip to monitor the uplink state and downlink state of the extension chip; the controller is connected to the extension chip; the extension chip is connected to the extension card uplink; the extension card is connected to the processor; the extension chip is connected to at least one hard disk downlink; Acquire link failure information between the extension chip and the extension card from the uplink status of the extension chip; Acquire the unhealthy status of each hard disk connected to the extension chip downstream from the downlink status of the extension chip; Sending a second control signal to a backplane programmable logic device to control the backplane programmable logic device to detect the heartbeat signal of the extension chip; the controller and the extension chip are both connected to the backplane programmable logic device; The heartbeat signal of the extension chip is read. If the heartbeat signal of the extension chip is not within a set range, it is confirmed that the extension chip is in a hung state.
2. The storage system fault monitoring method according to claim 1, characterized in that: Also includes: Sending a third control signal to the extension chip to control the extension chip to sense the main body information; The register in the extension chip is polled to obtain the entity information perceived by the extension chip, and the entity unhealthy state of the extension chip is extracted from the entity information perceived by the extension chip.
3. The storage system fault monitoring method according to claim 1, characterized in that: Acquiring link failure information between the extension chip and the extension card from the uplink state of the extension chip, including: Polling the register in the extension chip to obtain the link rate information and link bandwidth reduction information between the extension chip and the extension card from the uplink status of the extension chip; The link rate information and the link bandwidth reduction information between the extension chip and the extension card are analyzed to obtain the link fault information between the extension chip and the extension card.
4. The storage system fault monitoring method according to claim 1, characterized in that: Acquiring the unhealthy status of each hard disk connected to the extension chip downstream from the downlink status of the extension chip includes: Polling the register in the expansion chip, and obtaining the status information of each hard disk connected to the expansion chip in the downlink state of the expansion chip; Parsing the status information of each hard disk to obtain the self-monitoring analysis and report status results of each hard disk; According to the self-monitoring analysis and reported status results of each hard disk, it is determined whether the remapped sector count in the attribute is greater than a set threshold. If so, it is determined that the sector is damaged.
5. The storage system fault monitoring method according to claim 2, characterized in that: Controlling the extended chip to sense the main body information includes: Control the extension chip to sense the information of the clock module, the integrated circuit bus module, and the port physical layer module in the extension chip and store the information in the register; Correspondingly, obtaining the entity information perceived by the extension chip, and extracting the entity unhealthy state of the extension chip from the entity information perceived by the extension chip, includes: The information of the clock module, the integrated circuit bus module, and the port physical layer module in the extension chip is obtained, and the information of the clock module, the integrated circuit bus module, and the port physical layer module in the extension chip is parsed to extract the unhealthy state of the extension chip.
6. The storage system fault monitoring method according to claim 1, characterized in that: Reading the heartbeat signal of the expansion chip includes: Polling the register of the backplane programmable logic device and analyzing the register information corresponding to the backplane programmable logic device; According to the analysis result, the heartbeat signal of the extension chip is obtained.
7. The storage system fault monitoring method according to claim 1, characterized in that: Also includes: Monitoring a signal in the expansion card for detecting the stability of the power supply output voltage, so as to detect the power supply status of the expansion card in real time; At least one signal in the expansion chip for detecting the stability of the power supply output voltage is monitored to detect the power supply status of the expansion chip in real time.
8. The storage system fault monitoring method according to claim 1, characterized in that: Also includes: Monitoring the signal used to detect the stability of the power supply output voltage in each hard disk to detect the power supply status of each hard disk in real time; At the same time, it monitors whether the link between each hard disk and the expansion chip is disconnected, so as to locate the hard disk corresponding to the disconnected link.
9. The storage system fault monitoring method according to claim 1, characterized in that: The expansion chip is connected to the backplane programmable logic device via a general purpose input and output port; The general input and output port is a pin with a heartbeat function in the expansion chip.
10. The storage system fault monitoring method according to claim 1, characterized in that: The expansion chip is connected to the controller via an integrated circuit bus; or, The expansion chip is connected to the controller via a universal asynchronous receiver / transmitter.
11. A storage system fault monitoring device, characterized in that: The device comprises: a controller, an expansion chip connected to the controller, and a backplane programmable logic device connected to the controller and the expansion chip respectively; the expansion chip is connected to an expansion card uplink; the expansion card is connected to a processor; the expansion chip is connected to at least one hard disk downlink; The controller is used to send a first control signal to the extension chip to control the extension chip to monitor the uplink state and downlink state of the extension chip; obtain link fault information between the extension chip and the extension card from the uplink state of the extension chip; obtain the unhealthy state of each hard disk connected to the extension chip from the downlink state of the extension chip; send a second control signal to the backplane programmable logic device to control the backplane programmable logic device to detect the heartbeat signal of the extension chip; read the heartbeat signal of the extension chip, and if the heartbeat signal of the extension chip is not within a set range, confirm that the extension chip is in a hung state.
12. A non-volatile storage medium, characterized in that: The non-volatile storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the storage system fault monitoring method according to any one of claims 1 to 10 are implemented.
13. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instructions are executed by a processor, the steps of the storage system fault monitoring method according to any one of claims 1 to 10 are implemented.
Citation Information
Patent Citations
Expansion chip management method and device, storage medium and electronic equipment
CN116150068A
Fault state management and control method, device, equipment and medium
CN117112273A