Container persistent volume health monitoring system, method, computer device and medium

Abstract

The present invention discloses a container persistent volume health monitoring system, method, computer equipment and medium. In the container persistent volume health monitoring system, the container storage management module is configured to connect the container orchestration system and the storage system to feed back abnormal conditions of the persistent volume in the storage system to the container orchestration system; the storage monitoring module is configured to connect the container orchestration system and the storage system to monitor the performance indicators and abnormal conditions of the persistent volume, issue an alarm for abnormal conditions and restore the relevant functions of the container; the data collection and conversion module is configured to connect to the storage monitoring module to receive, process and convert the indicator information collected by the storage system; the cluster monitoring system is configured to connect to the data collection and conversion module to display the data exported by the data collection and conversion module. The system can monitor the abnormalities and performance indicators of the volume, call the relevant functions of the storage system to restore the container, and export in a standard data format, and display it intuitively through a data visualization tool.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a container persistent volume health monitoring system, method, computer equipment, and medium. Background Art

[0002] After the container management system creates a persistent volume through the container storage interface, it cannot effectively monitor the volume's health status. If certain problems arise with the volume on the storage side, such as inaccessibility or inability to read or write, it is difficult to debug and detect the root cause on the container management system side. Although CSI has added interface fields to check for volume anomalies, the detection information and scenarios are relatively simple, and events are only reported when the volume is abnormal. For distributed storage, when hard drives, networks, services, etc. enter a sub-healthy state, although the volume can be used, the read and write latency increases and the IOPS decreases. These storage anomalies cannot be effectively monitored. Summary of the Invention

[0003] In view of this, the purpose of an embodiment of the present invention is to propose a container persistent volume health monitoring system, which can monitor volume anomalies and performance indicators, call storage system related functions to restore containers, export them in a standard data format, and display them intuitively through data visualization tools.

[0004] Based on the above-mentioned purpose, one aspect of an embodiment of the present invention provides a container persistent volume health monitoring system. The system includes a container storage management module, a storage monitoring module, a data collection and conversion module, and a cluster monitoring system. Among them, the container storage management module is configured to connect the container orchestration system and the storage system to feed back abnormal conditions of the persistent volumes in the storage system to the container orchestration system; the storage monitoring module is configured to connect the container orchestration system and the storage system to monitor the performance indicators and abnormal conditions of the persistent volumes, issue alarms for abnormal conditions, and restore container-related functions; the data collection and conversion module is configured to connect the storage monitoring module to receive, process, and convert the indicator information collected by the storage system; the cluster monitoring system is configured to connect the data collection and conversion module to display the data exported by the data collection and conversion module.

[0005] In some embodiments, the container storage management module includes a container storage management Controller service module, a container storage management Node service module and a container storage management storage service module, wherein the container storage management Controller service module is configured to parse the volume parameters of the unmounted persistent volume to obtain storage and volume information, and report the exception to the container orchestration system; the container storage management Node service module is configured to parse the volume parameters and mount path parameters of the mounted persistent volume, detect the mount path IO, file system and mount point, and report the exception to the container orchestration system; the container storage management storage service module is configured to query the volume information of the storage system and feedback to the container storage management Controller service module in the event of an exception; the container storage management storage service module is also configured to query the volume information and mount information of the storage system and feedback to the container storage management Node service module in the event of an exception.

[0006] Another aspect of the embodiment of the present invention provides a method for monitoring the health of container persistent volumes. The method includes monitoring the health status of mounted persistent volumes through communication between the container storage management Controller service module, the container storage management storage service module, the container orchestration system, and the storage system; monitoring the health status of unmounted persistent volumes through communication between the container storage management Node service module, the container storage management storage service module, the container orchestration system, and the storage system; detecting volume performance indicators and abnormal conditions, issuing alarms for abnormalities, and recovering abnormalities to ensure the availability of volumes and containers through communication between the storage monitoring module, the container orchestration system, and the storage system; receiving volume performance indicator information obtained by the storage monitoring module and the container storage management module through the data collection and conversion module, processing and converting the data; registering and pulling data exported by the data collection and conversion module through the cluster monitoring system, and visually displaying it through data visualization tools.

[0007] In some embodiments, the health status monitoring of the mounted persistent volume through communication between the container storage management Controller service module, the container storage management storage service module, the container orchestration system and the storage system includes: the container orchestration system queries the container storage management Controller service module for volume information of the persistent volume; the container storage management Controller service module parses volume parameters to obtain storage and volume information, and calls the container storage management storage service module to query storage end information; the container storage management storage service module queries the storage system for volume information, wherein, for block storage, the volume information is queried, and for file storage, the NFS share or CIFS share information is queried; if the volume or file share is abnormal or does not exist in the storage system, the container storage management storage service module returns volume abnormality information to the container storage management Controller service module; the container storage management Controller service module reports the persistent volume abnormality to the container orchestration system.

[0008] In some embodiments, the health status of unmounted persistent volumes is monitored through communication between the container storage management Node service module, the container storage management storage service module, the container orchestration system, and the storage system, including: the container orchestration system queries the container storage management Node service module for volume status; the container storage management Node service module parses volume parameters and mount path parameters, detects mount path IO, file system detection, and mount point, and calls the container storage management storage service module to query storage end information; the container storage management storage service module calls the storage system interface to query storage volume and mount information, wherein, for block storage, the storage system volume mapping, host-side device and multi-path anomalies are detected; for file storage, the NFS or CIFS path and network information are detected; if there is an abnormality, the container storage management storage service module returns volume anomaly information to the container storage management Node service module; the container storage management Node service module reports the persistent volume anomaly to the container orchestration system.

[0009] In some embodiments, the detection of volume performance indicators through communication between the storage monitoring module, the container orchestration system, and the storage system includes: the storage monitoring module queries the container orchestration system to collect information about storage resources; the storage monitoring module queries the storage system to collect indicator information, wherein the indicator information includes performance indicators such as the read and write IOPS of the PVC, the average latency of the read and write requests of the PVC, the throughput of the PVC, and the used capacity, total capacity, and available capacity of the PVC; and the storage monitoring module exports the collected indicator information to a collector of the data collection and conversion module.

[0010] In some embodiments, abnormal situations are detected and alarms are issued through communication between the storage monitoring module, the container orchestration system and the storage system, including: the storage monitoring module periodically obtains the read and write IOPS of the persistent volume, the average latency of the read and write requests of the persistent volume, and the throughput of the persistent volume from the storage system, performs a comprehensive diagnosis on the obtained indicator information, and adopts a multi-level threshold method to determine whether the hard disk is in a sub-healthy state. If the indicator is abnormal for a long time, the storage system is queried to see whether the data on the hard disk still has complete redundant data on other hard disks, so as to perform disk switching and isolate the problem hard disk in some cases; the storage monitoring module detects and counts the I / O latency and other information of the storage node service module. If a node service module has a continuous abnormality, a sub-health alarm is generated, and the storage node corresponding to the storage service module is isolated and the business of the service module is distributed to other service modules in the storage cluster.

[0011] In some embodiments, abnormalities are recovered through communication between the storage monitoring module, the container orchestration system, and the storage system to ensure the availability of volumes and containers. This includes: when a container fails to restart due to a data volume abnormality, it will automatically attempt to successfully start the container on other nodes first to quickly restore business, and then perform related recovery work based on the disaster recovery backup function.

[0012] On the other hand, an embodiment of the present invention further provides a computer device, comprising: at least one processor; and a memory, the memory storing computer instructions that can be run on the processor, and the steps of implementing the method when the instructions are executed by the processor include: monitoring the health status of mounted persistent volumes through communication between the container storage management Controller service module, the container storage management storage service module, the container orchestration system and the storage system; monitoring the health status of unmounted persistent volumes through communication between the container storage management Node service module, the container storage management storage service module, the container orchestration system and the storage system; detecting volume performance indicators and abnormal conditions, issuing alarms for abnormalities, and recovering from abnormalities to ensure the availability of volumes and containers through communication between the storage monitoring module, the container orchestration system and the storage system; receiving volume performance indicator information obtained by the storage monitoring module and the container storage management module through the data collection and conversion module, and processing and converting the data; registering and pulling data exported by the data collection and conversion module through the cluster monitoring system, and intuitively displaying it through a data visualization tool.

[0013] According to another aspect of the embodiments of the present invention, a computer-readable storage medium is provided, which stores a computer program that implements the above method steps when executed by a processor.

[0014] The present invention has at least the following beneficial technical effects:

[0015] The container persistent volume health monitoring system of the present invention adopts a container persistent volume health monitoring method. By adding a container storage management module, a storage monitoring module, a data collection and conversion module, and a cluster monitoring system, the following functions can be achieved:

[0016] 1. It can monitor volume usage and detect various scenarios of volume anomalies (volume deletion, file system damage, volume mapping deletion, multi-path inaccessibility, etc.).

[0017] 2. It can monitor the performance indicators of volumes and the sub-health status of storage systems.

[0018] 3. The acquired data can be exported in a standard data format for the cluster monitoring system to pull and be intuitively displayed through data visualization tools.

[0019] 4. When the health status of the storage device system is diagnosed as abnormal based on performance indicators, the system can try to call the storage system related functions to automatically recover from abnormal scenarios such as hard disk isolation, storage node business transfer, and container recovery. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other embodiments can be obtained based on these drawings without paying any creative work.

[0021] Figure 1 A schematic diagram of an embodiment of a persistent volume health monitoring system provided by the present invention;

[0022] Figure 2 A schematic diagram of another embodiment of a persistent volume health monitoring system provided by the present invention;

[0023] Figure 3 A schematic diagram of an embodiment of a persistent volume health monitoring method provided by the present invention;

[0024] Figure 4 A schematic diagram of an embodiment of a computer device provided by the present invention;

[0025] Figure 5 A schematic diagram of an embodiment of a computer-readable storage medium provided by the present invention. DETAILED DESCRIPTION

[0026] In order to make the objectives, technical solutions and advantages of the present invention more clearly understood, the embodiments of the present invention are further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0027] It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are for distinguishing two non-identical entities with the same name or non-identical parameters. It can be seen that "first" and "second" are only for the convenience of expression and should not be understood as limitations on the embodiments of the present invention. Subsequent embodiments will not explain this one by one.

[0028] Container technology is a virtualization technology that improves resource utilization. It effectively partitions the resources of a single operating system into isolated groups, allowing for better balancing of conflicting resource demands between these groups. Compared to virtual machines, containers are more lightweight, easier to port and deploy, and more elastic and scalable. With the development of cloud computing and the maturity of container orchestration and management systems, an increasing number of applications are being deployed in containers.

[0029] Data in a container can be stored on media similar to virtual machine disks. Containers can use external storage devices through persistent volumes. A container's persistent volumes can be used to store application data within the container or to share data between containers. Using persistent volumes improves disk I / O performance and addresses the issue of low data storage efficiency within the container itself. Persistent volumes are presented to containers as directories, which leverage the container's UNIX file system to provide stability features or data sharing. Using a container's persistent volume is similar to mounting a file system on the system, enabling data sharing between multiple containers.

[0030] Storage systems are primarily categorized as centralized storage and distributed storage. Centralized storage primarily includes block-based SAN (Storage Area Network) networked storage systems and file-based Network Attached Storage (NAS). SAN systems support Fibre Channel (FC) and IP-based iSCSI protocols, while file-based NAS supports NFS (Network File System), CIFS (Common Network File System), and FTP (File Transfer Protocol).

[0031] With the rapid expansion of computer systems, the demand for storage is growing. Centralized storage servers have become a bottleneck in data center systems, a key concern for reliability and security. They are unable to meet the needs of large-scale storage applications, leading to the development of distributed storage. Distributed storage systems store data across multiple independent devices, employing a scalable system architecture, using multiple storage servers to share the storage load, and utilizing location servers to locate stored information. This not only improves system reliability, availability, and access efficiency, but also facilitates scalability.

[0032] The Container Storage Interface (CSI), an industry-standard interface specification, enables storage vendors to develop plug-ins that conform to the CSI standard. CSI decouples container orchestration systems from storage systems, allowing for upstream integration with container orchestration systems and downstream integration with various storage systems. Container orchestration systems can expose any storage system to their container workloads, providing persistent volume storage capabilities.

[0033] Based on the above objectives, a first aspect of an embodiment of the present invention provides an embodiment of a container persistent volume health monitoring system. Figure 1 Shown is a schematic diagram of an embodiment of a container persistent volume health monitoring system provided by the present invention. Figure 2 FIG2 shows a schematic diagram of another embodiment of a container persistent volume health monitoring system provided by the present invention. Figures 1 to 2 As shown, the container persistent volume health monitoring system of an embodiment of the present invention includes a container storage management module, a storage monitoring module, a data collection and conversion module and a cluster monitoring system, wherein the container storage management module is configured to connect the container orchestration system and the storage system to feed back abnormal conditions of the persistent volume in the storage system to the container orchestration system; the storage monitoring module is configured to connect the container orchestration system and the storage system to monitor the performance indicators and abnormal conditions of the persistent volume, issue alarms for abnormal conditions and restore container-related functions; the data collection and conversion module is configured to connect the storage monitoring module to receive, process and convert the indicator information collected by the storage system; the cluster monitoring system is configured to connect the data collection and conversion module to display the data exported by the data collection and conversion module.

[0034] In this embodiment, the container persistent volume health monitoring system is primarily divided into three parts: a container storage management module, a storage monitoring module, and a data collection and conversion module. The container storage management module implements volume anomaly monitoring and includes three submodules: the controller service module, the node service module, and the storage service module. The storage monitoring module monitors volume performance indicators, monitors and controls storage system anomalies, and handles storage anomaly cluster container processing. The data collection and conversion module is responsible for collecting, converting, and exporting indicator data, and then pulling and displaying it in the cluster monitoring system.

[0035] In some embodiments of the present invention, the container storage management module includes a container storage management Controller service module, a container storage management Node service module and a container storage management storage service module, wherein the container storage management Controller service module is configured to parse the volume parameters of an unmounted persistent volume to obtain storage and volume information, and report an exception to the container orchestration system; the container storage management Node service module is configured to parse the volume parameters and mount path parameters of the mounted persistent volume, detect the mount path IO, file system and mount point, and report an exception to the container orchestration system; the container storage management storage service module is configured to query the volume information of the storage system and feedback to the container storage management Controller service module in the event of an exception; the container storage management storage service module is also configured to query the volume information and mount information of the storage system and feedback to the container storage management Node service module in the event of an exception.

[0036] In this embodiment, the container storage management controller service module itself parses volume parameters to obtain storage and volume information, and calls the container storage management storage service module to query storage end information. The container storage management node service module parses volume parameters and mount path parameters, performs mount path I / O, file system detection, and mount point detection, and then calls the container storage management storage service module to query storage end information. The container storage management storage service module provides services to both the container storage management controller service module and the container storage management node service module.

[0037] A second aspect of an embodiment of the present invention provides a container persistent volume health monitoring method based on the above-mentioned container persistent volume health monitoring system. Figure 3 FIG. 1 is a schematic diagram of an embodiment of a method for monitoring the health of a container persistent volume provided by the present invention. Figure 3 As shown, the method includes the following steps:

[0038] 001. Monitor the health status of mounted persistent volumes through communication between the container storage management controller service module, the container storage management storage service module, the container orchestration system, and the storage system;

[0039] 002. Monitor the health status of unmounted persistent volumes through communication between the container storage management Node service module, the container storage management storage service module, the container orchestration system, and the storage system;

[0040] 003. Through communication between the storage monitoring module, the container orchestration system, and the storage system, volume performance indicators and anomalies are detected, anomalies are alerted, and anomaly recovery is performed to ensure the availability of volumes and containers.

[0041] 004. Receive the volume performance indicator information obtained by the storage monitoring module and the container storage management module through the data collection and conversion module, and process and convert the data;

[0042] 005. Register and pull the data exported by the data collection and conversion module through the cluster monitoring system, and display it intuitively through data visualization tools.

[0043] In this embodiment, Figure 1 and Figure 2 This diagram illustrates the communication relationships between the various modules of the container persistent volume health monitoring system. Based on this, the container storage management module monitors the health of both mounted and unmounted persistent volumes in the cluster. The storage monitoring module monitors volume performance metrics, detects storage anomalies, and performs container recovery. The data collection and conversion module is responsible for metric data collection, data conversion, and data export. The cluster monitoring system registers and pulls data exported by the data collection and conversion module, and displays it intuitively using data visualization tools.

[0044] In some embodiments of the present invention, health status monitoring of mounted persistent volumes is performed through communication between a container storage management Controller service module, a container storage management storage service module, a container orchestration system, and a storage system, including: the container orchestration system queries the container storage management Controller service module for volume information of the persistent volume; the container storage management Controller service module parses volume parameters to obtain storage and volume information, and calls the container storage management storage service module to query storage end information; the container storage management storage service module queries the storage system for volume information, wherein for block storage, volume information is queried, and for file storage, NFS sharing or CIFS sharing information is queried; if the volume or file sharing is abnormal or does not exist in the storage system, the container storage management storage service module returns volume abnormality information to the container storage management Controller service module; and the container storage management Controller service module reports the persistent volume abnormality to the container orchestration system.

[0045] In this embodiment, for unmounted persistent volumes, after creation, the container orchestration system queries the container storage management controller service module in real time for volume status, specifically, volume information. The container storage management controller service module has parsing capabilities, capable of parsing various persistent volume parameters to obtain relevant information. The container storage management storage service module establishes a connection with the storage system and retrieves volume information from it. If a storage anomaly occurs on the storage system, the container storage management controller service module reports the anomaly to the container orchestration system.

[0046] In some embodiments of the present invention, the health status of unmounted persistent volumes is monitored through communication between a container storage management Node service module, a container storage management storage service module, a container orchestration system, and a storage system, including: the container orchestration system queries the container storage management Node service module for volume status; the container storage management Node service module parses volume parameters and mount path parameters, detects mount path IO, file system detection, and mount point, and calls the container storage management storage service module to query storage end information; the container storage management storage service module calls the storage system interface to query storage volumes and mount information, wherein, for block storage, the storage system volume mapping, host-side device, and multi-path anomalies are detected; for file storage, the NFS or CIFS path and network information are detected; if there is an abnormality, the container storage management storage service module returns volume anomaly information to the container storage management Node service module; the container storage management Node service module reports the persistent volume anomaly to the container orchestration system.

[0047] In this embodiment, the health monitoring method for mounted persistent volumes is similar to that for unmounted volumes, except that the health monitoring method uses the container storage management Node service module instead of the container storage management Controller service module.

[0048] In some embodiments of the present invention, volume performance indicators are detected through communication between a storage monitoring module, a container orchestration system, and a storage system, including: the storage monitoring module queries the container orchestration system to collect information about storage resources; the storage monitoring module queries the storage system to collect indicator information, where the indicator information includes performance indicators such as the read and write IOPS of the PVC, the average latency of the read and write requests of the PVC, the throughput of the PVC, and the used capacity, total capacity, and available capacity of the PVC; and the storage monitoring module exports the collected indicator information to a collector of the data collection and conversion module.

[0049] In this embodiment, the storage monitoring module not only monitors volume performance metrics but also automatically recovers when specific anomalies are detected, ensuring volume and container availability. Volume performance metrics are monitored, and PVCs (Persistent Volume Claims) refer to these metrics. Specific metrics include PVC read and write IOPS, average latency of PVC read and write requests, PVC throughput, and other performance indicators, as well as PVC usage information such as used capacity, total capacity, and available capacity.

[0050] In some embodiments of the present invention, abnormal situations are detected and alarms are issued through communication between the storage monitoring module, the container orchestration system and the storage system, including: the storage monitoring module periodically obtains the read and write IOPS of the persistent volume, the average latency of the read and write requests of the persistent volume, and the throughput of the persistent volume from the storage system, performs comprehensive diagnosis on the obtained indicator information, and adopts a multi-level threshold method to determine whether the hard disk is in a sub-healthy state. If the indicator is abnormal for a long time, the storage system is queried to see whether the data on the hard disk still has complete redundant data on other hard disks, so as to perform disk switching and isolate the problem hard disk in some cases; the storage monitoring module detects and counts the I / O latency and other information of the storage node service module. If a node service module has a continuous abnormality, a sub-healthy alarm is generated, and the storage node corresponding to the storage service module is isolated and the business of the service module is distributed to other service modules in the storage cluster.

[0051] In this embodiment, the storage monitoring module periodically obtains performance metrics from the storage system, such as the read and write IOPS of persistent volumes, the average latency of persistent volume read and write requests, and the throughput of persistent volumes. When abnormal storage device system health is diagnosed based on these performance metrics, the module attempts to invoke relevant storage system functions to isolate hard drives, migrate storage node services, and perform other operations.

[0052] In some embodiments of the present invention, abnormality recovery work is performed through communication between the storage monitoring module, the container orchestration system and the storage system to ensure the availability of volumes and containers, including: when a container fails to restart due to a data volume abnormality, automatically attempting to successfully start the container on other nodes, quickly restoring business, and then performing related recovery work based on the disaster recovery backup function.

[0053] In this embodiment, this method realizes automatic recovery of some functions of the container in the event of an abnormality while performing health monitoring.

[0054] The present invention comprehensively monitors the usage, performance, abnormal conditions, and sub-health status of storage volumes and devices. Monitored indicators, alarms, and other information can be exported into a data format compatible with monitoring systems, enabling convenient integration with monitoring systems and easier, more intuitive monitoring through visualization tools. Detected volume or storage device anomalies can be automatically processed and recovered.

[0055] Based on the above objectives, a third aspect of an embodiment of the present invention provides a computer device. Figure 4 FIG. 1 is a schematic diagram of an embodiment of a computer device provided by the present invention. Figure 4As shown, the computer device of an embodiment of the present invention includes the following devices: at least one processor 021; and a memory 022, the memory 022 stores computer instructions 023 that can be run on the processor, and the steps of implementing the method when the instructions are executed by the processor include: monitoring the health status of mounted persistent volumes through communication between the container storage management Controller service module, the container storage management storage service module, the container orchestration system and the storage system; monitoring the health status of unmounted persistent volumes through communication between the container storage management Node service module, the container storage management storage service module, the container orchestration system and the storage system; detecting volume performance indicators and abnormal conditions, issuing alarms for abnormalities, and recovering from abnormalities to ensure the availability of volumes and containers through communication between the storage monitoring module, the container orchestration system and the storage system; receiving volume performance indicator information obtained by the storage monitoring module and the container storage management module through the data collection and conversion module, processing and converting the data; registering and pulling data exported by the data collection and conversion module through the cluster monitoring system, and intuitively displaying it through a data visualization tool.

[0056] The present invention also provides a computer-readable storage medium. Figure 5 FIG. 1 is a schematic diagram of an embodiment of a computer-readable storage medium provided by the present invention. Figure 5 As shown, the computer-readable storage medium 031 stores a computer program 032 that performs the above method when executed by a processor.

[0057] Finally, it should be noted that those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing the relevant hardware through a computer program. The program of the server centralized testing method can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, the storage medium of the program can be a magnetic disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc. The above-mentioned computer program embodiments can achieve the same or similar effects as the corresponding embodiments of any of the aforementioned methods.

[0058] In addition, the method disclosed in the embodiment of the present invention can also be implemented as a computer program executed by a processor, and the computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, the above functions defined in the method disclosed in the embodiment of the present invention are performed.

[0059] In addition, the above method steps and system units can also be implemented using a controller and a computer-readable storage medium for storing a computer program that enables the controller to implement the above steps or unit functions.

[0060] It will also be appreciated by those skilled in the art that the various exemplary logic blocks, modules, circuits and algorithmic steps described in conjunction with the disclosure herein can be implemented as electronic hardware, computer software or a combination of the two. In order to clearly illustrate this interchangeability of hardware and software, a general description has been given of the functions of various schematic components, blocks, modules, circuits and steps. Whether this function is implemented as software or hardware depends on specific applications and the design constraints imposed on the entire system. Those skilled in the art can implement the function in various ways for each specific application, but this implementation decision should not be interpreted as causing a departure from the disclosed scope of the embodiments of the present invention.

[0061] In one or more exemplary designs, the function can be implemented in hardware, software, firmware or any combination thereof. If implemented in software, the function can be stored as one or more instructions or codes on a computer-readable medium or transmitted via a computer-readable medium. Computer-readable media include computer storage media and communication media, and the communication media include any media that helps to transmit a computer program from one location to another. The storage medium can be any available medium that can be accessed by a general or special-purpose computer. As an example and not limitation, the computer-readable medium can include RAM, ROM, EEPROM, CD-ROM or other optical disk storage devices, magnetic disk storage devices or other magnetic storage devices, or any other medium that can be used to carry or store the required program code in the form of an instruction or data structure and can be accessed by a general or special-purpose computer or a general or special-purpose processor. In addition, any connection can be appropriately referred to as a computer-readable medium. For example, if a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL) or wireless technologies such as infrared, radio and microwaves are used to send software from a website, server or other remote source, the above-mentioned coaxial cable, fiber optic cable, twisted pair, DOL or wireless technologies such as infrared, radio and microwaves are all included in the definition of medium. As used herein, disk and disc include compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk, and Blu-ray disc, where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.

[0062] The above are exemplary embodiments disclosed in the present invention, but it should be noted that various changes and modifications may be made without departing from the scope of the embodiments disclosed in the claims. The functions, steps and / or actions of the method claims according to the disclosed embodiments described herein do not need to be performed in any particular order. In addition, although the elements disclosed in the embodiments of the present invention may be described or required in individual form, they may also be understood as multiple unless expressly limited to the singular.

[0063] It should be understood that, as used herein, the singular forms "a" and "an" are intended to include the plural forms as well, unless the context clearly supports an exception. It should also be understood that, as used herein, "and / or" is intended to include any and all possible combinations of one or more of the associated listed items.

[0064] The serial numbers of the embodiments disclosed in the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0065] Those skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware, or may be accomplished by a program instructing the relevant hardware, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk, or an optical disk, etc.

[0066] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the disclosure of the embodiments of the present invention (including the claims) is limited to these examples. Within the spirit of the embodiments of the present invention, the technical features of the above embodiments or different embodiments may be combined, and there are many other variations of different aspects of the above embodiments of the present invention, which are not provided in detail for the sake of simplicity. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present invention should be included in the scope of protection of the embodiments of the present invention.

Claims

1. A container persistent volume health monitoring system, characterized in that: include: Container storage management module, storage monitoring module, data collection and conversion module and cluster monitoring system, among which, The container storage management module is configured to connect the container orchestration system and the storage system to feed back abnormal conditions of the persistent volume in the storage system to the container orchestration system; The storage monitoring module is configured to connect the container orchestration system and the storage system to monitor persistent volume performance indicators and abnormal conditions, issue alarms for abnormal conditions, and restore container-related functions; The data collection and conversion module is configured to connect to the storage monitoring module to receive, process and convert the indicator information collected by the storage system; The cluster monitoring system is configured to connect to the data collection and conversion module to display the data exported by the data collection and conversion module; The container storage management module includes a container storage management Controller service module, a container storage management Node service module and a container storage management storage service module, wherein: The container storage management controller service module is configured to parse the volume parameters of the unmounted persistent volume to obtain storage and volume information, and report the exception to the container orchestration system; The container storage management Node service module is configured to parse the volume parameters and mount path parameters of the mounted persistent volume, detect the mount path IO, file system and mount point, and report abnormalities to the container orchestration system; The container storage management storage service module is configured to query the volume information of the storage system and provide feedback to the container storage management controller service module when an exception occurs; The container storage management storage service module is further configured to query the volume information and mount information of the storage system and provide feedback to the container storage management Node service module in case of an abnormality.

2. A container persistent volume health monitoring method based on the container persistent volume health monitoring system according to claim 1, characterized in that: include: Monitor the health of mounted persistent volumes through communication between the container storage management controller service module, the container storage management storage service module, the container orchestration system, and the storage system. Monitor the health status of unmounted persistent volumes through communication between the container storage management Node service module, the container storage management storage service module, the container orchestration system, and the storage system. Through communication between the storage monitoring module, container orchestration system, and storage system, volume performance indicators and anomalies are detected, anomalies are alerted, and anomaly recovery is performed to ensure the availability of volumes and containers. The data collection and conversion module receives the volume performance indicator information obtained by the storage monitoring module and the container storage management module, and processes and converts the data; Register and pull the data exported by the data collection and conversion module through the cluster monitoring system, and display it intuitively through data visualization tools.

3. The method for monitoring the health of a container persistent volume according to claim 2, wherein: The health status monitoring of the mounted persistent volume through communication between the container storage management Controller service module, the container storage management storage service module, the container orchestration system, and the storage system includes: The container orchestration system queries the container storage management Controller service module for volume information of the persistent volume; The container storage management controller service module parses the volume parameters to obtain storage and volume information, and calls the container storage management storage service module to query the storage end information; The container storage management storage service module queries the storage system for volume information. For block storage, it queries volume information; for file storage, it queries NFS share or CIFS share information. If the volume or file sharing in the storage system is abnormal or does not exist, the container storage management storage service module returns volume abnormality information to the container storage management controller service module; The container storage management Controller service module reports persistent volume exceptions to the container orchestration system.

4. The method for monitoring the health of a container persistent volume according to claim 2, wherein: The health status monitoring of unmounted persistent volumes through communication between the container storage management Node service module, the container storage management storage service module, the container orchestration system, and the storage system includes: The container orchestration system queries the container storage management Node service module for volume status; The container storage management Node service module parses volume parameters and mount path parameters, detects mount path IO, file system detection and mount point, and calls the container storage management storage service module to query storage end information; The container storage management storage service module calls the storage system interface to query storage volumes and mount information. For block storage, it detects storage system volume mapping, host-side device and multi-path anomalies. For file storage, it detects NFS or CIFS paths and network information. If there is an exception, the container storage management storage service module returns volume exception information to the container storage management Node service module; The container storage management Node service module reports persistent volume exceptions to the container orchestration system.

5. The method for monitoring the health of a container persistent volume according to claim 2, wherein: The detection of volume performance indicators through communication between the storage monitoring module, the container orchestration system, and the storage system includes: The storage monitoring module queries the container orchestration system to collect information about storage resources; The storage monitoring module queries the storage system to collect metrics, including the PVC's read and write IOPS, the average latency of PVC read and write requests, the PVC's throughput performance, and the PVC's used capacity, total capacity, and available capacity. The storage monitoring module exports the collected indicator information to the collector of the data collection and conversion module.

6. The method for monitoring the health of a container persistent volume according to claim 2, wherein: Detecting abnormalities and generating alarms through communication between the storage monitoring module, container orchestration system, and storage system include: The storage monitoring module periodically obtains the persistent volume's read and write IOPS, the average latency of persistent volume read and write requests, and the persistent volume's throughput from the storage system. It then performs a comprehensive diagnosis of the acquired metrics, using a multi-level threshold method to determine whether a hard drive is in a subhealthy state. If these metrics remain abnormal for a long time, the storage system is queried to determine whether the data on the drive has complete redundant data on other hard drives, enabling disk switching and isolation of the problematic drive. The storage monitoring module detects and collects statistics on the I / O latency of storage node service modules. If a node service module experiences persistent abnormalities, a sub-health alarm is generated. At the same time, the storage node corresponding to the storage service module is isolated and the business of the service module is distributed to other service modules in the storage cluster.

7. The method for monitoring the health of a container persistent volume according to claim 2, wherein: Recover from exceptions through communication between the storage monitoring module, container orchestration system, and storage system to ensure volume and container availability, including: When a container fails to restart due to an abnormal data volume, it automatically attempts to successfully start the container on another node to quickly restore the business, and then performs related recovery work based on the disaster recovery backup function.

8. A computer device, characterized in that: include: at least one processor; as well as A memory storing computer instructions executable on the processor, wherein the instructions, when executed by the processor, implement the steps of the method according to any one of claims 2 to 7.

9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 2 to 7 are implemented.

Images