High-reliability heterogeneous storage resource pool construction method and system
By virtualizing and optimizing heterogeneous storage devices, the online expansion of heterogeneous storage device storage resource pool is achieved, solving the limitations of existing storage devices expansion and inconvenient user use, and improving the convenience and reliability of the storage resource pool.
Patent Information
- Application Number
- CN202411850930.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-16
- Publication Date
- 2025-04-25
- Estimated Expiration
- 2044-12-16
AI Technical Summary
Existing storage devices have limitations when expanding capacity, and disk array expansion is prone to bottlenecks. Distributed cluster storage expansion is affected by problems such as hardware discontinuation and software compatibility, which leads to the inability to uniformly manage the storage space of new and old storage devices, which makes it inconvenient for users to use.
By virtualizing heterogeneous storage devices, online expansion of heterogeneous storage space is achieved, and data read, write and reliability design of heterogeneous storage pools are optimized to keep the user's upper-level application interface unchanged.
It realizes the online expansion of the storage resource pool of heterogeneous storage devices, keeps the user interface unchanged, improves the convenience and reliability of the storage resource pool, and solves the problem of inconvenient data access after user expansion.
Smart Images

Figure CN119883110A_ABST
Abstract
Description
Background Art
[0002] There are two main types of existing storage devices, namely disk array storage and distributed cluster storage. During the use of storage, as user data increases, there will be a need for capacity expansion. Expanding the original storage is the simplest and fastest solution. Disk array storage is expanded by vertically expanding the disk cabinet, and distributed cluster storage is expanded by horizontally expanding the nodes. Both types of storage expansion have certain limitations. Disk array expansion is to increase the number of disks while maintaining the original storage processor. Due to the limited storage heads, bottlenecks are very likely to occur. Although the distributed cluster storage system claims to support large nodes and capacity, it is difficult to expand due to hardware discontinuation or software compatibility. In the case that the original storage cannot be expanded, it can only be expanded by purchasing new storage devices, but it is difficult to integrate the storage space of the original storage device with the existing storage device, and it is impossible to provide users with a unified storage space. The upper-level application must identify the new and old storage and develop corresponding usage interfaces based on the storage, which causes inconvenience to users. Summary of the invention
[0003] The present application provides a highly reliable heterogeneous storage resource pool construction method and system for realizing online expansion of a storage resource pool of a heterogeneous storage device while keeping the user upper-layer application interface unchanged, thereby realizing the convenience and reliability of storage resource pool construction.
[0004] In a first aspect, a method for constructing a highly reliable heterogeneous storage resource pool is provided, comprising the following steps:
[0005] Virtualize heterogeneous storage devices;
[0006] Expand heterogeneous storage space;
[0007] Optimize data reading and writing in heterogeneous storage pools;
[0008] Design for reliability of heterogeneous storage pools.
[0009] In the above technical scheme, by virtualizing heterogeneous storage devices, expanding heterogeneous storage space, optimizing data reading and writing of heterogeneous storage pools, and designing the reliability of heterogeneous storage pools, online expansion of storage resource pools of heterogeneous storage devices is achieved, while keeping the user's upper-level application interface unchanged, thereby achieving convenience and reliability in building storage resource pools.
[0010] In a specific implementation scheme, the step of virtualizing the heterogeneous storage device specifically includes:
[0011] Unified management of heterogeneous storage devices;
[0012] Perform multipath mapping on virtualized block domains.
[0013] In a specific implementation scheme, heterogeneous storage devices are uniformly managed through the iSCSI protocol.
[0014] In a specific implementation scheme, the heterogeneous storage space is expanded using an embedded expansion method strategy and a combined expansion method strategy.
[0015] In a specific implementation scheme, the embedded capacity expansion method strategy embeds the virtualized storage device as a whole into the virtualized block domain corresponding to the existing file system to increase the capacity of the virtualized block storage pool.
[0016] In a specific implementation scheme, the combined capacity expansion method strategy uses the virtualized storage device as one or more independent virtualized block domains, builds one or more virtualized block storage pools accordingly, and adds the virtualized block storage pools as additional data pools to the file system.
[0017] In a specific implementation scheme, the method for optimizing heterogeneous storage pool data reading and writing includes designing a file system dynamic subtree partition distribution method, a data write load balancing method, and a striping dynamic distribution optimization method.
[0018] In a specific implementation scheme, a metadata management node reliability design method is used to design the reliability of a heterogeneous storage pool.
[0019] In a specific implementation scheme, the metadata management node reliability design method includes:
[0020] Design negotiation network protocols between multiple nodes;
[0021] Design the multi-node broadcast message format;
[0022] Design the master node management strategy;
[0023] Design the master-slave node switching strategy.
[0024] In a second aspect, a highly reliable heterogeneous storage resource pool construction system is provided, including:
[0025] A virtualization module, used for virtualizing heterogeneous storage devices;
[0026] Expansion module, used to expand heterogeneous storage space;
[0027] Read-write optimization module, used to optimize the reading and writing of data in heterogeneous storage pools;
[0028] The reliability design module is used to design the reliability of heterogeneous storage pools.
[0029] In the above technical scheme, by virtualizing heterogeneous storage devices, expanding heterogeneous storage space, optimizing data reading and writing of heterogeneous storage pools, and designing the reliability of heterogeneous storage pools, online expansion of storage resource pools of heterogeneous storage devices is achieved, while keeping the user's upper-level application interface unchanged, thereby achieving convenience and reliability in building storage resource pools. BRIEF DESCRIPTION OF THE DRAWINGS
[0030] Figure 1 A flowchart of a method for constructing a highly reliable heterogeneous storage resource pool provided in an embodiment of the present application;
[0031] Figure 2 A structural block diagram of a highly reliable heterogeneous storage resource pool construction system provided in an embodiment of the present application;
[0032] Figure 3 A schematic diagram of a virtualization design for heterogeneous storage devices provided in an embodiment of the present application;
[0033] Figure 4 A schematic diagram of a method for expanding storage space of a file system provided in an embodiment of the present application;
[0034] Figure 5 A schematic diagram of DNS load balancing provided in an embodiment of the present application;
[0035] Figure 6 A schematic diagram of a multi-node negotiation message format provided in an embodiment of the present application;
[0036] Figure 7 A schematic diagram of a metadata management master node state machine provided in an embodiment of the present application;
[0037] Figure 8 A schematic diagram of a metadata management standby node state machine provided in an embodiment of the present application. DETAILED DESCRIPTION
[0038] The present application is further described in detail below through the accompanying drawings and embodiments. Through these descriptions, the characteristics and advantages of the present application will become clearer and more specific.
[0039] The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration." Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments. Although various aspects of the embodiments are shown in the drawings, the drawings are not necessarily drawn to scale unless otherwise noted.
[0040] In addition, the technical features involved in different embodiments of the present application described below can be combined with each other as long as they do not conflict with each other.
[0041] To facilitate understanding of the high-reliability heterogeneous storage resource pool construction method and system provided in the embodiment of the present application, its application scenario is first explained. The high-reliability heterogeneous storage resource pool construction method and system provided in the embodiment of the present application are used to realize the online expansion of the storage resource pool of heterogeneous storage devices, while keeping the user upper-layer application interface unchanged, thereby realizing the convenience and reliability of the storage resource pool construction. There are two main types of existing storage devices, namely disk array storage and distributed cluster storage. During the storage use process, as user data increases, there will be a demand for capacity expansion. Expanding the original storage is the simplest and fastest solution. Disk array storage is expanded by vertically expanding the disk cabinet, and distributed cluster storage is expanded by horizontally expanding nodes. Both types of storage expansion have certain limitations. Disk array expansion is to increase the number of disks while maintaining the original storage processor. Due to the limited storage head, bottlenecks are very likely to occur; although the distributed cluster storage system claims to support large nodes and capacity, it is difficult to expand due to hardware discontinuation or software compatibility. When the original storage cannot be expanded, it can only be expanded by purchasing new storage devices. However, it is difficult to integrate the storage space of the original storage device with the existing storage device, and it is impossible to provide users with a unified storage space. The upper-level application must identify the new and old storage and develop corresponding usage interfaces based on the storage, which causes inconvenience to users. For this reason, the embodiment of the present application provides a highly reliable heterogeneous storage resource pool construction method and system to achieve online expansion of the storage resource pool of heterogeneous storage devices, while keeping the user's upper-level application interface unchanged, thereby achieving the convenience and reliability of storage resource pool construction. The following is a detailed description of the embodiment in conjunction with specific drawings.
[0042] refer to Figures 1 to 8 , Figure 1 A flowchart of a method for constructing a highly reliable heterogeneous storage resource pool provided in an embodiment of the present application; Figure 2 A structural block diagram of a highly reliable heterogeneous storage resource pool construction system provided in an embodiment of the present application; Figure 3 A schematic diagram of a virtualization design for heterogeneous storage devices provided in an embodiment of the present application; Figure 4 A schematic diagram of a method for expanding storage space of a file system provided in an embodiment of the present application; Figure 5 A schematic diagram of DNS load balancing provided in an embodiment of the present application; Figure 6 A schematic diagram of a multi-node negotiation message format provided in an embodiment of the present application; Figure 7 A schematic diagram of a metadata management master node state machine provided in an embodiment of the present application; Figure 8 A schematic diagram of a metadata management standby node state machine provided in an embodiment of the present application.
[0043] exist Figure 1 In the embodiment of the present application, a method for constructing a highly reliable heterogeneous storage resource pool is provided, comprising the following steps:
[0044] Virtualize heterogeneous storage devices;
[0045] Expand heterogeneous storage space;
[0046] Optimize data reading and writing in heterogeneous storage pools;
[0047] Design for reliability of heterogeneous storage pools.
[0048] In the above technical scheme, by virtualizing heterogeneous storage devices, expanding heterogeneous storage space, optimizing data reading and writing of heterogeneous storage pools, and designing the reliability of heterogeneous storage pools, online expansion of storage resource pools of heterogeneous storage devices is achieved, while keeping the user's upper-level application interface unchanged, thereby achieving convenience and reliability in building storage resource pools.
[0049] In a specific implementation scheme, the step of virtualizing the heterogeneous storage device specifically includes:
[0050] Unified management of heterogeneous storage devices;
[0051] Perform multipath mapping on virtualized block domains.
[0052] In a specific implementation scheme, heterogeneous storage devices are uniformly managed through the iSCSI protocol.
[0053] In a specific implementation scheme, the heterogeneous storage space is expanded using an embedded expansion method strategy and a combined expansion method strategy.
[0054] In a specific implementation scheme, the embedded capacity expansion method strategy embeds the virtualized storage device as a whole into the virtualized block domain corresponding to the existing file system to increase the capacity of the virtualized block storage pool.
[0055] In a specific implementation scheme, the combined capacity expansion method strategy uses the virtualized storage device as one or more independent virtualized block domains, builds one or more virtualized block storage pools accordingly, and adds the virtualized block storage pools as additional data pools to the file system.
[0056] In a specific implementation scheme, the method for optimizing heterogeneous storage pool data reading and writing includes designing a file system dynamic subtree partition distribution method, a data write load balancing method, and a striping dynamic distribution optimization method.
[0057] In a specific implementation scheme, a metadata management node reliability design method is used to design the reliability of a heterogeneous storage pool.
[0058] In a specific implementation scheme, the metadata management node reliability design method includes:
[0059] Design negotiation network protocols between multiple nodes;
[0060] Design the multi-node broadcast message format;
[0061] Design the master node management strategy;
[0062] Design the master-slave node switching strategy.
[0063] refer to Figures 3 to 8 , the method for constructing a high-reliability heterogeneous storage resource pool specifically includes:
[0064] 1. Virtualization Design of Heterogeneous Storage Devices
[0065] refer to Figure 3 , design a virtualization method for heterogeneous storage devices, and manage multiple sets of heterogeneous disk arrays and distributed cluster storage devices in a unified manner through the standard iSCSI protocol structure. Take over heterogeneous storage devices locally through the iSCSI protocol. All heterogeneous storage spaces constitute the heterogeneous layer of the system, and build one or more virtualized block domain storage pools. Use sharding technology to first divide a large storage space into 1G data blocks. The divided data blocks can be used in different storage pools, and all data blocks constitute the sharding layer of the system. Use redundancy technology to divide the shard storage into single copies, multiple copies, or erasure codes according to user redundancy requirements. The file layer virtualization method divides the unified storage space into multiple file systems according to different user capacity requirements to provide file services for users. The storage space of the managed storage devices is uniformly managed, scheduled, and allocated to build a shared distributed file system storage resource pool.
[0066] The storage device contains multiple nodes. Through distributed node mapping storage space, multiple disks are generated. Multipath management is used to virtualize the same storage space mapped by multiple paths into a virtualized block domain, which is convenient for direct access without caring about the status of each link. Each path can map a SCSI hard disk and has a SCSI address, which is composed of initiator ID, bus ID, target ID and LUN ID. In actual networking, the initiator ID generally corresponds to the host HBA port, the bus ID is generally fixed to 0 in the SAN mapping hard disk, the target ID generally corresponds to the storage array controller port, and the LUN ID indicates the sequence number of the LUN in the target. In order to distinguish whether the hard disks mapped by different paths are the same LUN, the multipath software borrows the WWN of the SCSI device. When the WWN is the same, it means that the SCSI devices mapped by the two paths are the same LUN.
[0067] 2. Heterogeneous Storage Space Expansion Design
[0068] refer to Figure 4 Two expansion methods, embedded expansion and combined expansion, are proposed for the expansion of shared distributed storage resource pools. Both methods keep the NFS mount directory on the user side unchanged, and from the user's perspective, the available storage space under the mounted directory is increased.
[0069] The embedded expansion method embeds the virtualized storage device as a whole into the virtualized block domain corresponding to the existing file system, increases the capacity of the virtualized block storage pool, and thus increases the storage capacity of the distributed file system. During the expansion process, based on the real-time operating status of each set of distributed cluster storage devices and pre-set policy parameters, data migration is dynamically planned and executed to transfer part of the data from the storage device with higher load to the device with lower load, so as to ensure the optimal distribution of data in the storage system and improve the overall performance and efficiency.
[0070] The combined capacity expansion method treats the virtualized storage device as one or more independent virtualized block domains, and correspondingly constructs one or more virtualized block storage pools, and adds the virtualized block storage pool as an additional data pool to the file system to expand the storage capacity. After the virtualized block storage pool is built, the virtualized block storage pool to be used is activated according to demand to make it active, so as to perform capacity expansion operations in units of resource pools. Those resource pools that are not currently active can be set to dormant mode. In this state, they do not participate in the system's rebalancing calculations to save resources. However, once there is a data access demand pointing to the data in these dormant resource pools, the system can respond quickly. Through efficient compression processing technology, it can quickly provide data access while significantly reducing the overall storage space consumption.
[0071] 3. Optimized design of data reading and writing in heterogeneous storage pools
[0072] refer to Figure 5, a dynamic subtree partition distribution algorithm for file systems based on RADOS is proposed. Based on the dynamic subtree partition method, in order to achieve the best scalability and performance, the file system separates metadata and business data and stores them uniformly in the RADOS layer. First, the data is divided into objects of the same size, each with a unique ID. Then, the object ID is mapped to the storage node using a hash algorithm to ensure that the data is evenly distributed and stored on the correct node. In order to further improve the security and fault tolerance of the data, each object is replicated on multiple nodes to achieve redundant backup of the data. The placement and replication of data is managed through an extensible storage allocation algorithm to ensure efficient distribution and access of data in the cluster. The metadata and information of the entire cluster, including the status of the node, the distribution of data, and the location of the replica, are maintained through the Cluster Map to ensure the consistency and stability of the cluster. By monitoring the load of the cluster nodes in real time, the subtree distribution on different nodes is dynamically adjusted. And the data distribution can be dynamically adjusted according to the load. Thus, the load balancing of all nodes on the file system is guaranteed.
[0073] A data write request allocation method based on DNS load balancing is proposed. When the file system is successfully mounted on all nodes, in order to ensure load balancing among nodes, DNS load balancing is designed as a preliminary allocation method for data write requests. Multiple IP addresses are configured for the same host name in the DNS server. When answering DNS queries, the DNS server will return different resolution results in sequence with the IP address of the host record in the DNS file for each query, directing the client's access to different machines, so that different clients access different servers. This mechanism gives each node an equal opportunity to process write requests, effectively avoiding overload of a single node and improving the stability and response speed of the overall system.
[0074] A striping dynamic distribution optimization method is proposed. In order to further optimize the striping effect, the number of stripes to be allocated on each disk is dynamically calculated and adjusted according to the actual performance parameters of the disk (such as I / O speed, latency), the remaining storage space size, and the current load status. When the number of stripes is large, the data is written to the disk with more stripes with a greater probability by adjusting the weight factor. This dynamic adjustment mechanism ensures that the data can be evenly and efficiently distributed on all available disks, thereby avoiding the situation where some disks are overloaded due to data skew while other disks are idle. When a large number of data stripes are detected on a disk, the weight factor is adjusted to allocate new write requests to disks with relatively fewer current stripes based on the automatic monitoring of the number of stripes on each disk, so as to balance the load of each disk. This method maintains a balanced distribution of data among disks and can maximize the storage and processing capabilities of each disk, further improving the overall performance and resource utilization of the system, and improving the parallel access capability and throughput of the storage pool.
[0075] IV. Reliability Design of Heterogeneous Storage Pool
[0076] refer to Figures 6 to 8 , a reliability design method for metadata management nodes is proposed. The metadata management node is used to save the metadata of the storage pool. The metadata management node adopts a master and standby design. The nodes are interconnected through 10 Gigabit Ethernet to achieve multi-frame interconnection. Each node is configured with a single ID and the corresponding frame IP address. Because multi-node negotiation is required, multi-node negotiation no longer uses unicast negotiation, but multicast messages are used for negotiation. The multicast address is 224.0.0.1, and the multicast port defaults to UDP port 30002 (configurable). When joining a node cluster, any node defaults to the master node and will only switch to the standby node when the master node cannot be found. In normal operation, the standby node does not send messages, and the master node broadcasts a message once per second. The format of the multi-node broadcast message is as follows Figure 6 As shown, where:
[0077] ID: Configure the ID for the current node. This value is unique in the node cluster, and different nodes cannot be configured with the same ID.
[0078] role: indicates the current node status, including managing the primary node (1: HE_PRIMARY) and managing the standby frame (2: HE_STANDBY).
[0079] ip_num: The number of IP addresses contained in the message, arranged in ip_address in array form.
[0080] ip_address: The management IP address of the current node (in binary format), which can contain multiple IP addresses.
[0081] The metadata management master node is responsible for the configuration of the entire machine. All configuration tasks are managed by the master node and the configured configuration information is sent to all standby nodes. The master node state machine is as follows Figure 7 As shown, under normal circumstances, the status of the current node is broadcast once a second to prevent other nodes from preempting the master node. If a message from other nodes is received showing that it is the master node, arbitration is performed by comparing the node IDs. The box with the smaller node ID is the new management master node.
[0082] The metadata management standby node forwards the management message to the master node for management. Under normal circumstances, it does not send multi-frame negotiation multicast messages. It only sends messages when it cannot receive messages from the master node and tries to seize the master position. The standby node state machine is as follows Figure 6 As shown:
[0083] (1) The standby node checks once a second whether it has received a broadcast message from the master node in the last three seconds. If it can normally receive the broadcast message from the master node, it only performs the check action; if it cannot receive the broadcast message from the master node, it executes step 2.
[0084] (2) Check whether a backup node message with a smaller ID than its own has been received in the last 3 seconds. If it can be received, sleep for 1 second and then execute step 1 again; otherwise, execute step 3.
[0085] (3) Check whether the broadcast message sent by the master node is received in the last 6 seconds. If it can be received, this frame sends the broadcast message and executes step 1 after sleeping for 1 second; otherwise, execute step 4.
[0086] (4) Since the master node message cannot be received within 6 seconds and the ID of this frame is the smallest among the normal operating frames, this node switches to the master node.
[0087] In this embodiment, a highly reliable heterogeneous storage resource pool construction method is provided to achieve the integrated use of file system storage space of multiple sets of heterogeneous disk arrays and distributed cluster storage devices, so that users can achieve reliable and efficient shared read and write access to shared distributed file system storage space without changing the user-side usage policy.
[0088] In the above technical scheme, a unified storage resource pool is constructed for heterogeneous storage devices, and a highly reliable heterogeneous storage resource pool construction method is provided; using the method of the present application, under the condition of keeping the existing storage device in use unchanged, there is no need to stop the storage services used by the user, and the online expansion of the storage resource pool of the heterogeneous storage device is realized, while keeping the user's upper-level application interface unchanged, thereby achieving the convenience and reliability of the storage resource pool construction.
[0089] exist Figure 2 In the embodiment of the present application, a highly reliable heterogeneous storage resource pool construction system is provided, including:
[0090] A virtualization module, used for virtualizing heterogeneous storage devices;
[0091] Expansion module, used to expand heterogeneous storage space;
[0092] Read-write optimization module, used to optimize the reading and writing of data in heterogeneous storage pools;
[0093] The reliability design module is used to design the reliability of heterogeneous storage pools.
[0094] In this embodiment, a method is provided that can integrate multiple heterogeneous storage devices and provide a unified storage resource pool. Regardless of whether the original storage device is expanded or a new storage device is added, the user-side interface is not changed, thereby achieving fast and imperceptible expansion and solving the inconvenience of data access for users after expansion.
[0095] In the above technical scheme, by virtualizing heterogeneous storage devices, expanding heterogeneous storage space, optimizing data reading and writing of heterogeneous storage pools, and designing the reliability of heterogeneous storage pools, online expansion of storage resource pools of heterogeneous storage devices is achieved, while keeping the user's upper-level application interface unchanged, thereby achieving convenience and reliability in building storage resource pools.
[0096] Those skilled in the art will appreciate that the present application may be implemented as a system, method or computer program product.
[0097] Therefore, the present disclosure may be specifically implemented in the following forms, namely: it may be completely hardware, it may be completely software (including firmware, resident software, microcode, etc.), or it may be a combination of hardware and software, generally referred to herein as a "circuit", "module" or "system". In addition, in some embodiments, the present application may also be implemented in the form of a computer program product in one or more computer-readable media, and the computer-readable medium may contain computer-readable program code.
[0098] Any combination of one or more computer-readable media can be used. Computer-readable media can be computer-readable signal media or computer-readable storage media. Computer-readable storage media can be, for example, but not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or devices, or any combination of the above. More specific examples (non-exhaustive list) of computer-readable storage media include: electrical connections with one or more wires, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above. In this document, computer-readable storage media can be any tangible medium containing or storing a program, which can be used by an instruction execution system, device or device or used in combination with it.
[0099] Although the embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and cannot be understood as limiting the present application. A person of ordinary skill in the art can change, modify, replace and modify the above embodiments within the scope of the present application. On this basis, a variety of replacements and improvements can be made to the present application, all of which fall within the scope of protection of the present application.
Claims
1. A method for constructing a highly reliable heterogeneous storage resource pool, characterized in that: The following steps are involved: Virtualize heterogeneous storage devices; Expand heterogeneous storage space; Optimize data reading and writing in heterogeneous storage pools; Design for reliability of heterogeneous storage pools.
2. The method for constructing a highly reliable heterogeneous storage resource pool according to claim 1, characterized in that: The steps for virtualizing heterogeneous storage devices include: Unified management of heterogeneous storage devices; Perform multipath mapping on virtualized block domains.
3. The method for constructing a highly reliable heterogeneous storage resource pool according to claim 2, characterized in that: Heterogeneous storage devices are managed uniformly through the iSCSI protocol.
4. The method for constructing a highly reliable heterogeneous storage resource pool according to claim 3, characterized in that: Use embedded expansion method strategies and combined expansion method strategies to expand heterogeneous storage space.
5. The method for constructing a highly reliable heterogeneous storage resource pool according to claim 4, characterized in that: The embedded capacity expansion method strategy embeds the virtualized storage device as a whole into the virtualized block domain corresponding to the existing file system, thereby increasing the capacity of the virtualized block storage pool.
6. The method for constructing a highly reliable heterogeneous storage resource pool according to claim 5, characterized in that: The combined capacity expansion method strategy uses the virtualized storage device as one or more independent virtualized block domains, constructs one or more virtualized block storage pools accordingly, and adds the virtualized block storage pools as additional data pools to the file system.
7. The method for constructing a highly reliable heterogeneous storage resource pool according to claim 6, characterized in that: The method for optimizing the reading and writing of data in a heterogeneous storage pool includes designing a file system dynamic subtree partition distribution method, a data writing load balancing method, and a striping dynamic distribution optimization method.
8. The method for constructing a highly reliable heterogeneous storage resource pool according to claim 7, characterized in that: The reliability of heterogeneous storage pools is designed using the metadata management node reliability design method.
9. The method for constructing a highly reliable heterogeneous storage resource pool according to claim 8, characterized in that: The metadata management node reliability design method comprises: Design negotiation network protocols between multiple nodes; Design the multi-node broadcast message format; Design the master node management strategy; Design the master-slave node switching strategy.
10. A highly reliable heterogeneous storage resource pool construction system, characterized in that: include: A virtualization module, used for virtualizing heterogeneous storage devices; Expansion module, used to expand heterogeneous storage space; Read-write optimization module, used to optimize the reading and writing of data in heterogeneous storage pools; The reliability design module is used to design the reliability of heterogeneous storage pools.
Citation Information
Patent Citations
Virtualized storage pool based on heterogeneous instruction set and method thereof
CN115065693A
Storage virtualization
US20060101204A1
Dynamically scaling application and storage system functions based on a heterogeneous resource pool available for use by a distributed storage management system
US20230121460A1
Access method and apparatus for storage pool
WO2024093958A1