Cross-data-center storage pool group configuration method, system, equipment and medium
By dividing storage pool groups based on physical location and using cost functions, the method optimizes cross-data center storage, addressing unbalanced loads and resource utilization, enhancing performance and reliability.
Patent Information
- Application Number
- CN202411613262.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-13
- Publication Date
- 2024-12-13
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing storage pool designs focus on single data centers, ignoring the challenges of cross-region deployments, leading to unbalanced loads and insufficient resource utilization across data centers.
A method and system for configuring storage pool groups across data centers by dividing virtual sub-storage pool groups based on the physical location of storage pools and business data, using cost functions to optimize selection and ensure load balancing and resource utilization.
This approach reduces data transmission delays, improves data access speed, enhances scalability and fault tolerance, and ensures load balancing across data centers, maximizing storage and network capacity.
Smart Images

Figure CN119128328A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of data management technology, and in particular to a configuration method, system, device and medium for a storage pool group across data centers. Background Art
[0002] In traditional distributed database deployments, storage pool groups are usually designed to be used within a single data center to support storage and access to database shards. However, with the evolution of distributed database technology, more and more systems are beginning to support deployment across data centers in different regions to meet global business needs. However, the existing storage pool design and optimization logic still focuses on a single data center, ignoring the new challenges brought about by cross-region deployment, which makes it easy for storage pool groups across data centers to have unbalanced loads and insufficient resource utilization. Summary of the invention
[0003] The purpose of the present application is to provide a configuration method, system, device and medium for a storage pool group across data centers, which can ensure load balancing of the storage pool group across data centers and full utilization of resources.
[0004] This application is implemented as follows: In a first aspect, the present application provides a method for configuring a storage pool group across data centers, comprising the following steps: Obtain characteristic parameters of business data and target pool configuration information. Determine whether a storage pool selection operation is required based on the characteristic parameters of the business data and the target pool configuration information; if so, enter the storage pool selection step; otherwise, store the business data into the currently selected storage pool based on the target pool configuration information. Storage pool selection step: In response to the storage pool selection instruction, when the number of virtual sub-storage pool groups is one, select a target storage pool from them according to a predetermined pool selection rule; when the number of virtual storage pool groups is multiple, first select a virtual sub-storage pool group according to the predetermined group selection rule, and then select a target storage pool from the selected virtual sub-storage pool group according to the predetermined pool selection rule; wherein the virtual sub-storage pool group is a storage pool group formed based on the physical location of the storage pool and the physical location of the business data storage; the predetermined pool selection rule is obtained based on the cost function of the storage pool, and the predetermined group selection rule is obtained based on the cost function of each virtual sub-storage pool group.
[0005] In an implementation of the present application, the target pool configuration information includes a physical location of the storage pool, a physical location of the business data storage, and a weight of the physical location of the business data storage.
[0006] In one implementation of the present application, the determination of whether a storage pool selection operation is required based on characteristic parameters of the business data and target pool configuration information includes: when the business data is full backup data, or the currently selected storage pool determined according to the target pool configuration information fails / is removed, or the currently selected storage pool determined according to the target pool configuration information reaches a storage threshold, it is determined that a storage pool selection operation is required.
[0007] In an implementation of the present application, the predetermined group selection rule includes: calculating a cost function of storing the service data in each virtual sub-storage pool group according to characteristic parameters of the service data, and selecting a virtual sub-storage pool group with a minimum cost function according to the calculation result.
[0008] In one implementation of the present application, the predetermined pool selection rules include: when the compression and deduplication functions are enabled in the storage pool, the business data is adjusted and the cost function of storing the business data in each storage pool is calculated, and based on the calculation results, the storage pool with the smallest cost function is selected as the target storage pool.
[0009] In an implementation of the present application, the cost function of the virtual sub-storage pool group includes a cost function of cost weight and a cost function of constraint conditions.
[0010] In an implementation of the present application, the calculation formula of the cost function of the virtual sub-storage pool group includes: in, d Represents business data, spg i Indicates the serial number is i Virtual sub-storage pool group, f cost represents the cost function of the virtual sub-storage pool group, p cost The cost function represents the cost weight, c cost represents the cost function of the constraint, and Respectively indicate the serial number i and j The cost weight of the virtual sub-storage pool group, express spg i Based on the cost function of storage resources, express spg i Based on the cost function of the virtual sub-storage pool group, Indicates the serial number is iThe storage pool with the largest remaining storage space in the virtual sub-storage pool group. express Storage utilization, α and β represents the predetermined coefficient, express The storage resource where it is located.
[0011] In a second aspect, the present application provides a configuration system for a storage pool group across data centers, comprising: The acquisition module is used to acquire characteristic parameters of business data and target pool configuration information. The judgment module is used to judge whether a storage pool selection operation is required based on the characteristic parameters of the business data and the target pool configuration information; if so, the storage pool selection step is entered; otherwise, the business data is stored in the currently selected storage pool according to the target pool configuration information. The pool selection module is used to execute the storage pool selection step: in response to the storage pool selection instruction, when the number of virtual sub-storage pool groups is one, a target storage pool is selected from them according to a predetermined pool selection rule; when the number of virtual storage pool groups is multiple, a virtual sub-storage pool group is first selected from them according to the predetermined group selection rule, and then a target storage pool is selected from the selected virtual sub-storage pool group according to the predetermined pool selection rule; wherein the virtual sub-storage pool group is a storage pool group formed according to the physical location of the storage pool and the physical location of the business data storage; the predetermined pool selection rule is obtained according to the cost function of the storage pool, and the predetermined group selection rule is obtained according to the cost function of each virtual sub-storage pool group.
[0012] In a third aspect, the present application provides an electronic device, comprising a memory for storing one or more programs; a processor; when the one or more programs are executed by the processor, a method as described in any one of the first aspects is implemented.
[0013] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements a method as described in any one of the above-mentioned first aspects.
[0014] Compared with the prior art, the present invention has at least the following advantages or beneficial effects: This application takes into account the complexity of cross-data center storage, and thus realizes the effective integration and optimal utilization of cross-data center storage resources by dividing virtual sub-storage pool groups according to the physical location of the storage pool and the physical location of the business data, and performing group and pool selection operations on this basis. This helps to reduce data transmission delays, improve data access speed, and enhance the scalability and fault tolerance of the system, as well as ensure load balancing of storage pool groups across data centers. That is, this application can ensure that, under the premise of meeting the data center architecture planning, the load of storage pool groups across data centers is balanced, and the storage capacity and network capacity of each data center are maximized, thereby providing stable backup or replication storage services to the outside world. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.
[0016] Figure 1 This is a topological diagram of three data centers in two regions in an embodiment of the present application; Figure 2 A flowchart of an embodiment of a method for configuring a storage pool group across data centers of the present application; Figure 3 A flowchart of storage pool group and service data preconfiguration in an embodiment of the present application; Figure 4 This is a schematic diagram of a storage pool group in two regions, Shanghai and Nanjing, in an embodiment of the present application; Figure 5 This is a schematic diagram of three virtual sub-storage pool groups in two locations and three centers in an embodiment of the present application; Figure 6 A structural block diagram of an electronic device provided in an embodiment of the present application.
[0017] Icon: 201, processor; 202, memory; 203, communication interface. DETAILED DESCRIPTION
[0018] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations.
[0019] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.
[0020] Example 1 In order to facilitate understanding of the technical solution provided by this application, some concepts are introduced below.
[0021] 1. Virtual sub-storage pool group When deployed across different data centers, the backup and CDM (Copy Data Management) system will create different storage pools on the storage resources of different data centers, combine different storage pools into a storage pool group, and read and write data in the storage pool group through the storage controller. When the system specifies the use of a storage pool group for backup or other business operations, the corresponding data should be stored in the storage pools of different data centers within the storage pool group. Since these storage pools are distributed in different data centers, data centers can be classified according to their geographical locations, and storage pools also have geographical location attributes. Grouping storage pools according to geographical location attributes constitutes a virtual sub-storage pool group. Depending on the geographical location granularity, different virtual sub-storage pool groups can be generated for the same storage pool group. Figure 1 The example topology of two regions and three data centers is given, and the storage pool group identifies the virtual sub-storage pool group consisting of two regions. It should be noted that Figure 1 The different data centers where the storage pools in Nanjing are located are not identified. In actual use, users can flexibly decide whether to distinguish different data centers in the same region based on actual needs.
[0022] See also Figure 2 The configuration method of a storage pool group across data centers includes the following steps: Obtain characteristic parameters of business data and target pool configuration information.
[0023] Determine whether a storage pool selection operation is required based on the characteristic parameters of the business data and the target pool configuration information; if so, enter the storage pool selection step; otherwise, store the business data in the currently selected storage pool based on the target pool configuration information.
[0024] The step of selecting a storage pool: in response to the storage pool selection instruction, when the number of virtual sub-storage pool groups is one, a target storage pool is selected from the virtual sub-storage pool groups according to a predetermined pool selection rule; when the number of virtual storage pool groups is multiple, a virtual sub-storage pool group is first selected from the virtual sub-storage pool groups according to the predetermined group selection rule, and then a target storage pool is selected from the selected virtual sub-storage pool group according to the predetermined pool selection rule. The virtual sub-storage pool group is a storage pool group formed according to the physical location of the storage pool and the physical location of the business data storage; the predetermined pool selection rule is obtained according to the cost function of the storage pool, and the predetermined group selection rule is obtained according to the cost function of each virtual sub-storage pool group.
[0025] It should be noted that in the existing user data center planning scheme, the storage pool of the same data center is usually selected to back up the database shard of the data center to avoid cross-regional traffic. If it cannot be met, it is also inclined to choose a storage pool that is closer in terms of region, such as another data center in the same region; further, if neither can be met, then another lower data center can be selected. However, the existing storage pool design and optimization logic still focuses on a single data center, ignoring these new problems brought about by cross-regional deployment.
[0026] In the above embodiment, the characteristic parameters of the business data and the target pool configuration information are first obtained as the basis for pool selection. Subsequently, by judging whether it is necessary to select a storage pool, a decision is made whether to start the pool selection process. In the storage pool selection step, the virtual sub-storage pool group is divided according to the physical location of the storage pool and the physical location of the business data storage to better reflect the cross-regional characteristics. Furthermore, when there is only one virtual sub-storage pool group, the optimal target storage pool is directly selected according to the predetermined pool selection rules, and when there are multiple virtual sub-storage pool groups, a virtual sub-storage pool group is first determined according to the predetermined group selection rules, and then the optimal target storage pool is selected from the selected virtual sub-storage pool group according to the predetermined group selection rules. Therefore, this solution can better meet the storage pool group data in the production environment to meet the planning requirements (mainly to meet the requirements related to cross-data centers), and meet the needs of being as dispersed as possible and balanced in throughput.
[0027] In summary, considering the complexity of cross-data center storage, the above embodiment realizes the effective integration and optimal utilization of cross-data center storage resources by dividing virtual sub-storage pool groups according to the physical location of the storage pool and the physical location of the business data, and performing group and pool selection operations on this basis. This helps to reduce data transmission delays, improve data access speed, enhance the scalability and fault tolerance of the system, and ensure load balancing of storage pool groups across data centers.
[0028] It should also be noted that the target pool configuration information is a series of information obtained after pre-configuring the storage pool group and business data in advance. The pre-configuration process of the storage pool group and business data can be as follows: Figure 3 As shown in the figure, it includes configuring the physical location of the storage pool in the storage pool, configuring the physical location of the business data storage, and configuring the weight of the physical location of the data storage. Among them, the configuration of the physical location of the storage pool and the business data storage determines the number and distribution of virtual sub-storage pool groups in the storage pool group. Assuming that only the regional level is configured, the virtual sub-storage pool groups will be grouped according to the region. Figure 4 The example shows two virtual sub-storage pool groups in Shanghai and Nanjing. If the physical location of the configuration is accurate to the data center, the grouping will be further refined to the data center. Figure 5 The example shows three virtual sub-storage pool groups in three centers in two locations. If further refinement is required, the physical location can be further refined to different computer rooms in the same data center, or different racks in the same computer room. However, from a business scenario perspective, generally, the data center level can meet most needs.
[0029] When business data at a certain physical location needs to be stored in a virtual sub-storage pool group, the cost weight of storing in these sub-groups needs to be defined. The cost weight ranges from 1 to 100. The higher the cost weight, the higher the cost of storing in the corresponding virtual sub-storage pool group, and the less likely the virtual sub-storage pool group is to be selected. For example Figure 4-Figure 5 The cost weight settings in the two examples indicate that business data will be stored in the same region or data center as much as possible. Of course, the user's data center planning may be the opposite. For example, if an off-site backup data center is planned and the backup data is not stored locally, the cost weight settings in the examples will be the opposite.
[0030] Based on the aforementioned solution, in some implementations of the present application, the target pool configuration information includes the physical location of the storage pool, the physical location of the business data storage, and the weight of the physical location of the business data storage.
[0031] It should be noted that the target pool configuration information is an important condition for determining whether a storage pool selection operation is needed. By breaking down the target pool configuration information into the physical location of the storage pool, the physical location of the business data storage, and the weight of the physical location of the business data storage, the accuracy of determining whether a storage pool selection operation is needed can be enhanced, thereby better initiating the storage pool selection operation as needed.
[0032] Among them, by introducing the weight of the physical location where the business data is stored, the system can more accurately evaluate the importance of different storage locations for specific business data. This weight can be determined based on a variety of factors, such as data access frequency, data recovery time objective (RTO), data recovery point objective (RPO), etc. Based on these weights, the subsequent system can give priority to those storage pools that have the greatest impact on the business and are most in need of performance and data security. In addition, by taking the physical location of the business data into consideration and setting corresponding weights for it, the system can give priority to those storage pools that are close to the physical location of the business data. This helps to reduce the delay and cost of data transmission, improve the response speed and throughput of data access, and thus improve user experience and business efficiency.
[0033] Based on the aforementioned scheme, in some implementations of the present application, the determination of whether a storage pool selection operation is required based on the characteristic parameters of the business data and the target pool configuration information includes: when the business data is full backup data, or the currently selected storage pool determined according to the target pool configuration information fails / is removed, or the currently selected storage pool determined according to the target pool configuration information reaches a storage threshold, it is determined that a storage pool selection operation is required.
[0034] It should be noted that when business data is identified as full backup data, it usually means that this data needs to be stored completely and independently to ensure data security and recoverability. At this time, it is necessary to select a storage pool to ensure the independence of the backup data and avoid potential conflicts or interference with other business data.
[0035] Furthermore, in actual operation, a storage pool may be temporarily or permanently unavailable due to hardware failure, maintenance requirements, or other reasons. At this time, if the system continues to write data to the storage pool, data loss or service interruption will occur. Therefore, by monitoring the status of the currently selected storage pool and triggering the storage pool selection operation when a failure or removal is found, the system can quickly switch to other available storage pools to ensure business continuity and data availability.
[0036] In addition, the capacity of the storage pool is limited. When the amount of data in the selected storage pool approaches or reaches its maximum storage capacity, continuing to write data to the storage pool will cause performance degradation or storage overflow. Therefore, by setting a storage threshold and triggering the storage pool selection operation when the threshold is reached, performance bottlenecks and data loss caused by full storage pools can be avoided, achieving the purpose of optimizing the use efficiency of storage resources, ensuring continuous data writing and stable system operation.
[0037] Based on the above scheme, in some implementations of the present application, the predetermined group selection rule includes: calculating the cost function of storing the business data in each virtual sub-storage pool group according to the characteristic parameters of the business data, and selecting a virtual sub-storage pool group with the smallest cost function according to the calculation result.
[0038] It should be noted that the cost function is a mathematical expression used to quantify the cost or overhead of storing business data in different virtual sub-storage pool groups. This cost can include multiple aspects, such as data transmission delay, storage cost, data access frequency, data importance, etc. Therefore, according to the characteristic parameters of business data (such as data size, access mode, importance, etc.) and the characteristics of virtual sub-storage pool groups (such as geographical location, storage capacity, performance, etc.), the corresponding cost function is designed, and the cost function value of each virtual sub-storage pool group is calculated through the designed cost function. The system can intuitively compare the advantages and disadvantages of different storage pool groups to select the virtual sub-storage pool group with the smallest cost function value, and avoid storing business data in storage pool groups with poor performance or excessively high costs. This will help optimize the configuration of storage resources, improve resource utilization efficiency, reduce data transmission delays, and improve the speed and efficiency of data access.
[0039] Based on the aforementioned scheme, in some implementations of the present application, the predetermined pool selection rules include: when the compression and deduplication functions are turned on in the storage pool, the business data is adjusted and the cost function of storing the business data in each storage pool is calculated, and based on the calculation results, the storage pool with the smallest cost function is selected as the target storage pool.
[0040] It should be noted that compression and deduplication are commonly used optimization technologies in modern storage systems. They can significantly reduce storage space usage and reduce storage costs. In the above implementation, when the storage pool has these functions enabled, the system will make corresponding adjustments to the business data (such as preprocessing to support compression or deduplication) and recalculate the cost function of the business data stored in the storage pool. Because the cost function of business data stored in each storage pool usually considers multiple factors, such as storage cost, performance, reliability, etc., these factors may change after the compression and deduplication functions are enabled. Therefore, before selecting the storage pool with the smallest cost function as the target storage pool, it is necessary to re-evaluate the storage efficiency and cost of the business data in different storage pools, and update the calculation results of the cost function accordingly. In short, by incorporating compression and deduplication functions into the consideration of the pre-selected pool selection rules, not only the storage efficiency is improved and the storage cost is reduced, but also the flexibility of the system and the user experience are enhanced.
[0041] Based on the above solution, in some implementations of the present application, the cost function of the virtual sub-storage pool group includes a cost function of cost weights and a cost function of constraints.
[0042] It should be noted that the cost function of cost weights assigns different weights to various evaluation indicators (such as storage cost, performance, reliability, latency, etc.) according to different business needs and storage pool characteristics, and calculates the comprehensive cost based on these weights. The cost function of constraints is used to represent specific conditions or restrictions that must be met during the storage selection process. These conditions may include storage capacity restrictions, geographical location requirements, data access permissions, network traffic, etc.
[0043] In the present application, the cost function of a virtual sub-storage pool group is defined as follows: when specified business data (such as a shard data of a distributed database) is written into a virtual sub-storage pool group, if writing into a virtual sub-storage pool group can minimize the cost function value, then the virtual sub-storage pool group is the target virtual sub-storage pool group this time.
[0044] The definition is described by the data formula: f cost represents the cost function of the virtual sub-storage pool group, d Represents business data, spg i Indicates the serial number is i The virtual sub-storage pool group of The target virtual sub-storage pool group is such that the above formula is true, that is: .in arg Indicates the appropriate subscript parameter selected.
[0045] Therefore, in some implementations of the present application, the calculation formula of the cost function of the virtual sub-storage pool group includes: in, p cost The cost function represents the cost weight, c cost Represents the cost function of the constraint.
[0046] Since the cost weight is based on the deployment and planning of the user data center and is configured and updated by the user in the storage pool group and business data pre-configuration, the cost function can be defined as: in, and Respectively indicate the serial number i and jThe cost weight of the virtual sub-storage pool group. Since the resource utilization of the storage pools in the virtual sub-storage pool group will be kept as balanced as possible when selecting the target storage pool according to the predetermined pool selection rule, it is a reasonable simplification that the constraint cost function of the virtual sub-storage pool group only depends on the storage pool with the largest remaining storage space in the group. Indicates the serial number is i The storage pool with the largest remaining storage space in the virtual sub-storage pool group is the storage pool with the largest remaining storage space. spg i Cost function based on storage pool group The definitions are as follows: in, express Storage usage. α and β The value needs to be based on the virtual sub-storage pool group i The cost weight is set. Generally, ; When the storage usage of all storage pools in the sub-storage pool group is greater than 80% and less than 100%, β =0, otherwise The role of these weighted coefficients is to amplify the cost piecewise linearly according to the cost weight. The greater the storage usage exceeds the limit, the greater the amplification. When the storage usage is not higher than 80%, it can be considered that the storage usage does not incur a cost; when the storage usage is higher than 80% and does not exceed 100%, the excess storage usage can be amplified. β times; when the storage usage is higher than 100%, the excess storage usage can be magnified α times.
[0047] Similarly, the sub-storage pool group spg i Cost function based on storage resources The processing is still simplified. Indicates a sub-storage pool The storage resource where it is located is defined as follows. in, For storage resources Storage utilization. Definition and Consistent.
[0048] Therefore, the total constraint cost function is as follows:
[0049] In summary, this application provides a configuration method for storage pool groups across data centers based on theoretical foundations and combined with actual production experience, on the premise that the physical storage location of business data (backup or replication of production data) in the data center meets the computing, storage resources and network planning of the user data center. This method uses the characteristics of the user data center such as computing, storage resources and network planning, as well as the storage capacity utilization rate, to evolve performance calculation formulas for cost weights and constraint costs, and combines them to obtain the final solution. Compared with other solutions, this solution can better meet the requirements of storage pool group data in the generation environment to meet planning requirements, and to be as dispersed as possible and balanced in throughput.
[0050] Example 2 The embodiment of the present application provides a configuration system for a storage pool group across data centers, which includes: The acquisition module is used to acquire characteristic parameters of business data and target pool configuration information. The judgment module is used to judge whether a storage pool selection operation is required based on the characteristic parameters of the business data and the target pool configuration information; if so, the storage pool selection step is entered; otherwise, the business data is stored in the currently selected storage pool according to the target pool configuration information. The pool selection module is used to execute the storage pool selection step: in response to the storage pool selection instruction, when the number of virtual sub-storage pool groups is one, a target storage pool is selected from them according to a predetermined pool selection rule; when the number of virtual storage pool groups is multiple, a virtual sub-storage pool group is first selected from them according to the predetermined group selection rule, and then a target storage pool is selected from the selected virtual sub-storage pool group according to the predetermined pool selection rule; wherein the virtual sub-storage pool group is a storage pool group formed according to the physical location of the storage pool and the physical location of the business data storage; the predetermined pool selection rule is obtained according to the cost function of the storage pool, and the predetermined group selection rule is obtained according to the cost function of each virtual sub-storage pool group.
[0051] For the specific implementation process of the above system, please refer to the configuration method of a storage pool group across data centers provided in Example 1, which will not be repeated here.
[0052] Example 3 See also Figure 6 , the embodiment of the present application provides an electronic device, which includes at least one processor 201 and at least one memory 202; wherein the processor 201 and the memory 202 are directly connected to each other, or communicate with each other through a communication interface 203, or are electrically connected through one or more communication buses or signal lines to achieve data transmission or interaction; the memory 202 stores program instructions that can be executed by the processor 201, and the processor 201 calls the program instructions to execute a configuration method for a storage pool group across data centers. For example, the following is implemented: Obtain characteristic parameters of business data and target pool configuration information. Determine whether a storage pool selection operation is required based on the characteristic parameters of the business data and the target pool configuration information; if so, enter the storage pool selection step; otherwise, store the business data into the currently selected storage pool based on the target pool configuration information. Storage pool selection step: In response to the storage pool selection instruction, when the number of virtual sub-storage pool groups is one, select a target storage pool from them according to a predetermined pool selection rule; when the number of virtual storage pool groups is multiple, first select a virtual sub-storage pool group according to the predetermined group selection rule, and then select a target storage pool from the selected virtual sub-storage pool group according to the predetermined pool selection rule; wherein the virtual sub-storage pool group is a storage pool group formed based on the physical location of the storage pool and the physical location of the business data storage; the predetermined pool selection rule is obtained based on the cost function of the storage pool, and the predetermined group selection rule is obtained based on the cost function of each virtual sub-storage pool group.
[0053] Among them, the memory 202 can be, but is not limited to, a random access memory (RAM), a read only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable read-only memory (EEPROM), etc.
[0054] The processor 201 may be an integrated circuit chip with signal processing capability. The processor 201 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.
[0055] Understandably, Figure 6 The structure shown is for illustration only. The electronic device may also include Figure 6 More or fewer components as shown, or with Figure 6Different configurations are shown. Figure 6 Each component shown in the figure can be implemented by hardware, software or a combination thereof.
[0056] Example 4 The present application provides a computer-readable storage medium having a computer program stored thereon, which implements a method for configuring a storage pool group across data centers when executed by a processor 201. For example, the following is implemented: Obtain characteristic parameters of business data and target pool configuration information. Determine whether a storage pool selection operation is required based on the characteristic parameters of the business data and the target pool configuration information; if so, enter the storage pool selection step; otherwise, store the business data into the currently selected storage pool based on the target pool configuration information. Storage pool selection step: In response to the storage pool selection instruction, when the number of virtual sub-storage pool groups is one, select a target storage pool from them according to a predetermined pool selection rule; when the number of virtual storage pool groups is multiple, first select a virtual sub-storage pool group according to the predetermined group selection rule, and then select a target storage pool from the selected virtual sub-storage pool group according to the predetermined pool selection rule; wherein the virtual sub-storage pool group is a storage pool group formed based on the physical location of the storage pool and the physical location of the business data storage; the predetermined pool selection rule is obtained based on the cost function of the storage pool, and the predetermined group selection rule is obtained based on the cost function of each virtual sub-storage pool group.
[0057] If the above functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, and other media that can store program codes.
[0058] It will be apparent to those skilled in the art that the present application is not limited to the details of the exemplary embodiments described above, and that the present application can be implemented in other specific forms without departing from the spirit or essential features of the present application. Therefore, the embodiments should be considered exemplary and non-limiting in all respects, and the scope of the present application is defined by the appended claims rather than the above description, and it is intended that all changes falling within the meaning and scope of the equivalent elements of the claims be included in the present application. Any reference numeral in a claim should not be considered as limiting the claim to which it relates.
Claims
1. A method for configuring a storage pool group across data centers, It is characterized in that The following steps are involved: Obtain characteristic parameters of business data and target pool configuration information; Determine whether a storage pool selection operation is required based on the characteristic parameters of the business data and the target pool configuration information; if so, proceed to the storage pool selection step; Otherwise, the business data is stored in the currently selected storage pool according to the target pool configuration information; A storage pool selection step: in response to the storage pool selection instruction, when the number of virtual sub-storage pool groups is one, a target storage pool is selected from the virtual sub-storage pool groups according to a predetermined pool selection rule; when the number of virtual storage pool groups is multiple, one virtual sub-storage pool group is first selected from the virtual sub-storage pool groups according to the predetermined group selection rule, and then a target storage pool is selected from the selected virtual sub-storage pool group according to the predetermined pool selection rule; Among them, the virtual sub-storage pool group is a storage pool group formed according to the physical location of the storage pool and the physical location of the business data storage; the predetermined pool selection rule is obtained according to the cost function of the storage pool, and the predetermined group selection rule is obtained according to the cost function of each virtual sub-storage pool group.
2. The method according to claim 1, It is characterized in that The target pool configuration information includes the physical location of the storage pool, the physical location of the business data storage, and the weight of the physical location of the business data storage.
3. The method according to claim 1, It is characterized in that The determining whether a storage pool selection operation is required according to the characteristic parameters of the business data and the target pool configuration information includes: When the business data is full backup data, or the currently selected storage pool determined according to the target pool configuration information fails / is removed, or the currently selected storage pool determined according to the target pool configuration information reaches the storage threshold, it is determined that a storage pool selection operation is required.
4. The method according to claim 1, It is characterized in that The predetermined group selection rules include: The cost function of storing the service data in each virtual sub-storage pool group is calculated according to the characteristic parameters of the service data, so as to select a virtual sub-storage pool group with the minimum cost function according to the calculation result.
5. The method according to claim 1, It is characterized in that The predetermined pool selection rules include: When the compression and deduplication functions are enabled in the storage pool, the business data is adjusted and the cost function of storing the business data in each storage pool is calculated, so as to select the storage pool with the smallest cost function as the target storage pool according to the calculation result.
6. The method according to claim 1, It is characterized in that The cost function of the virtual sub-storage pool group includes a cost function of cost weight and a cost function of constraint conditions.
7. The method according to any one of claims 1 to 6, It is characterized in that The calculation formula of the cost function of the virtual sub-storage pool group includes: in, d Represents business data, spg i Indicates the serial number is i Virtual sub-storage pool group, f cost represents the cost function of the virtual sub-storage pool group, p cost The cost function represents the cost weight, c cost represents the cost function of the constraint, and Respectively indicate the serial number i and j The cost weight of the virtual sub-storage pool group, express spg i Based on the cost function of storage resources, express spg i Based on the cost function of the virtual sub-storage pool group, Indicates the serial number is i The storage pool with the largest remaining storage space in the virtual sub-storage pool group. express Storage utilization, α and β represents the predetermined coefficient, express The storage resource where it is located.
8. A configuration system for storage pool groups across data centers, It is characterized in that include: The acquisition module is used to obtain characteristic parameters of business data and target pool configuration information; A judgment module is used to judge whether a storage pool selection operation is required based on characteristic parameters of business data and target pool configuration information; if so, entering a storage pool selection step; Otherwise, the business data is stored in the currently selected storage pool according to the target pool configuration information; A pool selection module is used to execute a storage pool selection step: in response to a storage pool selection instruction, when the number of virtual sub-storage pool groups is one, a target storage pool is selected from the virtual sub-storage pool groups according to a predetermined pool selection rule; when the number of virtual storage pool groups is multiple, a virtual sub-storage pool group is first selected from the virtual sub-storage pool groups according to the predetermined group selection rule, and then a target storage pool is selected from the selected virtual sub-storage pool group according to the predetermined pool selection rule; wherein the virtual sub-storage pool group is a storage pool group formed according to the physical location of the storage pool and the physical location of the business data storage; the predetermined pool selection rule is obtained according to the cost function of the storage pool, and the predetermined group selection rule is obtained according to the cost function of each virtual sub-storage pool group.
9. An electronic device, It is characterized in that include: A memory for storing one or more programs; processor; When the one or more programs are executed by the processor, the method according to any one of claims 1 to 7 is implemented.
10. A computer-readable storage medium having a computer program stored thereon, It is characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.
Citation Information
Patent Citations
Method and apparatus to improve efficiency in the use of resources in data center
CN102955675A
Cloud data system, cloud data center, and resource management method of the cloud data center
CN103986741A
Specification device selecting method for cross-data center cloud computing system
CN106126340A
Resource supply method of cross-data center cloud computing system
CN106209975A
Method and device for distributing virtual machines of virtual network elements distributed across data centers
CN110347473A
