Data copy configuration method and device for multiple machine rooms, medium, equipment and product
By obtaining the meta information and historical traffic information of the file directory, and generating and filtering data copy adjustment strategies, the problem of inefficient data copy adjustment in multi-computer room deployment is solved, and the optimal configuration of data copy deployment is achieved.
Patent Information
- Application Number
- CN202411179733.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-26
- Publication Date
- 2024-12-13
AI Technical Summary
In distributed file systems deployed in multi-computer room, manual adjustment of data copies is inefficient and ineffective, making it difficult to optimize performance and cost.
By obtaining the meta-information and historical traffic information of the file directory, an alternative replica adjustment strategy is generated, the potential benefits of each strategy are predicted, and the optimal target strategy is filtered out to optimize the deployment method of data replicas.
It realizes accurate optimization of the data copy deployment method, improves adjustment efficiency and effect, and ensures the optimal data copy configuration in a multi-computer room environment.
Smart Images

Figure CN119127794A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of computer technology, and in particular to a method, device, medium, equipment and product for configuring data copies in multiple computer rooms. Background Art
[0002] With the rapid growth of data volume and the increasing demand for distributed computing, the HDFS has become one of the infrastructures for large-scale data storage and processing. The HDFS has high availability, high fault tolerance and high performance through data sharding and multi-computer room deployment.
[0003] Generally speaking, in a distributed file system deployed in multiple computer rooms, data is configured in different computer rooms in the form of multiple data copies. Therefore, in a distributed file system in multiple computer rooms, how to deploy data copies in multiple computer rooms has a significant impact on the cost.
[0004] In the related art, staff generally manually adjust the data copies of individual file directories in the distributed file system based on data access patterns and traffic analysis to optimize the performance and cost of the distributed file system. For example, the number of data copies of hot data can be increased, the number of data copies of cold data can be reduced, or the file directory can be copied to a computer room where computing tasks are intensively accessed. However, this manual adjustment of data copies is inefficient and has poor adjustment effects. Summary of the invention
[0005] This summary is provided to introduce concepts in a brief form that will be described in detail in the detailed description below. This summary is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.
[0006] In a first aspect, the present disclosure provides a method for configuring data copies in multiple computer rooms, comprising: Obtaining meta information of a file directory historically accessed by each computer room in a multi-computer room environment and historical traffic information for the file directory; Generate multiple alternative copy adjustment strategies according to the deployment mode of the data copy of the file directory in the multi-computer room environment in the meta-information of the file directory; Predicting potential benefits of executing each replica adjustment strategy according to the meta information and the historical traffic information, wherein the potential benefits include potential traffic benefits and potential storage benefits; According to the potential benefits corresponding to each of the replica adjustment strategies, a target replica adjustment strategy is obtained by screening from the plurality of replica adjustment strategies; The deployment mode of the data copy corresponding to the file directory in the multi-computer room environment is controlled according to the target copy adjustment strategy.
[0007] In a second aspect, the present disclosure provides a data replica configuration device for multiple computer rooms, comprising: An acquisition module is configured to acquire meta information of a file directory historically accessed by each computer room in a multi-computer room environment and historical traffic information for the file directory; A strategy generation module is configured to generate a plurality of alternative copy adjustment strategies according to the deployment mode of the data copy of the file directory in the multi-computer room environment in the meta information of the file directory; A prediction module, configured to predict potential benefits of executing each replica adjustment strategy according to the meta information and the historical traffic information, wherein the potential benefits include potential traffic benefits and potential storage benefits; A screening module is configured to screen a target replica adjustment strategy from the plurality of replica adjustment strategies according to the potential benefit corresponding to each replica adjustment strategy; The control module is configured to control the deployment mode of the data copy corresponding to the file directory in the multi-computer room environment according to the target copy adjustment strategy.
[0008] In a third aspect, the present disclosure provides a computer-readable medium having a computer program stored thereon, which, when executed by a processing device, implements the steps of the method described in the first aspect.
[0009] In a fourth aspect, the present disclosure provides an electronic device, including: a storage device having a computer program stored thereon; A processing device is used to execute the computer program in the storage device to implement the steps of the method described in the first aspect.
[0010] In a fifth aspect, the present disclosure provides a computer program product, including a computer program, which implements the steps of the method described in the first aspect when executed by a processor.
[0011] Based on the above technical solution, by obtaining the metadata and historical traffic information of the file directory, multiple alternative copy adjustment strategies are generated according to the deployment method of the data copies of the file directory in the metadata of the file directory in a multi-computer room environment, and the potential benefits of executing each copy adjustment strategy are predicted based on the metadata and historical traffic information. According to the potential benefits corresponding to each copy adjustment strategy, a target copy adjustment strategy is screened from multiple copy adjustment strategies, and then the deployment method of the data copies corresponding to the file directory in the multi-computer room environment is controlled according to the target copy adjustment strategy. The potential benefits of the copy adjustment strategies corresponding to each file directory can be accurately calculated, so that the optimal target copy adjustment strategy can be selected according to the benefits, so that the deployment method of the data copies can be optimized.
[0012] Other features and advantages of the present disclosure will be described in detail in the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS
[0013] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale. In the drawings: Figure 1 It is a flowchart of a method for configuring data copies in multiple computer rooms according to some embodiments.
[0014] Figure 2 The diagram is a schematic structural diagram of a device for configuring data replicas in multiple computer rooms according to an exemplary embodiment.
[0015] Figure 3 It is a schematic structural diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION
[0016] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.
[0017] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.
[0018] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.
[0019] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.
[0020] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".
[0021] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.
[0022] Figure 1 FIG. 1 is a flow chart of a method for configuring data copies in multiple computer rooms according to some embodiments. Figure 1 As shown, the embodiment of the present disclosure provides a method for configuring data copies in multiple computer rooms. The method can be executed by an electronic device, and specifically can be executed by a device for configuring data copies in multiple computer rooms. The device can be implemented by software and / or hardware and configured in an electronic device. Figure 1 As shown, the method may include the following steps.
[0023] In step 110, the meta information of the file directories historically accessed by each computer room in the multi-computer room environment and the historical traffic information for the file directories are obtained.
[0024] Here, a multi-computer room environment refers to having multiple computer rooms in a computer infrastructure. For example, in a distributed file system, the distributed file system has multiple computer rooms distributed in different geographical locations as data centers.
[0025] The file directory historically accessed by the computer room refers to the file directory where the data required by the computing tasks in the computer room are located. Of course, the file directory can also be understood as the access path of the computer room. The computing tasks in the computer room access the corresponding file directory through the access path to obtain the required data.
[0026] The metadata of a file directory may include the size of the files in the file directory, the creation time of the files, and the deployment method of the data copies of the file directory in a multi-computer room environment. The creation time of the files can be used to determine the data used for subsequent calculation of potential benefits. The deployment method of the data copies of the file directory in a multi-computer room environment can be used to determine the copy adjustment strategy in the future. For example, Indicates the file directory In the machine room There is a copy of the data in the computer room There are two copies of the data.
[0027] The historical traffic information of the computer room for the file directory may refer to the size of the historical access traffic of the computing tasks in the computer room for each file directory. Exemplarily, the historical traffic information for different historical time periods can be obtained in different ways. For example, for a file directory with a creation date of 30 days ago, the historical traffic information can be directly read from the monitoring log of the computer room, and for a file directory with a creation date of 1 day ago, the historical traffic information can be calculated by the historical traffic information 30 days ago. For example, for the access path of / x0 / x1 / ... / xl / date={20540716} / hour=12, the date in the access path can be replaced with the date 30 days ago, such as / x0 / x1 / ... / xl / date={20540616} / hour=12, and then the traffic information of the past 30 days is queried to obtain the historical traffic information of the access path such as / x0 / x1 / ... / xl / date={20540616} / hour=12 and other computer rooms in the past 30 days, so as to estimate the traffic of the computer room in the future based on the historical traffic information.
[0028] In step 120, multiple candidate copy adjustment strategies are generated according to the deployment mode of the data copies of the file directory in the meta-information of the file directory in the multi-computer room environment.
[0029] Here, since the metadata of the file directory includes the deployment method of the data copies of the file directory in a multi-computer room environment, for each file directory, the deployment method of the data copies of the file directory in the multi-computer room environment can be adjusted according to the deployment method of the data copies, and all possible copy adjustment strategies for the file directory are generated.
[0030] The replica adjustment strategy is used to increase or decrease the data replicas of the deployment file directory in the target computer room in a multi-computer room environment. Increasing the data replica of the deployment file directory in the target computer room means deploying the data replica of the file directory in a computer room that lacks the data replica of the file directory. Reducing the data replica of the deployment file directory in the target computer room means deleting the data replica of the file directory in a computer room that already has the data replica of the file directory.
[0031] It should be understood that, depending on different requirements, the replica adjustment strategy may also be different, and the target computer room for each replica adjustment strategy may also be different.
[0032] For example, assuming that there are computer rooms A, B, and C in a multi-computer room environment, and the meta information indicates that data copies of file directory D are deployed in computer rooms A and B, then for the scenario of adding data copies of deployment file directory D, the existing copy adjustment strategies include: adding data copies of deployment file directory D in computer room C. For the scenario of reducing data copies of deployment file directory D, the existing copy adjustment strategies include: reducing data copies of deployment file directory D in computer room A and / or computer room B.
[0033] In step 130, the potential benefit of executing each replica adjustment strategy is predicted based on the meta information and historical traffic information, and the potential benefit includes potential traffic benefit and potential storage benefit.
[0034] Here, potential benefits refer to the expected benefits that a multi-computer room environment can bring when the replica adjustment strategy is executed. Among them, potential benefits include storage benefits and traffic benefits. Storage benefits represent the storage space that can be reduced in a multi-computer room environment, and traffic benefits represent the cross-computer room traffic that can be reduced in a multi-computer room environment.
[0035] Since computing tasks in a computer room will first go to the nearest computer room to obtain data, when a data copy corresponding to a deployment file directory is added in a computer room, the computing tasks of the computer room change from the original need to obtain data copies across computer rooms to obtaining data copies from the local computer room, which correspondingly reduces the cross-computer room traffic, but also increases the use of storage space. When reducing the data copies corresponding to the deployment file directory in a computer room, the computing tasks of the computer room change from the original need to obtain data copies from the local computer room to obtaining data copies across computer rooms, which correspondingly increases the cross-computer room traffic, but also reduces the use of storage space.
[0036] It should be understood that the values of potential storage income and potential flow income can be positive or negative. When the values of potential storage income and potential flow income are positive, it means that they can bring positive potential storage income and potential flow income. When the values of potential storage income and potential flow income are negative, it means that they can bring negative potential storage income and potential flow income. For example, when the potential storage income is negative, it means that the storage space will be increased, and when the potential storage income is positive, it means that the storage space will be reduced.
[0037] It should be noted that since data copies may be distributed in multiple different computer rooms, the computer room where the computing task is located may be different from the computer room where the data that the computing task needs to read is located. In this case, the computing task needs to obtain the required data through cross-computer room communication. Generally speaking, the cost of cross-computer room communication is higher than the cost of communication within the same computer room. In this case, by increasing the number of data copies and reasonably deploying the data copies in each computer room, the cross-computer room traffic can be significantly saved. However, increasing the number of data copies will also increase the storage cost accordingly.
[0038] For each generated replica adjustment strategy, the potential storage benefit and potential traffic benefit brought by the execution of the replica adjustment strategy are predicted through metadata and historical traffic information, so as to comprehensively weigh the potential storage benefit and potential traffic benefit to determine whether to execute the replica adjustment strategy.
[0039] In step 140 , a target replica adjustment strategy is obtained by screening from multiple replica adjustment strategies according to the potential benefits corresponding to each replica adjustment strategy.
[0040] Here, after obtaining the potential benefit of each replica adjustment strategy, at least one replica adjustment strategy may be selected from a plurality of candidate replica adjustment strategies as a target replica adjustment strategy.
[0041] It is worth noting that when selecting the target replica adjustment strategy based on potential benefits, the potential storage benefits and potential traffic benefits corresponding to each replica adjustment strategy can be comprehensively weighed, so that the selected target replica adjustment strategy can reduce the cross-computer room traffic more with a smaller increase in storage cost, or increase the cross-computer room traffic less with a larger reduction in storage cost.
[0042] In step 150, the deployment mode of the data replica corresponding to the control file directory in the multi-computer room environment is adjusted according to the target replica strategy.
[0043] Here, after obtaining the target copy adjustment strategy, the deployment mode of the data copy of the file directory in the multi-computer room environment can be adjusted by the target copy adjustment strategy. For example, if the target copy adjustment strategy is to add a data copy of the deployed file directory D in computer room C, then a data copy of the file directory D is added in computer room C.
[0044] It should be understood that, when the target copy adjustment strategy is to increase the data copy of the deployed file directory in the target computer room of the multi-computer room environment, the data copy of the file directory can be deployed in the target computer room by means of temporary caching. When the target copy adjustment strategy is to reduce the data copy of the deployed file directory in the target computer room of the multi-computer room environment, the data copy of the file directory deployed in the target computer room can be reduced in the target computer room by means of EC (Erasure coding).
[0045] It is worth noting that the above steps 110 to 150 can be performed periodically to timely adjust the deployment mode of the data copies of the file directory in the multi-computer room environment according to the changes in the multi-computer room environment. For example, the above steps 110 to 150 can be performed at least once a day to adjust the deployment mode of the data copies of the file directory in the multi-computer room environment.
[0046] Therefore, by obtaining the metadata and historical traffic information of the file directory, multiple alternative replica adjustment strategies are generated according to the deployment mode of the data copies of the file directory in the metadata of the file directory in the multi-computer room environment, and the potential benefit of executing each replica adjustment strategy is predicted based on the metadata and historical traffic information. According to the potential benefit corresponding to each replica adjustment strategy, a target replica adjustment strategy is screened from multiple replica adjustment strategies, and then the deployment mode of the data copies corresponding to the file directory in the multi-computer room environment is controlled according to the target replica adjustment strategy. The potential benefit of the replica adjustment strategy corresponding to each file directory can be accurately calculated, so as to select the optimal target replica adjustment strategy according to the benefit, so that the deployment mode of the data copies can be optimized.
[0047] In some feasible implementations, in step 130, the potential traffic benefit brought by the execution of the replica adjustment strategy is determined based on the historical traffic information of the target computer room targeted by the replica adjustment strategy, and the potential storage benefit brought by the execution of the replica adjustment strategy is determined based on the storage space occupied by the file directory included in the metadata.
[0048] Here, the historical traffic information of the target computer room targeted by the replica adjustment policy refers to the historical traffic information of the computing tasks in the target computer room that access the file directory corresponding to the replica adjustment policy for the file directory. For example, there are computing tasks A, B, and C in the target computer room, computing task A accesses file directory D to obtain data, computing task B accesses file directory D to obtain data, and computing task C accesses file directory E to obtain data. Then the historical traffic information of the replica adjustment policy for file directory D is the historical traffic information of computing tasks A and computing tasks B for file directory D.
[0049] In some embodiments, when the replica adjustment strategy is to add a data replica of the deployment file directory in at least one target computer room in a multi-computer room environment, the potential traffic revenue brought by the execution of the replica adjustment strategy can be calculated by a first calculation formula, and the first calculation formula is:
[0050] in, is the life cycle of the data copy, is the potential traffic revenue of the ith file directory during the life cycle of the data copy, Target computer room Historical traffic information for the dth day of the ith file directory. For example, Indicates the file directory In the Tianyu Machine Room The computational tasks are GB of communication traffic, and the computer room The computational tasks are GB of communication traffic.
[0051] For example, assuming the file directory Data copies are distributed in the computer room and If the replica adjustment strategy is to If a data replica is deployed in , the potential traffic benefit brought by executing the replica adjustment strategy is:
[0052] in, Indicates the target computer room The historical traffic information of the computing tasks for the corresponding file directory.
[0053] It is worth noting that the life cycle of a data copy refers to the deployment time of the data copy in the target data center. For example, the life cycle of a data copy can be 1-30 days. Of course, the life cycle of a data copy can be set according to actual conditions.
[0054] In some embodiments, when the replica adjustment strategy is to add a data replica of the deployment file directory in at least one target computer room in a multi-computer room environment, the potential storage benefit brought by the execution of the replica adjustment strategy can be calculated by a second calculation formula, and the second calculation formula is:
[0055] in, is the potential storage benefit of the replica adjustment strategy corresponding to the i-th file directory, is the size corresponding to the i-th file directory.
[0056] Of course, in other implementations, the potential storage benefit brought by the execution of the replica adjustment strategy may be determined based on the potential traffic benefit corresponding to the replica adjustment strategy and the storage space occupied by the file directory.
[0057] Exemplarily, the potential storage benefit brought by the execution of the replica adjustment strategy can be calculated by a third calculation formula, and the third calculation formula is:
[0058] in, The potential storage gain of the replica adjustment strategy corresponding to the i-th file directory.
[0059] It is worth mentioning that In fact, it indicates how much cross-data center traffic can be saved by the daily storage cost. The larger the value, the greater the potential traffic gain from adding data copies.
[0060] It should be noted that the lifecycle of the additionally deployed data replica can also be calculated by the first calculation formula and the second calculation formula. That is, the lifecycle corresponding to the maximum value in the third calculation formula is the lifecycle of the additionally deployed data replica.
[0061] In some embodiments, when the replica adjustment strategy is to reduce the data replicas of the deployment file directory in the target computer room in a multi-computer room environment, the potential traffic revenue brought by the execution of the replica adjustment strategy can be calculated by a fourth calculation formula, and the fourth calculation formula is:
[0062] in, is the potential traffic benefit of the copy adjustment strategy for the i-th file directory, n is the total number of days of historical traffic information, Target computer room Historical traffic information for the dth day for the ith file directory.
[0063] For example, assuming the file directory Data copies are distributed in the computer room and If the replica adjustment strategy is to After reducing the data copies, the traffic of all remaining data copies will flow to the same computer room. The potential traffic benefit brought by the execution of the copy adjustment strategy is:
[0064] in, Indicates the target computer room The historical traffic information of the computing task for the i-th file directory on the d-th day.
[0065] It is worth noting that the total number of days n can be determined based on the acquired historical traffic information. For example, in the embodiment of the present disclosure, the historical traffic information 30 days ago can be acquired, and accordingly, the total number of days n of the historical traffic information is 30 days.
[0066] In some embodiments, when the replica adjustment strategy is to reduce the data replicas of the file directory in at least one target computer room in a multi-computer room environment, the potential storage benefit brought by the execution of the replica adjustment strategy can be calculated by the fifth calculation formula, and the fifth calculation formula is:
[0067] in, is the potential storage benefit of the replica adjustment strategy corresponding to the i-th file directory, is the size corresponding to the i-th file directory.
[0068] That is to say, after reducing the deployment of one data copy, the potential storage benefit brought about is the reduction in the size of the deployed data copy.
[0069] pass and It can represent the impact of the replica adjustment strategy corresponding to the i-th file directory on the cross-computer room traffic and the potential storage benefits corresponding to the storage space after the data replica is eliminated.
[0070] Therefore, through the above implementation, the potential benefits of the replica adjustment strategy can be accurately calculated, and each replica adjustment strategy can be evaluated, thereby providing an accurate data basis for the screening of replica adjustment strategies.
[0071] In some feasible implementations, in step 140, a replica adjustment strategy whose potential benefit meets preset conditions can be selected from the replica adjustment strategies as a candidate replica adjustment strategy, and a target replica adjustment strategy can be determined from the candidate replica adjustment strategies based on the potential benefit.
[0072] Here, for different types of replica adjustment strategies, the corresponding preset conditions may be different. The preset conditions are used to screen replica adjustment strategies whose potential benefits can meet the requirements from the replica adjustment strategies as candidate replica adjustment strategies.
[0073] For example, when the replica adjustment strategy is to add a data replica of a file directory in a target computer room in a multi-computer room environment, the preset condition may be: The replica resizing strategy is not considered and / or The replica adjustment strategy of is not considered. as well as The replica adjustment strategy is determined as a candidate replica adjustment strategy.
[0074] It is worth mentioning that It can be understood that the potential traffic benefits achieved by executing the corresponding replica adjustment strategy are small. The above preset conditions are only some examples. In actual application, the preset conditions can also be set according to actual conditions.
[0075] When the replica adjustment strategy is to reduce the data replicas of the file directory in the target computer room in a multi-computer room environment, the preset conditions may be: The replica resizing strategy is not considered and / or The replica adjustment strategy of is not considered. In other words, and The replica adjustment strategy is determined as a candidate replica adjustment strategy.
[0076] It is worth mentioning that It can be understood that after executing the corresponding replica adjustment strategy, reducing data replicas will generate a large amount of cross-data center traffic. It can be understood that the potential storage benefits brought by executing the corresponding replica adjustment strategy are small. The above preset conditions are only some examples. In the actual application process, the preset conditions can also be set according to the actual situation.
[0077] In some embodiments, when the replica adjustment strategy is to reduce the number of data copies of a deployed file directory in at least one target computer room in a multi-computer room environment, it is also possible to select from the replica adjustment strategies a replica adjustment strategy whose historical access times are not greater than a preset threshold and whose potential benefits meet preset conditions based on the target computer room's historical access times for the file directory as a candidate replica adjustment strategy.
[0078] The historical access count may refer to the number of times a file directory is accessed by a computing task in a computer room. For example, the historical access count may refer to the number of times a file directory is accessed by a computing task in the past 30 days. The historical access count of a file directory in a target computer room refers to the number of times a data copy in the target computer room targeted by a copy adjustment strategy is accessed by computing tasks in other computer rooms.
[0079] Exemplarily, the number of historical accesses corresponding to the replica adjustment strategy can be calculated using the sixth calculation formula, which is:
[0080] in, The historical access count of the copy adjustment strategy corresponding to the i-th file directory, is the historical access count of the ith file directory on the dth day. For example, Indicates the file directory exist The page was visited 100 times per day.
[0081] When the replica adjustment strategy is to reduce the data replicas of the deployment file directory in at least one target computer room in a multi-computer room environment, the preset condition may be: The replica resizing strategy is not considered and / or The replica resizing strategy is not considered and / or The replica adjustment strategy of is not considered. In other words, , and The replica adjustment strategy is determined as a candidate replica adjustment strategy.
[0082] It should be understood that It can be understood that the data copies reduced by the replica adjustment strategy will be frequently accessed by computing tasks. If the replica adjustment strategy is executed to reduce the deployment of corresponding data copies, it will bring a large amount of cross-computer room traffic and increase communication costs.
[0083] Therefore, through the above implementation, the replica adjustment strategies can be filtered, and the replica adjustment strategies whose potential benefits do not meet the preset conditions can be excluded, so as to reduce the subsequent calculation amount and increase the accuracy of the selected target replica adjustment strategy.
[0084] In some feasible implementations, in step 140, based on the potential benefits corresponding to each of the multiple replica adjustment strategies, a set of target replica adjustment strategies that satisfies the benefit condition of maximizing the objective function can be determined within a given objective function and constraints.
[0085] Here, the target replica adjustment strategy set includes at least one replica adjustment strategy, that is, one or more target replica adjustment strategies are selected from all candidate replica adjustment strategies through a given objective function and constraint conditions.
[0086] The objective function is used to maximize the sum of the benefit conditions of the selected target replica adjustment strategy set under the constraints. The objective function and the constraints can comprehensively weigh the potential storage benefits and potential traffic benefits corresponding to each replica adjustment strategy, so that the selected target replica adjustment strategy can reduce more cross-computer room traffic with a smaller increase in storage cost, or reduce more cross-computer room traffic with a smaller increase in storage cost.
[0087] Exemplarily, the objective function is used to maximize the sum of the potential benefits of the selected target replica adjustment strategy under the constraints. For different types of replica adjustment strategies, the corresponding objective functions and constraints may be different. In other words, the potential benefits corresponding to the objective function may be maximizing the potential traffic benefits or maximizing the potential storage benefits.
[0088] In some embodiments, when the replica adjustment strategy is to add a data replica of the deployment file directory in at least one target computer room in a multi-computer room environment, the benefit condition of the objective function is the sum of the potential traffic benefits of the replica adjustment policies included in the target replica adjustment strategy set, and the constraint condition is that the sum of the storage space added by the replica adjustment policies included in the target replica adjustment strategy set does not exceed the preset storage capacity.
[0089] Among them, when the replica adjustment strategy is to add a data replica of the deployment file directory in at least one target computer room in a multi-computer room environment, it is assumed that the potential benefits corresponding to the candidate replica adjustment strategy determined by the above implementation method are as shown in Table 1.
[0090] Table 1:
[0091] Since adding more data replicas will increase the storage cost of a multi-computer room environment, the increase in storage space caused by adding more data replicas can be constrained not to exceed the preset storage capacity. If the preset storage capacity is exceeded, the storage space of the multi-computer room environment may be insufficient due to the addition of data replicas. Therefore, the target replica adjustment strategy can be selected in the replica adjustment strategy for adding data replicas of a file directory through the corresponding objective function and constraint conditions.
[0092] Among them, the objective function can be: , the constraints can be: and ,in, is a decision variable, which is used to indicate whether the replica adjustment strategy corresponding to the i-th file directory can be used as the target replica adjustment strategy. It means that the corresponding replica adjustment strategy will add a data replica, and S is the preset storage capacity.
[0093] It is worth noting that the constraints Indicates that the total amount of storage space increased by all selected replica adjustment strategies does not exceed the preset storage capacity. The objective function Used to maximize savings in cross-machine room traffic.
[0094] Through the mathematical programming solution algorithm, the corresponding The value of The replica adjustment strategy of is determined as the target replica adjustment strategy. For example, at least one replica adjustment strategy can be determined from Table 1 as the target replica adjustment strategy through the objective function and the constraint condition.
[0095] In some embodiments, when the replica adjustment strategy is to reduce data copies of the deployment file directory in at least one target computer room in a multi-computer room environment, the benefit condition of the objective function is the sum of the potential storage benefits of the replica adjustment policies included in the target replica adjustment strategy set, and the constraint condition is that the sum of the increased cross-computer room traffic caused by the replica adjustment policies included in the target replica adjustment strategy set does not exceed a preset traffic threshold.
[0096] Among them, when the replica adjustment strategy is to reduce the data copies of the deployment file directory in the target computer room in the multi-computer room environment, it is assumed that the potential benefits corresponding to the candidate replica adjustment strategies determined by the above implementation method are as shown in Table 2.
[0097] Table 2:
[0098] Since reducing the number of deployed data copies will increase the cross-computer room traffic in the multi-computer room environment, thereby increasing the bandwidth policy cost, the increase in cross-computer room traffic caused by reducing the number of data copies can be constrained not to exceed the preset traffic threshold. If this preset traffic threshold is exceeded, the reduction in data copy deployment may cause bandwidth pressure to the multi-computer room environment. Therefore, the target copy adjustment strategy can be selected in the copy adjustment strategy for adding data copies of the file directory through the corresponding objective function and constraint conditions.
[0099] Among them, the objective function can be: , the constraints can be: ,in, is a decision variable used to indicate whether the replica adjustment strategy corresponding to the i-th file directory can be used as the target replica adjustment strategy, and T is the preset traffic threshold.
[0100] It is worth noting that the constraints It is used to limit the increase in cross-machine room traffic caused by reducing the deployment of data copies to not exceed the preset traffic threshold. Used to minimize the storage space saved by data copy deployment.
[0101] Through the mathematical programming algorithm, the corresponding The value of The replica adjustment strategy of is determined as the target replica adjustment strategy. For example, at least one candidate replica adjustment strategy can be determined from Table 2 as the target replica adjustment strategy through the objective function and the constraint condition.
[0102] Therefore, through the above implementation, the increased cost during the replica adjustment process can be controlled through the objective function and constraints, and the benefits brought by the replica adjustment can be maximized at the same time, thereby achieving dual optimization of storage cost and bandwidth cost.
[0103] In some feasible implementations, in step 150, multiple target copy adjustment strategies can be sorted in descending order of potential benefits to obtain the sorted target copy adjustment strategies, and based on the sorted target copy adjustment strategies, the deployment methods of the data copies of the corresponding file directories in the multi-computer room environment are controlled in turn.
[0104] Here, after determining the target copy adjustment policy set including multiple copy adjustment policies from the copy adjustment policies, since the multi-computer room environment may change, resulting in the inability to execute all target copy adjustment policies included in the target copy adjustment policy set, all target copy adjustment policies included in the target copy adjustment policy set can be sorted to obtain the sorted target copy adjustment policies, and according to the sorted target copy adjustment policies, the target copy adjustment policies are executed in sequence to adjust the deployment method of the data copies of the corresponding file directories in the multi-computer room environment.
[0105] When the replica adjustment strategy is to add a data replica of the deployment file directory in the target computer room in a multi-computer room environment, the selected target replica adjustment strategies can be sorted in descending order of potential storage benefits. For example, The selected target replica adjustment strategies are sorted in descending order to preferentially execute the target replica adjustment strategy with the greatest potential storage benefit.
[0106] When the replica adjustment strategy is to reduce the number of data replicas of the deployment file directory in the target data center in a multi-data center environment, the selected target replica adjustment strategies can be sorted in descending order of potential storage benefits. For example, The selected target replica adjustment strategies are sorted in descending order to preferentially execute the target replica adjustment strategy with the greatest potential storage benefit.
[0107] Therefore, through the above implementation, the target replica adjustment strategy with the greatest benefit can be executed first, so as to ensure that the maximum benefit can be achieved when all target replica adjustment strategies cannot be fully executed. For example, assuming that 10 target replica adjustment strategies are selected from 100 replica adjustment strategies, when executing the target replica adjustment strategies, due to changes in the multi-computer room environment, after executing some target replica adjustment strategies, other target replica adjustment strategies may no longer be executed. By sorting in descending order of potential benefits, it can be ensured that the target replica adjustment strategy with the greatest benefit is executed first.
[0108] Figure 2 FIG. 1 is a schematic diagram showing a structure of a data replica configuration device for multiple computer rooms according to an exemplary embodiment. Figure 2 As shown, the embodiment of the present disclosure provides a data copy configuration device 200 for multiple computer rooms, and the data copy configuration device 200 for multiple computer rooms includes: The acquisition module 201 is configured to acquire the meta information of the file directory historically accessed by each computer room in a multi-computer room environment and the historical traffic information for the file directory; A policy generation module 202 is configured to generate a plurality of alternative copy adjustment policies according to the deployment mode of the data copy of the file directory in the meta information of the file directory in the multi-computer room environment; The prediction module 203 is configured to predict the potential benefit of executing each replica adjustment strategy according to the meta information and the historical traffic information, wherein the potential benefit includes potential traffic benefit and potential storage benefit; A screening module 204 is configured to screen a target replica adjustment strategy from the plurality of replica adjustment strategies according to the potential benefit corresponding to each replica adjustment strategy; The control module 205 is configured to control the deployment mode of the data replica corresponding to the file directory in the multi-computer room environment according to the target replica adjustment strategy.
[0109] Optionally, the screening module 204 is specifically configured to: Based on the potential benefits corresponding to each of the multiple replica adjustment strategies, within the given objective function and constraints, a set of target replica adjustment strategies that meets the condition of maximizing the benefit of the objective function is determined, and the target replica adjustment strategy set includes at least one of the replica adjustment strategies.
[0110] Optionally, in the case where the replica adjustment strategy is to deploy an additional data replica of the file directory in at least one target computer room in the multi-computer room environment, the benefit condition of the objective function is the sum of potential traffic benefits of the replica adjustment strategies included in the target replica adjustment strategy set, and the constraint condition is that the sum of storage space added by the replica adjustment strategies included in the target replica adjustment strategy set does not exceed a preset storage capacity; When the replica adjustment strategy is to reduce the deployment of data replicas of the file directory in at least one target computer room in the multi-computer room environment, the benefit condition of the objective function is the sum of the potential storage benefits of the replica adjustment strategies included in the target replica adjustment strategy set, and the constraint condition is that the sum of the increased cross-computer room traffic caused by the replica adjustment strategies included in the target replica adjustment strategy set does not exceed a preset traffic threshold.
[0111] Optionally, the prediction module 203 is specifically configured as follows: Determine potential traffic benefits brought by the execution of the replica adjustment strategy according to historical traffic information of the target computer room targeted by the replica adjustment strategy; According to the storage space occupied by the file directory included in the meta information, the potential storage benefit brought by the execution of the replica adjustment strategy is determined.
[0112] Optionally, the prediction module 203 is specifically configured as follows: When the replica adjustment strategy is to deploy additional data replicas of the file directory in at least one target computer room in the multi-computer room environment, the potential storage benefit brought by the execution of the replica adjustment strategy is determined based on the potential traffic benefit corresponding to the replica adjustment strategy and the storage space occupied by the file directory.
[0113] Optionally, the screening module 204 is specifically configured to: Selecting a replica adjustment strategy whose potential benefit meets a preset condition from the replica adjustment strategies as a candidate replica adjustment strategy; According to the potential benefits, a target replica adjustment strategy is obtained by screening from the candidate replica adjustment strategies.
[0114] Optionally, the screening module 204 is specifically configured to: In the case where the replica adjustment strategy is to reduce the deployment of data replicas of the file directory in at least one target computer room in the multi-computer room environment, based on the number of historical accesses to the file directory by the target computer room and the potential benefit, a replica adjustment strategy whose historical number of accesses is not greater than a preset number threshold and whose potential benefit meets the preset condition is selected from the replica adjustment strategies as the candidate replica adjustment strategy.
[0115] Optionally, the control module 205 is specifically configured as follows: Sorting the plurality of target replica adjustment strategies in descending order of the potential benefits to obtain sorted target replica adjustment strategies; Based on the sorted target copy adjustment strategy, the deployment mode of the data copies of the corresponding file directories in the multi-computer room environment is controlled in sequence.
[0116] The logic of the method executed by each functional module in the above-mentioned multi-computer room data replica configuration device 200 can refer to the part of the method related to the above-mentioned embodiment, and will not be repeated here.
[0117] Reference below Figure 3, which shows a schematic diagram of the structure of an electronic device (such as a terminal device or a server) 300 suitable for implementing the embodiment of the present disclosure. The terminal device in the embodiment of the present disclosure may include but is not limited to mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 3 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.
[0118] like Figure 3 As shown, the electronic device 300 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 301, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 302 or a program loaded from a storage device 308 to a random access memory (RAM) 303. In the RAM 303, various programs and data required for the operation of the electronic device 300 are also stored. The processing device 301, the ROM 302, and the RAM 303 are connected to each other via a bus 304. An input / output (I / O) interface 305 is also connected to the bus 304.
[0119] Typically, the following devices may be connected to the I / O interface 305: an input device 306 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 307 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 308 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 309. The communication device 309 may allow the electronic device 300 to communicate with other devices wirelessly or by wire to exchange data. Figure 3 The electronic device 300 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.
[0120] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 309, or installed from the storage device 308, or installed from the ROM 302. When the computer program is executed by the processing device 301, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.
[0121] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. Computer readable signal media may also be any computer readable medium other than computer readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.
[0122] In some embodiments, the electronic devices and the various computer rooms can communicate using any currently known or future developed network protocol such as HTTP (HyperTextTransfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.
[0123] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.
[0124] The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the electronic device, the electronic device: obtains the metadata of the file directories historically accessed by each computer room in a multi-computer room environment and the historical traffic information for the file directories; generates multiple alternative copy adjustment strategies based on the deployment method of the data copies of the file directories in the multi-computer room environment in the metadata of the file directory; predicts the potential benefits of executing each of the copy adjustment strategies based on the metadata and the historical traffic information, and the potential benefits include potential traffic benefits and potential storage benefits; according to the potential benefits corresponding to each of the copy adjustment strategies, screens out a target copy adjustment strategy from the multiple copy adjustment strategies; and controls the deployment method of the data copies corresponding to the file directory in the multi-computer room environment according to the target copy adjustment strategy.
[0125] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).
[0126] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0127] The modules involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the name of a module does not, in some cases, limit the module itself.
[0128] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.
[0129] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0130] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.
[0131] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.
[0132] Although the subject matter has been described in language specific to structural features and / or method logic actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims. Regarding the device in the above embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
Claims
1. A method for configuring data copies in multiple computer rooms, characterized in that: include: Obtaining meta information of a file directory historically accessed by each computer room in a multi-computer room environment and historical traffic information for the file directory; Generate multiple alternative copy adjustment strategies according to the deployment mode of the data copy of the file directory in the multi-computer room environment in the meta-information of the file directory; Predicting potential benefits of executing each replica adjustment strategy according to the meta information and the historical traffic information, wherein the potential benefits include potential traffic benefits and potential storage benefits; According to the potential benefits corresponding to each of the replica adjustment strategies, a target replica adjustment strategy is obtained by screening from the plurality of replica adjustment strategies; The deployment mode of the data copy corresponding to the file directory in the multi-computer room environment is controlled according to the target copy adjustment strategy.
2. The method according to claim 1, characterized in that The step of selecting a target replica adjustment strategy from a plurality of replica adjustment strategies according to the potential benefits corresponding to each replica adjustment strategy includes: Based on the potential benefits corresponding to each of the multiple replica adjustment strategies, within the given objective function and constraints, a set of target replica adjustment strategies that meets the condition of maximizing the benefit of the objective function is determined, and the target replica adjustment strategy set includes at least one of the replica adjustment strategies.
3. The method according to claim 2, characterized in that In the case where the replica adjustment strategy is to deploy an additional data replica of the file directory in at least one target computer room in the multi-computer room environment, the benefit condition of the objective function is the sum of the potential traffic benefits of the replica adjustment strategies included in the target replica adjustment strategy set, and the constraint condition is that the sum of the storage space added by the replica adjustment strategies included in the target replica adjustment strategy set does not exceed the preset storage capacity; When the replica adjustment strategy is to reduce the deployment of data replicas of the file directory in at least one target computer room in the multi-computer room environment, the benefit condition of the objective function is the sum of the potential storage benefits of the replica adjustment strategies included in the target replica adjustment strategy set, and the constraint condition is that the sum of the increased cross-computer room traffic caused by the replica adjustment strategies included in the target replica adjustment strategy set does not exceed a preset traffic threshold.
4. The method according to claim 1, characterized in that: The predicting, based on the meta information and the historical traffic information, the potential benefit of executing each replica adjustment strategy includes: Determine potential traffic benefits brought by the execution of the replica adjustment strategy according to historical traffic information of the target computer room targeted by the replica adjustment strategy; According to the storage space occupied by the file directory included in the meta information, the potential storage benefit brought by the execution of the replica adjustment strategy is determined.
5. The method according to claim 4, characterized in that The determining, according to the storage space occupied by the file directory included in the meta information, the potential storage benefit brought by the execution of the replica adjustment strategy includes: When the replica adjustment strategy is to deploy additional data replicas of the file directory in at least one target computer room in the multi-computer room environment, the potential storage benefit brought by the execution of the replica adjustment strategy is determined based on the potential traffic benefit corresponding to the replica adjustment strategy and the storage space occupied by the file directory.
6. The method according to any one of claims 1 to 5, characterized in that The step of selecting a target replica adjustment strategy from a plurality of replica adjustment strategies according to the potential benefits corresponding to each replica adjustment strategy includes: Selecting a replica adjustment strategy whose potential benefit meets a preset condition from the replica adjustment strategies as a candidate replica adjustment strategy; According to the potential benefits, a target replica adjustment strategy is obtained by screening from the candidate replica adjustment strategies.
7. The method according to claim 6, characterized in that The step of selecting the replica adjustment strategy whose potential benefit satisfies a preset condition from the replica adjustment strategies as a candidate replica adjustment strategy includes: In the case where the replica adjustment strategy is to reduce the deployment of data replicas of the file directory in at least one target computer room in the multi-computer room environment, based on the number of historical accesses to the file directory by the target computer room and the potential benefit, a replica adjustment strategy whose historical number of accesses is not greater than a preset number threshold and whose potential benefit meets the preset condition is selected from the replica adjustment strategies as the candidate replica adjustment strategy.
8. The method according to claim 1, characterized in that The method of controlling the deployment of the data replica corresponding to the file directory in the multi-computer room environment according to the target replica adjustment strategy includes: Sorting the plurality of target replica adjustment strategies in descending order of the potential benefits to obtain sorted target replica adjustment strategies; Based on the sorted target copy adjustment strategy, the deployment mode of the data copies of the corresponding file directories in the multi-computer room environment is controlled in sequence.
9. A data copy configuration device for multiple computer rooms, characterized in that: include: An acquisition module is configured to acquire meta information of a file directory historically accessed by each computer room in a multi-computer room environment and historical traffic information for the file directory; A strategy generation module is configured to generate a plurality of alternative copy adjustment strategies according to the deployment mode of the data copy of the file directory in the multi-computer room environment in the meta information of the file directory; A prediction module, configured to predict potential benefits of executing each replica adjustment strategy according to the meta information and the historical traffic information, wherein the potential benefits include potential traffic benefits and potential storage benefits; A screening module is configured to screen a target replica adjustment strategy from the plurality of replica adjustment strategies according to the potential benefit corresponding to each replica adjustment strategy; The control module is configured to control the deployment mode of the data copy corresponding to the file directory in the multi-computer room environment according to the target copy adjustment strategy.
10. A computer readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processing device, the steps of the method according to any one of claims 1 to 8 are implemented.
11. An electronic device, characterized in that: include: a storage device having a computer program stored thereon; A processing device, configured to execute the computer program in the storage device to implement the steps of the method according to any one of claims 1 to 8.
12. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.
Citation Information
Patent Citations
Dynamically adjusting the number of replicas of a file according to the probability that the file will be accessed within a distributed file system
CN104731691A
Method for adjusting distribution of data fragments and data server
CN106933868A
Self-adaptation control method for cost-driven copies
CN108228106A
Big data storage method and system
CN118535652A
