Data replication method, data storage system control method, device, equipment and medium

Abstract

The disclosed embodiment discloses a data replication method, a data storage system control method, an apparatus, a device and a medium, wherein the method comprises obtaining a data capture bandwidth and a data access frequency, wherein the data capture bandwidth is the bandwidth occupied when capturing data from a source data storage space to a target data storage space, and the data access frequency is the number of times data is captured from the source data storage space per unit time; in response to the data capture bandwidth being greater than or equal to the target bandwidth and / or the data access frequency being greater than or equal to the target access frequency, the data in the source data storage space is copied to the target data storage space. This solution enables a user to directly read data originally stored in the source data storage space from the target data storage space without the need to capture data from the source data storage space to the target data storage space, thereby saving communication costs and reducing the burden of data processing, while reducing the delay when the user reads data, thereby improving the user experience.

Description

Technical Field

[0001] The present disclosure relates to the field of network technology, and in particular to a data replication method, a data storage system control method, a device, a equipment and a medium. Background Art

[0002] In recent years, with the development of data processing technology, data processing can be completed by multiple parties who are not in the same place. As a result, since the local data storage system cannot meet the needs of multiple parties to read data in the above scenario, in related technologies, data can be stored in an online data storage system. Users who have data reading needs can access the data storage system online at any time and anywhere through any terminal device that can be connected to the Internet, so that they can read the data stored in the data storage system more conveniently. Among them, in order to reduce the delay of users reading data, multiple data centers located in different regions can be set up, and the corresponding data centers can host corresponding storage spaces, so that users can read data from the storage spaces hosted by the data centers in the same region as the users.

[0003] In the related art, although the latency for users to read data from a storage space hosted by a data center in the same region is low, when the data requested by the user to be read is not stored in the storage space, the online data storage system can go to the source storage space according to the configured source storage space address to grab the data requested by the user to be read, and store the data requested by the user in the storage space for the user to read.

[0004] In the above scheme, although it can ensure that the user can read the data requested by the user from the storage space hosted by the data center in the same area, when the communication resources between the storage space and the source storage space corresponding to the storage space are relatively scarce, going to the source storage space in a short period of time to capture data with a larger capacity and store it in the storage space will occupy more communication resources, resulting in a higher rate of captured data, or may cause the communication service provider to forcibly limit the occupation of communication resources by the data storage system; in addition, when the data processing resources of the data storage system are relatively scarce, frequently going to the source storage space to capture data and store it in the storage space may increase the data processing burden of the data storage system, which may cause the data storage system to limit the number of data captures per unit time, thereby damaging the user experience. Summary of the invention

[0005] In order to solve the problems in the related art, the embodiments of the present disclosure provide a data replication method, a data storage system control method, an apparatus, a device and a medium.

[0006] In a first aspect, an embodiment of the present disclosure provides a data replication method, which is applied to a data storage system, and the method includes:

[0007] Obtain data capture bandwidth and data access frequency. The data capture bandwidth is the bandwidth occupied when capturing data from the source data storage space to the target data storage space. The data access frequency is the number of times data is captured from the source data storage space per unit time.

[0008] In response to the data capture bandwidth being greater than or equal to the target bandwidth and / or the data access frequency being greater than or equal to the target access frequency, the data in the source data storage space is copied to the target data storage space.

[0009] In combination with the first aspect, in a first implementation of the first aspect of the present disclosure, in response to the data capture bandwidth being greater than or equal to the target bandwidth, and / or the data access frequency being greater than or equal to the access frequency threshold, before copying the data in the source data storage space to the target data storage space, the method further includes:

[0010] Acquire data replication configuration information, the data replication configuration information including a first data storage space identifier, a second data storage space identifier, and threshold configuration information, the threshold configuration information including at least one of a configuration single block and a configuration access frequency;

[0011] In response to the data storage space indicated by the first data storage space indicator being the source data storage space, and the data storage space indicated by the second data storage space indicator being the target data storage space, determining the configured bandwidth as the target bandwidth;

[0012] And / or, in response to the data storage space indicated by the first data storage space marker being the source data storage space and the data storage space indicated by the second data storage space marker being the target data storage space, the configured access frequency is determined as the target access frequency.

[0013] In combination with the first aspect or the first implementation of the first aspect, in a second implementation of the first aspect of the present disclosure, before copying the data in the source data storage space to the target data storage space, the method further includes:

[0014] Get the data crawling history of crawling data from the source data storage space;

[0015] Determine target data that has not been captured in the source data storage space according to the data capture history;

[0016] Copy the data in the source data storage space to the target data storage space, including:

[0017] Copies the target data from the source data storage space to the target data storage space.

[0018] In combination with the second implementation of the first aspect, in a third implementation of the first aspect of the present disclosure, the data crawling history includes the access time of the data directory where the data is located in the source data storage space;

[0019] Determine the target data that has not been captured in the source data storage space based on the data capture history, including:

[0020] A target data directory whose last access time of the source data storage space is earlier than the target access time is determined, and data in the target data directory is determined as target data.

[0021] In combination with the first aspect or the first implementation of the first aspect, in a fourth implementation of the first aspect of the present disclosure, before copying the data in the source data storage space to the target data storage space, the method further includes:

[0022] Obtain the capacity of the data files in the source data storage space, and sort the data files in the source data storage space in ascending order according to the capacity;

[0023] Copy the data in the source data storage space to the target data storage space, including:

[0024] Copy the sorted data files to the target data storage space in sequence.

[0025] In a second aspect, an embodiment of the present disclosure provides a data storage system control method, which is applied to a data storage system control end, and the method includes:

[0026] Acquire data replication configuration information, where the data replication configuration information includes a first data storage space identifier, a second data storage space identifier, and threshold configuration information, where the threshold configuration information includes at least one of a configured bandwidth and a configured access frequency;

[0027] Send data replication configuration information.

[0028] In combination with the second aspect, in a first implementation of the second aspect of the present disclosure, the data replication configuration information further includes at least one of first data replication indication information and second data replication indication information;

[0029] The first data replication indication information is used to indicate obtaining a data capture history of capturing data from a source data storage space, and determining target data that has not been captured in the source data storage space according to the data capture history;

[0030] The second data replication indication information is used to indicate obtaining the capacity of the data files in the source data storage space, and sorting the data files in the source data storage space in ascending order according to the capacity.

[0031] In a third aspect, an embodiment of the present disclosure provides a data replication device, wherein the device includes:

[0032] The bandwidth frequency acquisition module is configured to acquire the data capture bandwidth and data access frequency, wherein the data capture bandwidth is the bandwidth occupied by the target data storage space when capturing data from the source data storage space, and the data access frequency is the number of times data is captured from the source data storage space per unit time;

[0033] The data replication module is configured to replicate data in the source data storage space to the target data storage space in response to the data capture bandwidth being greater than or equal to the target bandwidth and / or the data access frequency being greater than or equal to the target access frequency.

[0034] In a fourth aspect, an embodiment of the present disclosure provides a data storage system control device, wherein the device includes:

[0035] a configuration information acquisition module configured to acquire data replication configuration information, the data replication configuration information including a first data storage space identifier, a second data storage space identifier, and threshold configuration information, the threshold configuration information including at least one of a configuration bandwidth and a configuration access frequency;

[0036] The configuration information sending module is configured to send data replication configuration information.

[0037] In a fifth aspect, an embodiment of the present disclosure provides an electronic device, comprising a memory and at least one processor; the memory is used to store one or more computer instructions, and the one or more computer instructions are executed by at least one processor to implement the method steps of any one of the first aspect, the first implementation method of the first aspect to the fourth implementation method, the second aspect, and the first implementation method of the second aspect.

[0038] In the sixth aspect, a computer-readable storage medium is provided in an embodiment of the present disclosure, on which computer instructions are stored. When the computer instructions are executed by a processor, the method steps of any one of the first aspect, the first implementation method of the first aspect to the fourth implementation method, the second aspect, and the first implementation method of the second aspect are implemented.

[0039] In the seventh aspect, a computer program product is provided in an embodiment of the present disclosure, comprising computer instructions, which, when executed by a processor, implement the method steps of any one of the first aspect, the first implementation manner of the first aspect to the fourth implementation manner, the second aspect, and the first implementation manner of the second aspect.

[0040] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0041] According to the technical solution provided by the embodiment of the present disclosure, by acquiring the data capture bandwidth and the data access frequency, and in response to the data capture bandwidth being greater than or equal to the target bandwidth and / or the data access frequency being greater than or equal to the target access frequency, the data in the source data storage space is copied to the target data storage space, wherein, since the data capture bandwidth is the bandwidth occupied when capturing data from the source data storage space to the target data storage space, and the data access frequency is the number of times data is captured from the source data storage space per unit time, the data capture bandwidth and the data access frequency can reflect the amount of communication resources occupied when capturing data from the source data storage space to the target data storage space. When the data capture bandwidth is greater than or equal to the target bandwidth, it can be considered that if the communication resources occupied by the data storage system continue to increase, it may lead to higher communication costs, or it may also cause the communication service provider to forcibly limit the communication resources that can be used by the data storage system; and when the data access frequency is greater than or equal to the target access frequency, it can be considered that if the data access frequency continues to increase, the data processing resources of the data storage system are occupied too much, which will cause the data processing burden of the data storage system to be too heavy, and the data storage system may limit the number of data captures per unit time. In order to avoid any of the following situations: excessively high communication costs, communication service providers forcibly limiting the communication resources that can be used by the data storage system, and the data storage system limiting the number of data captures per unit time, the present invention copies the data in the source data storage space to the target data storage space, so that the user can directly read the data originally stored in the source data storage space from the target data storage space without having to capture the data from the source data storage space to the target data storage space, thereby saving communication costs and reducing the data processing burden of the data storage system, while reducing the delay when the user reads the data, thereby improving the user experience.

[0042] According to the technical solution provided by the embodiment of the present disclosure, by acquiring data replication configuration information, when the data storage space indicated by the first data storage space indicator in the data replication configuration information is the source data storage space, and the data storage space indicated in the data replication configuration information is the target data storage space, it can be considered that the data replication configuration information is used to configure the target bandwidth and / or target access frequency corresponding to the source data storage space and the target data storage space. Therefore, in response to the data storage space indicated by the first data storage space indicator being the source data storage space, and the data storage space indicated by the second data storage space indicator being the target data storage space, the configured bandwidth is determined as the target bandwidth, and / or, in response to the data storage space indicated by the first data storage space indicator being the source data storage space, and the data storage space indicated by the second data storage space indicator being the target data storage space, the configured access frequency is determined as the target access frequency, thereby facilitating users to configure the target bandwidth and / or target access frequency, thereby improving user experience.

[0043] According to the technical solution provided by the embodiment of the present disclosure, by obtaining the data capture history of capturing data from the source data storage space, and determining the target data that has not been captured in the source data storage space based on the data capture history, and copying the target data from the source data storage space to the target data storage space, it can be ensured that the data captured from the source data storage space will not be duplicated, thereby improving the efficiency of the copying.

[0044] According to the technical solution provided by the embodiments of the present disclosure, by determining a target data directory whose source data storage space was last accessed earlier than the target access time, and determining the data in the target data directory as the target data, the accuracy of the target data that has not been captured in the determined source data storage space can be improved.

[0045] According to the technical solution provided by the embodiment of the present disclosure, by obtaining the capacity of the data files in the source data storage space, and sorting the data files in the source data storage space in order from small to large according to the capacity, and copying the sorted data files to the target data storage space in sequence, it is possible to preferentially copy the data files with smaller capacity in the source data storage space to the target data storage space. Among them, since when the user reads the data file, even if different data files have different capacities, the number of times required to read is one, by preferentially copying the data files with smaller capacity in the source data storage space to the target data storage space, the number of times data is captured from the source data storage space can be minimized under the premise that the speed of data file copying remains unchanged, thereby reducing the burden on the data storage system.

[0046] According to the technical solution provided by the embodiment of the present disclosure, by acquiring data replication configuration information and sending the data replication configuration information, the data storage system can receive the data replication configuration information. When the data storage space indicated by the first data storage space indicator in the data replication configuration information is the source data storage space, and the data storage space indicated in the data replication configuration information is the target data storage space, it can be considered that the data replication configuration information is used to configure the target bandwidth and / or target access frequency corresponding to the source data storage space and the target data storage space, so the data storage system can respond to the data storage space indicated by the first data storage space indicator as the source data storage space, and the data storage space indicated by the second data storage space indicator as the target data storage space, and determine the configured bandwidth as the target bandwidth, and / or, the data storage system can respond to the data storage space indicated by the first data storage space indicator as the source data storage space, and the data storage space indicated by the second data storage space indicator as the target data storage space, and determine the configured access frequency as the target access frequency, so as to facilitate the user to configure the target bandwidth and / or target access frequency, thereby improving the user experience.

[0047] According to the technical solution provided by the embodiment of the present disclosure, by making the data replication configuration information also include first data replication indication information, the data storage system can respond to the first data replication indication information, obtain the data capture history of capturing data from the source data storage space, and determine the target data that has not been captured in the source data storage space based on the data capture history, so as to copy the target data from the source data storage space to the target data storage space, which can ensure that the data captured from the source data storage space will not be copied repeatedly, thereby improving the efficiency of replication; by making the data replication configuration information also include second data replication indication information, the data storage system can respond to the second data replication indication information to obtain the capacity of the data file in the source data storage space, and sort the data files in the source data storage space in order from small to large according to the capacity, so as to copy the sorted data files to the target data storage space in sequence, so as to achieve the purpose of preferentially copying the data files with smaller capacity in the source data storage space to the target data storage space, and on the premise that the speed of data file copying remains unchanged, minimize the number of times data is captured from the source data storage space, thereby reducing the burden on the data storage system.

[0048] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Other features, objectives and advantages of the present disclosure will become more apparent through the following detailed description of non-limiting embodiments in conjunction with the accompanying drawings. In the accompanying drawings:

[0050] Figure 1 A schematic block diagram of an OSS system according to an embodiment of the present disclosure is shown;

[0051] Figure 2 A schematic block diagram showing a data storage system according to an embodiment of the present disclosure;

[0052] Figure 3 A flow chart showing a data replication method according to an embodiment of the present disclosure;

[0053] Figure 4 A schematic block diagram of an OSS system according to an embodiment of the present disclosure is shown;

[0054] Figure 5 A flow chart showing a data storage system control method according to an embodiment of the present disclosure;

[0055] Figure 6 A structural block diagram of a data replication device according to an embodiment of the present disclosure is shown;

[0056] Figure 7 A structural block diagram of a data storage system control device according to an embodiment of the present disclosure is shown;

[0057] Figure 8 A structural block diagram of an electronic device according to an embodiment of the present disclosure is shown;

[0058] Fig. 9 It is a schematic diagram of the structure of a computer system suitable for implementing the method according to the embodiment of the present disclosure. DETAILED DESCRIPTION

[0059] Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement them. In addition, for the sake of clarity, parts not related to the description of the exemplary embodiments are omitted in the accompanying drawings.

[0060] In the present disclosure, it should be understood that terms such as "include" or "have" are intended to indicate the presence of labels, numbers, steps, behaviors, components, parts, or combinations thereof disclosed in the present specification, and are not intended to exclude the possibility that one or more other labels, numbers, steps, behaviors, components, parts, or combinations thereof exist or are added.

[0061] It should also be noted that, in the absence of conflict, the embodiments and labels in the embodiments of the present disclosure can be combined with each other. The present disclosure will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0062] When the data storage system includes multiple data storage spaces, in order to ensure that the user can read the data he needs to read from the target storage space, the inventor of the present disclosure considers the following solutions.

[0063] In one embodiment of the present disclosure, when the target storage space does not store the data requested by the user to read, the data storage system can fetch the corresponding data from the source storage space according to the configured source storage space address. When the source storage space stores the data, the data storage system will store the data in the target storage space so that the user can read the data from the target storage space.

[0064] For example, the data storage system is an object storage service (OSS) system. Figure 1 A schematic block diagram of an OSS system according to an embodiment of the present disclosure is shown as follows: Figure 1As shown, the OSS system 100 includes an overseas container (Bucket) 101 located in an overseas data center and a domestic container 102 located in a domestic data center, wherein the container can be understood as a storage space, and the container is used to store objects (Object), wherein the object is the basic unit of OSS storage data, and the object can be understood as the data stored by the container.

[0065] The user terminal 110 may include a mobile device, a tablet computer, a laptop computer, or a built-in device in a motor vehicle, or any combination thereof. In some embodiments, the intelligent mobile device may include a smart phone, a personal digital assistant (PDA), a gaming device, a navigation device, or a point of sale (POS) device, or any combination thereof.

[0066] Users located overseas can request to read the corresponding object, i.e., data, from the OSS system 100 through the user terminal 110. In order to reduce the delay of the user terminal 110 reading the user requested data, the user terminal 110 can read the corresponding data from the overseas container 101. If the overseas container 101 does not store the data requested by the user, the OSS system 100 determines the source container corresponding to the overseas container 101 according to the configured return-to-source address. When the determined source station is the domestic container 102, the OSS system 100 can go to the domestic container 102 to capture the data requested by the user through a return-to-source method such as mirroring return-to-source. If the domestic container 102 stores the data requested by the user, it will respond to the capture of the OSS system. The OSS system stores the data requested by the user in the overseas container 101, and the overseas container 101 returns the data requested by the user to the user terminal 110.

[0067] Disadvantages of this solution: In recent years, with the increase in the number of users using data storage systems, the capacity of data stored in data storage systems has also increased dramatically. At the same time, users using data storage systems are also spread all over the world. In some scenarios, when a user is located overseas, usually in order to reduce the latency of the user reading data, the user can read the corresponding data from the storage space hosted by the overseas data center. However, due to the high communication cost between the overseas data center and the domestic data center, when the storage space hosted by the overseas data center does not store the data requested by the user, and the configured source storage space is the storage space hosted by the domestic data center, the data storage system will grab data from the storage space hosted by the domestic data center and store it in the storage space hosted by the overseas data center. In the storage space, considering that the communication resources between the data centers located in China and those located overseas are relatively scarce, if a large amount of data is captured in a short period of time, it may occupy more communication resources, the cost of data capture is high, and it may also cause the communication service provider to forcibly limit the user's occupation of communication resources, that is, limit the bandwidth of the data storage system to capture data from the storage space hosted by the data center located in China and store it in the storage space hosted by the data center located overseas, thereby sharply increasing the latency for users to read data; in addition, when the data processing resources of the data storage system are relatively scarce, frequently capturing data from the source storage space and storing it in the target storage space may increase the data processing burden of the data storage system, which may cause the data storage system to forcibly limit the number of data captures per unit time, thereby damaging the user experience.

[0068] Considering the shortcomings of the above schemes, the inventors of the present disclosure have proposed a new scheme: the scheme is applied to a data storage system, by obtaining a data capture bandwidth and a data access frequency, and in response to the data capture bandwidth being greater than or equal to a target bandwidth and / or the data access frequency being greater than or equal to a target access frequency, the data in the source data storage space is copied to the target data storage space, wherein, since the data capture bandwidth is the bandwidth occupied when capturing data from the source data storage space to the target data storage space, and the data access frequency is the number of times data is captured from the source data storage space per unit time, the data capture bandwidth and the data access frequency can reflect the data capture rate from the source data storage space to the target data storage space. The amount of communication resources occupied when grabbing data from the storage space to the target data storage space, when the data grabbing bandwidth is greater than or equal to the target bandwidth, it can be considered that if the communication resources occupied by the data storage system continue to increase, it may lead to higher communication costs, or it may also cause the communication service provider to forcibly limit the communication resources that the data storage system can use; and when the data access frequency is greater than or equal to the target access frequency, it can be considered that if the data access frequency continues to increase, the data processing resources of the data storage system are occupied too much, which will cause the data processing burden of the data storage system to be too heavy, and the data storage system may limit the number of data grabs per unit time. In order to avoid any of the situations of excessively high communication costs, the communication service provider forcibly limiting the communication resources that the data storage system can use, and the data storage system limiting the number of data grabs per unit time, the present disclosure, by copying the data in the source data storage space to the target data storage space, can enable the user to directly read the data originally stored in the source data storage space from the target data storage space, without the need to grab data from the source data storage space to the target data storage space, saving communication costs and reducing the data processing burden of the data storage system, while reducing the delay when the user reads data, and improving the user experience.

[0069] In order to solve the above problems, the present disclosure proposes a data replication method, a data storage system control method, a device, a equipment and a medium. Figure 2 FIG. 1 is a schematic block diagram of a data storage system according to an embodiment of the present disclosure. Figure 2 As shown, the network storage system 200 may include a target data storage space 211 and a source data storage space 212, wherein the target data storage space 211 may be hosted by a first data center, and the source data storage space 212 may be hosted by a second data center. A data center may be understood as an entity that realizes centralized processing, storage, transmission, exchange, and management of information in a physical space, and a data center may include computer equipment, server equipment, network equipment, storage equipment, and the like.

[0070] Figure 3A flow chart of a data replication method according to an embodiment of the present disclosure is shown. The method is applied to a data storage system, such as Figure 3 As shown, the data replication method includes steps S101 and S102.

[0071] In step S101, the data capture bandwidth and data access frequency are obtained.

[0072] The data capture bandwidth is the bandwidth occupied when capturing data from the source data storage space to the target data storage space, and the data access frequency is the number of times data is captured from the source data storage space per unit time.

[0073] In step S102 , in response to the data capture bandwidth being greater than or equal to the target bandwidth and / or the data access frequency being greater than or equal to the target access frequency, the data in the source data storage space is copied to the target data storage space.

[0074] In one embodiment of the present disclosure, the source data storage space and the target data storage space can be understood as pre-configured, that is, a data storage space can be configured in advance as a source data storage space of multiple data storage spaces other than the data storage space, and the corresponding multiple data storage spaces other than the source data storage space are configured as the target data storage space of the source data storage space. The data stored in the target data storage space can be understood as a copy of the data stored in the source data storage space at a certain moment.

[0075] In one embodiment of the present disclosure, the data capture bandwidth can be understood as the bandwidth occupied when the data center where the source storage space is located transmits the data captured from the source data storage space to the data center where the target data storage space is located. The data capture bandwidth can be detected by the data center where the source storage space is located, or by the data center where the target data storage space is located, or by other devices or systems.

[0076] In one embodiment of the present disclosure, the data access frequency can be obtained based on a data read and write log of a data storage system, which may include data read and write indication information, which may be used to indicate the number of requests to read data in a source data storage space and transfer the data to a target data storage space within a unit time, wherein reading a file may be regarded as reading it once.

[0077] In one embodiment of the present disclosure, the target bandwidth and the target access frequency may be pre-acquired, or may be acquired from a device or other location.

[0078] In one embodiment of the present disclosure, copying data in a source data storage space to a target data storage space can be understood as asynchronously copying the data in the source data storage space and operations such as creation, update and deletion of the data from the source storage space to the target storage space.

[0079] For example, the data storage system is an object storage service (OSS) system. Figure 4 A schematic block diagram of an OSS system according to an embodiment of the present disclosure is shown as follows: Figure 1 As shown, the OSS system 210 includes a first data center 201 located overseas and a second data center 202 located in China, wherein the first data center 201 carries an overseas container 221, and the second data center 202 carries a domestic container 222. The user terminal 203 located overseas can send a request 213 for reading user request data to the OSS system 210 to request to read the user request data. In order to reduce the delay of the user terminal 203 reading the user request data, the user terminal 203 can read the corresponding data from the overseas container 221. When the user request data requested by the user terminal 203 is not stored in the overseas container 221, the corresponding source container (i.e., source storage space) when the overseas container 221 is used as the target container (i.e., target storage space) can be obtained. When it is determined that the corresponding source container when the overseas container 221 is used as the target container is the domestic container 222, the user request data can be captured 232 from the domestic container 222 to capture the user request data. When the domestic container 222 includes the user request data, the user request data in the overseas container 221 can be stored in the overseas container 221 by means of mirroring back to the source 242. Among them, when the bandwidth occupied when capturing the user request data from the domestic container 222 to the overseas container 221, that is, the bandwidth occupied by the mirroring back to the source is greater than or equal to the target bandwidth, and / or the number of times the user request data is captured from the domestic container 222 per unit time is greater than or equal to the target access frequency, the OSS system can automatically start cross-region replication 252 between the domestic container 222 and the overseas container 221, and copy the data in the domestic container 222 to the overseas container 221. After the cross-region replication 252 is completed, the overseas container 221 stores the data in the domestic container 222, which can ensure that when the user reads data 223 from the overseas container 221, the data originally stored in the domestic container 222 can be directly read from the overseas container 221. There is no need for the OSS system to store the user-requested data in the domestic container 222 to the overseas container 221 through mirroring back to the source, thereby reducing the latency for users to read data, saving the communication cost between the overseas container 221 and the domestic container 222 when users read data, and improving the user experience.

[0080] According to the technical solution provided by the embodiment of the present disclosure, by acquiring the data capture bandwidth and the data access frequency, and in response to the data capture bandwidth being greater than or equal to the target bandwidth and / or the data access frequency being greater than or equal to the target access frequency, the data in the source data storage space is copied to the target data storage space, wherein, since the data capture bandwidth is the bandwidth occupied when capturing data from the source data storage space to the target data storage space, and the data access frequency is the number of times data is captured from the source data storage space per unit time, the data capture bandwidth and the data access frequency can reflect the amount of communication resources occupied when capturing data from the source data storage space to the target data storage space. When the data capture bandwidth is greater than or equal to the target bandwidth, it can be considered that if the communication resources occupied by the data storage system continue to increase, it may lead to higher communication costs, or it may also cause the communication service provider to forcibly limit the communication resources that can be used by the data storage system; and when the data access frequency is greater than or equal to the target access frequency, it can be considered that if the data access frequency continues to increase, the data processing resources of the data storage system are occupied too much, which will cause the data processing burden of the data storage system to be too heavy, and the data storage system may limit the number of data captures per unit time. In order to avoid any of the following situations: excessively high communication costs, communication service providers forcibly limiting the communication resources that can be used by the data storage system, and the data storage system limiting the number of data captures per unit time, the present invention copies the data in the source data storage space to the target data storage space, so that the user can directly read the data originally stored in the source data storage space from the target data storage space without having to capture the data from the source data storage space to the target data storage space, thereby saving communication costs and reducing the data processing burden of the data storage system, while reducing the delay when the user reads the data, thereby improving the user experience.

[0081] In one embodiment of the present disclosure, in step S102, in response to the data capture bandwidth being greater than or equal to the target bandwidth and / or the data access frequency being greater than or equal to the target access frequency, before copying the data in the source data storage space to the target data storage space, the method further includes the following steps:

[0082] Acquire data replication configuration information, the data replication configuration information including a first data storage space identifier, a second data storage space identifier, and threshold configuration information, the threshold configuration information including at least one of a configuration single block and a configuration access frequency;

[0083] In response to the data storage space indicated by the first data storage space indicator being the source data storage space, and the data storage space indicated by the second data storage space indicator being the target data storage space, determining the configured bandwidth as the target bandwidth;

[0084] And / or, in response to the data storage space indicated by the first data storage space marker being the source data storage space and the data storage space indicated by the second data storage space marker being the target data storage space, the configured access frequency is determined as the target access frequency.

[0085] In one embodiment of the present disclosure, obtaining data replication configuration information may be reading data replication configuration information stored in advance, or may be receiving data replication configuration information sent by a data storage system control terminal or other systems or devices.

[0086] Among them, the data storage system control end can be understood as being operated by an operator of the data storage service operator or the data storage service user. In some embodiments, the data storage system control end may include a mobile device, a tablet computer, a laptop computer, etc., or any combination thereof. In some embodiments, the mobile device may include a smart home device, a wearable device, a smart mobile device, a virtual reality device, or an augmented reality device, etc., or any combination thereof. In some embodiments, the smart home device may include a smart lighting device, a control device for a smart electrical device, a smart TV, a smart camera, or an intercom, etc., or any combination thereof. In some embodiments, the wearable device may include a smart bracelet, a smart shoelace, a smart glass, a smart helmet, a smart watch, a smart clothing, a smart backpack, a smart accessory, etc., or any combination thereof. In some embodiments, the smart mobile device may include a smart phone, a personal digital assistant (PDA), a gaming device, a navigation device, or a point of sale (POS) device, etc., or any combination thereof. In some embodiments, the virtual reality device and / or the augmented reality device may include a virtual reality helmet, a virtual reality glass, a virtual reality patch, an augmented reality helmet, an augmented reality glass, or an augmented reality patch, etc., or any combination thereof. For example, virtual reality devices and / or augmented reality devices may include various virtual reality products, etc.

[0087] In one embodiment of the present disclosure, the first data storage space mark and the second data storage space mark can be understood as indicating the corresponding data storage space. Further, the first data storage space mark and the second data storage space mark can also be used to indicate the region to which the corresponding data storage space belongs.

[0088] According to the technical solution provided by the embodiment of the present disclosure, by acquiring data replication configuration information, when the data storage space indicated by the first data storage space indicator in the data replication configuration information is the source data storage space, and the data storage space indicated in the data replication configuration information is the target data storage space, it can be considered that the data replication configuration information is used to configure the target bandwidth and / or target access frequency corresponding to the source data storage space and the target data storage space. Therefore, in response to the data storage space indicated by the first data storage space indicator being the source data storage space, and the data storage space indicated by the second data storage space indicator being the target data storage space, the configured bandwidth is determined as the target bandwidth, and / or, in response to the data storage space indicated by the first data storage space indicator being the source data storage space, and the data storage space indicated by the second data storage space indicator being the target data storage space, the configured access frequency is determined as the target access frequency, thereby facilitating users to configure the target bandwidth and / or target access frequency, thereby improving user experience.

[0089] In one embodiment of the present disclosure, in step S102, before copying the data in the source data storage space to the target data storage space, the method further includes the following steps:

[0090] Get the data crawling history of crawling data from the source data storage space;

[0091] Determine target data that has not been captured in the source data storage space according to the data capture history;

[0092] Copy the data in the source data storage space to the target data storage space, including:

[0093] Copies the target data from the source data storage space to the target data storage space.

[0094] In one embodiment of the present disclosure, the data capture history of capturing data from the source data storage space can be understood as a data reading log that records at least one of the data reading time, data reading times, and data reading source of reading data from the source data storage space. Based on the data capture history, it can be determined whether the corresponding data in the source data storage space has been captured.

[0095] According to the technical solution provided by the embodiment of the present disclosure, by obtaining the data capture history of capturing data from the source data storage space, and determining the target data that has not been captured in the source data storage space based on the data capture history, and copying the target data from the source data storage space to the target data storage space, it can be ensured that the data captured from the source data storage space will not be duplicated, thereby improving the efficiency of the copying.

[0096] In one embodiment of the present disclosure, the data capture history includes the access time of the data directory where the data is located in the source data storage space;

[0097] Determine the target data that has not been captured in the source data storage space based on the data capture history, which can be achieved through the following steps:

[0098] A target data directory whose last access time of the source data storage space is earlier than the target access time is determined, and data in the target data directory is determined as target data.

[0099] In one embodiment of the present disclosure, the target access time can be understood as the time when data is started to be captured from the source data storage space to the target data storage space, or it can also be understood as a certain time before the data is started to be captured from the source data storage space to the target data storage space. When the last access time of a data directory is earlier than the target access time, it can be considered that the data directory has not been accessed since the data was captured from the source data storage space to the target data storage space, and therefore the data in the data directory has not been captured to the target data storage space.

[0100] In one embodiment of the present disclosure, the target access time may be obtained in response to fetching data from a source data storage space to a target data storage space, or may be obtained from other devices or systems.

[0101] According to the technical solution provided by the embodiments of the present disclosure, by determining a target data directory whose source data storage space was last accessed earlier than the target access time, and determining the data in the target data directory as the target data, the accuracy of the target data that has not been captured in the determined source data storage space can be improved.

[0102] In one embodiment of the present disclosure, in step S102, before copying the data in the source data storage space to the target data storage space, the method further includes the following steps:

[0103] Obtain the capacity of the data files in the source data storage space, and sort the data files in the source data storage space in ascending order according to the capacity;

[0104] Copy the data in the source data storage space to the target data storage space, including:

[0105] Copy the sorted data files to the target data storage space in sequence.

[0106] In one embodiment of the present disclosure, obtaining the capacity of the data files in the source data storage space can be done by reading previously acquired data file attribute information, and obtaining the capacity of the data files in the source data storage space based on the data file attribute information, where the data file attribute information is data file attribute information indicating the respective capacities of the data files in the source data storage space; or it can be done by receiving data file attribute information sent by a data center or other device or system that carries the source data storage space, and obtaining the capacity of the data files in the source data storage space based on the data file attribute information.

[0107] According to the technical solution provided by the embodiment of the present disclosure, by obtaining the capacity of the data files in the source data storage space, and sorting the data files in the source data storage space in order from small to large according to the capacity, and copying the sorted data files to the target data storage space in sequence, it is possible to preferentially copy the data files with smaller capacity in the source data storage space to the target data storage space. Among them, since when the user reads the data file, even if different data files have different capacities, the number of times required to read is one, by preferentially copying the data files with smaller capacity in the source data storage space to the target data storage space, the number of times data is captured from the source data storage space can be minimized under the premise that the speed of data file copying remains unchanged, thereby reducing the burden on the data storage system.

[0108] Figure 5 A flow chart of a data storage system control method according to an embodiment of the present disclosure is shown, and the method is applied to a data storage system control end.

[0109] Among them, the data storage system control end can be understood as being operated by an operator of the data storage service operator or the data storage service user. In some embodiments, the data storage system control end may include a mobile device, a tablet computer, a laptop computer, etc., or any combination thereof. In some embodiments, the mobile device may include a smart home device, a wearable device, a smart mobile device, a virtual reality device, or an augmented reality device, etc., or any combination thereof. In some embodiments, the smart home device may include a smart lighting device, a control device for a smart electrical device, a smart TV, a smart camera, or an intercom, etc., or any combination thereof. In some embodiments, the wearable device may include a smart bracelet, a smart shoelace, a smart glass, a smart helmet, a smart watch, a smart clothing, a smart backpack, a smart accessory, etc., or any combination thereof. In some embodiments, the smart mobile device may include a smart phone, a personal digital assistant (PDA), a gaming device, a navigation device, or a point of sale (POS) device, etc., or any combination thereof. In some embodiments, the virtual reality device and / or the augmented reality device may include a virtual reality helmet, a virtual reality glass, a virtual reality patch, an augmented reality helmet, an augmented reality glass, or an augmented reality patch, etc., or any combination thereof. For example, virtual reality devices and / or augmented reality devices may include various virtual reality products, etc.

[0110] like Figure 5 As shown, the data storage system control method includes steps S201 and S202.

[0111] In step S201, data replication configuration information is obtained.

[0112] The data replication configuration information includes a first data storage space identifier, a second data storage space identifier, and threshold configuration information, and the threshold configuration information includes at least one of a configured bandwidth and a configured access frequency.

[0113] In step S202, data replication configuration information is sent.

[0114] In one embodiment of the present disclosure, the data replication configuration information may be stored in advance, or may be input through a human-computer interaction device at the data storage system control end. The data replication configuration information may be input through the human-computer interaction device at the data storage system control end, and may be obtained by obtaining the data replication configuration information input by the user through at least one of a keyboard, a touch screen, and a touch pad at the data storage system control end; or may be obtained by obtaining the voice information input by the user through a microphone at the data storage system control end, and performing voice recognition on the voice information to obtain the data replication configuration information.

[0115] In one embodiment of the present disclosure, sending the data replication configuration information may be sending the data replication configuration information to the data storage system via a wired network or a wireless network.

[0116] According to the technical solution provided by the embodiment of the present disclosure, by acquiring data replication configuration information and sending the data replication configuration information, the data storage system can receive the data replication configuration information. When the data storage space indicated by the first data storage space indicator in the data replication configuration information is the source data storage space, and the data storage space indicated in the data replication configuration information is the target data storage space, it can be considered that the data replication configuration information is used to configure the target bandwidth and / or target access frequency corresponding to the source data storage space and the target data storage space, so the data storage system can respond to the data storage space indicated by the first data storage space indicator as the source data storage space, and the data storage space indicated by the second data storage space indicator as the target data storage space, and determine the configured bandwidth as the target bandwidth, and / or, the data storage system can respond to the data storage space indicated by the first data storage space indicator as the source data storage space, and the data storage space indicated by the second data storage space indicator as the target data storage space, and determine the configured access frequency as the target access frequency, so as to facilitate the user to configure the target bandwidth and / or target access frequency, thereby improving the user experience.

[0117] In one embodiment of the present disclosure, the data replication configuration information further includes at least one of first data replication indication information and second data replication indication information;

[0118] The first data replication indication information is used to indicate obtaining a data capture history of capturing data from a source data storage space, and determining target data that has not been captured in the source data storage space according to the data capture history;

[0119] The second data replication indication information is used to indicate obtaining the capacity of the data files in the source data storage space, and sorting the data files in the source data storage space in ascending order according to the capacity.

[0120] According to the technical solution provided by the embodiment of the present disclosure, by making the data replication configuration information also include first data replication indication information, the data storage system can respond to the first data replication indication information, obtain the data capture history of capturing data from the source data storage space, and determine the target data that has not been captured in the source data storage space based on the data capture history, so as to copy the target data from the source data storage space to the target data storage space, which can ensure that the data captured from the source data storage space will not be copied repeatedly, thereby improving the efficiency of replication; by making the data replication configuration information also include second data replication indication information, the data storage system can respond to the second data replication indication information to obtain the capacity of the data file in the source data storage space, and sort the data files in the source data storage space in order from small to large according to the capacity, so as to copy the sorted data files to the target data storage space in sequence, so as to achieve the purpose of preferentially copying the data files with smaller capacity in the source data storage space to the target data storage space, and on the premise that the speed of data file copying remains unchanged, minimize the number of times data is captured from the source data storage space, thereby reducing the burden on the data storage system.

[0121] The following reference Figure 6 A data replication device according to an embodiment of the present disclosure is described. Figure 6 A structural block diagram of a data replication device according to an embodiment of the present disclosure is shown.

[0122] like Figure 6 As shown, the data replication device 300 includes:

[0123] The bandwidth frequency acquisition module 301 is configured to acquire the data capture bandwidth and the data access frequency, wherein the data capture bandwidth is the bandwidth occupied by the target data storage space when capturing data from the source data storage space, and the data access frequency is the number of times data is captured from the source data storage space per unit time;

[0124] The data replication module 302 is configured to replicate data in the source data storage space to the target data storage space in response to the data capture bandwidth being greater than or equal to the target bandwidth and / or the data access frequency being greater than or equal to the target access frequency.

[0125] According to the technical solution provided by the embodiment of the present disclosure, by acquiring the data capture bandwidth and the data access frequency, and in response to the data capture bandwidth being greater than or equal to the target bandwidth and / or the data access frequency being greater than or equal to the target access frequency, the data in the source data storage space is copied to the target data storage space, wherein, since the data capture bandwidth is the bandwidth occupied when capturing data from the source data storage space to the target data storage space, and the data access frequency is the number of times data is captured from the source data storage space per unit time, the data capture bandwidth and the data access frequency can reflect the amount of communication resources occupied when capturing data from the source data storage space to the target data storage space. When the data capture bandwidth is greater than or equal to the target bandwidth, it can be considered that if the communication resources occupied by the data storage system continue to increase, it may lead to higher communication costs, or it may also cause the communication service provider to forcibly limit the communication resources that can be used by the data storage system; and when the data access frequency is greater than or equal to the target access frequency, it can be considered that if the data access frequency continues to increase, the data processing resources of the data storage system are occupied too much, which will cause the data processing burden of the data storage system to be too heavy, and the data storage system may limit the number of data captures per unit time. In order to avoid any of the following situations: excessively high communication costs, communication service providers forcibly limiting the communication resources that can be used by the data storage system, and the data storage system limiting the number of data captures per unit time, the present invention copies the data in the source data storage space to the target data storage space, so that the user can directly read the data originally stored in the source data storage space from the target data storage space without having to capture the data from the source data storage space to the target data storage space, thereby saving communication costs and reducing the data processing burden of the data storage system, while reducing the delay when the user reads the data, thereby improving the user experience.

[0126] Those skilled in the art will understand that referring to Figure 6 The described technical solution can be combined with any of the embodiments described above, so as to have the technical effect achieved by any of the embodiments described above. The specific contents can refer to the description of the above embodiments, and the specific contents will not be repeated here.

[0127] The following reference Figure 7 A data storage system control device according to an embodiment of the present disclosure is described. Figure 7 A structural block diagram of a data storage system control device according to an embodiment of the present disclosure is shown.

[0128] like Figure 7 As shown, the data storage system control device 400 includes:

[0129] The configuration information acquisition module 401 is configured to acquire data replication configuration information, where the data replication configuration information includes a first data storage space identifier, a second data storage space identifier, and threshold configuration information, where the threshold configuration information includes at least one of a configuration bandwidth and a configuration access frequency;

[0130] The configuration information sending module 402 is configured to send data replication configuration information.

[0131] According to the technical solution provided by the embodiment of the present disclosure, by acquiring data replication configuration information and sending the data replication configuration information, the data storage system can receive the data replication configuration information. When the data storage space indicated by the first data storage space indicator in the data replication configuration information is the source data storage space, and the data storage space indicated in the data replication configuration information is the target data storage space, it can be considered that the data replication configuration information is used to configure the target bandwidth and / or target access frequency corresponding to the source data storage space and the target data storage space, so the data storage system can respond to the data storage space indicated by the first data storage space indicator as the source data storage space, and the data storage space indicated by the second data storage space indicator as the target data storage space, and determine the configured bandwidth as the target bandwidth, and / or, the data storage system can respond to the data storage space indicated by the first data storage space indicator as the source data storage space, and the data storage space indicated by the second data storage space indicator as the target data storage space, and determine the configured access frequency as the target access frequency, so as to facilitate the user to configure the target bandwidth and / or target access frequency, thereby improving the user experience.

[0132] Those skilled in the art will understand that referring to Figure 7 The described technical solution can be combined with any of the embodiments described above, so as to have the technical effect achieved by any of the embodiments described above. The specific contents can refer to the description of the above embodiments, and the specific contents will not be repeated here.

[0133] Figure 8 A structural block diagram of an electronic device according to an embodiment of the present disclosure is shown.

[0134] The present disclosure also provides an electronic device, such as Figure 8 As shown, the electronic device 500 includes at least one processor 501; and a memory 502 that is communicatively connected to the at least one processor 501; wherein the memory 502 stores instructions that can be executed by the at least one processor 501, and the instructions are executed by the at least one processor 501 to implement the following steps:

[0135] In a first aspect, an embodiment of the present disclosure provides a data replication method, which is applied to a data storage system, and the method includes:

[0136] Obtain data capture bandwidth and data access frequency. The data capture bandwidth is the bandwidth occupied when capturing data from the source data storage space to the target data storage space. The data access frequency is the number of times data is captured from the source data storage space per unit time.

[0137] In response to the data capture bandwidth being greater than or equal to the target bandwidth and / or the data access frequency being greater than or equal to the target access frequency, the data in the source data storage space is copied to the target data storage space.

[0138] In combination with the first aspect, in a first implementation of the first aspect of the present disclosure, in response to the data capture bandwidth being greater than or equal to the target bandwidth, and / or the data access frequency being greater than or equal to the access frequency threshold, before copying the data in the source data storage space to the target data storage space, the method further includes:

[0139] Acquire data replication configuration information, the data replication configuration information including a first data storage space identifier, a second data storage space identifier, and threshold configuration information, the threshold configuration information including at least one of a configuration single block and a configuration access frequency;

[0140] In response to the data storage space indicated by the first data storage space indicator being the source data storage space, and the data storage space indicated by the second data storage space indicator being the target data storage space, determining the configured bandwidth as the target bandwidth;

[0141] And / or, in response to the data storage space indicated by the first data storage space marker being the source data storage space and the data storage space indicated by the second data storage space marker being the target data storage space, the configured access frequency is determined as the target access frequency.

[0142] In combination with the first aspect or the first implementation of the first aspect, in a second implementation of the first aspect of the present disclosure, before copying the data in the source data storage space to the target data storage space, the method further includes:

[0143] Get the data crawling history of crawling data from the source data storage space;

[0144] Determine target data that has not been captured in the source data storage space according to the data capture history;

[0145] Copy the data in the source data storage space to the target data storage space, including:

[0146] Copies the target data from the source data storage space to the target data storage space.

[0147] In combination with the second implementation of the first aspect, in a third implementation of the first aspect of the present disclosure, the data crawling history includes the access time of the data directory where the data is located in the source data storage space;

[0148] Determine the target data that has not been captured in the source data storage space based on the data capture history, including:

[0149] A target data directory whose last access time of the source data storage space is earlier than the target access time is determined, and data in the target data directory is determined as target data.

[0150] In combination with the first aspect or the first implementation of the first aspect, in a fourth implementation of the first aspect of the present disclosure, before copying the data in the source data storage space to the target data storage space, the method further includes:

[0151] Obtain the capacity of the data files in the source data storage space, and sort the data files in the source data storage space in ascending order according to the capacity;

[0152] Copy the data in the source data storage space to the target data storage space, including:

[0153] Copy the sorted data files to the target data storage space in sequence.

[0154] In a second aspect, an embodiment of the present disclosure provides a data storage system control method, which is applied to a data storage system control end, and the method includes:

[0155] Acquire data replication configuration information, where the data replication configuration information includes a first data storage space identifier, a second data storage space identifier, and threshold configuration information, where the threshold configuration information includes at least one of a configured bandwidth and a configured access frequency;

[0156] Send data replication configuration information.

[0157] In combination with the second aspect, in a first implementation of the second aspect of the present disclosure, the data replication configuration information further includes at least one of first data replication indication information and second data replication indication information;

[0158] The first data replication indication information is used to indicate obtaining a data capture history of capturing data from a source data storage space, and determining target data that has not been captured in the source data storage space according to the data capture history;

[0159] The second data replication indication information is used to indicate obtaining the capacity of the data files in the source data storage space, and sorting the data files in the source data storage space in ascending order according to the capacity.

[0160] like Fig. 9 As shown, the computer system 600 includes a processing unit 601, which can perform various processes in the embodiments shown in the above figures according to the program stored in the read-only memory (ROM) 602 or the program loaded from the storage part 608 to the random access memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the system 600 are also stored. The CPU 601, the ROM 602, and the RAM 603 are connected to each other through a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0161] The following components are connected to the I / O interface 605: an input part 606 including a keyboard, a mouse, etc.; an output part 607 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage part 608 including a hard disk, etc.; and a communication part 609 including a network interface card such as a LAN card, a modem, etc. The communication part 609 performs communication processing via a network such as the Internet. The drive 610 is also connected to the I / O interface 605 as needed. Removable media 611, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., are installed on the drive 610 as needed, so that the computer program read therefrom is installed into the storage part 608 as needed. Among them, the processing unit 601 can be implemented as a processing unit such as a CPU, a GPU, a TPU, an FPGA, an NPU, etc.

[0162] In particular, according to an embodiment of the present disclosure, the method described above with reference to the accompanying drawings can be implemented as a computer software program. Exemplarily, an embodiment of the present disclosure includes a computer program product, which includes a computer program tangibly contained on a readable medium thereof, and the computer program includes a program code for executing the method in the accompanying drawings. In such an embodiment, the computer program can be downloaded and installed from a network through a communication portion 609, and / or installed from a removable medium 611. Exemplarily, an embodiment of the present disclosure includes a readable storage medium on which computer instructions are stored, and when the computer instructions are executed by a processor, the program code for executing the method in the accompanying drawings is implemented.

[0163] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each box in the road map or block diagram can represent a module, a program segment or a part of a code, and the module, a program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. Exemplary, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0164] The units or modules involved in the embodiments described in the present disclosure may be implemented by software or hardware. The units or modules described may also be set in a processor, and the names of these units or modules do not constitute limitations on the units or modules themselves in some cases.

[0165] As another aspect, the present disclosure further provides a computer-readable storage medium, which may be a computer-readable storage medium included in the node described in the above embodiment; or a computer-readable storage medium that exists independently and is not installed in a device. The computer-readable storage medium stores one or more programs, and the programs are used by one or more processors to execute the method described in the present disclosure.

[0166] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the present disclosure is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the inventive concept. The above exemplary features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) to form a technical solution.

Claims

1. A data replication method, wherein: The method is applied to a data storage system, and the method comprises: Obtaining data capture bandwidth and data access frequency, wherein the data capture bandwidth is the bandwidth occupied when capturing data from the source data storage space to the target data storage space, and the data access frequency is the number of times data is captured from the source data storage space per unit time; Acquire data replication configuration information, where the data replication configuration information includes a first data storage space identifier, a second data storage space identifier, and threshold configuration information, where the threshold configuration information includes at least one of a configured bandwidth and a configured access frequency; In response to the data storage space indicated by the first data storage space mark being the source data storage space, and the data storage space indicated by the second data storage space mark being the target data storage space, and in response to the data capture bandwidth being greater than or equal to the configured bandwidth, copying the data in the source data storage space to the target data storage space; and, in response to the data storage space indicated by the first data storage space marker being the source data storage space, and the data storage space indicated by the second data storage space marker being the target data storage space, in response to the data access frequency being greater than or equal to the configured access frequency, copying the data in the source data storage space to the target data storage space.

2. The data replication method according to claim 1, wherein: Before copying the data in the source data storage space to the target data storage space, the method further includes: Acquire a data capture history of capturing data from the source data storage space; Determine the target data that has not been captured in the source data storage space according to the data capture history; The step of copying the data in the source data storage space to the target data storage space comprises: The target data is copied from the source data storage space to the target data storage space.

3. The data replication method according to claim 2, wherein: The data capture history includes the access time of the data directory where the data in the source data storage space is located; The determining, according to the data capture history, target data that has not been captured in the source data storage space includes: A target data directory whose last access time of the source data storage space is earlier than the target access time is determined, and data in the target data directory is determined as the target data.

4. The data replication method according to claim 1, wherein: Before copying the data in the source data storage space to the target data storage space, the method further includes: Acquire the capacity of the data files in the source data storage space, and sort the data files in the source data storage space in ascending order according to the capacity; The step of copying the data in the source data storage space to the target data storage space comprises: The sorted data files are copied to the target data storage space in sequence.

5. A data storage system control method, wherein: The method is applied to a data storage system control end, and the method comprises: Acquire data replication configuration information, where the data replication configuration information includes a first data storage space identifier, a second data storage space identifier, and threshold configuration information, where the threshold configuration information includes at least one of a configured bandwidth and a configured access frequency; Send the data replication configuration information to the data storage system, so that the data storage system responds to the data storage space indicated by the first data storage space marker as the source data storage space, and the data storage space indicated by the second data storage space marker as the target data storage space, and responds to the data capture bandwidth being greater than or equal to the configured bandwidth, and copies the data in the source data storage space to the target data storage space; and, so that the data storage system responds to the data storage space indicated by the first data storage space marker as the source data storage space, and the data storage space indicated by the second data storage space marker as the target data storage space, and responds to the data access frequency being greater than or equal to the configured access frequency, and copies the data in the source data storage space to the target data storage space.

6. The data storage system control method according to claim 5, wherein: The data replication configuration information further includes at least one of first data replication indication information and second data replication indication information; The first data replication indication information is used to indicate obtaining a data capture history of capturing data from a source data storage space, and determining target data that has not been captured in the source data storage space according to the data capture history; The second data replication indication information is used to indicate obtaining the capacity of the data files in the source data storage space, and sorting the data files in the source data storage space in ascending order according to the capacity.

7. A data replication device, wherein: include: The bandwidth frequency acquisition module is configured to acquire data capture bandwidth and data access frequency, wherein the data capture bandwidth is the bandwidth occupied by the target data storage space when capturing data from the source data storage space, and the data access frequency is the number of times data is captured from the source data storage space per unit time; acquire data replication configuration information, wherein the data replication configuration information includes a first data storage space identifier, a second data storage space identifier, and threshold configuration information, wherein the threshold configuration information includes at least one of a configured bandwidth and a configured access frequency; A data replication module is configured to, in response to the data storage space indicated by the first data storage space marker being the source data storage space and the data storage space indicated by the second data storage space marker being the target data storage space, and in response to the data capture bandwidth being greater than or equal to the configured bandwidth, copy the data in the source data storage space to the target data storage space; and, in response to the data storage space indicated by the first data storage space marker being the source data storage space and the data storage space indicated by the second data storage space marker being the target data storage space, and in response to the data access frequency being greater than or equal to the configured access frequency, copy the data in the source data storage space to the target data storage space.

8. A data storage system control device, wherein: The device comprises: a configuration information acquisition module, configured to acquire data replication configuration information, wherein the data replication configuration information includes a first data storage space identifier, a second data storage space identifier, and threshold configuration information, wherein the threshold configuration information includes at least one of a configuration bandwidth and a configuration access frequency; A configuration information sending module is configured to send the data replication configuration information to a data storage system, so that the data storage system, in response to the data storage space indicated by the first data storage space marker being the source data storage space and the data storage space indicated by the second data storage space marker being the target data storage space, and in response to the data capture bandwidth being greater than or equal to the configured bandwidth, copies the data in the source data storage space to the target data storage space; and, in response to the data storage system, in response to the data storage space indicated by the first data storage space marker being the source data storage space and the data storage space indicated by the second data storage space marker being the target data storage space, and in response to the data access frequency being greater than or equal to the configured access frequency, copies the data in the source data storage space to the target data storage space.

9. An electronic device, wherein: The method comprises a memory and at least one processor; wherein the memory is used to store one or more computer instructions, wherein the one or more computer instructions are executed by the at least one processor to implement the method steps described in any one of claims 1 to 6.

10. A computer-readable storage medium having computer instructions stored thereon, wherein: When the computer instructions are executed by a processor, the method steps described in any one of claims 1 to 6 are implemented.

Images