Data migration method and device, electronic equipment and computer readable storage medium

Abstract

The application discloses a data migration method, comprising: monitoring bandwidth of an enterprise disk and nearline storage media, obtaining a first bandwidth of the enterprise disk and a second bandwidth of the nearline storage media; determining non-hot data in the enterprise disk when the first bandwidth exceeds a first preset threshold and the second bandwidth is lower than a second preset threshold; and migrating the non-hot data to the nearline storage media. The application has the technical effect that part of the non-hot data in the enterprise disk is migrated to the nearline storage media with lower performance based on the bandwidth parameter, so as to reduce the storage pressure of the enterprise disk, fully exert the storage performance of the nearline storage media, effectively improve the storage performance of the storage system, and realize stable storage of data information. The application also discloses a data migration device, an electronic device and a computer readable storage medium, which have the above technical effect.

Description

Technical Field

[0001] This application relates to the field of storage technology, and in particular to a data migration method, as well as a data migration device, electronic device, and computer-readable storage medium. Background Technology

[0002] With the rapid development of the Internet big data era, data information has become the most valuable key asset. In the Internet storage industry, data storage depends on storage systems. With the dramatic increase in Internet data, the storage performance of storage systems is of paramount importance.

[0003] Therefore, how to effectively improve the storage performance of storage systems and achieve stable storage of data information is a problem that urgently needs to be solved by those skilled in the art. Summary of the Invention

[0004] The purpose of this application is to provide a data migration method that can effectively improve the storage performance of a storage system and achieve stable storage of data information; another purpose of this application is to provide a data migration device, electronic device, and computer-readable storage medium, all of which have the above-mentioned beneficial effects.

[0005] Firstly, this application provides a data migration method, including:

[0006] Bandwidth monitoring is performed on enterprise-class disks and nearline storage media to obtain a first bandwidth of the enterprise-class disks and a second bandwidth of the nearline storage media.

[0007] When the first bandwidth exceeds the first preset threshold and the second bandwidth is lower than the second preset threshold, non-hot data in the enterprise-level disk is determined.

[0008] The non-hot data is migrated to the nearline storage medium.

[0009] Optionally, before performing bandwidth monitoring on the enterprise-grade disk and nearline storage medium to obtain the first bandwidth of the enterprise-grade disk and the second bandwidth of the nearline storage medium, the method further includes:

[0010] Set corresponding limit conditions for the enterprise-class disk and the nearline storage medium respectively, and perform the step of bandwidth monitoring of the enterprise-class disk and the nearline storage medium under the limit conditions to obtain the first bandwidth of the enterprise-class disk and the second bandwidth of the nearline storage medium.

[0011] Optionally, the step of monitoring the bandwidth of the enterprise-grade disk and the nearline storage medium to obtain a first bandwidth of the enterprise-grade disk and a second bandwidth of the nearline storage medium includes:

[0012] The first total bandwidth of the enterprise-level disk within a first preset time period is calculated, and the bandwidth per unit time is calculated based on the first total bandwidth to obtain the first bandwidth;

[0013] The second total bandwidth of the nearline storage medium within a second preset time period is statistically analyzed, and the bandwidth per unit time is calculated based on the second total bandwidth to obtain the second bandwidth.

[0014] Optionally, determining the non-hot data in the enterprise-grade disk includes:

[0015] Obtain the access count of each stored data in the enterprise-level disk;

[0016] The stored data whose access count is less than a preset number is considered as the non-hot data.

[0017] Optionally, migrating the non-hot data to the nearline storage medium includes:

[0018] Calculate the bandwidth of the non-hot data based on the number of times the non-hot data is accessed;

[0019] Determine whether the bandwidth is lower than a preset threshold; the preset threshold is a preset ratio value of the second bandwidth;

[0020] If so, the non-hot data is migrated to the nearline storage medium.

[0021] Optionally, migrating the non-hot data to the nearline storage medium includes:

[0022] The non-thermal data is compressed to obtain compressed data;

[0023] The compressed data is migrated to the nearline storage medium.

[0024] Optionally, the data migration method further includes:

[0025] When the first bandwidth does not exceed the first preset threshold, or the second bandwidth is not lower than the second preset threshold, return to the step of monitoring the bandwidth of the enterprise-level disk and the nearline storage medium to obtain the first bandwidth of the enterprise-level disk and the second bandwidth of the nearline storage medium.

[0026] Secondly, this application also discloses a data migration apparatus, comprising:

[0027] The monitoring module is used to monitor the bandwidth of enterprise-class disks and nearline storage media, and to obtain the first bandwidth of the enterprise-class disks and the second bandwidth of the nearline storage media.

[0028] The determination module is used to determine non-hot data in the enterprise-level disk when the first bandwidth exceeds a first preset threshold and the second bandwidth is lower than a second preset threshold;

[0029] A migration module is used to migrate the non-hot data to the nearline storage medium.

[0030] Thirdly, this application also discloses an electronic device, comprising:

[0031] Memory, used to store computer programs;

[0032] A processor for executing the computer program to implement any of the data migration methods described above.

[0033] Fourthly, this application also discloses a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of any of the data migration methods described above.

[0034] This application provides a data migration method, including bandwidth monitoring of an enterprise-grade disk and a near-line storage medium to obtain a first bandwidth of the enterprise-grade disk and a second bandwidth of the near-line storage medium; when the first bandwidth exceeds a first preset threshold and the second bandwidth is lower than a second preset threshold, determining non-hot data in the enterprise-grade disk; and migrating the non-hot data to the near-line storage medium.

[0035] By applying the technical solution provided in this application, in the storage system, more data information is centrally stored on enterprise-level disks, while near-line storage media is only used to store a small amount of cold data. Based on this, the bandwidth of both can be monitored in real time. When the bandwidth of both meets the corresponding preset conditions, non-hot data in the enterprise-level disk can be migrated to the near-line storage media for storage. This realizes the migration of some non-hot data in the enterprise-level disk to the lower-performance near-line storage media based on bandwidth parameters, reducing the storage pressure on the enterprise-level disk, giving full play to the storage performance of the near-line storage media, thereby effectively improving the storage performance of the storage system and realizing stable storage of data information.

[0036] The data migration apparatus, electronic device, and computer-readable storage medium provided in this application also have the above-mentioned technical effects, and will not be described in detail here. Attached Figure Description

[0037] To more clearly illustrate the technical solutions in the prior art and the embodiments of this application, the accompanying drawings used in the description of the prior art and the embodiments of this application will be briefly introduced below. Of course, the accompanying drawings described below with respect to the embodiments of this application are only a part of the embodiments in this application. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort, and such other drawings also fall within the protection scope of this application.

[0038] Figure 1 A flowchart illustrating a data migration method provided in this application;

[0039] Figure 2 A schematic diagram of a data migration device provided in this application;

[0040] Figure 3 This is a schematic diagram of the structure of an electronic device provided in this application. Detailed Implementation

[0041] The core of this application is to provide a data migration method that can effectively improve the storage performance of a storage system and achieve stable storage of data information; another core aspect of this application is to provide a data migration device, electronic device, and computer-readable storage medium, all of which have the aforementioned beneficial effects.

[0042] To provide a clearer and more complete description of the technical solutions in the embodiments of this application, the technical solutions in the embodiments of this application will be described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of this application.

[0043] This application provides a data migration method.

[0044] Please refer to Figure 1 , Figure 1 This is a flowchart illustrating a data migration method provided in this application, which may include the following steps S101 to S103.

[0045] S101: Monitors bandwidth for enterprise-class disks and nearline storage media to obtain the first bandwidth of enterprise-class disks and the second bandwidth of nearline storage media.

[0046] This step aims to achieve bandwidth monitoring of enterprise-grade disks and nearline storage media. It is understood that the data migration method provided in this application aims to achieve data migration based on bandwidth parameters, so as to migrate data information from enterprise-grade disks to nearline storage media, thereby reducing the storage pressure on enterprise-grade disks and maximizing the storage performance of nearline storage media. Therefore, during the operation of the storage system, the bandwidth of enterprise-grade disks and nearline storage media can be monitored in real-time / periodically / irregularly to obtain the corresponding bandwidth data, namely the first bandwidth of the enterprise-grade disk and the second bandwidth of the nearline storage media. The implementation form of bandwidth monitoring and its calculation method is not unique; it can be set by technical personnel according to the actual situation, and this application does not limit it in this regard.

[0047] S102: When the first bandwidth exceeds the first preset threshold and the second bandwidth is lower than the second preset threshold, non-hot data in the enterprise-level disk is determined.

[0048] This step aims to identify non-hot data in enterprise-level disks and determine whether to migrate this data based on threshold conditions. First, regarding bandwidth parameters, bottleneck thresholds for the enterprise-level disk (i.e., the first preset threshold mentioned above) and nearline storage media (i.e., the second preset threshold mentioned above) can be preset. Further, for the enterprise-level disk (the migrating party), if its bandwidth is above the bottleneck threshold, it indicates high storage pressure, meeting the data migration conditions; if its bandwidth is below the bottleneck threshold, it indicates low storage pressure, and data migration is unnecessary. For the nearline storage media (the receiving party), if its bandwidth is above the bottleneck threshold, it indicates high storage pressure, not meeting the data migration conditions; if its bandwidth is below the bottleneck threshold, it indicates low storage pressure, and data migration can proceed. Therefore, when the first bandwidth exceeds the first preset threshold and the second bandwidth is below the second preset threshold, it indicates high storage pressure on the enterprise-level disk and low storage pressure on the nearline storage media. In this case, non-hot data can be identified in the enterprise-level disk to facilitate subsequent data migration operations.

[0049] S103: Migrate non-hot data to nearline storage media.

[0050] This step aims to achieve data migration. After identifying the non-hot data on the enterprise-class disk, the non-hot data can be migrated from the enterprise-class disk to the nearline storage medium, thereby reducing the storage pressure on the enterprise-class disk and maximizing the storage performance of the nearline storage medium.

[0051] As can be seen, the data migration method provided in this application embodiment stores more data information in the storage system on the enterprise-level disk, while the near-line storage medium is only used to store a small amount of cold data. Based on this, the bandwidth of both can be monitored in real time. When the bandwidth of both meets the corresponding preset conditions, the non-hot data in the enterprise-level disk can be migrated to the near-line storage medium for storage. This realizes the migration of some non-hot data in the enterprise-level disk to the lower-performance near-line storage medium based on bandwidth parameters, reducing the storage pressure on the enterprise-level disk, giving full play to the storage performance of the near-line storage medium, thereby effectively improving the storage performance of the storage system and realizing stable storage of data information.

[0052] Based on the above embodiments:

[0053] In one embodiment of this application, before performing bandwidth monitoring on the enterprise-class disk and nearline storage medium to obtain the first bandwidth of the enterprise-class disk and the second bandwidth of the nearline storage medium, the following steps may be included:

[0054] Set corresponding extreme conditions for enterprise-class disks and nearline storage media respectively, and perform bandwidth monitoring of enterprise-class disks and nearline storage media under extreme conditions to obtain the first bandwidth of enterprise-class disks and the second bandwidth of nearline storage media.

[0055] To ensure the stability and accuracy of data migration, extreme conditions can be pre-set for enterprise-grade disks and nearline storage media to obtain their bandwidth parameters under these conditions. Therefore, before monitoring the bandwidth of enterprise-grade disks and nearline storage media, extreme conditions can be set for each to obtain the first bandwidth of the enterprise-grade disk under extreme conditions and the second bandwidth of the nearline storage media under extreme conditions.

[0056] It is understandable that the limiting conditions for enterprise-grade disks and nearline storage media may be the same or different, essentially determined by their inherent characteristics, and this application does not impose any limitations on this. In one possible implementation, the limiting conditions for both are set as follows (tested using 100% read and 128K block size):

[0057] Enterprise-class disks: percentReads="100" ioSizeKiB="128" MiBPerSecond="560";

[0058] Nearline storage media: percentReads="100" ioSizeKiB="128" MiBPerSecond="280".

[0059] In one embodiment of this application, the above-described bandwidth monitoring of the enterprise-class disk and nearline storage medium to obtain the first bandwidth of the enterprise-class disk and the second bandwidth of the nearline storage medium may include the following steps:

[0060] The first total bandwidth of the enterprise-level disk within the first preset time period is calculated, and the first bandwidth is obtained by calculating the bandwidth per unit time based on the first total bandwidth;

[0061] The second total bandwidth of the near-line storage medium within a second preset time period is statistically analyzed, and the bandwidth per unit time is calculated based on the second total bandwidth to obtain the second bandwidth.

[0062] This application provides a method for calculating the bandwidth of enterprise-grade disks and nearline storage media. For enterprise-grade disks, the total bandwidth within a first preset time period (the aforementioned first total bandwidth) can be calculated first. Then, the bandwidth per unit time is calculated, and this bandwidth within the unit time period is taken as the first bandwidth. For example, the total bandwidth of an enterprise-grade disk within 5 minutes can be calculated, and then its bandwidth per second is calculated; this bandwidth per second is the first bandwidth. Similar to enterprise-grade disks, the second bandwidth of nearline storage media can also be implemented using the above method. That is, the total bandwidth within a second preset time period (the aforementioned second total bandwidth) can be calculated first, and then the bandwidth per unit time period is calculated, and this bandwidth within the unit time period is taken as the second bandwidth.

[0063] It should be noted that the values ​​of the first and second preset durations mentioned above do not affect the implementation of the technical solution of this application. They can be set by technical personnel according to the actual situation. This application does not limit them. In addition, the values ​​of the two can be the same or different, and can be set according to their actual performance.

[0064] In one embodiment of this application, determining non-hot data in an enterprise-level disk may include the following steps:

[0065] Get the access count of each storage data in an enterprise-level disk;

[0066] Stored data that has been accessed less than a preset number of times is considered non-hot data.

[0067] This application provides a method for identifying non-hot data in an enterprise-level disk, which can be based on the access frequency of each stored data in the enterprise-level disk. It is understood that the more times stored data is accessed, the higher its usage frequency, and it can be called hot data; conversely, the fewer times stored data is accessed, the lower its usage frequency, and it can be called cold data (or non-hot data). Based on this, the access frequency of each stored data in the enterprise-level disk can be obtained sequentially. If its access frequency has reached a preset number, it is considered hot data and no data migration is required; conversely, if its access frequency has not reached the preset number, it is considered non-hot data and data migration can be performed. Similarly, the value of the preset threshold does not affect the implementation of the technical solution of this application and can be set by technicians according to the actual situation; this application does not limit it in this regard.

[0068] In one embodiment of this application, the above-described migration of non-hot data to nearline storage media may include the following steps:

[0069] Calculate the bandwidth of non-hot data based on the number of times non-hot data is accessed;

[0070] Determine if the bandwidth is lower than a preset threshold; the preset threshold is a preset ratio of the second bandwidth.

[0071] If so, the non-hot data will be migrated to nearline storage media.

[0072] This application provides a method for migrating non-hot data to nearline storage media. Specifically, after identifying the non-hot data in the enterprise-level disk, the bandwidth of each non-hot data can be calculated based on the number of accesses to the non-hot data. Furthermore, for each non-hot data, it can be determined whether its bandwidth is lower than a preset threshold, and the non-hot data with bandwidth lower than the preset threshold is migrated to the nearline storage media.

[0073] The preset threshold refers to a preset proportion of the second bandwidth, such as 10% of the second bandwidth. This means that when the bandwidth of non-hot data is lower than 10% of the second bandwidth, data migration is possible; when the bandwidth of non-hot data is not lower than 10% of the second bandwidth, data migration is not performed. This allows data migration to be achieved while ensuring the storage performance of the near-line storage medium, avoiding the instability caused by excessive data migration. Similarly, the preset proportion value does not affect the implementation of the technical solution of this application; it can be set by technical personnel according to the actual situation, and this application does not impose any limitations on it.

[0074] In one embodiment of this application, the above-described migration of non-hot data to nearline storage media may include the following steps:

[0075] Compress non-thermal data to obtain compressed data;

[0076] Migrate compressed data to nearline storage media.

[0077] The data migration method provided in this application can also perform compression processing on non-hot data before data migration to improve data migration efficiency and stability. Specifically, after identifying the non-hot data to be migrated from the enterprise-level disk, it can be compressed before being migrated to the near-line storage medium to obtain compressed non-hot data, i.e., the compressed data mentioned above, and then the compressed data is migrated to the near-line storage medium. It is understood that data migration in the form of compressed packages can effectively simplify the amount of data migration, improve data migration efficiency, and also ensure the stability of non-hot data during the migration process. Of course, the data compression process can adopt any of the existing technologies, which will not be elaborated here.

[0078] In addition, the need to compress non-hot data can be determined based on the amount of non-hot data to be migrated. For example, when the amount of non-hot data to be migrated is large, a compression-then-migration approach can be adopted, while when the amount of non-hot data to be migrated is small, a direct migration approach can be adopted.

[0079] In one embodiment of this application, the data migration method may further include the following steps:

[0080] When the first bandwidth does not exceed the first preset threshold, or the second bandwidth is not lower than the second preset threshold, return to the step of monitoring the bandwidth of the enterprise-class disk and the nearline storage medium to obtain the first bandwidth of the enterprise-class disk and the second bandwidth of the nearline storage medium.

[0081] The data migration method provided in this application aims to achieve cyclic monitoring. If the first bandwidth does not exceed the first preset threshold or the second bandwidth is not lower than the second preset threshold, it indicates that the storage pressure of the enterprise-level disk is not high, or the storage pressure of the near-line storage medium is high. At this time, the data migration operation is not performed. Therefore, the step of monitoring the bandwidth of the enterprise-level disk and the near-line storage medium in S101 can be returned.

[0082] Based on the above embodiments:

[0083] This application provides another data migration method, the implementation process of which can be divided into the following two stages:

[0084] Phase 1: Set the limit conditions for Enterprise media (i.e., enterprise-level disks) and Nearline media (i.e., nearline storage media) respectively, and calculate the current bandwidth of Enterprise media and Nearline media respectively. When the current bandwidth of Enterprise media (i.e., the first bandwidth) reaches more than 80% of the bandwidth (exceeding the first preset threshold), and the current bandwidth of Nearline media (i.e., the second bandwidth) is less than 50% of the bandwidth (less than the second preset threshold), proceed to Phase 2.

[0085] Phase 2: Generate a data migration plan:

[0086] The bandwidth of each stored data in the Entropy medium is calculated based on the number of accesses. For stored data with a bandwidth less than 10% of the first bandwidth, it is regarded as non-hot data to be migrated and migrated from the Entropy medium to the Nearline medium. During the data migration, a method of compression before migration can be adopted.

[0087] As can be seen, the data migration method provided in this application embodiment stores more data information in the storage system on the enterprise-level disk, while the near-line storage medium is only used to store a small amount of cold data. Based on this, the bandwidth of both can be monitored in real time. When the bandwidth of both meets the corresponding preset conditions, the non-hot data in the enterprise-level disk can be migrated to the near-line storage medium for storage. This realizes the migration of some non-hot data in the enterprise-level disk to the lower-performance near-line storage medium based on bandwidth parameters, reducing the storage pressure on the enterprise-level disk, giving full play to the storage performance of the near-line storage medium, thereby effectively improving the storage performance of the storage system and realizing stable storage of data information.

[0088] This application provides a data migration apparatus.

[0089] Please refer to Figure 2 , Figure 2 This application provides a schematic diagram of the structure of a data migration apparatus, which may include:

[0090] Monitoring module 1 is used to monitor the bandwidth of enterprise-level disks and nearline storage media to obtain the first bandwidth of enterprise-level disks and the second bandwidth of nearline storage media.

[0091] Module 2 is used to determine non-hot data in the enterprise-level disk when the first bandwidth exceeds the first preset threshold and the second bandwidth is lower than the second preset threshold;

[0092] Migration module 3 is used to migrate non-hot data to nearline storage media.

[0093] As can be seen, in the data migration device provided in this application embodiment, most of the data information is stored in the enterprise-level disk in the storage system, while the near-line storage medium is only used to store a small amount of cold data. Based on this, the bandwidth of both can be monitored in real time. When the bandwidth of both meets the corresponding preset conditions, the non-hot data in the enterprise-level disk can be migrated to the near-line storage medium for storage. This realizes the migration of some non-hot data in the enterprise-level disk to the lower-performance near-line storage medium based on bandwidth parameters, reducing the storage pressure on the enterprise-level disk, giving full play to the storage performance of the near-line storage medium, thereby effectively improving the storage performance of the storage system and realizing stable storage of data information.

[0094] In one embodiment of this application, the data migration apparatus may further include a limit condition setting module, used to set corresponding limit conditions for the enterprise-level disk and the nearline storage medium respectively before performing bandwidth monitoring on the enterprise-level disk and the nearline storage medium to obtain the first bandwidth of the enterprise-level disk and the second bandwidth of the nearline storage medium, so as to perform the step of bandwidth monitoring on the enterprise-level disk and the nearline storage medium to obtain the first bandwidth of the enterprise-level disk and the second bandwidth of the nearline storage medium under the limit conditions.

[0095] In one embodiment of this application, the monitoring module 1 may include:

[0096] The first calculation unit is used to calculate the first total bandwidth of the enterprise-level disk within a first preset time period, and to calculate the bandwidth per unit time based on the first total bandwidth to obtain the first bandwidth.

[0097] The second calculation unit is used to calculate the second total bandwidth of the near-line storage medium within a second preset time period, and to calculate the bandwidth per unit time based on the second total bandwidth to obtain the second bandwidth.

[0098] In one embodiment of this application, the determining module 2 may include:

[0099] The acquisition unit is used to acquire the number of accesses to each storage data in the enterprise-level disk.

[0100] The determination unit is used to classify stored data that has been accessed less than a preset number of times as non-hot data.

[0101] In one embodiment of this application, the migration module 3 may include:

[0102] The calculation unit is used to calculate the bandwidth of non-hot data based on the number of times non-hot data is accessed;

[0103] The judgment unit is used to determine whether the bandwidth is lower than a preset threshold; the preset threshold is a preset ratio value of the second bandwidth.

[0104] The migration unit is used to migrate non-hot data to nearline storage media if the bandwidth is lower than a preset threshold.

[0105] In one embodiment of this application, the migration module 3 described above can be specifically used to compress non-hot data to obtain compressed data; and to migrate the compressed data to a nearline storage medium.

[0106] In one embodiment of this application, the data migration device may further include a loop module, used to return to the step of monitoring the bandwidth of the enterprise-class disk and the nearline storage medium to obtain the first bandwidth of the enterprise-class disk and the second bandwidth of the nearline storage medium when the first bandwidth does not exceed the first preset threshold or the second bandwidth is not lower than the second preset threshold.

[0107] For a description of the apparatus provided in the embodiments of this application, please refer to the above method embodiments; further details will not be repeated here.

[0108] This application provides an electronic device.

[0109] Please refer to Figure 3 , Figure 3 This application provides a schematic diagram of the structure of an electronic device, which may include:

[0110] Memory, used to store computer programs;

[0111] A processor, used to execute computer programs, can implement the steps of any of the data migration methods described above.

[0112] like Figure 3 The diagram shows the structural composition of an electronic device, which may include a processor 10, a memory 11, a communication interface 12, and a communication bus 13. The processor 10, memory 11, and communication interface 12 all communicate with each other through the communication bus 13.

[0113] In this embodiment, the processor 10 may be a central processing unit (CPU), an application-specific integrated circuit, a digital signal processor, a field-programmable gate array, or other programmable logic devices.

[0114] The processor 10 can call programs stored in the memory 11. Specifically, the processor 10 can execute operations in the embodiments of the data migration method.

[0115] The memory 11 is used to store one or more programs. The programs may include program code, which includes computer operation instructions. In this embodiment, the memory 11 stores at least a program for implementing the following functions:

[0116] Bandwidth monitoring is performed on enterprise-class disks and nearline storage media to obtain the first bandwidth of enterprise-class disks and the second bandwidth of nearline storage media.

[0117] When the first bandwidth exceeds the first preset threshold and the second bandwidth is lower than the second preset threshold, non-hot data in the enterprise-level disk is identified.

[0118] Migrate non-hot data to nearline storage media.

[0119] In one possible implementation, the memory 11 may include a program storage area and a data storage area, wherein the program storage area may store the operating system and applications required for at least one function; and the data storage area may store data created during use.

[0120] In addition, memory 11 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device or other volatile solid-state storage device.

[0121] Communication interface 12 can be an interface for the communication module, used to connect with other devices or systems.

[0122] Of course, it should be noted that, Figure 3 The structure shown does not constitute a limitation on the electronic device in the embodiments of this application. In practical applications, the electronic device may include more than Figure 3 More or fewer components as shown, or combinations of certain components.

[0123] This application provides a computer-readable storage medium.

[0124] The computer-readable storage medium provided in this application embodiment stores a computer program, which, when executed by a processor, can implement the steps of any of the data migration methods described above.

[0125] The computer-readable storage medium may include various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0126] For a description of the computer-readable storage medium provided in the embodiments of this application, please refer to the above method embodiments; further details will not be repeated here.

[0127] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since it corresponds to the method disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to the method section.

[0128] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0129] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein can be implemented directly by hardware, a software module executed by a processor, or a combination of both. The software module can be located in random access memory (RAM), main memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.

[0130] The technical solutions provided in this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the embodiments above are only for the purpose of helping to understand the methods and core ideas of this application. It should be noted that those skilled in the art can make several improvements and modifications to this application without departing from the principles of this application, and these improvements and modifications also fall within the protection scope of this application.

Claims

1. A data migration method, characterized in that, include: Bandwidth monitoring is performed on enterprise-class disks and nearline storage media to obtain a first bandwidth of the enterprise-class disks and a second bandwidth of the nearline storage media. When the first bandwidth exceeds the first preset threshold and the second bandwidth is lower than the second preset threshold, non-hot data in the enterprise-level disk is determined. The non-hot data is migrated to the nearline storage medium; The step of determining non-hot data in the enterprise-level disk includes: obtaining the access count of each piece of stored data in the enterprise-level disk; and identifying the stored data with an access count lower than a preset number as the non-hot data. The step of migrating the non-hot data to the nearline storage medium includes: calculating the bandwidth of the non-hot data based on the number of accesses to the non-hot data; determining whether the bandwidth is lower than a preset threshold; the preset threshold is a preset proportion of the second bandwidth; if so, then migrating the non-hot data to the nearline storage medium.

2. The data migration method according to claim 1, characterized in that, Before performing bandwidth monitoring on the enterprise-grade disk and nearline storage media to obtain the first bandwidth of the enterprise-grade disk and the second bandwidth of the nearline storage media, the method further includes: Set corresponding limit conditions for the enterprise-class disk and the nearline storage medium respectively, and perform the step of bandwidth monitoring of the enterprise-class disk and the nearline storage medium under the limit conditions to obtain the first bandwidth of the enterprise-class disk and the second bandwidth of the nearline storage medium.

3. The data migration method according to claim 1, characterized in that, The bandwidth monitoring of enterprise-grade disks and nearline storage media to obtain a first bandwidth of the enterprise-grade disks and a second bandwidth of the nearline storage media includes: The first total bandwidth of the enterprise-level disk within a first preset time period is calculated, and the bandwidth per unit time is calculated based on the first total bandwidth to obtain the first bandwidth; The second total bandwidth of the nearline storage medium within a second preset time period is statistically analyzed, and the bandwidth per unit time is calculated based on the second total bandwidth to obtain the second bandwidth.

4. The data migration method according to claim 1, characterized in that, The migration of the non-hot data to the nearline storage medium includes: The non-thermal data is compressed to obtain compressed data; The compressed data is migrated to the nearline storage medium.

5. The data migration method according to claim 1, characterized in that, Also includes: When the first bandwidth does not exceed the first preset threshold, or the second bandwidth is not lower than the second preset threshold, return to the step of monitoring the bandwidth of the enterprise-level disk and the nearline storage medium to obtain the first bandwidth of the enterprise-level disk and the second bandwidth of the nearline storage medium.

6. A data migration device, characterized in that, include: The monitoring module is used to monitor the bandwidth of enterprise-class disks and nearline storage media, and to obtain the first bandwidth of the enterprise-class disks and the second bandwidth of the nearline storage media. The determination module is used to determine non-hot data in the enterprise-level disk when the first bandwidth exceeds a first preset threshold and the second bandwidth is lower than a second preset threshold; A migration module is used to migrate the non-hot data to the nearline storage medium; The determining module is specifically used to obtain the number of accesses to each stored data in the enterprise-level disk; The stored data whose access count is less than a preset number is considered as the non-hot data; The migration module is specifically used to calculate the bandwidth of the non-hot data based on the number of accesses to the non-hot data; determine whether the bandwidth is lower than a preset threshold; the preset threshold is a preset ratio of the second bandwidth; if so, the non-hot data is migrated to the nearline storage medium.

7. An electronic device, characterized in that, include: Memory, used to store computer programs; A processor for executing the computer program to implement the steps of the data migration method as described in any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of the data migration method as described in any one of claims 1 to 5.

Images