A data storage method, system, terminal and medium for multi-hard disk coordination

Abstract

The present invention discloses a data storage method, system, terminal and medium for multi-hard disk coordination. By obtaining hard disk information within a historical period through SMART information, analyzing and processing the hard disk information to obtain worn sectors, and analyzing the worn sectors to obtain a hard disk analysis value, so as to reflect the wear degree of the overall sectors in the hard disk. At the same time, based on the hard disk analysis value, multiple hard disks are classified and distinguished to obtain hard disks to be coordinated and normal hard disks. Sorting is performed according to the size of the hard disk analysis value corresponding to the hard disks to be coordinated to obtain a table of hard disks to be coordinated. Then, analyzing the historical storage information of the hard disks to be coordinated in the table of hard disks to be coordinated within multiple historical periods to obtain a storage risk value, and reflecting the data storage stability degree of the hard disks to be coordinated within multiple historical periods through the storage risk value. Finally, determining the coordinated hard disks in the table of hard disks to be coordinated.

Description

Technical Field

[0001] The present invention relates to the technical field of data storage, and particularly to a data storage method, system, terminal and medium for multi-hard disk coordination. Background Art

[0002] SMART is a hard disk health monitoring technology that can monitor the health status of hard disks in real time. When multi-hard disk coordinated storage data migration is required, by analyzing the health status of hard disks and the loss of stored data in the hard disks to be coordinated in multiple consecutive historical periods, the hard disks to be coordinated are determined. At the same time, the stored data in the hard disks to be coordinated is further analyzed, and the analysis results are used as the basis for migration coordination priorities, so as to solve the problems of migration failure or data loss caused by insufficient storage space during the coordinated hard disk data migration process.

[0003] In the prior art, during multi-hard disk coordinated storage data migration, there are problems of migration failure or data loss of stored data due to insufficient storage space of hard disks. Therefore, by obtaining and analyzing the storage sector status of hard disks through SMART information, a hard disk analysis value is obtained, which reflects the health status of the hard disks. The hard disks to be coordinated are screened out, and through the loss of stored data in the hard disks to be coordinated in multiple consecutive historical periods, a storage risk value is obtained, and the coordinated hard disks are further screened out. For the screened coordinated hard disks, by analyzing the access situation of the stored data in the coordinated hard disks in multiple consecutive historical periods, a migration priority value is obtained, and at the same time, combined with the storage risk value, the problem of how to reasonably determine the data migration priority is solved. Finally, by comparing the priority migration data with the remaining storage capacity of normal hard disks, the problems of migration failure or data loss caused by insufficient storage space during the coordinated hard disk data migration process are solved. Summary of the Invention

[0004] The purpose of the present invention is to provide a data storage method, system, terminal and medium for multi-hard disk coordination to solve at least one of the above-mentioned prior art problems.

[0005] The purpose of the present invention can be achieved by the following technical solutions:

[0006] In a first aspect, a data storage method for multi-hard disk coordination according to the present invention includes:

[0007] Step 1: Obtain hard disk information within a historical period through SMART information, where the hard disk information includes storage sectors, perform analysis and processing based on the storage sectors to obtain worn sectors, analyze the worn sectors in the hard disk to obtain the number of worn sectors and the wear degree value, and perform analysis and processing on the number of worn sectors and the wear degree value, and output to obtain a hard disk analysis value;

[0008] Step 2: Based on the hard disk analysis value, compare the hard disk analysis value with the hard disk analysis threshold. If the hard disk analysis value is less than or equal to the hard disk analysis threshold, mark it as a normal hard disk. If the hard disk analysis value is greater than the hard disk analysis threshold, mark it as a hard disk to be coordinated, and summarize multiple hard disks to be coordinated to obtain a coordination table. Based on the coordination table, obtain the historical storage information of the hard disks to be coordinated in multiple consecutive historical periods through SMART information. Among them, the historical storage information includes the storage loss frequency and the storage loss amount. Analyze the storage loss frequency and the storage loss amount to obtain a storage risk value, and compare it with the storage risk threshold. If the storage risk value is greater than the storage risk threshold, generate a migration coordination signal to obtain coordinated hard disks;

[0009] Step 3: Based on the migration coordination signal, analyze the stored data of the coordinated hard disks in multiple consecutive historical periods to obtain a data access value and an access stability value. Add the data access value and the access stability value to obtain a migration priority value, and analyze and process the migration priority value and the storage risk value to obtain a migration sorting value. Based on the migration sorting value, summarize the coordinated hard disks to obtain a coordinated hard disk table;

[0010] Step 4: In the coordinated hard disk table, obtain the priority migration memory corresponding to the data to be migrated first in the coordinated hard disks. At the same time, obtain the remaining storage capacity of the normal hard disks, and compare and process the priority migration memory corresponding to the stored data in the coordinated hard disks with the remaining storage capacity of the normal hard disks to complete the coordination work of migrating the stored data and solve the problem of migrating the data of the coordinated hard disks.

[0011] As a further solution of the present invention: The acquisition method of the worn sectors is as follows:

[0012] Obtain the storage sectors of the hard disk through SMART information and analyze the storage sectors. The process is as follows:

[0013] Divide the historical period into several analysis time periods, obtain the reading speed of the storage sectors in the analysis time periods, calculate the ratio of the reading speed of the storage sectors in the analysis time periods to the reading speed threshold to obtain a reading analysis value;

[0014] Sum up and average the reading analysis values corresponding to all analysis time periods to obtain a sector wear value;

[0015] Compare the sector wear value with the sector wear threshold. If the sector wear value is greater than the sector wear threshold, that is, the analyzed storage sectors in the hard disk are worn more, mark the storage sectors with greater wear in the hard disk as worn sectors.

[0016] As a further solution of the present invention: The acquisition method of the hard disk analysis value is as follows:

[0017] Count the number of worn sectors in the hard disk, and calculate the ratio with the total number of storage sectors in the hard disk to obtain the number of worn sectors;

[0018] Obtain the sector wear value corresponding to the worn sector, subtract the sector wear value corresponding to the worn sector from the sector wear threshold, and calculate the ratio with the sector wear threshold to obtain the wear degree value;

[0019] Multiply the number of worn sectors by the wear degree value to obtain the hard disk analysis value.

[0020] As a further solution of the present invention: the acquisition method of the storage risk value is as follows:

[0021] Based on multiple consecutive historical periods, arbitrarily select one historical period as the target period, and divide the target period into several target time periods;

[0022] Obtain the number of data loss times within the target time period, calculate the ratio of the number of data loss times within the target time period to the total number of data storage times within the target time period to obtain the time period loss frequency;

[0023] Calculate the average value of the time period loss frequencies within all target time periods to obtain the storage loss frequency, and mark it as ;

[0024] Obtain the number of data loss within the target time period, calculate the ratio of the number of data loss within the target time period to the total number of data storage times within the target time period to obtain the time period loss amount;

[0025] Calculate the average value of the time period loss amounts within all target time periods to obtain the storage loss amount, and mark it as ;

[0026] Substitute the storage loss frequency and the storage loss amount into the formula: , calculate to obtain the cycle risk value , where , represent preset proportionality coefficients;

[0027] Sum up and take the average value of the cycle risk values corresponding to all historical periods to obtain the storage risk value .

[0028] As a further solution of the present invention: the acquisition method of the migration priority value is as follows:

[0029] Based on multiple historical periods, arbitrarily select one historical period as the target period, and divide the target period into several target time periods;

[0030] Obtain the number of accesses to the stored data during the target period, calculate the ratio of the number of accesses to the stored data during the target period to the duration of the target period to obtain the access frequency;

[0031] Sum up and average the access frequencies during all target periods to obtain the data access value;

[0032] The access stability value is obtained as follows:

[0033] Establish a two-dimensional coordinate system, mark the data access values corresponding to the historical period on the Y-axis of the two-dimensional coordinate system to obtain the access change curve;

[0034] Within the access change curve, mark the data access threshold on the Y-axis and draw a straight line parallel to the X-axis as the threshold reference line, where the threshold reference line intersects the access change curve;

[0035] Extract the access change curve above the threshold reference line and obtain the number of access change curves above the threshold reference line to get the out-of-bounds number;

[0036] Calculate the ratio of the out-of-bounds number to the out-of-bounds number threshold to obtain the out-of-bounds number ratio;

[0037] Statistically calculate the length of the access change curve above the threshold reference line and calculate the ratio to the total length of the access change curve to obtain the out-of-bounds length value;

[0038] Calculate the product of the out-of-bounds number and the out-of-bounds length value to obtain the access stability value.

[0039] As a further solution of the present invention, the migration sorting value is obtained as follows:

[0040] Compare the migration coordination value with the migration coordination threshold, and the process is as follows;

[0041] If the migration coordination value is greater than or equal to the migration coordination threshold, mark the stored data analyzed in the coordination hard disk as the priority migration data;

[0042] Obtain the number of priority migration data and calculate the ratio to the total amount of stored data in the coordination hard disk to obtain the priority migration quantity;

[0043] Obtain the memory of the priority migration quantity and calculate the ratio to the total memory of the stored data in the coordination hard disk to obtain the priority migration memory;

[0044] Multiply the priority migration quantity by the priority migration memory to calculate the migration sorting value.

[0045] As a further solution of the present invention: in the coordinated hard disk table, extract the first coordinated hard disk in the sorting, and obtain the priority migration memory corresponding to the first coordinated hard disk in the sorting ;

[0046] Compare the priority migration memory corresponding to the first coordinated hard disk in the sorting with the remaining storage capacity of the normal hard disk. The process is as follows:

[0047] If there is a normal hard disk with a remaining storage capacity greater than or equal to the priority migration memory corresponding to the first coordinated hard disk in the sorting, then preferentially migrate the priority migration data in the first coordinated hard disk to the normal hard disk;

[0048] If there is no normal hard disk with a remaining storage capacity greater than or equal to the priority migration memory corresponding to the first coordinated hard disk in the sorting, then perform data memory compression processing on the priority migration data in the first coordinated hard disk. The process is as follows:

[0049] Compare the normal hard disks according to the remaining storage capacity of the normal hard disks, sort them in descending order, and extract the normal hard disk with the largest remaining storage capacity as the first normal migration hard disk of the first coordinated hard disk;

[0050] Mark the remaining storage capacity of the first normal migration hard disk as , and through the formula: , calculate the maximum value of the compressed memory of the priority migration data in the first coordinated hard disk;

[0051] Traverse the priority migration data in all coordinated hard disks in the coordinated hard disk table, and perform analysis and processing according to the sorting of the coordinated hard disks in the coordinated hard disk table until the coordination work of the priority migration data in all coordinated hard disks in the coordinated hard disk table is completed.

[0052] In the second aspect, a data storage system for multi-hard disk coordination includes:

[0053] Hard disk wear evaluation module: Obtain the hard disk information in the historical period through SMART information. Among them, the hard disk information includes storage sectors. Based on the storage sectors, analyze and process to obtain worn sectors, and analyze the worn sectors in the hard disk to obtain the number of worn sectors and the wear degree value. Analyze and process the number of worn sectors and the wear degree value, and output to obtain the hard disk analysis value;

[0054] Hard disk analysis and coordination module: Based on the hard disk analysis value, compare the hard disk analysis value with the hard disk analysis threshold. If the hard disk analysis value is less than or equal to the hard disk analysis threshold, mark it as a normal hard disk. If the hard disk analysis value is greater than the hard disk analysis threshold, mark it as a hard disk to be coordinated, and summarize multiple hard disks to be coordinated to obtain a coordination table. Based on the coordination table, obtain the historical storage information of the hard disks to be coordinated in multiple consecutive historical periods through SMART information. Among them, the historical storage information includes the storage loss frequency and the storage loss amount. Analyze the storage loss frequency and the storage loss amount to obtain a storage risk value, and compare it with the storage risk threshold. If the storage risk value is greater than the storage risk threshold, generate a migration coordination signal to obtain coordinated hard disks;

[0055] Storage data analysis module: Based on the migration coordination signal, analyze the storage data of the coordinated hard disks in multiple consecutive historical periods to obtain a data access value and an access stability value. Add the data access value and the access stability value to obtain a migration priority value, and analyze and process the migration priority value and the storage risk value to obtain a migration sorting value. Based on the migration sorting value, summarize the coordinated hard disks to obtain a coordinated hard disk table;

[0056] Coordination migration planning module: In the coordinated hard disk table, obtain the priority migration memory corresponding to the data to be migrated first in the coordinated hard disks. At the same time, obtain the remaining storage capacity of the normal hard disks, and compare and process the priority migration memory corresponding to the storage data in the coordinated hard disks with the remaining storage capacity of the normal hard disks to complete the coordination work of storing data migration and solve the problem of data migration of the coordinated hard disks.

[0057] In a third aspect, a data storage terminal for multi-hard disk coordination includes:

[0058] A memory 302, a processor 301, and a computer program 303 stored on the memory 302. When the computer program 303 is executed on the processor 301, the steps of the above method are implemented.

[0059] In a fourth aspect, a data storage medium for multi-hard disk coordination includes:

[0060] When the computer program runs on the processor, the steps of the above method are implemented.

[0061] Advantages of the present invention:

[0062] 1. The present invention obtains the hard disk information within the historical period through SMART information, analyzes and processes the hard disk information to obtain worn sectors, and analyzes the worn sectors to obtain a hard disk analysis value, thereby reflecting the wear degree of the overall sectors within the hard disk. At the same time, based on the hard disk analysis value, multiple hard disks are classified and distinguished to obtain hard disks to be coordinated and normal hard disks. Sorting is performed according to the size of the hard disk analysis value corresponding to the hard disks to be coordinated to obtain a table of hard disks to be coordinated. Then, the historical storage information of the hard disks to be coordinated in the table of hard disks to be coordinated within multiple historical periods is analyzed to obtain a storage risk value, and the data storage stability degree of the hard disks to be coordinated within multiple historical periods is reflected through the storage risk value. Finally, the coordinated hard disks in the table of hard disks to be coordinated are determined;

[0063] 2. The present invention analyzes the stored data of the coordinated hard disks within multiple consecutive historical periods based on the migration coordination signal to obtain a data access value and an access stability value. The data access value and the access stability value are analyzed and processed to obtain a migration priority value, and the migration priority value and the storage risk value are analyzed and processed to obtain a migration coordination value. Thus, the migration priority of the stored data in the coordinated hard disks is reflected through the migration coordination value, and the coordinated hard disks are sorted to obtain a table of coordinated hard disks. Furthermore, the stored data in the coordinated hard disks is migrated one by one according to the table of coordinated hard disks;

[0064] 3. In the table of coordinated hard disks, the present invention obtains the priority migration memory corresponding to the data to be migrated first in the coordinated hard disks. At the same time, the remaining storage capacity of the normal hard disks is obtained, and the priority migration memory corresponding to the stored data in the coordinated hard disks is compared with the remaining storage capacity of the normal hard disks. Thus, according to the remaining storage space of the normal hard disks, the problem of migration failure or data loss caused by insufficient storage space during the data migration process of the coordinated hard disks is avoided, and the balanced allocation of storage resources is realized. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0066] Figure 1 FIG. is a flowchart of the steps for screening coordinated hard disks in a data storage method for coordinating multiple hard disks provided in Embodiment 1 of the present invention;

[0067] Figure 2 FIG. is a flowchart of the steps for coordinating stored data in a data storage method for coordinating multiple hard disks provided in Embodiments 2 and 3 of the present invention;

[0068] Figure 3It is a schematic structural diagram of a multi - hard - disk coordinated data storage system provided by Embodiment 4 of the present invention;

[0069] Figure 4 It is a schematic structural diagram of a multi - hard - disk coordinated data storage device provided by Embodiment 5 of the present invention. Detailed implementation manners

[0070] In order to enable those skilled in the art to better understand the solution of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0071] Embodiment 1

[0072] Figure 1 It is a flowchart of a multi - hard - disk coordinated data storage method provided by Embodiment 1 of the present invention. The embodiments of the present invention are applicable to the situation of determining the overall sector wear degree of a hard disk based on the wear degrees of multiple sectors in the hard disk. This multi - hard - disk coordinated data storage method can be executed by a multi - hard - disk coordinated data storage system, which can be implemented by software and / or hardware, and can be configured in a multi - hard - disk coordinated data storage device. Optionally, a multi - hard - disk coordinated data storage device can be an electronic device, such as a notebook, a desktop computer, and a smart tablet, etc., and the embodiments of the present invention do not limit this.

[0073] As Figure 1 shown, a multi - hard - disk coordinated data storage method provided by the embodiments of the present invention specifically includes the following steps:

[0074] Step 1: Obtain hard - disk information within a historical period through SMART information. The hard - disk information includes storage sectors. Based on the storage sectors, perform analysis and processing to obtain worn sectors, and analyze the worn sectors in the hard disk to obtain the number of worn sectors and the wear - degree value. Analyze and process the number of worn sectors and the wear - degree value, and output to obtain a hard - disk analysis value;

[0075] In some embodiments, the process of obtaining the storage sectors of the hard disk through SMART information and analyzing the storage sectors is as follows:

[0076] Divide the historical period into several analysis time periods, obtain the reading speed of the storage sectors within the analysis time periods, calculate the ratio of the reading speed of the storage sectors within the analysis time periods to the reading - speed threshold to obtain a reading - analysis value;

[0077] Sum up and average the read analysis values corresponding to all analysis periods to obtain the sector wear value;

[0078] It should be noted that the historical period is divided in equal time intervals;

[0079] Compare the sector wear value with the sector wear threshold, and the process is as follows:

[0080] If the sector wear value is greater than the sector wear threshold, that is, the analyzed storage sectors in the hard disk have a large wear, mark the storage sectors with large wear in the hard disk as worn sectors;

[0081] If the sector wear value is less than or equal to the sector wear threshold, that is, the analyzed storage sectors in the hard disk have a small wear, mark the storage sectors with small wear in the hard disk as normal sectors;

[0082] Count the number of worn sectors in the hard disk and calculate the ratio with the total number of storage sectors in the hard disk to obtain the number of worn sectors;

[0083] Obtain the sector wear value corresponding to the worn sectors, subtract the sector wear value corresponding to the worn sectors from the sector wear threshold, and calculate the ratio with the sector wear threshold to obtain the wear degree value;

[0084] Multiply the number of worn sectors by the wear degree value to obtain the hard disk analysis value;

[0085] It can be understood that the meaning represented by the hard disk analysis value is: it reflects the wear degree of the overall sectors in the hard disk, that is, it intuitively presents the data storage stability of the hard disk in a quantitative way. Specifically, if this value is larger, it means that the proportion of worn sectors in the hard disk is relatively high and the wear degree of the worn sectors is relatively large, that is, the probability of data loss in the hard disk is relatively large. On the contrary, if this value is smaller, it means that the proportion of worn sectors in the hard disk is relatively low and the wear degree of the worn sectors is relatively small, that is, the probability of data loss in the hard disk is relatively small;

[0086] Step 2: Based on the hard disk analysis value, compare the hard disk analysis value with the hard disk analysis threshold. If the hard disk analysis value is less than or equal to the hard disk analysis threshold, mark it as a normal hard disk. If the hard disk analysis value is greater than the hard disk analysis threshold, mark it as a hard disk to be coordinated, and summarize multiple hard disks to be coordinated to obtain a coordination table. Based on the coordination table, obtain the historical storage information of the hard disks to be coordinated in multiple consecutive historical periods through SMART information. Among them, the historical storage information includes the storage loss frequency and the storage loss amount. Analyze the storage loss frequency and the storage loss amount to obtain the storage risk value, and compare it with the storage risk threshold. If the storage risk value is greater than the storage risk threshold, generate a migration coordination signal to obtain the coordinated hard disk;

[0087] In some embodiments, the hard disk analysis value is compared with the hard disk analysis threshold, and the process is as follows;

[0088] If the hard disk analysis value is greater than the hard disk analysis threshold, it indicates that the proportion of worn sectors in the hard disk is relatively high, and the degree of wear of the worn sectors is relatively large, that is, the probability of data storage loss in the hard disk is relatively large. The hard disk with a relatively large probability of data storage loss is marked as a hard disk to be coordinated;

[0089] If the hard disk analysis value is less than or equal to the hard disk analysis threshold, it indicates that the proportion of worn sectors in the hard disk is relatively low, and the degree of wear of the worn sectors is relatively small, that is, the probability of data loss in the hard disk is relatively small. The hard disk with a relatively small probability of data loss is marked as a normal hard disk;

[0090] Obtain the hard disk analysis values corresponding to the hard disks to be coordinated, compare their sizes, and sort them in descending order to obtain a coordination table;

[0091] Based on multiple consecutive historical periods, arbitrarily select one historical period as the target period, and divide the target period into several target time periods;

[0092] It should be noted that the way of dividing the target period is the same as the way of dividing the historical period;

[0093] Obtain the number of data loss times within the target time period, calculate the ratio of the number of data loss times within the target time period to the total number of data storage times within the target time period to obtain the time period loss frequency;

[0094] Calculate the average value of the time period loss frequencies within all target time periods to obtain the storage loss frequency, and mark it as ;

[0095] Obtain the number of data loss within the target time period, calculate the ratio of the number of data loss within the target time period to the total number of data storage within the target time period to obtain the time period loss quantity;

[0096] Calculate the average value of the time period loss quantities within all target time periods to obtain the storage loss quantity, and mark it as ;

[0097] Substitute the storage loss frequency and the storage loss quantity into the formula: to calculate the cycle risk value , where , represent preset proportionality coefficients, and takes the value of 3.2344, takes the value of 1.3576;

[0098] Sum up the cycle risk values corresponding to all historical cycles and take the average to obtain the storage risk value ;

[0099] It can be understood that the meaning represented by the storage risk value is: it reflects the data storage stability degree of the hard disk to be coordinated in multiple historical cycles. Specifically, the larger this value is, the higher the data loss frequency and the larger the data loss amount of the hard disk to be coordinated in multiple historical cycles, and the less stable the data storage of the hard disk to be coordinated. On the contrary, the smaller this value is, the lower the data loss frequency and the smaller the data loss amount of the hard disk to be coordinated in multiple historical cycles, and the more stable the data storage of the hard disk to be coordinated;

[0100] Compare the storage risk value with the storage risk threshold, and the process is as follows:

[0101] If the storage risk value is greater than the storage risk threshold, it means that the data loss frequency of the hard disk to be coordinated in multiple historical cycles is higher, and the data loss amount is larger, and the data storage loss risk of the hard disk to be coordinated is greater. Generate a migration coordination signal and mark the hard disk to be coordinated corresponding to the migration coordination signal as a coordinated hard disk;

[0102] If the storage risk value is less than or equal to the storage risk threshold, it means that the data loss frequency of the hard disk to be coordinated in multiple historical cycles is lower, and the data loss amount is smaller, that is, the data storage loss risk of the hard disk to be coordinated is smaller. Generate a small loss risk signal;

[0103] The specific implementation scheme of the embodiment of the present invention is: obtain the hard disk information in the historical cycle through SMART information, analyze and process the hard disk information to obtain the worn sectors, and analyze the worn sectors to obtain the hard disk analysis value, so as to reflect the wear degree of the overall sectors in the hard disk. At the same time, based on the hard disk analysis value, classify and distinguish multiple hard disks to obtain the hard disks to be coordinated and normal hard disks, sort according to the size of the hard disk analysis value corresponding to the hard disks to be coordinated to obtain a table of hard disks to be coordinated, then analyze the historical storage information of the hard disks to be coordinated in the table of hard disks to be coordinated in multiple historical cycles to obtain the storage risk value, and reflect the data storage stability degree of the hard disks to be coordinated in multiple historical cycles through the storage risk value, and finally determine the coordinated hard disks in the table of hard disks to be coordinated.

[0104] Embodiment 2

[0105] As Figure 1-2 shown, on the basis of Embodiment 1, a data storage method for multi-hard disk coordination described in the embodiment of the present invention includes:

[0106] Step 3: Based on the migration coordination signal, analyze the stored data of the coordinated hard disks in multiple consecutive historical periods to obtain the data access value and the access stability value. Analyze and process the data access value and the access stability value to obtain the migration priority value, and then analyze and process the migration priority value and the storage risk value to obtain the migration sorting value. Based on the migration sorting value, summarize the coordinated hard disks to obtain the coordinated hard disk table;

[0107] In some embodiments, based on multiple historical periods, arbitrarily select one historical period as the target period, and divide the target period into several target time periods;

[0108] It should be noted that the way of dividing the target period is the same as that of dividing the historical period;

[0109] Obtain the number of accesses of the stored data within the target time period, and calculate the ratio of the number of accesses of the stored data within the target time period to the target time period duration to obtain the access frequency;

[0110] Sum up and average the access frequencies within all target time periods to obtain the data access value;

[0111] Establish a two-dimensional coordinate system, where the X-axis is the historical period and the Y-axis is the data access value. Sort and mark multiple historical periods on the X-axis of the two-dimensional coordinate system in the order of time series, and mark the corresponding data access values of the historical periods on the Y-axis of the two-dimensional coordinate system to obtain the access change curve;

[0112] Within the access change curve, mark the data access threshold on the Y-axis and draw a straight line parallel to the X-axis as the threshold reference line, where the threshold reference line intersects the access change curve;

[0113] Extract the access change curve above the threshold reference line and obtain the number of access change curves above the threshold reference line to get the overrun number;

[0114] Calculate the ratio of the overrun number to the overrun number threshold to obtain the overrun number ratio;

[0115] It should be noted that the overrun number threshold is the total number of sub-curves obtained by dividing the access change curve with the intersection point as the reference point after the access change curve intersects the threshold reference line;

[0116] Statistically calculate the length of the access change curve above the threshold reference line and calculate the ratio to the total length of the access change curve to obtain the overrun length value;

[0117] Multiply the overrun number and the overrun length value to obtain the access stability value;

[0118] Add the data access value to the access stability value to obtain the migration priority value, and mark it as ;

[0119] Substitute the migration priority value and the storage risk value into the formula: to calculate the migration coordination value , where 、 represent preset proportionality coefficients, takes the value of 2.554, takes the value of 6.375;

[0120] It can be understood that the meaning represented by the migration coordination value is: by analyzing the historical access frequency and the stability of the access frequency of the stored data in the coordinated hard disk, it reflects the migration priority of the stored data in the coordinated hard disk. Specifically, if this value is larger, it means that the historical access frequency of the stored data in the coordinated hard disk is higher and the access frequency is more stable. On the contrary, if this value is smaller, it means that the historical access frequency of the stored data in the coordinated hard disk is lower and the access frequency is less stable;

[0121] Compare the migration coordination value with the migration coordination threshold, and the process is as follows;

[0122] If the migration coordination value is greater than or equal to the migration coordination threshold, mark the analyzed stored data in the coordinated hard disk as data to be migrated preferentially;

[0123] If the migration coordination value is less than the migration coordination threshold, mark the analyzed stored data in the coordinated hard disk as non-preferred migration data;

[0124] Obtain the number of data to be migrated preferentially, and calculate the ratio with the total amount of stored data in the coordinated hard disk to obtain the preferential migration quantity;

[0125] Obtain the memory of the preferential migration quantity, and calculate the ratio with the total memory of the stored data in the coordinated hard disk to obtain the preferential migration memory;

[0126] Multiply the preferential migration quantity by the preferential migration memory to calculate the migration sorting value;

[0127] Compare the migration sorting values corresponding to the coordinated hard disks, and sort them in descending order of the migration sorting values to obtain the coordinated hard disk table;

[0128] The specific implementation of the embodiment of the present invention is as follows: Based on the migration coordination signal, analyze the stored data of the coordinated hard disk in multiple consecutive historical cycles to obtain the data access value and the access stability value. Analyze and process the data access value and the access stability value to obtain the migration priority value, and analyze and process the migration priority value and the storage risk value to obtain the migration coordination value. Thus, the migration priority of the stored data in the coordinated hard disk is reflected by the migration coordination value, and the coordinated hard disks are sorted to obtain the coordinated hard disk table. Furthermore, the stored data in the coordinated hard disks is migrated one by one according to the coordinated hard disk table.

[0129] Embodiment III

[0130] As Figure 1-2 shown, based on Embodiments 1 and 2, a data storage method for multi-hard disk coordination according to an embodiment of the present invention includes:

[0131] Step 4: In the coordinated hard disk table, obtain the priority migration memory corresponding to the data to be migrated first in the coordinated hard disk. At the same time, obtain the remaining storage capacity of the normal hard disk, and compare and process the priority migration memory corresponding to the stored data in the coordinated hard disk with the remaining storage capacity of the normal hard disk to complete the migration coordination work of the stored data and solve the problem of data migration in the coordinated hard disk;

[0132] Exemplarily, in the coordinated hard disk table, extract the first coordinated hard disk in the sorting, and obtain the priority migration memory corresponding to the first coordinated hard disk in the sorting ;

[0133] Compare and process the priority migration memory corresponding to the first coordinated hard disk in the sorting with the remaining storage capacity of the normal hard disk. The process is as follows:

[0134] If there is a normal hard disk with a remaining storage capacity greater than or equal to the priority migration memory corresponding to the first coordinated hard disk in the sorting, then preferentially migrate the data to be migrated first in the first coordinated hard disk to the normal hard disk;

[0135] If there is no normal hard disk with a remaining storage capacity greater than or equal to the priority migration memory corresponding to the first coordinated hard disk in the sorting, then perform data memory compression processing on the data to be migrated first in the first coordinated hard disk. The process is as follows:

[0136] Compare the normal hard disks according to the remaining storage capacity of the normal hard disks, sort them in descending order, and extract the normal hard disk with the largest remaining storage capacity as the first normal migration hard disk of the first coordinated hard disk;

[0137] Mark the remaining storage capacity of the first normal migration hard disk as , and through the formula: , calculate the maximum value of the compressed memory of the data to be migrated first in the first coordinated hard disk;

[0138] Traverse and coordinate the data to be preferentially migrated in all coordinated hard disks in the coordinated hard disk table, and perform analysis and processing according to the sorting of the coordinated hard disks in the coordinated hard disk table until the coordination work of the data to be preferentially migrated in all coordinated hard disks in the coordinated hard disk table is completed;

[0139] The specific implementation scheme of the embodiment of the present invention is as follows: in the coordinated hard disk table, obtain the preferential migration memory corresponding to the data to be preferentially migrated in the coordinated hard disk. At the same time, obtain the remaining storage capacity of the normal hard disk, and compare and process the preferential migration memory corresponding to the stored data in the coordinated hard disk with the remaining storage capacity of the normal hard disk. Thus, according to the remaining storage space of the normal hard disk, the problem of migration failure or data loss caused by insufficient storage space during the data migration of the coordinated hard disk is avoided, and the balanced allocation of storage resources is realized.

[0140] Embodiment 4

[0141] Refer to Figure 3 , on the basis of Embodiment 1, Embodiment 2 and Embodiment 3, the embodiment of the present invention further provides a data storage system for multi-hard disk coordination, including:

[0142] Hard disk wear evaluation module: Obtain the hard disk information in the historical period through SMART information. Among them, the hard disk information includes storage sectors, analyze and process based on the storage sectors to obtain worn sectors, and analyze the worn sectors in the hard disk to obtain the number of worn sectors and the wear degree value. Analyze and process the number of worn sectors and the wear degree value, and output to obtain the hard disk analysis value;

[0143] Analysis hard disk coordination module: Based on the hard disk analysis value, compare the hard disk analysis value with the hard disk analysis threshold. If the hard disk analysis value is less than or equal to the hard disk analysis threshold, it is marked as a normal hard disk. If the hard disk analysis value is greater than the hard disk analysis threshold, it is marked as a hard disk to be coordinated, and summarize multiple hard disks to be coordinated to obtain a table of hard disks to be coordinated. Based on the table of hard disks to be coordinated, obtain the historical storage information of the hard disks to be coordinated in multiple consecutive historical periods through SMART information. Among them, the historical storage information includes the storage loss frequency and the storage loss amount. Analyze the storage loss frequency and the storage loss amount to obtain the storage risk value, and compare it with the storage risk threshold. If the storage risk value is greater than the storage risk threshold, generate a migration coordination signal to obtain a coordinated hard disk;

[0144] Storage data analysis module: Based on the migration coordination signal, analyze the stored data of the coordinated hard disk in multiple consecutive historical periods to obtain the data access value and the access stability value. Add the data access value and the access stability value to obtain the migration priority value, and analyze and process the migration priority value and the storage risk value to obtain the migration sorting value. Based on the migration sorting value, summarize the coordinated hard disks to obtain a coordinated hard disk table;

[0145] Coordination migration planning module: In the coordination hard disk table, obtain the priority migration memory corresponding to the data with priority migration in the coordination hard disk. At the same time, obtain the remaining storage capacity of the normal hard disk, and compare the priority migration memory corresponding to the stored data in the coordination hard disk with the remaining storage capacity of the normal hard disk to complete the coordination work of storing data migration and solve the problem of coordinating hard disk data migration.

[0146] Embodiment 5

[0147] Refer to Figure 4 Moreover, an embodiment of the present invention further provides a computer device 3, including: a memory 302, a processor 301, and a computer program 303 stored on the memory 302. When the computer program 303 is executed on the processor 301, it implements a multi-hard disk coordinated data storage method as described in any one of the above methods.

[0148] The computer device 3 may be a computing device such as a desktop computer, a notebook, a palm computer, and a cloud server. The computer device 3 may include, but is not limited to, a processor 301 and a memory 302. Those skilled in the art can understand that

[0149] Figure 4 merely examples of the computer device 3, which do not constitute a limitation on the computer device 3. It may include more or fewer components than shown in the figure, or combine some components, or different components. For example, it may also include input / output devices, network access devices, etc.

[0150] The so-called processor 301 may be a central processing unit (CPU), and the processor 301 may also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0151] In some embodiments, the memory 302 may be an internal storage unit of the computer device 3, such as a hard disk or memory of the computer device 3. In other embodiments, the memory 302 may also be an external storage device of the computer device 3, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a Flash Card, etc. equipped on the computer device 3. Further, the memory 302 may also include both the internal storage unit and the external storage device of the computer device 3. The memory 302 is used to store an operating system, application programs, a BootLoader, data, and other programs, such as program codes of the computer program. The memory 302 may also be used to temporarily store data that has been output or is to be output.

[0152] Embodiment Six

[0153] An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is run by a processor, it implements a method for coordinated data storage of multiple hard disks as described in any one of the above methods.

[0154] In this embodiment, if the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, to implement all or part of the processes in the above embodiment methods of the present application, a computer program can be used to instruct relevant hardware to complete. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by a processor, it can implement the steps of the above various method embodiments. Among them, the computer program includes computer program code, and the computer program code can be in the form of source code, object code, an executable file, or some intermediate form, etc. The computer-readable medium may at least include: any entity or device that can carry the computer program code to the photographing device / terminal device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk, or an optical disc, etc. In some jurisdictions, according to legislation and patent practice, the computer-readable medium may not be an electrical carrier signal and a telecommunication signal.

[0155] In the above embodiments, the descriptions of the various embodiments have their own focuses. For parts not detailed or recorded in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0156] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of this application.

[0157] In the embodiments disclosed in this application, it should be understood that the disclosed device / terminal device and method can be implemented in other ways. For example, the device / terminal device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed.

[0158] Another point is that the displayed or discussed coupling or direct coupling or communication connection to each other can be through some interfaces. The indirect coupling or communication connection of the device or unit can be in an electrical, mechanical or other form.

[0159] The units described as separate components may or may not be physically separated. The components displayed as units may or may not be physical units, that is, they can be located in one place, or can be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0160] The above formulas are all dimensionless and take their numerical calculations. The formulas are obtained by collecting a large amount of data for software simulation to obtain a formula that is closest to the actual situation. The preset parameters in the formulas are set by technicians in this field according to the actual situation.

[0161] The above has described a detailed description of an embodiment of the present invention, but the content described is only a preferred embodiment of the present invention and cannot be considered to be used to limit the scope of implementation of the present invention. All equal changes and improvements made according to the scope of the application of the present invention should still fall within the scope covered by the patent of the present invention.

Claims

1. A data storage method for multi-hard disk coordination, characterized in that: The following steps are involved: Step 1: Obtain hard disk information in a historical period through SMART information, wherein the hard disk information includes storage sectors, and analyze and process the storage sectors to obtain wear sectors, and analyze the wear sectors in the hard disk to obtain the number of wear sectors and the wear degree value, and analyze and process the number of wear sectors and the wear degree value to output the hard disk analysis value; Step 2: Based on the hard disk analysis value, compare the hard disk analysis value with the hard disk analysis threshold. If the hard disk analysis value is less than or equal to the hard disk analysis threshold, it is marked as a normal hard disk. If the hard disk analysis value is greater than the hard disk analysis threshold, it is marked as a hard disk to be coordinated. Multiple hard disks to be coordinated are summarized to obtain a table to be coordinated. Based on the table to be coordinated, historical storage information of the hard disk to be coordinated in multiple continuous historical periods is obtained through SMART information, wherein the historical storage information includes storage loss frequency and storage loss amount. The storage loss frequency and the storage loss amount are analyzed to obtain a storage risk value, which is compared with the storage risk threshold. If the storage risk value is greater than the storage risk threshold, a migration coordination signal is generated to obtain a coordinated hard disk. Step 3: Based on the migration coordination signal, the storage data of the coordinated hard disk in multiple continuous historical periods is analyzed to obtain the data access value and the access stability value, the data access value and the access stability value are added and summed to obtain the migration priority value, and the migration priority value and the storage risk value are analyzed and processed to obtain the migration ranking value, and based on the migration ranking value, the coordinated hard disk is summarized to obtain the coordinated hard disk table; The way to access stable values ​​is: A two-dimensional coordinate system is established, and the data access values ​​corresponding to the historical period are plotted on the Y axis of the two-dimensional coordinate system to obtain an access change curve; In the access change curve, the data access threshold is marked on the Y axis, and a straight line parallel to the X axis is drawn as the threshold reference line, where the threshold reference line intersects the access change curve; Extract the access change curve above the threshold reference line, obtain the number of access change curves above the threshold reference line, and obtain the out-of-bounds number; The over-limit quantity is calculated by ratioing the over-limit quantity to the over-limit quantity threshold to obtain the over-limit quantity ratio; The length of the access change curve above the threshold reference line is counted, and the ratio is calculated with the total length of the access change curve to obtain the over-bounded length value; The access stability value is obtained by multiplying the number of out-of-bounds and the out-of-bounds length value; Step 4: In the coordination hard disk table, obtain the priority migration memory corresponding to the priority migration data in the coordination hard disk. At the same time, obtain the remaining storage capacity of the normal hard disk, and compare the priority migration memory corresponding to the storage data in the coordination hard disk with the remaining storage capacity of the normal hard disk to complete the storage data migration coordination work and solve the problem of coordinating hard disk data migration.

2. The method for storing data in a multi-hard disk coordination manner according to claim 1, characterized in that: The method to obtain the wear sector is: Get the storage sectors of the hard disk through SMART information and analyze the storage sectors. The process is as follows: Divide the historical period into several analysis periods, obtain the reading speed of the storage sector in the analysis period, calculate the ratio of the reading speed of the storage sector in the analysis period to the reading speed threshold, and obtain the reading analysis value; The read analysis values ​​corresponding to all analysis periods are added and averaged to obtain the sector wear value; The sector wear value is compared with the sector wear threshold. If the sector wear value is greater than the sector wear threshold, that is, the storage sector analyzed in the hard disk is heavily worn, the storage sector with heavy wear in the hard disk is marked as a worn sector.

3. The data storage method of multiple hard disk coordination according to claim 1, characterized in that: The hard disk analysis value is obtained as follows: Count the number of worn sectors in the hard disk and calculate the ratio with the total number of storage sectors in the hard disk to obtain the number of worn sectors; Obtaining a sector wear value corresponding to the worn sector, subtracting the sector wear value corresponding to the worn sector from the sector wear threshold, and performing ratio calculation with the sector wear threshold to obtain a wear degree value; The hard disk analysis value is obtained by multiplying the number of worn sectors by the wear degree value.

4. The data storage method of multiple hard disk coordination according to claim 1, characterized in that: Storing Value at Risk The way to obtain is: Based on multiple continuous historical periods, any historical period is selected as the target period, and the target period is divided into several target time periods; Obtain the number of data losses within the target period, calculate the ratio of the number of data losses within the target period to the total number of data storage within the target period, and obtain the period loss frequency; Calculate the average of the period loss frequency in all target periods to obtain the storage loss frequency and mark it as ; Obtain the amount of data loss within the target period, calculate the ratio of the amount of data loss within the target period to the total amount of data stored within the target period, and obtain the amount of data loss during the period; Calculate the average of the number of period losses in all target periods to obtain the storage loss amount, which is marked as ; The loss frequency will be stored and storage loss Substituting into the formula: , calculate the cycle risk value ,in, , Expressed as a preset scaling factor; The cycle analysis values ​​corresponding to all historical cycles Add and average the values ​​to get the storage risk value .

5. The data storage method of multiple hard disk coordination according to claim 1, characterized in that: The data access value is obtained as follows: Based on multiple historical periods, any historical period is selected as the target period, and the target period is divided into several target time periods; Obtain the number of accesses to the stored data within the target period, calculate the ratio of the number of accesses to the stored data within the target period to the duration of the target period, and obtain the access frequency; The access frequencies in all target time periods are added up and averaged to obtain the data access value.

6. The method for storing data in a multi-hard disk coordination manner according to claim 1, characterized in that: The migration sort value is obtained as follows: The migration coordination value is compared with the migration coordination threshold, and the process is as follows; If the migration coordination value is greater than or equal to the migration coordination threshold, the analyzed storage data in the coordination hard disk is marked as priority migration data; Obtain the number of priority migration data, and calculate the ratio with the total amount of data stored in the coordinated hard disk to obtain the priority migration number; Obtain the priority migration amount memory, and calculate the ratio with the total memory of the data stored in the coordinated hard disk to obtain the priority migration memory; The migration ranking value is calculated by multiplying the number of priority migrations by the priority migration memory.

7. The data storage method of multiple hard disk coordination according to claim 1, characterized in that: In the coordination hard disk table, extract the first coordinated hard disk in the order, and obtain the priority migration memory corresponding to the first coordinated hard disk in the order ; The priority migration memory corresponding to the first coordinated hard disk in the sorting is compared with the remaining storage capacity of the normal hard disk. The process is as follows: If there is a normal hard disk whose remaining storage capacity is greater than or equal to the priority migration memory corresponding to the first coordinated hard disk in the order, the priority migration data in the first coordinated hard disk in the order is preferentially migrated to the normal hard disk; If there is no normal hard disk whose remaining storage capacity is greater than or equal to the priority migration memory corresponding to the first coordinated hard disk in the sorting order, the priority migration data in the first coordinated hard disk in the sorting order is compressed in the data memory, and the process is as follows: Compare the normal hard disks according to the remaining storage capacity of the normal hard disks, and sort them in descending order, extract the normal hard disk with the largest remaining storage capacity as the first normal migration hard disk of the sorted first coordination hard disk; The remaining storage capacity of the first normal migration hard disk is marked as , through the formula: , calculate and obtain the maximum value of the compressed memory of the priority migration data in the first coordinated hard disk; The priority migration data in all the coordinated hard disks in the coordinated hard disk table are traversed, and the data are analyzed and processed according to the order of the coordinated hard disks in the coordinated hard disk table until the coordination work of the priority migration data in all the coordinated hard disks in the coordinated hard disk table is completed.

8. A data storage system coordinated by multiple hard disks, characterized in that: The system is used to implement the data storage method for multiple hard disk coordination described in any one of claims 1 to 7, comprising: Hard disk wear assessment module: obtains hard disk information in the historical period through SMART information, where the hard disk information includes storage sectors, performs analysis and processing based on the storage sectors to obtain wear sectors, and analyzes the wear sectors in the hard disk to obtain the number of wear sectors and the wear degree value, analyzes and processes the number of wear sectors and the wear degree value, and outputs the hard disk analysis value; Analyze the hard disk coordination module: Based on the hard disk analysis value, compare the hard disk analysis value with the hard disk analysis threshold. If the hard disk analysis value is less than or equal to the hard disk analysis threshold, it is marked as a normal hard disk. If the hard disk analysis value is greater than the hard disk analysis threshold, it is marked as a hard disk to be coordinated. Multiple hard disks to be coordinated are summarized to obtain a table to be coordinated. Based on the table to be coordinated, the historical storage information of the hard disk to be coordinated in multiple continuous historical cycles is obtained through SMART information, wherein the historical storage information includes the storage loss frequency and the storage loss amount. The storage loss frequency and the storage loss amount are analyzed to obtain a storage risk value, which is compared with the storage risk threshold. If the storage risk value is greater than the storage risk threshold, a migration coordination signal is generated to obtain a coordinated hard disk. Storage data analysis module: Based on the migration coordination signal, the storage data of the coordinated hard disk in multiple continuous historical periods is analyzed to obtain the data access value and the access stability value, the data access value and the access stability value are added and summed to obtain the migration priority value, and the migration priority value and the storage risk value are analyzed and processed to obtain the migration ranking value, and based on the migration ranking value, the coordinated hard disk is summarized to obtain the coordinated hard disk table; Coordinated migration planning module: In the coordinated hard disk table, obtain the priority migration memory corresponding to the priority migration data in the coordinated hard disk, and at the same time, obtain the remaining storage capacity of the normal hard disk, and compare the priority migration memory corresponding to the storage data in the coordinated hard disk with the remaining storage capacity of the normal hard disk to complete the storage data migration coordination work and solve the problem of coordinated hard disk data migration.

9. A data storage terminal with multiple hard disks coordinated, characterized in that: A memory (302), a processor (301) and a computer program (303) stored in the memory (302), when the computer program (303) is executed on the processor (301), implements the steps of the multi-hard disk coordinated data storage method according to any one of claims 1 to 7.

10. A data storage medium coordinated by multiple hard disks, characterized in that: When the multi-hard disk coordinated data storage system is run by a processor, the steps of the multi-hard disk coordinated data storage method as claimed in any one of claims 1 to 7 are implemented.

Images