An automated verification method, device, equipment, and storage medium for deduplication rate

Abstract

The present invention belongs to the technical field of data storage, and specifically provides an automated verification method, device, equipment, and storage medium for the deduplication rate. The method includes the following steps: confirming the home node of the volume to which the data to be written belongs, and confirming the initial state value of the write attribute for deduplication statistics; respectively writing data containing the first data file into the volume; respectively entering the volume deduplication statistics page through the thread number of the volume to record the value of the write attribute; calculating the deduplication rate based on the recorded value; comparing the calculated deduplication rate with the deduplication rate queried by MCS. When the difference is within the set first threshold range, the verification passes. When the difference is within the set second threshold range, an alarm with a general marking level is generated. When the difference is within the set third threshold range, an alarm with a severe marking level is generated, and an email is sent to the relevant responsible person through SNMP. When an abnormality occurs, the verification result is informed to the relevant person in charge through an alarm, which can save the time for development and testing.

Description

Technical Field

[0001] The present invention relates to the technical field of data storage, and in particular, to an automated verification method, device, equipment, and storage medium for the deduplication rate. Background Art

[0002] With the continuous growth of business requirements, the complexity trend of today's IT systems is very obvious. One of the key aspects is the importance of data storage. When storing data, we often use deduplication technology. The essence of deduplication technology lies in calculating fingerprints for the written data, and only retaining one copy of the data (PBA) and the corresponding metadata (that is, the metadata stores the mapping relationship L->P from the logical address LBA to the physical address PBA when the data is written) and the fingerprint lock (HBA) data. Duplicate data can be deleted, and there is generally an upper limit on how much duplicate data is deleted, that is, there is a maximum specification for the deduplication rate.

[0003] By using the comparison and verification technology to delete duplicate data on the storage device and only retaining one copy, redundant data can be eliminated, the physical space of the storage device can be optimized, and the growing data storage requirements can be met. How to verify the deduplication rate is the technical problem to be solved in this application. Summary of the Invention

[0004] By using the comparison and verification technology to delete duplicate data on the storage device and only retaining one copy, redundant data can be eliminated, the physical space of the storage device can be optimized, and the growing data storage requirements can be met. Regarding how to verify the deduplication rate, the present invention provides an automated verification method, device, equipment, and storage medium for the deduplication rate.

[0005] In a first aspect, the technical solution of the present invention provides an automated verification method for the deduplication rate, including the following steps:

[0006] Confirm the home node of the volume of the data to be written, and confirm the thread number of the volume for deduplication statistics;

[0007] On the home node of the volume, enter the volume deduplication statistics page through the confirmed thread number to record the initial state values of the total count of IO requests, the count of write requests with fingerprints, the count of write requests without fingerprints, the count of deduplicated requests, and the count of requests for calculating fingerprints;

[0008] Write data containing the first data file into the volume respectively;

[0009] Enter the volume deduplication statistics page through the thread number of the volume respectively to record the values of the total count of IO requests, the count of write requests with fingerprints, the count of write requests without fingerprints, the count of deduplicated requests, and the count of requests for calculating fingerprints;

[0010] Calculate the deduplication rate according to the recorded values;

[0011] Compare the calculated deduplication rate with the deduplication rate queried by MCS. When the difference is within the set first threshold range, the verification passes.

[0012] Furthermore, the method further includes:

[0013] When the difference is within the set second threshold range, generate an alarm with a general mark level in the MCS system and send an email to the relevant responsible person through SNMP.

[0014] Furthermore, the method further includes:

[0015] When the difference is within the set third threshold range, generate an alarm with a serious mark level in the MCS system and send an email to the relevant responsible person through SNMP.

[0016] Furthermore, before the step of writing the first data file in the first volume where the deduplication feature is set, it includes:

[0017] Set a number of random data files, and the number of random data files includes the first data file.

[0018] Furthermore, before the steps of confirming the home node of the volume to which the data to be written belongs and confirming the thread number of the volume for deduplication statistics, it includes:

[0019] Activate the deduplication license function in MCS;

[0020] Create a thin pool Pool0;

[0021] Create thin volumes in the created thin pool Pool0, including the first volume and the second volume with deduplication features set and the third volume without deduplication features;

[0022] Map the created thin volumes to the host.

[0023] Furthermore, the step of calculating the deduplication rate according to the recorded values includes:

[0024] The deduplication rate is equal to the ratio of the total number of data copies written to the volume with the deduplication feature set to the total number of data copies written to each volume;

[0025] When the data written to each volume is the same, the deduplication rate is equal to the ratio of the data volume written to the volume with the deduplication feature set to the total data volume written to each volume.

[0026] In a second aspect, the technical solution of the present invention further provides an automatic verification device for the deduplication rate, including a thread number statistics module, a recording module, a writing module, a calculation module, and a comparison and verification module;

[0027] The thread number statistics module is used to confirm the home node of the volume to which the data to be written belongs and confirm the thread number of the volume for deduplication statistics;

[0028] A recording module, which is used to enter the volume deduplication statistics page on the home node of the volume through the confirmed thread number to record the initial state values of the total count of IO requests, the count of write requests with fingerprints, the count of write requests without fingerprints, the count of deduplicated requests, and the count of requests for calculating fingerprints; after the writing module finishes execution, it enters the volume deduplication statistics page through the thread number of the volume to record the values of the total count of IO requests, the count of write requests with fingerprints, the count of write requests without fingerprints, the count of deduplicated requests, and the count of requests for calculating fingerprints.

[0029] A writing module, which is used to write data including the first data file into the volume respectively.

[0030] A calculation module, which is used to calculate the deduplication rate according to the recorded values.

[0031] A comparison and verification module, which is used to compare the calculated deduplication rate with the deduplication rate queried by MCS. When the difference is within the set first threshold range, the verification passes.

[0032] Furthermore, the device further includes an alarm setting module, which is used to generate an alarm with a general marking level in the MCS system and send an email to the relevant responsible person through SNMP when the comparison and verification module determines that the difference is within the set second threshold range; when the difference is within the set third threshold range, generate an alarm with a serious marking level in the MCS system and send an email to the relevant responsible person through SNMP.

[0033] Furthermore, before the step of selecting and setting the first volume with deduplication features to write the first data file, it includes:

[0034] The device further includes a random file setting module, which is used to set a number of random data files, and the number of random data files includes the first data file.

[0035] Furthermore, the device further includes a system setting module, a pool creation module, a volume creation module, and a mapping module;

[0036] A system setting module, which is used to activate the deduplication license function in MCS;

[0037] A pool creation module, which is used to create a thin pool Pool0;

[0038] A volume creation module, which is used to create thin volumes in the created thin pool Pool0, including the first volume, the second volume with deduplication features, and the third volume without deduplication features;

[0039] A mapping module, which is used to map the created thin volumes to the host.

[0040] Furthermore, the step of calculating the deduplication rate according to the recorded values includes:

[0041] The deduplication rate calculated by the calculation module is equal to the ratio of the total number of data copies written to the volume with the deduplication feature enabled to the total number of data copies written to each volume.

[0042] When the data written to each volume is the same, the deduplication rate is equal to the ratio of the amount of data written to the volume with the deduplication feature enabled to the total amount of data written to each volume.

[0043] In a third aspect, the technical solution of the present invention also provides an electronic device, which includes:

[0044] At least one processor; and,

[0045] A memory communicatively connected to the at least one processor; wherein,

[0046] The memory stores computer program instructions executable by the at least one processor, and the computer program instructions are executed by the at least one processor so that the at least one processor can execute the automated verification method of the deduplication rate as described in the first aspect.

[0047] In a fourth aspect, the technical solution of the present invention also provides a non-transitory computer-readable storage medium, which stores computer instructions that cause the computer to execute the automated verification method of the deduplication rate as described in the first aspect.

[0048] It can be seen from the above technical solutions that the present invention has the following advantages: The cumbersome calculation process is automated, and an automatic verification process is added. When an abnormality occurs, the verification result is notified to the relevant person in charge by means of an alarm. This solution can greatly save the time of developers and testers and can be executed on the device at night or during idle time.

[0049] In addition, the design principle of the present invention is reliable, the structure is simple, and it has a very wide application prospect.

[0050] It can be seen that compared with the prior art, the present invention has outstanding substantive features and significant progress, and the beneficial effects of its implementation are also obvious. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, other drawings can also be obtained based on these drawings without creative efforts.

[0052] Figure 1 It is a schematic flowchart of the method according to an embodiment of the present invention.

[0053] Figure 2 Schematic block diagram of an apparatus according to an embodiment of the present invention. Detailed implementation manners

[0054] By means of a comparison and verification technique, duplicate data on a storage device is deleted, and only one copy is retained, thereby eliminating redundant data, optimizing the physical space of the storage device, and meeting the growing data storage requirements. Regarding how to verify the deduplication rate, the present invention provides an automated verification method, apparatus, device, and storage medium for the deduplication rate. Under this storage system, the deduplication license function is activated, and then through the pool and volume functions of the MCS, a RAID is created to add an internal memory, enabling the MCS to use the storage space. A thin volume is created on this storage space, and the volume is given the deduplication feature. At this time, the volume has the deduplication function, that is, when storing data, it will automatically determine whether the data is duplicate. Each time data is stored, the hash value is used as the criterion for judging data duplication, similar to a fingerprint. When the hash values of two parts of data are the same, we consider that these two parts of data are identical. When it is determined that there is already duplicate data, it is not added repeatedly but only a data mapping relationship is added. To enable those skilled in the art to better understand the technical solutions in the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0055] It should be noted that totalIoNum: total count of IO requests; writeWithFpNum: count of write requests with fingerprints; writeWithOutFpNum: count of write requests without fingerprints; dedupedNum: count of deduplicated requests; computeFpNum: count of requests for computing fingerprints.

[0056] As Figure 1 shown, an embodiment of the present invention provides an automated verification method for the deduplication rate, including the following steps:

[0057] Step 1: Confirm the belonging node of the volume for the data to be written, and confirm the thread number of the volume for deduplication statistics;

[0058] Step 2: On the belonging node of the volume, enter the volume deduplication statistics page through the confirmed thread number to record the initial state values of the total count of IO requests, the count of write requests with fingerprints, the count of write requests without fingerprints, the count of deduplicated requests, and the count of requests for computing fingerprints;

[0059] Step 3: Write data containing the first data file into the volume respectively;

[0060] Step 4: Enter the volume deduplication statistics page through the thread numbers of the volumes respectively to record the values of the total count of IO requests, the count of write requests with fingerprints, the count of write requests without fingerprints, the count of deduplicated requests, and the count of requests for calculating fingerprints;

[0061] Step 5: Calculate the deduplication rate based on the recorded values;

[0062] Step 6: Compare the calculated deduplication rate with the deduplication rate queried by MCS. When the difference is within the set first threshold range, the verification passes.

[0063] For the initially created volume vdisk, view its corresponding volume thread number. When there are changes in the total data totalIoNum, the written data changes writeWithFpNum, writeWithOutFpNum, and the deduplicated data dedupedNum under this thread number, the status of the volume for each written data is different. For the convenience of automatic calculation, record the number of times of data written each time as X, that is, when X = 1, the data is written 1 time. In this design, vdisk0 and vdisk1 are volumes with deduplication characteristics, and vdisk2 is a volume without deduplication characteristics. The purpose of vdisk2 is to increase the volume capacity. When the written data is the same, the calculation formula for the deduplication rate is the total data volume / the duplicate data volume. By automatically recording the number of times of data writing and the changes in the volume status, verify whether the deduplication rate is consistent with the dedup_shrink_ratio queried by MCS through commands, and set a compliance range. When it does not meet the requirements, an alarm is popped up.

[0064] An embodiment of the present invention provides an automatic verification method for the deduplication rate, including the following steps:

[0065] S1: Activate the deduplication license function in MCS;

[0066] S2: Create a thin pool Pool0; and add 4 hard disks to form a Draid5;

[0067] S3: Create thin volumes in the created thin pool Pool0, including a first volume vdisk0, a second volume vdisk1 with deduplication characteristics, and a third volume vdisk2 without deduplication characteristics;

[0068] That is, create thin volumes vdisk0 and vdisk1, belonging to the pool Pool0, with a capacity of 100G, and enable the deduplication feature; create a volume vdisk2 without deduplication characteristics, also with a capacity of 100G;

[0069] S4: Map the created thin volumes to the host;

[0070] Map all the 3 created volumes to the FC host, and record the UIDs of vdisk0, vdisk1, and vdisk2; select the FC host, enter the name, and create the host after adding the corresponding ports. Map the volumes vdisk0, vdisk1, and vdisk2 to the host, and use the command scsi-recan to discover the mapped vdisks at the host side and format the vdisks.

[0071] S5: Confirm the home node of the volume for which data is to be written, and confirm the thread number of the volume for deduplication statistics;

[0072] Through ldbe->SSA->se agent instances->agent->diskArray->disk->confirm the btreeId of the volume (such as 0x0018), and btreeID % 16 (note the base conversion) is the thread number of the volume for deduplication statistics. Assume that the btreeid of the current volume vdisk0 is 0x0006 and the btreeid of vdisk1 is 0x0007;

[0073] S6: On the home node of the volume, enter the volume deduplication statistics page through the confirmed thread number to record the initial state values of the total count of IO requests, the count of write requests with fingerprints, the count of write requests without fingerprints, the count of deduplicated requests, and the count of requests for computing fingerprints;

[0074] On the home node node1 of the volume vdisk0, enter the volume deduplication statistics page through ldbe->SSA->dedup agent instances->【0x0】->dedupRecord[]->volume thread number [0x6], and record totalIoNum, writeWithFpNum, writeWithOutFpNum, dedupedNum, computeFpNum. At this initial state, all parameters are 0;

[0075] On the home node node1 of the volume vdisk1, enter the volume deduplication statistics page through ldbe->SSA->dedup agent instances->【0x0】->dedupRecord[]->volume thread number [0x7], and record totalIoNum, writeWithFpNum, writeWithOutFpNum, dedupedNum, computeFpNum. At this initial state, all parameters are 0;

[0076] S7: Write data containing the first data file into the volume respectively;

[0077] It should be noted that before this step value, it is necessary to determine whether the first data file exists. If so, step S7 is executed; otherwise, a number of random data files are set, including the first data file; then step S7 is executed.

[0078] On the client side, use dd if=$file1 of= / dev / mapper / mpatha bs=8k count=1 to write data to volume vdisk0, view the data changes, and press the R key on the keyboard to refresh (due to the influence of the UCA data downbrush mechanism, the data changes are not real-time and may take up to about 3 minutes to refresh). At this time, totalIoNum = computeFpNu = 1, writeWithFpNum = 1, dedupedNum = 0. Random data can also be written through vdbench, and the data size can be customized.

[0079] On the client side, use dd if=$file1 of= / dev / mapper / mpathb bs=8k count=1 to write data to volume vdisk1, which is the same as the data written to vdsik0. View the data changes, and the refresh method is the same as the previous step. At this time, totalIoNum = computeFpNu = 1, writeWithFpNum = 0, dedupedNum = 1. Use lsmdiskgrp 0|grep dedup_shrink_ratio to view that the deduplication ratio is 1:2.

[0080] It should be noted that the understanding of the deduplication ratio can be that it is equivalent to writing a data A first, and then writing a B and an A. Then the deduplication ratio is 2:3.

[0081] On the client side, use dd if=$file1 of= / dev / mapper / mpathc bs=8k count=1 to write data to volume vdisk2, which is the same as the data written to vdsik0. Use lsmdiskgrp 0|grep dedup_shrink_ratio to view that the deduplication ratio becomes X:(X + Y); where, when the total number of data copies written to vdisk0 and vdisk1 is recorded as X, and the total number of data copies written to vdisk2 is recorded as Y.

[0082] S8: Enter the volume deduplication statistics page through the thread number of the volume respectively to record the values of the total count of IO requests, the count of write requests with fingerprints, the count of write requests without fingerprints, the count of deduplicated requests, and the count of requests for calculating fingerprints;

[0083] S9: Calculate the deduplication ratio according to the recorded values;

[0084] It should be noted that the deduplication rate is equal to the ratio of the total number of data copies written to the volume with the deduplication feature enabled to the total number of data copies written to each volume;

[0085] When the data written to each volume is the same, the deduplication rate is equal to the ratio of the amount of data written to the volume with the deduplication feature enabled to the total amount of data written to each volume.

[0086] S10: Compare the calculated deduplication rate with the deduplication rate queried by MCS;

[0087] When the difference is within the set first threshold range, execute step S11; when the difference is within the set second threshold range, execute step S12; when the difference is within the set third threshold range, execute step S13;

[0088] Here, the first threshold range is ±1, the second threshold range is greater than 1 and less than 5; the third threshold range is greater than 5 and less than 10.

[0089] S11: Verification passed;

[0090] S12: Generate an alarm with a general marking level in the MCS system and send an email to the relevant responsible person through SNMP;

[0091] S13: Generate an alarm with a severe marking level in the MCS system and send an email to the relevant responsible person through SNMP.

[0092] The cumbersome calculation process is automated, and an automatic verification process is added. When an exception occurs, the verification result is notified to the relevant person in charge through an alarm. This solution can greatly save the time of developers and testers.

[0093] Such as Figure 2 As shown, an embodiment of the present invention further provides an automatic verification device for the deduplication rate, including a thread number statistics module, a recording module, a writing module, a calculation module, and a comparison and verification module;

[0094] The thread number statistics module is used to confirm the home node of the volume to which the data to be written belongs and confirm the thread number of the volume for deduplication statistics;

[0095] The recording module is used to enter the volume deduplication statistics page on the home node of the volume through the confirmed thread number to record the initial state values of the total number of IO requests, the number of write requests with fingerprints, the number of write requests without fingerprints, the number of deduplicated requests, and the number of requests for calculating fingerprints; after the writing module finishes execution, it enters the volume deduplication statistics page through the thread number of the volume to record the values of the total number of IO requests, the number of write requests with fingerprints, the number of write requests without fingerprints, the number of deduplicated requests, and the number of requests for calculating fingerprints;

[0096] The writing module is used to write data containing the first data file into the volume respectively;

[0097] A calculation module, configured to calculate the deduplication rate according to the recorded values;

[0098] A comparison and verification module, configured to compare the calculated deduplication rate with the deduplication rate queried by MCS, and when the difference is within a set first threshold range, the verification passes.

[0099] The device further includes an alarm setting module, configured to generate an alarm with a general marking level in the MCS system and send an email to the relevant responsible person through SNMP when the difference judged by the comparison and verification module is within a set second threshold range; when the difference is within a set third threshold range, generate an alarm with a severe marking level in the MCS system and send an email to the relevant responsible person through SNMP.

[0100] In some embodiments, before the step of writing the first data file into the first volume where the deduplication feature is selected and set, it includes:

[0101] The device further includes a random file setting module, configured to set a number of random data files, and the number of random data files includes the first data file.

[0102] In some embodiments, the device further includes a system setting module, a pool creation module, a volume creation module, and a mapping module;

[0103] The system setting module is configured to activate the deduplication license function in MCS;

[0104] The pool creation module is configured to create a thin pool Pool0;

[0105] The volume creation module is configured to create thin volumes in the created thin pool Pool0, including a first volume, a second volume with deduplication features set, and a third volume without deduplication features;

[0106] The mapping module is configured to map the created thin volumes to the host.

[0107] In some embodiments, the deduplication rate calculated by the calculation module is equal to the ratio of the total number of data copies written to each volume to the total number of data copies written to the volume with the deduplication feature set; when the data written to each volume is the same, the deduplication rate is equal to the ratio of the total amount of data written to each volume to the amount of data written to the volume with the deduplication feature set.

[0108] An embodiment of the present invention further provides an electronic device, which includes: a processor, a communication interface, a memory, and a bus. Among them, the processor, the communication interface, and the memory complete communication with each other through the bus. The bus can be used for information transmission between the electronic device and the sensor. The processor can call the logical instructions in the memory to execute the following method: Step 1: Confirm the ownership node of the volume to which the data to be written belongs, and confirm the thread number of the volume for deduplication statistics; Step 2: Enter the volume deduplication statistics page on the ownership node of the volume through the confirmed thread number to record the initial state values of the total count of IO requests, the count of write requests with fingerprints, the count of write requests without fingerprints, the count of deduplicated requests, and the count of requests for calculating fingerprints; Step 3: Write the data including the first data file into the volume respectively; Step 4: Enter the volume deduplication statistics page through the thread number of the volume respectively to record the values of the total count of IO requests, the count of write requests with fingerprints, the count of write requests without fingerprints, the count of deduplicated requests, and the count of requests for calculating fingerprints; Step 5: Calculate the deduplication rate according to the recorded values; Step 6: Compare the calculated deduplication rate with the deduplication rate queried by MCS. When the difference is within the set first threshold range, the verification passes; when the difference is within the set second threshold range, an alarm with a general mark level is generated in the MCS system, and an email is sent to the relevant responsible person through SNMP; when the difference is within the set third threshold range, an alarm with a severe mark level is generated in the MCS system, and an email is sent to the relevant responsible person through SNMP.

[0109] In some embodiments, the processor can call the logical instructions in the memory to execute the following method: Activate the deduplication license function in MCS; Create a thin pool Pool0; Create thin volumes in the created thin pool Pool0, including the first volume and the second volume with deduplication characteristics and the third volume without deduplication characteristics; Map the created thin volumes to the host.

[0110] In addition, when the above-mentioned logical instructions in the memory are implemented in the form of software functional units and sold or used as an independent product, they can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: USB flash drives, mobile hard disks, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), magnetic disks, or optical disks, etc., which can store program codes.

[0111] An embodiment of the present invention provides a non-transitory computer-readable storage medium, which stores computer instructions that cause a computer to execute the method provided in the above method embodiment. For example, it includes: S1: Activate the deduplication license function in the MCS; S2: Create a thin pool Pool0; S3: Create thin volumes in the created thin pool Pool0, including a first volume, a second volume with deduplication characteristics, and a third volume without deduplication characteristics; S4: Map the created thin volumes to the host; S5: Confirm the ownership node of the volume to which the data to be written belongs, and confirm the thread number of the volume for deduplication statistics; S6: Enter the volume deduplication statistics page on the ownership node of the volume through the confirmed thread number to record the initial state values of the total count of IO requests, the count of write requests with fingerprints, the count of write requests without fingerprints, the count of deduplicated requests, and the count of requests for calculating fingerprints; S7: Write data containing the first data file into the volume respectively; S8: Enter the volume deduplication statistics page through the thread number of the volume respectively to record the values of the total count of IO requests, the count of write requests with fingerprints, the count of write requests without fingerprints, the count of deduplicated requests, and the count of requests for calculating fingerprints; S9: Calculate the deduplication rate based on the recorded values; S10: Compare the calculated deduplication rate with the deduplication rate queried in the MCS; when the difference is within the set first threshold range, execute step S11, when the difference is within the set second threshold range, execute step S12, and when the difference is within the set third threshold range, execute step S13; S11: Verification passed; S12: Generate an alarm with a general mark level in the MCS system and send an email to the relevant responsible person through SNMP; S13: Generate an alarm with a serious mark level in the MCS system and send an email to the relevant responsible person through SNMP.

[0112] Although the present invention has been described in detail by referring to the accompanying drawings and in combination with the preferred embodiments, the present invention is not limited thereto. Without departing from the spirit and essence of the present invention, those of ordinary skill in the art can make various equivalent modifications or substitutions to the embodiments of the present invention, and these modifications or substitutions should all be within the scope of the present invention. / Any person skilled in the art within the technical scope disclosed by the present invention can easily think of changes or substitutions, which should all be covered by the protection scope of the present invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.

Claims

1. An automated verification method for the deduplication rate, characterized in that It includes the following steps: Confirm the home node of the volume to which the data to be written belongs, and confirm the thread number of the volume for deduplication statistics; On the home node of the volume, enter the volume deduplication statistics page through the confirmed thread number to record the initial state values of the total IO request count, the fingerprinted write request count, the non-fingerprinted write request count, the deduplicated request count, and the fingerprint calculation request count; Write data containing the first data file into the volume respectively; Enter the volume deduplication statistics page through the thread number of the volume respectively to record the values of the total IO request count, the fingerprinted write request count, the non-fingerprinted write request count, the deduplicated request count, and the fingerprint calculation request count; Calculate the deduplication rate according to the recorded values; specifically, the deduplication rate is equal to the ratio of the total number of data copies written to the volume with the deduplication feature set to the total number of data copies written to each volume; when the data written to each volume is the same, the deduplication rate is equal to the ratio of the data volume written to the volume with the deduplication feature set to the total data volume written to each volume; compare the calculated deduplication rate with the deduplication rate queried by MCS, and when the difference is within the set first threshold range, the verification passes; Before the steps of confirming the home node of the volume to which the data to be written belongs and confirming the thread number of the volume for deduplication statistics, it includes: Activate the deduplication license function in MCS; Create a thin pool Pool0; Create thin volumes in the created thin pool Pool0, including the first volume, the second volume with the deduplication feature set, and the third volume without the deduplication feature; Map the created thin volumes to the host.

2. The automated verification method for the deduplication rate according to claim 1, characterized in that This method further includes: When the difference is within the set second threshold range, generate an alarm with a general mark level in the MCS system and send an email to the relevant responsible person through SNMP.

3. The automated verification method for the deduplication rate according to claim 2, characterized in that This method further includes: When the difference is within the set third threshold range, generate an alarm with a serious mark level in the MCS system and send an email to the relevant responsible person through SNMP.

4. The automated verification method for the deduplication rate according to claim 3, wherein Before the step of writing data containing the first data file into the volume respectively, it includes: Set a number of random data files, including the first data file.

5. An automated verification device for deduplication rate, characterized in that, It includes a thread number statistics module, a recording module, a writing module, a calculation module, and a comparison and verification module; The thread number statistics module is used to confirm the home node of the volume to which the data to be written belongs and confirm the thread number of the volume for deduplication statistics; The recording module is used to enter the volume deduplication statistics page through the confirmed thread number on the home node of the volume to record the initial state values of the total IO request count, the fingerprinted write request count, the non-fingerprinted write request count, the deduplicated request count, and the fingerprint calculation request count; After the writing module finishes execution, enter the volume deduplication statistics page through the thread number of the volume respectively to record the values of the total IO request count, the fingerprinted write request count, the non-fingerprinted write request count, the deduplicated request count, and the fingerprint calculation request count; The writing module is used to write data containing the first data file into the volume respectively; The calculation module is used to calculate the deduplication rate according to the recorded values; the deduplication rate calculated by the calculation module is equal to the ratio of the total number of data copies written to the volume with the deduplication feature set to the total number of data copies written to each volume; When the data written to each volume is the same, the deduplication rate is equal to the ratio of the amount of data written to the volume with the deduplication feature enabled to the total amount of data written to each volume; A comparison and verification module for comparing the calculated deduplication rate with the deduplication rate queried by MCS. When the difference is within the set first threshold range, the verification passes; The apparatus further includes a system setting module, a pool creation module, a volume creation module, and a mapping module; The system setting module is used to activate the deduplication license function in MCS; The pool creation module is used to create a thin pool Pool0; The volume creation module is used to create thin volumes in the created thin pool Pool0, including a first volume and a second volume with the deduplication feature set and a third volume without the deduplication feature; The mapping module is used to map the created thin volumes to the host.

6. The automated verification device for the deduplication rate according to claim 5, wherein The apparatus further includes an alarm setting module. When the comparison and verification module determines that the difference is within the set second threshold range, a general-level alarm is generated in the MCS system and an email is sent to the relevant responsible person through SNMP; When the difference is within the set third threshold range, a severe-level alarm is generated in the MCS system and an email is sent to the relevant responsible person through SNMP.

7. An electronic device, characterized in that, The electronic device includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores computer program instructions executable by the at least one processor, and the computer program instructions are executed by the at least one processor to enable the at least one processor to execute the automated verification method of the deduplication rate as described in any one of claims 1 to 4.

8. A non-transitory computer-readable storage medium, characterized in that, The non-transitory computer-readable storage medium stores computer instructions that cause the computer to execute the automated verification method of the deduplication rate as described in any one of claims 1 to 4.

Images