High-speed storage array data storage method, device and server
By copying and segmenting the target data set, and prioritizing the attributes and status information of the storage unit, data redundancy and load balancing problems in existing storage arrays are solved, and high-speed distributed storage and redundancy of data are realized Backup, improves storage efficiency and reliability.
Patent Information
- Application Number
- CN202410715036.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-04
- Publication Date
- 2024-12-24
- Estimated Expiration
- 2044-06-04
AI Technical Summary
Existing storage arrays lack data redundancy and load balancing when data is stored in segmented data, resulting in data loss and poor storage performance.
By copying and segmenting the target data set, the basic attributes and historical status information of the storage unit are collected in real time, prioritized and written to the data block pair to the appropriate storage unit, forming a data storage table with redundant backup and load balancing .
It realizes high-speed distributed storage and redundant backup of data, improves storage efficiency and reliability, and optimizes the overall performance of the storage array.
Smart Images

Figure CN118585129B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of data storage, and in particular relates to a high-speed storage array data storage method, device and server. Background Art
[0002] A storage array is an array of multiple disks that are used as a single disk. It stores data in different disks in a segmented manner. When accessing data, the related disks in the array work together, which greatly reduces the data access time and has better space utilization. When storing segmented data, some existing storage arrays do not have data redundancy functions, which can easily cause data loss. In addition, most of them store segmented data in each disk space in a designated or random distribution manner, which has a poor load balancing effect on each disk space in the storage array, which is not conducive to improving the overall working performance of the storage array. Summary of the invention
[0003] The object of the present invention is to provide a high-speed storage array data storage method, device and server to solve the above-mentioned problems existing in the prior art.
[0004] In order to achieve the above object, the present invention adopts the following technical solutions:
[0005] In a first aspect, a high-speed storage array data storage method is provided, comprising:
[0006] a. Obtain the target data set to be stored and the unique data label of the target data set;
[0007] b. Copy the target data set to obtain a mirror data set of the target data set;
[0008] c. Based on the set segmentation conditions, the target data set and the mirror data set are segmented to obtain a number of target data blocks and mirror data blocks corresponding to each target data block, and each target data block and its corresponding mirror data block are sequentially formed into data block pairs, and each data block pair is associated with a corresponding data segment number;
[0009] d. Real-time collection of basic attribute information and historical status information of each storage unit in the storage array;
[0010] e. Prioritize each storage unit according to its basic attribute information and historical status information, and select the two storage units with the highest priority as the storage units to be written;
[0011] f. Sequentially extract a pair of data blocks, write the target data block and the mirror data block of the data block pair into two storage units to be written, and obtain the write address of the target data block and the mirror data block;
[0012] g. Use the write address of the target data block and the mirror data block to form an address pair, and associate the address pair with the corresponding data segment number and enter it into the data storage table;
[0013] h. Repeat steps d-g until all data blocks corresponding to the data segment numbers and address pairs have been entered into the data storage table to obtain the final data storage table;
[0014] i. Associate the final data storage table with the unique data label of the target dataset and archive it.
[0015] In a possible design, segmenting the target data set and the mirror data set based on the set segmentation condition to obtain a plurality of target data blocks and mirror data blocks corresponding to each target data block includes:
[0016] Determine the number of segment bits or segment bytes based on the set segment conditions;
[0017] The target data set and the mirror data set are segmented according to the number of segment bits or the number of segment bytes to obtain a number of target data blocks and mirror data blocks corresponding to each target data block.
[0018] In a possible design, the basic attribute information includes data writing speed, data reading speed and remaining storage capacity, and the historical status information includes cumulative working time, historical failure rate and historical average power consumption.
[0019] In a possible design, the prioritizing of the storage units according to the basic attribute information and historical status information of the storage units includes:
[0020] Determine the storage classification number of the target data set according to the unique data label of the target data set;
[0021] Retrieve the corresponding indicator conversion rules and comprehensive calculation models based on the storage classification number;
[0022] The index conversion rules are used to convert the data writing speed, data reading speed, remaining storage capacity, accumulated working time, historical failure rate and historical average power consumption of each storage unit to obtain the writing speed index, reading speed index, remaining capacity index, working time index, failure rate index and power consumption index of each storage unit;
[0023] Substituting the write speed index, read speed index, remaining capacity index, working time index, failure rate index and power consumption index of each storage unit into the comprehensive calculation model for calculation, the comprehensive index of each storage unit is obtained;
[0024] The storage units are prioritized based on the comprehensive index.
[0025] In a possible design, the index conversion rule includes a write speed index formula, a read speed index formula, a remaining capacity index formula, a working time index formula, a failure rate index formula and a power consumption index formula, and the index conversion rule is used to perform index conversion processing on the data write speed, data read speed, remaining storage capacity, cumulative working time, historical failure rate and historical average power consumption of each storage unit to obtain the write speed index, read speed index, remaining capacity index, working time index, failure rate index and power consumption index of each storage unit, including:
[0026] Substitute the data writing speed into the writing speed index formula to calculate and obtain the writing speed index; substitute the data reading speed into the reading speed index formula to calculate and obtain the reading speed index; substitute the remaining storage capacity into the remaining capacity index formula to calculate and obtain the remaining capacity index; substitute the accumulated working time into the working time index formula to calculate and obtain the working time index; substitute the historical failure rate into the failure rate index formula to calculate and obtain the failure rate index; substitute the historical average power consumption into the power consumption index formula to calculate and obtain the power consumption index.
[0027] In one possible design, the comprehensive computational model is
[0028] S=ω1A+ω2B+ω3C+ω4D+ω5E+ω6F
[0029] Among them, S represents the comprehensive index, A, B, C, D, E and F represent the write speed index, read speed index, remaining capacity index, working time index, failure rate index and power consumption index respectively, ω1, ω2, ω3, ω4, ω5 and ω6 are the set first weight coefficient, second weight coefficient, third weight coefficient, fourth weight coefficient, fifth weight coefficient and sixth weight coefficient respectively.
[0030] In a possible design, the use of the write addresses of the target data block and the mirror data block to form an address pair, and the address pair is associated with the corresponding data segment number and then entered into the data storage table, including:
[0031] Using the write addresses of the target data block and the mirror data block to form an address pair, and determining the data segment number associated with the address pair;
[0032] The data segment numbers associated with the address pairs are entered into the data segment number column of the data storage table in the order of numbers, and the address pairs are entered into the address pair column of the data storage table so that the address pairs and the associated data segment numbers are in the same row.
[0033] In a second aspect, a high-speed storage array data storage device is provided, comprising a data acquisition unit, a data replication unit, a data segmentation unit, an information collection unit, an array sorting unit, a data writing unit, an address entry unit and a table archiving unit, wherein:
[0034] A data acquisition unit, used to acquire a target data set to be stored and a unique data label of the target data set;
[0035] A data replication unit is used to replicate the target data set to obtain a mirror data set of the target data set;
[0036] A data segmentation unit is used to segment the target data set and the mirror data set based on the set segmentation conditions to obtain a number of target data blocks and mirror data blocks corresponding to each target data block, and to sequentially form data block pairs with each target data block and its corresponding mirror data block, and each data block pair is associated with a corresponding data segment number;
[0037] An information collection unit, used to collect basic attribute information and historical status information of each storage unit in the storage array in real time;
[0038] An array sorting unit, used to sort the priority of each storage unit according to the basic attribute information and historical status information of each storage unit, and select the two storage units with the highest priority as the storage units to be written;
[0039] A data writing unit is used to sequentially extract a pair of data blocks, write the target data block and the mirror data block of the data block pair into two storage units to be written respectively, and obtain the write addresses of the target data block and the mirror data block;
[0040] The address entry unit is used to form an address pair using the write addresses of the target data block and the mirror data block, and enter the address pair into the data storage table after associating the corresponding data segment number to obtain the final data storage table.
[0041] The table archiving unit is used to associate the final data storage table with the unique data label of the target data set and then archive it.
[0042] In a third aspect, a high-speed storage array data storage device is provided, comprising:
[0043] A memory for storing instructions;
[0044] A processor is used to read the instructions stored in the memory and execute any one of the methods described in the first aspect according to the instructions.
[0045] In a fourth aspect, a computer-readable storage medium is provided, wherein instructions are stored on the computer-readable storage medium, and when the instructions are executed on a computer, the computer is caused to execute any one of the methods described in the first aspect. In addition, a high-speed storage array data storage server is provided, wherein the server is pre-installed with a computer program product, and when the computer program product is executed on the server, the server is caused to execute any one of the methods described in the first aspect.
[0046] Beneficial effect: The present invention obtains several data block pairs with corresponding data segment numbers by copying and segmenting the target data set to be stored, and then prioritizes and selects each storage unit based on the basic attribute information and historical status information of each storage unit in the storage array in real time, and then sequentially writes the data block pairs into the two storage units with the highest priority, obtains two write addresses to form an address pair, associates the address pair with the corresponding data segment number and enters it into the data storage table, and repeats this until the data entry is completed to obtain the final data storage table, and finally associates the final data storage table with the unique data tag of the target data set and archives it, so as to realize high-speed distributed storage and redundant backup of data in the storage array. The present invention can significantly improve the storage efficiency of data, ensure the reliability and integrity of data storage, and by analyzing the performance and status of each storage unit in the storage array and selecting the storage unit for data storage in real time, the storage space of each storage unit can be effectively utilized, the load capacity of each storage unit can be balanced, and the overall working performance of the storage array can be optimized and improved. BRIEF DESCRIPTION OF THE DRAWINGS
[0047] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0048] Figure 1 This is a schematic diagram of the steps of the method in Example 1 of the present invention;
[0049] Figure 2 This is a schematic diagram of the structure of the device in Example 2 of the present invention;
[0050] Figure 3 This is a schematic diagram of the structure of the device in Example 3 of the present invention. DETAILED DESCRIPTION
[0051] It should be noted that the description of these embodiments is used to help understand the present invention, but does not constitute a limitation of the present invention. The specific structures and functional details disclosed herein are only used to describe the exemplary embodiments of the present invention. However, the present invention can be embodied in many alternative forms, and it should not be understood that the present invention is limited to the embodiments set forth herein.
[0052] It should be understood that, unless otherwise clearly specified and limited, the term "connection" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the embodiments can be understood according to specific circumstances.
[0053] In the following description, certain details are provided to facilitate a complete understanding of the example embodiments. However, it will be appreciated by those of ordinary skill in the art that the example embodiments may be implemented without these certain details. For example, devices may be shown in block diagrams to avoid obscuring the examples with unnecessary details. In other embodiments, well-known processes, structures, and techniques may not be shown in unnecessary detail to avoid obscuring the embodiments.
[0054] Embodiment 1:
[0055] This embodiment provides a high-speed storage array data storage method, which can be used in an array controller of a storage array, such as Figure 1 As shown, the method comprises the following steps:
[0056] S1. Obtain the target data set to be stored and the unique data label of the target data set.
[0057] In specific implementation, the array controller first receives the target data set to be stored and the storage classification for the target data set transmitted by the external data end. Several storage classifications can be set in advance, and the external data end selects a storage classification as the storage classification of the target data set. The array controller generates a unique data number for the target data set, and generates a storage classification number according to the storage classification for the target data set, and uses the unique data number and the storage classification number to form a unique data tag for the target data set.
[0058] S2. Copy the target data set to obtain a mirror data set of the target data set.
[0059] In specific implementation, the array controller replicates the target data set to obtain a mirror data set of the target data set. The data replication facilitates subsequent redundant backup of the target data set.
[0060] S3. Based on the set segmentation conditions, the target data set and the mirror data set are segmented respectively to obtain a number of target data blocks and mirror data blocks corresponding to each target data block, and each target data block and its corresponding mirror data block are sequentially grouped into data block pairs, and each data block pair is associated with a corresponding data segment number.
[0061] In a specific implementation, the array controller determines the number of segment bits or the number of segment bytes based on the set segment conditions; then segments the target data set and the mirror data set according to the number of segment bits or the number of segment bytes to obtain a number of target data blocks and mirror data blocks corresponding to each target data block; then, each target data block and its corresponding mirror data block are sequentially grouped into data block pairs, and each data block pair is associated with a corresponding data segment number.
[0062] S4. Collect basic attribute information and historical status information of each storage unit in the storage array in real time.
[0063] In specific implementation, after the data segmentation is completed, the array controller collects basic attribute information and historical status information of each storage unit in the storage array in real time. The basic attribute information includes data writing speed, data reading speed and remaining storage capacity, and the historical status information includes cumulative working time, historical failure rate and historical average power consumption.
[0064] S5. Prioritize each storage unit according to its basic attribute information and historical status information, and select two storage units with the highest priority as the storage units to be written.
[0065] In specific implementation, the array controller first determines the storage classification number of the target data set according to the unique data tag of the target data set, and retrieves the corresponding indicator conversion rules and comprehensive calculation models based on the storage classification number. The indicator conversion rules include a write speed index formula, a read speed index formula, a remaining capacity index formula, a working time index formula, a failure rate index formula and a power consumption index formula. For example, the write speed index formula is A=a×α×100%, where A is the write speed index, a is the data writing speed, and α is the set write speed conversion parameter; the read speed index formula is B=b×β×100%, where B is the read speed index, b is the data reading speed, and β is the set read speed conversion parameter; the remaining capacity index formula is C=c×γ×100%, where C is the remaining capacity index. , c is the remaining storage capacity, γ is the set remaining capacity conversion parameter; the working time index formula is D=d×δ×100%, where D is the working time index, d is the cumulative working time, and δ is the set working time conversion parameter; the failure rate index formula is E=e×ε×100%, where E is the failure rate index, e is the historical failure rate, and ε is the set failure rate conversion parameter; the power consumption index formula is F=f×ζ×100%, where F is the power consumption index, f is the historical average power consumption, and ζ is the set power consumption conversion parameter; and so on, the formulas of the indicator conversion rules can be configured and set according to actual needs.
[0066] Then, the index conversion rules are used to convert the data writing speed, data reading speed, remaining storage capacity, cumulative working time, historical failure rate and historical average power consumption of each storage unit to obtain the writing speed index, reading speed index, remaining capacity index, working time index, failure rate index and power consumption index of each storage unit. That is, the data writing speed is substituted into the writing speed index formula to calculate and obtain the writing speed index; the data reading speed is substituted into the reading speed index formula to calculate and obtain the reading speed index; the remaining storage capacity is substituted into the remaining capacity index formula to calculate and obtain the remaining capacity index; the cumulative working time is substituted into the working time index formula to calculate and obtain the working time index; the historical failure rate is substituted into the failure rate index formula to calculate and obtain the failure rate index; the historical average power consumption is substituted into the power consumption index formula to calculate and obtain the power consumption index.
[0067] Next, the write speed index, read speed index, remaining capacity index, working time index, failure rate index and power consumption index of each storage unit are substituted into the comprehensive calculation model for calculation to obtain the comprehensive index of each storage unit. The comprehensive calculation model is:
[0068] S=ω1A+ω2B+ω3C+ω4D+ω5E+ω6F
[0069] Among them, S represents the comprehensive index, A, B, C, D, E and F represent the write speed index, read speed index, remaining capacity index, working time index, failure rate index and power consumption index respectively, ω1, ω2, ω3, ω4, ω5 and ω6 are the set first weight coefficient, second weight coefficient, third weight coefficient, fourth weight coefficient, fifth weight coefficient and sixth weight coefficient respectively.
[0070] Finally, the storage units are prioritized according to their comprehensive indexes. The higher the comprehensive index, the higher the priority, and the two storage units with the highest priority are selected as the storage units to be written.
[0071] S6. extract a pair of data blocks in sequence, write the target data block and the mirror data block of the data block pair into two storage units to be written respectively, and obtain the write addresses of the target data block and the mirror data block.
[0072] In specific implementation, the array controller extracts the first pair of data block pairs in the current data block pair queue according to the arrangement order of the data block pairs, and writes the target data block and the mirror data block of the data block pair into two storage units to be written, respectively, to obtain the write addresses of the target data block and the mirror data block in the two storage units to be written.
[0073] S7. Use the write addresses of the target data block and the mirror data block to form an address pair, and associate the address pair with the corresponding data segment number and enter it into the data storage table.
[0074] In a specific implementation, the array controller may use the write addresses of the target data block and the mirror data block to form an address pair, and determine the data segment number associated with the address pair, and then enter the data segment number associated with the address pair into the data segment number column of the data storage table in numerical order, and enter the address pair into the address pair column in the data storage table, so that the address pair and the associated data segment number are in the same row.
[0075] S8. Repeat steps S4 to S7 until all data segment numbers and address pairs corresponding to all data block pairs have been entered into the data storage table, thereby obtaining a final data storage table.
[0076] In specific implementation, the array controller may repeatedly execute the above steps S4 to S7 until all data block pairs have been written into the storage array and the data segment numbers and address pairs corresponding to all data block pairs have been entered into the data storage table, thereby obtaining a final data storage table.
[0077] S9. Associate the final data storage table with the unique data label of the target dataset and archive it.
[0078] In specific implementation, the array controller associates the final data storage table with the unique data tag of the target data set and archives it, and stores it in a locally preset storage space. When the external data terminal needs to obtain the target data set, the array controller can retrieve the final data storage table according to the unique data tag, and then extract the storage address of each target data block from the final data storage table, and then extract each target data block from each storage unit according to the storage address to form the target data set. When the target data block in a storage unit is lost, the array controller can extract the storage address of the mirror data block corresponding to the target data block from the final data storage table, and then extract the mirror data block from the corresponding storage unit according to the storage address of the mirror data block to replace the target data block for use, or copy it to the address of the target data block to re-record the lost target data block.
[0079] The method of this embodiment can realize high-speed distributed storage and redundant backup of data in the storage array, significantly improve the storage efficiency of data, ensure the reliability and integrity of data storage, and through the performance and status analysis of each storage unit in the storage array, select the storage unit in real time for data storage, which can effectively utilize the storage space of each storage unit, balance the load capacity of each storage unit, and optimize and improve the overall working performance of the storage array.
[0080] Embodiment 2:
[0081] This embodiment provides a high-speed storage array data storage device, such as Figure 2 As shown, it includes a data acquisition unit, a data replication unit, a data segmentation unit, an information collection unit, an array sorting unit, a data writing unit, an address entry unit and a table archiving unit, wherein:
[0082] A data acquisition unit, used to acquire a target data set to be stored and a unique data label of the target data set;
[0083] A data replication unit is used to replicate the target data set to obtain a mirror data set of the target data set;
[0084] A data segmentation unit is used to segment the target data set and the mirror data set based on the set segmentation conditions to obtain a number of target data blocks and mirror data blocks corresponding to each target data block, and to sequentially form data block pairs with each target data block and its corresponding mirror data block, and each data block pair is associated with a corresponding data segment number;
[0085] An information collection unit, used to collect basic attribute information and historical status information of each storage unit in the storage array in real time;
[0086] An array sorting unit, used to sort the priority of each storage unit according to the basic attribute information and historical status information of each storage unit, and select the two storage units with the highest priority as the storage units to be written;
[0087] A data writing unit is used to sequentially extract a pair of data blocks, write the target data block and the mirror data block of the data block pair into two storage units to be written respectively, and obtain the write addresses of the target data block and the mirror data block;
[0088] The address entry unit is used to form an address pair using the write addresses of the target data block and the mirror data block, and enter the address pair into the data storage table after associating the corresponding data segment number to obtain the final data storage table.
[0089] The table archiving unit is used to associate the final data storage table with the unique data label of the target data set and then archive it.
[0090] Embodiment 3:
[0091] This embodiment provides a high-speed storage array data storage device, such as Figure 3 As shown, at the hardware level, it includes:
[0092] Data interface, used to establish data connection between the processor and the external data terminal;
[0093] A memory for storing instructions;
[0094] The processor is used to read the instructions stored in the memory and execute the high-speed storage array data storage method in embodiment 1 according to the instructions.
[0095] Optionally, the device further includes an internal bus, through which the processor, the memory and the data interface can be interconnected, and the internal bus can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc.
[0096] The memory may include, but is not limited to, random access memory (RAM), read only memory (ROM), flash memory, first input first output (FIFO) and / or first in last out (FILO) memory, etc. The processor may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
[0097] Embodiment 4:
[0098] This embodiment provides a computer-readable storage medium, on which instructions are stored, and when the instructions are executed on a computer, the computer executes the high-speed storage array data storage method in Embodiment 1. The computer-readable storage medium refers to a carrier for storing data, which may include but is not limited to a floppy disk, an optical disk, a hard disk, a flash memory, a USB flash drive, and / or a memory stick, etc. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices.
[0099] This embodiment also provides a high-speed storage array data storage server, the server is pre-installed with a computer program product, when the computer program product is run on the server, the server executes the high-speed storage array data storage method in embodiment 1. The server can be a general-purpose computer, a special-purpose computer, a computer network or other programmable device.
[0100] Finally, it should be noted that the above description is only a preferred embodiment of the present invention and is not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.
Claims
1. A high-speed storage array data storage method, characterized in that: include: a. Obtain the target data set to be stored and the unique data label of the target data set; b. Copy the target data set to obtain a mirror data set of the target data set; c. Based on the set segmentation conditions, the target data set and the mirror data set are segmented to obtain a number of target data blocks and mirror data blocks corresponding to each target data block, and each target data block and its corresponding mirror data block are sequentially formed into data block pairs, and each data block pair is associated with a corresponding data segment number; d. Real-time collection of basic attribute information and historical status information of each storage unit in the storage array, the basic attribute information includes data writing speed, data reading speed and remaining storage capacity, the historical status information includes cumulative working time, historical failure rate and historical average power consumption; e. Prioritize each storage unit according to its basic attribute information and historical status information, and select the two storage units with the highest priority as the storage units to be written; The method of prioritizing each storage unit according to basic attribute information and historical status information of each storage unit includes: determining the storage classification number of the target data set according to the unique data tag of the target data set; retrieving the corresponding indicator conversion rule and comprehensive calculation model based on the storage classification number; using the indicator conversion rule to perform indicator conversion processing on the data writing speed, data reading speed, remaining storage capacity, cumulative working time, historical failure rate and historical average power consumption of each storage unit to obtain the writing speed index, reading speed index, remaining capacity index, working time index, failure rate index and power consumption index of each storage unit; substituting the writing speed index, reading speed index, remaining capacity index, working time index, failure rate index and power consumption index of each storage unit into the comprehensive calculation model for calculation to obtain the comprehensive index of each storage unit; and prioritizing each storage unit based on the comprehensive index; f. Sequentially extract a pair of data blocks, write the target data block and the mirror data block of the data block pair into two storage units to be written, and obtain the write address of the target data block and the mirror data block; g. Use the write address of the target data block and the mirror data block to form an address pair, and associate the address pair with the corresponding data segment number and enter it into the data storage table; h. Repeat steps d-g until all data blocks corresponding to the data segment numbers and address pairs have been entered into the data storage table to obtain the final data storage table; i. Associate the final data storage table with the unique data label of the target dataset and archive it.
2. The high-speed storage array data storage method according to claim 1, characterized in that: The target data set and the mirror data set are segmented based on the set segmentation conditions to obtain a plurality of target data blocks and mirror data blocks corresponding to each target data block, including: Determine the number of segment bits or segment bytes based on the set segment conditions; The target data set and the mirror data set are segmented according to the number of segment bits or the number of segment bytes to obtain a number of target data blocks and mirror data blocks corresponding to each target data block.
3. The high-speed storage array data storage method according to claim 1, characterized in that: The index conversion rule includes a write speed index formula, a read speed index formula, a remaining capacity index formula, a working time index formula, a failure rate index formula and a power consumption index formula. The index conversion rule is used to perform index conversion processing on the data write speed, data read speed, remaining storage capacity, cumulative working time, historical failure rate and historical average power consumption of each storage unit to obtain the write speed index, read speed index, remaining capacity index, working time index, failure rate index and power consumption index of each storage unit, including: Substitute the data writing speed into the writing speed index formula to calculate and obtain the writing speed index; substitute the data reading speed into the reading speed index formula to calculate and obtain the reading speed index; substitute the remaining storage capacity into the remaining capacity index formula to calculate and obtain the remaining capacity index; substitute the accumulated working time into the working time index formula to calculate and obtain the working time index; substitute the historical failure rate into the failure rate index formula to calculate and obtain the failure rate index; substitute the historical average power consumption into the power consumption index formula to calculate and obtain the power consumption index.
4. The high-speed storage array data storage method according to claim 1, characterized in that: The comprehensive calculation model is S=ω1A+ω2B+ω3C+ω4D+ω5E+ω6F Among them, S represents the comprehensive index, A, B, C, D, E and F represent the write speed index, read speed index, remaining capacity index, working time index, failure rate index and power consumption index respectively, ω1, ω2, ω3, ω4, ω5 and ω6 are the set first weight coefficient, second weight coefficient, third weight coefficient, fourth weight coefficient, fifth weight coefficient and sixth weight coefficient respectively.
5. The high-speed storage array data storage method according to claim 1, characterized in that: The method of using the write addresses of the target data block and the mirror data block to form an address pair, and associating the address pair with the corresponding data segment number and entering it into the data storage table includes: Using the write addresses of the target data block and the mirror data block to form an address pair, and determining the data segment number associated with the address pair; The data segment numbers associated with the address pairs are entered into the data segment number column of the data storage table in the order of numbers, and the address pairs are entered into the address pair column of the data storage table so that the address pairs and the associated data segment numbers are in the same row.
6. A high-speed storage array data storage device, characterized in that: It includes a data acquisition unit, a data replication unit, a data segmentation unit, an information collection unit, an array sorting unit, a data writing unit, an address entry unit and a table archiving unit, wherein: A data acquisition unit, used to acquire a target data set to be stored and a unique data label of the target data set; A data replication unit is used to replicate the target data set to obtain a mirror data set of the target data set; A data segmentation unit is used to segment the target data set and the mirror data set based on the set segmentation conditions to obtain a number of target data blocks and mirror data blocks corresponding to each target data block, and to sequentially form data block pairs with each target data block and its corresponding mirror data block, and each data block pair is associated with a corresponding data segment number; An information collection unit, used to collect basic attribute information and historical status information of each storage unit in the storage array in real time, wherein the basic attribute information includes data writing speed, data reading speed and remaining storage capacity, and the historical status information includes accumulated working time, historical failure rate and historical average power consumption; An array sorting unit, used to prioritize each storage unit according to basic attribute information and historical status information of each storage unit, and select the two storage units with the highest priority as the storage units to be written; the prioritization of each storage unit according to the basic attribute information and historical status information of each storage unit includes: determining the storage classification number of the target data set according to the unique data tag of the target data set; retrieving the corresponding indicator conversion rule and comprehensive calculation model based on the storage classification number; using the indicator conversion rule to perform indicator conversion processing on the data writing speed, data reading speed, remaining storage capacity, cumulative working time, historical failure rate and historical average power consumption of each storage unit to obtain the writing speed index, reading speed index, remaining capacity index, working time index, failure rate index and power consumption index of each storage unit; substituting the writing speed index, reading speed index, remaining capacity index, working time index, failure rate index and power consumption index of each storage unit into the comprehensive calculation model for calculation to obtain the comprehensive index of each storage unit; prioritizing each storage unit based on the comprehensive index; A data writing unit is used to sequentially extract a pair of data blocks, write the target data block and the mirror data block of the data block pair into two storage units to be written respectively, and obtain the write addresses of the target data block and the mirror data block; The address entry unit is used to form an address pair using the write addresses of the target data block and the mirror data block, and enter the address pair into the data storage table after associating the corresponding data segment number to obtain the final data storage table. The table archiving unit is used to associate the final data storage table with the unique data label of the target data set and then archive it.
7. A high-speed storage array data storage device, characterized in that: include: A memory for storing instructions; A processor is used to read the instructions stored in the memory and execute the high-speed storage array data storage method according to any one of claims 1 to 5 according to the instructions.
8. A high-speed storage array data storage server, characterized in that: The server is preinstalled with a computer program product, and when the computer program product runs on the server, the server executes the high-speed storage array data storage method according to any one of claims 1 to 5.
Citation Information
Patent Citations
Phase change memory, data-parallel writing method and data reading method
CN103295627A
Method, equipment for data replication and computer program product
CN110737396A
Data storage method and device and data reading method and device
CN112328172A
Data storage method and system based on cloud order virtualization platform
CN116880765A
Hierarchical data compression testing
US20120221533A1
