Unlock instant, AI-driven research and patent intelligence for your innovation.

Data reconstruction automatic parameter adjustment method and system based on a genetic algorithm, and storage medium

A genetic algorithm and data reconstruction technology, applied in the direction of genetic law, redundant operation data error detection, electrical digital data processing, etc. The design principle is reliable and the effect of wide application prospect

Pending Publication Date: 2021-08-03
济南浪潮数据技术有限公司
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Aiming at the problem of gluster’s default cluster reconstruction scheme in the prior art and the lack of optimization for special scenes, resulting in low recovery performance of small scenes; the present invention provides an automatic parameter adjustment method, system and storage for data reconstruction based on genetic algorithm medium to solve the above technical problems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data reconstruction automatic parameter adjustment method and system based on a genetic algorithm, and storage medium
  • Data reconstruction automatic parameter adjustment method and system based on a genetic algorithm, and storage medium
  • Data reconstruction automatic parameter adjustment method and system based on a genetic algorithm, and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0036] Such as figure 1 As shown, this embodiment provides a genetic algorithm-based automatic parameter adjustment method for data reconstruction including the following steps:

[0037] S1: Introduce the genetic algorithm, in the data recovery control algorithm, accumulate the size of the recovered objects, and record the total number of recovered objects and the number of recovered small objects;

[0038] S2: Determine the type of data recovery scenario, and determine the optimal parameter processing method according to the ratio of the number of recovery to the total number of recovery objects under different recovery methods obtained in step S1;

[0039] In the step S2, the data recovery scenario types include files, blocks, and objects; the total data recovery amount of data recovery in the next recovery period is calculated regularly by a timer, and then data training is performed according to the rules of the genetic algorithm to obtain a single recovery. The optimal p...

Embodiment 2

[0066] Such as figure 2 As shown, this embodiment provides an automatic parameter adjustment system 1 for data reconstruction based on a genetic algorithm, including: a distinguishing recovery scene module 2, the distinguishing recovery scene module 2 sends a distinguishing signal to the counting module 3, and the counting module 3 Under different restoration scenarios, record the total number of restored objects, the number of restored small objects, and the size of the restored objects. The counting module 3 sends the counting information to the matching parameter module 4, and the matching parameter module 4 determines and selects the best parameter processing method.

[0067] The system that present embodiment provides also comprises the processing module 5 of NVME hard disk and adjusts and reconstructs the speed module 6, and the processing module 5 of described NVME hard disk introduces the thought mechanism of graphics processor multi-threading, obtains the number of gr...

Embodiment 3

[0069] This embodiment provides a computer storage medium, where instructions are stored in the computer storage medium, and when the computer is run on the computer, the computer is made to execute the above method.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a data reconstruction automatic parameter adjustment method and system based on a genetic algorithm, and a storage medium, and the method comprises the following steps: S1, introducing the genetic algorithm, accumulating the sizes of recovery objects in a data recovery control algorithm, and recording the total number of the recovery objects and the number of recovered small objects; S2, judging the type of a data recovery scene, and determining and selecting the optimal parameter processing mode according to the proportion of the recovery number in the total recovery object number in different recovery modes obtained in the step S1; S3, according to the different recovery scenes determined in the step S2, selecting an algorithm to balance the weight, matching different parameters, and therefore recovery parameters in the different scenes are optimized; S4, counting in the step S1 is finally emptied in the genetic algorithm trainer, so that the recovery parameters of the recovery scene are optimized in the next period; S5, processing the NVME hard disk under the genetic algorithm; and S6, adjusting the reconstruction speed according to the cluster scale.

Description

technical field [0001] The invention belongs to the field of data restoration, and in particular relates to an automatic parameter adjustment method, system and storage medium for data reconstruction based on a genetic algorithm. Background technique [0002] The key to a storage system is to store data. The main feature of distributed storage is that a large-scale cluster may be a large-capacity storage pool composed of thousands of disks. The data volume of the storage pool can reach the level of PB or even EB. In case of failure or capacity expansion, data recovery after capacity reduction is a very important process. The data carried by the failed disk is redistributed to the new disk, and the process of recovering the data in the failed disk from other normal disks is called reconstructing data. In the existing technology, the gluster default cluster reconstruction scheme is adopted, and there is a lack of optimization for special scenarios, such as the scenario of a l...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/14G06N3/12
CPCG06F11/1471G06N3/126
Inventor 毛贝贝
Owner 济南浪潮数据技术有限公司