A fault-tolerant distributed storage system based on modal instruction for quickly troubleshooting data failure and safe storage

Abstract

The application discloses a fault-tolerant distributed storage system based on modal instruction for realizing quick troubleshooting of data faults and safe storage, belongs to the technical field of storage systems, and comprises a modal instruction query and troubleshooting data fault visual system and a modal instruction safe storage analysis system which are connected with a key-value pair storage, and the modal instruction safe storage analysis system is further connected with a high-frequency and low-frequency modal instruction storage cluster.The application utilizes the modal instruction characteristics, realizes safe distributed storage of data, and according to the effective positioning of the modal instruction classified address key-value pair, can quickly find the data fault source, saves the troubleshooting time, reduces the accident repair cost, more reasonably finds a solution, and makes more effective guarantee for the digital economy.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of storage systems, and in particular to a fault-tolerant distributed storage system based on modal instructions for quickly troubleshooting data faults and secure storage. BACKGROUND

[0002] Generally, with the rapid development of intelligent mechanical technology, the demand for operation data is increasing, and with the use of a large amount of complex data, it is difficult to troubleshoot in a short time once data problems occur. The use of modal instruction characteristics (continuity, inheritance, function grouping, multi-modal association, structured coding, and reduction of data redundancy) can quickly locate the data problem point, saving troubleshooting time, and greatly reducing development and testing costs and production economic losses, whether in the testing phase or in the production phase.

[0003] At the same time, after the problem occurs, normal business services cannot be interrupted, otherwise the production downtime loss will be expanded, and the fault-tolerant storage solution is particularly important, not only to solve the troubleshooting efficiency, but also to consider fault-tolerant production backup.

[0004] In addition to troubleshooting efficiency and fault-tolerant features, data security is also an important part, otherwise data leakage and data loss will also face huge losses. The use of modal instructions and distributed storage solutions that establish corresponding key-value pairs with stored data not only ensures the security of the data, but also manages the data scientifically according to the scientific modal instruction classification technology, implements high and low frequency classification calculation, reasonably uses computing resources, efficiently realizes application efficiency, not only saves energy and reduces emissions, but also reasonably uses storage resources, and achieves the purpose of economic benefit.

[0005] In summary, the current ordinary distributed storage method mainly uses simple storage technology to directly store data, which cannot provide fine services for a large number of business scenarios and production needs that use modal instructions, and it is also difficult to troubleshoot data abnormalities and faults, and it does not meet the development trend of future data services. Efficient use, troubleshooting and secure storage of modal instruction data are urgent problems to be solved. SUMMARY

[0006] The purpose of the present application is to provide a fault-tolerant distributed storage system based on modal instructions for quickly troubleshooting data faults and secure storage, to solve the problems in the background art.

[0007] To achieve the above purpose, the technical solution adopted by the present application is:

[0008] The application discloses a fault-tolerant distributed storage system based on modal instructions, which realizes rapid troubleshooting of data faults and safe storage.

[0009] The modal instruction safe storage analysis system performs validity analysis on the generated data containing modal instructions, and classifies the modal instructions into high-frequency and low-frequency categories.

[0010] The modal instruction query and troubleshooting visual system is used for providing a visual interface, supporting fault query, frequency analysis and abnormal score calculation based on modal instructions.

[0011] The high-low frequency modal instruction storage cluster is a cluster for storing and configuring differential encryption of modal instructions classified according to data frequency of business scenarios.

[0012] Further, the modal instruction safe storage analysis system comprises a data production terminal, a data analyzer, a data abnormality feedback component, a modal instruction classification component, a high-frequency modal instruction classification frequency calculator, a low-frequency modal instruction classification frequency calculator, a corresponding modal instruction storage address key-value pair creation and update component and a data distribution storage selector.

[0013] The data production terminal is used for generating data containing modal instructions.

[0014] The data analyzer is used for analyzing whether the generated data is valid and existing modal instructions.

[0015] The modal instruction classification component is used for classifying the valid and existing modal instructions into high-frequency and low-frequency modal instructions through the high-frequency modal instruction classification frequency calculator and the low-frequency modal instruction classification frequency calculator.

[0016] The corresponding modal instruction storage address key-value pair creation and update component is used for creating and updating the modal instruction storage address key-value pair address of the classified modal instructions.

[0017] The data abnormality feedback component is used for feeding back data, which does not contain valid modal instructions and fails in the creation and update of the modal instruction storage address key-value pair address, to the data production terminal.

[0018] The data distribution storage selector is used for storing the high-frequency modal instructions and the low-frequency modal instructions into the high-frequency and low-frequency modal instruction storage clusters respectively.

[0019] Further, the creating and updating of the modal instruction storage address key-value pair component creates and updates the modal instruction storage address key-value pair address by using a hash table, array index algorithm.

[0020] Further, the key-value pair storage includes a main storage and a slave storage, and the data of the main storage is automatically backed up to the slave storage.

[0021] Further, the modal instruction query and troubleshooting visual system includes a modal instruction query and troubleshooting visual system, a modal instruction query and troubleshooting analyzer, a target modal instruction and corresponding data analyzer, and a modal instruction troubleshooting configuration information storage,

[0022] The modal instruction query and troubleshooting visual system is an operating interface system running on a computer, relying on the modal instruction troubleshooting configuration information storage and the key-value pair storage, for inputting accident troubleshooting conditions, result display, and system state monitoring;

[0023] The modal instruction query and troubleshooting analyzer is used to finely analyze the frequency and time period of the modal instruction with unclear abnormal display and large number of complex sources, to find the time point of the data connection established by the modal instruction key-value pair with the closest fault time point, narrow down the troubleshooting range, and efficiently find the problem modal instruction data;

[0024] The modal instruction query and troubleshooting analyzer is used to obtain frequency data from the key-value pair storage to analyze the problem modal instruction found in the troubleshooting, and set new troubleshooting conditions to continue the troubleshooting if there is no abnormality;

[0025] The target modal instruction and corresponding data analyzer analyzes the abnormal modal instruction and corresponding data found in the troubleshooting according to the corresponding data of the query instruction, calculates the troubleshooting score of the modal instruction, and returns the analysis result to the interface of the modal instruction query and troubleshooting visual system, and updates it to the modal instruction troubleshooting configuration information storage.

[0026] Further, the troubleshooting conditions include the modal instruction category, whether the running frequency matches, whether there is a storage address, whether the running time period is abnormal, whether the time difference is abnormal, whether the creation and update are successful, whether the modal instruction key-value pair address can be queried, whether the storage cluster database is valid according to the modal instruction key-value pair address query, and whether the data source is searchable.

[0027] Further, the high and low frequency modal instruction storage cluster includes a high frequency modal instruction storage cluster and a low frequency modal instruction storage cluster,

[0028] The high frequency modal instruction storage cluster uses a distributed storage cluster and a full flash storage pool, and uses a symmetric encryption algorithm to encrypt the data;

[0029] The low-frequency modal instruction storage cluster uses a distributed storage cluster and a hybrid storage pool, and uses an asymmetric encryption algorithm to encrypt the data.

[0030] Beneficial effects:

[0031] This invention utilizes the characteristics of modal instructions to achieve secure distributed data storage. By effectively locating address key-value pairs based on modal instruction classification, it can quickly find the source of data failure, save troubleshooting time, reduce accident repair costs, and find more reasonable solutions, thus providing more effective protection for the digital economy. Attached Figure Description

[0032] Figure 1 This is a flowchart of the present invention. Detailed Implementation

[0033] The present invention will now be described in further detail with reference to the accompanying drawings and specific embodiments.

[0034] Example

[0035] like Figure 1 As shown, this embodiment provides a fault-tolerant distributed storage system based on modal instructions for rapid troubleshooting and secure storage of data faults. It includes a modal instruction secure storage analysis system, a modal instruction query and data fault troubleshooting vision system, a high- and low-frequency modal instruction storage cluster, and a key-value pair memory for storing the mapping relationship between modal instructions and storage addresses.

[0036] The modal instruction secure storage analysis system performs validity analysis on the generated data containing modal instructions and classifies the modal instructions into high-frequency and low-frequency categories. The classified modal instructions are then mapped to key-value pairs of storage addresses.

[0037] The modal instruction secure storage and analysis system includes a data production terminal, a data analyzer, a data anomaly feedback component, a modal instruction classification component, a high-frequency modal instruction classification count calculator, a low-frequency modal instruction classification count calculator, a component for creating and updating corresponding modal instruction storage address key-value pairs, and a data distribution storage selector.

[0038] The data production terminal is used to generate data containing modal instructions. As the source of data production, the data production terminal can be a human-computer interaction device, electronic device, computer or other electronic hardware device, or a data source generated by human or automated machine operation.

[0039] The data analyzer is used to analyze whether the generated data is a valid and existing modal instruction. If the analysis result is an invalid modal instruction, it will be fed back to the data anomaly feedback component to notify and warn the data production terminal, so as to avoid invalid program operation and invalid data storage.

[0040] The modal instruction classification component is used to distinguish high and low frequency modal instructions by high frequency modal instruction classification times calculator and low frequency modal instruction classification times calculator. High and low frequency modal instructions refer to the number of times of using modal instructions within a time period to determine whether it is high or low frequency. For example, more than 3 times within 5 minutes is calculated as high frequency, and less than 3 times is calculated as low frequency. It can be defined according to actual business requirements. Through classification calculation, the calculation efficiency can be improved and the calculation resources can be saved.

[0041] The creation and update of the modal instruction storage address key-value pair component is used to create and update the modal instruction storage address key-value pair address after classification. Specifically, the algorithm of hash table and array index can be used to create and update the modal instruction storage address key-value pair address, and the key-value pair address will be stored in the modal instruction storage address key-value pair main memory after creation or update. In order to avoid data loss or facilitate query and verification, the main memory will automatically backup the data to the modal instruction storage address key-value pair from the storage.

[0042] The data exception feedback component is used to feed back the data that does not contain valid modal instructions and the creation and update of modal instruction storage address key-value pair address fails to the data production terminal. The data distribution storage selector is used to store high frequency modal instructions and low frequency modal instructions in high and low frequency modal instruction storage clusters respectively.

[0043] The modal instruction query and troubleshooting data fault visual system is used to provide a visual interface to support fault query, frequency analysis and abnormal score calculation based on modal instructions.

[0044] The modal instruction query and troubleshooting data fault visual system includes modal instruction query and troubleshooting visual system, modal instruction troubleshooting query, modal instruction troubleshooting analyzer, target modal instruction and corresponding data analyzer and modal instruction troubleshooting configuration information storage.

[0045] The modal instruction query and troubleshooting visual system is an operation interface system running on a computer, relying on a modal instruction troubleshooting configuration information storage and a key-value pair storage, inputting accident troubleshooting conditions, querying existing modal instruction key-value pair addresses, whole system health running time, and statistical display of modal instruction key-value pair data. The key-value pair address of abnormal data, whether the key-value pair is frequency abnormal, the abnormal frequency of the modal instruction, and the time point of the abnormal frequency, etc. Then, an algorithm (such as a Naive Bayes classifier) is used to determine whether the modal instruction and the corresponding data are abnormal. For example, when a production failure occurs, causing multiple devices to shut down, after troubleshooting external factors, the main cause needs to be found. The data can be viewed through the operation interface system. If the data is obviously abnormal, the modal instruction of the abnormal data can be directly found, so that the data source can be quickly located and the problem can be solved. If the abnormal fault source display is not obvious, and the modal instruction source is complex and large in quantity, the conditions can be set through the modal instruction troubleshooting query, the frequency and time period of the modal instruction data can be refined, the time point of the data connection established by the modal instruction key-value pair of the latest fault time point can be found, the troubleshooting range can be narrowed, the problem modal instruction data can be efficiently found, and the troubleshooting cost can be saved.

[0046] The modal instruction troubleshooting analyzer is used to obtain frequency data from the key-value pair storage to analyze the problem modal instruction found in the troubleshooting. If the analysis is normal, a new troubleshooting condition is set to continue the troubleshooting.

[0047] The target modal instruction and corresponding data analyzer analyzes the abnormal modal instruction and corresponding data found in the troubleshooting in combination with the corresponding data of the query instruction, calculates the troubleshooting score of the modal instruction, and returns the result of the analysis to the interface of the modal instruction query and troubleshooting visual system, and updates it to the modal instruction troubleshooting configuration information storage. The troubleshooting score of the modal instruction can be calculated, the score can be used to determine whether the instruction is abnormal, so that the accident modal instruction can be found, and the accident cause can be traced to find the cause. The troubleshooting score standard is shown in Table 1.

[0048] Table 1

[0049]

[0050] The high and low frequency mode instruction storage cluster is composed of a high frequency mode instruction storage cluster and a low frequency mode instruction storage cluster, and is intended to determine the storage cluster according to the data frequency of the business scene, for example, for the high frequency mode instruction storage cluster, a distributed storage cluster and a full flash storage pool can be used, and for the low frequency mode instruction storage cluster, a distributed storage cluster and a hybrid storage pool can be used, so that the cost value maximization can be achieved in the aspects of hardware configuration, operation and maintenance, and capacity. While using distributed storage technology, distinguishing high and low frequency mode instruction storage is also to more efficiently improve the fault tolerance mechanism. For high frequency mode instruction storage technology, high availability storage nodes should be focused on to avoid request interruption or response delay, while low frequency mode instruction storage should focus on multi-level hardware fault tolerance, so that the business service interruption is not easily affected when the hardware is replaced. Distinguishing high and low frequency mode instruction storage can also achieve fine treatment in data encryption and access control. For high frequency mode instruction storage data, symmetric encryption algorithm (such as AES-256 algorithm) can be used for data encryption, so that the encryption and decryption speed is relatively fast, which meets the high frequency use scene, saves processing time and saves resources; while the low frequency mode instruction storage data uses asymmetric encryption algorithm (such as RSA, DSA, ECC, etc.) for data encryption, which is not as fast as symmetric encryption algorithm, but can realize reasonable use of data characteristics and guarantee data security.

[0051] The storage system in the embodiment involves data analysis, data classification, data transmission and data storage technology. The data analysis mainly analyzes the effectiveness of the modal instruction contained in the data, which can be calculated according to business requirements, or can be calculated by using professional modal analysis software (such as ANSYS Workbench, ABAQUS, SolidworksSimulation, etc.). The data classification can be classified according to function, application field, instruction persistence and instruction group according to business scene and product demand. The data transmission uses a combination of wireless and wired data transmission technology. The data storage mainly uses a combination of direct storage technology, network storage technology and cloud storage technology. A fault-tolerant distributed storage system field based on modal instruction for quickly troubleshooting data faults and safe storage is disclosed, including devices, equipment, models, systems, and media.

[0052] Although the embodiments of the present application are described in the specification, these embodiments are only as a hint and should not limit the protection scope of the present application. Various omissions, substitutions and changes made within the scope of the present application should be included in the protection scope of the present application.

Claims

1. A fault-tolerant distributed storage system based on modal instruction to realize quick troubleshooting of data failure and safe storage, characterized in that, The modal instruction safe storage analysis system, the modal instruction query and troubleshooting visual system, the high and low frequency modal instruction storage cluster, and the key-value pair storage for storing the mapping relationship between the modal instruction and the storage address, The modal instruction safe storage analysis system performs validity analysis on the generated data containing the modal instruction, and classifies the modal instruction into high frequency and low frequency, and maps the storage address key-value pair to the key-value pair storage after classification. The modal instruction query and troubleshooting visual system is used to provide a visual interface, support fault query based on modal instruction, frequency analysis and abnormal score calculation. The high and low frequency modal instruction storage cluster is a cluster that stores and configures differential encryption according to the classification of modal instructions based on the frequency of using data in business scenarios. 2.The fault-tolerant distributed storage system based on the modal instruction to realize the quick troubleshooting of data failure and the safe storage according to claim 1, wherein: The modal instruction safe storage analysis system includes a data production terminal, a data analyzer, a data anomaly feedback component, a modal instruction classification component, a high frequency modal instruction classification times calculator, a low frequency modal instruction classification times calculator, a corresponding modal instruction storage address key-value pair creation and update component, and a data distribution storage selector, The data production terminal is used to generate data containing modal instructions. The data analyzer is used to analyze whether the generated data is valid and existing modal instruction. The modal instruction classification component is used to classify the valid and existing modal instruction into high and low frequency modal instruction through the high frequency modal instruction classification times calculator and the low frequency modal instruction classification times calculator. The corresponding modal instruction storage address key-value pair creation and update component is used to create and update the modal instruction storage address key-value pair address after classification. The data anomaly feedback component is used to feed back the data that does not contain valid modal instruction and fails to create and update the modal instruction storage address key-value pair address to the data production terminal. The data distribution storage selector is used to store high frequency modal instruction and low frequency modal instruction into high and low frequency modal instruction storage cluster respectively. 3.The fault-tolerant distributed storage system based on the modal instruction to realize the quick troubleshooting of data failure and the safe storage according to claim 2, wherein: The corresponding modal instruction storage address key-value pair creation and update component creates and updates the modal instruction storage address key-value pair address by using hash table and array index algorithm.

4. The fault-tolerant distributed storage system based on the modal instruction to realize the quick troubleshooting of data failure and the safe storage according to claim 1, characterized in that: The key-value pair storage includes a main storage and a slave storage, and the data of the main storage is automatically backed up to the slave storage.

5. The fault-tolerant distributed storage system based on modal instruction to realize quick troubleshooting of data failure and safe storage according to claim 1, characterized in that: The modal instruction query and troubleshooting visual system includes a modal instruction query and troubleshooting visual system, a modal instruction troubleshooting query, a modal instruction troubleshooting analyzer, a target modal instruction and a corresponding data analyzer, and a modal instruction troubleshooting configuration information storage, The modal instruction query and troubleshooting visual system is an operating interface system running on a computer, relying on the modal instruction troubleshooting configuration information storage and the key-value pair storage, and is used to input accident troubleshooting conditions, display results, and monitor system status. The modal instruction troubleshooting queryer is used for fine-grained frequency and time period of modal instructions with unobvious abnormal display and large number of sources, to find out the time point of data connection established by the modal instruction key-value pair with the closest fault time point, narrow down the troubleshooting range, and efficiently find the problem modal instruction data; The modal instruction troubleshooting analyzer is used for acquiring frequency data from the key-value pair memory, to analyze the problem modal instruction found in the troubleshooting, and set a new troubleshooting condition to continue the troubleshooting if there is no abnormality; The target modal instruction and corresponding data analyzer analyzes the abnormal modal instruction and corresponding data found in the troubleshooting according to the corresponding data of the query instruction, calculates the troubleshooting score of the modal instruction, returns the analysis result to the interface of the modal instruction query and troubleshooting visual system, and updates the result to the modal instruction troubleshooting configuration information memory. 6.The fault-tolerant distributed storage system based on the modal instruction to realize the quick troubleshooting of data failure and the safe storage according to claim 5, wherein: The troubleshooting condition includes the modal instruction category, whether the running frequency is matched, whether there is a storage address, whether the running time period is abnormal, whether the time difference is abnormal, whether the creation and update are successful, whether the modal instruction key-value pair address can be queried, whether the storage cluster database is valid according to the modal instruction key-value pair address query, and whether the data source is searchable. 7.The fault-tolerant distributed storage system based on modal instruction to realize quick troubleshooting of data failure and safe storage according to claim 1, wherein: The high and low frequency modal instruction storage cluster includes a high frequency modal instruction storage cluster and a low frequency modal instruction storage cluster, The high frequency modal instruction storage cluster uses a distributed storage cluster and a full flash storage pool, and uses a symmetric encryption algorithm to encrypt data; The low frequency modal instruction storage cluster uses a distributed storage cluster and a hybrid storage pool, and uses an asymmetric encryption algorithm to encrypt data.

Images