Fault-tolerant distributed storage system for realizing rapid data fault checking and secure storage based on modal instruction

Abstract

The invention discloses a fault-tolerant distributed storage system for realizing rapid data fault checking and secure storage based on a modal instruction, and belongs to the technical field of storage systems. Comprising a modal instruction query and troubleshooting data fault visual system and a modal instruction security storage analysis system which are connected with the modal instruction storage address key value pair memory, and the modal instruction security storage analysis system is connected with the high-frequency and low-frequency modal instruction storage clusters. According to the method, the characteristics of the modal instruction are applied, safe distributed data storage is achieved, meanwhile, according to effective positioning of the modal instruction classification address key value pairs, a data fault source can be quickly found, the troubleshooting time is saved, the accident repair cost is reduced, a solution is more reasonably found, and more effective guarantee is provided for digital economy.

Description

Technical Field

[0001] The present invention relates to the technical field of storage systems, and in particular, to a fault-tolerant distributed storage system that realizes fast troubleshooting of data faults and secure storage based on modal instructions. Background Art

[0002] Generally, with the rapid development of intelligent machinery technology, the demand for operation data is getting higher and higher. Along with the use of a large number of complex data, once data problems occur, it is difficult to troubleshoot in a short time. By using the characteristics of modal instructions (persistence, inheritance, function grouping, multi-modal association, structured coding, reducing data redundancy), the data problem points can be quickly located, saving troubleshooting time. Whether in the test stage or in the production stage, it greatly reduces the development and test costs and production economic losses.

[0003] At the same time, after problems occur, normal business services cannot be interrupted, otherwise the production outage losses will expand. A fault-tolerant storage solution is particularly important, which not only needs to solve the troubleshooting efficiency, but also should take into account fault-tolerant production backup.

[0004] In addition to troubleshooting efficiency and fault-tolerant characteristics, data security is also an important aspect. Otherwise, data leakage and data loss will also face huge losses. The distributed storage solution that uses modal instructions to establish corresponding key-value pairs with stored data not only ensures the security of data, but also scientifically manages the data according to the scientific modal instruction classification technology, realizes high and low frequency classification calculation, reasonably uses computing resources, and efficiently realizes application efficiency. It not only saves energy and reduces emissions, but also reasonably uses storage resources to achieve the purpose of being economical and practical.

[0005] In summary, the current common distributed storage methods mainly directly store data by simple storage technology, cannot finely serve business scenarios and production needs that use a large number of modal instructions, are difficult to troubleshoot data anomalies and generated faults, and do not conform to the development trend of future data services. Efficiently using, troubleshooting, and securely storing modal instruction data are problems that need to be solved urgently. Summary of the Invention

[0006] The purpose of the present invention is to provide a fault-tolerant distributed storage system that realizes fast troubleshooting of data faults and secure storage based on modal instructions, and solves the problems in the above background art.

[0007] To achieve the above purpose, the technical solution adopted by the present invention is as follows: A fault-tolerant distributed storage system that realizes fast troubleshooting of data faults and secure storage based on modal instructions, including a modal instruction secure storage analysis system, a modal instruction query and data fault troubleshooting vision system, a high and low frequency modal instruction storage cluster, and a modal instruction storage address key-value pair memory. The modal instruction secure storage analysis system performs validity analysis on the generated data containing modal instructions, classifies the modal instructions into high-frequency and low-frequency categories, and maps the classified modal instruction storage address key-value pairs to the modal instruction storage address key-value pair memory; The modal instruction query and data fault troubleshooting vision system is used to provide a visual interface, supporting fault query, frequency analysis, and abnormal score calculation based on modal instructions; The high-low frequency modal instruction storage cluster is a cluster that classifies and stores modal instructions according to the data usage frequency in business scenarios and configures differential encryption.

[0008] Furthermore, the modal instruction secure storage analysis system includes a data production terminal, a data analyzer, a data anomaly feedback component, a modal instruction classification component, a high-frequency modal instruction classification times calculator, a low-frequency modal instruction classification times calculator, a component for creating and updating corresponding modal instruction storage address key-value pairs, and a data distribution storage selector. The data production terminal is used to generate data containing modal instructions; The data analyzer is used to analyze whether the generated data is a valid and existing modal instruction; The modal instruction classification component is used to classify valid and existing modal instructions into high-frequency and low-frequency modal instructions through the high-frequency modal instruction classification times calculator and the low-frequency modal instruction classification times calculator. The component for creating and updating corresponding modal instruction storage address key-value pairs is used to create and update the addresses of the modal instruction storage address key-value pairs for the classified modal instructions; The data anomaly feedback component is used to feedback the data that the data analyzer analyzes does not contain valid modal instructions and the data for which the creation and update of the modal instruction storage address key-value pair addresses fail to the data production terminal; The data distribution storage selector is used to store high-frequency modal instructions and low-frequency modal instructions in the high-frequency and low-frequency modal instruction storage clusters respectively.

[0009] Furthermore, the component for creating and updating corresponding modal instruction storage address key-value pairs creates and updates the addresses of the modal instruction storage address key-value pairs by using algorithms such as hash tables and array indexes.

[0010] Furthermore, the modal instruction storage address key-value pair memory includes a main memory and a slave memory, and the data in the main memory will be automatically backed up to the slave memory.

[0011] Furthermore, the modal instruction query and data fault troubleshooting vision system includes a modal instruction query and troubleshooting vision system, a modal instruction troubleshooting query analyzer, a modal instruction troubleshooting analyzer, a target modal instruction and corresponding data analyzer, and a modal instruction troubleshooting configuration information memory. The modal instruction query and troubleshooting visual system is an operating interface system running on a computer, relying on the modal instruction troubleshooting configuration information memory and the modal instruction storage address key-value pair memory, and is used for inputting accident troubleshooting conditions, result display, and system status monitoring; The modal instruction troubleshooting query tool is used to refine the frequency and time period of modal instructions with unclear abnormal display of the fault source and complex and large quantities, so as to find the time point of the data connection established by the modal instruction key-value pair closest to the fault time point, narrow the troubleshooting scope, and efficiently find the problem modal instruction data; The modal instruction troubleshooting analyzer is used to obtain frequency data from the modal instruction storage address key-value pair memory to analyze the troubleshooting problem modal instructions. If there is no abnormality in the analysis, new troubleshooting conditions are set to continue troubleshooting; The target modal quality and corresponding data analyzer combines the query instruction corresponding data to analyze the abnormal modal instructions and corresponding data in the troubleshooting, calculates the troubleshooting score of the modal instructions, and returns the analyzed results to the interface of the modal instruction query and troubleshooting visual system, and updates them to the modal instruction troubleshooting configuration information memory.

[0012] Further, the troubleshooting conditions include modal instruction category, whether the operating frequency matches, whether there is a storage address, whether the operating time period is abnormal, whether the time difference is abnormal, whether the creation and update are successful, whether the modal instruction key-value pair address can be queried, whether it is effective to query the storage cluster database based on the modal instruction key-value pair address, and whether the data source is queryable.

[0013] Further, the high and low frequency modal instruction storage clusters include a high frequency modal instruction storage cluster and a low frequency modal instruction storage cluster. The high frequency modal instruction storage cluster uses a distributed storage cluster and a full flash storage pool, and uses a symmetric encryption algorithm to encrypt the data; The low frequency modal instruction storage cluster uses a distributed storage cluster and a hybrid storage pool, and uses an asymmetric encryption algorithm to encrypt the data.

[0014] Beneficial effects:

[0015] The present invention utilizes the characteristics of modal instructions to achieve secure distributed storage of data. At the same time, according to the effective positioning of the modal instruction classification address key-value pair, the data fault source can be quickly found, the troubleshooting time is saved, thereby reducing the accident repair cost, and a more reasonable solution can be found, providing a more effective guarantee for the digital economy. Brief Description of the Drawings

[0016] Figure 1 is the flowchart of the present invention. Detailed Embodiments

[0017] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0018] Embodiment As Figure 1 shown, this embodiment provides a fault-tolerant distributed storage system for quickly troubleshooting data faults and securely storing data based on modal instructions, including a modal instruction secure storage analysis system, a modal instruction query and data fault troubleshooting vision system, a high-frequency and low-frequency modal instruction storage cluster, and a modal instruction storage address key-value pair memory.

[0019] The modal instruction secure storage analysis system performs validity analysis on the generated data containing modal instructions, classifies the modal instructions into high-frequency and low-frequency ones, and maps the storage address key-value pairs of the classified modal instructions to the modal instruction storage address key-value pair memory.

[0020] The modal instruction secure storage analysis system includes a data production terminal, a data analyzer, a data anomaly feedback component, a modal instruction classification component, a high-frequency modal instruction classification times calculator, a low-frequency modal instruction classification times calculator, a component for creating and updating corresponding modal instruction storage address key-value pairs, and a data distribution storage selector.

[0021] The data production terminal is used to generate data containing modal instructions. As the data production source, the data production terminal can be an electronic hardware device such as a human-computer interaction device, an electronic device, a computer, etc., and is a data source generated through operations of people, automated machines, etc.

[0022] The data analyzer is used to analyze whether the generated data is a valid and existing modal instruction. If the analysis result is an invalid modal instruction, it will be fed back to the data anomaly feedback component to alert the data production terminal and avoid the ineffective operation of the program and the storage of invalid data.

[0023] The modal instruction classification component is used to distinguish high-frequency and low-frequency modal instructions from the valid and existing modal instructions through a high-frequency modal instruction classification times calculator and a low-frequency modal instruction classification times calculator. High-frequency and low-frequency modal instructions refer to judging whether they are high-frequency or low-frequency based on the number of times the modal instruction is used within a time period. For example, those executed more than 3 times within 5 minutes are considered high-frequency, and those executed less than 3 times are considered low-frequency, which can be defined according to actual business requirements. Through classification calculation, the calculation efficiency can be improved and calculation resources can be saved.

[0024] The component for creating and updating the key-value pairs of the modal instruction storage address is used to create and update the key-value pairs of the modal instruction storage address for the classified modal instructions. Specifically, the key-value pairs of the modal instruction storage address can be created and updated by using algorithms such as hash tables and array indexes, and the key-value pair address will be stored in the main memory of the modal instruction storage address key-value pair during both creation and update. To avoid data loss or facilitate query and verification, the main memory will automatically back up this data to the secondary memory of the modal instruction storage address key-value pair.

[0025] The data exception feedback component is used to feedback the data that does not contain valid modal instructions and the data with failed creation and update of the key-value pairs of the modal instruction storage address in the data analyzed by the data analyzer to the data production terminal. The data distribution storage selector is used to store high-frequency modal instructions and low-frequency modal instructions in high-frequency and low-frequency modal instruction storage clusters respectively.

[0026] The visual system for querying modal instructions and troubleshooting data faults is used to provide a visual interface, supporting fault query, frequency analysis, and abnormal score calculation based on modal instructions.

[0027] The visual system for querying modal instructions and troubleshooting data faults includes a visual system for querying and troubleshooting modal instructions, a modal instruction troubleshooting query analyzer, a modal instruction troubleshooting analyzer, a target modal instruction and the corresponding data analyzer, and a modal instruction troubleshooting configuration information memory.

[0028] The visual system for querying modal instructions and troubleshooting data faults is an operating interface system running on a computer. Relying on the modal instruction troubleshooting configuration information memory and the modal instruction storage address key-value pair memory, input the accident troubleshooting conditions to query the existing key-value pair addresses of modal instructions, the total healthy running time of the entire system, and the statistical display of modal instruction key-value pair data. The key-value pair addresses of abnormal data, whether the key-value pairs have abnormal frequencies, the time points when abnormal frequencies of modal instructions occur, etc. are obtained, and then algorithms (such as the Naive Bayes classifier) are used to determine whether the modal instruction and the corresponding data are abnormal. For example, when a production failure occurs and multiple devices are shut down, after excluding external factors, the main cause needs to be found. The data can be viewed through the operating interface system. If the data anomaly is obvious, the modal instruction with the abnormal data can be directly found, and the data source can be quickly located and the problem can be solved. If the anomaly display of the fault source is not obvious, and the sources of modal instructions are complex and large in number, the modal instruction troubleshooting query analyzer can be used to set conditions to refine the frequency and time period of modal instruction data, find the time point when the data connection is established for the key-value pair of the modal instruction closest to the fault time point, narrow the troubleshooting scope, and efficiently find the problem modal instruction data, saving the troubleshooting cost.

[0029] The modal instruction troubleshooting analyzer is used to obtain frequency data from the modal instruction storage address key-value pair memory to analyze the identified problematic modal instructions. If there is no anomaly in the analysis, new troubleshooting conditions are set to continue the troubleshooting.

[0030] The target modal quality and corresponding data analyzer analyzes the problematic modal instructions and corresponding data identified in combination with the data corresponding to the query instruction, calculates the troubleshooting score of the modal instruction, and returns the analyzed results to the interface of the modal instruction query and troubleshooting visual system, as well as updates them to the modal instruction troubleshooting configuration information memory. Under conditions such as this, the troubleshooting score of the modal instruction can be calculated. Based on this score, it can be determined whether the instruction is abnormal, thereby finding the accident modal instruction and tracing back to find the cause of the accident. The troubleshooting score criteria are shown in Table 1: Table 1

[0031] The high- and low-frequency modal instruction storage cluster consists of a high-frequency modal instruction storage cluster and a low-frequency modal instruction storage cluster, aiming to determine the storage cluster based on the data frequency in the business scenario. For example, for the high-frequency modal instruction storage cluster, a distributed storage cluster and a full-flash storage pool can be used. For the low-frequency modal instruction storage cluster, a distributed storage cluster and a hybrid storage pool can be used. In this way, the control cost value can be maximized in terms of hardware configuration, operation and maintenance management, and capacity. While applying distributed storage technology, differentiating between high- and low-frequency modal instruction storage is also to more efficiently improve the fault tolerance mechanism. For high-frequency modal instruction storage technology, high-availability storage nodes should be emphasized to avoid request interruption or slow response. For low-frequency modal instruction storage, multi-level hardware fault tolerance should be emphasized, and it is not easy to affect the interruption of business services when hardware is replaced. Differentiating between high- and low-frequency modal instruction storage can also achieve refined treatment in data encryption and access control. For the data stored in the high-frequency modal instruction storage, the symmetric encryption algorithm (such as the AES-256 algorithm) can be used for data encryption. In this way, the encryption and decryption speed is relatively fast, which conforms to the high-frequency usage scenario, saves processing time and resources. For the data stored in the low-frequency modal instruction storage, the asymmetric encryption algorithm (such as RSA, DSA, ECC, etc.) is used for data encryption. Although the encryption and decryption speed is not as fast as the symmetric encryption algorithm, it can reasonably utilize the data characteristics and ensure data security.

[0032] The storage system in this embodiment involves data analysis, data classification, data transmission, and data storage technologies. Among them, data analysis mainly analyzes the validity of the modal instructions contained in the data, which can be custom modeled and calculated according to business requirements, or can be carried out using professional modal analysis software (such as ANSYS Workbench, ABAQUS, Solidworks Simulation, etc.); data classification can be technically classified according to function, application field, instruction persistence, and instruction group according to business scenarios and product requirements; data transmission uses a combination of wireless and wired data transmission technologies; the data storage method mainly uses a combination of direct storage technology, network storage technology, and cloud storage technology; disclose a fault-tolerant distributed storage system field based on modal instructions for quickly troubleshooting data faults and secure storage, including devices, equipment, models, systems, and media.

[0033] Although the embodiments of the present invention are described in the specification, these embodiments are only for reference and should not limit the protection scope of the present invention. All omissions, substitutions, and changes made within the scope of the gist of the present invention should be included in the protection scope of the present invention.

Claims

1. A fault-tolerant distributed storage system that realizes rapid troubleshooting of data faults and secure storage based on modal instructions, characterized in that, It includes a modal instruction secure storage analysis system, a visual system for querying modal instructions and troubleshooting data faults, a high-low frequency modal instruction storage cluster, and a modal instruction storage address key-value pair memory. The modal instruction secure storage analysis system conducts validity analysis on the generated data containing modal instructions, classifies the modal instructions into high-frequency and low-frequency ones, and maps the storage address key-value pairs of the classified modal instructions to the modal instruction storage address key-value pair memory. The visual system for querying modal instructions and troubleshooting data faults is used to provide a visual interface, supporting fault query, frequency analysis, and abnormal score calculation based on modal instructions. The high-low frequency modal instruction storage cluster is a cluster that classifies and stores modal instructions according to the data usage frequency in business scenarios and configures differential encryption.

2. The fault-tolerant distributed storage system for quickly troubleshooting data faults and securely storing data based on modal instructions according to claim 1, wherein: The modal instruction secure storage analysis system includes a data production terminal, a data analyzer, a data anomaly feedback component, a modal instruction classification component, a high-frequency modal instruction classification times calculator, a low-frequency modal instruction classification times calculator, a component for creating and updating corresponding modal instruction storage address key-value pairs, and a data distribution storage selector. The data production terminal is used to generate data containing modal instructions. The data analyzer is used to analyze whether the generated data is valid and existing modal instructions. The modal instruction classification component is used to classify valid and existing modal instructions into high-frequency and low-frequency modal instructions through the high-frequency modal instruction classification times calculator and the low-frequency modal instruction classification times calculator. The component for creating and updating corresponding modal instruction storage address key-value pairs is used to create and update the addresses of the modal instruction storage address key-value pairs for the classified modal instructions. The data anomaly feedback component is used to feedback the data that the data analyzer analyzes as not containing valid modal instructions and the data for which the creation and update of the modal instruction storage address key-value pair addresses fail to the data production terminal. The data distribution storage selector is used to store high-frequency modal instructions and low-frequency modal instructions in the high-frequency and low-frequency modal instruction storage clusters respectively.

3. The fault-tolerant distributed storage system for quickly troubleshooting data faults and securely storing data based on modal instructions according to claim 2, wherein: The component for creating and updating corresponding modal instruction storage address key-value pairs creates and updates the addresses of the modal instruction storage address key-value pairs by applying algorithms such as hash tables and array indexes.

4. The fault-tolerant distributed storage system for quickly troubleshooting data faults and securely storing data based on modal instructions according to claim 1, wherein: The modal instruction storage address key-value pair memory includes a main memory and a slave memory, and the data in the main memory will be automatically backed up to the slave memory.

5. The fault-tolerant distributed storage system for quickly troubleshooting data faults and securely storing data based on modal instructions according to claim 1, wherein: The visual system for querying modal instructions and troubleshooting data faults includes a visual system for querying and troubleshooting modal instructions, a modal instruction troubleshooting query analyzer, a modal instruction troubleshooting analyzer, a target modal instruction and corresponding data analyzer, and a modal instruction troubleshooting configuration information memory. The visual system for querying modal instructions and troubleshooting data faults is an operating interface system running on a computer, relying on the modal instruction troubleshooting configuration information memory and the modal instruction storage address key-value pair memory, and is used for inputting accident troubleshooting conditions, result display, and system status monitoring. The modal instruction troubleshooting query tool is used to refine the frequency and time period of modal instructions with unclear abnormal display of the fault source and complex and large quantities of sources, so as to find out the time point of the data connection established by the key-value pair of the modal instruction closest to the fault time point, narrow down the troubleshooting scope, and efficiently find the problem modal instruction data; The modal instruction troubleshooting analyzer is used to obtain frequency data from the modal instruction storage address key-value pair memory to analyze the troubleshooting problem modal instructions. If there is no abnormality in the analysis, new troubleshooting conditions are set to continue troubleshooting; The target modal quality and corresponding data analyzer combines the query instruction corresponding data to analyze the abnormal modal instructions and corresponding data during troubleshooting, calculates the troubleshooting score of the modal instructions, and returns the analyzed results to the interface of the modal instruction query and troubleshooting visual system, as well as updates them to the modal instruction troubleshooting configuration information memory.

6. The fault-tolerant distributed storage system for quickly troubleshooting data faults and securely storing data based on modal instructions according to claim 5, wherein: The troubleshooting conditions include modal instruction category, whether the operating frequency matches, whether there is a storage address, whether the operating time period is abnormal, whether the time difference is abnormal, whether the creation / updating is successful, whether the modal instruction key-value pair address can be queried, whether it is effective to query the storage cluster database based on the modal instruction key-value pair address, and whether the data source is queryable.

7. The fault-tolerant distributed storage system for quickly troubleshooting data faults and securely storing data based on modal instructions according to claim 1, characterized in that: The high and low frequency modal instruction storage cluster includes a high frequency modal instruction storage cluster and a low frequency modal instruction storage cluster, The high frequency modal instruction storage cluster uses a distributed storage cluster and a full flash storage pool, and uses a symmetric encryption algorithm to encrypt the data; The low frequency modal instruction storage cluster uses a distributed storage cluster and a hybrid storage pool, and uses an asymmetric encryption algorithm to encrypt the data.

Images