Enterprise security data storage and optimization method and system
By using the first and second data distributors in the enterprise data storage system to process external and internal data needs respectively, and dynamically switch according to load conditions, the problems of low data processing efficiency and security risks are solved, and efficient and reliable data is achieved Store and optimize resource allocation.
Patent Information
- Application Number
- CN202411444015.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-16
- Publication Date
- 2025-01-10
- Estimated Expiration
- 2044-10-16
AI Technical Summary
In the prior art, external demands of enterprise data need to be extracted and sent from local databases manually, resulting in low data processing efficiency and security risks, and cannot meet the external audit requirements of suddenness, timeliness and strictness.
Adopt an enterprise secure data storage and optimization method, and handle the external and internal data needs of the enterprise through the first and second data distributors, judge the load condition of the distributor in real time, trigger optimization instructions based on the load difference and other indicators, and dynamically switch distribution. The machine optimizes data storage method to ensure safe and efficient data transmission.
It realizes flexible data storage selection, avoids overloading of a single distributor, improves data storage efficiency and reliability, optimizes resource allocation, reduces storage costs, and improves business response speed.
Smart Images

Figure CN119292535A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of enterprise data management, and in particular to an enterprise secure data storage and optimization method and system. Background Art
[0002] In today's era of accelerated digital transformation, enterprise data is not only an important basis for internal operations and decision-making, but also the cornerstone of external supervision, auditing and cooperation and communication. The internal demand for data analysis in enterprises is growing, including market trend forecasting, financial performance evaluation, operational process optimization and other aspects. These demands have driven enterprises to continue to pursue deep data mining and instant analysis capabilities. At the same time, external demands should not be ignored, especially the audit demands from the audit department, which require enterprises to provide complete, accurate and traceable data records to verify the compliance of enterprise operations and the authenticity of financial reports. These external demands are often sudden, timely and strict, and place extremely high demands on the data response capabilities of enterprises. However, in related technologies, when external needs arise, relevant personnel are required to manually extract data from the local database and package it and send it to external demand personnel, which has technical problems such as low data processing efficiency and data security risks. Summary of the invention
[0003] The present invention aims at the technical problems existing in the prior art and provides a method and system for storing and optimizing enterprise security data.
[0004] The technical solution of the present invention to solve the above technical problems is as follows: a method for enterprise security data storage and optimization, applied to a data storage system, the data storage system includes a first data distributor and a second data distributor, the method includes: Obtaining a data security storage instruction, wherein the data security storage instruction includes one of a first security storage instruction and a second security storage instruction, the first security storage instruction is an instruction triggered in response to a storage demand outside the enterprise, and the second security storage instruction is an instruction triggered in response to a storage demand within the enterprise; Sending and storing the enterprise target data in a cloud data storage device through a first data distributor according to the first secure storage instruction, and sending and storing the enterprise target data in a local data storage device through a second data distributor according to the second secure storage instruction; During the data storage process, the load conditions of the first data distributor and the second data distributor are determined in real time, and the load difference between the first data distributor and the second data distributor is determined, wherein the load difference indicates the load exceeding the standard of the second data distributor relative to the first data distributor; When the first data distributor and the second data distributor are not overloaded, and the load difference between the second data distributor and the first data distributor is greater than or equal to a preset value, a first optimization instruction for enterprise security data storage is triggered, and the first optimization instruction for enterprise security data storage indicates that the enterprise security data sending and storage method needs to be optimized; When the second secure storage instruction is obtained, according to the first optimization instruction for secure data storage of the enterprise, a distributor switch is performed to send and store the enterprise target data in the local data storage through the first data distributor; When the load difference between the second data distributor and the first data distributor is reduced to less than a preset value, the distributor is switched again to send the enterprise target data through the second data distributor and store it in the local data storage.
[0005] Further, the load difference between the first data distributor and the second data distributor includes a current temperature difference, and when the load difference between the second data distributor and the first data distributor is greater than or equal to a preset value, triggering the first optimization instruction for enterprise secure data storage includes: When the difference between the current temperature value of the second data distributor and the current temperature value of the first data distributor is greater than or equal to a preset value, a first optimization instruction for enterprise secure data storage is triggered.
[0006] Further, the load difference between the first data distributor and the second data distributor includes a cumulative usage time difference, and when the load difference between the second data distributor and the first data distributor is greater than or equal to a preset value, triggering a first optimization instruction for enterprise secure data storage includes: When the difference between the accumulated usage time of the second data distributor and the accumulated usage time of the first data distributor is greater than or equal to a preset value, a first optimization instruction for enterprise secure data storage is triggered.
[0007] Further, the switching of the distributor according to the first enterprise secure data storage optimization instruction to send and store the enterprise target data in the local data storage through the first data distributor includes: According to the first optimization instruction for enterprise secure data storage, the second data distributor for data storage distribution is switched to the first data distributor; The enterprise target data is sent and stored in the cloud data storage device through the first data distributor to obtain temporary target data; The temporary target data is sent and stored in the local data storage device, and the temporary target data in the cloud data storage device is erased.
[0008] Further, after determining the load conditions of the first data distributor and the second data distributor in real time during data storage, and determining the load difference between the first data distributor and the second data distributor, the method further includes: In the case where both the first data distributor and the second data distributor are overloaded, when a second secure storage instruction is obtained, control the first data distributor and the second data distributor to perform intermittent switching to alternately send and store enterprise target data in the local data memory through the first data distributor and the second data distributor.
[0009] Further, the performing distributor switching to send and store enterprise target data in the local data memory through the first data distributor includes: During the process of sending and storing enterprise target data in the local data memory through the first data distributor, obtain the data read-write efficiency value of the enterprise target data; In the case where the data read-write efficiency value is lower than the data read-write efficiency threshold, trigger a second optimization instruction for enterprise secure data storage, where the second optimization instruction for enterprise secure data storage indicates that the enterprise secure data sending and storage method needs to be further optimized; According to the second optimization instruction for enterprise secure data storage, divide the enterprise target data into a first sub-data packet and a second sub-data packet, and control the first data distributor and the second data distributor to perform intermittent switching so that the first sub-data packet is sent and stored in the local data memory through the first data distributor, and the second sub-data packet is sent and stored in the local data memory through the second data distributor, where the bit value of the first sub-data packet is greater than the bit value of the second sub-data packet.
[0010] Further, the obtaining the data read-write efficiency value of the enterprise target data includes: Obtain the read-write rate value and read-write accuracy of the enterprise target data; Input the read-write rate value and the read-write accuracy into a pre-trained data read-write efficiency value prediction model to obtain the data read-write efficiency value, where the data read-write efficiency value prediction model satisfies the following expression: E= /
[0011] In the formula, E is the data read-write efficiency value, R is the current data read-write rate value, is the data reference read-write rate value, A is the current data read-write accuracy, is the data reference read-write accuracy, L is the performance load of the first data distributor, 0 < L < 1, and the performance load represents the original performance size of the distributor, is the performance penalty factor, ≥1, performance penalty factor It is positively correlated with the usage load of the data distributor.
[0012] Further, the re-switching of the distributor to send and store the enterprise target data in the local data storage through the second data distributor includes: In response to the load difference between the second data distributor and the first data distributor being reduced to less than a preset value, switching the first data distributor for data storage and distribution to the second data distributor; The enterprise target data is sent and stored in a local data storage device through the second data distributor.
[0013] Furthermore, after sending and storing the enterprise target data in the cloud data storage device through the first data distributor according to the first secure storage instruction, the method further includes: Obtaining the cumulative storage time of the enterprise target data in the cloud data storage; After the accumulated storage time reaches the preset storage time, an automatic clearing program is started to automatically clear the enterprise target data in the cloud data storage device.
[0014] The beneficial effects of the present invention are as follows: after obtaining a data security storage instruction, the corresponding data storage method is determined according to the type of the data security storage instruction. When the data security storage instruction is a first security storage instruction, the enterprise target data is sent and stored in a cloud data storage device through a first data distributor. When the data security storage instruction is a second security storage instruction, the enterprise target data is sent and stored in a local data storage device through a second data distributor. In addition, the load conditions of the first data distributor and the second data distributor are judged in real time during the data storage process. When neither the first data distributor nor the second data distributor is overloaded, and the load difference between the second data distributor and the first data distributor is greater than or equal to a preset value, a first optimization instruction for enterprise security data storage is triggered. When the second security storage instruction is obtained, according to the first optimization instruction for enterprise security data storage, a distributor switch is performed to send and store the enterprise target data in a local data storage device through the first data distributor. When the load difference between the second data distributor and the first data distributor is reduced to less than a preset value, the distributor switch is performed again to send and store the enterprise target data in a local data storage device through the second data distributor. In this way, enterprise data security storage not only realizes flexible storage selection based on instruction type, but also effectively avoids overload of a single distributor through dynamic monitoring and adaptive adjustment of distributor load. It not only improves the overall efficiency and reliability of data storage, but also helps enterprises optimize resource allocation, reduce storage costs and improve business response speed while ensuring data security. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] Figure 1 A schematic diagram of the structure of an embodiment of a data storage system of the present invention; Figure 2 A schematic diagram of an embodiment of the enterprise security data storage and optimization method of the present invention; Figure 3 A schematic diagram of an embodiment of a data storage system of the present invention; Figure 4 A schematic diagram of an embodiment of a computer-readable storage medium of the present invention. DETAILED DESCRIPTION
[0016] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.
[0017] In the description of this application, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this application, "plurality" means two or more, unless otherwise clearly and specifically defined.
[0018] In the description of the present application, the term "for example" is used to mean "used as an example, illustration or description". Any embodiment described as "for example" in the present application is not necessarily to be construed as being more preferred or advantageous than other embodiments. The following description is given to enable any technician in the field to implement and use the present invention. In the following description, details are listed for the purpose of explanation. It should be understood that a person of ordinary skill in the art can recognize that the present invention can be implemented without using these specific details. In other examples, well-known structures and processes will not be elaborated in detail to avoid unnecessary details to obscure the description of the present invention. Therefore, the present invention is not intended to be limited to the embodiments shown, but is consistent with the widest scope consistent with the principles and features disclosed in the present application.
[0019] Example 1 In today's era of accelerated digital transformation, enterprise data is not only an important basis for internal operations and decision-making, but also the cornerstone of external supervision, auditing and cooperation and communication. The internal demand for data analysis in enterprises is growing, including market trend forecasting, financial performance evaluation, operational process optimization and other aspects. These demands have driven enterprises to continue to pursue deep data mining and instant analysis capabilities. At the same time, external demands should not be ignored, especially the audit demands from the audit department, which require enterprises to provide complete, accurate and traceable data records to verify the compliance of enterprise operations and the authenticity of financial reports. These external demands are often sudden, timely and strict, and place extremely high demands on the data response capabilities of enterprises. However, in related technologies, when external needs arise, relevant personnel are required to manually extract data from the local database and package it and send it to external demand personnel, which has technical problems such as low data processing efficiency and data security risks.
[0020] In view of the above problems, the present application proposes an enterprise security data storage and optimization method, which is applied to a data storage system. The following is an example of a data storage system executing the enterprise security data storage and optimization method. In the embodiment of the present application, the data storage system includes a first data distributor 100 and a second data distributor 200. Figure 1 As shown, Figure 1 1 is a schematic diagram of the structure of an embodiment of the data storage system of the present invention, wherein the first data distributor 100 is wirelessly connected to the cloud data storage 300, the second data distributor 200 is wiredly connected to the local data storage 400, and the cloud data storage 300 is wirelessly connected to the local data storage 400. It should be noted that although the logical order is shown in the flowchart, in some cases, the steps shown or described can be performed in a different order than here. Please refer to the attached Figure 2 The method includes the following steps S100 to S600: S100, obtaining a data security storage instruction, wherein the data security storage instruction includes one of a first security storage instruction and a second security storage instruction, the first security storage instruction is an instruction triggered in response to a storage demand outside the enterprise, and the second security storage instruction is an instruction triggered in response to a storage demand within the enterprise; Specifically, the first secure storage instruction may be a secure storage instruction triggered by a government audit department or an external cooperation unit's demand for data of the enterprise, and the second secure storage instruction may be a secure storage instruction triggered by an internal demand department of the enterprise's demand for data of the enterprise.
[0021] For example, when the audit department conducts a financial data review of a company, it needs to obtain the company's financial data. At this time, the audit department can send a data storage instruction to the company's data storage system, so that after receiving the instruction, the company's data storage system automatically sends the corresponding financial data to the target storage address (such as a cloud data storage device), so that the audit department can check the relevant data for financial auditing. When the company's operating department calculates the company's operating efficiency, it needs to obtain the company's operating data (operating input and operating income data, etc.). At this time, the company's operating department can send a data storage instruction to the company's data storage system, so that after receiving the instruction, the company's data storage system automatically sends the corresponding operating data to the target storage address (such as a local data storage device), so that the company's operating department can check the relevant data for operating efficiency calculation.
[0022] It can be understood that due to the inconsistent requirements of internal data demands and external data demands on data security and transmission timeliness, and in order to ensure the safe sending and storage of external demand data, in an embodiment of the present application, two different data distributors can be used to send and store data; for example, one data distributor is used to send enterprise external demand data, and one data distributor is used to send enterprise internal demand data.
[0023] S200, sending and storing the enterprise target data in a cloud data storage device through a first data distributor according to the first secure storage instruction, and sending and storing the enterprise target data in a local data storage device through a second data distributor according to the second secure storage instruction; Specifically, in the embodiment of the present application, the first data distributor is used for sending and storing the enterprise's external demand data, and the second data distributor is used for sending and storing the enterprise's internal demand data. When the data security storage instruction received by the data storage system is the first security storage instruction, the enterprise's target data is sent and stored in the cloud data storage device through the first data distributor, and the external demand department can check the relevant data in the cloud data storage device. When the data security storage instruction received by the data storage system is the second security storage instruction, the enterprise's target data is sent and stored in the local data storage device through the second data distributor, and the enterprise's internal demand department can check, download, etc. the relevant data in the local data storage device.
[0024] In order to ensure data security issues caused by the transmission of enterprise data to the outside (such as a cloud data storage device), in one embodiment, in the step S200: after the enterprise target data is sent and stored in the cloud data storage device through the first data distributor according to the first security storage instruction, it also includes: obtaining the cumulative storage time of the enterprise target data in the cloud data storage device; after the cumulative storage time reaches the preset storage time, starting the automatic clearing program to automatically clear the enterprise target data in the cloud data storage device.
[0025] Specifically, a certain amount of time is reserved for the external demand department to review the data and other business processes. When the cumulative storage time of the enterprise target data in the cloud data storage exceeds the preset time, it can be roughly judged that the external demand department has completed the relevant business processes. At this time, the automatic clearing program is started to automatically clear the enterprise target data in the cloud data storage. In this way, it is ensured that the enterprise data cannot be used without restriction when it is transmitted to the outside, thereby ensuring the security of the enterprise data.
[0026] It is understandable that since the demand for internal data of an enterprise is more frequent, the demand for external data of an enterprise is relatively less. Therefore, under normal circumstances, the usage frequency and usage load of the second data distributor are greater than those of the first data distributor; thus, after a certain period of use, the failure probability of the second data distributor is greater than that of the first data distributor.
[0027] S300, determining in real time during the data storage process the load conditions of the first data distributor and the second data distributor, and determining the load difference between the first data distributor and the second data distributor, wherein the load difference indicates the load exceeding the standard condition of the second data distributor relative to the first data distributor; Specifically, in order to prevent the frequent and excessive use of the second data distributor from affecting its service life and data transmission performance, the load conditions of the first data distributor and the second data distributor are monitored in real time during the data storage process, so that the data storage method can be optimized and adjusted according to the load conditions of the two. The load conditions of the first data distributor and the second data distributor can be the first case: neither of them is overloaded, but the current load of one is much greater than the current load of the other; the second case: both are overloaded; the third case: neither of them is overloaded, and the current loads of the two are equivalent.
[0028] In the first case, the one with the larger load needs to be restricted to avoid frequent overuse and thus affecting its performance. In the second case, both need to be restricted to avoid frequent overuse and thus affecting their performance. In the third case, since the loads are similar and neither is overloaded, no intervention is required.
[0029] It should be noted that the load conditions of the first data distributor and the second data distributor may refer to the current temperature values of the first data distributor and the second data distributor, or may refer to the cumulative working time of the first data distributor and the second data distributor. When the current temperature of the first data distributor or the second data distributor is greater than the temperature threshold, it indicates that the data distributor has a greater risk of failure, and its use needs to be suppressed or its frequent use needs to be controlled. Or when the cumulative working time of the first data distributor or the second data distributor exceeds the time threshold, it indicates that the data distributor has a greater risk of failure, and its use needs to be suppressed or its frequent use needs to be controlled.
[0030] S400: When the first data distributor and the second data distributor are not overloaded, and the load difference between the second data distributor and the first data distributor is greater than or equal to a preset value, trigger a first optimization instruction for enterprise security data storage, wherein the first optimization instruction for enterprise security data storage indicates that the enterprise security data transmission and storage method needs to be optimized; In one embodiment, the load of the first data distributor and the second data distributor refers to the current temperature. Therefore, when the first data distributor and the second data distributor are not overloaded, and the load difference between the second data distributor and the first data distributor is greater than or equal to the preset value, that is, the current temperature values of the first data distributor and the second data distributor are both lower than the temperature threshold, and the difference between the current temperature value of the second data distributor and the current temperature value of the first data distributor is greater than or equal to the preset value, the first optimization instruction for enterprise security data storage is triggered. In other words, when the current temperature values of the first data distributor and the second data distributor are both lower than the temperature threshold, but the current temperature value of the second data distributor is much higher than the current temperature value of the first data distributor, it means that the current load of the second data distributor is much higher than the current load of the first data distributor. At this time, the first optimization instruction for enterprise security data storage is triggered to optimize the enterprise security data sending and storage method, so as to balance the usage load of the first data distributor and the second data distributor and avoid excessive and frequent use of the second data distributor.
[0031] In another embodiment, the load of the first data distributor and the second data distributor refers to the cumulative duration of work use. Therefore, when the first data distributor and the second data distributor are not overloaded, and the difference between the load of the second data distributor and the first data distributor is greater than or equal to the preset value, that is, the cumulative duration of use of the first data distributor and the second data distributor is lower than the duration threshold, and the difference between the cumulative duration of use of the second data distributor and the cumulative duration of use of the first data distributor is greater than or equal to the preset duration value, the first optimization instruction for enterprise security data storage is triggered. In other words, when the cumulative duration of use of the first data distributor and the second data distributor is lower than the duration threshold, but the cumulative duration of use of the second data distributor far exceeds the cumulative duration of use of the first data distributor, it means that the current load of the second data distributor is far greater than the current load of the first data distributor. At this time, the first optimization instruction for enterprise security data storage is triggered to optimize the enterprise security data sending and storage method, so as to balance the usage load of the first data distributor and the second data distributor and avoid excessive and frequent use of the second data distributor.
[0032] S500: When a second secure storage instruction is obtained, according to the first optimization instruction for secure data storage of the enterprise, a distributor switch is performed to send and store the enterprise target data in a local data storage device through the first data distributor; In one embodiment, the step S500: performing distributor switching according to the first enterprise secure data storage optimization instruction to send and store the enterprise target data in the local data storage through the first data distributor includes: S510, according to the first optimization instruction for enterprise secure data storage, switching the second data distributor for data storage distribution to the first data distributor; S520, sending the enterprise target data through the first data distributor and storing it in the cloud data storage to obtain temporary target data; S530: Send and store the temporary target data in a local data storage device, and erase the temporary target data in the cloud data storage device.
[0033] When the system triggers the first optimization instruction for enterprise secure data storage, it indicates that the second data distributor needs to be suppressed. When the second secure storage instruction is obtained, the second data distributor needs to be started for data distribution and storage according to the original policy. However, in the embodiment of the present application, after the system triggers the first optimization instruction for enterprise secure data storage, the distributor is switched according to the first optimization instruction for enterprise secure data storage to send and store the enterprise target data in the local data storage through the first data distributor, thereby avoiding excessive and frequent use of the second data distributor.
[0034] Specifically, first, according to the first optimization instruction for enterprise secure data storage, the second data distributor for data storage distribution is switched to the first data distributor. Then, the enterprise target data is sent and stored in the cloud data storage device through the first data distributor to obtain temporary target data. Finally, the temporary target data is sent and stored in the local data storage device, and the temporary target data in the cloud data storage device is erased. In this way, the frequency of excessive use of the second data distributor can be reduced while ensuring data security storage, which is conducive to the performance recovery or maintenance of the second data distributor.
[0035] In the case where neither the first data distributor nor the second data distributor is overloaded, but the current load of the second data distributor is much greater than the current load of the first data distributor, the strategy of the embodiment of the present application is to switch the second data distributor that performs data storage and distribution to the first data distributor. According to the previous description, the first data distributor and the cloud data storage device are wirelessly connected, so there is a certain stability risk in the data transmission between the two, that is, in this case, under unfavorable external environments such as network instability, the data reading and writing efficiency value of the enterprise target data may be low, which affects the data storage efficiency. Therefore, in one embodiment, the distributor switching to send and store the enterprise target data in the local data storage device through the first data distributor includes: In the process of sending and storing the enterprise target data in the local data storage device through the first data distributor, obtaining the data reading and writing efficiency value of the enterprise target data; When the data read / write efficiency value is lower than the data read / write efficiency threshold, a second optimization instruction for enterprise secure data storage is triggered, wherein the second optimization instruction for enterprise secure data storage indicates that the enterprise secure data transmission and storage method needs to be further optimized; According to the second optimization instruction for enterprise secure data storage, the enterprise target data is divided into a first sub-data packet and a second sub-data packet, and the first data distributor and the second data distributor are controlled to perform intermittent switching so that the first sub-data packet is sent through the first data distributor and stored in the local data storage, and the second sub-data packet is sent through the second data distributor and stored in the local data storage, wherein the bit value of the first sub-data packet is greater than the bit value of the second sub-data packet.
[0036] Specifically, when obtaining the data reading and writing efficiency value of the enterprise target data, the reading and writing rate value and the reading and writing accuracy rate of the enterprise target data can be first obtained; then the reading and writing rate value and the reading and writing accuracy rate are input into a pre-trained data reading and writing efficiency value estimation model to obtain the data reading and writing efficiency value, wherein the data reading and writing efficiency value estimation model satisfies the following expression: / ; where E is the data read / write efficiency value, R is the current data read / write rate value, is the data benchmark read / write rate value, A is the current data read / write accuracy rate (the accuracy rate can be approximately calculated using data loss), is the data benchmark read / write accuracy rate, L is the performance load of the first data distributor, 0 < L < 1, and the performance load represents the original performance size of the distributor, is the performance penalty factor, ≥1, and the performance penalty factor is positively correlated with the usage load of the first data distributor. After obtaining the data read / write efficiency value through the data read / write efficiency value prediction model, if it is determined that the data read / write efficiency value is lower than the data read / write efficiency threshold, it indicates that the data sending and storage through the first data distributor is affected by external environments such as poor network when performing distributor switching. At this time, it is necessary to trigger the second optimization instruction for enterprise secure data storage to further optimize the enterprise secure data sending and storage method.
[0037] After the system obtains the second optimization instruction for enterprise secure data storage, the embodiment of the present application divides the enterprise target data into a first sub-data packet and a second sub-data packet according to the second optimization instruction for enterprise secure data storage, and controls the first data distributor and the second data distributor to perform intermittent switching so that the first sub-data packet is sent and stored in the local data memory through the first data distributor, and the second sub-data packet is sent and stored in the local data memory through the second data distributor. For example, first send and store the first sub-data packet in the local data memory through the first data distributor, and then send and store the second sub-data packet in the local data memory through the second data distributor; or the sending of the first sub-data packet and the second sub-data packet alternates. For example, the first sub-data packet is first sent through the first data distributor for 1 minute, and the second sub-data packet is then sent through the second data distributor for 1 minute, and then the first sub-data packet is sent through the first data distributor for 1 minute again, and so on until the enterprise target data is completely sent and stored. In this way, considering the current situations of both the first data distributor and the second data distributor comprehensively and performing the distribution and storage of the enterprise target data can improve the data storage efficiency.
[0038] It should be noted that when constructing the data read / write efficiency value prediction model in the embodiment of the present application, a large amount of data is collected for model parameter training. When the performance load L of the first data distributor is 0.8, after the first data distributor is used for 100 hours, the performance penalty factor is 1.2, that is, the data read / write efficiency benchmark value of the first data distributor becomes 0.83 (i.e., 1 / 1.2) after being used for 100 hours, that is, E = .
[0039] S600. When the load difference between the second data distributor and the first data distributor is reduced to less than a preset value, the distributor is switched again to send the enterprise target data through the second data distributor and store it in the local data storage.
[0040] Specifically, when neither the first data distributor nor the second data distributor is overloaded, but the current load of the second data distributor is much greater than the current load of the first data distributor, the strategy of the embodiment of the present application is to switch the second data distributor for data storage distribution to the first data distributor. Therefore, in the process of data distribution and storage using the first data distributor, if it is monitored that the load difference between the second data distributor and the first data distributor is reduced to less than the preset value, that is, at this time, the current load of the second data distributor is close to the current load of the first data distributor, the embodiment of the present application will switch the first data distributor for data storage distribution back to the second data distributor, so as to send and store the enterprise target data in the local data storage device through the second data distributor. In this way, the load status of the first data distributor and the second data distributor is monitored in real time, and the first data distributor and the second data distributor are adaptively switched to ensure the optimization of resource utilization.
[0041] Example 2 On the basis of Example 1, after determining the load conditions of the first data distributor and the second data distributor in real time during the data storage process, and determining the load difference between the first data distributor and the second data distributor, the method further includes: When the first data distributor and the second data distributor are both overloaded, when the second secure storage instruction is obtained, the first data distributor and the second data distributor are controlled to perform intermittent switching to alternately send the enterprise target data through the first data distributor and the second data distributor and store it in the local data storage device.
[0042] Specifically, when the load conditions of the first data distributor and the second data distributor are monitored in real time during the data storage process, and it is determined that the first data distributor and the second data distributor are both overloaded at this time, it means that if any one of the first data distributor and the second data distributor continues to be used excessively and frequently, it will cause serious impact on its performance or life. Therefore, in the embodiment of the present application, when it is determined that the first data distributor and the second data distributor are both overloaded, and when the second secure storage instruction is obtained, the first data distributor and the second data distributor are controlled to perform intermittent switching to alternately send and store the enterprise target data in the local data storage device through the first data distributor and the second data distributor. In this way, it is possible to avoid excessive and frequent use of any one of the first data distributor and the second data distributor, thereby stably maintaining the service life and performance of the data distributor.
[0043] Based on this, the enterprise security data storage and optimization method of the embodiment of the present application, after obtaining the data security storage instruction, determines the corresponding data storage method according to the type of the data security storage instruction. When the data security storage instruction is the first security storage instruction, the enterprise target data is sent and stored in the cloud data storage device through the first data distributor. When the data security storage instruction is the second security storage instruction, the enterprise target data is sent and stored in the local data storage device through the second data distributor; and in the data storage process, the load conditions of the first data distributor and the second data distributor are judged in real time. When the first data distributor and the second data distributor are not overloaded, and the load difference between the second data distributor and the first data distributor is greater than or equal to the preset value, the first optimization instruction for enterprise security data storage is triggered. When the second security storage instruction is obtained, according to the first optimization instruction for enterprise security data storage, the distributor is switched to send and store the enterprise target data in the local data storage device through the first data distributor; and when the load difference between the second data distributor and the first data distributor is reduced to less than the preset value, the distributor is switched again to send and store the enterprise target data in the local data storage device through the second data distributor. In this way, enterprise data security storage not only realizes flexible storage selection based on instruction type, but also effectively avoids overload of a single distributor through dynamic monitoring and adaptive adjustment of distributor load. It not only improves the overall efficiency and reliability of data storage, but also helps enterprises optimize resource allocation, reduce storage costs and improve business response speed while ensuring data security.
[0044] See also Figure 3 , Figure 3 Schematic diagram of an embodiment of a data storage system provided by an embodiment of the present invention. Figure 3As shown, an embodiment of the present invention provides a data storage system 500, which also includes a memory 510, a processor 520, and a computer program 511 stored in the memory 510 and executable on the processor 520. When the processor 520 executes the computer program 511, the following steps are implemented: obtaining a data security storage instruction, wherein the data security storage instruction includes a first security storage instruction and a second security storage instruction, wherein the first security storage instruction is an instruction triggered in response to a storage demand outside the enterprise, and the second security storage instruction is an instruction triggered in response to a storage demand within the enterprise; according to the first security storage instruction, the enterprise target data is sent and stored in a cloud data storage device through a first data distributor, and according to the second security storage instruction, the enterprise target data is sent and stored in a local data storage device through a second data distributor; during the data storage process, real-time judgment is made on the load conditions of the first data distributor and the second data distributor, and judgment is made on the load conditions of the first data distributor and the second data distributor. a load difference between the first data distributor and the second data distributor, wherein the load difference indicates that the load of the second data distributor exceeds the standard relative to the first data distributor; when the first data distributor and the second data distributor are not overloaded, and the load difference between the second data distributor and the first data distributor is greater than or equal to a preset value, triggering a first optimization instruction for enterprise secure data storage, wherein the first optimization instruction for enterprise secure data storage indicates that the enterprise secure data sending and storage method needs to be optimized; when the second secure storage instruction is obtained, according to the first optimization instruction for enterprise secure data storage, performing distributor switching to send and store the enterprise target data in the local data storage device through the first data distributor; when the load difference between the second data distributor and the first data distributor is reduced to less than the preset value, performing distributor switching again to send and store the enterprise target data in the local data storage device through the second data distributor.
[0045] See also Figure 4 , Figure 4 A schematic diagram of an embodiment of a computer-readable storage medium provided in an embodiment of the present invention. Figure 4As shown, this embodiment provides a computer-readable storage medium 600, on which a computer program 611 is stored. When the computer program 611 is executed by a processor, the following steps are implemented: obtaining a data security storage instruction, wherein the data security storage instruction includes one of a first security storage instruction and a second security storage instruction, wherein the first security storage instruction is an instruction triggered in response to a storage demand outside the enterprise, and the second security storage instruction is an instruction triggered in response to a storage demand within the enterprise; according to the first security storage instruction, the enterprise target data is sent and stored in a cloud data storage device through a first data distributor, and according to the second security storage instruction, the enterprise target data is sent and stored in a local data storage device through a second data distributor; during the data storage process, the load conditions of the first data distributor and the second data distributor are determined in real time, and the load conditions of the first data distributor and the second data distributor are determined; A load difference value is used, and the load difference value indicates that the load of the second data distributor exceeds the load standard relative to the first data distributor; when the first data distributor and the second data distributor are not overloaded, and the load difference value between the second data distributor and the first data distributor is greater than or equal to a preset value, a first optimization instruction for enterprise security data storage is triggered, and the first optimization instruction for enterprise security data storage indicates that the enterprise security data sending and storage method needs to be optimized; when the second security storage instruction is obtained, according to the first optimization instruction for enterprise security data storage, the distributor is switched to send the enterprise target data through the first data distributor and store it in the local data storage; when the load difference value between the second data distributor and the first data distributor is reduced to less than the preset value, the distributor is switched again to send the enterprise target data through the second data distributor and store it in the local data storage.
[0046] It should be noted that in the above embodiments, the description of each embodiment has its own emphasis, and for parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0047] It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0048] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded computer, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0049] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0050] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0051] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.
[0052] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.
Claims
1. A method for storing and optimizing enterprise security data, characterized in that: Applied to a data storage system, the data storage system includes a first data distributor and a second data distributor, the method includes: Obtaining a data security storage instruction, wherein the data security storage instruction includes one of a first security storage instruction and a second security storage instruction, the first security storage instruction is an instruction triggered in response to a storage demand outside the enterprise, and the second security storage instruction is an instruction triggered in response to a storage demand within the enterprise; Sending and storing the enterprise target data in a cloud data storage device through a first data distributor according to the first secure storage instruction, and sending and storing the enterprise target data in a local data storage device through a second data distributor according to the second secure storage instruction; During the data storage process, the load conditions of the first data distributor and the second data distributor are determined in real time, and the load difference between the first data distributor and the second data distributor is determined, wherein the load difference indicates the load exceeding the standard of the second data distributor relative to the first data distributor; When the first data distributor and the second data distributor are not overloaded, and the load difference between the second data distributor and the first data distributor is greater than or equal to a preset value, a first optimization instruction for enterprise security data storage is triggered, and the first optimization instruction for enterprise security data storage indicates that the enterprise security data sending and storage method needs to be optimized; When the second secure storage instruction is obtained, according to the first optimization instruction for secure data storage of the enterprise, a distributor switch is performed to send and store the enterprise target data in the local data storage through the first data distributor; When the load difference between the second data distributor and the first data distributor is reduced to less than a preset value, the distributor is switched again to send the enterprise target data through the second data distributor and store it in the local data storage.
2. The enterprise security data storage and optimization method according to claim 1, characterized in that: The load difference between the first data distributor and the second data distributor includes a current temperature difference, and when the load difference between the second data distributor and the first data distributor is greater than or equal to a preset value, triggering a first optimization instruction for enterprise secure data storage includes: When the difference between the current temperature value of the second data distributor and the current temperature value of the first data distributor is greater than or equal to a preset value, a first optimization instruction for enterprise secure data storage is triggered.
3. The enterprise security data storage and optimization method according to claim 1, characterized in that: The load difference between the first data distributor and the second data distributor includes a cumulative usage time difference, and triggering a first optimization instruction for enterprise secure data storage when the load difference between the second data distributor and the first data distributor is greater than or equal to a preset value includes: When the difference between the accumulated usage time of the second data distributor and the accumulated usage time of the first data distributor is greater than or equal to a preset value, a first optimization instruction for enterprise secure data storage is triggered.
4. The enterprise security data storage and optimization method according to claim 1, characterized in that: The switching of the distributor according to the first enterprise secure data storage optimization instruction to send and store the enterprise target data in the local data storage through the first data distributor comprises: According to the first optimization instruction for enterprise secure data storage, the second data distributor for data storage distribution is switched to the first data distributor; The enterprise target data is sent and stored in the cloud data storage device through the first data distributor to obtain temporary target data; The temporary target data is sent and stored in the local data storage device, and the temporary target data in the cloud data storage device is erased.
5. The enterprise security data storage and optimization method according to claim 1, characterized in that: After determining the load conditions of the first data distributor and the second data distributor in real time during the data storage process, and determining the load difference between the first data distributor and the second data distributor, the method further includes: When the first data distributor and the second data distributor are both overloaded, when the second secure storage instruction is obtained, the first data distributor and the second data distributor are controlled to perform intermittent switching to alternately send the enterprise target data through the first data distributor and the second data distributor and store it in the local data storage device.
6. The enterprise security data storage and optimization method according to claim 1, characterized in that: The switching of the distributor to send the enterprise target data through the first data distributor and store it in the local data storage device includes: In the process of sending and storing the enterprise target data in the local data storage device through the first data distributor, obtaining the data reading and writing efficiency value of the enterprise target data; When the data read / write efficiency value is lower than the data read / write efficiency threshold, a second optimization instruction for enterprise secure data storage is triggered, wherein the second optimization instruction for enterprise secure data storage indicates that the enterprise secure data transmission and storage method needs to be further optimized; According to the second optimization instruction for enterprise secure data storage, the enterprise target data is divided into a first sub-data packet and a second sub-data packet, and the first data distributor and the second data distributor are controlled to perform intermittent switching so that the first sub-data packet is sent through the first data distributor and stored in the local data storage, and the second sub-data packet is sent through the second data distributor and stored in the local data storage, wherein the bit value of the first sub-data packet is greater than the bit value of the second sub-data packet.
7. The enterprise security data storage and optimization method according to claim 6, characterized in that: The step of obtaining the data reading and writing efficiency value of the enterprise target data includes: Obtain the reading and writing rate values and reading and writing accuracy of enterprise target data; The read / write rate value and the read / write accuracy rate are input into a pre-trained data read / write efficiency value estimation model to obtain a data read / write efficiency value, wherein the data read / write efficiency value estimation model satisfies the following expression: E= / Where E is the data read / write efficiency value, R is the current data read / write rate value, is the data benchmark read / write rate value, A is the current data read / write accuracy rate, is the data benchmark read / write accuracy rate, L is the performance load of the first data distributor, 0 < L < 1, and the performance load characterizes the original performance size of the distributor, is the performance penalty factor, ≥ 1, the performance penalty factor is positively correlated with the usage load of the data distributor.
8. The enterprise security data storage and optimization method according to claim 1, characterized in that: The method of re-switching the distributor to send the enterprise target data to the local data storage through the second data distributor comprises: In response to the load difference between the second data distributor and the first data distributor being reduced to less than a preset value, switching the first data distributor for data storage and distribution to the second data distributor; The enterprise target data is sent and stored in a local data storage device through the second data distributor.
9. The enterprise security data storage and optimization method according to any one of claims 1 to 8, characterized in that: After sending and storing the enterprise target data in the cloud data storage device through the first data distributor according to the first secure storage instruction, the method further includes: Obtaining the cumulative storage time of the enterprise target data in the cloud data storage; After the accumulated storage time reaches the preset storage time, an automatic clearing program is started to automatically clear the enterprise target data in the cloud data storage device.
10. A data storage system, characterized in that: include: a first data distributor, a second data distributor, and Memory for storing computer software programs; A processor is used to read and execute the computer software program, thereby implementing the enterprise security data storage and optimization method described in any one of claims 1-9.
Citation Information
Patent Citations
Supply chain-based data analysis method, system and device, and storage medium
CN115392777A
Distributed market data acquisition and management system for equity investment
CN116797267A
Automatic storage management in networked data storage systems using storage device monitoring
US20230259292A1