Enterprise security data storage and optimization method and system

By using two data distributors in the enterprise data storage system to handle external and internal data demands respectively, and dynamically adjusting the load in real time, the problems of low data processing efficiency and security risks in enterprises are solved, achieving efficient and secure data storage and optimization.

CN119292535BActive Publication Date: 2025-12-26HUBEI XINQIAO DIGITAL INTELLIGENCE TECHNOLOGY CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411444015.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-10-16
Publication Date
2025-12-26
Estimated Expiration
2044-10-16

AI Technical Summary

Technical Problem

In existing technologies, enterprises face low data processing efficiency and data security risks when responding to external data demands, especially the difficulty in meeting the sudden and time-sensitive requirements of external audit demands.

Method used

Two data distributors are used to handle the enterprise's external and internal data needs respectively. By monitoring the distributor load in real time and making dynamic adjustments, flexible selection and optimization of data storage methods can be achieved, including distributor switching and data packet allocation to optimize resource utilization.

Benefits of technology

It improves the overall efficiency and reliability of data storage, reduces storage costs, enhances business response speed, and ensures data security.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119292535B_ABST
    Figure CN119292535B_ABST
Patent Text Reader

Abstract

The present application relates to a kind of enterprise security data storage and optimization method and system, the load condition of two data distributors is monitored in real time in the data storage process in the method.When both are not overloaded, and the load difference of second data distributor compared with the first data distributor reaches or exceeds preset threshold, system automatically triggers optimization instruction, i.e., when receiving the second security storage instruction that should be stored to local through second data distributor, it is changed to be stored through the first data distributor with lower load, to balance distributor load, improve storage efficiency.As the load condition changes, when the load difference of second data distributor and the first data distributor reduces to below preset threshold, system again automatically switches back to use second data distributor for local data storage, to ensure the optimization of resource utilization.So, it helps enterprise to optimize resource allocation while ensuring data security, reduce storage cost, improve business response speed.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of enterprise data management, in particular to an enterprise secure data storage and optimization method and system. BACKGROUND

[0002] In today's era of accelerating digital transformation, enterprise data is not only an important basis for internal operation and decision-making, but also a cornerstone for external regulation, audit and cooperation and exchange. The demand for data analysis within the enterprise is growing, including market trend prediction, financial performance evaluation, operation process optimization and other aspects, which drives the continuous pursuit of enterprise data deep mining and real-time analysis capabilities. At the same time, external demands cannot be ignored, especially the audit needs from the audit department, which requires enterprises to provide complete, accurate and traceable data records to verify the compliance of enterprise operations and the authenticity of financial reports. These external demands are often sudden, time-sensitive and strict, putting high demands on the data response capabilities of enterprises. However, in related technologies, when external needs arise, relevant personnel need to manually extract and package data from local databases and send them to external demand personnel, which has the technical problems of low data processing efficiency and data security risks. SUMMARY

[0003] The present application provides an enterprise secure data storage and optimization method and system to solve the technical problems in the prior art.

[0004] The technical solution of the present application to solve the above technical problems is as follows: an enterprise secure data storage and optimization method applied to a data storage system, the data storage system comprising a first data distributor and a second data distributor, the method comprising:

[0005] obtaining a data security storage instruction, wherein the data security storage instruction comprises one of a first security storage instruction and a second security storage instruction, the first security storage instruction is an instruction triggered in response to external storage needs of the enterprise, and the second security storage instruction is an instruction triggered in response to internal storage needs of the enterprise;

[0006] sending and storing enterprise target data in a cloud data storage according to the first security storage instruction through the first data distributor, and sending and storing enterprise target data in a local data storage according to the second security storage instruction through the second data distributor;

[0007] judging the load conditions of the first data distributor and the second data distributor in real time during the data storage process, and judging the load difference between the first data distributor and the second data distributor, the load difference representing the over-standard condition of the second data distributor relative to the first data distributor in terms of load;

[0008] In the case that the first data distributor and the second data distributor are not overloaded, and the load difference between the second data distributor and the first data distributor is greater than or equal to a preset value, a first optimization instruction of enterprise security data storage is triggered, and the first optimization instruction of enterprise security data storage indicates that the sending and storage mode of enterprise target data needs to be optimized.

[0009] In the case that the second security storage instruction is obtained, the distributor switching is performed according to the first optimization instruction of enterprise security data storage, so that the enterprise target data is sent and stored in the local data storage by the first data distributor.

[0010] In the case that the load difference between the second data distributor and the first data distributor is reduced to less than the preset value, the distributor switching is performed again, so that the enterprise target data is sent and stored in the local data storage by the second data distributor.

[0011] Further, the load difference between the first data distributor and the second data distributor includes a current temperature difference, and in the case that the load difference between the second data distributor and the first data distributor is greater than or equal to a preset value, the first optimization instruction of enterprise security data storage is triggered.

[0012] In the case that the difference between the current temperature value of the second data distributor and the current temperature value of the first data distributor is greater than or equal to a preset value, the first optimization instruction of enterprise security data storage is triggered.

[0013] Further, the load difference between the first data distributor and the second data distributor includes a use cumulative time difference, and in the case that the load difference between the second data distributor and the first data distributor is greater than or equal to a preset value, the first optimization instruction of enterprise security data storage is triggered.

[0014] In the case that the difference between the use cumulative time of the second data distributor and the use cumulative time of the first data distributor is greater than or equal to a preset value, the first optimization instruction of enterprise security data storage is triggered.

[0015] Further, the distributor switching according to the first optimization instruction of enterprise security data storage includes:

[0016] According to the first optimization instruction of enterprise security data storage, the second data distributor for data storage distribution is switched to the first data distributor.

[0017] The enterprise target data is sent and stored in the cloud data storage by the first data distributor to obtain temporary target data.

[0018] sending and storing the temporary target data in the local data storage, and erasing the temporary target data in the cloud data storage.

[0019] Further, after judging the load conditions of the first data distributor and the second data distributor in real time during the data storage process, and judging the load difference between the first data distributor and the second data distributor, the method further comprises:

[0020] In the case that both the first data distributor and the second data distributor are overloaded, when the second security storage instruction is obtained, the first data distributor and the second data distributor are controlled to be intermittently switched to alternately send and store the enterprise target data in the local data storage through the first data distributor and the second data distributor.

[0021] Further, the method of sending and storing the enterprise target data in the local data storage through the first data distributor by switching the distributor comprises:

[0022] During the process of sending and storing the enterprise target data in the local data storage through the first data distributor, a data read-write efficiency value of the enterprise target data is obtained.

[0023] In the case that the data read-write efficiency value is lower than a data read-write efficiency threshold value, a second optimization instruction of enterprise security data storage is triggered, and the second optimization instruction of enterprise security data storage represents that the enterprise security data sending and storage mode needs to be further optimized.

[0024] According to the second optimization instruction of enterprise security data storage, the enterprise target data is divided into a first sub-data packet and a second sub-data packet, and the first data distributor and the second data distributor are controlled to be intermittently switched so that the first sub-data packet is sent and stored in the local data storage through the first data distributor, and the second sub-data packet is sent and stored in the local data storage through the second data distributor, wherein the bit value of the first sub-data packet is greater than the bit value of the second sub-data packet.

[0025] Further, the method of obtaining the data read-write efficiency value of the enterprise target data comprises:

[0026] The read-write rate value and the read-write accuracy rate of the enterprise target data are obtained.

[0027] The read-write rate value and the read-write accuracy rate are input into a pre-trained data read-write efficiency value estimation model to obtain the data read-write efficiency value, wherein the data read-write efficiency value estimation model satisfies the following expression:

[0028] E= /

[0029] E is a data read-write efficiency value, R is a current data read-write rate value, is a data reference read-write rate value, A is a current data read-write accuracy rate, is a data reference read-write accuracy rate, L is a performance load of the first data distributor, 0 is a performance penalty factor, ≥1, the performance penalty factor is positively correlated with the usage load of the data distributor.

[0030] Further, the re-distributor switching to send and store the enterprise target data to the local data storage through the second data distributor comprises:

[0031] in response to the load difference between the second data distributor and the first data distributor being reduced to less than a preset value, switching the first data distributor for data storage distribution to the second data distributor;

[0032] sending and storing the enterprise target data to the local data storage through the second data distributor.

[0033] Further, after the first data distributor sends and stores the enterprise target data to the cloud data storage according to the first secure storage instruction, it further comprises:

[0034] obtaining the storage cumulative duration of the enterprise target data in the cloud data storage;

[0035] after the storage cumulative duration reaches a storage preset time, starting an automatic clearing program to automatically clear the enterprise target data in the cloud data storage.

[0036] The beneficial effects of the present application are: after obtaining the data security storage instruction, the corresponding data storage mode is determined according to the type of the data security storage instruction, when the data security storage instruction is the first security storage instruction, the enterprise target data is sent and stored in the cloud data storage through the first data distributor, when the data security storage instruction is the second security storage instruction, the enterprise target data is sent and stored in the local data storage through the second data distributor; and the load conditions of the first data distributor and the second data distributor are judged in real time during the data storage process, when the first data distributor and the second data distributor are not overloaded, and the load difference between the second data distributor and the first data distributor is greater than or equal to the preset value, the enterprise security data storage first optimization instruction is triggered, in the case of obtaining the second security storage instruction, the distributor switching is carried out according to the enterprise security data storage first optimization instruction to send the enterprise target data to the local data storage through the first data distributor; and in the case that the load difference between the second data distributor and the first data distributor is reduced to less than the preset value, the distributor switching is carried out again to send the enterprise target data to the local data storage through the second data distributor. In this way, the enterprise data security storage not only realizes flexible storage selection based on instruction type, but also effectively avoids single distributor overload through dynamic monitoring and adaptive adjustment of distributor load, which not only improves the overall efficiency and reliability of data storage, but also helps enterprises to optimize resource allocation, reduce storage cost and improve business response speed while ensuring data security. BRIEF DESCRIPTION OF DRAWINGS

[0037] Figure 1 It is an embodiment structure diagram of the data storage system of the present application;

[0038] Figure 2 It is an embodiment flow diagram of the enterprise security data storage and optimization method of the present application;

[0039] Figure 3 It is an embodiment diagram of the data storage system of the present application;

[0040] Figure 4 It is an embodiment diagram of the computer readable storage medium of the present application. DETAILED DESCRIPTION

[0041] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

[0042] In the description of the present application, the terms "first", "second" are only for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined with "first", "second" can be explicitly or implicitly included one or more of the features. In the description of the present application, the meaning of "multiple" is two or more, unless otherwise specifically limited.

[0043] In the description of the present application, the term "for example" is used to indicate "as an example, illustration or description". Any embodiment described as "for example" in the present application is not necessarily interpreted as more preferred or more advantageous than other embodiments. The following description is given in order to enable any person skilled in the art to implement and use the present application. In the following description, details are listed for the purpose of explanation. It should be understood that those skilled in the art can recognize that the present application can be implemented without using these specific details. In other examples, well-known structures and processes will not be described in detail to avoid unnecessary details making the description of the present application obscure. Therefore, the present application is not intended to be limited to the embodiments shown, but is consistent with the broadest scope consistent with the principles and characteristics disclosed in the present application.

[0044] Embodiment 1

[0045] In the era of today's digital transformation acceleration, enterprise data is not only an important basis for internal operation and decision-making, but also a cornerstone for external supervision, audit and cooperation and exchange. The demand for data analysis within the enterprise is growing, including market trend prediction, financial performance evaluation, operation process optimization and other aspects, which drives the enterprise to continuously pursue the ability of deep mining and instant analysis of data. At the same time, external demand cannot be ignored, especially the audit demand from the audit department, which requires enterprises to provide complete, accurate and traceable data records to verify the compliance of enterprise operation and the authenticity of financial reports. These external demands often have suddenness, timeliness and strictness, which puts high requirements on the data response ability of enterprises. However, in the related technology, when external needs, relevant personnel need to manually extract and package from local database to external demand personnel, there are technical problems of low data processing efficiency and data security risk.

[0046] To solve the above problems, the present application proposes an enterprise secure data storage and optimization method, which is applied to a data storage system. In the following, the data storage system executes the enterprise secure data storage and optimization method is taken as an example for description, the data storage system in the present application embodiment includes a first data distributor 100 and a second data distributor 200, as shown in Figure 1 Figure 1 ​Fig. 1 is a schematic diagram of an embodiment of the data storage system of the present application, in which the first data distributor 100 is wirelessly connected to the cloud data storage 300, the second data distributor 200 is wiredly connected to the local data storage 400, and the cloud data storage 300 is wirelessly connected to the local data storage 400. It should be noted that although a logical sequence is shown in the flowchart, in some cases, the steps shown or described can be performed in an order different from that shown here. Please refer to the accompanying Figure 2 The method comprises the following steps S100-S600:

[0047] S100, obtaining a data security storage instruction, wherein the data security storage instruction comprises one of a first security storage instruction and a second security storage instruction, the first security storage instruction is an instruction triggered in response to a storage demand outside the enterprise, and the second security storage instruction is an instruction triggered in response to a storage demand inside the enterprise;

[0048] Specifically, the first security storage instruction can be a security storage instruction triggered in response to a data demand of the enterprise by a government audit department or an external cooperative unit, and the second security storage instruction can be a security storage instruction triggered in response to a data demand of the enterprise by a demand department inside the enterprise.

[0049] For example, when an audit department conducts a financial data review on an enterprise, the audit department needs to obtain financial data related to the enterprise. At this time, the audit department can send a data storage instruction to the data storage system of the enterprise, so that the data storage system of the enterprise automatically sends the corresponding financial data to a target storage address (such as a cloud data storage) after receiving the instruction, so that the audit department can review the related data for financial audit. When an operation department of the enterprise needs to calculate the operation efficiency of the enterprise, it needs to obtain operation related data (such as operation input and operation income data) of the enterprise. At this time, the operation department of the enterprise can send a data storage instruction to the data storage system of the enterprise, so that the data storage system of the enterprise automatically sends the corresponding operation data to a target storage address (such as a local data storage) after receiving the instruction, so that the operation department of the enterprise can review the related data for operation efficiency calculation.

[0050] It can be understood that, since the requirements of internal data demand and external data demand for data security and transmission timeliness are inconsistent, and in order to ensure the safe sending and storage of external demand data, two different data distributors can be used for data sending and storage in the embodiment of the present application; for example, one data distributor is used for sending external demand data of the enterprise, and the other data distributor is used for sending internal demand data of the enterprise.

[0051] S200, transmitting and storing the enterprise target data to the cloud data storage according to the first data distribution device and the first security storage instruction, and transmitting and storing the enterprise target data to the local data storage according to the second data distribution device and the second security storage instruction;

[0052] Specifically, in the embodiment of the present application, the first data distribution device is used for transmitting and storing the enterprise external demand data, and the second data distribution device is used for transmitting and storing the enterprise internal demand data. When the data security storage instruction received by the data storage system is the first security storage instruction, the enterprise target data is transmitted and stored to the cloud data storage through the first data distribution device, and the external demand department can check the relevant data in the cloud data storage. When the data security storage instruction received by the data storage system is the second security storage instruction, the enterprise target data is transmitted and stored to the local data storage through the second data distribution device, and the enterprise internal demand department can check, download, etc. the relevant data in the local data storage.

[0053] In order to ensure the data security problem caused by the transmission of enterprise data to the outside (such as the cloud data storage), in an embodiment, after the step S200: transmitting and storing the enterprise target data to the cloud data storage according to the first data distribution device and the first security storage instruction, it further comprises: obtaining the storage cumulative duration of the enterprise target data in the cloud data storage; after the storage cumulative duration reaches the storage preset time, starting an automatic clearing program to automatically clear the enterprise target data in the cloud data storage.

[0054] Specifically, a certain time is reserved for the external demand department to review the data and handle other businesses. When the storage cumulative duration of the enterprise target data in the cloud data storage exceeds the preset duration, it can be roughly judged that the external demand department has completed the relevant business handling. At this time, the automatic clearing program is started to automatically clear the enterprise target data in the cloud data storage. In this way, it is ensured that the enterprise data cannot be used unlimitedly when it is transmitted to the outside, thereby ensuring the security of the enterprise data.

[0055] It can be understood that, since the demand for enterprise internal data is more frequent, the demand for enterprise external data is relatively less. Therefore, under normal circumstances, the usage frequency and usage load of the second data distribution device are greater than those of the first data distribution device. In this way, after a certain duration of use, the failure probability of the second data distribution device is greater than that of the first data distribution device.

[0056] S300, judging the load conditions of the first data distributor and the second data distributor in real time during the data storage process, and judging the load difference between the first data distributor and the second data distributor, the load difference representing the overloading condition of the second data distributor relative to the first data distributor in terms of load;

[0057] Specifically, to prevent frequent and excessive use of the second data distributor from affecting its service life and data transmission performance, the load conditions of the first data distributor and the second data distributor are monitored in real time during the data storage process. In this way, the data storage mode can be optimized and adjusted according to the load conditions of the two data distributors. The load conditions of the first data distributor and the second data distributor can be the first condition: both are not overloaded, but the current load of one of them is much greater than that of the other; the second condition: both are overloaded; and the third condition: both are not overloaded, and the current loads of the two are comparable.

[0058] For the first condition, the one with a larger load needs to be limited in use to avoid frequent and excessive use affecting its performance. For the second condition, both need to be limited in use to avoid both being frequently and excessively used and affecting their performance. For the third condition, since the loads are comparable and neither is overloaded, no intervention is needed.

[0059] It should be noted that the load conditions of the first data distributor and the second data distributor can refer to the current temperature conditions of the first data distributor and the second data distributor, or to the cumulative working time conditions of the first data distributor and the second data distributor. When the current temperature of the first data distributor or the second data distributor is greater than a temperature threshold, it indicates that the data distributor has a high risk of failure and needs to be inhibited in use or controlled in frequent use. Or when the cumulative working time of the first data distributor or the second data distributor exceeds a time threshold, it indicates that the data distributor has a high risk of failure and needs to be inhibited in use or controlled in frequent use.

[0060] S400, in the case where neither the first data distributor nor the second data distributor is overloaded, and the load difference between the second data distributor and the first data distributor is greater than or equal to a preset value, triggering an enterprise security data storage first optimization instruction, the enterprise security data storage first optimization instruction representing that the enterprise security data storage mode needs to be optimized;

[0061] In an embodiment, the load of the first data distributor and the second data distributor refers to the current temperature, so when the first data distributor and the second data distributor are not overloaded, and the load difference between the second data distributor and the first data distributor is greater than or equal to a preset value, that is, the current temperature values of the first data distributor and the second data distributor are both lower than a temperature threshold, and the difference between the current temperature value of the second data distributor and the current temperature value of the first data distributor is greater than or equal to a preset value, the first optimization instruction of the enterprise security data storage is triggered. That is, when the current temperature values of the first data distributor and the second data distributor are both lower than the temperature threshold, but the current temperature value of the second data distributor is much higher than the current temperature value of the first data distributor, it indicates that the current load of the second data distributor is much greater than the current load of the first data distributor, at this time, the first optimization instruction of the enterprise security data storage is triggered to optimize the enterprise security data sending and storage mode, so as to balance the use load of the first data distributor and the second data distributor, and avoid the overuse of the second data distributor.

[0062] In another embodiment, the load of the first data distributor and the second data distributor refers to the cumulative use length, so when the first data distributor and the second data distributor are not overloaded, and the load difference between the second data distributor and the first data distributor is greater than or equal to a preset value, that is, the cumulative use lengths of the first data distributor and the second data distributor are both lower than a length threshold, and the difference between the cumulative use length of the second data distributor and the cumulative use length of the first data distributor is greater than or equal to a length preset value, the first optimization instruction of the enterprise security data storage is triggered. That is, when the cumulative use lengths of the first data distributor and the second data distributor are both lower than the length threshold, but the cumulative use length of the second data distributor is much higher than the cumulative use length of the first data distributor, it indicates that the current load of the second data distributor is much greater than the current load of the first data distributor, at this time, the first optimization instruction of the enterprise security data storage is triggered to optimize the enterprise security data sending and storage mode, so as to balance the use load of the first data distributor and the second data distributor, and avoid the overuse of the second data distributor.

[0063] S500, in the case where the second security storage instruction is acquired, according to the first optimization instruction of the enterprise security data storage, the distributor switching is performed to send the enterprise target data to the local data storage through the first data distributor;

[0064] In an embodiment, the step S500: according to the first optimization instruction of the enterprise security data storage, the distributor switching is performed to send the enterprise target data to the local data storage through the first data distributor, comprising:

[0065] S510, switching the second data distributor for data storage distribution to the first data distributor according to the enterprise security data storage first optimization instruction;

[0066] S520, sending and storing the enterprise target data to the cloud data storage to obtain temporary target data through the first data distributor;

[0067] S530, sending and storing the temporary target data to the local data storage, and erasing the temporary target data in the cloud data storage.

[0068] When the system triggers the enterprise security data storage first optimization instruction, it indicates that the second data distributor needs to be inhibited from use. In the case of obtaining the second security storage instruction, the second data distributor needs to be started for data distribution storage according to the original strategy. However, in the embodiment of the application, after the system triggers the enterprise security data storage first optimization instruction, the distributor is switched according to the enterprise security data storage first optimization instruction to send and store the enterprise target data to the local data storage through the first data distributor, so as to avoid the excessive frequent use of the second data distributor.

[0069] Specifically, first, the second data distributor for data storage distribution is switched to the first data distributor according to the enterprise security data storage first optimization instruction. Then, the enterprise target data is sent and stored to the cloud data storage to obtain temporary target data through the first data distributor. Finally, the temporary target data is sent and stored to the local data storage, and the temporary target data in the cloud data storage is erased. In this way, the data security storage can be ensured, the frequency of excessive use of the second data distributor can be reduced, and the performance recovery or maintenance of the second data distributor can be facilitated.

[0070] In the case that the first data distributor and the second data distributor are not overloaded, but the current load of the second data distributor is much larger than that of the first data distributor, the strategy of the embodiment of the application is to switch the second data distributor for data storage distribution to the first data distributor. As known from the foregoing description, the first data distributor is in wireless communication connection with the cloud data storage, so that there is a certain stability risk in data transmission between the two. That is, in this case, in the case of unstable network and other unfavorable external environment, the data read-write efficiency value of the enterprise target data may be low, which affects the storage efficiency of the data. Therefore, in an embodiment, the distributor switching to send and store the enterprise target data to the local data storage through the first data distributor comprises:

[0071] In the process of sending and storing the enterprise target data to the local data storage through the first data distributor, the data read-write efficiency value of the enterprise target data is obtained.

[0072] In the case where the data read-write efficiency value is lower than the data read-write efficiency threshold value, an enterprise security data storage second optimization instruction is triggered, which represents that the enterprise security data sending storage mode needs to be further optimized.

[0073] According to the enterprise security data storage second optimization instruction, the enterprise target data is divided into a first sub-data packet and a second sub-data packet, and the first data distributor and the second data distributor are controlled to be intermittently switched so that the first sub-data packet is sent through the first data distributor and stored in the local data storage, and the second sub-data packet is sent through the second data distributor and stored in the local data storage, wherein the bit value of the first sub-data packet is greater than the bit value of the second sub-data packet.

[0074] Specifically, when obtaining the data read-write efficiency value of the enterprise target data, the read-write rate value and the read-write accuracy rate of the enterprise target data can be obtained first; then the read-write rate value and the read-write accuracy rate are input into a pre-trained data read-write efficiency value estimation model to obtain the data read-write efficiency value, wherein the data read-write efficiency value estimation model satisfies the following expression: ; in the formula, E is the data read-write efficiency value, R is the current data read-write rate value, is the data benchmark read-write rate value, A is the current data read-write accuracy rate (the accuracy rate can be approximately calculated by data loss), is the data benchmark read-write accuracy rate, L is the performance load of the first data distributor, 0 is the performance penalty factor, ≥1, the performance penalty factor is positively correlated with the use load of the first data distributor. After obtaining the data read-write efficiency value through the data read-write efficiency value estimation model, if it is judged that the data read-write efficiency value is lower than the data read-write efficiency threshold value, it means that the data sending storage through the first data distributor is affected by the poor network and other external environments, at this time, the enterprise security data storage second optimization instruction needs to be triggered to further optimize the enterprise security data sending storage mode.

[0075] ​After the system obtains the enterprise security data storage second optimization instruction, the embodiment of the application divides the enterprise target data into a first sub-data packet and a second sub-data packet according to the enterprise security data storage second optimization instruction, and controls the first data distributor and the second data distributor to perform intermittent switching so that the first sub-data packet is sent by the first data distributor and stored in the local data storage, and the second sub-data packet is sent by the second data distributor and stored in the local data storage. For example, the first sub-data packet is first sent by the first data distributor and stored in the local data storage, and then the second sub-data packet is sent by the second data distributor and stored in the local data storage. Alternatively, the sending of the first sub-data packet and the second sub-data packet is alternately performed, for example, the first sub-data packet is first sent by the first data distributor for 1 min, the second sub-data packet is then sent by the second data distributor for 1 min, and then the first sub-data packet is again sent by the first data distributor for 1 min, and so on until the enterprise target data is completely sent and stored. In this way, the current status of the first data distributor and the second data distributor is comprehensively considered, and the distribution and storage of the enterprise target data are performed, which can improve the efficiency of data storage.

[0076] It should be noted that when constructing the data read-write efficiency value estimation model, a large amount of data is collected for model parameter training. When the performance load L of the first data distributor is 0.8, the performance penalty factor of the first data distributor is 1.2 after the first data distributor is used for 100 h, that is, the data read-write efficiency baseline value of the first data distributor becomes 0.83 (i.e., 1 / 1.2) after the first data distributor is used for 100 h, that is, E= .

[0077] S600, in the case where the load difference between the second data distributor and the first data distributor is reduced to less than a preset value, the distributor switching is performed again to send the enterprise target data by the second data distributor and store it in the local data storage.

[0078] ​Specifically, in the case that both the first data distributor and the second data distributor are not overloaded, but the current load of the second data distributor is much larger than the current load of the first data distributor, the strategy of the embodiment of the application is to switch the second data distributor performing data storage distribution to the first data distributor. Therefore, in the process of data distribution storage by using the first data distributor, if it is monitored that the load difference between the second data distributor and the first data distributor is reduced to less than a preset value, i.e., the current load of the second data distributor is close to the current load of the first data distributor at this time, the embodiment of the application switches the first data distributor performing data storage distribution to the second data distributor again, so as to send and store the enterprise target data to and in the local data storage by using the second data distributor. In this way, the load states of the first data distributor and the second data distributor are monitored in real time, and the first data distributor and the second data distributor are adaptively switched, so as to ensure the optimization of resource utilization.

[0079] Embodiment 2

[0080] On the basis of embodiment 1, after judging the load states of the first data distributor and the second data distributor and the load difference between the first data distributor and the second data distributor in real time in the process of data storage, the embodiment further includes the following steps.

[0081] In the case that both the first data distributor and the second data distributor are overloaded, when the second security storage instruction is acquired, the first data distributor and the second data distributor are controlled to be intermittently switched to alternately send and store the enterprise target data to and in the local data storage by using the first data distributor and the second data distributor.

[0082] Specifically, when the load states of the first data distributor and the second data distributor are monitored in real time in the process of data storage, and it is judged that both the first data distributor and the second data distributor are overloaded at this time, it is indicated that any one of the first data distributor and the second data distributor will continue to be used too frequently, which will seriously affect the performance or service life thereof. Therefore, in the embodiment of the application, in the case that both the first data distributor and the second data distributor are overloaded, and when the second security storage instruction is acquired, the first data distributor and the second data distributor are controlled to be intermittently switched to alternately send and store the enterprise target data to and in the local data storage by using the first data distributor and the second data distributor. In this way, any one of the first data distributor and the second data distributor can be avoided to be used too frequently, so as to stably maintain the service life and performance of the data distributor.

[0083] Based on this, the enterprise security data storage and optimization method provided by the embodiments of the present application, after obtaining the data security storage instruction, determines the corresponding data storage mode according to the type of the data security storage instruction, when the data security storage instruction is the first security storage instruction, sends and stores the enterprise target data to the cloud data storage through the first data distributor, when the data security storage instruction is the second security storage instruction, sends and stores the enterprise target data to the local data storage through the second data distributor; and judges the load conditions of the first data distributor and the second data distributor in real time during the data storage process, when the first data distributor and the second data distributor are not overloaded, and the load difference between the second data distributor and the first data distributor is greater than or equal to the preset value, triggers the enterprise security data storage first optimization instruction, in the case of obtaining the second security storage instruction, according to the enterprise security data storage first optimization instruction, performs distributor switching to send and store the enterprise target data to the local data storage through the first data distributor; and in the case that the load difference between the second data distributor and the first data distributor is reduced to less than the preset value, re-performs distributor switching to send and store the enterprise target data to the local data storage through the second data distributor. In this way, the enterprise data security storage not only realizes flexible storage selection based on instruction type, but also effectively avoids single distributor overload through dynamic monitoring and adaptive adjustment of distributor load, not only improves the overall efficiency and reliability of data storage, but also helps enterprises to optimize resource allocation while ensuring data security, reduce storage costs, and improve business response speed.

[0084] Please refer to Figure 3 , Figure 3 The embodiment of the data storage system provided by the embodiments of the present application is shown in the figure. Figure 3As shown, the embodiment of the present application provides a data storage system 500, which further comprises a memory 510, a processor 520 and a computer program 511 stored in the memory 510 and capable of running on the processor 520, and the processor 520 implements the following steps when executing the computer program 511: obtaining a data security storage instruction, wherein the data security storage instruction comprises one of a first security storage instruction and a second security storage instruction, the first security storage instruction is an instruction triggered in response to a storage demand outside the enterprise, and the second security storage instruction is an instruction triggered in response to a storage demand inside the enterprise; sending and storing enterprise target data in a cloud data storage through a first data distributor according to the first security storage instruction, and sending and storing the enterprise target data in a local data storage through a second data distributor according to the second security storage instruction; judging the load conditions of the first data distributor and the second data distributor in real time during the data storage process, and judging the load difference value of the first data distributor and the second data distributor, wherein the load difference value represents the exceeding condition of the second data distributor relative to the first data distributor in terms of load; triggering an enterprise security data storage first optimization instruction when the first data distributor and the second data distributor are not overloaded, and the load difference value of the second data distributor and the first data distributor is greater than or equal to a preset value, wherein the enterprise security data storage first optimization instruction represents that the enterprise security data sending and storage mode needs to be optimized; performing distributor switching to send and store the enterprise target data in the local data storage through the first data distributor according to the enterprise security data storage first optimization instruction when the second security storage instruction is obtained; and performing distributor switching again to send and store the enterprise target data in the local data storage through the second data distributor when the load difference value of the second data distributor and the first data distributor is reduced to less than the preset value.

[0085] Please refer to Figure 4 , Figure 4 An embodiment of a computer readable storage medium provided by the embodiment of the present application is shown. As Figure 4As shown, the embodiment provides a computer readable storage medium 600, which stores a computer program 611, and the computer program 611 is executed by a processor to implement the following steps: obtaining a data security storage instruction, wherein the data security storage instruction comprises one of a first security storage instruction and a second security storage instruction, the first security storage instruction is an instruction triggered in response to a storage demand outside an enterprise, and the second security storage instruction is an instruction triggered in response to a storage demand inside the enterprise; sending and storing enterprise target data in a cloud data storage through a first data distributor according to the first security storage instruction, and sending and storing the enterprise target data in a local data storage through a second data distributor according to the second security storage instruction; judging load conditions of the first data distributor and the second data distributor in real time during data storage, and judging a load difference between the first data distributor and the second data distributor, the load difference representing an over-standard condition of the second data distributor relative to the first data distributor in terms of load; in a case where neither the first data distributor nor the second data distributor is overloaded, and the load difference between the second data distributor and the first data distributor is greater than or equal to a preset value, triggering an enterprise security data storage first optimization instruction, the enterprise security data storage first optimization instruction representing that an enterprise security data sending and storage mode needs to be optimized; in a case where the second security storage instruction is obtained, performing distributor switching to send and store the enterprise target data in the local data storage through the first data distributor according to the enterprise security data storage first optimization instruction; in a case where the load difference between the second data distributor and the first data distributor is reduced to less than the preset value, re-performing distributor switching to send and store the enterprise target data in the local data storage through the second data distributor.

[0086] It should be noted that in the above embodiments, the description of each embodiment has its own emphasis, and the parts not described in detail in an embodiment can be referred to the related description of other embodiments.

[0087] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0088] The present application is described in reference to the flowchart and / or block diagrams of the methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each block of the flowchart and / or block diagrams, and combinations of blocks in the flowchart and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more flowcharts and / or blocks Figure 1 one or more blocks or combinations of blocks

[0089] These computer program instructions can also be stored in a computer- readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more flowcharts and / or blocks Figure 1 one or more blocks or combinations of blocks

[0090] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more flowcharts and / or blocks Figure 1 one or more blocks or combinations of blocks

[0091] While the preferred embodiments of the application have been described, additional variations and modifications can be made to the embodiments by those of skill in the art once they have the benefit of the present disclosure without departing from the spirit and scope of the application. Accordingly, the attached claims are intended to embrace all such variations and modifications as fall within the scope of the present application.

[0092] Obviously, numerous modifications and variations of the present application are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims and their equivalents, the application can be practiced otherwise than as specifically described.

Claims

1. An enterprise secure data storage and optimization method, characterized in that, The method is applied to a data storage system comprising a first data distributor and a second data distributor, and comprises: obtaining a data security storage instruction, wherein the data security storage instruction comprises one of a first security storage instruction and a second security storage instruction, the first security storage instruction is an instruction triggered in response to a storage demand outside an enterprise, and the second security storage instruction is an instruction triggered in response to a storage demand inside the enterprise; sending and storing enterprise target data to a cloud data storage according to the first security storage instruction through the first data distributor, and sending and storing the enterprise target data to a local data storage according to the second security storage instruction through the second data distributor; judging a load condition of the first data distributor and the second data distributor in real time during data storage, and judging a load difference value of the first data distributor and the second data distributor, the load difference value representing an over-standard condition of the second data distributor relative to the first data distributor in terms of load; in a case where neither the first data distributor nor the second data distributor is overloaded, and the load difference value of the second data distributor and the first data distributor is greater than or equal to a preset value, triggering an enterprise security data storage first optimization instruction, the enterprise security data storage first optimization instruction representing that an enterprise security data sending and storage mode needs to be optimized; in a case where the second security storage instruction is obtained, performing distributor switching to send and store the enterprise target data to the local data storage through the first data distributor according to the enterprise security data storage first optimization instruction; in a case where the load difference value of the second data distributor and the first data distributor is reduced to less than the preset value, re-performing distributor switching to send and store the enterprise target data to the local data storage through the second data distributor.

2. The method of claim 1, wherein, The load difference value of the first data distributor and the second data distributor comprises a current temperature difference value, in a case where neither the first data distributor nor the second data distributor is overloaded, and the load difference value of the second data distributor and the first data distributor is greater than or equal to a preset value, triggering an enterprise security data storage first optimization instruction, comprising: in a case where a difference between a current temperature value of the second data distributor and a current temperature value of the first data distributor is greater than or equal to a preset value, triggering the enterprise security data storage first optimization instruction.

3. The method of claim 1, wherein, The load difference value of the first data distributor and the second data distributor comprises a use cumulative duration difference value, in a case where neither the first data distributor nor the second data distributor is overloaded, and the load difference value of the second data distributor and the first data distributor is greater than or equal to a preset value, triggering an enterprise security data storage first optimization instruction, comprising: in a case where a difference between a use cumulative duration of the second data distributor and a use cumulative duration of the first data distributor is greater than or equal to a preset value, triggering the enterprise security data storage first optimization instruction.

4. The method of claim 1, wherein, The first optimization instruction of the enterprise security data storage is used to switch the distributor to send and store the enterprise target data to the local data storage through the first data distributor. The second data distributor for data storage distribution is switched to the first data distributor according to the first optimization instruction of the enterprise security data storage. The enterprise target data is sent and stored to the cloud data storage to obtain temporary target data through the first data distributor. The temporary target data is sent and stored to the local data storage, and the temporary target data in the cloud data storage is erased.

5. The method of claim 1, wherein, After judging the load conditions of the first data distributor and the second data distributor and the load difference between the first data distributor and the second data distributor in real time during the data storage process, the following steps are further included: When the second security storage instruction is obtained under the condition that both the first data distributor and the second data distributor are overloaded, the first data distributor and the second data distributor are controlled to be intermittently switched to alternately send and store the enterprise target data to the local data storage through the first data distributor and the second data distributor.

6. The method of claim 1, wherein, The first optimization instruction of the enterprise security data storage is used to switch the distributor to send and store the enterprise target data to the local data storage through the first data distributor. During the process of sending and storing the enterprise target data to the local data storage through the first data distributor, a data read-write efficiency value of the enterprise target data is obtained. When the data read-write efficiency value is lower than a data read-write efficiency threshold value, a second optimization instruction of the enterprise security data storage is triggered, which indicates that the enterprise security data sending and storage mode needs to be further optimized. According to the second optimization instruction of the enterprise security data storage, the enterprise target data is divided into a first sub-data packet and a second sub-data packet, and the first data distributor and the second data distributor are controlled to be intermittently switched so that the first sub-data packet is sent and stored to the local data storage through the first data distributor, and the second sub-data packet is sent and stored to the local data storage through the second data distributor, wherein the bit value of the first sub-data packet is greater than that of the second sub-data packet.

7. The method of claim 6, wherein, The data read-write efficiency value of the enterprise target data is obtained by: Obtaining the read-write speed value and the read-write accuracy rate of the enterprise target data; The read-write speed value and the read-write accuracy rate are input into a pre-trained data read-write efficiency value estimation model to obtain the data read-write efficiency value, wherein the data read-write efficiency value estimation model satisfies the following expression: E= / In the formula, E is a data read-write efficiency value, R is a current data read-write speed value, is a data reference read-write speed value, A is a current data read-write accuracy, is a data reference read-write accuracy, L is a performance load of the first data distributor, 0 is a performance penalty factor, ≥1, the performance penalty factor is in a positive correlation with the use load of the data distributor.

8. The method of claim 1, wherein, The first optimization instruction of the enterprise security data storage is used to switch the distributor to send and store the enterprise target data to the local data storage through the first data distributor. The first data distributor for data storage distribution is switched to the second data distributor in response to the load difference between the second data distributor and the first data distributor being reduced to less than a preset value. The enterprise target data is sent and stored to the local data storage through the second data distributor.

9. The method of claim 1-8, wherein, After the enterprise target data is sent and stored in the cloud data storage by the first data distributor according to the first security storage instruction, the method further comprises: acquiring the storage cumulative duration of the enterprise target data in the cloud data storage; after the storage cumulative duration reaches the storage preset time, starting an automatic clearing program to automatically clear the enterprise target data in the cloud data storage.

10. A data storage system, characterized by comprise: a first data distributor, a second data distributor, and a memory for storing a computer software program; a processor for reading and executing the computer software program, thereby realizing the enterprise security data storage and optimization method of any one of claims 1-9.

Citation Information

Patent Citations

  • Supply chain-based data analysis method, system and device, and storage medium

    CN115392777A

  • Distributed market data acquisition and management system for equity investment

    CN116797267A