A system and method for optimizing back-end data storage space
By adopting a tree-shaped service center and storage server system in the back-end data storage space, data levels are divided according to the security baseline and optimized processing, the problem of low data management efficiency is solved, and the utilization rate of storage space and system security is improved. , avoiding the omission of important data.
Patent Information
- Application Number
- CN202011023380.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-09-25
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2040-09-25
AI Technical Summary
The existing technology is difficult to effectively manage and optimize the back-end data storage space, resulting in data being unable to be fully utilized, which may lead to security incidents and important data omissions, increasing costs and security risks.
A back-end data storage space optimization system is adopted to generate security baselines through the tree structure of the service center and the storage server, and divide data into different security levels. Data deletion, transfer and storage space are carried out according to the proportion and information increment speed. Allocation to improve storage space utilization and system security.
It realizes efficient management of back-end storage space, avoids important data omissions, improves system security and reliability, and saves storage costs.
Smart Images

Figure CN111966694B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a system and method for optimizing backend data storage space. Background Art
[0002] Now is the data age, and various security issues have gradually emerged. The network security industry has been greatly developed, and the premise of supporting network security technology is data. Storage is a form of expression that puts data (including logs, pictures, videos, etc.) on physical or cloud servers for easy viewing at any time.
[0003] In today's digital information age, data is becoming more and more numerous and richer. When users view their own data, if the amount of data is too large, they may ignore certain data. If this data is security data, such as hacker attack data, it may cause huge losses.
[0004] Therefore, how to better utilize storage space, how to organize and optimize data, save costs, improve system security, and avoid missing important data are issues that urgently need to be solved by technical personnel in this field. Summary of the invention
[0005] The purpose of this application is to provide a backend data storage space optimization system and method to solve the problem that due to the lack of storage space and data management solutions, data cannot fully play its role and easily cause security incidents. The specific solution is as follows:
[0006] In a first aspect, the present application provides a system for optimizing backend data storage space, including: a service center, a service site, and a storage server;
[0007] Each of the storage servers is used to store data of a business type, and the storage servers located in the same domain belong to one service site, and all the service sites belong to the service center;
[0008] The service center is used to generate a security baseline for each storage server, and send the security baseline to the storage server through the service site;
[0009] The storage server is used to perform a check operation according to the security baseline, and send the check result to the service center through the service site;
[0010] The service center is used to determine the proportion of data with different security levels under the same business type based on the inspection results. When the proportion of low security level data exceeds a preset threshold, an instruction is sent to the storage server of the business type to control the storage server to delete or transfer the low security level data.
[0011] Preferably, the service center is used for:
[0012] Group storage servers of the same functional type into the same domain.
[0013] Preferably, the service center is used to send the security baseline to the storage server through the service site using the message middleware ActiveMQ;
[0014] Correspondingly, the storage server is used to send the inspection result to the service center through the service site by using the message middleware ActiveMQ.
[0015] Preferably, the service center is used for:
[0016] Determine the overall storage space occupancy rate of the storage server based on the inspection results; when the overall storage space occupancy rate exceeds the preset occupancy rate, determine the proportion of data with different security levels under the same business type based on the inspection results; if the proportion of low security level data exceeds the preset threshold, generate a deletion instruction for the low security level data and send it to the storage server; if the proportion of low security level data does not exceed the preset threshold, generate a capacity expansion prompt.
[0017] Preferably, the service center is also used for:
[0018] The information increment speed of data of different security levels under the same business type is determined according to the inspection result; and the storage space of data of different security levels is allocated according to the information increment speed of data of different security levels.
[0019] Preferably, the data of different security levels under the same business type include high security level data, medium security level data, and low security level data.
[0020] Preferably, the service center is used for:
[0021] Determining the storage space increment of the data of different security levels after a preset time according to the information increment speed of the data of different security levels;
[0022] When the unallocated storage space of the storage server is greater than or equal to the storage space increment of the high security level data, a storage space equal to the storage space increment of the high security level data is allocated to the high security level data, otherwise a capacity expansion prompt is generated;
[0023] After allocating storage space for high security level data, if the unallocated storage space of the storage server is greater than or equal to the storage space increment of the medium security level, allocate storage space of the size of the storage space increment of the medium security level data to the medium security level data, otherwise generate a transfer task for the medium security level data;
[0024] After allocating storage space for medium security level data, if the unallocated storage space of the storage server is greater than or equal to the storage space increment of the low security level, storage space equal to the storage space increment size of the low security level data is allocated to the low security level data, otherwise a deletion task for the low security level is generated.
[0025] In a second aspect, the present application provides a method for optimizing backend data storage space, comprising:
[0026] Generate a security baseline for each storage server using a service center, and send the security baseline to the storage server through a service site;
[0027] Using the storage server to perform a check operation according to the security baseline, and sending the check result to the service center through the service site;
[0028] The service center determines the proportion of data of different security levels under the same business type according to the inspection result, and when the proportion of low security level data exceeds a preset threshold, sends an instruction to the storage server of the business type to control the storage server to delete or transfer the low security level data;
[0029] Each of the storage servers is used to store data of a business type, the storage servers located in the same domain belong to one service site, and all the service sites belong to the service center.
[0030] The present application provides an optimization system for back-end data storage space, including: a service center, a service site, and a storage server; wherein each storage server is used to store data of a business type, storage servers located in the same domain belong to a service site, and all service sites belong to the service center. In actual applications, the service center is used to generate a security baseline for each storage server, and send the security baseline to the storage server through the service site; the storage server is used to perform inspection operations based on the security baseline, and send the inspection results to the service center through the service site; the service center is used to determine the proportion of data with different security levels under the same business type based on the inspection results, and when the proportion of low-security-level data exceeds a preset threshold, send instructions to the storage server of the business type to control the storage server to delete or transfer the low-security-level data.
[0031] It can be seen that the system stores data through storage nodes in a tree structure. Each storage server at the bottom is used to store data of a business type, and divides the data under the same business type into different security levels to optimize the back-end data. The top-level service center determines the distribution of data of different security levels at the bottom by issuing security baselines and receiving the execution results of the security baselines. When the proportion of low-security level data is high, it is deleted to manage the back-end storage space. Ultimately, the utilization rate of the back-end storage space is improved, and the optimization of data organization is achieved to avoid the loss of important data and improve the security and reliability of the system.
[0032] In addition, the present application also provides a method for optimizing backend data storage space, the technical effects of which correspond to the technical effects of the above-mentioned system and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0033] In order to more clearly illustrate the embodiments of the present application or the technical solutions of the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0034] Figure 1 A schematic diagram of the architecture of an embodiment of a backend data storage space optimization system provided by the present application;
[0035] Figure 2 A schematic diagram of an implementation process of an optimization system for back-end data storage space provided by the present application;
[0036] Figure 3 This is a flowchart of an embodiment of a method for optimizing backend data storage space provided in this application. DETAILED DESCRIPTION
[0037] The core of this application is to provide a system and method for optimizing back-end data storage space, thereby improving the utilization rate of back-end storage space, and also realizing data sorting and optimization, avoiding omission of important security data, and improving security and reliability.
[0038] In order to enable those skilled in the art to better understand the present application, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.
[0039] The following is an introduction to an embodiment of a backend data storage space optimization system provided by the present application. Figure 1 , embodiment 1 includes: a service center, a service site and a storage server; wherein each of the storage servers is used to store data of a business type, storage servers located in the same domain belong to one of the service sites, and all of the service sites belong to the service center.
[0040] The implementation process of this system is as follows Figure 2 As shown, the service center is used to generate a security baseline for each storage server, and send the security baseline to the storage server through the service site; the storage server is used to perform an inspection operation according to the security baseline, and send the inspection result to the service center through the service site; the service center is used to determine the proportion of data with different security levels under the same business type according to the inspection result, and when the proportion of low-security-level data exceeds a preset threshold, send an instruction to the storage server of this business type to control the storage server to delete or transfer the low-security-level data.
[0041] Specifically, storage servers are divided according to business types, and one storage server is used to store data of one business type. Storage servers of the same functional type are divided into the same domain (such as auditing and testing). All storage servers in a domain belong to the service site as subordinates, and all service sites in the entire system belong to the service center as subordinates. Each superior can obtain the data of the subordinate.
[0042] The service center will send the established security baseline to the storage server through the service site. The storage server will perform detection tasks based on the security baseline, specifically matching and collecting locally stored data information, determining the proportion of data with different security levels, determining local storage performance, etc., and finally feeding back the detection results to the service center. The service center will optimize the storage space of the storage server based on the detection results.
[0043] The above security baseline includes, but is not limited to, the detection task of the proportion of data with different security levels under the same business type, and may also include the detection task of the overall storage space utilization of the storage server, etc.
[0044] Specifically, the service center sends the security baseline to subordinates in the form of tasks, including service sites and storage servers. The storage server performs corresponding detection tasks according to the security baseline, compares the data content, and generates detection results, which are reported upward step by step until they are summarized to the service center.
[0045] Since ActiveMQ supports reliable connections, has configurable automatic reconnection, and supports distributed destinations across networks, this embodiment uses ActiveMQ as a message middleware to send and receive task messages. Specifically, the service center is used to use the message middleware ActiveMQ to send the security baseline to the storage server through the service site; correspondingly, the storage server is used to use the message middleware ActiveMQ to send the inspection result to the service center through the service site.
[0046] In this embodiment, the deletion method may be rm or rsync.
[0047] like Figure 2 As shown, data under the same business type can be divided into three security levels: primary data, secondary data, and tertiary data, or high security level data, medium security level data, and low security level data.
[0048] In actual applications, if the overall storage space occupancy rate of the storage server is low, there is no need to delete or transfer data. Therefore, as a preferred implementation, the service center is used to: determine the overall storage space occupancy rate of the storage server according to the inspection results; when the overall storage space occupancy rate exceeds the preset occupancy rate, determine the proportion of data with different security levels under the same business type according to the inspection results; if the proportion of low-security level data exceeds the preset threshold, generate a deletion instruction for the low-security level data and send it to the storage server; if the proportion of low-security level data does not exceed the preset threshold, generate a capacity expansion prompt.
[0049] For example, Figure 2 As shown, when the overall storage space occupancy rate exceeds 80%, if level 3 data (low security level data) exists, the level 1 data will be deleted; if level 3 data does not exist and level 2 data (medium security level data) exists, the level 2 data will be deleted; if neither level 3 data nor level 2 data exists, it indicates that all data stored in the storage server is level 1 data (high security level data), and a capacity expansion prompt is generated.
[0050] The present embodiment provides an optimization system for back-end data storage space. The system stores data through storage nodes in a tree structure. Each storage server at the bottom layer is used to store data of a business type, and divides the data under the same business type into different security levels to achieve optimization of the back-end data. The top-level service center determines the distribution of data of different security levels at the bottom layer by issuing security baselines and receiving the execution results of the security baselines. When the proportion of low-security-level data is high, it deletes it, thereby achieving management of the back-end storage space. Ultimately, the utilization rate of the back-end storage space is improved, and the optimization of data organization is achieved to avoid the loss of important data and improve the security and reliability of the system.
[0051] In summary, this embodiment optimizes the space for back-end data storage to a certain extent, which can ensure that important data is not lost, save storage space, classify data, facilitate observation and adjustment, and help users more intuitively find important data, such as important information of attackers, thereby solving the problem of user storage optimization.
[0052] Another embodiment of the optimization system for back-end data storage space provided by the present application is described in detail below. This embodiment is expanded to a certain extent on the basis of the previous embodiment.
[0053] In this embodiment, the service center is further used to: determine the information increment speed of data of different security levels under the same business type according to the inspection result; and allocate storage space for data of different security levels according to the information increment speed of data of different security levels.
[0054] Assuming that the data of different security levels under the same service type include high security level data, medium security level data, and low security level data, then the service center can be specifically used for:
[0055] Determining the storage space increment of the data of different security levels after a preset time according to the information increment speed of the data of different security levels;
[0056] When the unallocated storage space of the storage server is greater than or equal to the storage space increment of the high security level data, a storage space equal to the storage space increment of the high security level data is allocated to the high security level data, otherwise a capacity expansion prompt is generated;
[0057] After allocating storage space for high security level data, if the unallocated storage space of the storage server is greater than or equal to the storage space increment of the medium security level, allocate storage space of the size of the storage space increment of the medium security level data to the medium security level data, otherwise generate a transfer task for the medium security level data;
[0058] After allocating storage space for medium security level data, if the unallocated storage space of the storage server is greater than or equal to the storage space increment of the low security level, storage space equal to the storage space increment size of the low security level data is allocated to the low security level data, otherwise a deletion task for the low security level is generated.
[0059] Specifically, in actual applications, after a period of time T, the following steps are performed:
[0060] The storage server detects the following information based on the security baseline: data storage time, data distribution, and average incremental speed of data at different security levels, and feeds the detection results back to the service center. The service center draws an information incremental speed graph for each security level data under the same business type. Based on the information incremental speed graph, the reserved storage space S1 for high security level data, the reserved storage space S2 for medium security level data, and the reserved storage space S3 for low security level data are estimated. For data at different security levels, the following processing is performed:
[0061] For high-security level data, storage space must be guaranteed, that is, according to the reserved storage space S1 for high-security level data, corresponding storage space is allocated for it. If the space is insufficient, an expansion task and expansion prompt are generated.
[0062] For medium security level data, if the space is insufficient, a transfer strategy is adopted, that is, a transfer task is generated according to the reserved storage space S2 of the medium security level data.
[0063] For low-security-level data, if the space is insufficient, a time-sensitive storage strategy is adopted, that is, a deletion task is generated based on the reserved storage space S3 for low-security-level data.
[0064] A backend data storage space optimization method provided in an embodiment of the present application is introduced below. The backend data storage space optimization method described below is implemented based on a backend data storage space optimization system described above.
[0065] like Figure 3 As shown, the method for optimizing the backend data storage space of this embodiment includes:
[0066] S301, using a service center to generate a security baseline for each storage server, and sending the security baseline to the storage server through a service site;
[0067] S302: Utilize the storage server to perform a check operation according to the security baseline, and send the check result to the service center through the service site;
[0068] S303, using the service center to determine the proportion of data of different security levels under the same business type according to the inspection result, and when the proportion of low security level data exceeds a preset threshold, sending an instruction to the storage server of the business type to control the storage server to delete or transfer the low security level data;
[0069] Each of the storage servers is used to store data of a business type, the storage servers located in the same domain belong to one service site, and all the service sites belong to the service center.
[0070] The backend data storage space optimization method of this embodiment is implemented based on the backend data storage space optimization system described above, so the specific implementation method of the method can be seen in the implementation example part of the backend data storage space optimization system in the previous text, and its function corresponds to the function of the above-mentioned system, which will not be repeated here.
[0071] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.
[0072] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented directly using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
[0073] The above is a detailed introduction to the scheme provided by the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for general technical personnel in this field, according to the idea of the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.
Claims
1. A system for optimizing backend data storage space, It is characterized in that include: Service centers, service sites and storage servers; Each of the storage servers is used to store data of a business type, and the storage servers located in the same domain belong to one service site, and all the service sites belong to the service center; The service center is used to generate a security baseline for each storage server, and send the security baseline to the storage server through the service site; The storage server is used to perform a check operation according to the security baseline, and send the check result to the service center through the service site; The service center is used to determine the overall storage space occupancy rate of the storage server according to the inspection result; when the overall storage space occupancy rate exceeds the preset occupancy rate, determine the proportion of data with different security levels under the same business type according to the inspection result; if the proportion of low security level data exceeds the preset threshold, generate a deletion instruction for the low security level data to control the storage server to delete the low security level data; if the proportion of low security level data does not exceed the preset threshold, generate a capacity expansion prompt; Alternatively, the service center is used to determine the information increment speed of data of different security levels under the same business type according to the inspection result; allocate storage space to data of different security levels according to the information increment speed of data of different security levels; determine the storage space increment of data of different security levels after a preset time according to the information increment speed of data of different security levels; when the unallocated storage space of the storage server is greater than or equal to the storage space increment of the high security level data, allocate storage space of the storage space increment size of the high security level data to the high security level data, otherwise generate a capacity expansion prompt; after allocating storage space to the high security level data, if the unallocated storage space of the storage server is greater than or equal to the storage space increment of the medium security level, allocate storage space of the storage space increment size of the medium security level data to the medium security level data, otherwise generate a transfer task for the medium security level data; after allocating storage space to the medium security level data, if the unallocated storage space of the storage server is greater than or equal to the storage space increment of the low security level, allocate storage space of the storage space increment size of the low security level data to the low security level data, otherwise generate a deletion task for the low security level to control the storage server to delete the low security level data; The service center is used to divide storage servers of the same functional type into the same domain; The service center is used to send the security baseline to the storage server through the service site by using the message middleware ActiveMQ; The storage server is used to send the inspection result to the service center through the service site by using the message middleware ActiveMQ; The data of different security levels under the same service type include high security level data, medium security level data, and low security level data.
2. A method for optimizing backend data storage space, It is characterized in that include: Generate a security baseline for each storage server using a service center, and send the security baseline to the storage server through a service site; Using the storage server to perform a check operation according to the security baseline, and sending the check result to the service center through the service site; Determining the overall storage space occupancy rate of the storage server according to the inspection result by the service center; When the overall storage space occupancy rate exceeds the preset occupancy rate, determining the proportion of data of different security levels under the same business type according to the inspection result; If the proportion of low security level data exceeds a preset threshold, a deletion instruction for the low security level data is generated to control the storage server to delete the low security level data; If the proportion of low-security-level data does not exceed the preset threshold, a capacity expansion prompt is generated; Alternatively, the service center is used to determine the information increment speed of data of different security levels under the same business type according to the inspection results; Allocating storage space for data of different security levels according to information increment speed of the data of different security levels; Determining the storage space increment of the data of different security levels after a preset time according to the information increment speed of the data of different security levels; When the unallocated storage space of the storage server is greater than or equal to the storage space increment of the high security level data, a storage space equal to the storage space increment of the high security level data is allocated to the high security level data, otherwise a capacity expansion prompt is generated; After allocating storage space for high security level data, if the unallocated storage space of the storage server is greater than or equal to the storage space increment of the medium security level, allocate storage space of the size of the storage space increment of the medium security level data to the medium security level data, otherwise generate a transfer task for the medium security level data; After allocating storage space for the medium security level data, if the unallocated storage space of the storage server is greater than or equal to the storage space increment of the low security level, allocate storage space of the storage space increment size of the low security level data to the low security level data, otherwise generate a deletion task for the low security level to control the storage server to delete the low security level data; Using the service center to divide storage servers of the same functional type into the same domain; Using the service center and the message middleware ActiveMQ, the security baseline is sent to the storage server through the service site; Using the storage server and the message middleware ActiveMQ, the inspection result is sent to the service center through the service site; Among them, each storage server is used to store data of a business type, the storage servers located in the same domain belong to one service site, and all the service sites belong to the service center; the data of different security levels under the same business type include high security level data, medium security level data, and low security level data.
