Data backup storage method and system
By setting up the main server and backup server in different geographical locations, and performing data splitting and transmission of different data blocks on the main server, the high cost, privacy and security issues of data backup storage are solved, and the effects of dual storage and rapid recovery are achieved.
Patent Information
- Application Number
- CN202510466593.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-04-15
- Publication Date
- 2025-05-13
- Estimated Expiration
- 2045-04-15
AI Technical Summary
The prior art has high economic costs, labor costs, data privacy and security problems in data backup and storage, especially when facing natural disasters, data disasters, etc., which may lead to data loss or leakage.
By setting the main server and the backup server in different geographical locations, and dividing the storage space of the main server into fixed storage space and temporary storage space, data splitting and differential data block transmission are performed, and the data in the temporary storage space is deleted after the transmission is completed.
It realizes dual storage, reduces the cost and time of data backup storage, enhances the privacy and security of data, and restores data through the backup server when the main server fails, ensuring the normal operation of the enterprise.
Smart Images

Figure CN119988102A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of computers and data backup, and in particular to a data backup storage method and system. Background Art
[0002] With the development of computer technology, many companies have transformed from paper data to electronic data. Compared with direct physical storage of paper data, electronic data needs to be stored virtually, and the corresponding electronic data needs to be stored in the server. Then, since a single server can store a large amount of electronic data in a centralized manner, when the server suffers from irresistible natural disasters such as fire and flood, or when the server encounters data disasters such as viruses, network communication failures, software and hardware failures, and human operation errors, it may cause the corresponding server to be inaccessible or data loss, which directly causes inestimable losses to the normal operation of the enterprise. Therefore, most companies currently back up and store the original electronic data to ensure data integrity. However, due to the large amount of electronic data in many companies, the economic and human costs spent by companies on data backup storage are high, so it is necessary to reduce the cost of data backup storage. In addition, since the electronic data of many companies also involves the business information of the corresponding companies, if data leakage occurs, it will also affect the normal operation of the company, so it is necessary to ensure the privacy and security of data during data backup storage. Summary of the invention
[0003] In view of the above-mentioned shortcomings of the prior art, an object of the present invention is to provide a data backup storage method and system for solving the technical problems existing in the prior art.
[0004] To achieve the above purpose and other related purposes, the present invention provides a data backup storage method, comprising the following steps: Configure storage space for the main server, dividing the storage space of the main server into fixed storage space and temporary storage space; Adding the original data to the fixed storage space for permanent storage, and adding the original data to the temporary storage space for temporary caching; The original data temporarily cached in the current backup time period is split in the temporary storage space to obtain a plurality of data blocks; and the source data block and the target data block are compared in the temporary storage space, and the target data block with differences is used as the differential data block; wherein the source data block is the data block obtained when the data is split in the previous backup time period, and the target data block is the data block obtained when the data is split in the current backup time period; The differential data blocks are transmitted from the main server to the backup server for backup storage, including: sorting and numbering all differential data blocks in the temporary storage space in the order of data block generation time; associating all differential data blocks in the temporary storage space according to the numbering results to obtain a differential data block sequence; if the transmitted differential data blocks are different from the differential data block sequence, locating the last differential data block that has completed transmission during the transmission process, and using the numbering result corresponding to the differential data block as the starting number, and marking all differential data blocks after the starting number as missing data blocks; retransmitting the missing data blocks to the backup server in the order corresponding to the numbering results until the transmitted differential data blocks are exactly the same as the differential data block sequence.
[0005] Optionally, the process of transmitting the differential data block from the primary server to the backup server for backup storage further includes: Recording the transmission time, and when the transmission time is greater than or equal to a preset time, comparing the transmitted differential data block with the differential data block sequence; If the transmitted differential data blocks are exactly the same as the differential data block sequence, a transmission completion message is output so that the main server deletes the original data temporarily cached in the current backup time period and the data blocks obtained when splitting the data in the previous backup time period from the temporary storage space according to the transmission completion message.
[0006] Optionally, the method further comprises: Establishing a block index for all differential data blocks in the temporary storage space according to the numbering result, and transmitting all the block indexes to the backup server before transmitting the differential data blocks; wherein the block index includes the location information of the differential data blocks, and a single block index corresponds to a single differential data block; After completing the transmission of all block indexes, starting to transmit the differential data blocks from the primary server to the backup server; and, When the transmission time is greater than or equal to a preset time, performing differential data block matching in the backup server according to the block index; If there is no unmatched block index, insert the differential data block transmitted in the current backup time period into the data block sequence backed up in the previous backup time period according to the position information contained in the block index, so as to back up and store the original data in the backup server; If there is an unmatched block index, the unmatched block index will be recorded as an idle index, and feedback will be given to the main server that there is packet loss in the transmission process of the differential data block, and the differential data block corresponding to the idle index will be retransmitted through the main server until the idle index completes the differential data block matching.
[0007] Optionally, the method further comprises: When the missing data blocks are retransmitted to the backup server in the order corresponding to the numbering results, the missing data blocks are compressed; and / or when the differential data blocks corresponding to the free indexes are retransmitted through the primary server, the differential data blocks corresponding to the free indexes are compressed; The received compressed differential data block is decompressed by the backup server.
[0008] Optionally, the method further comprises: Configuring encryption characters in the primary server, and configuring decryption characters corresponding to the encryption characters in the backup server; Encrypting the original data temporarily cached in the temporary storage space during the current backup period using the encryption character, and performing data splitting based on the encryption result; and, After the differential data blocks transmitted in the current backup time period are successfully inserted into the data block sequence backed up in the previous backup time period, the differential data blocks transmitted in the current backup time period are decrypted using the decryption character to back up and store the original data in the backup server.
[0009] Optionally, the method further comprises: Acquire the enterprise information of the enterprise, the enterprise information including: enterprise credit code information, enterprise organization code information and / or enterprise business registration number information; The encrypted characters and the decrypted characters are generated according to the enterprise information.
[0010] Optionally, the method further comprises: deleting original data temporarily cached in the current backup time period and data blocks obtained when data is split in the previous backup time period from the temporary storage space; wherein the backup server and the main server are arranged in different geographical locations.
[0011] The present invention also provides a data backup storage system, the system comprising: A storage space configuration module, used to configure the storage space of the main server, and divide the storage space of the main server into a fixed storage space and a temporary storage space; A data original storage module, used for adding the original data to the fixed storage space for permanent storage, and adding the original data to the temporary storage space for temporary caching; A data splitting and comparing module is used to split the original data temporarily cached in the current backup time period in the temporary storage space to obtain multiple data blocks; and to compare the source data block and the target data block in the temporary storage space, and use the target data block with differences as the differential data block; wherein the source data block is the data block obtained when the data is split in the previous backup time period, and the target data block is the data block obtained when the data is split in the current backup time period; A data backup storage module, used for transmitting the differential data blocks from the main server to the backup server for backup storage, including: sorting and numbering all differential data blocks in the temporary storage space in the order of data block generation time; associating all differential data blocks in the temporary storage space according to the numbering results to obtain a differential data block sequence; if the transmitted differential data blocks are different from the differential data block sequence, locating the last differential data block to complete the transmission process, and using the numbering result corresponding to the differential data block as the starting number, and marking all differential data blocks after the starting number as missing data blocks; and retransmitting the missing data blocks to the backup server in the order corresponding to the numbering results until the transmitted differential data blocks are exactly the same as the differential data block sequence.
[0012] Optionally, the process in which the data backup storage module transmits the differential data block from the primary server to the backup server for backup storage further includes: Recording the transmission time, and when the transmission time is greater than or equal to a preset time, comparing the transmitted differential data block with the differential data block sequence; If the transmitted differential data blocks are completely identical to the differential data block sequence, a transmission completion message is output, so that the primary server deletes the original data temporarily cached in the current backup time period and the data blocks obtained when the data is split in the previous backup time period from the temporary storage space according to the transmission completion message; And, the original data temporarily cached in the current backup time period and the data blocks obtained when the data was split in the previous backup time period are deleted from the temporary storage space; wherein the backup server and the main server are set in different geographical locations.
[0013] Optionally, the system further comprises: Establishing a block index for all differential data blocks in the temporary storage space according to the numbering result, and transmitting all the block indexes to the backup server before transmitting the differential data blocks; wherein the block index includes the location information of the differential data blocks, and a single block index corresponds to a single differential data block; After completing the transmission of all block indexes, starting to transmit the differential data blocks from the primary server to the backup server; and, When the transmission time is greater than or equal to a preset time, performing differential data block matching in the backup server according to the block index; If there is no unmatched block index, insert the differential data block transmitted in the current backup time period into the data block sequence backed up in the previous backup time period according to the position information contained in the block index, so as to back up and store the original data in the backup server; If there is an unmatched block index, the unmatched block index will be recorded as an idle index, and feedback will be given to the main server that there is packet loss in the transmission process of the differential data block, and the differential data block corresponding to the idle index will be retransmitted through the main server until the idle index completes the differential data block matching.
[0014] As described above, the present invention provides a data backup storage method and system, which has the following beneficial effects: the present invention first records the electronic data generated by the enterprise as original data, then divides the pre-set server for storing data into a main server and a backup server, and sets the main server and the backup server in different geographical locations, and the geographical location distance between the main server and the backup server is greater than or equal to the preset distance; then configures the storage space of the main server, and divides the storage space of the main server into a fixed storage space and a temporary storage space; at the same time, adds the original data to the fixed storage space for permanent storage, and adds the original data to the temporary storage space for temporary caching; then In the temporary storage space, the original data temporarily cached in the current backup time period is split to obtain multiple data blocks; and, in the temporary storage space, the source data block and the target data block are compared, and the target data block with differences is used as the differential data block; wherein the source data block is the data block obtained when the data is split in the previous backup time period, and the target data block is the data block obtained when the data is split in the current backup time period; finally, the differential data block is transmitted from the main server to the backup server for backup storage, and after the transmission is completed, the original data temporarily cached in the current backup time period and the data block obtained when the data is split in the previous backup time period are deleted from the temporary storage space. It can be seen from this that the present invention can use the main server to permanently store the original data in electronic form generated by the enterprise during the production and operation process by setting the main server and the backup server, and can use the backup server for backup storage on the other hand, so that the main server and the backup server can be used to realize dual storage of the original data, thereby strengthening the data storage work of the enterprise. Moreover, the present invention can reduce the probability of problems occurring in both the main server and the backup server at the same time by setting the main server and the backup server in different geographical locations; and because the backup server fully backs up the original data, even if the main server fails and causes data loss or inaccessibility, the enterprise can restore the data through the backup server, thereby not affecting the normal operation of the enterprise. At the same time, the present invention obtains multiple data blocks by splitting the original data, and then compares the differences in the data blocks obtained after the data splitting between the previous backup time period and the current backup time period, and only transmits the data blocks with differences in the current backup time period during the backup transmission process. Compared with the prior art that requires the transmission of the entire original data, the present invention can ensure that while the backup server can back up all the original data, it can also save the communication traffic used by the original data in the backup process, which not only reduces the cost of the enterprise in data backup, but also speeds up the backup storage efficiency of the original data and shortens the backup storage time of the original data.In addition, after the main server completes the backup storage of the original data of the current backup time period, the present invention will delete the original data temporarily cached in the current backup time period and the data blocks obtained when the data was split in the previous backup time period from the temporary storage space, thereby freeing up the temporary storage space of the main server and reducing the storage space of the main server occupied by data backup tasks. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] Figure 1 A schematic diagram of a data backup storage method according to an embodiment of the present invention; Figure 2 A schematic diagram of the connection between a primary server and a backup server provided in an embodiment of the present invention; Figure 3 A schematic diagram of the hardware structure of a data backup storage system provided in one embodiment of the present invention. DETAILED DESCRIPTION
[0016] The following describes the embodiments of the present invention by specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.
[0017] It should be noted that the illustrations provided in this embodiment are only used to illustrate the basic concept of the present invention in a schematic manner. Therefore, the drawings only show components related to the present invention rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed arbitrarily, and the component layout may also be more complicated.
[0018] See also Figure 1 As shown, this embodiment provides a data backup storage method, comprising the following steps: S110, obtaining the electronic data generated by the enterprise and recording it as the original data. As an example, in this embodiment or other embodiments, the electronic data generated by the enterprise can be specifically defined according to the actual situation of different enterprises, and is not limited here. For example, the code log data, software operation data, etc. presented in electronic form by the software enterprise during software development can be used as the original data, and the program code data, product parameter data, etc. presented in electronic form by the manufacturing enterprise during industrial product manufacturing can be used as the original data, and the financial data, contract data, etc. presented in electronic form by the software enterprise, manufacturing enterprise or other enterprises can also be used as the original data.
[0019] S120, divide the pre-set servers for storing data into main servers and backup servers, and set the main servers and backup servers in different geographical locations, and the geographical distance between the main server and the backup server is greater than or equal to the preset distance. As an example, in this embodiment or other embodiments, the main server and the backup server can use the same type of server, or different types of servers. The enterprise can make corresponding choices according to different backup needs, which will not be described in detail here. If the enterprise selects different types of servers as the main server and the backup server, the storage space capacity of the backup server needs to be greater than that of the main server so that the backup server can fully back up the original data. At the same time, the number of backup servers can be set according to actual conditions. For example, when the main server and the backup server are the same type of servers, two backup servers can be set, and the geographical distance between the two backup servers is equal to the geographical distance between any backup server and the main server. As an example, in this embodiment or other embodiments, the preset distance can be set according to actual conditions, and no specific numerical value is limited here. For example, the preset distance can be set to 50 kilometers, the preset distance can be set to 200 kilometers, or the preset distance can be set to 500 kilometers. Figure 2 As shown, for a certain main server A, there is a corresponding backup server B, and under the condition that the preset distance is set to 50 kilometers, the geographical location distance between the main server A and the backup server B is 70 kilometers.
[0020] S130, configure the storage space of the main server, and divide the storage space of the main server into a fixed storage space and a temporary storage space. As an example, in this embodiment or other embodiments, the fixed storage space and the temporary storage space can be set according to the actual situation, and are not specifically limited here. For example, 50% of the storage space of the main server can be used as fixed storage space, and the other 50% of the storage space can be used as temporary storage space; 70% of the storage space of the main server can be used as fixed storage space, and the other 30% of the storage space can be used as temporary storage space; 85% of the storage space of the main server can be used as fixed storage space, and the other 15% of the storage space can be used as temporary storage space. As an example, in this embodiment or other embodiments, when the storage space of the main server is configured, it can be configured only once or multiple times. For example, when the fixed storage space is insufficient, but the temporary storage space is idle, the storage space of the main server can be configured again, reducing the capacity of the temporary storage space and increasing the capacity of the fixed storage space. Similarly, when the fixed storage space is idle but the temporary storage space is insufficient, the storage space of the main server can be configured again to reduce the capacity of the fixed storage space and increase the capacity of the temporary storage space. Therefore, the storage space allocation and the number of configurations when configuring the storage space of the main server can be determined according to the actual situation, and will not be repeated here.
[0021] S140, adding the original data to a fixed storage space for permanent storage, and adding the original data to a temporary storage space for temporary caching; S150, splitting the original data temporarily cached in the current backup time period in the temporary storage space to obtain multiple data blocks; and comparing the source data block and the target data block in the temporary storage space, using the target data block with differences as the differential data block; wherein the source data block is the data block obtained when the data was split in the previous backup time period, and the target data block is the data block obtained when the data was split in the current backup time period. As an example, in this embodiment or other embodiments, the specific duration of the backup time period can be flexibly set by the enterprise according to different backup requirements, and the total duration of a single backup time period needs to meet the requirement that the corresponding data can be fully backed up.
[0022] S160, transferring the differential data blocks from the primary server to the backup server for backup storage, and deleting the original data temporarily cached in the current backup time period and the data blocks obtained when splitting the data in the previous backup time period from the temporary storage space after the transfer is completed.
[0023] According to the above records, in an exemplary embodiment, the process of transferring the differential data blocks from the main server to the backup server for backup storage in step S160 includes: sorting and numbering all the differential data blocks in the temporary storage space in the order of the data block generation time. As an example, in this embodiment or other embodiments, when all the differential data blocks in the temporary storage space are numbered, they can be numbered according to the sorting result, and the earlier the data block generation time is, the earlier the corresponding sorting result is, and the smaller the number is. Among them, when numbering, the numbering can start from the number 0, and the subsequent differential data blocks are numbered in a manner of gradually increasing by one. Then, all the differential data blocks in the temporary storage space are associated according to the numbering result to obtain a differential data block sequence; and, the transmission time is recorded, and when the transmission time is greater than or equal to the preset time, the transmitted differential data block is compared with the differential data block sequence. If the transmitted differential data block is exactly the same as the differential data block sequence, a transmission completion message is output so that the main server deletes the original data temporarily cached in the current backup time period and the data blocks obtained when the data is split in the previous backup time period from the temporary storage space according to the transmission completion message. If the transmitted differential data block is not the same as the differential data block sequence, the last differential data block that has completed the transmission in the transmission process is located, and the numbering result corresponding to the differential data block is used as the starting number, and all differential data blocks located after the starting number are recorded as missing data blocks; and the missing data blocks are retransmitted to the backup server in the order corresponding to the numbering result until the transmitted differential data block is exactly the same as the differential data block sequence. As an example, in this embodiment or other embodiments, the preset time can be set by the enterprise according to actual needs, and no specific numerical value is limited here. Among them, the duration of the preset time cannot be higher than one-fifth of the total duration of a single backup time period, so that when the transmitted differential data block is different from the differential data block sequence, the main server can use the remaining backup duration to transmit the missing data block. If the total transmission time of all differential data blocks in the current backup time period exceeds the total duration of the current backup time period, and the differential data blocks that have been transmitted are still different from the differential data block sequence, the main server can send a "backup failure" alarm message to the enterprise manager so that the corresponding enterprise manager can extend the current backup time period to ensure that the original data in each backup time period can be fully backed up. It can be seen that when the differential data blocks that have been transmitted are different from the differential data block sequence, this embodiment only needs to transmit the remaining differential data blocks, and does not need to retransmit all differential data blocks in the current backup time period, which can not only save the communication traffic of the backup process and reduce the cost of data backup for the enterprise, but also speed up the backup storage efficiency and shorten the backup storage time.
[0024] According to the above records, in an exemplary embodiment, the data backup storage method may also include: establishing a block index for all differential data blocks in the temporary storage space according to the numbering result, and transmitting all the block indexes to the backup server before transmitting the differential data blocks; wherein the block index includes the location information of the differential data blocks, and a single block index corresponds to a single differential data block; after completing the transmission of all the block indexes, starting to transmit the differential data blocks from the main server to the backup server; and when the transmission time is greater than or equal to the preset time, matching the differential data blocks according to the block index in the backup server; if there is no unmatched block index, inserting the differential data blocks transmitted in the current backup time period into the data block sequence backed up in the previous backup time period according to the location information contained in the block index, so as to back up and store the original data in the backup server; if there is an unmatched block index, the unmatched block index is recorded as an idle index, and feedback is given to the main server that there is packet loss in the transmission process of the differential data block, and the differential data block corresponding to the idle index is retransmitted through the main server until the idle index completes the differential data block matching. It can be seen that by establishing block indexes for all differential data blocks in the temporary storage space, and transmitting all block indexes before transmitting differential data blocks, the backup server can directly match differential data blocks according to the block index after receiving all differential data blocks, and then insert the corresponding differential data blocks into the sequence of data blocks backed up in the previous backup time period according to the position information contained in the block index, so as to avoid the situation of disordered backup in the current backup time period. At the same time, for the block index that has not been matched, the backup server will feedback to the main server that there is packet loss in the transmission process of the differential data block, and then the main server will retransmit the differential data block corresponding to the idle index, without the need to retransmit all differential data blocks in the current backup time period, which can not only save the communication traffic of the backup process and reduce the cost of data backup for enterprises, but also speed up the backup storage efficiency and shorten the backup storage time.
[0025] According to the above records, in an exemplary embodiment, the data backup storage method may also include: compressing the missing data blocks when retransmitting the missing data blocks to the backup server in the order corresponding to the numbering results; and / or compressing the differential data blocks corresponding to the idle index when retransmitting the differential data blocks corresponding to the idle index through the main server; and decompressing the received compressed differential data blocks through the backup server. It can be seen that by compressing the missing data blocks and / or compressing the differential data blocks corresponding to the idle index, and then transmitting the compressed differential data blocks, compared with directly transmitting the uncompressed differential data blocks, since the storage capacity of the compressed differential data blocks is smaller than that before compression, the backup storage efficiency can be accelerated and the backup storage time can be shortened.
[0026] According to the above records, in an exemplary embodiment, the data backup storage method may also include: configuring encryption characters in the main server, and configuring decryption characters corresponding to the encryption characters in the backup server; using the encryption characters to encrypt the original data temporarily cached in the temporary storage space during the current backup time period, and splitting the data based on the encryption result; and after the differential data block transmitted during the current backup time period is successfully inserted into the data block sequence backed up during the previous backup time period, using the decryption characters to decrypt the differential data block transmitted during the current backup time period, so as to back up and store the original data in the backup server. As an example, in this embodiment or other embodiments, the process of generating encryption characters and decryption characters may be: obtaining the enterprise information of the enterprise, the enterprise information includes but is not limited to the enterprise credit code information, the enterprise organization code information and / or the enterprise business registration number information; generating encryption characters and decryption characters according to the enterprise information. As an example, in this embodiment or other embodiments, when generating encryption characters and decryption characters according to the enterprise information, it can be completed using the existing encryption and decryption algorithm technology, and the encryption and decryption algorithm is not specifically limited here. It can be seen that by encrypting the original data temporarily cached in the temporary storage space with encryption characters, it can be ensured that during the backup process of the original data, even if communication hijacking occurs on the communication transmission link, the original data of the enterprise will not be directly leaked, thereby ensuring the data privacy and security of the enterprise during data backup and storage. At the same time, by setting the encryption characters and decryption characters on the main server and the backup server respectively, the security of data transmission can be further increased. In addition, using enterprise information to generate encryption characters and decryption characters can ensure that the corresponding encryption characters and decryption characters are unique, increasing the difficulty of password cracking.
[0027] In summary, the present invention provides a data backup storage method, which first records the electronic data generated by the enterprise as original data, then divides the pre-set server for storing data into a main server and a backup server, and sets the main server and the backup server in different geographical locations, and the geographical distance between the main server and the backup server is greater than or equal to the preset distance; then configures the storage space of the main server, and divides the storage space of the main server into a fixed storage space and a temporary storage space; at the same time, adds the original data to the fixed storage space for permanent storage, and adds the original data to the temporary storage space for temporary caching; then in the temporary storage space The original data temporarily cached in the current backup time period is split to obtain multiple data blocks; and the source data block and the target data block are compared in the temporary storage space, and the target data block with differences is used as the differential data block; wherein the source data block is the data block obtained when the data is split in the previous backup time period, and the target data block is the data block obtained when the data is split in the current backup time period; finally, the differential data block is transferred from the main server to the backup server for backup storage, and after the transmission is completed, the original data temporarily cached in the current backup time period and the data block obtained when the data is split in the previous backup time period are deleted from the temporary storage space. It can be seen that this method can use the main server to permanently store the original data in electronic form generated by the enterprise during the production and operation process by setting the main server and the backup server, and can use the backup server for backup storage on the other hand, so that the main server and the backup server can be used to realize dual storage of the original data, thereby strengthening the data storage work of the enterprise. Moreover, by setting the main server and the backup server in different geographical locations, the method can reduce the probability of problems occurring in both the main server and the backup server at the same time; and because the backup server fully backs up the original data, even if the main server fails and causes data loss or inaccessibility, the enterprise can restore the data through the backup server, thereby not affecting the normal operation of the enterprise. At the same time, the method splits the original data to obtain multiple data blocks, and then compares the differences in the data blocks obtained after the data split between the previous backup time period and the current backup time period, and only transmits the data blocks with differences in the current backup time period during the backup transmission process. Compared with the prior art that requires the transmission of the entire original data, the method can ensure that while the backup server can back up all the original data, it can also save the communication traffic used by the original data in the backup process, which not only reduces the enterprise's cost in data backup, but also speeds up the backup storage efficiency of the original data and shortens the backup storage time of the original data.In addition, after the main server completes the backup storage of the original data of the current backup time period, this method will delete the original data temporarily cached in the current backup time period and the data blocks obtained when the data was split in the previous backup time period from the temporary storage space, thereby freeing up the temporary storage space of the main server and reducing the storage space of the main server occupied by data backup tasks.
[0028] like Figure 3 As shown, in another exemplary embodiment of the present invention, a data backup storage system is also provided, comprising: The data acquisition module 310 is used to obtain the electronic data generated by the enterprise and record it as raw data. As an example, in this embodiment or other embodiments, the electronic data generated by the enterprise can be specifically defined according to the actual situation of different enterprises, and is not limited here. For example, the code log data, software operation data, etc. presented in electronic form by the software enterprise during software development can be used as raw data, and the program code data, product parameter data, etc. presented in electronic form by the manufacturing enterprise during industrial product manufacturing can be used as raw data. The financial data, contract data, etc. presented in electronic form by the software enterprise, manufacturing enterprise or other enterprises can also be used as raw data.
[0029] The server module 320 is used to divide the pre-set servers for storing data into main servers and backup servers, and set the main servers and backup servers in different geographical locations, and the geographical distance between the main server and the backup server is greater than or equal to the preset distance. As an example, in this embodiment or other embodiments, the main server and the backup server can use the same type of server, or different types of servers. The enterprise can make corresponding choices according to different backup needs, which will not be described in detail here. If the enterprise selects different types of servers as the main server and the backup server, the storage space capacity of the backup server needs to be greater than that of the main server so that the backup server can fully back up the original data. At the same time, the number of backup servers can be set according to actual conditions. For example, when the main server and the backup server are the same type of servers, two backup servers can be set, and the geographical distance between the two backup servers is equal to the geographical distance between any backup server and the main server. As an example, in this embodiment or other embodiments, the preset distance can be set according to actual conditions, and no specific numerical value is specified here. For example, the preset distance can be set to 50 kilometers, or the preset distance can be set to 200 kilometers, or the preset distance can be set to 500 kilometers. Figure 2 As shown, for a certain main server A, there is a corresponding backup server B, and under the condition that the preset distance is set to 50 kilometers, the geographical location distance between the main server A and the backup server B is 70 kilometers.
[0030] The storage space configuration module 330 is used to configure the storage space of the main server, and divide the storage space of the main server into a fixed storage space and a temporary storage space. As an example, in this embodiment or other embodiments, the fixed storage space and the temporary storage space can be set according to the actual situation, and are not specifically limited here. For example, 50% of the storage space of the main server can be used as a fixed storage space, and the other 50% of the storage space can be used as a temporary storage space; 70% of the storage space of the main server can be used as a fixed storage space, and the other 30% of the storage space can be used as a temporary storage space; 85% of the storage space of the main server can also be used as a fixed storage space, and the other 15% of the storage space can be used as a temporary storage space. As an example, in this embodiment or other embodiments, when the storage space of the main server is configured, it can be configured only once or multiple times. For example, when the fixed storage space is insufficient, but the temporary storage space is idle, the storage space of the main server can be configured again, reducing the capacity of the temporary storage space and increasing the capacity of the fixed storage space. Similarly, when the fixed storage space is idle but the temporary storage space is insufficient, the storage space of the main server can be configured again to reduce the capacity of the fixed storage space and increase the capacity of the temporary storage space. Therefore, the storage space allocation and the number of configurations when configuring the storage space of the main server can be determined according to the actual situation, and will not be repeated here.
[0031] The data original storage module 340 is used to add the original data to the fixed storage space for permanent storage, and to add the original data to the temporary storage space for temporary caching; The data splitting and comparing module 350 is used to split the original data temporarily cached in the current backup time period in the temporary storage space to obtain multiple data blocks; and compare the source data blocks and the target data blocks in the temporary storage space, and use the target data blocks with differences as differential data blocks; wherein the source data blocks are the data blocks obtained when the data is split in the previous backup time period, and the target data blocks are the data blocks obtained when the data is split in the current backup time period; The data backup storage module 360 is used to transfer the differential data blocks from the primary server to the backup server for backup storage, and after the transmission is completed, delete the original data temporarily cached in the current backup time period and the data blocks obtained when the data was split in the previous backup time period from the temporary storage space.
[0032] According to the above records, in an exemplary embodiment, the process of the data backup storage module 360 transferring the differential data block from the primary server to the backup server for backup storage includes: All differential data blocks in the temporary storage space are sorted and numbered in the order of the data block generation time. As an example, in this embodiment or other embodiments, when all differential data blocks in the temporary storage space are numbered, they can be numbered according to the sorting result, and the earlier the data block generation time is, the earlier the corresponding sorting result is, and the smaller the number is. Among them, when numbering, the numbering can start from the number 0, and the subsequent differential data blocks are numbered in a manner of gradually increasing by one. Then, all differential data blocks in the temporary storage space are associated according to the numbering result to obtain a differential data block sequence; and, the transmission time is recorded, and when the transmission time is greater than or equal to the preset time, the transmitted differential data block is compared with the differential data block sequence. If the transmitted differential data block is exactly the same as the differential data block sequence, the transmission completion message information is output, so that the main server deletes the original data temporarily cached in the current backup time period and the data blocks obtained when the data is split in the previous backup time period from the temporary storage space according to the transmission completion message information. If the transmitted differential data block is not the same as the differential data block sequence, then locate the last differential data block that has been transmitted during the transmission process, and use the numbering result corresponding to the differential data block as the starting number, and record all differential data blocks after the starting number as missing data blocks; and retransmit the missing data blocks to the backup server in the order corresponding to the numbering results until the transmitted differential data block is exactly the same as the differential data block sequence. As an example, in this embodiment or other embodiments, the preset time can be set by the enterprise according to actual needs, and no specific numerical value is limited here. Among them, the duration of the preset time cannot be higher than one-fifth of the total duration of a single backup time period, so that when the transmitted differential data block is different from the differential data block sequence, the main server can use the remaining backup time to transmit the missing data block. If the total transmission time of all differential data blocks in the current backup time period exceeds the total duration of the current backup time period, and the differential data blocks that have been transmitted are still different from the differential data block sequence, the main server can send a "backup failure" alarm message to the enterprise manager so that the corresponding enterprise manager can extend the current backup time period to ensure that the original data in each backup time period can be fully backed up. It can be seen that when the differential data blocks that have been transmitted are different from the differential data block sequence, this embodiment only needs to transmit the remaining differential data blocks, and does not need to retransmit all differential data blocks in the current backup time period, which can not only save the communication traffic of the backup process and reduce the cost of data backup for the enterprise, but also speed up the backup storage efficiency and shorten the backup storage time.
[0033] According to the above records, in an exemplary embodiment, the data backup storage system may also include: establishing a block index for all differential data blocks in the temporary storage space according to the numbering result, and transmitting all the block indexes to the backup server before transmitting the differential data blocks; wherein the block index includes the location information of the differential data blocks, and a single block index corresponds to a single differential data block; after completing the transmission of all the block indexes, starting to transmit the differential data blocks from the main server to the backup server; and when the transmission time is greater than or equal to the preset time, matching the differential data blocks according to the block index in the backup server; if there is no unmatched block index, inserting the differential data blocks transmitted in the current backup time period into the data block sequence backed up in the previous backup time period according to the location information contained in the block index, so as to back up and store the original data in the backup server; if there is an unmatched block index, recording the unmatched block index as an idle index, and feeding back to the main server that there is packet loss in the transmission process of the differential data block, and retransmitting the differential data block corresponding to the idle index through the main server until the idle index completes the differential data block matching. It can be seen that by establishing block indexes for all differential data blocks in the temporary storage space, and transmitting all block indexes before transmitting differential data blocks, the backup server can directly match differential data blocks according to the block index after receiving all differential data blocks, and then insert the corresponding differential data blocks into the sequence of data blocks backed up in the previous backup time period according to the position information contained in the block index, so as to avoid the situation of disordered backup in the current backup time period. At the same time, for the block index that has not been matched, the backup server will feedback to the main server that there is packet loss in the transmission process of the differential data block, and then the main server will retransmit the differential data block corresponding to the idle index, without the need to retransmit all differential data blocks in the current backup time period, which can not only save the communication traffic of the backup process and reduce the cost of data backup for enterprises, but also speed up the backup storage efficiency and shorten the backup storage time.
[0034] According to the above records, in an exemplary embodiment, the data backup storage system may also include: when the missing data blocks are retransmitted to the backup server in the order corresponding to the numbering results, the missing data blocks are compressed; and / or, when the differential data blocks corresponding to the idle indexes are retransmitted through the main server, the differential data blocks corresponding to the idle indexes are compressed; and the received compressed differential data blocks are decompressed through the backup server. It can be seen that by compressing the missing data blocks and / or compressing the differential data blocks corresponding to the idle indexes, and then transmitting the compressed differential data blocks, compared with directly transmitting the uncompressed differential data blocks, since the storage capacity of the compressed differential data blocks is smaller than that before compression, the backup storage efficiency can be increased and the backup storage time can be shortened.
[0035] According to the above records, in an exemplary embodiment, the data backup storage system may also include: configuring encryption characters in the main server, and configuring decryption characters corresponding to the encryption characters in the backup server; using encryption characters to encrypt the original data temporarily cached in the temporary storage space during the current backup time period, and splitting the data based on the encryption result; and after the differential data block transmitted during the current backup time period is successfully inserted into the data block sequence backed up during the previous backup time period, using decryption characters to decrypt the differential data block transmitted during the current backup time period, so as to back up and store the original data in the backup server. As an example, in this embodiment or other embodiments, the process of generating encryption characters and decryption characters may be: obtaining the enterprise information of the enterprise, the enterprise information includes but is not limited to the enterprise credit code information, the enterprise organization code information and / or the enterprise business registration number information; generating encryption characters and decryption characters according to the enterprise information. As an example, in this embodiment or other embodiments, when generating encryption characters and decryption characters according to the enterprise information, it can be completed using the existing encryption and decryption algorithm technology, and the encryption and decryption algorithm is not specifically limited here. It can be seen that by encrypting the original data temporarily cached in the temporary storage space with encryption characters, it can be ensured that during the backup process of the original data, even if communication hijacking occurs on the communication transmission link, the original data of the enterprise will not be directly leaked, thereby ensuring the data privacy and security of the enterprise during data backup and storage. At the same time, by setting the encryption characters and decryption characters on the main server and the backup server respectively, the security of data transmission can be further increased. In addition, using enterprise information to generate encryption characters and decryption characters can ensure that the corresponding encryption characters and decryption characters are unique, increasing the difficulty of password cracking.
[0036] In summary, the present invention provides a data backup storage system, which first records the electronic data generated by the enterprise as original data, then divides the pre-set server for storing data into a main server and a backup server, and sets the main server and the backup server in different geographical locations, and the geographical distance between the main server and the backup server is greater than or equal to the preset distance; then configures the storage space of the main server, and divides the storage space of the main server into a fixed storage space and a temporary storage space; at the same time, adds the original data to the fixed storage space for permanent storage, and adds the original data to the temporary storage space for temporary caching; then in the temporary storage space The original data temporarily cached in the current backup time period is split to obtain multiple data blocks; and the source data block and the target data block are compared in the temporary storage space, and the target data block with differences is used as the differential data block; wherein the source data block is the data block obtained when the data is split in the previous backup time period, and the target data block is the data block obtained when the data is split in the current backup time period; finally, the differential data block is transferred from the main server to the backup server for backup storage, and after the transfer is completed, the original data temporarily cached in the current backup time period and the data block obtained when the data is split in the previous backup time period are deleted from the temporary storage space. It can be seen that by setting up the main server and the backup server, on the one hand, the main server can be used to permanently store the original data in electronic form generated by the enterprise during the production and operation process, and on the other hand, the backup server can be used for backup storage, so that the main server and the backup server can be used to realize dual storage of the original data, thereby strengthening the data storage work of the enterprise. Moreover, by setting up the main server and the backup server in different geographical locations, the system can reduce the probability of problems occurring in both the main server and the backup server at the same time; and because the backup server fully backs up the original data, even if the main server fails and causes data loss or inaccessibility, the enterprise can still restore the data through the backup server, thereby not affecting the normal operation of the enterprise. At the same time, the system splits the original data into multiple data blocks, and then compares the differences between the data blocks obtained after the data split between the previous backup time period and the current backup time period, and only transmits the data blocks with differences in the current backup time period during the backup transmission process. Compared with the existing technology that requires the transmission of the entire original data, the system can ensure that while the backup server can back up all the original data, it can also save the communication traffic used by the original data in the backup process, which not only reduces the enterprise's cost in data backup, but also speeds up the backup storage efficiency of the original data and shortens the backup storage time of the original data.In addition, after the main server completes the backup storage of the original data for the current backup time period, the system will delete the original data temporarily cached for the current backup time period and the data blocks obtained when splitting the data in the previous backup time period from the temporary storage space, thereby freeing up the temporary storage space of the main server and reducing the storage space of the main server occupied by data backup tasks.
[0037] It should be noted that the data backup storage system provided in the above embodiment and the data backup storage method provided in the above embodiment belong to the same concept, wherein the specific manner in which each module and unit performs the operation has been described in detail in the method embodiment, and will not be repeated here. In practical applications, the data backup storage system provided in the above embodiment can allocate the above functions to different functional modules as needed, that is, divide the internal structure of the system into different functional modules to complete all or part of the functions described above, which is not limited here. Therefore, the present invention effectively overcomes various shortcomings in the prior art and has a high industrial utilization value.
[0038] The above embodiments are merely illustrative of the principles and effects of the present invention, and are not intended to limit the present invention. Anyone familiar with the art may modify or alter the above embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or alterations made by a person of ordinary skill in the art without departing from the spirit and technical concept disclosed by the present invention shall still be covered by the claims of the present invention.
Claims
1. A data backup storage method, characterized in that: The method comprises the following steps: Configure storage space for the main server, dividing the storage space of the main server into fixed storage space and temporary storage space; Adding the original data to the fixed storage space for permanent storage, and adding the original data to the temporary storage space for temporary caching; The original data temporarily cached in the current backup time period is split in the temporary storage space to obtain a plurality of data blocks; and the source data block and the target data block are compared in the temporary storage space, and the target data block with differences is used as the differential data block; wherein the source data block is the data block obtained when the data is split in the previous backup time period, and the target data block is the data block obtained when the data is split in the current backup time period; The differential data blocks are transmitted from the main server to the backup server for backup storage, including: sorting and numbering all differential data blocks in the temporary storage space in the order of data block generation time; associating all differential data blocks in the temporary storage space according to the numbering results to obtain a differential data block sequence; if the transmitted differential data blocks are different from the differential data block sequence, locating the last differential data block that has completed transmission during the transmission process, and using the numbering result corresponding to the differential data block as the starting number, and marking all differential data blocks after the starting number as missing data blocks; retransmitting the missing data blocks to the backup server in the order corresponding to the numbering results until the transmitted differential data blocks are exactly the same as the differential data block sequence.
2. The data backup storage method according to claim 1, characterized in that: The process of transmitting the differential data block from the primary server to the backup server for backup storage also includes: Recording the transmission time, and when the transmission time is greater than or equal to a preset time, comparing the transmitted differential data block with the differential data block sequence; If the transmitted differential data blocks are exactly the same as the differential data block sequence, a transmission completion message is output so that the main server deletes the original data temporarily cached in the current backup time period and the data blocks obtained when splitting the data in the previous backup time period from the temporary storage space according to the transmission completion message.
3. The data backup storage method according to claim 2, characterized in that: The method further comprises: Establishing a block index for all differential data blocks in the temporary storage space according to the numbering result, and transmitting all the block indexes to the backup server before transmitting the differential data blocks; wherein the block index includes the location information of the differential data blocks, and a single block index corresponds to a single differential data block; After completing the transmission of all block indexes, starting to transmit the differential data blocks from the primary server to the backup server; and, When the transmission time is greater than or equal to a preset time, performing differential data block matching in the backup server according to the block index; If there is no unmatched block index, insert the differential data block transmitted in the current backup time period into the data block sequence backed up in the previous backup time period according to the position information contained in the block index, so as to back up and store the original data in the backup server; If there is an unmatched block index, the unmatched block index will be recorded as an idle index, and feedback will be given to the main server that there is packet loss in the transmission process of the differential data block, and the differential data block corresponding to the idle index will be retransmitted through the main server until the idle index completes the differential data block matching.
4. The data backup storage method according to claim 3, characterized in that: The method further comprises: When the missing data blocks are retransmitted to the backup server in the order corresponding to the numbering results, the missing data blocks are compressed; and / or when the differential data blocks corresponding to the free indexes are retransmitted through the primary server, the differential data blocks corresponding to the free indexes are compressed; The received compressed differential data block is decompressed by the backup server.
5. The data backup storage method according to claim 3, characterized in that: The method further comprises: Configuring encryption characters in the primary server, and configuring decryption characters corresponding to the encryption characters in the backup server; Encrypting the original data temporarily cached in the temporary storage space during the current backup period using the encryption character, and performing data splitting based on the encryption result; and, After the differential data blocks transmitted in the current backup time period are successfully inserted into the data block sequence backed up in the previous backup time period, the differential data blocks transmitted in the current backup time period are decrypted using the decryption character to back up and store the original data in the backup server.
6. The data backup storage method according to claim 5, characterized in that: The method further comprises: Acquire the enterprise information of the enterprise, the enterprise information including: enterprise credit code information, enterprise organization code information and / or enterprise business registration number information; The encrypted characters and the decrypted characters are generated according to the enterprise information.
7. The data backup storage method according to any one of claims 1 to 6, characterized in that: The method further comprises: deleting the original data temporarily cached in the current backup time period and the data blocks obtained when the data is split in the previous backup time period from the temporary storage space; wherein the backup server and the main server are arranged in different geographical locations.
8. A data backup storage system, characterized in that: The system comprises: A storage space configuration module, used to configure the storage space of the main server, and divide the storage space of the main server into a fixed storage space and a temporary storage space; A data original storage module, used for adding the original data to the fixed storage space for permanent storage, and adding the original data to the temporary storage space for temporary caching; A data splitting and comparing module is used to split the original data temporarily cached in the current backup time period in the temporary storage space to obtain multiple data blocks; and to compare the source data block and the target data block in the temporary storage space, and use the target data block with differences as the differential data block; wherein the source data block is the data block obtained when the data is split in the previous backup time period, and the target data block is the data block obtained when the data is split in the current backup time period; A data backup storage module, used for transmitting the differential data blocks from the main server to the backup server for backup storage, including: sorting and numbering all differential data blocks in the temporary storage space in the order of data block generation time; associating all differential data blocks in the temporary storage space according to the numbering results to obtain a differential data block sequence; if the transmitted differential data blocks are different from the differential data block sequence, locating the last differential data block to complete the transmission process, and using the numbering result corresponding to the differential data block as the starting number, and marking all differential data blocks after the starting number as missing data blocks; and retransmitting the missing data blocks to the backup server in the order corresponding to the numbering results until the transmitted differential data blocks are exactly the same as the differential data block sequence.
9. The data backup storage system according to claim 8, characterized in that: The process in which the data backup storage module transmits the differential data block from the primary server to the backup server for backup storage also includes: Recording the transmission time, and when the transmission time is greater than or equal to a preset time, comparing the transmitted differential data block with the differential data block sequence; If the transmitted differential data blocks are completely identical to the differential data block sequence, a transmission completion message is output, so that the primary server deletes the original data temporarily cached in the current backup time period and the data blocks obtained when the data is split in the previous backup time period from the temporary storage space according to the transmission completion message; And, the original data temporarily cached in the current backup time period and the data blocks obtained when the data was split in the previous backup time period are deleted from the temporary storage space; wherein the backup server and the main server are set in different geographical locations.
10. The data backup storage system according to claim 9, characterized in that: The system further comprises: Establishing a block index for all differential data blocks in the temporary storage space according to the numbering result, and transmitting all the block indexes to the backup server before transmitting the differential data blocks; wherein the block index includes the location information of the differential data blocks, and a single block index corresponds to a single differential data block; After completing the transmission of all block indexes, starting to transmit the differential data blocks from the primary server to the backup server; and, When the transmission time is greater than or equal to a preset time, performing differential data block matching in the backup server according to the block index; If there is no unmatched block index, insert the differential data block transmitted in the current backup time period into the data block sequence backed up in the previous backup time period according to the position information contained in the block index, so as to back up and store the original data in the backup server; If there is an unmatched block index, the unmatched block index will be recorded as an idle index, and feedback will be given to the main server that there is packet loss in the transmission process of the differential data block, and the differential data block corresponding to the idle index will be retransmitted through the main server until the idle index completes the differential data block matching.
Citation Information
Patent Citations
Data processing method and device
CN110825559A
Electric power data storage management method and system, terminal equipment and storage medium
CN116701365A
Data backup method, device and system
CN117215826A
SM2-based certificateless identity authentication method and system
CN119402292A
Method and systems for providing back up for a database
US20230142887A1