A big data-based information security storage method and system
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- 毕小强
- Filing Date
- 2021-11-30
- Publication Date
- 2026-06-02
Smart Images
Figure CN114065268B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of information security technology, specifically to an information security storage method and system based on big data. Background Technology
[0002] Information security refers to the technical and managerial security protections established and adopted for data processing systems, in order to protect computer hardware, software, and data from being damaged, altered, or leaked due to accidental or malicious causes.
[0003] During the information storage process, information may be lost due to accidents or unforeseen circumstances and cannot be recovered. Therefore, it is necessary to improve the existing information storage methods. Summary of the Invention
[0004] In view of the shortcomings of the prior art, the present invention provides an information security storage method and system based on big data, which improves the anti-attack capability and recoverability of data information and reduces the probability of data loss.
[0005] To solve the above-mentioned technical problems, the present invention proposes the following technical solution:
[0006] A method for secure information storage based on big data includes the following steps:
[0007] Divide the data that needs to be stored into multiple segments;
[0008] Multiple segments are sequentially numbered according to the order of the data information, and each segment has a unique number.
[0009] Encrypt multiple segments separately to form multiple encrypted segments;
[0010] Multiple encrypted fragments are combined with multiple fragments one by one to form multiple combined fragments, wherein the number of the encrypted fragments is different from the number of the fragments;
[0011] Assign multiple combined fragments to different storage areas;
[0012] The combined fragments are encrypted to form encrypted combined fragments;
[0013] Assign a unique identifier to the encrypted combination fragment;
[0014] Store encrypted combination fragments that have the same unique identifier.
[0015] Furthermore, symmetric or asymmetric encryption algorithms are used to encrypt multiple fragments separately.
[0016] Furthermore, symmetric or asymmetric encryption algorithms are used to encrypt the combined fragments.
[0017] Furthermore, it includes the following steps:
[0018] Search for all encrypted combination fragments with a certain unique identifier in different storage areas;
[0019] Decrypt all the found encrypted combination fragments once to obtain multiple combination fragments;
[0020] Decompose the combined fragment into fragments and encrypted fragments;
[0021] Sort the segments according to their codes;
[0022] Determine if any segments are missing after sorting;
[0023] If there are missing segments in the sorted sequence, find the location of the encrypted segment corresponding to the missing segment;
[0024] Decrypt the encrypted segment corresponding to the missing segment;
[0025] The encrypted fragment corresponding to the decrypted missing fragment is added to the position of the missing fragment.
[0026] A big data-based information security storage system includes:
[0027] The data sharding module is used to divide the data information that needs to be stored into multiple fragments;
[0028] The segment numbering module is used to sequentially number multiple segments according to the order of data information, with each segment having a unique number.
[0029] A single-fragment encryption module is used to encrypt multiple fragments separately, forming multiple encrypted fragments;
[0030] The fragment combination module is used to combine multiple encrypted fragments with multiple fragments one by one to form multiple combined fragments, wherein the number of the encrypted fragments is different from the number of the fragments;
[0031] The fragment allocation module is used to allocate multiple combined fragments to different storage areas;
[0032] The secondary fragment encryption module is used to encrypt the combined fragments to form encrypted combined fragments;
[0033] The flag allocation module is used to assign a unique flag code to the encrypted combined fragment;
[0034] The fragment storage module is used to store encrypted combination fragments that have the same unique identifier.
[0035] Furthermore, the primary fragment encryption module uses a symmetric encryption algorithm or an asymmetric encryption algorithm to encrypt the fragment.
[0036] Furthermore, the secondary fragment encryption module uses a symmetric encryption algorithm or an asymmetric encryption algorithm to encrypt the combined fragments.
[0037] Furthermore, including:
[0038] The fragment search module is used to search for all encrypted combination fragments with a certain unique identifier in different storage areas;
[0039] The single-fragment decryption module is used to decrypt all the found encrypted combination fragments in one go, resulting in multiple combination fragments;
[0040] The fragment decomposition module is used to decompose combined fragments into fragments and encrypted fragments;
[0041] The fragment sorting module is used to sort fragments according to their encoding.
[0042] The missing data detection module is used to determine whether there are any missing data segments after sorting.
[0043] The missing fragment search module is used to find the location of the encrypted fragment corresponding to the missing fragment when there are missing fragments in the sorted fragments;
[0044] The secondary fragment decryption module is used to decrypt the encrypted fragments corresponding to the missing fragments;
[0045] The missing fragment completion module is used to fill in the missing fragment with the encrypted fragment corresponding to the decrypted missing fragment.
[0046] As can be seen from the above technical solution, the beneficial effects of the present invention are as follows: by dividing the data information into multiple segments, combining each segment with an encrypted segment with a different number, and storing the encrypted data in partitions, the anti-attack capability and recoverability of the data information are improved, and the probability of data loss is reduced. Attached Figure Description
[0047] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the accompanying drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. In all the drawings, similar elements or parts are generally identified by similar reference numerals. In the drawings, the elements or parts are not necessarily drawn to scale.
[0048] Figure 1 This is a flowchart of the method of the present invention;
[0049] Figure 2 This is a block diagram of the system of the present invention. Detailed Implementation
[0050] The embodiments of the technical solution of the present invention will now be described in detail with reference to the accompanying drawings. These embodiments are merely illustrative of the technical solution of the present invention and are therefore intended to limit the scope of protection of the present invention.
[0051] See Figure 1 As shown in the figure, this embodiment provides an information security storage method based on big data, which includes the following steps:
[0052] The data to be stored is divided into multiple segments. The size of each segment can be selected as 256 bytes or 512 bytes, etc. Segments smaller than 256 bytes or 512 bytes are padded with 0 bytes.
[0053] Multiple segments are sequentially numbered according to the order of the data information, and each segment has a unique number.
[0054] Multiple segments are encrypted separately to form multiple encrypted segments.
[0055] Multiple encrypted fragments are combined one by one with other fragments to form multiple combined fragments. The encrypted fragments have different numbers than the individual fragments. A fragment can carry one encrypted fragment, multiple encrypted fragments, or all encrypted fragments with numbers different from its own. The combination of fragments with encrypted fragments randomly selects one or more encrypted fragments with codes different from its own. There is a one-to-one or one-to-many mapping relationship between the fragment numbers and the encrypted fragment numbers. If a fragment is lost, its encrypted information can be located through the mapping relationship, and the lost fragment information can be decrypted.
[0056] Multiple combined fragments are allocated to different storage regions. These fragments are randomly distributed across each storage region. When the number of combined fragments exceeds the number of storage regions, some storage regions store multiple combined fragments; when the number of combined fragments is less than the number of storage regions, some storage regions store no combined fragments. Storage regions can be different areas within the same server or different servers.
[0057] The combined fragments are encrypted to form encrypted combined fragments.
[0058] Assign a unique identifier to the encrypted combination fragment.
[0059] Encrypted fragments with the same unique identifier are stored. By dividing data into multiple fragments, each fragment is combined with an encrypted fragment with a different number, and then stored in partitions after encryption, the resilience and recoverability of the data are improved, and the probability of data loss is reduced.
[0060] In this embodiment, symmetric or asymmetric encryption algorithms are used to encrypt multiple fragments separately. The symmetric encryption algorithm uses AES or SM4 encryption, while the asymmetric encryption algorithm uses SHA1 or SM2 encryption.
[0061] In this embodiment, either a symmetric encryption algorithm or an asymmetric encryption algorithm is used to encrypt the combined fragments. The symmetric encryption algorithm uses AES or SM4 encryption, while the asymmetric encryption algorithm uses SHA1 or SM2 encryption.
[0062] In this embodiment, the following steps are included:
[0063] Search for all encrypted combination fragments with a certain unique identifier in different storage areas.
[0064] Decrypting all found encrypted combinations in one operation yields multiple combinations. If the encryption method is symmetric, the decryption process is the same as the decryption process for the corresponding symmetric encryption method; if the encryption method is asymmetric, the decryption process is the same as the decryption process for the corresponding asymmetric encryption method.
[0065] The combined fragments are broken down into individual fragments and encrypted fragments.
[0066] Sort the segments according to their encoding.
[0067] Determine if any segments are missing after sorting.
[0068] If there are missing segments in the sorted sequence, find the location of the encrypted segment corresponding to the missing segment.
[0069] Decrypt the encrypted segment corresponding to the missing segment. If the encryption method is symmetric, the second decryption process is the same as the decryption process of the corresponding symmetric encryption method; if the encryption method is asymmetric, the second decryption process is the same as the decryption process of the corresponding asymmetric encryption method.
[0070] The encrypted fragments corresponding to the decrypted missing fragments are then inserted into the missing fragment's position. Through this process, fragments with the same unique identifier are reassembled. To improve data recoverability, multiple encrypted fragments are appended to the original fragment, provided memory allows.
[0071] See Figure 2 As shown, an information security storage system based on big data includes a data sharding module, a fragment numbering module, a primary fragment encryption module, a fragment combination module, a fragment allocation module, a secondary fragment encryption module, a flag allocation module, and a fragment storage module.
[0072] The data sharding module is used to divide the data information to be stored into multiple fragments. The size of the fragment can be selected as 256 bytes or 512 bytes, etc. Fragments that are less than 256 bytes or 512 bytes are padded with 0 bytes.
[0073] The segment numbering module is used to sequentially number multiple segments according to the order of data information, with each segment having a unique number.
[0074] The single-fragment encryption module is used to encrypt multiple fragments separately, forming multiple encrypted fragments.
[0075] The fragment combination module is used to combine multiple encrypted fragments one by one to form multiple combined fragments. The encrypted fragments have different numbers than the individual fragments. A fragment can carry one encrypted fragment, multiple encrypted fragments, or all encrypted fragments with numbers different from its own. The combination of fragments with encrypted fragments randomly selects one or more encrypted fragments with different codes. There is a one-to-one or one-to-many mapping relationship between the fragment numbers and the encrypted fragment numbers. If a fragment is lost, its encrypted information can be located through the mapping relationship, and the lost fragment information can be decrypted.
[0076] The fragment allocation module is used to distribute multiple combined fragments to different storage regions. These combined fragments are randomly allocated to each storage region. When the number of combined fragments exceeds the number of storage regions, some storage regions store multiple combined fragments; when the number of combined fragments is less than the number of storage regions, some storage regions have no combined fragments. Storage regions can be different areas within the same server or different servers.
[0077] The secondary fragment encryption module is used to encrypt combined fragments to form encrypted combined fragments.
[0078] The flag allocation module is used to assign a unique flag code to the encrypted combination fragment.
[0079] The fragment storage module is used to store encrypted combination fragments with the same unique identifier. By dividing data information into multiple fragments, each fragment is combined with an encrypted fragment with a different number, and then stored in partitions after encryption, the resistance to attacks and recoverability of data information are improved, and the probability of data loss is reduced.
[0080] In this embodiment, the primary fragment encryption module encrypts the fragment using either a symmetric or asymmetric encryption algorithm. The symmetric encryption algorithm uses AES or SM4, while the asymmetric encryption algorithm uses SHA1 or SM2.
[0081] In this embodiment, the secondary fragment encryption module uses either a symmetric encryption algorithm or an asymmetric encryption algorithm to encrypt the combined fragments. The symmetric encryption algorithm uses either AES or SM4 encryption, while the asymmetric encryption algorithm uses either SHA1 or SM2 encryption.
[0082] In this embodiment, it includes a fragment search module, a primary fragment decryption module, a fragment decomposition module, a fragment sorting module, a missing fragment judgment module, a missing fragment search module, a secondary fragment decryption module, and a missing fragment supplementation module.
[0083] The fragment search module is used to find all encrypted combination fragments with a certain unique identifier in different storage areas.
[0084] The single-fragment decryption module is used to decrypt all the encrypted combination fragments found in one go, resulting in multiple combination fragments. If the encryption method is symmetric encryption, the single decryption process is the decryption process of the corresponding symmetric encryption method. If the encryption method is asymmetric encryption, the single decryption process is the decryption process of the corresponding asymmetric encryption method.
[0085] The fragment decomposition module is used to decompose combined fragments into individual fragments and encrypted fragments.
[0086] The fragment sorting module is used to sort fragments according to their encoding.
[0087] The missing data detection module is used to determine whether there are any missing data segments after sorting.
[0088] The missing fragment search module is used to find the location of the encrypted fragment corresponding to the missing fragment when there are missing fragments in the sorted fragments.
[0089] The secondary fragment decryption module is used to decrypt the encrypted fragment corresponding to the missing fragment. If the encryption method is a symmetric encryption method, the secondary decryption process is the decryption process of the corresponding symmetric encryption method. If the encryption method is an asymmetric encryption method, the secondary decryption process is the decryption process of the corresponding asymmetric encryption method.
[0090] The missing segment completion module is used to fill in the missing segment with the corresponding encrypted segment. Through the above process, segments with the same unique identifier are reassembled. To improve the data recoverability, multiple encrypted segments are appended to the missing segment, provided memory allows.
[0091] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention, and they should all be covered within the scope of the claims and specification of the present invention.
Claims
1. A method for secure information storage based on big data, characterized in that, Includes the following steps: Divide the data that needs to be stored into multiple segments; Multiple segments are sequentially numbered according to the order of the data information, and each segment has a unique number. Encrypt multiple segments separately to form multiple encrypted segments; Multiple encrypted fragments are combined with multiple fragments one by one to form multiple combined fragments, wherein the number of the encrypted fragments is different from the number of the fragments; Assign multiple combined fragments to different storage areas; The combined fragments are encrypted to form encrypted combined fragments; Assign a unique identifier to the encrypted combination fragment; Store encrypted combination fragments that have the same unique identifier.
2. The information security storage method based on big data according to claim 1, characterized in that, Multiple fragments are encrypted separately using either a symmetric or asymmetric encryption algorithms.
3. The information security storage method based on big data according to claim 1, characterized in that, The combined fragments are encrypted using either a symmetric or asymmetric encryption algorithms.
4. The information security storage method based on big data according to claim 1, characterized in that, Includes the following steps: Search for all encrypted combination fragments with a certain unique identifier in different storage areas; Decrypt all the found encrypted combination fragments once to obtain multiple combination fragments; Decompose the combined fragment into fragments and encrypted fragments; Sort the segments according to their codes; Determine if any segments are missing after sorting; If there are missing segments in the sorted sequence, find the location of the encrypted segment corresponding to the missing segment; Decrypt the encrypted segment corresponding to the missing segment; The encrypted fragment corresponding to the decrypted missing fragment is added to the position of the missing fragment.
5. An information security storage system based on big data, characterized in that, include: The data sharding module is used to divide the data information that needs to be stored into multiple fragments; The segment numbering module is used to sequentially number multiple segments according to the order of data information, with each segment having a unique number. A single-fragment encryption module is used to encrypt multiple fragments separately, forming multiple encrypted fragments; The fragment combination module is used to combine multiple encrypted fragments with multiple fragments one by one to form multiple combined fragments, wherein the number of the encrypted fragments is different from the number of the fragments; The fragment allocation module is used to allocate multiple combined fragments to different storage areas; The secondary fragment encryption module is used to encrypt the combined fragments to form encrypted combined fragments; The flag allocation module is used to assign a unique flag code to the encrypted combined fragment; The fragment storage module is used to store encrypted combination fragments that have the same unique identifier.
6. The information security storage system based on big data according to claim 5, characterized in that, The primary segment encryption module uses either a symmetric encryption algorithm or an asymmetric encryption algorithm to encrypt the segment.
7. The information security storage system based on big data according to claim 5, characterized in that, The secondary fragment encryption module uses either a symmetric encryption algorithm or an asymmetric encryption algorithm to encrypt the combined fragments.
8. The information security storage system based on big data according to claim 5, characterized in that, include: The fragment search module is used to search for all encrypted combination fragments with a certain unique identifier in different storage areas; The single-fragment decryption module is used to decrypt all the found encrypted combination fragments in one go, resulting in multiple combination fragments; The fragment decomposition module is used to decompose combined fragments into fragments and encrypted fragments; The fragment sorting module is used to sort fragments according to their encoding. The missing data detection module is used to determine whether there are any missing data segments after sorting. The missing fragment search module is used to find the location of the encrypted fragment corresponding to the missing fragment when there are missing fragments in the sorted fragments; The secondary fragment decryption module is used to decrypt the encrypted fragments corresponding to the missing fragments; The missing fragment completion module is used to fill in the missing fragment with the encrypted fragment corresponding to the decrypted missing fragment.