Structured data compression encryption transmission method and system for hierarchical network management

Abstract

The application provides a structured data compression encryption transmission method and system for hierarchical network management, comprising: a primary node generating and issuing data according to network management requirements; the data is organized in a structured form, serialized into a string, and subjected to hierarchical splitting processing according to the level and identity of a target receiver to obtain a data packet subjected to splitting processing; the primary node performs encryption processing on the data packet subjected to splitting processing to obtain encrypted data; the primary node performs compression processing on the encrypted data to obtain encrypted and encapsulated data; and a lower-level node receives the encrypted and encapsulated data, performs decryption and decompression, and obtains an original string. The application can significantly improve data transmission efficiency, guarantee data security, and realize hierarchical permission isolation.

Description

Technical Field

[0001] This invention belongs to the field of network management, specifically relating to a method and system for structured data compression and encryption transmission for hierarchical network management. Background Technology

[0002] With the rapid development of network technology, network scale continues to expand, and network architecture becomes increasingly complex. In large-scale network scenarios, a hierarchical network management model is commonly adopted, dividing the network according to levels to form a multi-level management system of first-level nodes (headquarters or central nodes), second-level nodes (regional or branch structure nodes), and third-level nodes (end-level access nodes). This hierarchical architecture can effectively distribute management pressure and manage the end-level nodes more granularly, but it also brings about security and efficiency issues in data transmission across levels.

[0003] Patent document CN110247764A provides a system, method, and apparatus for managing network data transmission. The system includes: a Huffman compression unit for performing Huffman compression on plaintext data to be transmitted, generating Huffman-coded packets and compressed data packets after compression; a key pair unit for generating a public key for asymmetric encryption and a private key for asymmetric encryption; and a data transmission unit, including a receiving end portion and a sending end portion. The sending end portion receives the Huffman-coded packets and compressed data packets, encrypts the Huffman-coded packets using the asymmetric encryption public key, and sends the compressed data packets and the encrypted Huffman-coded packets to the receiving end portion.

[0004] There are still some issues with data in hierarchical network management scenarios.

[0005] One issue is data redundancy and transmission efficiency. In hierarchical network management, higher-level nodes need to send various management information to lower-level nodes, including task scheduling information, network planning information, and node parameter settings. This information is usually represented in JSON format, which is widely used due to its good readability and cross-platform compatibility. However, JSON format stores key-value pairs in plain text, which contains a large number of redundant characters and whitespace symbols. When the configuration data volume is large or the frequency of data transmission is high, the size of the original JSON file will significantly increase the network transmission burden, consume bandwidth resources, and reduce system response speed.

[0006] Secondly, there is the issue of data security risks. During transmission, the various data may be tampered with or forged. If the configuration data is maliciously intercepted during transmission, critical network information will be leaked. Traditional plaintext transmission methods cannot effectively prevent such risks. Therefore, it is necessary to encrypt and protect the data before transmission.

[0007] Furthermore, in a network management architecture, the scope of network information access for nodes at different levels should have clear boundaries. Level 1 nodes possess all network planning information; this isolation of permissions is a core security principle of hierarchical management. Level 3 nodes, however, should only have information about their own node. However, in some scenarios, a unified distribution method pushes all data to all nodes, requiring each node to filter it, violating the principle of least privilege and increasing the potential risk of sensitive information leakage. Summary of the Invention

[0008] To address the shortcomings of existing technologies, the purpose of this invention is to provide a structured data compression and encryption transmission method and system for hierarchical network management.

[0009] A structured data compression and encryption transmission method for hierarchical network management, provided by the present invention, includes: Step S100: The first-level node generates and distributes data according to network management requirements; the data below is organized in a structured form, serialized into a string, and the distributed data is split into layers according to the target receiving level and identity to obtain split data packets; Step S200: For the split data packets, the first-level node performs encryption processing to obtain encrypted data; Step S300: For the encrypted data, the first-level nodes perform compression processing to obtain encrypted encapsulated data; Step S400: After receiving the encrypted and encapsulated data, the lower-level node decrypts it and decompresses the stream to obtain the original string.

[0010] Preferably, step S100 includes: Step S101: The primary node obtains the distributed data containing all task information, network planning information, and network node parameter configuration information; Step S102: The primary node determines the target node range for sending data, determines the list of secondary nodes that need to receive the data, and filters out the data records belonging to the secondary node to form a data packet specifically for that secondary node. Step S103: For the third-level nodes under the second-level nodes, the first-level nodes further filter out the data records that belong to the third-level nodes from the second-level nodes, encapsulate them in the data packets of the second-level nodes and transmit them together, and the second-level nodes distribute them to the third-level nodes after receiving them.

[0011] Preferably, step S200 includes: Step S201: The first-level node obtains the RSA public key corresponding to the target receiver node; Step S202: The first-level node directly calls the RSA encryption function to encrypt all data using the target node's public key, generating a ciphertext byte array; Step S203: Base64 encode the encrypted byte array, convert it into a text format that can be securely embedded in a JSON string, and encapsulate it into a JSON object for transmission.

[0012] Preferably, step S300 includes: Step S301: Convert the JSON string into a byte array using UTF-8 character encoding; Step S302: Create a GZIPOutputStream compressed output stream instance and associate it with the target byte array output stream; Step S303: Write the JSON byte array into GZIPOutputStream, where the compressor compresses and encodes the data, effectively eliminating redundant information in the JSON format; Step S304: Obtain the compressed byte array, store the compressed byte array as a .json.gz format file, and proceed to the next processing step.

[0013] Preferably, step S400 includes: Step S401: Identify the compression algorithm identifier, create a GZIPInputStream decompression stream, obtain and decompress the compressed data, and obtain the original JSON string; Step S402: Obtain the encrypted data field, perform Base64 decoding, and obtain the ciphertext byte array; Step S403: Decrypt the ciphertext using the stored RSA private key to obtain the compressed plaintext data byte array; Step S404: Parse the JSON string into a data object and perform subsequent processing according to business logic.

[0014] According to the present invention, a hierarchical network management system includes: a first-level node, a second-level node, and a third-level node; wherein, the second-level node is a subordinate node of the first-level node, and the third-level node is a subordinate node of the second-level node; First-level nodes generate and distribute data according to network management requirements; the data below is organized in a structured form, serialized into strings, and then split into hierarchical data packets according to the target receiving level and identity. For the data packets that have been split, the first-level node encrypts them to obtain encrypted data. For encrypted data, the first-level nodes perform compression processing to obtain encrypted encapsulated data; After receiving the encrypted and encapsulated data, the lower-level node decrypts it and decompresses the stream to obtain the original string.

[0015] Preferably, the primary node obtains the distributed data containing all task information, network planning information, and network node parameter configuration information; The primary node determines the target node range for sending data, determines the list of secondary nodes that need to receive the data, and filters out the data records belonging to the secondary node to form a data packet specifically for that secondary node. For the third-level nodes under the second-level nodes, the first-level nodes further filter out the data records that are specific to the third-level nodes from the second-level nodes, encapsulate them in the data packets of the second-level nodes and transmit them together, and then the second-level nodes distribute them to the third-level nodes after receiving them.

[0016] Preferably, the primary node obtains the RSA public key corresponding to the target receiver node; The first-level node directly calls the RSA encryption function, uses the target node's public key to encrypt all data, and generates a ciphertext byte array; The encrypted byte array is Base64 encoded, converted into a text format that can be securely embedded in a JSON string, and then encapsulated into a JSON object for transmission.

[0017] Preferably, the first-level node converts the JSON string into a byte array using UTF-8 character encoding; Create a GZIPOutputStream instance for compressed output and associate it with the target byte array output stream; Write the JSON byte array into GZIPOutputStream, and the compressor will compress and encode the data, effectively eliminating redundant information in the JSON format; Obtain the compressed byte array and store it as a .json.gz file.

[0018] Preferably, the lower-level node identifies the compression algorithm identifier, creates a GZIPInputStream decompression stream, obtains and decompresses the compressed data, and obtains the original JSON string; Obtain the encrypted data field, perform Base64 decoding, and obtain the ciphertext byte array; The ciphertext is decrypted using the stored RSA private key to obtain the compressed plaintext data byte array; The JSON string is parsed into a data object, and then further processed according to the business logic.

[0019] Compared with the prior art, the present invention has the following beneficial effects: 1. Significantly improves data transmission efficiency. By introducing GZIP compression technology, JSON structured data is compressed into .json.gz format before transmission. This fully utilizes the redundancy of repeated keys and similar structures in JSON data, significantly reducing network bandwidth consumption and transmission latency. The efficiency improvement brought by compression is particularly pronounced when inter-node link bandwidth is limited, effectively ensuring the timely issuance of network management commands and improving system response speed.

[0020] 2) Ensuring Data Security. The compressed file content is encrypted using the RSA asymmetric encryption algorithm to ensure data security during cross-level transmission. Each receiving node possesses an independent public-private key pair; the private key is stored locally on the node, ensuring that even if the transmission channel is intercepted, attackers cannot decrypt and obtain the plaintext content. The receiver decrypts using the private key, achieving end-to-end security protection.

[0021] 3) Implement hierarchical access control. Before data is distributed, it is split into hierarchical data packets. First-level nodes filter and form dedicated data packets for each node based on the target node's hierarchy and access permissions. Second-level nodes only receive information from themselves and their subordinate third-level nodes, and third-level nodes only receive information from themselves. This design achieves access control isolation at the data source, avoiding the risk of lower-level nodes accessing data beyond their permissions. It achieves hierarchical data isolation and minimizes exposure, complying with the principle of least privilege for data access control. Attached Figure Description

[0022] Other features, objects, and advantages of the present invention will become more apparent from the following detailed description of non-limiting embodiments with reference to the accompanying drawings: Figure 1 This is a schematic diagram of a structured data compression and encryption transmission method for hierarchical network management. Figure 2 A flowchart for data generation and splitting processing; Figure 3 Here is a flowchart of the RSA encryption process; Figure 4 This is a flowchart of the compression process; Figure 5 Flowchart for decompressing and decrypting received data. Detailed Implementation

[0023] The present invention will now be described in detail with reference to specific embodiments. These embodiments will help those skilled in the art to further understand the present invention, but do not limit the invention in any way. It should be noted that those skilled in the art can make several changes and improvements without departing from the concept of the present invention. These all fall within the protection scope of the present invention.

[0024] See Figure 1 This invention proposes a structured data compression and encryption transmission method for hierarchical network management, applicable to a hierarchical network management system comprising primary, secondary, and tertiary nodes. The method includes: Step S100: The primary node generates data to be distributed, including task information, network planning information, and network node parameter configuration information, based on network management requirements. The data is organized in a structured format, serialized into a string using JSON format, and then split into hierarchical data packets according to the target's receiving level and identity.

[0025] Step S200: For the split data packets, the first-level node uses the RSA algorithm to encrypt them, resulting in encrypted data; There are two main methods when using the RSA algorithm for encryption: One approach is to directly call the RSA encryption function to encrypt all data using the public key, generating a ciphertext byte array.

[0026] Second, a block encryption strategy is adopted, which divides the compressed data into multiple data blocks of a fixed size, encrypts each data block separately using RSA, and concatenates the ciphertext of each block in sequence. At the same time, metadata, including the number of blocks and the length of each block, is appended to the ciphertext header to facilitate correct reassembly by the receiver.

[0027] Step S300: For the encrypted data, the first-level node uses the GZIP compression algorithm to compress the data to obtain encrypted encapsulated data; To achieve efficient compression, a processing pipeline can be constructed using the Java I / O stream wrapper pattern. Compression is implemented by using a ByteArrayOutputStream as the target container and wrapping it with a GZIPOutputStream. After compression, the finish() and close() methods are called to correctly write the data to the end of the GZIP file.

[0028] When the JSON file is large, loading all the data at once will consume too much memory. In this case, a pipelined streaming compression approach can be used, where the JSON is fed into the compressor in segments as a stream. The compressor then writes the compressed data into the target file block by block, thereby reducing memory usage and ensuring system stability.

[0029] Step S400: After receiving the encrypted and encapsulated data, the lower-level node decrypts it using the RSA algorithm and decompresses the stream using GZIP to obtain the original JSON string.

[0030] There are two main methods for decompression: one is to directly decompress all data, which can quickly retrieve all data when the data volume is small. The other is to use streaming decompression, where the receiver can use a streaming decompression library to receive and parse the JSON stream simultaneously, thus avoiding excessive memory usage.

[0031] The present invention will now be described in more detail with reference to preferred embodiments.

[0032] The data splitting process in step S100 specifically includes: Step S101: The first-level node obtains all task information, network planning information, and network node parameter configuration information.

[0033] Step S102: The primary node determines the target node range for the data transmission, determines the list of secondary nodes that need to receive the data, and filters out the data records belonging to the secondary node to form a data transmission packet specific to the secondary node.

[0034] Step S103: For the third-level nodes under the second-level nodes, the first-level nodes further filter out the data records that belong to the third-level nodes from the second-level nodes, encapsulate them in the data packets of the second-level nodes and transmit them together, and the second-level nodes distribute them to the third-level nodes after receiving them.

[0035] Specifically, after step S100, step S200 uses the RSA encryption algorithm for encryption, which includes: Step S201: The first-level node obtains the RSA public key corresponding to the target receiver node.

[0036] Step S202: The first-level node directly calls the RSA encryption function to encrypt all data using the target node's public key, generating a ciphertext byte array.

[0037] Step S203: Base64 encode the encrypted byte array, convert it into a text format that can be securely embedded in a JSON string, and encapsulate it into a JSON object for transmission.

[0038] Specifically, after step S200, step S300 uses the GZIP compression algorithm for compression processing, which includes: Step S301: Convert the JSON string into a byte array using UTF-8 character encoding.

[0039] Step S302: Create a GZIPOutputStream compressed output stream instance and associate it with the target byte array output stream. Step S303: Write the JSON byte array into GZIPOutputStream, where the compressor compresses and encodes the data, effectively eliminating redundant information such as repeated key names and structure symbols in the JSON format. Step S304: Obtain the compressed byte array, store the compressed byte array as a .json.gz format file, and proceed to the next processing step.

[0040] Specifically, after step S300, step S400, which involves decrypting and decompressing the data, includes: Step S401: Identify the compression algorithm identifier, create a GZIPInputStream decompression stream, obtain the compressed data and decompress it, and obtain the original JSON string.

[0041] Step S402: Obtain the encrypted data field, perform Base64 decoding, and obtain the ciphertext byte array.

[0042] Step S403: Decrypt the ciphertext using the stored RSA private key to obtain the compressed plaintext data byte array.

[0043] Step S404: Parse the JSON string into a data object, and perform subsequent processing such as configuration loading and task execution according to business logic.

[0044] The present invention also provides a hierarchical network management system, which can be implemented by executing the process steps of the structured data compression and encryption transmission method for hierarchical network management. That is, those skilled in the art can understand the structured data compression and encryption transmission method for hierarchical network management as a preferred embodiment of the hierarchical network management system.

[0045] According to the present invention, a hierarchical network management system includes: a first-level node, a second-level node, and a third-level node; wherein, the second-level node is a subordinate node of the first-level node, and the third-level node is a subordinate node of the second-level node; First-level nodes generate and distribute data according to network management requirements; the data below is organized in a structured form, serialized into strings, and then split into hierarchical data packets according to the target receiving level and identity. For the data packets that have been split, the first-level node encrypts them to obtain encrypted data. For encrypted data, the first-level nodes perform compression processing to obtain encrypted encapsulated data; After receiving the encrypted and encapsulated data, the lower-level node decrypts it and decompresses the stream to obtain the original string.

[0046] Those skilled in the art will understand that, besides implementing the system and its various devices, modules, and units provided by this invention in the form of purely computer-readable program code, the same functions can be achieved entirely through logical programming of the method steps, making the system and its various devices, modules, and units of this invention function in the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers, and embedded microcontrollers. Therefore, the system and its various devices, modules, and units provided by this invention can be considered as a hardware component, and the devices, modules, and units included therein for implementing various functions can also be considered as structures within the hardware component; alternatively, the devices, modules, and units for implementing various functions can be considered as both software modules implementing the method and structures within the hardware component.

[0047] Specific embodiments of the present invention have been described above. It should be understood that the present invention is not limited to the specific embodiments described above, and those skilled in the art can make various changes or modifications within the scope of the claims, which do not affect the essence of the present invention. Unless otherwise specified, the embodiments and features described in this application can be arbitrarily combined with each other.

Claims

1. A method for structured data compression and encrypted transmission for hierarchical network management, characterized in that, include: Step S100: The primary node generates and distributes data according to network management requirements; The data below is organized in a structured form, serialized into a string, and then split into hierarchical data packets according to the target's receiving level and identity. Step S200: For the split data packets, the first-level node performs encryption processing to obtain encrypted data; Step S300: For the encrypted data, the first-level nodes perform compression processing to obtain encrypted encapsulated data; Step S400: After receiving the encrypted and encapsulated data, the lower-level node decrypts it and decompresses the stream to obtain the original string.

2. The structured data compression and encryption transmission method for hierarchical network management according to claim 1, characterized in that, Step S100 includes: Step S101: The primary node obtains the distributed data containing all task information, network planning information, and network node parameter configuration information; Step S102: The primary node determines the target node range for sending data, determines the list of secondary nodes that need to receive the data, and filters out the data records belonging to the secondary node to form a data packet specifically for that secondary node. Step S103: For the third-level nodes under the second-level nodes, the first-level nodes further filter out the data records that belong to the third-level nodes from the second-level nodes, encapsulate them in the data packets of the second-level nodes and transmit them together, and the second-level nodes distribute them to the third-level nodes after receiving them.

3. The structured data compression and encryption transmission method for hierarchical network management according to claim 1, characterized in that, Step S200 includes: Step S201: The first-level node obtains the RSA public key corresponding to the target receiver node; Step S202: The first-level node directly calls the RSA encryption function to encrypt all data using the target node's public key, generating a ciphertext byte array; Step S203: Base64 encode the encrypted byte array, convert it into a text format that can be securely embedded in a JSON string, and encapsulate it into a JSON object for transmission.

4. The structured data compression and encryption transmission method for hierarchical network management according to claim 3, characterized in that, Step S300 includes: Step S301: Convert the JSON string into a byte array using UTF-8 character encoding; Step S302: Create a GZIPOutputStream compressed output stream instance and associate it with the target byte array output stream; Step S303: Write the JSON byte array into GZIPOutputStream, where the compressor compresses and encodes the data, effectively eliminating redundant information in the JSON format; Step S304: Obtain the compressed byte array, store the compressed byte array as a .json.gz format file, and proceed to the next processing step.

5. The structured data compression and encryption transmission method for hierarchical network management according to claim 4, characterized in that, Step S400 includes: Step S401: Identify the compression algorithm identifier, create a GZIPInputStream decompression stream, obtain and decompress the compressed data, and obtain the original JSON string; Step S402: Obtain the encrypted data field, perform Base64 decoding, and obtain the ciphertext byte array; Step S403: Decrypt the ciphertext using the stored RSA private key to obtain the compressed plaintext data byte array; Step S404: Parse the JSON string into a data object and perform subsequent processing according to business logic.

6. A hierarchical network management system, characterized in that, include: There are first-level nodes, second-level nodes, and third-level nodes; where second-level nodes are subordinate nodes of first-level nodes, and third-level nodes are subordinate nodes of second-level nodes. First-level nodes generate and distribute data according to network management requirements; the data below is organized in a structured form, serialized into strings, and then split into hierarchical data packets according to the target receiving level and identity. For the data packets that have been split, the first-level node encrypts them to obtain encrypted data. For encrypted data, the first-level nodes perform compression processing to obtain encrypted encapsulated data; After receiving the encrypted and encapsulated data, the lower-level node decrypts it and decompresses the stream to obtain the original string.

7. The hierarchical network management system according to claim 6, characterized in that, The primary node obtains the distributed data containing full task information, network planning information, and network node parameter configuration information; The primary node determines the target node range for sending data, determines the list of secondary nodes that need to receive the data, and filters out the data records belonging to the secondary node to form a data packet specifically for that secondary node. For the third-level nodes under the second-level nodes, the first-level nodes further filter out the data records that are specific to the third-level nodes from the second-level nodes, encapsulate them in the data packets of the second-level nodes and transmit them together, and then the second-level nodes distribute them to the third-level nodes after receiving them.

8. The hierarchical network management system according to claim 6, characterized in that, The first-level node obtains the RSA public key corresponding to the target receiver node; The first-level node directly calls the RSA encryption function, uses the target node's public key to encrypt all data, and generates a ciphertext byte array; The encrypted byte array is Base64 encoded, converted into a text format that can be securely embedded in a JSON string, and then encapsulated into a JSON object for transmission.

9. The hierarchical network management system according to claim 8, characterized in that, The first-level node converts the JSON string into a byte array, using UTF-8 character encoding; Create a GZIPOutputStream instance for compressed output and associate it with the target byte array output stream; Write the JSON byte array into GZIPOutputStream, and the compressor will compress and encode the data, effectively eliminating redundant information in the JSON format; Obtain the compressed byte array and store it as a .json.gz file.

10. The hierarchical network management system according to claim 9, characterized in that, The lower-level node identifies the compression algorithm identifier, creates a GZIPInputStream decompression stream, obtains and decompresses the compressed data, and obtains the original JSON string; Obtain the encrypted data field, perform Base64 decoding, and obtain the ciphertext byte array; The ciphertext is decrypted using the stored RSA private key to obtain the compressed plaintext data byte array; The JSON string is parsed into a data object, and then further processed according to the business logic.

Images