Processing method based on Internet communication transmission

Abstract

The present invention discloses a processing method based on Internet communication transmission, including: obtaining data to be transmitted and preprocessing it to generate a data packet; performing data encryption processing on the data packet to obtain an encrypted data packet; performing Reed-Solomon encoding on the encrypted data packet, adding redundant check information, and generating a coded data packet; calculating the optimal number of threads N according to real-time network delay and bandwidth, and opening N threads, and using the transmission control protocol to send the coded data packets respectively; the receiving end receives the coded data packet and performs Reed-Solomon decoding on it, and then reorganizes and verifies the integrity of the decrypted data packet: if the match is successful, the data transmission is successful, and the process ends; if the match fails, the data is tampered with or the transmission is wrong, triggering a retransmission mechanism for retransmission, and issuing an alarm. The problem of low data security, low transmission efficiency and poor stability in the existing Internet communication transmission technology is solved.

Description

Technical Field

[0001] The present invention relates to the technical field of communication signal processing, and in particular to a processing method based on Internet communication transmission. Background Art

[0002] With the rapid development of the Internet, Internet-based communication transmission technology has become the core means of information exchange and data sharing. In all walks of life, the demand for large-scale and efficient data transmission is growing, such as in the application fields of cloud computing, big data analysis, the Internet of Things and online multimedia. In order to meet these needs, we continue to explore advanced transmission protocols, encryption algorithms and data processing methods to improve the efficiency, security and reliability of data transmission.

[0003] The traditional Transmission Control Protocol (TCP) and User Datagram Protocol (UDP) have met basic communication needs to a certain extent, but their performance and functions have become insufficient in the face of complex and changing network environments and growing amounts of data. For this reason, various improved protocols and technologies, such as the Quick Transport Protocol (QUIC), Multipath TCP (MPTCP), efficient encryption algorithms and error correction coding technologies have emerged one after another, injecting new vitality into the development of Internet communication transmission.

[0004] However, with the increasing complexity of the network environment and security threats, existing communication transmission technologies still face many challenges. First, in terms of data security, traditional encryption methods may not be able to resist high-level network attacks, and data may still be intercepted or tampered with during transmission; second, in terms of transmission efficiency, the fixed data packet size and single-threaded transmission mode cannot adapt to the real-time changing network bandwidth and delay, resulting in low transmission efficiency; in addition, network instability, such as packet loss, delay and jitter, seriously affects the reliability of data transmission, and existing error control mechanisms (such as simple retransmission strategies) cannot effectively solve these problems.

[0005] Therefore, there is an urgent need for a communication transmission processing method that can comprehensively improve data security, transmission efficiency and stability to meet the needs of current and future Internet applications. Summary of the invention

[0006] The purpose of this section is to summarize some aspects of the embodiments of the present invention and briefly introduce some preferred embodiments. Some simplifications or omissions may be made in this section and the abstract of the specification and the title of the invention of this application to avoid blurring the purpose of this section, the abstract of the specification and the title of the invention, and such simplifications or omissions cannot be used to limit the scope of the present invention.

[0007] In view of the above existing problems, the present invention is proposed.

[0008] Therefore, the technical problem solved by the present invention is that the existing Internet communication transmission technology has the problems of low data security, low transmission efficiency and poor stability.

[0009] In order to solve the above technical problems, the present invention provides the following technical solutions: obtaining data to be transmitted and preprocessing the data to generate a data packet;

[0010] Performing data encryption processing on the data packet to obtain an encrypted data packet;

[0011] Performing Reed-Solomon encoding on the encrypted data packet, adding redundant check information, and generating an encoded data packet;

[0012] Calculate the optimal number of threads N according to the real-time network delay and bandwidth, start the N threads, and use the transmission control protocol to send the encoded data packets respectively;

[0013] The receiving end receives the encoded data packet and performs Reed-Solomon decoding on it, and then reassembles and performs integrity check on the decrypted data packet:

[0014] If the match is successful, the data transmission is successful and the process ends;

[0015] If the match fails, the data is tampered with or transmitted incorrectly, the retransmission mechanism is triggered to retransmit and an alarm is issued.

[0016] As a preferred solution of the processing method based on Internet communication transmission described in the present invention, the preprocessing includes:

[0017] Obtain the data to be transmitted and divide it into initial data blocks;

[0018] Calculating the data entropy H of each of the initial data blocks;

[0019] Calculate the adaptive data packet size S according to the data entropy H and the real-time network bandwidth B;

[0020] According to the adaptive data packet size S, the initial data block is divided into data packets, and a sequence number is added to each data packet.

[0021] As a preferred solution of the processing method based on Internet communication transmission described in the present invention, the mathematical calculation formula of the data entropy H is:

[0022]

[0023] Where n is the number of symbols in the data, p i is the probability of the i-th symbol appearing.

[0024] As a preferred solution of the processing method based on Internet communication transmission described in the present invention, the mathematical expression formula of the adaptive data packet size S is as follows:

[0025]

[0026] Among them, H is data entropy, B is real-time network bandwidth, and K is adjustment coefficient, ranging from 0 <K≤1。

[0027] As a preferred solution of the processing method based on Internet communication transmission described in the present invention, the data encryption processing includes:

[0028] Generate a symmetric key K of 256 bits in length s , encrypting the data packet using an advanced encryption standard to obtain an encrypted data packet;

[0029] Using the public key K of the receiver pub , using the RSA algorithm to generate the symmetric key K s Encrypt and get the encryption key K enc ;

[0030] The encryption key K enc Attached to the header of the encrypted data packet.

[0031] As a preferred solution of the processing method based on Internet communication transmission described in the present invention, Reed-Solomon encoding is performed on the encrypted data packet to add redundant check information, including:

[0032] Assume the number of original symbols k, the number of check symbols t, and the total number of symbols n = k + t.

[0033] As a preferred solution of the processing method based on Internet communication transmission described in the present invention, the optimal number of threads N is calculated according to the real-time network delay L and the real-time network bandwidth B. The mathematical expression formula is as follows:

[0034]

[0035] in, It represents rounding up, S is the adaptive data packet size, L is the real-time network delay, and B is the real-time network bandwidth.

[0036] As a preferred solution of the processing method based on Internet communication transmission described in the present invention, the receiving end receives the encoded data packet, performs Reed-Solomon decoding, corrects transmission errors, and obtains an encrypted data packet;

[0037] Extract the encryption key K enc , using the private key K of the receiving end priv Perform RSA decryption to obtain the symmetric key Ks ;

[0038] Through the symmetric key K s Perform AES decryption on the encrypted data packet to restore the original data packet.

[0039] As a preferred solution of the processing method based on Internet communication transmission described in the present invention, the decrypted data packet is reassembled and integrity checked, including:

[0040] Reorganize the data packets according to the sequence numbers of the data packets to restore the initial data blocks;

[0041] Perform integrity check on the reorganized data block by using the SHA-256 hash algorithm to calculate the hash value Hash recv and the hash value Hash provided by the sender send Compare and judge Hash recv Is it equal to Hash? send ;

[0042] If Hash recv =Hash send , the match is successful;

[0043] If Hash recv ≠Hash send , the match fails.

[0044] Beneficial effects of the present invention:

[0045] 1. By preprocessing the data to be transmitted and generating data packets, large-scale data can be split into several small controllable units, which is convenient for subsequent encryption, encoding and transmission processing, reduces the amount of data transmitted in a single time, reduces network load, improves the flexibility and efficiency of data transmission, and achieves the beneficial effects of optimizing data structure and improving transmission efficiency;

[0046] 2. Through data encryption processing, the confidentiality and integrity of the transmitted data are protected, preventing the data from being illegally intercepted, tampered with or stolen during transmission, ensuring that only the authorized recipient can decrypt and read the data, achieving the beneficial effect of enhancing data security and protecting sensitive information;

[0047] 3. By generating coded data packets, the detection and correction of errors in the data transmission process are realized, the anti-interference ability of data in unstable network environment is improved, and data errors caused by channel noise or interference are reduced, achieving the beneficial effect of improving data transmission reliability and reducing the number of data retransmissions;

[0048] 4. By real-time monitoring of network conditions, reasonable allocation of the number of threads, full use of network bandwidth, avoiding network congestion or waste of resources, improving the parallelism and throughput of data transmission, and reducing transmission delay, the beneficial effects of improving data transmission efficiency and optimizing network performance are achieved;

[0049] 5. Through error correction decoding, erroneous data in transmission can be repaired, and through integrity verification, it can be ensured that the data has not been tampered with, and the received data is consistent with the sent data, ensuring the integrity and accuracy of the data, achieving the beneficial effect of ensuring data transmission reliability and improving data accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor. Among them:

[0051] Figure 1 It is a flowchart of a processing method based on Internet communication transmission shown in the present invention;

[0052] Figure 2 A schematic diagram showing a comparison of data integrity under different network packet loss rates shown in the present invention;

[0053] Figure 3 It is a schematic diagram of comparing transmission time under different data sizes shown in the present invention. DETAILED DESCRIPTION

[0054] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are described in detail below in conjunction with the drawings. It is obvious that the described embodiments are only part of the embodiments of the present invention, but not all of the embodiments.

[0055] Based on the embodiments of the present invention, all other embodiments obtained by ordinary persons in the art without making any creative work should fall within the scope of protection of the present invention.

[0056] In the following description, many specific details are set forth to facilitate a full understanding of the present invention, but the present invention may also be implemented in other ways different from those described herein, and those skilled in the art may make similar generalizations without violating the connotation of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.

[0057] According to an embodiment of the present invention, Figure 1 The flowchart shown is a processing method based on Internet communication transmission, which specifically includes the following steps:

[0058] S1, obtain the data to be transmitted and pre-process it to generate a data packet;

[0059] S2, encrypting the data packet to obtain an encrypted data packet;

[0060] S3, performing Reed-Solomon encoding on the encrypted data packet, adding redundant check information, and generating an encoded data packet;

[0061] S4. Calculate the optimal number of threads N according to the real-time network delay and bandwidth, start N threads, and use the transmission control protocol to send encoded data packets respectively;

[0062] S5. The receiving end receives the encoded data packet and performs Reed-Solomon decoding on it, and then reassembles and performs integrity check on the decrypted data packet:

[0063] If the match is successful, the data transmission is successful and the process ends;

[0064] If the match fails, the data is tampered with or transmitted incorrectly, the retransmission mechanism is triggered to retransmit and an alarm is issued.

[0065] In order to better illustrate a processing method based on Internet communication transmission provided by an embodiment of the present invention, the deficiencies in the prior art are solved by means of data preprocessing, hybrid encryption, forward error correction coding and multi-threaded transmission, and the security, efficiency and stability of data transmission are improved. This embodiment is applied to the scenario of "a medical institution needs to transmit the patient's medical imaging data (such as MRI scans, with a size of about 500MB) to another cooperative hospital, and requires ensuring the security, integrity and transmission efficiency of the data", and the specific process of implementing the method of the present invention is illustrated; specifically, the following steps are included:

[0066]

Data preprocessing

[0067] (1) Obtain and initially divide data

[0068] Obtaining data: The medical institution extracts 500MB of MRI image data to be transmitted from the database;

[0069] Initial data block division: 500MB of data is divided into 5 initial data blocks, each of which is 100MB in size;

[0070] (2) Calculate data entropy H

[0071] Purpose: To evaluate the complexity of data and guide the subsequent data packet size adjustment;

[0072] Calculation method:

[0073]

[0074] Where n is the number of different symbols in the data. The MRI image data is in bytes, n = 256, p i is the probability of the occurrence of the ith symbol, obtained by counting the byte distribution in the statistical block;

[0075] Calculation process: For each data block, count the number of times each byte appears and calculate p i , then calculate H, such as H = 7.8;

[0076] (3) Calculate the adaptive data packet size S

[0077] Known parameters: real-time network bandwidth B = 80MB / s, adjustment coefficient K = 0.9;

[0078] Calculate S:

[0079]

[0080] Based on data entropy and bandwidth, the packet size is determined to be approximately 9.23MB;

[0081] (4) Divide the data packets and add sequence numbers

[0082] Divide data packets: Divide each 100MB data block into 11 data packets, for a total of 55 data packets;

[0083] Add sequence number: add a unique sequence number to each data packet to facilitate subsequent reassembly;

[0084]

Data encryption

[0085] (1) Generate a symmetric key and encrypt the data packet

[0086] Generate symmetric key K s : Generate a 256-bit key using a secure random number generator;

[0087] AES encryption: For each data packet, use K s Perform AES-256 encryption to obtain an encrypted data packet;

[0088] (2) Encrypted symmetric key

[0089] Get the receiving end's public key K pub : Obtain the RSA public key from the cooperating hospital;

[0090] RSA Encryption:

[0091]

[0092] The symmetric key K is encrypted using the public key of the receiving end. s , get Kenc ;

[0093] (3) Attach the encryption key to the packet header

[0094] 1. Data packet structure table

[0095] Packet header Packet Contents <![CDATA[K enc +Serial Number]]> Encrypted data packet content

[0096]

Forward Error Correction Coding Processing

[0097] Reed-Solomon coding

[0098] Selection parameters: original symbol number k = 1024;

[0099] The number of check symbols t=32;

[0100] Total number of symbols n = k + t = 1056;

[0101] Encoding process: Reed-Solomon encoding is performed on each encrypted data packet to generate an encoded data packet containing redundant checksum information;

[0102]

Multi-threaded transmission

[0103] (1) Calculate the optimal number of threads N

[0104] Known parameters: real-time network bandwidth B = 80MB / s;

[0105] Network delay L = 0.05s;

[0106] Data packet size S = 9.23MB;

[0107] Calculate N:

[0108]

[0109] Among them, the optimal number of threads is 1;

[0110] (2) Start the thread to transmit data

[0111] Establish a TCP connection: open a thread and establish a TCP connection;

[0112] Send data packets: send coded data packets in sequence;

[0113]

Data reception and decryption

[0114] (1) Receive and decode data packets

[0115] Receiving data packets: The receiving end receives data packets through a TCP connection;

[0116] FEC decoding: Perform Reed-Solomon decoding on the received coded data packets, correct errors, and recover the encrypted data packets;

[0117] (2) Extract and decrypt the symmetric key

[0118] Extract K enc : Extract the encrypted symmetric key from the packet header;

[0119] RSA decryption:

[0120]

[0121] Among them, K priv is the private key of the receiving end;

[0122] Decrypt K using the receiver's private key enc , get the symmetric key K s ;

[0123] (3) Decrypting data packets

[0124] AES decryption: Using K s Perform AES-256 decryption on the encrypted data packet to obtain the original data packet;

[0125]

Data Reorganization and Verification

[0126] (1) Data Reorganization

[0127] Reassembly by sequence number: According to the sequence number of the data packet, from 1 to 55, the data packets are spliced ​​in order to restore the original data;

[0128] (2) Integrity Check

[0129] The sender calculates the hash value:

[0130] Hash send =SHA-256(original data)

[0131] The receiving end calculates the hash value:

[0132] Hash recv =SHA-256(receive data)

[0133] Compare hash values: If Hash send =Hash recv , the data is complete and correct.

[0134] It should be noted that the embodiment of the present invention combines AES symmetric encryption and RSA asymmetric encryption to ensure the security of data and keys, uses the SHA-256 hash algorithm to ensure that the data has not been tampered with, and can dynamically adjust the data packet size according to data entropy and network bandwidth to optimize transmission efficiency. By calculating the optimal number of threads, network resources are fully utilized, and Reed-Solomon coding is used to reduce retransmissions caused by network errors and improve transmission stability.

[0135] Through the above embodiments, the processing method based on Internet communication transmission provided by the present invention successfully realizes the safe, efficient and stable transmission of large-scale medical imaging data, and meets the high requirements of medical institutions for data transmission.

[0136] Furthermore, in order to verify the superiority of the method of the present invention in terms of data transmission integrity and transmission efficiency, this embodiment is compared with the traditional method through simulation, and the results are as follows: Figure 2 , Figure 3 shown.

[0137] Simulation comparison conditions:

[0138] Network environment settings:

[0139] Network bandwidth: 80MB / s (megabytes per second);

[0140] Network delay: 0.05s (seconds);

[0141] Network packet loss rate range: 0% to 50%, in steps of 5%;

[0142] Data size range: 100MB to 1000MB, in 100MB increments;

[0143] The difference between the traditional method and the method of the present invention

[0144] Traditional methods

[0145] Data preprocessing: fixed data packet size (e.g. 1MB), not adjusted based on data entropy and network conditions;

[0146] Encryption method: only symmetric encryption (such as AES) is used, lacking hybrid encryption mechanism;

[0147] Error control: Forward error correction coding (FEC) is not used, and the retransmission mechanism is relied on, which increases the transmission time;

[0148] Transmission mode: Single-thread transmission, which cannot fully utilize the network bandwidth;

[0149] Method of the present invention

[0150] Data preprocessing: dynamically adjust the data packet size according to data entropy and real-time network conditions to improve transmission efficiency;

[0151] Encryption method: A hybrid encryption mechanism is used, combining symmetric encryption and asymmetric encryption to ensure data security and encryption efficiency;

[0152] Error control: Forward error correction coding (FEC) is introduced to correct errors within a certain range without the need for retransmission, thus improving data integrity;

[0153] Transmission mode: multi-threaded transmission, fully utilizing network bandwidth and reducing transmission time;

[0154] Simulation parameter setting

[0155] Bandwidth Utilization:

[0156] Traditional method: 80%

[0157] The method of the present invention: 95%;

[0158] Data integrity model

[0159] Traditional method: Data integrity decreases exponentially as the packet loss rate increases. The model is:

[0160] Data Integrity 传统 =e -k·P ×100%

[0161] Where k = 0.1, P is the packet loss rate (0 to 1);

[0162] The method of the present invention: Due to the use of FEC, the sensitivity of data integrity to packet loss rate is reduced, and the model is:

[0163] Data Integrity 本发明 =(1-P 2 )×100%

[0164] Transmission time calculation:

[0165] Transmission time = data size ÷ (network bandwidth × bandwidth utilization)

[0166] Comparison with traditional methods

[0167] Reference Figure 2 , showing the data integrity comparison between the traditional method and the method of the present invention under different network packet loss rates, where:

[0168] Traditional method: As the network packet loss rate increases, data integrity decreases rapidly. When the packet loss rate reaches 30%, the data integrity is less than 5%, which cannot meet the requirements of medical image transmission.

[0169] The method of the present invention: Due to the use of forward error correction coding (FEC), even when the packet loss rate is as high as 50%, the data integrity can still be maintained above 75%;

[0170] Based on the above, it can be intuitively seen that the traditional method does not adopt an error correction mechanism and is very sensitive to packet loss rate, which causes data to be easily damaged and requires frequent retransmission. The FEC used in the method of the present invention can correct errors within a certain range without retransmission, significantly improving data integrity.

[0171] Preferably, in the case of poor network conditions, the method of the present invention can ensure the complete transmission of medical imaging data, thereby avoiding diagnostic errors caused by data corruption.

[0172] Reference Figure 3 , shows the transmission time comparison between the traditional method and the method of the present invention under different data sizes, where:

[0173] Traditional method: Due to low bandwidth utilization, the transmission time is long. For example, transferring 500MB of data requires:

[0174]

[0175] The method of the present invention: by optimizing bandwidth utilization, the transmission time is reduced. For example, the transmission of 500MB of data requires:

[0176]

[0177] Based on the above, it can be intuitively seen that the traditional method cannot fully utilize the network bandwidth, resulting in low transmission efficiency, while the method of the present invention improves bandwidth utilization and reduces transmission time through adaptive data packet size and multi-threaded transmission.

[0178] Preferably, in scenarios where large amounts of medical data need to be frequently transmitted, the method of the present invention can save a lot of time and improve work efficiency.

[0179] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

Claims

1. A processing method based on Internet communication transmission, characterized in that: include: Obtain the data to be transmitted and pre-process it to generate data packets; Performing data encryption processing on the data packet to obtain an encrypted data packet; Performing Reed-Solomon encoding on the encrypted data packet, adding redundant check information, and generating an encoded data packet; Calculate the optimal number of threads N according to the real-time network delay and bandwidth, start the N threads, and use the transmission control protocol to send the encoded data packets respectively; The receiving end receives the encoded data packet and performs Reed-Solomon decoding on it, and then reassembles and performs integrity check on the decrypted data packet: If the match is successful, the data transmission is successful and the process ends; If the match fails, the data is tampered with or transmitted incorrectly, the retransmission mechanism is triggered to retransmit and an alarm is issued.

2. The processing method based on Internet communication transmission according to claim 1, characterized in that: The preprocessing comprises: Obtain the data to be transmitted and divide it into initial data blocks; Calculating the data entropy H of each of the initial data blocks; Calculate the adaptive data packet size S according to the data entropy H and the real-time network bandwidth B; According to the adaptive data packet size S, the initial data block is divided into data packets, and a sequence number is added to each data packet.

3. The processing method based on Internet communication transmission according to claim 2 is characterized in that: The mathematical calculation formula of the data entropy H is: Where n is the number of symbols in the data, p i is the probability of the i-th symbol appearing.

4. The processing method based on Internet communication transmission according to claim 2 is characterized in that: The mathematical expression formula of the adaptive data packet size S is as follows: Among them, H is data entropy, B is real-time network bandwidth, and K is adjustment coefficient, ranging from 0 <K≤1。 5. The processing method based on Internet communication transmission according to claim 1, characterized in that: The data encryption process includes: Generate a symmetric key K of 256 bits in length s , encrypting the data packet using an advanced encryption standard to obtain an encrypted data packet; Using the public key K of the receiver pub , using the RSA algorithm to generate the symmetric key K s Encrypt and get the encryption key K enc ; The encryption key K enc Attached to the header of the encrypted data packet.

6. The processing method based on Internet communication transmission according to claim 1, characterized in that: Performing Reed-Solomon encoding on the encrypted data packet and adding redundant check information includes: Assume the number of original symbols k, the number of check symbols t, and the total number of symbols n = k + t.

7. The processing method based on Internet communication transmission according to claim 1, characterized in that: According to the real-time network delay L and the real-time network bandwidth B, the optimal number of threads N is calculated. The mathematical expression formula is as follows: in, It represents rounding up, S is the adaptive data packet size, L is the real-time network delay, and B is the real-time network bandwidth.

8. The processing method based on Internet communication transmission according to claim 1, characterized in that: The receiving end receives the encoded data packet, performs Reed-Solomon decoding, corrects transmission errors, and obtains an encrypted data packet; Extract the encryption key K enc , using the private key K of the receiving end priv Perform RSA decryption to obtain the symmetric key K s ; Through the symmetric key K s Perform AES decryption on the encrypted data packet to restore the original data packet.

9. The processing method based on Internet communication transmission according to claim 1, characterized in that: Reassemble and verify the integrity of the decrypted data packets, including: Reorganize the data packets according to the sequence numbers of the data packets to restore the initial data blocks; Perform integrity check on the reorganized data block by using the SHA-256 hash algorithm to calculate the hash value Hash recv and the hash value Hash provided by the sender send Compare and judge Hash recv Is it equal to Hash? send ; If Hash recv =Hash send , the match is successful; If Hash recv ≠Hash send , the match fails.

Images