High-throughput data secure transmission method and system, electronic equipment and storage medium

Abstract

The invention provides a high-throughput data secure transmission method and system, electronic equipment and a storage medium, and belongs to the technical field of data transmission, and the method comprises the steps that a sending end GPU encrypts a data file to obtain encrypted data; the sending end CPU sends the encrypted data to a receiving end CPU; the receiving end CPU receives the encrypted data sent by the sending end CPU; and the receiving end GPU decrypts the encrypted data to obtain a data file. When data transmission is carried out between the sending end and the receiving end, data encryption and decryption are carried out through the GPU, data transmission is carried out through the CPU, and when high-throughput data is transmitted, the requirement for safe transmission of the high-throughput data can be met due to the fact that the data volume encrypted and decrypted by the GPU in unit time is higher than that of the CPU.

Description

Technical Field

[0001] The present invention relates to the field of data transmission technology, and in particular to a high-throughput data secure transmission method, system, electronic device and storage medium. Background Art

[0002] Ethernet high-throughput secure data transmission enables high-speed, high-capacity data transmission while ensuring data security in Ethernet networks. As one of the most commonly used network technologies in local area networks (LANs) and wide area networks (WANs), Ethernet is widely used in enterprises, data centers, cloud computing, and the industrial internet. The implementation of high-throughput secure transmission in Ethernet is designed to meet the demands of modern networks for high bandwidth, low latency, and high security.

[0003] Ethernet high-throughput data transmission based on national encryption algorithms requires encryption and decryption before and after data transmission. Currently, existing technologies use the CPU to encrypt and decrypt data. Encryption and decryption with national encryption algorithms consumes CPU resources and time, and the amount of data encrypted and decrypted per unit time is insufficient to meet high-throughput transmission requirements. Summary of the Invention

[0004] The present invention provides a high-throughput data security transmission method, system, electronic device and storage medium, which are used to solve the technical problem in the prior art that the amount of CPU encryption and decryption data is difficult to meet the requirements of high-throughput data security transmission.

[0005] The present invention provides a high-throughput data security transmission method, which is applied to a sending end and includes: The GPU at the sending end encrypts the data file to obtain encrypted data; The sending end CPU sends the encrypted data to the receiving end CPU.

[0006] According to a high-throughput data security transmission method provided by the present invention, the encrypted data includes multiple message ciphertexts; The sending end GPU encrypts the data file to obtain encrypted data, including: Splitting the data file into a plurality of data messages and saving the data messages to a first message queue running on the CPU of the sending end; Saving the data message in the first message queue to a second message queue running on the sending end GPU; The sending-end GPU encrypts the data message in the second message queue to obtain the message ciphertext, and saves the message ciphertext to a third message queue running on the sending-end GPU; The message ciphertext in the third message queue is saved in a fourth message queue running based on the sending end CPU.

[0007] According to a high-throughput data security transmission method provided by the present invention, splitting the data file into multiple data messages and saving them to a first message queue running on the sending end CPU includes: Using a first thread to split the data file and save the data message to the first message queue; Saving the data message in the first message queue to a second message queue running on the sending end GPU includes: Using a second thread to save the data message in the first message queue to the second message queue; The step of saving the ciphertext of the message in the third message queue to a fourth message queue running on the sending end CPU includes: A third thread is used to save the message ciphertext in the third message queue to the fourth message queue.

[0008] The present invention also provides a high-throughput data security transmission method, which is applied to a receiving end and includes: The receiving end CPU receives the encrypted data sent by the sending end CPU; The GPU at the receiving end decrypts the encrypted data to obtain a data file.

[0009] According to a high-throughput data security transmission method provided by the present invention, the encrypted data includes multiple message ciphertexts; The receiving end CPU receives the encrypted data sent by the sending end CPU, including: The received message ciphertext is saved in a fifth message queue running on the receiving end CPU.

[0010] According to a high-throughput data security transmission method provided by the present invention, the receiving-end GPU decrypts the encrypted data to obtain a data file, including: Saving the message ciphertext in the fifth message queue to a sixth message queue running based on the receiving end GPU; The receiving-end GPU decrypts the message ciphertext in the sixth message queue to obtain a message plaintext, and saves the message plaintext to a seventh message queue running on the receiving-end GPU; Saving the plain text of the message in the seventh message queue to an eighth message queue running on the receiving end CPU; The message plaintexts in the eighth message queue are synthesized into the data file.

[0011] The present invention also provides a high-throughput data security transmission system, which is applied to a sending end and includes: The GPU at the sending end is used to encrypt the data file to obtain encrypted data; The sending end CPU is used to send the encrypted data to the receiving end CPU.

[0012] The present invention also provides a high-throughput data security transmission system, which is applied to a receiving end and includes: The receiving end CPU is used to receive the encrypted data sent by the sending end CPU; The receiving end GPU is used to decrypt the encrypted data to obtain a data file.

[0013] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the high-throughput data secure transmission method as described above is implemented.

[0014] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements any of the high-throughput data secure transmission methods described above.

[0015] The present invention also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the computer program implements any of the above-mentioned high-throughput data secure transmission methods.

[0016] The high-throughput data security transmission method, system, electronic device and storage medium provided by the present invention encrypt and decrypt data through the GPU and transmit data through the CPU when data is transmitted between the sending end and the receiving end. When transmitting high-throughput data, the amount of data encrypted and decrypted per unit time by the GPU is higher than that of the CPU, which can meet the requirements of high-throughput data security transmission. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the present invention or the prior art, a brief introduction is given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0018] Figure 1 This is one of the flow charts of the high-throughput data secure transmission method provided by the present invention.

[0019] Figure 2 This is the second flow chart of the high-throughput data secure transmission method provided by the present invention.

[0020] Figure 3 It is a flow chart of step S1 provided by the present invention.

[0021] Figure 4 It is a flow chart of step S4 provided by the present invention.

[0022] Figure 5 This is one of the structural diagrams of the high-throughput data security transmission system provided by the present invention.

[0023] Figure 6 This is the second structural diagram of the high-throughput data security transmission system provided by the present invention.

[0024] Figure 7 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0025] To make the objectives, technical solutions, and advantages of the present invention more clear, the technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the embodiments described are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.

[0026] It should be noted that, in the description of the present invention, the terms "comprise," "include," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a list of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. Without further limitation, the phrase "comprises a..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising the elements. Terms such as "upper" and "lower" indicate positions or relationships based on those shown in the accompanying drawings and are intended solely to facilitate the description of the present invention and simplify the description. They are not intended to indicate or imply that the devices or elements referred to must have a specific orientation, be constructed, or operate in a specific orientation, and are therefore not to be construed as limitations on the present invention. Unless otherwise expressly specified or limited, the terms "mounted," "connected," and "connected" should be broadly construed, for example, to mean fixed, removable, or integral; mechanical or electrical; direct or indirect through an intermediary; or internal communication between two elements. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0027] The terms "first," "second," and so forth, used herein are used to distinguish similar objects, not to describe a specific order or precedence. It should be understood that such terms are interchangeable where appropriate, allowing embodiments of the present invention to be implemented in an order other than that illustrated or described herein. Furthermore, the terms "first," "second," and so forth generally distinguish objects of a single type, and do not limit the number of objects. For example, the first object may be one or more. Furthermore, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates an "or" relationship between the connected objects.

[0028] The following combination Figure 1-Figure 7 The present invention describes a high-throughput data secure transmission method, system, electronic device, and storage medium.

[0029] It should be noted that the high-throughput data security transmission system of the present invention includes a sending end and a receiving end, and both the sending end and the receiving end are equipped with a CPU and a GPU.

[0030] like Figure 1 As shown, the present invention provides a high-throughput data security transmission method applied to a sending end, comprising: In step S1, the sending end GPU encrypts the data file to obtain encrypted data.

[0031] In some implementations, data files may be encrypted using a national encryption algorithm, such as a symmetric encryption algorithm, an asymmetric encryption algorithm, a hash algorithm, a stream encryption algorithm, and the like.

[0032] In step S2, the sending end CPU sends the encrypted data to the receiving end CPU.

[0033] In some embodiments, encrypted data can be sent via Ethernet. The core features of Ethernet high-throughput data security transmission include: High throughput: supports high-speed data transmission, typically reaching bandwidths of 1Gbps, 10Gbps, 40Gbps, or even 100Gbps; Low latency: Reduces data transmission delay while ensuring security, meeting real-time requirements; High security: Encryption, authentication, integrity verification and other security mechanisms are used to prevent data leakage, tampering and forgery; Compatibility: Compatible with existing Ethernet protocols and hardware devices, easy to deploy and upgrade; Scalability: Supports large-scale network environments and can adapt to the growing amount of data and user scale.

[0034] like Figure 2 As shown, the present invention provides a high-throughput data security transmission method applied to a receiving end, comprising: Step S3: The receiving end CPU receives the encrypted data sent by the sending end CPU.

[0035] In step S4, the receiving end GPU decrypts the encrypted data to obtain a data file.

[0036] Among them, both the sending-end GPU and the receiving-end GPU can adopt mid-to-low-end GPUs, and the data volume generated by the GPU's encryption and decryption capabilities only needs to meet the data volume requirements during high-throughput data transmission.

[0037] Of course, if the data file is encrypted using the national secret algorithm, the encrypted data needs to be decrypted using the national secret algorithm.

[0038] As can be seen from the above, when the present invention transmits data between the sending end and the receiving end, data encryption and decryption are performed through the GPU and data transmission is performed through the CPU. When transmitting high-throughput data, since the amount of data encrypted and decrypted per unit time by the GPU is higher than that of the CPU, the requirements for secure transmission of high-throughput data can be met.

[0039] In some embodiments, the encrypted data of the present invention may include multiple message ciphertexts; like Figure 3 As shown, step S1 may further include: Step S11: split the data file into multiple data messages and save them to a first message queue running on the sending end CPU.

[0040] Specifically, a real-time message queue server RMQ-C1 can be deployed on the sending end. The server RMQ-C1 caches messages based on the host memory and runs based on the sending end CPU. When the server RMQ-C1 is shut down, the messages can be persisted to the disk. When it is started, the messages can be read from the disk and cached again in the host memory. One or more message queues can be created on demand in the server RMQ-C1, and the message queues can also be deleted on demand.

[0041] A real-time message queue server RMQ-G1 can be deployed on the sending end. Server RMQ-G1 caches messages based on GPU memory and runs based on the sending end GPU. Messages are lost when server RMQ-G1 is shut down. One or more message queues can be created on demand within server RMQ-G1, and message queues can also be deleted on demand. When server RMQ-G1 is started, one or more message queues are first created on demand.

[0042] In step S11 , multiple data messages may be saved in a first message queue created in the server RMQ-C1 .

[0043] Step S12: Save the data message in the first message queue to a second message queue running on the sending end GPU.

[0044] Specifically, step S12 first obtains the data message in the first message queue, and then saves the data message in the first message queue to the second message queue created in the server RMQ-G1.

[0045] In step S13, the sending-end GPU encrypts the data message in the second message queue to obtain a ciphertext message, and saves the ciphertext message to a third message queue running on the sending-end GPU.

[0046] Step S13 can save the message ciphertext to the third message queue created in the server RMQ-G1.

[0047] Step S14: Save the ciphertext of the message in the third message queue to a fourth message queue running on the sending end CPU.

[0048] Specifically, step S14 first obtains the message ciphertext in the third message queue, and then saves the message ciphertext in the third message queue to the fourth message queue created in the server RMQ-C1.

[0049] In this way, the data file can be encrypted by splitting the data file into multiple data messages and saving them to the message queue.

[0050] In some embodiments, a single thread can be used to process steps S11, S12, and S14, but a single thread will result in slow data encryption. To increase the speed of data encryption, step S11 of the present invention may include: Using a first thread to split the data file and save the data message to a first message queue; Step S12 may include: Using the second thread to save the data message in the first message queue to the second message queue; Step S14 may include: The third thread is used to save the ciphertext of the message in the third message queue to the fourth message queue.

[0051] In this way, multiple threads can be used to perform data file splitting, data message caching and message ciphertext caching in parallel, which can improve the speed of data encryption.

[0052] After the data file is split into data messages and the message ciphertexts are obtained in step S1, step S2 of the present invention may further include: obtaining the message ciphertexts in the fourth message queue and sending them to the receiving end. In this way, the encrypted data can be sent in the form of sending the message ciphertexts.

[0053] Of course, the present invention can also deploy a real-time message queue server RMQ-C2 at the receiving end. The server RMQ-C2 caches messages based on the host memory and runs based on the receiving end CPU. When the server RMQ-C2 is shut down, the messages can be persisted to the disk, and when it is started, the messages can be read from the disk and cached again in the host memory. One or more message queues can be created on demand in the server RMQ-C2, and the message queues can also be deleted on demand.

[0054] A real-time message queue server RMQ-G2 can be deployed on the receiving end. Server RMQ-G2 caches messages based on GPU memory and runs based on the receiving end GPU. Messages are lost when server RMQ-G2 is shut down. One or more message queues can be created on demand within server RMQ-G2, and message queues can also be deleted on demand. When server RMQ-G2 is started, one or more message queues are first created on demand.

[0055] After sending the ciphertext message in step S2, step S3 of the present invention may further include: saving the received ciphertext message to a fifth message queue executed by the receiving end CPU. Step S3 may save the ciphertext message to the fifth message queue created in the server RMQ-C2. In this way, encrypted data can be received by saving the ciphertext message to the message queue.

[0056] In some embodiments, as Figure 4 As shown, step S4 of the present invention may include: Step S41: Save the ciphertext of the message in the fifth message queue to the sixth message queue running based on the GPU of the receiving end.

[0057] Specifically, step S41 first obtains the message ciphertext in the fifth message queue, and then saves the message ciphertext in the fifth message queue to the sixth message queue created in the server RMQ-G2.

[0058] In step S42 , the receiving-end GPU decrypts the ciphertext message in the sixth message queue to obtain a plaintext message, and saves the plaintext message to a seventh message queue running on the receiving-end GPU.

[0059] Specifically, step S42 first obtains the message ciphertext in the sixth message queue and then decrypts it, and saves the message plaintext in the seventh message queue created in the server RMQ-G2.

[0060] Step S43: Save the plain text messages in the seventh message queue to an eighth message queue running on the receiving end CPU.

[0061] Specifically, step S43 first obtains the plain text of the message in the seventh message queue, and then saves the plain text of the message in the seventh message queue to the eighth message queue created in the server RMQ-C2.

[0062] Step S44: synthesize the plain text messages in the eighth message queue into a data file.

[0063] Specifically, step S44 first obtains the plain text messages in the eighth message queue, then synthesizes the plain text messages in the eighth message queue into a data file, and saves it to a directory configured by the receiving end.

[0064] In this way, the message ciphertext can be decrypted through the message queue, thereby realizing the decryption of the encrypted data.

[0065] In some embodiments, a single thread can be used to process steps S41, S43, and S44, but a single thread will result in a slow data decryption speed. To increase the speed of data decryption, step S41 of the present invention may include: Using the fourth thread to save the ciphertext of the message in the fifth message queue to the sixth message queue; Step S43 may include: Using the fifth thread to save the plain text of the message in the seventh message queue to the eighth message queue; Step S44 may include: The sixth thread is used to synthesize the plain text messages in the eighth message queue into a data file.

[0066] In this way, multiple threads can be used to perform message ciphertext caching, message plaintext caching and data file synthesis in parallel, which can improve the speed of data decryption.

[0067] In some embodiments, the present invention can use a single core of a GPU to encrypt and decrypt data, but a single core can process data slowly. To increase the speed of GPU encryption and decryption, both the sending and receiving GPUs of the present invention can have multiple cores. In step S2, the sending end GPU encrypts the data file, which may include: dividing the data message into a plurality of first message groups; Multiple cores of the GPU at the sending end encrypt multiple first message groups in parallel; wherein each first message group is encrypted on a different core; In step S4, the receiving end GPU decrypts the encrypted data, which may include: dividing the ciphertext message into a plurality of second message groups; The multiple cores of the GPU at the receiving end decrypt the multiple second message groups in parallel; wherein each second message group is decrypted on a different core.

[0068] This can improve the speed of data encryption and decryption by dividing the data into multiple groups and processing each group of data in parallel through a multi-core GPU.

[0069] like Figure 5 As shown, the high-throughput data security transmission system applied to the sending end provided by the present invention includes: The GPU at the sending end is used to encrypt the data file to obtain encrypted data; The sending end CPU is used to send the encrypted data to the receiving end CPU.

[0070] like Figure 6 As shown, the high-throughput data security transmission system applied to the receiving end provided by the present invention includes: The receiving end CPU is used to receive the encrypted data sent by the sending end CPU; The GPU at the receiving end is used to decrypt the encrypted data to obtain the data file.

[0071] Figure 7 Schematic diagram of the structure of the electronic device provided by the present invention, such as Figure 7 As shown, the electronic device may include: a processor, a communications interface, a memory, and a communications bus, wherein the processor, the communications interface, and the memory communicate with each other via the communications bus. The processor may call logic instructions in the memory to execute a high-throughput data security transmission method, which includes: a sending-end GPU encrypting a data file to obtain encrypted data; a sending-end CPU sending the encrypted data to a receiving-end CPU; the receiving-end CPU receiving the encrypted data sent by the sending-end CPU; and the receiving-end GPU decrypting the encrypted data to obtain a data file.

[0072] Furthermore, the logical instructions in the aforementioned memory can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the portion that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage media include various media capable of storing program code, such as USB flash drives, mobile hard drives, read-only memories (ROMs), random access memories (RAMs), magnetic disks, or optical disks.

[0073] On the other hand, the present invention also provides a computer program product, which includes a computer program stored on a non-transitory computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the computer can execute the high-throughput data security transmission method provided by the above-mentioned embodiments, the method including: the sending end GPU encrypts the data file to obtain encrypted data; the sending end CPU sends the encrypted data to the receiving end CPU; the receiving end CPU receives the encrypted data sent by the sending end CPU; the receiving end GPU decrypts the encrypted data to obtain a data file.

[0074] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, it is implemented to execute the high-throughput data security transmission method provided by the above-mentioned embodiments, the method comprising: the sending end GPU encrypts the data file to obtain encrypted data; the sending end CPU sends the encrypted data to the receiving end CPU; the receiving end CPU receives the encrypted data sent by the sending end CPU; the receiving end GPU decrypts the encrypted data to obtain a data file.

[0075] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one location or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Persons of ordinary skill in the art will be able to understand and implement the present invention without inventive effort.

[0076] Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented using software plus a necessary general-purpose hardware platform, or of course, hardware. Based on this understanding, the essence of the above technical solution, or the portion that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, or an optical disk, and includes a number of instructions for causing a computer device (such as a personal computer, server, or network device) to execute the methods described in each embodiment or certain portions of the embodiments.

[0077] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A high-throughput data security transmission method, applied to a sending end, characterized in that: include: The GPU at the sending end encrypts the data file to obtain encrypted data; The sending end CPU sends the encrypted data to the receiving end CPU.

2. The high-throughput data secure transmission method according to claim 1, characterized in that: The encrypted data includes a plurality of message ciphertexts; The sending end GPU encrypts the data file to obtain encrypted data, including: Splitting the data file into a plurality of data messages and saving the data messages to a first message queue running on the CPU of the sending end; Saving the data message in the first message queue to a second message queue running on the sending end GPU; The sending-end GPU encrypts the data message in the second message queue to obtain the message ciphertext, and saves the message ciphertext to a third message queue running on the sending-end GPU; The message ciphertext in the third message queue is saved in a fourth message queue running based on the sending end CPU.

3. The high-throughput data secure transmission method according to claim 2, characterized in that: The step of splitting the data file into a plurality of data messages and saving the data messages to a first message queue executed by the CPU of the sending end includes: Using a first thread to split the data file and save the data message to the first message queue; Saving the data message in the first message queue to a second message queue running on the sending end GPU includes: Using a second thread to save the data message in the first message queue to the second message queue; The step of saving the ciphertext of the message in the third message queue to a fourth message queue running on the sending end CPU includes: A third thread is used to save the message ciphertext in the third message queue to the fourth message queue.

4. A high-throughput data security transmission method, applied to a receiving end, characterized in that: include: The receiving end CPU receives the encrypted data sent by the sending end CPU; The GPU at the receiving end decrypts the encrypted data to obtain a data file.

5. The high-throughput data secure transmission method according to claim 4, characterized in that: The encrypted data includes a plurality of message ciphertexts; The receiving end CPU receives the encrypted data sent by the sending end CPU, including: The received message ciphertext is saved in a fifth message queue running on the receiving end CPU.

6. The high-throughput data secure transmission method according to claim 5, characterized in that: The receiving end GPU decrypts the encrypted data to obtain a data file, including: Saving the message ciphertext in the fifth message queue to a sixth message queue running based on the receiving end GPU; The receiving-end GPU decrypts the message ciphertext in the sixth message queue to obtain a message plaintext, and saves the message plaintext to a seventh message queue running on the receiving-end GPU; Saving the plain text of the message in the seventh message queue to an eighth message queue running on the receiving end CPU; The message plaintexts in the eighth message queue are synthesized into the data file.

7. A high-throughput data security transmission system, applied to the sending end, characterized in that: include: The GPU at the sending end is used to encrypt the data file to obtain encrypted data; The sending end CPU is used to send the encrypted data to the receiving end CPU.

8. A high-throughput data security transmission system, applied to a receiving end, characterized in that: include: The receiving end CPU is used to receive the encrypted data sent by the sending end CPU; The receiving end GPU is used to decrypt the encrypted data to obtain a data file.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the high-throughput data secure transmission method according to any one of claims 1 to 6 is implemented.

10. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the high-throughput data secure transmission method according to any one of claims 1 to 6 is implemented.

Images