A method and apparatus for multimodal process data transmission

Abstract

This invention belongs to the field of data transmission technology. It discloses a method and apparatus for multimodal process data transmission, comprising: acquiring a multimodal dataset, sorting it according to preset rules and generating modal sequence codes; generating encryption features based on the modality and transmission time; generating an initial transmission key, and combining it with the modal sequence codes to generate a first key to encrypt first modal data; for subsequent modal data, using the encryption features and key evolution of the previous modality to generate the current key and encrypting it; encapsulating and sending the encrypted data; and receiving the transmission packet and decrypting each modal data sequentially in a chain-like order. This method establishes data correlation verification through intermodal chain-like key evolution, preventing data replacement and order tampering; it incorporates context information to achieve dynamic key evolution, avoiding the single point of failure risk of fixed keys, while simplifying key management and improving the security of multimodal data transmission.

Description

Technical Field

[0001] This invention relates to the field of data transmission technology, and more specifically, to a multimodal process data transmission method and apparatus. Background Technology

[0002] With the rapid development of medical informatics and intelligent medical technologies, medical data is exhibiting multimodal characteristics. Modern medical diagnosis and treatment often require the comprehensive use of various types of medical data, including medical imaging data, physiological signal data, laboratory test data, electronic medical record text data, and audio-visual data. These different modalities of medical data need to be frequently transmitted and shared between medical institutions and between medical institutions and patients to support applications such as remote diagnosis, multidisciplinary consultations, and medical data archiving.

[0003] Traditional data transmission methods in existing technologies typically employ a fixed encryption key to uniformly encrypt all modal data, or generate a random key independently for each modal data. The former carries the risk of a single point of failure; once the key is cracked, all modal data is at risk of being leaked. While the latter improves security, it significantly increases key management complexity and lacks correlation verification between modal data, making it vulnerable to data substitution attacks. Furthermore, existing technologies lack security mechanisms to protect the transmission order of multimodal data. Attackers can disrupt the integrity of data transmission by rearranging data order or inserting forged data, and the receiver may find it difficult to detect such attacks. During multimodal data transmission, if the order of data packets is maliciously altered or forged data packets are inserted, the receiver may receive an incorrect dataset, affecting the reliability of data transmission. Summary of the Invention

[0004] To overcome the aforementioned problems in the prior art, this invention proposes a multimodal process data transmission method and apparatus to solve the above-mentioned problems.

[0005] This invention provides the following technical solution:

[0006] A multimodal process data transmission method, comprising:

[0007] Obtain the multimodal dataset to be transmitted, sort the modal data in the multimodal dataset according to the preset sorting rules, and generate modal sequence codes based on the sorted multimodal dataset;

[0008] For each modal data, a corresponding encryption feature is generated based on the transmission time;

[0009] Generate an initial transmission key, use the initial transmission key and the modal sequence code to generate a first key, and use the first key to encrypt the first modal data;

[0010] For each modal data except the first modal data: using the encryption features and encryption key of the previous modal, generate the encryption key for the current modal data through key evolution; encrypt the current modal data using the current encryption key;

[0011] The encrypted data is encapsulated into a transmission packet and sent to the recipient, who then receives and decrypts the packet.

[0012] Preferably, generating modal sequence codes based on the sorted multimodal dataset includes:

[0013] Obtain the unique type code corresponding to each modality type, where the unique type code is a positive integer;

[0014] Based on the sorting results of the multimodal dataset, the unique type codes of each modality are sequentially concatenated to form a modality sequence code.

[0015] Preferably, generating the corresponding encryption feature based on the transmission time includes:

[0016] Obtain the data transmission timestamp, convert the timestamp into a percentage value using a preset time mapping algorithm, multiply the percentage value by the total data length, and calculate the starting position of feature extraction.

[0017] The corresponding feature data extraction length is obtained from the preset modality feature length mapping table based on the modality type identifier;

[0018] Using the calculated starting position as the center, extract half the feature data length forward and backward, and combine them to form a complete feature data segment;

[0019] An encrypted feature is obtained by performing a one-way hash function on the feature data fragment.

[0020] Preferably, generating the initial transmission key includes: obtaining a random byte sequence of a specified length through a hardware random number generator, and standardizing the random byte sequence to obtain the initial transmission key;

[0021] The process of generating the first key using the initial transmission key and the modal sequence code includes:

[0022] The initial transmission key is divided into key blocks according to the length of the modal sequence code;

[0023] For each key block, convert it into multiple values. Perform mathematical operations on each converted value with its corresponding unique type code to generate a result value.

[0024] The results of dividing all the keys into blocks are combined sequentially to form an intermediate result;

[0025] A one-way hash function is applied to the intermediate result to generate the first key.

[0026] Preferably, generating the encryption key for the current mode through the key evolution method includes:

[0027] Obtain the encryption key and encryption signature of the previous mode;

[0028] The first half of the encryption key is combined with the second half of the encryption feature to form the first combined value;

[0029] The second part of the encryption key is combined with the first part of the encryption feature to form a second combined value;

[0030] Calculate the difference between the unique type code of the current mode and the unique type code of the previous mode, and use it as the evolution factor;

[0031] Perform a circular shift operation on the first combination value using an evolution factor. The number of shifts is equal to the absolute value of the evolution factor. Shift right when the evolution factor is positive and shift left when it is negative.

[0032] The first combined value after shifting is combined with the second combined value to obtain the intermediate value of evolution;

[0033] Apply a one-way hash function to the intermediate value of the evolution to generate the encryption key for the current mode.

[0034] Preferably, the step of encapsulating the encrypted data into a transmission packet includes:

[0035] Create a transport packet header, which includes a sender identifier, a receiver identifier, transmission time information, and the number of modes;

[0036] Create a modal index area to record the position offset, length, modal type identifier, and modal sequence number of each modal data in the transmission packet;

[0037] Create a data area and store the encrypted data and corresponding integrity verification values ​​of each modality in the order of modality.

[0038] Create a key area and encrypt the initial transmission key and modal sequence code using the recipient's public key;

[0039] Calculate a digital signature for the packet header, modal index area, and data area using the sender's private key;

[0040] The header, modal index area, data area, key area, and digital signature of the transmission packet are combined to form a complete transmission packet.

[0041] Preferably, the receiving party receiving and decrypting the transmission packet includes:

[0042] Extract the key area from the transmitted packet, decrypt it using the receiver's private key, and obtain the initial transmission key and modal sequence code;

[0043] Obtain the location information and modal order of each modality from the modal index area;

[0044] Based on the initial transmission key and modal sequence code, reconstruct the first key, and use the first key to decrypt the first modal data;

[0045] Generate corresponding encryption features based on the decrypted first modal data and transmission time;

[0046] For each subsequent modal data: following the modal order, using the encryption features and encryption key of the previous modality, generate the encryption key for the current modality through a key evolution method; use the generated encryption key to decrypt the current modal data.

[0047] The present invention also provides a multimodal process data transmission device for implementing a multimodal process data transmission method, comprising:

[0048] The data preparation module is used to acquire the multimodal dataset to be transmitted, sort the modal data in the multimodal dataset according to the preset sorting rules, and generate modal sequence codes based on the sorted multimodal dataset.

[0049] The encryption feature generation module is used to generate corresponding encryption features for each modal data based on the transmission time;

[0050] The initial encryption module is used to generate an initial transmission key, generate a first key using the initial transmission key and the modal sequence code, and encrypt the first modal data using the first key;

[0051] The evolutionary encryption module is used for each modal data except the first modal data: using the encryption features and encryption key of the previous modality, it generates the encryption key for the current modality through a key evolution method; and encrypts the current modal data using the current encryption key.

[0052] The transmission and decryption module is used to encapsulate encrypted data into transmission packets and send them to the receiver, who then receives and decrypts the transmission packets.

[0053] This invention provides a multimodal process data transmission method and apparatus, which have the following beneficial effects:

[0054] By incorporating contextual information such as modality type and transmission time into the encryption feature generation process and employing a dynamic key evolution mechanism, each modal data possesses a unique and interconnected encryption key. This method avoids the single point of failure risk associated with using fixed keys and solves the complexities of managing independent random keys. Furthermore, the dynamic evolution of the keys ensures that even during long-term transmission, attackers cannot break the encryption system through pattern analysis, significantly improving the security of multimodal medical data transmission.

[0055] By generating modal sequence codes and integrating them into the key generation process, combined with a key evolution mechanism based on the encryption features of the previous modality, a chain-like association relationship is established between modal data. This design ensures that the decryption of each modality depends on the correct decryption of the preceding modality. If an attacker attempts to rearrange the data order or insert forged data, all subsequent modal data will fail to be decrypted correctly, thus effectively preventing data substitution attacks and order tampering attacks, and ensuring the integrity and reliability of multimodal data transmission. Attached Figure Description

[0056] Figure 1 This is a flowchart illustrating a multimodal process data transmission method according to the present invention.

[0057] Figure 2 This is a schematic diagram of a multimodal process data transmission device according to the present invention. Detailed Implementation

[0058] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0059] Example 1

[0060] Please see Figure 1 In this embodiment, a multimodal process data transmission method includes:

[0061] S1. Obtain the multimodal dataset to be transmitted, sort the modal data in the multimodal dataset according to the preset sorting rules, and generate modal sequence codes based on the sorted multimodal dataset.

[0062] The process of generating modal sequence codes based on the sorted multimodal dataset includes:

[0063] Obtain the unique type code corresponding to each modality type, where the unique type code is a positive integer;

[0064] Based on the sorting results of the multimodal dataset, the unique type codes of each modality are sequentially concatenated to form a modality sequence code.

[0065] In this embodiment, it should be noted that the multimodal dataset is determined by the sender based on specific business requirements or the receiver's request, specifying the modal types to be transmitted, and then extracting data of these specific modalities from the corresponding database. Common modalities in medical systems include image data, physiological signal data, text data, and laboratory test data. Acquiring a multimodal dataset refers to extracting these different modalities of data from the data source system and organizing them into a single dataset.

[0066] It should be noted that the preset sorting rule refers to the predefined rules for sorting different modal data according to the application scenario requirements. The sorting rule can be based on various factors, such as sorting by data volume, sorting by data acquisition time, or sorting by modal type in a fixed order. Different sorting rules will affect the subsequently generated modal sequence codes, and thus affect the entire encryption chain.

[0067] It should be noted that the unique type code is a positive integer identifier pre-assigned to each modality type. For example, type code 1 can be assigned to image data, type code 2 to physiological signal data, and type code 3 to text data, etc. This type code can be stored in the system configuration to ensure consistency throughout the data transmission system.

[0068] S2. For each modal data, generate the corresponding encryption feature based on the transmission time;

[0069] The step of generating the corresponding encryption feature based on the transmission time includes:

[0070] Obtain the data transmission timestamp, convert the timestamp into a percentage value using a preset time mapping algorithm, multiply the percentage value by the total data length, and calculate the starting position of feature extraction.

[0071] The corresponding feature data extraction length is obtained from the preset modality feature length mapping table based on the modality type identifier;

[0072] Using the calculated starting position as the center, extract half the feature data length forward and backward, and combine them to form a complete feature data segment;

[0073] An encrypted feature is obtained by performing a one-way hash function on the feature data fragment.

[0074] In this embodiment, it should be noted that the data transmission timestamp can typically be the time when the data was acquired, usually accurate to the millisecond level. By incorporating the time factor into the encryption feature generation process, it can be ensured that even the same modal data will generate different encryption features when transmitted at different times, increasing the time-varying and unpredictable nature of the encryption system.

[0075] It should be noted that the preset time mapping algorithm is an algorithm that converts timestamps into percentage values ​​between 0 and 1, and can be implemented in various ways. For example, a percentage can be obtained by dividing a combination of certain digits of the timestamp by a fixed value, or the difference between the timestamp and a certain reference time point can be mapped to a preset range. The main purpose of this algorithm is to transform the time factor into a standardized value that can be used for subsequent calculations.

[0076] It should be noted that the modality feature length mapping table is a pre-configured lookup table used to define the feature extraction length for different modalities of data. The feature data segment is a data segment extracted forward and backward by half the feature data extraction length, centered on the calculated starting position. This ensures that data segments can be extracted while avoiding the security risks associated with always extracting data from a fixed position. Performing a one-way hash function on the feature data segment generates a hash value with high unpredictability and irreversibility, enhancing the security of subsequent key evolution processes. The one-way hash function can use mature hash functions such as SHA-256 or MD5.

[0077] S3. Generate an initial transmission key, use the initial transmission key and the modal sequence code to generate a first key, and use the first key to encrypt the first modal data;

[0078] The generation of the initial transmission key includes: obtaining a random byte sequence of a specified length through a hardware random number generator, and standardizing the random byte sequence to obtain the initial transmission key;

[0079] The process of generating the first key using the initial transmission key and the modal sequence code includes:

[0080] The initial transmission key is divided into key blocks according to the length of the modal sequence code;

[0081] For each key block, convert it into multiple values. Perform mathematical operations on each converted value with its corresponding unique type code to generate a result value.

[0082] The results of dividing all the keys into blocks are combined sequentially to form an intermediate result;

[0083] A one-way hash function is applied to the intermediate result to generate the first key.

[0084] In this embodiment, it should be noted that standardization processing refers to normalizing the random byte sequence, such as adjusting its length and format conversion, to make it conform to the input requirements of the cryptographic system. The generation process of the first key first divides the initial transmission key into multiple key blocks according to the length of the modal sequence code. For example, if the modal sequence code contains 3 elements, the initial transmission key will be divided into 3 blocks. Then, for each key block, it is converted into multiple values ​​and mathematical operations are performed with the unique type code at the corresponding position. These mathematical operations can be simple bitwise operations or preset mathematical functions, the purpose of which is to incorporate modal type information into the key generation process. Next, all the results of the operations are combined sequentially to form an intermediate result. Finally, a one-way hash function is performed on this intermediate result to generate the first key. Encrypting the first modal data using the first key can employ a standard symmetric encryption algorithm such as AES, and a suitable encryption mode such as ECB, CBC, or CTR can be selected.

[0085] S4. For each modal data except the first modal data: using the encryption features and encryption key of the previous modal, generate the encryption key for the current modal data through key evolution; encrypt the current modal data using the current encryption key;

[0086] The generation of the encryption key for the current mode through the key evolution method includes:

[0087] Obtain the encryption key and encryption signature of the previous mode;

[0088] The first half of the encryption key is combined with the second half of the encryption feature to form the first combined value;

[0089] The second part of the encryption key is combined with the first part of the encryption feature to form a second combined value;

[0090] Calculate the difference between the unique type code of the current mode and the unique type code of the previous mode, and use it as the evolution factor;

[0091] Perform a circular shift operation on the first combination value using an evolution factor. The number of shifts is equal to the absolute value of the evolution factor. Shift right when the evolution factor is positive and shift left when it is negative.

[0092] The first combined value after shifting is combined with the second combined value to obtain the intermediate value of evolution;

[0093] Apply a one-way hash function to the intermediate value of the evolution to generate the encryption key for the current mode.

[0094] In this embodiment, it should be noted that the purpose of cross-combination is to merge two data blocks into a new data block. Specifically, it can be done by combining the first half of the encryption key with the second half of the encryption feature in a byte-alternating or concatenated manner to form a first combined value; similarly, the second half of the encryption key with the first half of the encryption feature is combined according to the same rules to form a second combined value.

[0095] It should be noted that the evolution factor is obtained by calculating the difference between the unique type code of the current modality and the unique type code of the previous modality. Then, this evolution factor is used to perform a cyclic shift operation on the first combination value. The number of shifts is equal to the absolute value of the evolution factor. When the evolution factor is positive, a right shift is performed, and when it is negative, a left shift is performed.

[0096] It should be noted that combining the shifted first and second combined values ​​can be achieved using a simple concatenation operation to obtain an intermediate evolutionary value. Finally, a one-way hash function is applied to this intermediate value to generate the encryption key for the current modality. This process ensures that the encryption key for each modality depends on the encryption information of the previous modality, thus establishing a chain-like dependency. Through this key evolution mechanism, even if an attacker obtains the key for one modality, they cannot directly deduce the keys for other modalities, because the generation of each key depends on the encryption features of the previous modality, and these features can only be obtained by correctly decrypting the data of the previous modality and knowing the encryption feature generation mechanism. This design provides a robust order protection and integrity verification mechanism for multimodal data transmission.

[0097] S5. Encapsulate the encrypted data into a transmission packet and send it to the receiver. The receiver receives the transmission packet and decrypts it.

[0098] The step of encapsulating the encrypted data into a transmission packet includes:

[0099] Create a transport packet header, which includes a sender identifier, a receiver identifier, transmission time information, and the number of modes;

[0100] Create a modal index area to record the position offset, length, modal type identifier, and modal sequence number of each modal data in the transmission packet;

[0101] Create a data area and store the encrypted data and corresponding integrity verification values ​​of each modality in the order of modality.

[0102] Create a key area and encrypt the initial transmission key and modal sequence code using the recipient's public key;

[0103] Calculate a digital signature for the packet header, modal index area, and data area using the sender's private key;

[0104] The header, modal index area, data area, key area, and digital signature of the transmission packet are combined to form a complete transmission packet.

[0105] The receiving party receiving and decrypting the transmission packet includes:

[0106] Extract the key area from the transmitted packet, decrypt it using the receiver's private key, and obtain the initial transmission key and modal sequence code;

[0107] Obtain the location information and modal order of each modality from the modal index area;

[0108] Based on the initial transmission key and modal sequence code, reconstruct the first key, and use the first key to decrypt the first modal data;

[0109] Generate corresponding encryption features based on the decrypted first modal data and transmission time;

[0110] For each subsequent modal data: following the modal order, using the encryption features and encryption key of the previous modality, generate the encryption key for the current modality through a key evolution method; use the generated encryption key to decrypt the current modal data.

[0111] In this embodiment, it should be noted that the encapsulation of the transmission packet involves organizing the encrypted multimodal data into a structured data packet. The key area uses the receiver's public key to encrypt the initial transmission key and modal sequence code, employing asymmetric encryption to ensure that only the receiver holding the corresponding private key can decrypt and obtain this critical information. Using the sender's private key to calculate digital signatures for the transmission packet header, modal index area, and data area verifies the authenticity and integrity of the data source, preventing data tampering and forgery during transmission.

[0112] It should be noted that the receiver's decryption process begins with using its own private key to decrypt the key area, obtaining the initial transmission key and modal sequence code. These two elements are the starting point of the decryption chain and are indispensable. Then, based on the information in the modal index area, the receiver can determine the position and order of each modal data, reconstruct the first key using the same algorithm, and use it to decrypt the first modal data. Based on the decrypted first modal data and transmission time information, the receiver can generate the same encryption signature as the sender.

[0113] It's important to note that for the decryption of each subsequent modal data, the receiver needs to follow the modal order, using the encryption features and key of the previous modality, and generating the encryption key for the current modality using the same key evolution method as the sender. Then, this key is used to decrypt the current modal data. This chained decryption mechanism ensures that modal data must be decrypted sequentially in the correct order. Any missing or incorrectly decrypted modal data will prevent subsequent modal data from being decrypted correctly, thus effectively preventing data tampering and reordering attacks.

[0114] Example 2

[0115] Please see Figure 2 This invention provides a multimodal process data transmission device for implementing a multimodal process data transmission method, comprising:

[0116] The data preparation module is used to acquire the multimodal dataset to be transmitted, sort the modal data in the multimodal dataset according to the preset sorting rules, and generate modal sequence codes based on the sorted multimodal dataset.

[0117] The encryption feature generation module is used to generate corresponding encryption features for each modal data based on the transmission time;

[0118] The initial encryption module is used to generate an initial transmission key, generate a first key using the initial transmission key and the modal sequence code, and encrypt the first modal data using the first key;

[0119] The evolutionary encryption module is used for each modal data except the first modal data: using the encryption features and encryption key of the previous modality, it generates the encryption key for the current modality through a key evolution method; and encrypts the current modal data using the current encryption key.

[0120] The transmission and decryption module is used to encapsulate encrypted data into transmission packets and send them to the receiver, who then receives and decrypts the transmission packets.

[0121] In the several embodiments provided by this invention, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only one method, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0122] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any changes or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in the present invention should be included within the scope of protection of the present invention.

[0123] In conclusion, the above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A multimodal process data transmission method, characterized in that: include: Obtain the multimodal dataset to be transmitted, sort the modal data in the multimodal dataset according to the preset sorting rules, and generate modal sequence codes based on the sorted multimodal dataset; For each modal data, a corresponding encryption feature is generated based on the transmission time; The step of generating the corresponding encryption feature based on the transmission time includes: Obtain the data transmission timestamp, convert the timestamp into a percentage value using a preset time mapping algorithm, multiply the percentage value by the total data length, and calculate the starting position of feature extraction. The corresponding feature data extraction length is obtained from the preset modality feature length mapping table based on the modality type identifier; Using the calculated starting position as the center, extract half the feature data length forward and backward, and combine them to form a complete feature data segment; An encrypted feature is obtained by performing a one-way hash function on the feature data fragment; Generate an initial transmission key, use the initial transmission key and the modal sequence code to generate a first key, and use the first key to encrypt the first modal data; For each modal data except the first modal data: using the encryption features and encryption key of the previous modal, generate the encryption key for the current modal data through key evolution; encrypt the current modal data using the current encryption key; encapsulate the encrypted data into a transmission packet and send it to the receiver, which receives the transmission packet and decrypts it; The generation of the encryption key for the current mode through the key evolution method includes: Obtain the encryption key and encryption signature of the previous mode; The first half of the encryption key is combined with the second half of the encryption feature to form the first combined value; The second part of the encryption key is combined with the first part of the encryption feature to form a second combined value; Calculate the difference between the unique type code of the current mode and the unique type code of the previous mode, and use it as the evolution factor; Perform a circular shift operation on the first combination value using an evolution factor. The number of shifts is equal to the absolute value of the evolution factor. Shift right when the evolution factor is positive and shift left when it is negative. The first combined value after shifting is combined with the second combined value to obtain the intermediate value of evolution; Apply a one-way hash function to the intermediate value of the evolution to generate the encryption key for the current mode.

2. The multimodal process data transmission method according to claim 1, characterized in that, The process of generating modal sequence codes based on the sorted multimodal dataset includes: Obtain the unique type code corresponding to each modality type, where the unique type code is a positive integer; Based on the sorting results of the multimodal dataset, the unique type codes of each modality are sequentially concatenated to form a modality sequence code.

3. The multimodal process data transmission method according to claim 1, characterized in that, The generation of the initial transmission key includes: obtaining a random byte sequence of a specified length through a hardware random number generator, and standardizing the random byte sequence to obtain the initial transmission key; The process of generating the first key using the initial transmission key and the modal sequence code includes: The initial transmission key is divided into key blocks according to the length of the modal sequence code; For each key block, convert it into multiple values. Perform mathematical operations on each converted value with its corresponding unique type code to generate a result value. The results of dividing all the keys into blocks are combined sequentially to form an intermediate result; A one-way hash function is applied to the intermediate result to generate the first key.

4. The multimodal process data transmission method according to claim 1, characterized in that, The step of encapsulating the encrypted data into a transmission packet includes: Create a transport packet header, which includes a sender identifier, a receiver identifier, transmission time information, and the number of modes; Create a modal index area to record the position offset, length, modal type identifier, and modal sequence number of each modal data in the transmission packet; Create a data area and store the encrypted data and corresponding integrity verification values ​​of each modality in the order of modality. Create a key area and encrypt the initial transmission key and modal sequence code using the recipient's public key; Calculate a digital signature for the packet header, modal index area, and data area using the sender's private key; The header, modal index area, data area, key area, and digital signature of the transmission packet are combined to form a complete transmission packet.

5. A multimodal process data transmission method according to claim 4, characterized in that, The receiving party receiving and decrypting the transmission packet includes: Extract the key area from the transmitted packet, decrypt it using the receiver's private key, and obtain the initial transmission key and modal sequence code; Obtain the location information and modal order of each modality from the modal index area; Based on the initial transmission key and modal sequence code, reconstruct the first key, and use the first key to decrypt the first modal data; Generate corresponding encryption features based on the decrypted first modal data and transmission time; For each subsequent modal data: following the modal order, using the encryption features and encryption key of the previous modality, generate the encryption key for the current modality through a key evolution method; use the generated encryption key to decrypt the current modal data.

6. A multimodal process data transmission device, used to implement the multimodal process data transmission method as described in any one of claims 1-5, characterized in that, include: The data preparation module is used to acquire the multimodal dataset to be transmitted, sort the modal data in the multimodal dataset according to the preset sorting rules, and generate modal sequence codes based on the sorted multimodal dataset. The encryption feature generation module is used to generate corresponding encryption features for each modal data based on the transmission time; the initial encryption module is used to generate an initial transmission key, use the initial transmission key and the modal sequence code to generate a first key, and use the first key to encrypt the first modal data. The evolutionary encryption module is used to generate the encryption key for the current mode for each mode of data except the first mode of data, using the encryption features and encryption key of the previous mode through a key evolution method. Encrypt the current modal data using the current encryption key; The transmission and decryption module is used to encapsulate encrypted data into transmission packets and send them to the receiver, who then receives and decrypts the transmission packets.

Images