A data encryption transmission method based on multimodality

Abstract

The present invention relates to the technical field of special multimodal data transmission in the field of cultural relics security, and specifically discloses a multimodal-based data encryption transmission method, comprising a plurality of first clients, a plurality of second clients, and a server; each of the first clients sends a multimodal-encrypted request data packet to the server, and can retrieve a multimodal-encrypted target data packet stored in the corresponding second client according to a mapping relationship stored in the server; the mapping relationship between each first client and each second client is unique, and the mapping relationships between each first client and multiple second clients are different; the present invention performs multimodal encryption on both request data and target data, thereby realizing multi-level encryption of data and effectively improving data security.

Description

Technical Field

[0001] The present invention belongs to the technical field of special multimodal data transmission in the field of cultural relics security, and specifically relates to a multimodal-based data encryption transmission method. Background Art

[0002] With the advancement of computer technology, the amount of information in various modalities on the Internet has gradually increased. Among these, information in modalities such as images, voice, and text is increasing at an extremely rapid rate. Some of this information is publicly available, while some requires confidentiality. For information that requires confidentiality, cryptography can be used to encrypt it. During the encryption process, the information to be encrypted is called plaintext, and the encrypted information is called ciphertext. The key, known only to the sender and receiver, is the key. Encryption is the process of converting plaintext into ciphertext using cryptography. However, with the current development of computer technology, techniques for decrypting keys are also developing, such as using side channels to decrypt keys, thereby decrypting ciphertext using the key information obtained. Therefore, existing encryption methods suffer from low encryption security.

[0003] In the field of cultural relics protection, the protection method of cultural relics has gradually evolved from conventional human search and protection to relying on a variety of scientific and technological means such as visual sensing technology, vibration detection technology, infrared detection technology, and ultrasonic detection technology to protect cultural relics. When relying on modern scientific and technological methods to protect cultural relics, it is necessary to transmit data in various modes, such as text, messages, pictures, audio, video and other different modes of data. Since cultural relic data is relatively important data, the data needs to be encrypted during the transmission process to improve data security.

[0004] In order to improve the security of cultural relics data, traditional encryption methods can be used to encrypt different data forms using a single encryption method, or the data encryption transmission method provided by the application publication number CN113221145A, the application publication date 2021.08.06, and the name of a data encryption method, device, electronic device and storage medium based on multimodal conversion can be used to encrypt and protect cultural relics data. This invention patent application uses a trained generative adversarial network, power consumption map, and RSA encryption algorithm to perform multimodal encryption on the encrypted data, so that the encryption effect during the modal conversion process is better, effectively improving security. However, whether it is a conventional encryption method or the aforementioned invention patent application, it is only for the secret keys of the sender and receiver. When coordinating the transmission of cultural relics data to a third-party client that has the function of transmitting cultural relics data as an intermediate, the decryption and encryption effects of the cultural relics data are not ideal. Summary of the Invention

[0005] In view of the shortcomings of the existing technology used for parallel transmission of multimodal data such as text, messages, pictures, audio, and video in the secure data transmission of cultural relics, the present invention provides a multimodal data encryption transmission method that solves the problems raised in the above background technology.

[0006] The technical solutions of the present invention are as follows:

[0007] A data encryption transmission method based on multimodality:

[0008] comprising a plurality of first clients, a plurality of second clients and a server;

[0009] Each of the first clients sends a request data packet based on multimodal encryption to the server, and can retrieve a target data packet based on multimodal encryption stored in the corresponding second client according to a mapping relationship stored in the server;

[0010] The mapping relationship between each first client and each second client is unique, and the mapping relationship between each first client and multiple second clients is different.

[0011] Furthermore, the mapping relationship is determined based on a third modal encryption operator for the third encryption determined according to the third data modality.

[0012] Furthermore, the process of data encryption transmission between the first client, the second client and the server is as follows:

[0013] Step S31: The first client generates a multimodal encryption request data packet according to the retrieved data requirement, and sends the multimodal encryption request data packet to the server;

[0014] Step S32: The server performs a primary analysis on the multimodal encryption request data packet received from the first client to match the corresponding second client, and sends the multimodal encryption request data packet to the corresponding second client;

[0015] Step S33: The second client parses the received multimodal encryption request data packet to obtain specific request information for retrieving data from the first client;

[0016] Step S34: The second client retrieves corresponding data according to the specific request information obtained in S33, then generates a multimodal encrypted target data packet based on the retrieved data, and feeds the multimodal encrypted target data packet back to the server;

[0017] Step S35: the server performs a primary analysis on the multimodal encrypted target data packet received from the second client to match the corresponding first client, and feeds back the multimodal encrypted target data packet to the corresponding first client;

[0018] Step S36: The first client receives and parses the target data packet based on multimodal encryption to obtain target data information.

[0019] Furthermore, the specific process of the first client generating a multimodal encryption request data packet according to the retrieved data requirements in step S31 is as follows:

[0020] Step S41: The first client generates request data according to the retrieved data requirements;

[0021] Step S42: The first client determines a first modal encryption operator for first encryption using the first data modality to perform primary encryption on the request data, thereby obtaining a primary encrypted request data packet.

[0022] Step S43: After completing step S42, the first client uses the second data modality to determine a second modal encryption operator for the second encryption to perform secondary encryption on the primary encryption request data packet to obtain a secondary encryption request data packet;

[0023] Step S44: After completing step S43, the first client uses the third data modality to determine the third modal encryption operator for the third encryption to perform third-level encryption on the second-level encryption request data packet to obtain a target data packet based on multimodal encryption.

[0024] Furthermore, the specific process of step S32 is as follows:

[0025] Step S51: The server parses the third modal encryption operator of the multimodal encryption request data packet received from the first client using the public key to obtain specific features of the third modal encryption operator;

[0026] Step S52: After completing step S51, the server matches the obtained specific features of the third modal encryption operator with the encryption operator features stored internally, to obtain the corresponding second client;

[0027] Step S3: After completing step S52, the server sends the multimodal encryption request data packet to the corresponding second client.

[0028] Furthermore, the specific process of step S33 is as follows:

[0029] Step S61: The second client uses the public key to perform a first-level analysis on the third modal encryption operator based on the multimodal encryption request data packet to decrypt the third modal encryption operator;

[0030] Step S62: The second client performs secondary parsing of the second modal encryption operator based on the multimodal encryption request data packet using the first private key pair to decrypt the second modal encryption operator;

[0031] Step S63: The second client performs a third-level analysis on the first modal encryption operator of the multimodal encryption request data packet after the second-level analysis using the second private key to decrypt the first modal encryption operator.

[0032] Step S64: After the decryption operations from step S6 to step S63, the second client obtains the specific request information sent by the first client.

[0033] Furthermore, the specific process of step S34 is as follows:

[0034] Step S71: The second client retrieves corresponding data according to the acquired specific request information;

[0035] Step S72: The second client uses the first data modality to determine a first modal encryption operator for the first encryption to perform primary encryption on the data to obtain a primary encrypted data packet;

[0036] Step S73: The second client determines a second modal encryption operator for second encryption using the second data modality to perform secondary encryption on the primary encrypted data packet to obtain a secondary encrypted data packet.

[0037] Step S74: The second client uses the third data modality to determine a third modal encryption operator for the third encryption to perform third-level encryption on the second-level encrypted data packet to obtain a target data packet based on multimodal encryption.

[0038] Furthermore, when the first client encrypts the request data, the first modal encryption operator and the second modal encryption operator that match the target second client are used for encryption, and the third modal encryption operator has a matching identifier corresponding to the first client and the target second client;

[0039] When the second client parses the multimodal encryption request data packet sent by the first client, it uses the public key to decrypt the third modal encryption operator, and uses the first private key and the second private key matching the first client to decrypt the second modal encryption operator and the first modal encryption operator respectively.

[0040] Furthermore, when performing step S36, the first client performs the same process of parsing the target data packet based on multimodal encryption as steps S61 to S63.

[0041] Furthermore, any first client and any second client have corresponding encryption operators and secret keys, and the encryption operators and secret keys between any first client and any second client are different.

[0042] Beneficial effects

[0043] Compared with the prior art, the multimodal data encryption transmission method provided by the present invention has the following beneficial effects:

[0044] The present invention establishes a mapping relationship between the first client and the second client, and uses the server as a verification unit of the mapping relationship to match the first client that issues a data request with the corresponding second client, thereby performing effective data transmission and retrieval. The server is responsible for coordinating the sending of request data and target data, effectively improving the data sending efficiency; and both the request data and the target data are encrypted based on multimodal encryption, thereby realizing multi-level encryption of the data and effectively improving the security of the data. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1 This is a diagram of the architecture of the present invention. DETAILED DESCRIPTION

[0046] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments.

[0047] like Figure 1 As shown, a data encryption transmission method based on multimodality:

[0048] comprising a plurality of first clients, a plurality of second clients and a server;

[0049] Each of the first clients sends a request data packet based on multimodal encryption to the server, and can retrieve a target data packet based on multimodal encryption stored in the corresponding second client according to a mapping relationship stored in the server;

[0050] The mapping relationship between each first client and each second client is unique, and the mapping relationships between each first client and multiple second clients are different; thereby achieving accurate transmission of requested data and target data according to different mapping relationships.

[0051] In the present invention, the mapping relationship is determined based on a third modal encryption operator for third encryption determined according to the third data modality; the third modal encryption operator has identifiers of the first client and the target second client, so that the corresponding first client and second client are determined based on the identifier of the third modal encryption operator, thereby accurately transmitting data;

[0052] The target second client is a client that stores data required by the first client that sends the request data packet based on multimodal encryption. The target client may be unique or may be multiple;

[0053] When the target client is unique, when the first client generates request data, the unique target second client is automatically matched, and when encrypting using the third modal encryption operator, the identifiers of the first client and the target second client are automatically matched;

[0054] When there are multiple target clients, when the first client generates request data, the first client can select a target second client, and when encrypting using the third modal encryption operator, automatically match the identifier of the first client with the selected target second client.

[0055] In the present invention, the process of data encryption transmission between the first client, the second client and the server is as follows:

[0056] Step S31: The first client generates a multimodal encryption request data packet according to the retrieved data requirement, and sends the multimodal encryption request data packet to the server;

[0057] When the first client generates a request data packet based on multimodal encryption, the request data is encrypted according to the matching of the target second client where the retrieved data is located, so as to ensure that the transmission path of the request data packet based on multimodal encryption is unique;

[0058] The data retrieved by the first client is in any one or more modes of text, message, picture, audio, and video. When generating a multimodal encryption request data packet, multimodal encryption is performed according to the different forms of the data modalities;

[0059] Step S32: The server performs a primary analysis on the multimodal encryption request data packet received from the first client to match the corresponding second client, and sends the multimodal encryption request data packet to the corresponding second client;

[0060] The server can only perform a first-level analysis on the multimodal encryption request data packet, and the purpose of the server's analysis of the multimodal encryption request data packet is to match the target second client corresponding to the multimodal encryption request data packet;

[0061] Step S33: The second client parses the received multimodal encryption request data packet to obtain specific request information for retrieving data from the first client;

[0062] The second client can only obtain the specific request information of the first client to retrieve data after decrypting and parsing the third modal encryption operator, the second modal encryption operator, and the first modal encryption operator in sequence. If the decryption and parsing of the encryption operator at any level fails, the specific request information of the first client to retrieve data will not be obtained, and the parsing failure information will be fed back to the server, which will then be fed back to the first client by the server;

[0063] Step S34: The second client retrieves corresponding data according to the specific request information obtained in S33, then generates a multimodal encrypted target data packet based on the retrieved data, and feeds the multimodal encrypted target data packet back to the server;

[0064] When the second client generates a target data packet based on multimodal encryption, the request data is encrypted according to the matching of the second client corresponding to the received request data packet based on multimodal encryption, so as to ensure that the transmission path of the target data packet based on multimodal encryption is unique;

[0065] Step S35: the server performs a primary analysis on the multimodal encrypted target data packet received from the second client to match the corresponding first client, and feeds back the multimodal encrypted target data packet to the corresponding first client;

[0066] The server can only perform a first-level analysis on the target data packet based on the multimodal encryption, and the purpose of the server's analysis on the target data packet based on the multimodal encryption is to match the target first client corresponding to the target data packet based on the multimodal encryption;

[0067] Step S36: The first client receives and parses the target data packet based on the multimodal encryption to obtain target data information;

[0068] The first client can only obtain the target data information sent by the second client after decrypting and parsing the third modal encryption operator, the second modal encryption operator, and the first modal encryption operator in sequence. If the decryption and parsing of the encryption operator at any level fails, the target data information sent by the second client will not be obtained, and the information of the parsing failure will be fed back to the server, and then fed back to the first client by the server.

[0069] In the present invention, the specific process of the first client generating a multimodal encryption request data packet according to the retrieved data requirements in step S31 is as follows:

[0070] Step S41: The first client generates request data according to the retrieved data requirements;

[0071] Step S42: The first client determines a first modal encryption operator for first encryption using the first data modality to perform primary encryption on the request data, thereby obtaining a primary encrypted request data packet.

[0072] Step S43: After completing step S42, the first client uses the second data modality to determine a second modal encryption operator for the second encryption to perform secondary encryption on the primary encryption request data packet to obtain a secondary encryption request data packet;

[0073] Step S44: After completing step S43, the first client uses the third data modality to determine a third modal encryption operator for the third encryption to perform third-level encryption on the second-level encryption request data packet to obtain a target data packet based on multimodal encryption;

[0074] In the present invention, the request data generated by the first client is encrypted through steps S42 to S44 to achieve three-level encryption, thereby effectively improving the security of the data; and according to the different modal forms of the data, the forms of the first modal encryption operator, the second modal encryption operator and the third modal encryption operator can be matched.

[0075] In the present invention, the specific process of step S32 is:

[0076] Step S51: The server parses the third modal encryption operator of the multimodal encryption request data packet received from the first client using the public key to obtain specific features of the third modal encryption operator;

[0077] Step S52: After completing step S51, the server matches the obtained specific features of the third modal encryption operator with the encryption operator features stored internally, to obtain the corresponding second client;

[0078] Step S3: After completing step S52, the server sends the multimodal encryption request data packet to the corresponding second client.

[0079] In the present invention, the specific process of step S33 is as follows:

[0080] Step S61: The second client uses the public key to perform a first-level analysis on the third modal encryption operator based on the multimodal encryption request data packet to decrypt the third modal encryption operator;

[0081] Step S62: The second client performs secondary parsing of the second modal encryption operator based on the multimodal encryption request data packet using the first private key pair to decrypt the second modal encryption operator;

[0082] Step S63: The second client performs a third-level analysis on the first modal encryption operator of the multimodal encryption request data packet after the second-level analysis using the second private key to decrypt the first modal encryption operator.

[0083] Step S64: After the decryption operations from step S6 to step S63, the second client obtains the specific request information sent by the first client.

[0084] In the present invention, the specific process of step S34 is as follows:

[0085] Step S71: The second client retrieves corresponding data according to the acquired specific request information;

[0086] Step S72: The second client uses the first data modality to determine a first modal encryption operator for the first encryption to perform primary encryption on the data to obtain a primary encrypted data packet;

[0087] Step S73: The second client determines a second modal encryption operator for second encryption using the second data modality to perform secondary encryption on the primary encrypted data packet to obtain a secondary encrypted data packet.

[0088] Step S74: The second client uses the third data modality to determine a third modal encryption operator for the third encryption to perform third-level encryption on the second-level encrypted data packet to obtain a target data packet based on multimodal encryption.

[0089] In the invention, when the first client encrypts the request data, it uses the first modal encryption operator and the second modal encryption operator that match the target second client to encrypt the data, and the third modal encryption operator has a matching identifier corresponding to the first client and the target second client;

[0090] When the second client parses the multimodal encryption request data packet sent by the first client, it decrypts the third modal encryption operator using the public key, and decrypts the second modal encryption operator and the first modal encryption operator using the first private key and the second private key that match the first client, respectively;

[0091] For the first client.

[0092] In the present invention, when performing step S36, the first client performs the same process of parsing the target data packet based on multimodal encryption as steps S61 to S63.

[0093] In the present invention, any first client and any second client have corresponding encryption operators and secret keys, and the encryption operators and secret keys between any first client and any second client are different.

[0094] The above description is only a preferred specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any technician familiar with the technical field, within the technical scope disclosed by the present invention, who makes equivalent replacements or changes based on the technical solution and inventive concept of the present invention, should be covered by the scope of protection of the present invention.

Claims

1. A multimodal data encryption transmission method, characterized by: comprising a plurality of first clients, a plurality of second clients and a server; Each of the first clients sends a request data packet based on multimodal encryption to the server, and can retrieve a target data packet based on multimodal encryption stored in the corresponding second client according to a mapping relationship stored in the server; The mapping relationship between each first client and each second client is unique, and the mapping relationships between each first client and multiple second clients are different; The process of data encryption transmission between the first client, the second client and the server is as follows: Step S31: The first client generates a multimodal encryption request data packet according to the retrieved data requirement, and sends the multimodal encryption request data packet to the server; Step S32: The server performs a primary analysis on the multimodal encryption request data packet received from the first client to match the corresponding second client, and sends the multimodal encryption request data packet to the corresponding second client; Step S33: The second client parses the received multimodal encryption request data packet to obtain specific request information for retrieving data from the first client; Step S34: The second client retrieves corresponding data according to the specific request information obtained in S33, then generates a multimodal encrypted target data packet based on the retrieved data, and feeds the multimodal encrypted target data packet back to the server; Step S35: the server performs a primary analysis on the multimodal encrypted target data packet received from the second client to match the corresponding first client, and feeds back the multimodal encrypted target data packet to the corresponding first client; Step S36: The first client receives and parses the target data packet based on multimodal encryption to obtain target data information.

2. The multimodal data encryption transmission method according to claim 1, characterized in that: The mapping relationship is determined based on a third modal encryption operator for the third encryption determined according to the third data modality.

3. The multimodal data encryption transmission method according to claim 1, characterized in that: The specific process of the first client generating a multimodal encryption request data packet according to the retrieved data requirements in step S31 is as follows: Step S41: The first client generates request data according to the retrieved data requirements; Step S42: The first client determines a first modal encryption operator for first encryption using the first data modality to perform primary encryption on the request data, thereby obtaining a primary encrypted request data packet. Step S43: After completing step S42, the first client uses the second data modality to determine a second modal encryption operator for the second encryption to perform secondary encryption on the primary encryption request data packet to obtain a secondary encryption request data packet; Step S44: After completing step S43, the first client uses the third data modality to determine the third modal encryption operator for the third encryption to perform third-level encryption on the second-level encryption request data packet to obtain a target data packet based on multimodal encryption.

4. The multimodal data encryption transmission method according to claim 3, characterized in that: The specific process of step S32 is as follows: Step S51: The server parses the third modal encryption operator of the multimodal encryption request data packet received from the first client using the public key to obtain specific features of the third modal encryption operator; Step S52: After completing step S51, the server matches the obtained specific features of the third modal encryption operator with the encryption operator features stored internally, to obtain the corresponding second client; Step S3: After completing step S52, the server sends the multimodal encryption request data packet to the corresponding second client.

5. The multimodal data encryption transmission method according to claim 4, characterized in that: The specific process of step S33 is as follows: Step S61: The second client uses the public key to perform a first-level analysis on the third modal encryption operator based on the multimodal encryption request data packet to decrypt the third modal encryption operator; Step S62: The second client performs secondary parsing of the second modal encryption operator based on the multimodal encryption request data packet using the first private key pair to decrypt the second modal encryption operator; Step S63: The second client performs a third-level analysis on the first modal encryption operator of the multimodal encryption request data packet after the second-level analysis using the second private key to decrypt the first modal encryption operator. Step S64: After the decryption operations from step S6 to step S63, the second client obtains the specific request information sent by the first client.

6. The multimodal data encryption transmission method according to claim 5, characterized in that: The specific process of step S34 is as follows: Step S71: The second client retrieves corresponding data according to the acquired specific request information; Step S72: The second client uses the first data modality to determine a first modal encryption operator for the first encryption to perform primary encryption on the data to obtain a primary encrypted data packet; Step S73: The second client determines a second modal encryption operator for second encryption using the second data modality to perform secondary encryption on the primary encrypted data packet to obtain a secondary encrypted data packet. Step S74: The second client uses the third data modality to determine a third modal encryption operator for the third encryption to perform third-level encryption on the second-level encrypted data packet to obtain a target data packet based on multimodal encryption.

7. The multimodal data encryption transmission method according to claim 6, characterized in that: When the first client encrypts the request data, the first modal encryption operator and the second modal encryption operator that match the target second client are used for encryption, and the third modal encryption operator has matching identifiers corresponding to the first client and the target second client; When the second client parses the multimodal encryption request data packet sent by the first client, it uses the public key to decrypt the third modal encryption operator, and uses the first private key and the second private key matching the first client to decrypt the second modal encryption operator and the first modal encryption operator respectively.

8. The multimodal data encryption transmission method according to claim 7, characterized in that: When performing step S36, the first client performs the same process of parsing the target data packet based on multimodal encryption as steps S61 to S63.

9. The multimodal data encryption transmission method according to claim 1, characterized in that: Any first client and any second client have corresponding encryption operators and secret keys, and the encryption operators and secret keys between any first client and any second client are different.

Images