A data remote linkage method and system for smart glasses

Abstract

The present invention discloses a data remote linkage method and system for smart glasses, belonging to the field of data linkage technology, which specifically includes: collecting multimodal perception data in real time through smart glasses, encrypting and transmitting to a remote server after preprocessing using quantum key distribution technology; after the server decrypts the data and verifies the integrity, it uses facial expressions and sound features to perform emotion recognition and analysis; based on the recognition result, the server generates feedback information and encrypts it and transmits it back to the smart glasses; after the smart glasses decrypt the feedback information, they display it to the user through a display screen and voice prompts, thereby realizing two-way safe and efficient emotional interaction and improving the security of data transmission.

Description

Technical Field

[0001] The present invention belongs to the technical field of data linkage, and in particular to a method and system for remote data linkage of smart glasses. Background Art

[0002] In recent years, with the rapid development of information technology, smart wearable devices, especially smart glasses, as a bridge connecting the real world and the digital world, are rapidly changing our lifestyles. Smart glasses integrate a variety of advanced technologies such as augmented reality, artificial intelligence, machine vision, and natural language processing to provide users with a more convenient, efficient, and intelligent interactive experience. In the field of remote technical support and collaboration, traditional technical support methods usually require experts to be on site, which not only increases time costs and travel expenses, but may also bring safety hazards in dangerous environments. Especially in the complex and critical scene of subway vehicle maintenance, the traditional method is not only inefficient, but may also increase safety hazards due to human factors. The emergence of smart glasses provides a new solution for remote technical support. Through smart glasses, experts can view the situation of the subway vehicle maintenance site in real time, conduct remote guidance and diagnosis, and greatly improve work efficiency and safety. However, existing smart glasses still have problems of low efficiency and poor safety in remote data transmission and linkage control, and it is difficult to meet the application needs in complex scenarios such as subway vehicle maintenance.

[0003] For example, the Chinese patent application with publication number CN112085232A discloses an operation and inspection system and method based on augmented reality technology, including a smart glasses device, a data acquisition device, a data transmission device, a server and a display; the smart glasses device is used to scan the site and equipment information and display it on the virtual screen in front with graphic information, and is used to collect the operator's own action information; the data acquisition device is used to collect the physical quantity information of the equipment and convert it into a digital signal; the data transmission device is a wireless router, and the smart glasses device communicates with the server through the wireless router; the server is used to analyze and process the information collected by the smart glasses device and the data acquisition device, and transmit the analyzed and processed information to the display; the display is used to display the information analyzed and processed by the server. By wearing the smart glasses device and linking with the management platform, the user can free his hands, share information with the management platform in real time, and improve work efficiency.

[0004] For example, a Chinese patent application with publication number CN117834462A discloses a real-time data integration and linkage method and system, including: marking at least one device node and configuring a number of external data points for each device node; marking a number of internal data points and marking the external data points associated with them; constructing at least one data acquisition node and marking the device nodes that need to be connected to each data acquisition node; constructing at least one specific associated application script based on internal data points, script functions, controls and script interfaces; constructing at least one application node, and each application node is marked and associated with a number of internal and external data points; the application node obtains the access information of the data acquisition node where the corresponding external data point is located based on the associated external data point, establishes a connection with it and interacts with data, obtains the real-time value of the external data point, and updates the corresponding real-time value of the internal data point in the memory; the application node executes the script based on the real-time value of the internal data point and the script engine.

[0005] The above existing technologies all have the following problems: 1) high technical complexity and cost; 2) no sentiment analysis is involved, and flexibility and scalability are poor; 3) low reliance on smart devices; 4) poor real-time performance and response speed. Summary of the invention

[0006] In view of the shortcomings of the prior art, the present invention proposes a data remote linkage method and system for smart glasses, which collects multimodal perception data in real time through smart glasses, and after pre-processing, encrypts and transmits it to a remote server using quantum key distribution technology; after the server decrypts the data and verifies the integrity, it uses facial expressions and sound features to perform emotion recognition and analysis; based on the recognition results, the server generates feedback information and encrypts it and transmits it back to the smart glasses; after the smart glasses decrypt the feedback information, they display it to the user through a display screen and voice prompts, thereby realizing two-way safe and efficient emotional interaction and improving the security of data transmission.

[0007] To achieve the above object, the present invention provides the following technical solutions:

[0008] A data remote linkage method for smart glasses, comprising:

[0009] Step S1: collecting multimodal perception data in real time through the sensors of the smart glasses and performing preprocessing;

[0010] Step S2: using quantum key distribution technology to encrypt and transmit the pre-processed multimodal sensing data to a remote server;

[0011] Step S3: the remote server receives the encrypted multimodal perception data, decrypts the encrypted data using the corresponding decryption key, restores the original multimodal perception data, and performs integrity verification on the decrypted multimodal perception data;

[0012] Step S4: After integrity verification, the remote server uses the facial expressions and voice features captured by the smart glasses to perform emotion recognition and analysis;

[0013] Step S5: Generate feedback information based on the results of emotion recognition and analysis, encrypt the feedback information using the same encryption key, and transmit the encrypted feedback information back to the smart glasses;

[0014] Step S6: After receiving the encrypted feedback information, the smart glasses use the corresponding decryption key to decrypt it, and at the same time, display the decrypted feedback information to the user through the display screen and voice prompt on the smart glasses;

[0015] The specific steps of step S2 include:

[0016] S2.1: The smart glasses generate and send quantum state-encoded photons to the remote server through the quantum channel. The remote server measures the received photons and records the measurement results.

[0017] S2.2: Based on the quantum measurement results, the smart glasses and the remote server use the quantum key negotiation protocol to negotiate multi-dimensional keys. At the same time, the smart glasses process the pre-processed multi-modal perception data. Apply the hash function to generate the integrity check code, obtain the final encryption key, and confirm whether the encryption key is successfully distributed through the classic channel. represents the nth preprocessed multimodal perception data, and n represents the number of preprocessed multimodal perception data;

[0018] S2.3: The smart glasses use the encryption key to encrypt the pre-processed multimodal perception data through a hybrid encryption algorithm, and introduce a data segmentation and distributed storage strategy to process the encrypted data in blocks and store them in N remote servers in a distributed manner;

[0019] S2.4: Smart glasses use multiple encrypted tunneling technologies and real-time network monitoring to transmit encrypted multimodal perception data and integrity check codes to remote servers through classical channels.

[0020] Specifically, the specific steps of S2.2 include:

[0021] S2.21: Based on the quantum measurement results, the smart glasses and the remote server initiate a quantum key agreement protocol and exchange some measurement results through a classical channel;

[0022] S2.22: Based on the exchange result, the smart glasses and the remote server negotiate using a quantum key negotiation protocol to obtain a secure key;

[0023] S2.23: While negotiating the key, the smart glasses preprocess the collected multimodal perception data, and use the preprocessed multimodal perception data as the input of the hash function SHA-256, and generate a fixed-length string as the integrity check code through hash calculation;

[0024] S2.24: Combine the security key in step S2.22 and the integrity check code in step S2.23 to generate the final encryption key.

[0025] Specifically, the specific steps of S2.2 also include:

[0026] S2.25: The smart glasses generate a random number as a challenge code, encrypt the challenge code using an encryption key, and send it to the remote server through a classical channel. The remote server decrypts the challenge code using the same encryption key and responds with a result.

[0027] S2.26: The remote server sends the response result back to the smart glasses through the classic channel. The smart glasses compare the received response results and determine whether the key distribution is successful and the key is correct based on the comparison result.

[0028] S2.27: If the key is confirmed to be correct, the smart glasses and the remote server use the encryption key for encrypted communication.

[0029] Specifically, the specific steps of S2.3 include:

[0030] S2.31: Obtain the preprocessed multimodal perception data in step S2.2 and the encryption key in step S2.2;

[0031] S2.32: Use an asymmetric encryption algorithm to symmetrically encrypt the encryption key to obtain a symmetric encryption key, and use the symmetric encryption key to Encrypt and generate encrypted data ,in, Indicates the nth encrypted data;

[0032] S2.33: Encrypted data Split according to preset rules to form M data blocks;

[0033] S2.34: Design a distributed storage strategy to store the segmented encrypted data blocks in N remote servers according to the distributed storage strategy;

[0034] S2.35: Perform ongoing monitoring and maintenance of distributed storage strategies.

[0035] Specifically, the multimodal perception data in step S1 includes behavior data, environmental data, facial expression data and sound data; the behavior data includes head movement trajectory data, and the environmental data includes light intensity and sound decibels.

[0036] Specifically, the quantum state in S2.1 contains key information, time tag and spatial positioning information.

[0037] A data remote linkage system for smart glasses, comprising: a data processing module, a communication module, a decryption and verification module, an analysis module, and a display module;

[0038] The data processing module is used to collect multimodal perception data in real time through the sensors of the smart glasses, and perform preliminary processing and cleaning;

[0039] The communication module is used to generate a secure key using quantum key distribution technology, and use the key to encrypt and transmit the pre-processed multimodal sensing data and feedback information;

[0040] The decryption verification module is used to decrypt the encrypted multimodal sensing data using the corresponding decryption key after the remote server receives it, restore the original data, and perform integrity verification;

[0041] The analysis module is used to perform emotion recognition and analysis on the decrypted and verified multimodal perception data, and extract facial expression and voice feature information;

[0042] The display module is used to decrypt the received encrypted feedback information and display the decrypted feedback information to the user.

[0043] Specifically, the decryption verification module includes: a data receiving unit, a decryption unit and an integrity verification unit;

[0044] The data receiving unit is used to receive an encrypted data packet from a communication channel;

[0045] The decryption unit is used to decrypt the data using the same key as used for encryption;

[0046] The integrity verification unit verifies the integrity and authenticity of the decrypted data through a hash verification method.

[0047] An electronic device comprises a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, steps of a method for remote data linkage of smart glasses are implemented.

[0048] Compared with the prior art, the present invention has the following beneficial effects:

[0049] 1. The present invention proposes a data remote linkage system for smart glasses. By integrating quantum key distribution technology, it realizes the secure real-time transmission and encryption protection of multimodal perception data, ensuring user privacy and data security. At the same time, the system can automatically perform emotion recognition and analysis, and generate personalized feedback based on the analysis results, which is instantly conveyed to the user through smart glasses, thereby improving the user experience and the level of interactive intelligence.

[0050] 2. The present invention proposes a data remote linkage method for smart glasses, which not only realizes the rapid collection, encrypted transmission and verification of data, but also integrates the emotion recognition function, so that the remote server can accurately understand the user's emotions and make corresponding feedback. It not only simplifies the user operation process, but also enhances the emotional interaction ability of the system, providing users with a more convenient, safe and intelligent remote information interaction experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] Figure 1 A schematic diagram of a data remote linkage method for smart glasses according to the present invention;

[0052] Figure 2 This is a principle flow chart of a data remote linkage method for smart glasses of the present invention;

[0053] Figure 3 This is a flow chart of encryption transmission of a data remote linkage method for smart glasses of the present invention;

[0054] Figure 4 This is an architecture diagram of a data remote linkage system of smart glasses of the present invention. DETAILED DESCRIPTION

[0055] Example 1

[0056] See also Figure 1-Figure 3 , an embodiment of the present invention provides: a data remote linkage method for smart glasses, comprising the following steps:

[0057] Step S1: collecting multimodal perception data in real time through the sensors of the smart glasses and performing preprocessing;

[0058] The multimodal perception data in step S1 includes behavior data, environmental data, facial expression data and sound data; the behavior data includes head movement trajectory data, and the environmental data includes light intensity and sound decibels.

[0059] It should be noted that through the various sensors integrated in smart glasses, including cameras, microphones, gyroscopes, and photosensors, the multimodal perception data is pre-processed including denoising, filtering, data cleaning, and feature extraction to reduce the amount of data transmission and improve the efficiency of subsequent processing.

[0060] Step S2: using quantum key distribution technology to encrypt and transmit the pre-processed multimodal sensing data to a remote server;

[0061] Step S3: the remote server receives the encrypted multimodal perception data, decrypts the encrypted data using the corresponding decryption key, restores the original multimodal perception data, and performs integrity verification on the decrypted multimodal perception data;

[0062] Furthermore, the specific steps of step S3 include:

[0063] S3.1: Receive encrypted data and obtain decryption key;

[0064] S3.2: decrypting the received encrypted data using a decryption key and a corresponding decryption algorithm, wherein the decryption process converts the encrypted data back to its original form, i.e., a plaintext representation of the multimodal sensory data;

[0065] S3.3: The decrypted data is the original multimodal perception data, and the decrypted multimodal perception data is verified for integrity. The integrity verification of the decrypted multimodal perception data is achieved by calculating the hash value of the data and comparing it with the hash value attached during transmission. If the two hash values ​​match, the data integrity is verified; if not, it indicates that the data has been tampered with.

[0066] Step S4: After integrity verification, the remote server uses the facial expressions and voice features captured by the smart glasses to perform emotion recognition and analysis;

[0067] It should be noted that smart glasses are usually equipped with sensors such as cameras and microphones to capture environmental information around the wearer, including images and sounds. These sensors include a field of view facing the front of the wearer and a camera facing the wearer himself. In the present invention, the facial expressions and voice features captured by smart glasses refer to the wearer himself, wherein the smart glasses are worn on the wearer's head, and their sensors naturally face the wearer or the environment in front of the wearer. The specific data collection process is: the wearer's facial image is captured by a front camera or other sensors integrated on the glasses frame, and then the facial expression features are extracted by image recognition technology. At the same time, the microphone will capture the wearer's voice, and the voice features such as pitch, volume, etc. are extracted by voice analysis technology for emotional analysis.

[0068] Specifically, the specific steps of step S4 include:

[0069] S4.1: preprocessing the facial expression image and sound data after decryption and integrity verification, including face detection, image normalization, and grayscale conversion steps for image data; and noise suppression and feature extraction steps for sound data;

[0070] S4.2: Extract features from the preprocessed image and sound data. For facial expressions, the shape, texture, and position features of the key areas of the eyes, mouth, and eyebrows are extracted; for sound, the pitch, rhythm, and volume features are extracted;

[0071] S4.3: Using a machine learning algorithm to build an emotion recognition model, wherein the specific process of using the machine learning algorithm to build the model is the prior art content in this field, and is not an inventive solution of the present application, and will not be described in detail here;

[0072] S4.4: Using the extracted features to train the emotion recognition model, wherein the model training process is the prior art content in this field, is not the inventive solution of the present application, and is not described in detail here;

[0073] S4.5: Input the extracted features into the trained emotion recognition model, and the emotion recognition model will output the corresponding emotion label or emotion probability distribution;

[0074] S4.6: Analyze and interpret the results of emotion recognition. Based on the emotion labels or probability distributions output by the emotion recognition model, the emotional state expressed by the facial expressions and sounds captured by the smart glasses can be determined, such as happiness, sadness, and anger.

[0075] Step S5: Generate feedback information based on the results of emotion recognition and analysis, encrypt the feedback information using the same encryption key, and transmit the encrypted feedback information back to the smart glasses;

[0076] Step S6: After receiving the encrypted feedback information, the smart glasses use the corresponding decryption key to decrypt it. At the same time, the decrypted feedback information is displayed to the user on the smart glasses through a display screen and voice prompts.

[0077] The specific steps of step S2 include:

[0078] S2.1: The smart glasses generate and send quantum state-encoded photons to the remote server through the quantum channel. The remote server measures the received photons and records the measurement results.

[0079] The quantum state in S2.1 contains key information, time tag and spatial positioning information.

[0080] Furthermore, the specific steps of S2.1 include:

[0081] S2.11: At the smart glasses end, the information to be transmitted is encoded into the quantum state of the photon using quantum state coding technology, wherein the coding process mainly maps the classical bits 0 and 1 to different states of the quantum bit, such as the polarization state of the photon, and the quantum state coding technology is the prior art content in this field, and is not the inventive solution of the present application, and will not be elaborated here;

[0082] S2.12: A quantum channel is established between the smart glasses and the remote server through quantum entanglement technology, wherein quantum entanglement is a special correlation between quantum states, which can ensure the security and efficiency of information during transmission. The process of quantum entanglement is the prior art content in this field and is not the inventive solution of this application, and will not be described in detail here;

[0083] S2.13: The smart glasses send the encoded photons to the remote server through the quantum channel. During the transmission process, the quantum state information carried by the photons will maintain its integrity unless it is disturbed by external factors such as quantum noise;

[0084] S2.14: After receiving the photon, the remote server uses a quantum measurement device to measure the quantum state of the photon. The measurement process needs to follow the measurement principle of quantum mechanics, that is, the measurement will change the quantum state of the photon and reveal the information it carries;

[0085] S2.15: The remote server records the measurement results and performs further data processing or information decoding as needed. The decoding process may involve mapping the state of the quantum bit back to a classical bit for subsequent processing or storage.

[0086] S2.2: Based on the quantum measurement results, the smart glasses and the remote server use the quantum key negotiation protocol to negotiate multi-dimensional keys. At the same time, the smart glasses process the pre-processed multi-modal perception data. Apply the hash function to generate the integrity check code, obtain the final encryption key, and confirm whether the encryption key is successfully distributed through the classic channel. represents the nth preprocessed multimodal perception data, and n represents the number of preprocessed multimodal perception data;

[0087] S2.3: The smart glasses use the encryption key to encrypt the pre-processed multimodal perception data through a hybrid encryption algorithm, and introduce a data segmentation and distributed storage strategy to process the encrypted data in blocks and store them in N remote servers in a distributed manner;

[0088] S2.4: Smart glasses use multiple encrypted tunneling technologies and real-time network monitoring to transmit encrypted multimodal perception data and integrity check codes to remote servers through classical channels.

[0089] Furthermore, the specific steps of S2.4 include:

[0090] S2.41: The smart glasses encrypt the pre-processed multimodal sensing data using the negotiated encryption key, and apply a hash function to the encrypted data or the original data to generate an integrity check code to ensure that the data has not been tampered with during transmission;

[0091] S2.42: Establish multiple encrypted tunnels between smart glasses and remote servers to enhance the security of data transmission, which usually involves using multiple encryption layers, each layer using a different encryption algorithm or key;

[0092] S2.43: During the data transmission process, the smart glasses and the remote server are configured with a real-time network monitoring function to monitor the network status and data transmission situation, wherein the real-time network monitoring includes traffic analysis, anomaly detection, and intrusion prevention measures to ensure the real-time and security of data transmission;

[0093] S2.44: The encrypted multimodal sensing data and integrity check code are transmitted to the remote server through the classical channel. It should be noted that during the transmission process, multiple encryption tunnel technologies ensure the security and privacy of the data, while real-time network monitoring provides real-time monitoring and protection of the data transmission process.

[0094] The specific steps of S2.2 include:

[0095] S2.21: Based on the quantum measurement results, the smart glasses and the remote server initiate a quantum key agreement protocol and exchange some measurement results through a classical channel;

[0096] Furthermore, the specific steps of S2.21 include:

[0097] (1) As a party to quantum key distribution, smart glasses prepare a series of quantum states, such as the four polarization states in the BB84 protocol, and send the quantum states to a remote server through a quantum channel. It should be noted that the preparation of these quantum states requires high-precision quantum light sources and modulators to ensure the accuracy and stability of the quantum states.

[0098] (2) After receiving the quantum state, the remote server uses the measurement basis (such as horizontal / vertical polarization, +45° / -45° polarization) agreed in advance with the smart glasses to measure the quantum state, and uses the measurement result as the original data for quantum key negotiation. In the present invention, the measurement basis selects +45° polarization;

[0099] (3) The smart glasses and the remote server exchange some measurement results through a classical channel. In the present invention, the classical channel selects an optical fiber channel. The purpose of this step is to coordinate the measurement bases of both parties so as to screen out quantum states measured using the same measurement base, thereby generating candidate bits of the shared key.

[0100] (4) Based on the exchanged information, both parties screen out quantum states measured using the same measurement basis and retain the measurement results of the quantum states as candidate bits for the key.

[0101] S2.22: Based on the exchange result, the smart glasses and the remote server negotiate using a quantum key negotiation protocol to obtain a secure key;

[0102] S2.23: While negotiating the key, the smart glasses preprocess the collected multimodal perception data, and use the preprocessed multimodal perception data as the input of the hash function SHA-256, and generate a fixed-length string as the integrity check code through hash calculation;

[0103] Furthermore, the specific steps of hash calculation include:

[0104] (1) Message padding: Pad the original message to ensure that its length is a multiple of 512 bits. The padding method is to add a binary 1 bit to the end of the original message, then add multiple 0 bits until the length is a multiple of 512 bits, and finally add 64 bits of the original message length;

[0105] (2) Message extension: The padded message is regarded as q 512-bit message blocks. Each 512-bit message block is extended to generate r 64-byte extended message blocks for subsequent compression function iterations. The extension method is to transform the original 512-bit message block to generate multiple 64-byte message blocks.

[0106] (3) Initialize hash value: Initialize the hash value register using a set of predefined initial values;

[0107] (4) Compression function iteration: The compression function is applied to each message block in the expanded message block sequence. In each iteration, the compression function reads the value of the current hash value register, an extended message block, and external parameters, and performs a series of complex bit operations and mathematical operations to update the value of the hash value register. It should be noted that the compression function contains complex bit operations and mathematical operations, including logical operations, bit shifts, and additions.

[0108] (5) Output hash value: After completing all compression function iterations, the value in the hash value register is the final hash value, which is a 256-bit binary number.

[0109] S2.24: Combine the security key in step S2.22 and the integrity check code in step S2.23 to generate a final encryption key;

[0110] S2.25: The smart glasses generate a random number as a challenge code, encrypt the challenge code using an encryption key, and send it to the remote server through a classical channel. The remote server decrypts the challenge code using the same encryption key and responds with a result, wherein the response result includes: confirmation of the challenge code, a result of performing a specific operation, or further instructions to the smart glasses;

[0111] S2.26: The remote server sends the response result back to the smart glasses through the classic channel. The smart glasses compare the received response results and determine whether the key distribution is successful and the key is correct based on the comparison result.

[0112] S2.27: If the key is confirmed to be correct, the smart glasses and the remote server use this key for encrypted communication.

[0113] The specific steps of S2.3 include:

[0114] S2.31: Obtain the preprocessed multimodal perception data in step S2.2 and the encryption key in step S2.2;

[0115] S2.32: Use an asymmetric encryption algorithm to symmetrically encrypt the encryption key to obtain a symmetric encryption key, and use the symmetric encryption key to Encrypt and generate encrypted data ,in, Indicates the nth encrypted data;

[0116] S2.33: Encrypted data The data is segmented according to preset rules to form M data blocks, wherein the preset rules can be formulated according to the data size, security requirements or storage requirements. Data segmentation facilitates parallel processing and storage of data and improves overall efficiency;

[0117] S2.34: Design a distributed storage strategy to store the segmented encrypted data blocks in N remote servers according to the distributed storage strategy;

[0118] Among them, the distributed storage strategy includes selecting the geographical location, network architecture, data redundancy and fault tolerance mechanism of N remote servers. The distributed storage strategy will ensure the high availability, reliability and security of data.

[0119] S2.35: Continuously monitor and maintain distributed storage strategies, including performance monitoring, security auditing, and data backup and recovery.

[0120] Example 2

[0121] See also Figure 4 , another embodiment provided by the present invention: a data remote linkage system of smart glasses, comprising: a data processing module, a communication module, a decryption and verification module, an analysis module, and a display module;

[0122] The data processing module is used to collect multimodal perception data in real time through the sensors of the smart glasses, and to perform preliminary processing and cleaning for subsequent encryption and transmission;

[0123] A communication module, used to generate a secure key using quantum key distribution technology, and use the key to encrypt and transmit the pre-processed multimodal sensing data and feedback information;

[0124] A decryption verification module is used to decrypt the encrypted multimodal sensing data using the corresponding decryption key after the remote server receives it, restore the original data, and perform integrity verification;

[0125] The analysis module is used to perform emotion recognition and analysis on the decrypted and verified multimodal perception data, and extract facial expression and voice feature information;

[0126] The display module is used to decrypt the received encrypted feedback information and display the decrypted feedback information to the user.

[0127] The data processing module includes: a sensor unit and a preprocessing unit;

[0128] A sensor unit for capturing multimodal data of video, audio, and motion;

[0129] The preprocessing unit is used to perform preprocessing operations such as denoising, compression, and format conversion on the raw data collected by the sensor to improve data quality and transmission efficiency.

[0130] The communication module includes: a quantum key generation unit, a data encryption unit and an encryption transmission unit;

[0131] A quantum key generation unit, used to generate highly secure keys through a quantum channel;

[0132] A data encryption unit, used to encrypt the pre-processed multimodal data and feedback information using the generated key;

[0133] The encryption transmission unit is responsible for the encapsulation of encrypted data and its secure transmission through quantum or classical channels.

[0134] The decryption verification module includes: a data receiving unit, a decryption unit and an integrity verification unit;

[0135] A data receiving unit, used for receiving an encrypted data packet from a communication channel;

[0136] A decryption unit, used to decrypt the data using the same key as used for encryption;

[0137] The integrity verification unit verifies the integrity and authenticity of the decrypted data through a hash verification method.

[0138] The analysis module includes: feature extraction unit, emotion recognition unit and result processing unit;

[0139] A feature extraction unit, used to extract facial expression and sound feature information from video and audio data;

[0140] Emotion recognition unit, used to perform emotion recognition based on the extracted features using deep learning algorithms;

[0141] The analysis result processing unit is used to organize and analyze the recognition results.

[0142] The display module includes: a feedback data receiving unit, a decryption unit and a display unit;

[0143] A feedback data receiving unit, configured to receive encrypted feedback information from a communication channel;

[0144] A decryption unit, used to decrypt the feedback information using the same key as used for encryption;

[0145] The display unit includes a display screen and a voice prompt system, which is used to display or broadcast the decrypted feedback information to the user.

[0146] Example 3

[0147] An electronic device includes a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, steps of a method for remote data linkage of smart glasses are implemented. For details, please refer to the above method embodiment, which will not be repeated here.

[0148] The embodiments of the present invention are described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementation modes, which are merely illustrative rather than restrictive. Under the guidance of the present invention, ordinary technicians in the field may also change, modify, replace and modify the above-mentioned embodiments without departing from the purpose and scope of protection of the present invention, and all of these are within the protection of the present invention.

[0149] If the disclosed technical solution involves personal information, the product using the disclosed technical solution has clearly informed the personal information processing rules and obtained the individual's voluntary consent before processing the personal information. If the disclosed technical solution involves sensitive personal information, the product using the disclosed technical solution has obtained the individual's separate consent before processing the sensitive personal information, and at the same time meets the "explicit consent" requirement. For example, on personal information collection devices such as cameras, clear and prominent signs are set to inform that the personal information collection scope has been entered and personal information will be collected. If the individual voluntarily enters the collection scope, it is deemed that he or she agrees to the collection of his or her personal information; or on the device that processes personal information, when the personal information processing rules are notified by obvious signs / information, the individual's authorization is obtained through pop-up information or by asking the individual to upload his or her personal information; among them, the personal information processing rules may include information such as the personal information processor, the purpose of personal information processing, the processing method, and the type of personal information processed.

Claims

1. A data remote linkage method for smart glasses, characterized in that: include: Step S1: collecting multimodal perception data in real time through the sensors of the smart glasses and performing preprocessing; Step S2: using quantum key distribution technology to encrypt and transmit the pre-processed multimodal sensing data to a remote server; Step S3: the remote server receives the encrypted multimodal perception data, decrypts the encrypted data using the corresponding decryption key, restores the original multimodal perception data, and performs integrity verification on the decrypted multimodal perception data; Step S4: After integrity verification, the remote server uses the facial expressions and voice features captured by the smart glasses to perform emotion recognition and analysis; Step S5: Generate feedback information based on the results of emotion recognition and analysis, encrypt the feedback information using the same encryption key, and transmit the encrypted feedback information back to the smart glasses; Step S6: After receiving the encrypted feedback information, the smart glasses use the corresponding decryption key to decrypt it, and at the same time, display the decrypted feedback information to the user through the display screen and voice prompt on the smart glasses; The specific steps of step S2 include: S2.1: The smart glasses generate and send quantum state-encoded photons to the remote server through the quantum channel. The remote server measures the received photons and records the measurement results. S2.2: Based on the quantum measurement results, the smart glasses and the remote server use the quantum key negotiation protocol to negotiate multi-dimensional keys. At the same time, the smart glasses process the pre-processed multi-modal perception data. Apply the hash function to generate the integrity check code, obtain the final encryption key, and confirm whether the encryption key is successfully distributed through the classic channel. represents the nth preprocessed multimodal perception data, and n represents the number of preprocessed multimodal perception data; S2.3: The smart glasses use the encryption key to encrypt the pre-processed multimodal perception data through a hybrid encryption algorithm, and introduce a data segmentation and distributed storage strategy to process the encrypted data in blocks and store them in N remote servers in a distributed manner; S2.4: Smart glasses use multiple encrypted tunneling technologies and real-time network monitoring to transmit encrypted multimodal perception data and integrity check codes to remote servers through classical channels.

2. The data remote linkage method of smart glasses as claimed in claim 1, characterized in that: The specific steps of S2.2 include: S2.21: Based on the quantum measurement results, the smart glasses and the remote server initiate a quantum key agreement protocol and exchange some measurement results through a classical channel; S2.22: Based on the exchange result, the smart glasses and the remote server negotiate using a quantum key negotiation protocol to obtain a secure key; S2.23: While negotiating the key, the smart glasses preprocess the collected multimodal perception data, and use the preprocessed multimodal perception data as the input of the hash function SHA-256, and generate a fixed-length string as the integrity check code through hash calculation; S2.24: Combine the security key in step S2.22 and the integrity check code in step S2.23 to generate the final encryption key.

3. The data remote linkage method of smart glasses as claimed in claim 2, characterized in that: The specific steps of S2.2 also include: S2.25: The smart glasses generate a random number as a challenge code, encrypt the challenge code using an encryption key, and send it to the remote server through a classical channel. The remote server decrypts the challenge code using the same encryption key and responds with a result. S2.26: The remote server sends the response result back to the smart glasses through the classic channel. The smart glasses compare the received response results and determine whether the key distribution is successful and the key is correct based on the comparison result. S2.27: If the key is confirmed to be correct, the smart glasses and the remote server use the encryption key for encrypted communication.

4. The data remote linkage method of smart glasses as claimed in claim 3, characterized in that: The specific steps of S2.3 include: S2.31: Obtain the preprocessed multimodal perception data in step S2.2 and the encryption key in step S2.2; S2.32: Use an asymmetric encryption algorithm to symmetrically encrypt the encryption key to obtain a symmetric encryption key, and use the symmetric encryption key to Encrypt and generate encrypted data ,in, Indicates the nth encrypted data; S2.33: Encrypted data Split according to preset rules to form M data blocks; S2.34: Design a distributed storage strategy to store the segmented encrypted data blocks in N remote servers according to the distributed storage strategy; S2.35: Perform ongoing monitoring and maintenance of distributed storage strategies.

5. The data remote linkage method of smart glasses as claimed in claim 4, characterized in that: The multimodal perception data in step S1 includes behavior data, environmental data, facial expression data and sound data; the behavior data includes head movement trajectory data, and the environmental data includes light intensity and sound decibels.

6. The data remote linkage method of smart glasses as claimed in claim 5, characterized in that: The quantum state in S2.1 contains key information, time tag and spatial positioning information.

7. A data remote linkage system for smart glasses, used to implement a data remote linkage method for smart glasses according to any one of claims 1 to 6, characterized in that: include: Data processing module, communication module, decryption and verification module, analysis module, and display module; The data processing module is used to collect multimodal perception data in real time through the sensors of the smart glasses, and perform preliminary processing and cleaning; The communication module is used to generate a secure key using quantum key distribution technology, and use the key to encrypt and transmit the pre-processed multimodal sensing data and feedback information; The decryption verification module is used to decrypt the encrypted multimodal sensing data using the corresponding decryption key after the remote server receives it, restore the original data, and perform integrity verification; The analysis module is used to perform emotion recognition and analysis on the decrypted and verified multimodal perception data, and extract facial expression and voice feature information; The display module is used to decrypt the received encrypted feedback information and display the decrypted feedback information to the user.

8. The data remote linkage system of smart glasses as claimed in claim 7, characterized in that: The decryption verification module includes: a data receiving unit, a decryption unit and an integrity verification unit; The data receiving unit is used to receive an encrypted data packet from a communication channel; The decryption unit is used to decrypt the data using the same key as used for encryption; The integrity verification unit verifies the integrity and authenticity of the decrypted data through a hash verification method.

9. An electronic device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the data remote linkage method for smart glasses described in any one of claims 1 to 6 are implemented.

Images