A data processing method, apparatus and system for an AR device

Abstract

This application relates to the field of data protection technology, and discloses a data processing method, apparatus, and system for AR devices. When the computational complexity of the data to be processed on the AR device meets the outsourcing conditions, the data to be processed is encrypted using a public key and an encryption algorithm, and the encrypted data to be processed and the data processing method are transmitted to a local device. The local device converts the data processing method into a linear function supported by a fully homomorphic encryption algorithm; it performs homomorphic operations on the encrypted data to be processed based on the linear function to obtain the encrypted operation result; the encrypted operation result is fed back to the AR device, so that the AR device can use a private key and a decryption algorithm to decrypt the encrypted operation result to obtain the plaintext operation result. By transmitting the computationally complex data to the local device for processing, the AR device can achieve the effect of improving its computing power. Furthermore, the use of a fully homomorphic encryption algorithm to protect the data to be processed provides extremely high security.

Description

Technical Field

[0001] This application relates to the field of data protection technology, and in particular to a data processing method, apparatus and system for an AR device. Background Technology

[0002] Augmented Reality (AR) technology is a technology that cleverly integrates virtual information with the real world. It simulates and applies computer-generated text, images, 3D models, music, videos, and other virtual information to the real world. The two types of information complement each other, thereby "enhancing" the real world.

[0003] With the development of augmented reality technology, AR devices are becoming increasingly popular with the market and consumers. However, limited by factors such as space, battery life, and heat dissipation, current AR devices often use low-power, low-performance computing chips. Limited computing power restricts the functionality of AR devices, limits their application scenarios, and thus affects the user experience.

[0004] It is evident that improving the computing power of AR devices is a problem that needs to be solved by those skilled in the art. Summary of the Invention

[0005] The purpose of this application is to provide a data processing method, apparatus, and system for AR devices, which can improve the computing power of AR devices.

[0006] To address the aforementioned technical problems, this application provides a data processing method for an AR device, applicable to local devices, the method comprising:

[0007] The system receives encrypted data to be processed and a data processing method transmitted from an AR device; wherein the encrypted data to be processed is obtained by the AR device encrypting the data to be processed using a public key and an encryption algorithm;

[0008] The data processing method is converted into a linear function supported by a fully homomorphic encryption algorithm;

[0009] Homomorphic operations are performed on the ciphertext data to be processed based on the linear function to obtain the ciphertext operation result;

[0010] The encrypted operation result is fed back to the AR device so that the AR device can use the private key and decryption algorithm to decrypt the encrypted operation result to obtain the plaintext operation result; wherein, the private key and the public key are a public-private key pair obtained by using a key generation algorithm, and the encryption algorithm is matched with the decryption algorithm.

[0011] Optionally, converting the data processing method into a linear function supported by a fully homomorphic encryption algorithm includes:

[0012] Determine whether the data processing method conforms to linear arithmetic;

[0013] If the data processing method conforms to linear operations, the linear operations contained in the data processing method are converted into linear functions that conform to the multiplication and addition protocols of fully homomorphic encryption.

[0014] If the data processing method does not conform to linear operations, the data processing method is converted into a linearized processing method; the linear operations contained in the linearized processing method are converted into linear functions that conform to the multiplication and addition protocols of fully homomorphic encryption.

[0015] Optionally, converting the data processing method into a linearized processing method includes:

[0016] Based on the types of operations included in the data processing method, a matching transformation function is selected; wherein, the transformation function is a Taylor expansion, a piecewise function, an absolute value function, or a maximization / minimization function;

[0017] The data processing method is converted into a linearized processing method using the transformation function.

[0018] Optionally, before converting the data processing method into a linear function supported by a fully homomorphic encryption algorithm, the method further includes:

[0019] Receive the public key and digital signature transmitted by the AR device;

[0020] The public key is processed using the set signature method to obtain the signature result;

[0021] If the signature result matches the digital signature, the step of converting the data processing method into a linear function supported by a fully homomorphic encryption algorithm is performed.

[0022] An alarm will be issued if the signature result is inconsistent with the digital signature.

[0023] Optionally, feeding back the ciphertext calculation result to the AR device includes:

[0024] The encrypted computation result is fed back to the AR device based on a wireless transmission protocol or a set private communication protocol.

[0025] Optionally, before receiving the encrypted data to be processed and the data processing method transmitted by the AR device, the method further includes:

[0026] Receive the various operation types and their corresponding operation numbers transmitted by the AR device;

[0027] Using the homomorphic addition and homomorphic multiplication of the fully homomorphic encryption algorithm, a linear function matching each of the operation types is established;

[0028] Record the correspondence between each linear function and each operation number;

[0029] Accordingly, the process of receiving the encrypted data to be processed transmitted by the AR device and the data processing method, and converting the data processing method into a linear function supported by the fully homomorphic encryption algorithm, includes:

[0030] Receive the encrypted data to be processed and the corresponding target operation number transmitted by the AR device;

[0031] Search for the linear function that matches the target operation number from the correspondence between each of the linear functions and each of the operation numbers.

[0032] This application embodiment also provides a data processing apparatus for an AR device, suitable for local devices, the apparatus including a receiving unit, a conversion unit, a calculation unit and a feedback unit;

[0033] The receiving unit is used to receive the encrypted data to be processed and the data processing method transmitted by the AR device; wherein, the encrypted data to be processed is obtained by the AR device encrypting the data to be processed using a public key and an encryption algorithm;

[0034] The conversion unit is used to convert the data processing method into a linear function supported by the fully homomorphic encryption algorithm;

[0035] The computation unit is used to perform homomorphic operations on the ciphertext data to be processed based on the linear function to obtain the ciphertext operation result;

[0036] The feedback unit is used to feed back the ciphertext operation result to the AR device, so that the AR device can use the private key and decryption algorithm to decrypt the ciphertext operation result to obtain the plaintext operation result; wherein, the private key and the public key are a public-private key pair obtained by using a key generation algorithm, and the encryption algorithm is matched with the decryption algorithm.

[0037] Optionally, the conversion unit includes a judgment subunit, a first conversion subunit, a second conversion subunit, and a third conversion subunit;

[0038] The judgment subunit is used to determine whether the data processing method conforms to linear operation;

[0039] The first conversion subunit is used to convert the linear operations contained in the data processing method into linear functions that conform to the multiplication and addition protocols of fully homomorphic encryption, when the data processing method conforms to linear operations.

[0040] The second conversion subunit is used to convert the data processing method into a linearized processing method when the data processing method does not conform to linear operation.

[0041] The third conversion subunit is used to convert the linear operations contained in the linearization process into linear functions that conform to the multiplication and addition protocols of fully homomorphic encryption.

[0042] Optionally, the second conversion subunit is used to select a matching conversion function according to the operation type included in the data processing method; wherein the conversion function is a Taylor expansion, a piecewise function, an absolute value function, or a maximization / minimization function; and the data processing method is converted into a linearization processing method using the conversion function.

[0043] Optionally, it may also include a signature unit and a prompt unit;

[0044] The receiving unit is also used to receive the public key and digital signature transmitted by the AR device;

[0045] The signature unit is used to process the public key using a set signature method to obtain a signature result; if the signature result is consistent with the digital signature, the step of converting the data processing method into a linear function supported by a fully homomorphic encryption algorithm is performed.

[0046] The notification unit is used to issue an alarm notification when the signature result is inconsistent with the digital signature.

[0047] Optionally, the feedback unit is used to feed back the encrypted operation result to the AR device based on a wireless transmission protocol or a set private communication protocol.

[0048] Optionally, it may also include a setup unit and a recording unit;

[0049] The receiving unit is also used to receive the various operation types transmitted by the AR device and their respective operation numbers;

[0050] The establishment unit is used to establish linear functions matching each of the operation types using the homomorphic addition and homomorphic multiplication of the fully homomorphic encryption algorithm;

[0051] The recording unit is used to record the correspondence between each of the linear functions and each of the operation numbers;

[0052] Accordingly, the receiving unit is used to receive the encrypted data to be processed and the corresponding target operation number transmitted by the AR device;

[0053] The conversion unit is used to query the linear function that matches the target operation number from the correspondence between each of the linear functions and each of the operation numbers.

[0054] This application also provides a data processing method for an AR device, applicable to AR devices, the method comprising:

[0055] If the computational complexity of the data to be processed meets the outsourcing conditions, the data to be processed is encrypted using a public key and an encryption algorithm to obtain the ciphertext data to be processed.

[0056] The ciphertext data to be processed and the data processing method are transmitted to the local device so that the local device can convert the data processing method into a linear function supported by a fully homomorphic encryption algorithm; homomorphic operation is performed on the ciphertext data to be processed based on the linear function to obtain the ciphertext operation result, and the ciphertext operation result is fed back to the AR device;

[0057] Receive the encrypted operation result fed back by the local device;

[0058] The ciphertext operation result is decrypted using a private key and a decryption algorithm to obtain the plaintext operation result; wherein the private key and the public key are a public-private key pair obtained using a key generation algorithm, and the encryption algorithm is matched with the decryption algorithm.

[0059] Optionally, before encrypting the data to be processed using a public key and an encryption algorithm to obtain the ciphertext data to be processed, the method further includes:

[0060] Filter out operation types whose computational complexity meets the outsourcing criteria;

[0061] Each operation type and its corresponding operation number are transmitted to the local device so that the local device can establish a linear function matching each operation type using homomorphic addition and homomorphic multiplication of the fully homomorphic encryption algorithm; and the correspondence between each linear function and each operation number is recorded.

[0062] Accordingly, the transmission of the encrypted data to be processed to the local device and the data processing method include:

[0063] The encrypted data to be processed and the corresponding target operation number are transmitted to the local device.

[0064] This application also provides a data processing apparatus for an AR device, applicable to AR devices, the apparatus including an encryption unit, a transmission unit, a receiving unit, and a decryption unit;

[0065] The encryption unit is used to encrypt the data to be processed using a public key and an encryption algorithm, when the computational complexity of the data to be processed meets the outsourcing conditions, so as to obtain the ciphertext data to be processed.

[0066] The transmission unit is used to transmit the ciphertext data to be processed and the data processing method to the local device, so that the local device can convert the data processing method into a linear function supported by a fully homomorphic encryption algorithm; perform homomorphic operations on the ciphertext data to be processed based on the linear function to obtain the ciphertext operation result, and feed the ciphertext operation result back to the AR device;

[0067] The receiving unit is used to receive the encrypted operation result fed back by the local device;

[0068] The decryption unit is used to decrypt the ciphertext operation result using a private key and a decryption algorithm to obtain the plaintext operation result; wherein the private key and the public key are a public-private key pair obtained using a key generation algorithm, and the encryption algorithm is matched with the decryption algorithm.

[0069] Optionally, it also includes a screening unit and a pre-transmission unit;

[0070] The filtering unit is used to filter out operation types whose computational complexity meets the outsourcing conditions;

[0071] The pre-transmission unit is used to transmit each operation type and its corresponding operation number to the local device, so that the local device can use the homomorphic addition and homomorphic multiplication of the fully homomorphic encryption algorithm to establish a linear function matching each operation type; and record the correspondence between each linear function and each operation number.

[0072] Accordingly, the transmission unit is used to transmit the encrypted data to be processed and the corresponding target operation number to the local device.

[0073] This application also provides a data processing system for an AR device, including an AR device and a local device;

[0074] The AR device is configured to, when the computational complexity of the data to be processed meets the outsourcing conditions, encrypt the data to be processed using a public key and an encryption algorithm to obtain ciphertext data; transmit the ciphertext data to be processed and the data processing method to a local device; receive the ciphertext computation result fed back by the local device; and decrypt the ciphertext computation result using a private key and a decryption algorithm to obtain the plaintext computation result; wherein the private key and the public key are a public-private key pair obtained using a key generation algorithm, and the encryption algorithm is matched with the decryption algorithm.

[0075] The local device is configured to receive the ciphertext data to be processed and the data processing method transmitted by the AR device; convert the data processing method into a linear function supported by a fully homomorphic encryption algorithm; perform homomorphic operations on the ciphertext data to be processed based on the linear function to obtain the ciphertext operation result; and feed back the ciphertext operation result to the AR device.

[0076] This application also provides an electronic device, including:

[0077] Memory, used to store computer programs;

[0078] A processor for executing the computer program to implement the steps of the data processing method for the AR device described above.

[0079] This application also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps of the data processing method for the AR device described above.

[0080] As can be seen from the above technical solution, when the computational complexity of the data to be processed on the AR device meets the outsourcing conditions, the AR device uses a public key and an encryption algorithm to encrypt the data to be processed, obtaining ciphertext data; it then transmits the ciphertext data and the data processing method to the local device. The local device converts the data processing method into a linear function supported by a fully homomorphic encryption algorithm; it performs homomorphic operations on the ciphertext data to be processed based on the linear function to obtain the ciphertext operation result; and it feeds back the ciphertext operation result to the AR device. After receiving the ciphertext operation result from the local device, the AR device uses a private key and a decryption algorithm to decrypt the ciphertext operation result to obtain the plaintext operation result; wherein, the private key and public key are a public-private key pair obtained using a key generation algorithm, and the encryption algorithm matches the decryption algorithm. In this technical solution, the AR device accelerates large-scale data computation by transmitting computationally complex data to the local device for processing, thereby improving the AR device's computing power. Furthermore, the fully homomorphic encryption algorithm protects the data to be processed on the AR device, providing extremely high security, avoiding the risk of user privacy data leakage, and thus optimizing the user experience. Attached Figure Description

[0081] To more clearly illustrate the embodiments of this application, the accompanying drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0082] Figure 1Signaling diagram of a data processing method for an AR device provided in an embodiment of this application;

[0083] Figure 2 A schematic diagram of the structure of a data processing device for an AR device suitable for local devices, provided in an embodiment of this application;

[0084] Figure 3 This application provides a schematic diagram of the structure of a data processing device for an AR device.

[0085] Figure 4 A schematic diagram of the structure of a data processing system for an AR device provided in an embodiment of this application;

[0086] Figure 5 This is a schematic diagram illustrating the interaction between AR glasses and a local device, provided as an embodiment of the present invention.

[0087] Figure 6 This is a structural diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0088] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the protection scope of this application.

[0089] The terms “comprising” and “having” in the specification, claims, and accompanying drawings of this application, and any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the steps or units listed, but may include steps or units not listed.

[0090] To enable those skilled in the art to better understand the present application, the present application will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0091] Next, a data processing method for an AR device provided by an embodiment of this application will be described in detail. Figure 1 A signaling diagram for a data processing method for an AR device provided in an embodiment of this application, the method comprising:

[0092] S101: When the computational complexity of the data to be processed meets the outsourcing conditions, the AR device uses a public key and an encryption algorithm to encrypt the data to be processed in order to obtain the ciphertext data to be processed.

[0093] AR devices come in a wide variety of types, such as AR glasses, AR watches, and other intelligent devices.

[0094] AR devices need to process a wide variety of data, and the computational methods required for different types of data vary. In practical applications, before performing calculations and analysis on the data to be processed, AR devices can first assess the computational complexity of the data. Computational complexity can be the time spent processing the data, the system resources consumed, or a combination of both.

[0095] Taking the comprehensive evaluation of computational complexity based on the time spent and the system resources occupied as an example, the outsourcing conditions can include set time thresholds and resource thresholds. When the time spent exceeds the set time threshold and the system resources occupied exceed the resource threshold, it indicates that the computational complexity of the data to be processed is high, and the outsourcing conditions are met. Therefore, the data to be processed can be handed over to the local device for computation.

[0096] To ensure the security of the data to be processed and to guarantee that the computation results fed back by the local device can be recognized by the AR device, a fully homomorphic encryption algorithm can be used to protect the data to be processed in this embodiment. Fully homomorphic encryption has extremely high security, and the currently emerging lattice-based homomorphic encryption algorithm has quantum attack resistance, which can fully guarantee the security of user privacy data.

[0097] To use homomorphic encryption algorithms, initial setup is required, the most important part of which is generating a public key for encrypting plaintext data and a private key for decrypting ciphertext data. The AR device can run a key generation algorithm to process the set parameters, thereby obtaining a public-private key pair. The AR device can then use the public key and encryption algorithm to encrypt the data to be processed, obtaining ciphertext data to be processed, and then transmit the ciphertext data to the local device.

[0098] The local device is a high-performance computing platform that can accurately and efficiently process large-scale data or complex computational data.

[0099] Compared to outsourcing data processing to cloud servers, which requires a longer network transmission time, this application embodiment allows the AR device and the local device to communicate based on a wireless transmission protocol or a pre-defined private communication protocol. This provides high bandwidth, low latency, and shortens network transmission time, while also meeting high real-time performance requirements and response time demands for outsourced computation. The local device can be a general-purpose workstation or a dedicated computing device for accelerating homomorphic encryption operations.

[0100] S102: The AR device transmits encrypted data to be processed and the data processing method to the local device.

[0101] Considering that different types of data require different data processing methods, in order to meet the processing needs of different types of data, AR devices can transmit the data processing method corresponding to the encrypted data to be processed along with the encrypted data to be processed to the local device.

[0102] S103: The local device receives the encrypted data to be processed and the data processing method transmitted by the AR device, and converts the data processing method into a linear function supported by the fully homomorphic encryption algorithm.

[0103] Fully homomorphic encryption algorithms can only process linear functions. Considering that the data processing method corresponding to the ciphertext data to be processed may be a non-linear operation, in order to ensure that the local device can use fully homomorphic encryption algorithms to process the ciphertext data to be processed, it is necessary to first convert the data processing method into a linear function supported by fully homomorphic encryption algorithms.

[0104] In this embodiment of the invention, the process by which the local device converts the data processing method into a linear function supported by the fully homomorphic encryption algorithm may include determining whether the data processing method conforms to linear operation.

[0105] If the data processing method conforms to linear operations, it means that there is no need to switch from nonlinear to linear operations. The linear operations contained in the data processing method can be directly converted into linear functions that conform to the multiplication and addition protocols of fully homomorphic encryption.

[0106] If the data processing method does not conform to linear operations, it is necessary to first perform a switch from nonlinear to linear operations, that is, to convert the data processing method into a linearized processing method; then, the linear operations contained in the linearized processing method are converted into linear functions that conform to the multiplication and addition protocols of fully homomorphic encryption.

[0107] There are several ways to convert nonlinear operations into linear operations. In practical applications, a matching transformation function can be selected based on the types of operations involved in the data processing method; using the transformation function, the data processing method can be converted into a linearized processing method. The transformation function can be a Taylor expansion, a piecewise function, an absolute value function, or a maximization / minimization function.

[0108] S104: The local device performs homomorphic operations on the ciphertext data to be processed based on a linear function to obtain the ciphertext operation result, and then feeds the ciphertext operation result back to the AR device.

[0109] The local device can perform the operation in encrypted state, thus obtaining the encrypted operation result.

[0110] S105: The AR device receives the encrypted operation result fed back by the local device, and uses the private key and decryption algorithm to decrypt the encrypted operation result to obtain the plaintext operation result.

[0111] The private key and public key are a public-private key pair obtained using a key generation algorithm, and the encryption algorithm is matched with the decryption algorithm.

[0112] After receiving the encrypted operation result from the local device, the AR device can use the private key in the public-private key pair to decrypt the encrypted operation result, thereby obtaining the plaintext operation result.

[0113] As can be seen from the above technical solution, when the computational complexity of the data to be processed on the AR device meets the outsourcing conditions, the AR device uses a public key and an encryption algorithm to encrypt the data to be processed, obtaining ciphertext data; it then transmits the ciphertext data and the data processing method to the local device. The local device converts the data processing method into a linear function supported by a fully homomorphic encryption algorithm; it performs homomorphic operations on the ciphertext data to be processed based on the linear function to obtain the ciphertext operation result; and it feeds back the ciphertext operation result to the AR device. After receiving the ciphertext operation result from the local device, the AR device uses a private key and a decryption algorithm to decrypt the ciphertext operation result to obtain the plaintext operation result; wherein, the private key and public key are a public-private key pair obtained using a key generation algorithm, and the encryption algorithm matches the decryption algorithm. In this technical solution, the AR device accelerates large-scale data computation by transmitting computationally complex data to the local device for processing, thereby improving the AR device's computing power. Furthermore, the fully homomorphic encryption algorithm protects the data to be processed on the AR device, providing extremely high security, avoiding the risk of user privacy data leakage, and thus optimizing the user experience.

[0114] In AR devices, the processing method corresponding to each type of data can be regarded as a type of operation. Considering that the number of operation types is limited, in this embodiment, operation numbers can be used to represent different operation processing methods. In this way, when the AR device encounters data that needs to be outsourced, it only needs to transmit the encrypted outsourced data and its corresponding operation number to the local device, without having to transmit the operation processing method corresponding to the outsourced data every time, thereby improving the interaction efficiency between the AR device and the local device.

[0115] In its implementation, before encrypting the data to be processed using a public key and encryption algorithm to obtain the ciphertext data, the AR device can pre-select the operation types whose computational complexity meets the outsourcing conditions; and transmit each operation type and its corresponding operation number to the local device. After receiving the operation types and their corresponding operation numbers transmitted by the AR device, the local device can use the homomorphic addition and homomorphic multiplication of the fully homomorphic encryption algorithm to establish a linear function matching each operation type; and record the correspondence between each linear function and each operation number.

[0116] Correspondingly, the AR device can directly transmit the encrypted data to be processed and the corresponding target operation number to the local device. After receiving the encrypted data to be processed and the corresponding target operation number transmitted by the AR device, the local device can query the linear function that matches the target operation number from the correspondence between each linear function and each operation number.

[0117] By using operation numbers to represent the operation processing method and pre-recording the correspondence between each linear function and each operation number in the local device, the data interaction efficiency between the AR device and the local device can be effectively improved. Moreover, after the local device obtains the encrypted data to be processed, it can directly call the corresponding linear function based on the target operation number, saving the time spent generating the linear function each time and improving the processing efficiency of the local device for the encrypted data to be processed.

[0118] In this embodiment of the invention, in order to prevent the public key from being maliciously tampered with, the public key can be signed and verified by a local device.

[0119] In practice, the AR device can process the public key according to the set signing method to obtain a digital signature. The public key and digital signature are then transmitted together to the local device.

[0120] After receiving the public key and digital signature from the AR device, the local device can process the public key using the set signature method to obtain a signature result. If the signature result matches the digital signature, it indicates that the public key has not been tampered with, and the step of converting the data processing method into a linear function supported by a fully homomorphic encryption algorithm can be performed. If the signature result does not match the digital signature, it indicates that the public key is highly likely to have been tampered with, and an alarm can be triggered.

[0121] By signing and verifying the public key, the correctness of the public key is guaranteed, as well as the correctness of the ciphertext data to be processed obtained by encrypting the ciphertext data based on the public key and the correctness of the ciphertext operation result obtained by the local device after processing the ciphertext data. This allows the AR device to obtain the correct plaintext operation result after decrypting the ciphertext operation result.

[0122] Figure 2This is a schematic diagram of the structure of a data processing device for an AR device provided in an embodiment of this application. It is applicable to local devices and includes a receiving unit 21, a conversion unit 22, a processing unit 23, and a feedback unit 24.

[0123] The receiving unit 21 is used to receive the encrypted data to be processed and the data processing method transmitted by the AR device; wherein, the encrypted data to be processed is obtained by the AR device encrypting the data to be processed using a public key and an encryption algorithm;

[0124] The conversion unit 22 is used to convert the data processing method into a linear function supported by the fully homomorphic encryption algorithm;

[0125] The operation unit 23 is used to perform homomorphic operations on the ciphertext data to be processed based on a linear function to obtain the ciphertext operation result;

[0126] Feedback unit 24 is used to feed back the ciphertext operation result to the AR device so that the AR device can use the private key and decryption algorithm to decrypt the ciphertext operation result to obtain the plaintext operation result; wherein, the private key and public key are a public-private key pair obtained by using a key generation algorithm, and the encryption algorithm and decryption algorithm are matched.

[0127] Optionally, the conversion unit includes a judgment subunit, a first conversion subunit, a second conversion subunit, and a third conversion subunit;

[0128] The judgment sub-unit is used to determine whether the data processing method conforms to linear operation;

[0129] The first conversion subunit is used to convert the linear operations contained in the data processing method into linear functions that conform to the multiplication and addition protocols of fully homomorphic encryption, provided that the data processing method conforms to linear operations.

[0130] The second conversion subunit is used to convert the data processing method into a linearized processing method when the data processing method does not conform to linear operation.

[0131] The third conversion subunit is used to convert the linear operations contained in the linearization process into linear functions that conform to the multiplication and addition protocols of fully homomorphic encryption.

[0132] Optionally, the second transformation subunit is used to select a matching transformation function based on the type of operation included in the data processing method; wherein the transformation function is a Taylor expansion, a piecewise function, an absolute value function, or a maximization / minimization function; using the transformation function, the data processing method is converted into a linearized processing method.

[0133] Optionally, it may also include a signature unit and a prompt unit;

[0134] The receiving unit is also used to receive the public key and digital signature transmitted by the AR device;

[0135] The signature unit is used to process the public key using a set signature method to obtain a signature result; if the signature result is consistent with the digital signature, it performs the step of converting the data processing method into a linear function supported by a fully homomorphic encryption algorithm.

[0136] The alert unit is used to issue an alarm when the signature result is inconsistent with the digital signature.

[0137] Optionally, the feedback unit is used to feed back the encrypted operation result to the AR device based on a wireless transmission protocol or a set private communication protocol.

[0138] Optionally, it may also include a setup unit and a recording unit;

[0139] The receiving unit is also used to receive the various operation types transmitted by the AR device and their corresponding operation numbers;

[0140] Establishment unit, used to establish linear functions matching each operation type using homomorphic addition and homomorphic multiplication of the fully homomorphic encryption algorithm;

[0141] The recording unit is used to record the correspondence between each linear function and each operation number;

[0142] Correspondingly, the receiving unit is used to receive the encrypted data to be processed and the corresponding target operation number transmitted by the AR device;

[0143] The conversion unit is used to query the linear function whose target operation number matches the correspondence between each linear function and each operation number.

[0144] Figure 2 The description of the features in the corresponding embodiments can be found in [reference needed]. Figure 1 The relevant descriptions of the corresponding embodiments will not be repeated here.

[0145] As can be seen from the above technical solution, the local device receives the encrypted data to be processed and the data processing method transmitted by the AR device. The encrypted data to be processed is obtained by the AR device encrypting the data using a public key and an encryption algorithm. The local device converts the data processing method into a linear function supported by a fully homomorphic encryption algorithm; it performs homomorphic operations on the encrypted data to be processed based on the linear function to obtain the encrypted operation result; and it feeds back the encrypted operation result to the AR device, so that the AR device, after receiving the encrypted operation result from the local device, can decrypt the encrypted operation result using a private key and a decryption algorithm to obtain the plaintext operation result. The private key and public key are a public-private key pair obtained using a key generation algorithm, and the encryption algorithm matches the decryption algorithm. In this technical solution, the AR device accelerates large-scale data operations by transmitting computationally complex data to the local device for processing, thereby improving the AR device's computing power. Furthermore, the fully homomorphic encryption algorithm protects the data to be processed by the AR device, providing extremely high security, avoiding the risk of user privacy data leakage, and thus optimizing the user experience.

[0146] Figure 3 This is a schematic diagram of the structure of a data processing device for an AR device provided in an embodiment of this application. It is applicable to AR devices and includes an encryption unit 31, a transmission unit 32, a receiving unit 33, and a decryption unit 34.

[0147] The encryption unit 31 is used to encrypt the data to be processed using a public key and an encryption algorithm, when the computational complexity of the data to be processed meets the outsourcing conditions, so as to obtain the ciphertext data to be processed.

[0148] The transmission unit 32 is used to transmit the ciphertext data to be processed and the data processing method to the local device, so that the local device can convert the data processing method into a linear function supported by the fully homomorphic encryption algorithm; perform homomorphic operation on the ciphertext data to be processed based on the linear function to obtain the ciphertext operation result, and feed the ciphertext operation result back to the AR device;

[0149] The receiving unit 33 is used to receive the encrypted operation result fed back by the local device;

[0150] The decryption unit 34 is used to decrypt the ciphertext operation result using the private key and the decryption algorithm to obtain the plaintext operation result; wherein, the private key and the public key are a public-private key pair obtained using the key generation algorithm, and the encryption algorithm is matched with the decryption algorithm.

[0151] Optionally, it also includes a screening unit and a pre-transmission unit;

[0152] The filtering unit is used to filter out operation types whose computational complexity meets the outsourcing criteria;

[0153] The pre-transmission unit is used to transmit each operation type and its corresponding operation number to the local device, so that the local device can use the homomorphic addition and homomorphic multiplication of the fully homomorphic encryption algorithm to establish a linear function matching each operation type; and record the correspondence between each linear function and each operation number.

[0154] Correspondingly, the transmission unit is used to transmit the encrypted data to be processed and the corresponding target operation number to the local device.

[0155] Figure 3 The description of the features in the corresponding embodiments can be found in [reference needed]. Figure 1 The relevant descriptions of the corresponding embodiments will not be repeated here.

[0156] As can be seen from the above technical solution, when the computational complexity of the data to be processed on the AR device meets the outsourcing conditions, the AR device uses a public key and an encryption algorithm to encrypt the data to be processed, obtaining ciphertext data; it then transmits the ciphertext data and the data processing method to the local device, so that the local device can convert the data processing method into a linear function supported by a fully homomorphic encryption algorithm; it performs homomorphic operations on the ciphertext data to be processed based on the linear function, obtaining the ciphertext operation result; and it feeds the ciphertext operation result back to the AR device. After receiving the ciphertext operation result from the local device, the AR device uses a private key and a decryption algorithm to decrypt the ciphertext operation result, obtaining the plaintext operation result; wherein, the private key and public key are a public-private key pair obtained using a key generation algorithm, and the encryption algorithm matches the decryption algorithm. In this technical solution, the AR device accelerates large-scale data computation by transmitting computationally complex data to the local device for processing, thereby improving the AR device's computing power. Furthermore, it uses a fully homomorphic encryption algorithm to protect the data to be processed on AR devices, providing extremely high security and avoiding the risk of user privacy data leakage, thereby optimizing the user experience.

[0157] Figure 4 A schematic diagram of the structure of a data processing system for an AR device provided in an embodiment of this application includes an AR device 41 and a local device 42;

[0158] AR device 41 is used to encrypt the data to be processed using a public key and an encryption algorithm, when the computational complexity of the data to be processed meets the outsourcing conditions, to obtain ciphertext data to be processed; transmit the ciphertext data to be processed and the data processing method to a local device 42; receive the ciphertext operation result fed back by the local device 42; and decrypt the ciphertext operation result using a private key and a decryption algorithm to obtain the plaintext operation result; wherein the private key and public key are a public-private key pair obtained using a key generation algorithm, and the encryption algorithm and decryption algorithm are matched.

[0159] The local device 42 is used to receive the ciphertext data to be processed and the data processing method transmitted by the AR device 41; convert the data processing method into a linear function supported by the fully homomorphic encryption algorithm; perform homomorphic operation on the ciphertext data to be processed based on the linear function to obtain the ciphertext operation result; and feed back the ciphertext operation result to the AR device 41.

[0160] Figure 4 The description of the features in the corresponding embodiments can be found in [reference needed]. Figure 1 The relevant descriptions of the corresponding embodiments will not be repeated here.

[0161] As can be seen from the above technical solution, when the computational complexity of the data to be processed on the AR device meets the outsourcing conditions, the AR device uses a public key and an encryption algorithm to encrypt the data to be processed, obtaining ciphertext data; it then transmits the ciphertext data and the data processing method to the local device. The local device converts the data processing method into a linear function supported by a fully homomorphic encryption algorithm; it performs homomorphic operations on the ciphertext data to be processed based on the linear function to obtain the ciphertext operation result; and it feeds back the ciphertext operation result to the AR device. After receiving the ciphertext operation result from the local device, the AR device uses a private key and a decryption algorithm to decrypt the ciphertext operation result to obtain the plaintext operation result; wherein, the private key and public key are a public-private key pair obtained using a key generation algorithm, and the encryption algorithm matches the decryption algorithm. In this technical solution, the AR device accelerates large-scale data computation by transmitting computationally complex data to the local device for processing, thereby improving the AR device's computing power. Furthermore, the fully homomorphic encryption algorithm protects the data to be processed on the AR device, providing extremely high security, avoiding the risk of user privacy data leakage, and thus optimizing the user experience.

[0162] Taking AR devices, such as AR glasses, as an example, Figure 5 This is a schematic diagram illustrating the interaction between AR glasses and a local device according to an embodiment of the present invention. During the operation of the AR glasses, the AR glasses encrypt the data d that needs to be outsourced for computational acceleration using the public key pk and the encryption algorithm Encrypt to obtain ciphertext c. The AR glasses send the ciphertext c and the computation number number to be performed to the local device. The local device performs the computation in the ciphertext state, obtaining the ciphertext computation result c'; the local device sends the ciphertext computation result to the AR glasses. The AR glasses decrypt c' using the private key sk and the decryption algorithm Decrypt to obtain the plaintext d' of the computation result. Thus, a privacy-preserving AR glasses computational acceleration is completed.

[0163] The AR glasses privacy protection computing acceleration solution based on fully homomorphic encryption can accelerate the large-scale data computing in AR glasses and provide extremely high security to avoid the leakage of user privacy data, thereby optimizing the user experience.

[0164] Figure 6 A structural diagram of an electronic device provided in an embodiment of this application, such as... Figure 6 As shown, the electronic device includes: a memory 60 for storing computer programs;

[0165] The processor 61 is used to execute a computer program to implement the steps of the data processing method of the AR device as described in the above embodiment.

[0166] The electronic devices provided in this embodiment may include, but are not limited to, smartphones, tablets, laptops, or desktop computers.

[0167] The processor 61 may include one or more processing cores, such as a quad-core processor or an octa-core processor. The processor 61 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 61 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, the processor 61 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, the processor 61 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0168] The memory 60 may include one or more computer-readable storage media, which may be non-transitory. The memory 60 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In this embodiment, the memory 60 is used to store at least the following computer program 601, which, after being loaded and executed by the processor 61, is capable of implementing the relevant steps of the data processing method for the AR device disclosed in any of the foregoing embodiments. In addition, the resources stored in the memory 60 may also include an operating system 602 and data 603, and the storage method may be temporary or permanent storage. The operating system 602 may include Windows, Unix, Linux, etc. The data 603 may include, but is not limited to, linear functions supported by fully homomorphic encryption algorithms.

[0169] In some embodiments, the electronic device may further include a display screen 62, an input / output interface 63, a communication interface 64, a power supply 65, and a communication bus 66.

[0170] Those skilled in the art will understand that Figure 6 The structures shown do not constitute a limitation on electronic devices and may include more or fewer components than those shown.

[0171] It is understood that if the data processing method of the AR device in the above embodiments is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the current technology, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and executes all or part of the steps of the methods in the various embodiments of this application. The aforementioned storage medium includes: USB flash drive, mobile hard drive, read-only memory (ROM), random access memory (RAM), electrically erasable programmable ROM, register, hard disk, removable disk, CD-ROM, magnetic disk, or optical disk, and other media capable of storing program code.

[0172] Based on this, embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps of the data processing method for the AR device described above.

[0173] The foregoing has provided a detailed description of a data processing method, apparatus, and system for an AR device according to embodiments of this application. The various embodiments are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since it corresponds to the method disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to in the method section.

[0174] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0175] The data processing method, apparatus, and system for an AR device provided in this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the embodiments above are only for the purpose of helping to understand the method and its core ideas. It should be noted that those skilled in the art can make several improvements and modifications to this application without departing from the principles of this application, and these improvements and modifications also fall within the protection scope of the claims of this application.

Claims

1. A data processing method for an AR device, characterized in that, For local devices, the method includes: Receive the various operation types and their corresponding operation numbers transmitted by the AR device; Using the homomorphic addition and homomorphic multiplication of the fully homomorphic encryption algorithm, a linear function matching each of the operation types is established; Record the correspondence between each linear function and each operation number; The system receives encrypted data to be processed and a data processing method transmitted from an AR device; wherein the encrypted data to be processed is obtained by the AR device encrypting the data to be processed using a public key and an encryption algorithm; The data processing method is converted into a linear function supported by a fully homomorphic encryption algorithm; Homomorphic operations are performed on the ciphertext data to be processed based on the linear function to obtain the ciphertext operation result; The ciphertext operation result is fed back to the AR device so that the AR device can use the private key and decryption algorithm to decrypt the ciphertext operation result to obtain the plaintext operation result; wherein, the private key and the public key are a public-private key pair obtained using a key generation algorithm, and the encryption algorithm is matched with the decryption algorithm; Accordingly, the process of receiving the encrypted data to be processed transmitted by the AR device and the data processing method, and converting the data processing method into a linear function supported by the fully homomorphic encryption algorithm, includes: Receive the encrypted data to be processed and the corresponding target operation number transmitted by the AR device; Search for the linear function that matches the target operation number from the correspondence between each of the linear functions and each of the operation numbers.

2. The data processing method for the AR device according to claim 1, characterized in that, The step of converting the data processing method into a linear function supported by a fully homomorphic encryption algorithm includes: Determine whether the data processing method conforms to linear arithmetic; If the data processing method conforms to linear operations, the linear operations contained in the data processing method are converted into linear functions that conform to the multiplication and addition protocols of fully homomorphic encryption. If the data processing method does not conform to linear operations, the data processing method is converted into a linearized processing method; the linear operations contained in the linearized processing method are converted into linear functions that conform to the multiplication and addition protocols of fully homomorphic encryption.

3. The data processing method for the AR device according to claim 2, characterized in that, The step of converting the data processing method into a linear processing method includes: Based on the types of operations included in the data processing method, a matching transformation function is selected; wherein, the transformation function is a Taylor expansion, a piecewise function, an absolute value function, or a maximization / minimization function; The data processing method is converted into a linearized processing method using the transformation function.

4. The data processing method for the AR device according to claim 1, characterized in that, Before converting the data processing method into a linear function supported by a fully homomorphic encryption algorithm, the method further includes: Receive the public key and digital signature transmitted by the AR device; The public key is processed using the set signature method to obtain the signature result; If the signature result matches the digital signature, the step of converting the data processing method into a linear function supported by a fully homomorphic encryption algorithm is performed. An alarm will be issued if the signature result is inconsistent with the digital signature.

5. The data processing method for the AR device according to claim 1, characterized in that, The step of feeding back the encrypted operation result to the AR device includes: The encrypted computation result is fed back to the AR device based on a wireless transmission protocol or a set private communication protocol.

6. A data processing device for an AR device, characterized in that, Applicable to local devices, the device includes a receiving unit, a conversion unit, a processing unit, and a feedback unit; The receiving unit is used to receive the encrypted data to be processed and the data processing method transmitted by the AR device; wherein, the encrypted data to be processed is obtained by the AR device encrypting the data to be processed using a public key and an encryption algorithm; The conversion unit is used to convert the data processing method into a linear function supported by the fully homomorphic encryption algorithm; The computation unit is used to perform homomorphic operations on the ciphertext data to be processed based on the linear function to obtain the ciphertext operation result; The feedback unit is used to feed back the ciphertext operation result to the AR device, so that the AR device can use the private key and decryption algorithm to decrypt the ciphertext operation result to obtain the plaintext operation result; wherein, the private key and the public key are a public-private key pair obtained by using a key generation algorithm, and the encryption algorithm is matched with the decryption algorithm; It also includes an establishment unit and a recording unit; the receiving unit is further configured to receive each operation type and its corresponding operation number transmitted by the AR device; the establishment unit is configured to establish a linear function matching each operation type using homomorphic addition and homomorphic multiplication of a fully homomorphic encryption algorithm; the recording unit is configured to record the correspondence between each linear function and each operation number; correspondingly, the receiving unit is configured to receive the ciphertext data to be processed transmitted by the AR device and the corresponding target operation number; the conversion unit is configured to query the linear function matching the target operation number from the correspondence between each linear function and each operation number.

7. A data processing method for an AR device, characterized in that, Applicable to AR devices, the method includes: If the computational complexity of the data to be processed meets the outsourcing conditions, the data to be processed is encrypted using a public key and an encryption algorithm to obtain the ciphertext data to be processed. The ciphertext data to be processed and the data processing method are transmitted to the local device so that the local device can convert the data processing method into a linear function supported by a fully homomorphic encryption algorithm; homomorphic operation is performed on the ciphertext data to be processed based on the linear function to obtain the ciphertext operation result, and the ciphertext operation result is fed back to the AR device; Receive the encrypted operation result fed back by the local device; The ciphertext operation result is decrypted using a private key and a decryption algorithm to obtain the plaintext operation result; wherein the private key and the public key are a public-private key pair obtained using a key generation algorithm, and the encryption algorithm is matched with the decryption algorithm; Before encrypting the data to be processed using a public key and an encryption algorithm to obtain the ciphertext data to be processed, the following steps are included: Filter out operation types whose computational complexity meets the outsourcing criteria; Each operation type and its corresponding operation number are transmitted to the local device so that the local device can establish a linear function matching each operation type using homomorphic addition and homomorphic multiplication of the fully homomorphic encryption algorithm; and the correspondence between each linear function and each operation number is recorded. Accordingly, the transmission of the encrypted data to be processed to the local device and the data processing method include: The encrypted data to be processed and the corresponding target operation number are transmitted to the local device.

8. A data processing system for an AR device, characterized in that, Including AR devices and local devices; The AR device is used to encrypt the data to be processed using a public key and an encryption algorithm, provided that the computational complexity of the data to be processed meets the outsourcing conditions, so as to obtain the ciphertext data to be processed. Transmit the encrypted data to be processed and the data processing method to the local device; The system receives the encrypted operation result from the local device; it then uses a private key and a decryption algorithm to decrypt the encrypted operation result to obtain the plaintext operation result; wherein the private key and the public key are a public-private key pair obtained using a key generation algorithm, and the encryption algorithm is matched with the decryption algorithm. The local device is configured to receive ciphertext data to be processed and data processing method transmitted from the AR device; convert the data processing method into a linear function supported by a fully homomorphic encryption algorithm; perform homomorphic operations on the ciphertext data to be processed based on the linear function to obtain a ciphertext operation result; and feed back the ciphertext operation result to the AR device. Before receiving the ciphertext data to be processed and data processing method transmitted from the AR device, the device further includes: receiving each operation type and its corresponding operation number transmitted from the AR device; establishing a linear function matching each operation type using homomorphic addition and homomorphic multiplication of the fully homomorphic encryption algorithm; and recording the correspondence between each linear function and each operation number. Correspondingly, receiving the ciphertext data to be processed and data processing method transmitted from the AR device, and converting the data processing method into a linear function supported by a fully homomorphic encryption algorithm, includes: receiving the ciphertext data to be processed and the corresponding target operation number transmitted from the AR device; and querying the linear function matching the target operation number from the correspondence between each linear function and each operation number.

Images