Display method, display terminal, augmented reality device, electronic device, and medium
Patent Information
- Application Number
- CN202611000749.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-07-06
- Publication Date
- 2026-10-20
Smart Images
Figure FT_1 
Figure FT_2 
Figure FT_3
Abstract
Description
Technical Field
[0001] This invention relates to the field of display, and more particularly to a display method, display terminal, augmented reality device, electronic device, and medium. Background Technology
[0002] When users use display devices, the content displayed on the screen can be seen by others, posing a privacy leak problem. Existing technologies for preventing leaks typically involve controlling the screen's viewing angle; however, others can still see the screen content even when within the viewing angle. Current display devices are not very effective at preventing privacy leaks in terms of screen display. Summary of the Invention
[0003] The main objective of this invention is to provide a display method, display terminal, augmented reality device, electronic device, and medium, aiming to solve the problem that the existing display devices are not very effective in preventing privacy leaks in terms of screen display.
[0004] To achieve the above objectives, the present invention provides a display method applied to a display terminal, the display method comprising: Obtain the data to be displayed, wherein the data to be displayed includes basic display data and privacy display data; Obtain the encryption signature of the associated augmented reality device; The basic display data is displayed, and the privacy display data is encrypted using the encryption feature, so that the augmented reality device can decrypt the privacy display data using the encryption feature, and combine the basic display data and the decrypted privacy display data to obtain a complete display screen.
[0005] Optionally, encrypting the privacy display data using the encryption feature includes: Match the target encoding method corresponding to the encryption feature; Privacy-encoded data is obtained by encoding the privacy display data using the target encoding method. The privacy-encoded data is overlaid on the basic display data for display.
[0006] Optionally, encoding the privacy display data using the target encoding method to obtain privacy-encoded data includes: The privacy display data is converted into a two-dimensional feature map corresponding to the display screen of the display terminal; Generate the visual noise signal corresponding to the two-dimensional feature map; The visual noise signal is used as the privacy-encoded data.
[0007] Optionally, the step of overlaying the privacy-encoded data onto the basic display data for display includes: The transparency of the privacy-encoded data is adjusted to a preset transparency to obtain transparent privacy-encoded data. The transparent privacy-encoded data is overlaid on the basic display data for display.
[0008] Optionally, encrypting the privacy display data using the encryption feature includes: Identify the target augmented reality device corresponding to the encryption feature; The privacy display data is sent to the target augmented reality device.
[0009] To achieve the above objectives, the present invention also provides a display method applied to an augmented reality device, the display method comprising: The encryption feature is acquired and sent to the display terminal so that the display terminal can encrypt and display the privacy display data based on the encryption feature. Obtain the privacy display data that is encrypted and displayed on the display terminal; The privacy display content corresponding to the privacy display data is determined by the encryption features; The privacy display content is displayed and combined with the basic display content on the display terminal to obtain a complete display screen.
[0010] Optionally, obtaining the encryption features includes: The user wearing the augmented reality device is identified to obtain the user's corresponding identity identifier; Generate the encryption feature corresponding to the identity identifier.
[0011] Optionally, the identification of the user wearing the augmented reality device includes: Obtain the user's iris image; Iris recognition is performed on the iris image to obtain the user's corresponding identity identifier.
[0012] Optionally, determining the privacy display content corresponding to the privacy display data through the encryption feature includes: Acquire the display screen data in the display terminal; High-frequency extraction is performed on the displayed image data to obtain a high-frequency texture map; Privacy feature data is obtained by extracting features from the high-frequency texture map; The privacy display content is obtained by decoding the privacy feature data based on the encryption features.
[0013] Optionally, determining the privacy display content corresponding to the privacy display data through the encryption feature includes: Obtain the privacy display data sent by the display terminal; Control the screen transparency state of the augmented reality device to be opaque; The privacy display data is displayed.
[0014] To achieve the above objectives, the present invention also provides a display terminal, which is applied to the display method described in any of the preceding claims.
[0015] To achieve the above objectives, the present invention also provides an augmented reality device applied to the display method described in any of the preceding claims.
[0016] To achieve the above objectives, the present invention also provides an electronic device, the electronic device including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the display method as described above.
[0017] To achieve the above objectives, the present invention also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps of the display method described above.
[0018] This invention proposes a display method, display terminal, augmented reality device, electronic device, and medium. The method involves acquiring data to be displayed, which includes basic display data and privacy display data; acquiring the encryption features of an associated augmented reality device; displaying the basic display data; and encrypting the privacy display data using the encryption features, enabling the augmented reality device to decrypt the privacy display data using the encryption features. The complete display image is then obtained by combining the basic display data and the decrypted privacy display data. By dividing the data to be displayed into basic display data and privacy display data, and encrypting the privacy display data based on the augmented reality device, only the associated augmented reality device can access the content of the privacy display data. Furthermore, the encrypted display of the privacy display data ensures that only the user wearing the augmented reality device can see the privacy display data, and thus, combined with the basic display data, the complete image is displayed. This reliably prevents others from seeing the privacy display data, improving the security of privacy information. Attached Figure Description
[0019] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.
[0020] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, those skilled in the art can obtain other drawings based on these drawings without creative effort.
[0021] Figure 1 This is a flowchart illustrating the application of the first embodiment of the display method of the present invention to a display terminal; Figure 2 This is a schematic diagram of the process of applying the first embodiment of the display method of the present invention to an augmented reality device; Figure 3 This is a detailed flowchart of the method of the present invention; Figure 4 This is a schematic diagram of the module structure of the electronic device of the present invention. Detailed Implementation
[0022] It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, and not all of them. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of this application.
[0023] This invention provides a display method, referring to... Figure 1 , Figure 1 This is a flowchart illustrating the first embodiment of the display method of the present invention applied to a display terminal. The method includes the following steps: Step S110: Obtain the data to be displayed, wherein the data to be displayed includes basic display data and privacy display data; The data to be displayed is the display data corresponding to the complete display screen; the specific content of the data to be displayed is set based on the actual display needs; for example, if encryption is not used, the screen data of the display terminal is the data to be displayed. In this embodiment, the privacy display data is encrypted, so the data to be displayed is divided into basic display data and privacy display data.
[0024] The basic display data is the data in the data to be displayed that does not require privacy protection, that is, the display data in the data to be displayed excluding the privacy display data.
[0025] The privacy-displaying data refers to the data that needs to be protected for privacy among the data to be displayed.
[0026] The basic display data and privacy display data in the data to be displayed can be set according to actual needs; they can be preset or set by the user; for example, the data in the data to be displayed can be automatically detected, and the data belonging to the privacy protection type can be used as privacy display data, while the other data can be used as basic display data. The privacy protection type can be set according to actual needs, and may include: User-specific content: For example, within a certain system, different users have different data, such as usage data and user information. When this type of content is detected, it is displayed as private data. Files involving privacy, such as photos and emails, will be treated as privacy data when the system detects that such files need to be displayed. Privacy-related interfaces: such as chat software interfaces and specific web pages. When it is detected that such interfaces or web pages need to be displayed, they will be treated as privacy-related data. Specific data displayed in the interface, such as ID card information, address, contact information, and confidential data in documents, application interfaces, or web pages, are displayed as private data, while other content in the display interface is still considered basic data.
[0027] Content with confidentiality markings: To further enable automatic identification of privacy-displayed data, confidentiality markings can be set for relevant files, interfaces, etc. The specific form of the confidentiality markings can be set according to actual needs. For example, a fixed text can be set as a confidentiality marking in the file name. When the file name of a displayed file is detected to contain this fixed text, it will be used as privacy-displayed data. Alternatively, a watermark of a confidentiality marking such as a fixed text or fixed icon can be added to the display interface of a specific software, webpage, or document. When the watermark of the confidentiality marking is detected, the display interface will be used as privacy-displayed data.
[0028] Users can set privacy display data according to their own needs, and can also add or delete content as privacy display data based on the preset privacy protection types.
[0029] In practical applications, for the data to be displayed, the privacy display data contained therein can be determined first based on presets or user settings. After determination, other data in the data to be displayed can be used as the basic display data.
[0030] Step S120: Obtain the encryption characteristics of the associated augmented reality device; AR (Augmented Reality) devices are used to overlay virtual information onto the real environment; the specific type of augmented reality device can be set according to actual needs, such as AR glasses, AR helmets, etc.
[0031] Augmented reality devices associated with display terminals can communicate with the display terminals to transmit data.
[0032] The specific connection method can be set according to actual needs, such as building a communication connection between augmented reality devices and display terminals through Bluetooth, local area networks, etc.
[0033] Encryption features are data used to control the encrypted display process for augmented reality devices. It is understood that different augmented reality devices have different encryption features, and the same augmented reality device has different encryption features when used by different users. The specific form and content of encryption features can be set based on actual needs.
[0034] The encryption features are sent from the associated augmented reality device to the display terminal.
[0035] A display terminal is a display device with a publicly accessible display screen; a publicly accessible display screen refers to a screen whose content can be seen by people other than the user during use; such as computers, mobile phones, tablets, etc. When using these terminals, as long as others are within the display's viewing angle, they can see the content displayed on the screen.
[0036] As for augmented reality devices, their screens are set up in the form of lenses, so only the user wearing the augmented reality device can see the content displayed by the device.
[0037] Step S130: Display the basic display data and encrypt the privacy display data using the encryption feature, so that the augmented reality device can decrypt the privacy display data using the encryption feature and combine the basic display data and the decrypted privacy display data to obtain a complete display screen.
[0038] The basic display data is displayed on the display terminal; in other embodiments, the basic display data may also be sent to an augmented reality device for display.
[0039] Since privacy display data requires privacy protection, directly displaying it on the display terminal would allow other users to see it. Therefore, in this embodiment, the privacy display data is encrypted using encryption features, converting it into data that is not directly recognizable by the human eye. This prevents other users from seeing the privacy display data, while the user wearing the augmented reality device can decrypt the encrypted privacy display data using the encryption features. The decrypted privacy display data is then combined with the basic display data displayed on the display terminal to obtain the complete display screen corresponding to the data to be displayed.
[0040] In practical applications, the encryption and decryption methods correspond to the encryption features. After the encryption features are determined, the decryption method on the augmented reality device (ARD) corresponds to the encryption and display method on the display terminal, thereby enabling the ARD to decrypt the privacy-displayed data. Specific encryption and decryption methods can be set according to actual needs. For example, the encryption feature may indicate a set of keys, which are used for encryption and decryption. Alternatively, the encryption feature may correspond to a set of encryption and decryption methods, with the AR terminal displaying the data using the encryption method corresponding to the encryption feature, and the ARD device decrypting it using the decryption method. Furthermore, the encryption feature may indicate the parameters involved in encryption and decryption. For instance, if the encryption method involves perturbation and transformation of the privacy-displayed data, the encryption feature can indicate the perturbation parameters, and the ARD device can perform reverse decryption based on the perturbation parameters.
[0041] See Figure 2 The display method is applied to an augmented reality device, and the display method includes: Step S210: Obtain the encryption feature and send the encryption feature to the display terminal so that the display terminal can encrypt and display the privacy display data based on the encryption feature; Step S220: Obtain the privacy display data that is encrypted and displayed on the display terminal; Step S230: Determine the privacy display content corresponding to the privacy display data through the encryption feature; Step S240: Display the privacy display content to combine it with the basic display content on the display terminal to obtain a complete display screen.
[0042] The specific methods by which augmented reality devices acquire encryption features can be set based on actual needs. For example, they can acquire relevant user information to generate or match corresponding encryption features, such as determining encryption features based on the user's logged-in account, or identifying the user and then determining encryption features based on the user's identity; or they can generate or match corresponding encryption features based on their own device information.
[0043] After acquiring the encryption features, the augmented reality device sends the encryption features to the display terminal; the display terminal then displays the privacy-protected content in encrypted form based on the encryption features.
[0044] Augmented reality devices decrypt encrypted data to obtain the private display content based on the encryption features.
[0045] The privacy display content is the actual display content extracted from the encrypted privacy display data.
[0046] After obtaining the privacy display content, the privacy display content is displayed on the augmented reality device. At this time, the display terminal displays the basic display data, and the augmented reality device displays the privacy display content. Combining the two will yield the complete display screen corresponding to the data to be displayed.
[0047] Understandably, the basic display data on the display terminal is fixed on the display terminal, while the content displayed by the augmented reality device changes as the user's head moves. Therefore, in actual display, the specific display method of the privacy display content can be set according to actual needs. For example, the privacy display content can be displayed along with the display screen of the display terminal. In this way, the relative position between the privacy display content and the basic display data is fixed. The privacy display content seen by the user is directly displayed in the position where the privacy display content needs to be displayed on the display terminal. Combining the basic display data and the privacy display content yields a complete display screen with the same positions as the data to be displayed. Alternatively, the privacy display content can be set to follow the augmented reality device, such as always displaying it in a fixed area of the augmented reality device's display screen. In this case, the relative position between the privacy display content and the basic display data is not fixed, so the user can focus on the display of the privacy display content.
[0048] This embodiment divides the data to be displayed into basic display data and privacy display data, and encrypts the privacy display data based on the augmented reality device. This ensures that only the associated augmented reality device can access the content of the privacy display data, and then the privacy display data is encrypted and displayed so that only the user wearing the augmented reality device can see the privacy display data. Combined with the basic display data, the complete picture can be seen, reliably preventing others from seeing the privacy display data and improving the security of privacy information.
[0049] Further details will follow. Figure 3 In the second embodiment of the display method of the present invention based on the first embodiment of the present invention, step S130 includes the following steps: Step S131: Match the target encoding method corresponding to the encryption feature; Step S132: Encode the privacy display data using the target encoding method to obtain privacy encoded data; Step S133: Overlay the privacy-encoded data onto the basic display data for display.
[0050] The encoding method refers to the way privacy-displaying data is encoded in encrypted displays. The specific type of encoding method can be set according to actual needs, such as data encryption, perturbation conversion, etc.
[0051] The target encoding method is the encoding method corresponding to the encryption feature; the corresponding encoding method can be preset for different encryption features, and the display terminal matches the target encoding method corresponding to the encryption feature after receiving the encryption feature.
[0052] Augmented reality (AR) devices and display terminals authenticate each other via a communication link. Different AR devices correspond to different target encoding methods, and the display terminal stores a mapping relationship between each AR device and its target encoding method. After successful authentication, the display terminal retrieves the corresponding target encoding method based on the identity information of the currently connected AR device to establish a suitable data transmission channel. Simultaneously, each AR device is pre-configured with different access permissions, which at least limit the range of privacy display data it can retrieve from the display terminal, ensuring that the privacy display data obtained by different AR devices is distinct. After determining the target encoding method, the privacy display data is encoded based on the target encoding method to obtain privacy-encoded data.
[0053] Privacy-encoded data is the displayed data after the privacy display data has been encrypted.
[0054] By overlaying privacy-encoded data onto the basic display data, other personnel can only see the content of the basic display data, thus preventing the leakage of privacy display data.
[0055] Further, step S132 includes the following steps: Step S1321: Convert the privacy display data into a two-dimensional feature map corresponding to the display screen of the display terminal; Step S1322: Generate the visual noise signal corresponding to the two-dimensional feature map; Step S1323: Use the visual noise signal as the privacy-encoded data.
[0056] In this embodiment, encryption is achieved by converting the privacy display data into a perturbation signal.
[0057] It is understandable that both the basic display data and the privacy display data are set based on the screen parameters of the display terminal. Therefore, in order to ensure the consistency of the basic display data and the privacy display data in terms of display size and position, the privacy display data is converted into a two-dimensional feature map that matches the display screen of the display terminal.
[0058] First, convert the privacy display data into binary data or a feature matrix, then map the binary data or feature matrix onto the display screen to obtain a two-dimensional feature map:
[0059] Where F(x, y) is a two-dimensional feature map, x indicates the horizontal coordinate, y indicates the vertical coordinate; m indicates the width of the display screen; and n indicates the height of the display screen.
[0060] The two-dimensional feature map is then converted into a visual noise signal. The specific conversion method can be set according to actual needs, such as Fourier high-frequency embedding or structured noise coding. The conversion method can be indicated by encryption features. For example, if the encryption feature indicates Fourier high-frequency embedding, the display terminal will encrypt using Fourier high-frequency embedding, and the augmented reality device will decrypt using Fourier high-frequency embedding.
[0061] Fourier high-frequency embeddings include: Performing a Fourier transform on the two-dimensional feature map yields the corresponding frequency domain information.
[0062] Where F(u, v) indicates the frequency signal.
[0063] Select the high-frequency region in the frequency signal and perform amplitude modulation on the high-frequency region:
[0064] Where F'(u, v) represents the high-frequency region; F''(u, v) represents the frequency signal after amplitude modulation; and α represents the amplitude. The visual noise signal is obtained by performing an inverse Fourier transform on the frequency signal.
[0065] Where N(x, y) is the visual noise signal.
[0066] Structured noise coding includes: The 2D feature map is converted into a seed. The size of the display image and the seed are then input into a PRNG (PseudoRandom Number Generator) to obtain a visual noise signal.
[0067] Where B represents the size of the displayed image.
[0068] After obtaining the visual noise signal, the visual noise signal is superimposed on the basic display data as privacy-encoded data. The privacy-encoded data is then converted into a visual noise signal, which cannot be read by the naked eye. This visual noise signal is then superimposed on the normal basic display data.
[0069] Further, step S133 includes the following steps: Step S1331: Adjust the transparency of the privacy-encoded data to a preset transparency to obtain transparent privacy-encoded data; Step S1332: Overlay the transparent privacy-encoded data onto the basic display data for display.
[0070] It is understandable that privacy-encoded data is superimposed on the basic encoded data after being encoded. Therefore, the privacy-encoded data exhibits noise characteristics that are not the original content, which can affect the integrity of the display. At the same time, other people can also intuitively see the abnormality of the confidential display. In order to avoid this problem, this embodiment sets the transparency of the privacy-encoded data when superimposing it, so that the privacy-encoded data presents slight texture or noise, thereby reducing the visual perception of the privacy-encoded data.
[0071] The preset transparency is the transparency corresponding to the pre-set privacy-encoded data; the specific value of the preset transparency can be set according to actual needs.
[0072] Transparent privacy-encoded data is data obtained by setting transparency for privacy-encoded data.
[0073] Overlay transparent privacy-encoded data onto the base display data:
[0074] Among them, I out (x, y) represents the final content displayed on the terminal; I base (x, y) is the base display data; β is the preset transparency.
[0075] Further, step S230 includes the following steps: Step S231: Obtain the display screen data in the display terminal; Step S232: High-frequency extraction is performed on the displayed image data to obtain a high-frequency texture map; Step S233: Extract features from the high-frequency texture map to obtain privacy feature data; Step S234: Decode the privacy feature data based on the encryption feature to obtain the privacy display content.
[0076] When encrypted display is used to overlay privacy-encoded data on a display terminal, the augmented reality device needs to extract and decrypt the encrypted privacy-encoded data from the screen displayed on the display terminal.
[0077] Display screen data refers to the actual content displayed on the display terminal, including basic display data and privacy display data. The specific method of acquiring display screen data can be set according to actual needs, such as capturing images from a camera to obtain the real-world image, and then segmenting the display screen of the display terminal in the real-world image to obtain display screen data.
[0078] It is understandable that due to issues such as viewing angle shift, perspective distortion, and refresh rate differences on the screen, the collected display data is prone to deviation. Therefore, after collecting the display data, it is advisable to first correct and align the display data before performing subsequent operations. The correction and alignment methods can be set according to actual needs, such as using feature point matching methods like SIFT (Scale-invariant feature transform) or ORB (Oriented FAST and Rotated BRIEF), or homography transformation to achieve correction and alignment.
[0079] High-frequency extraction involves extracting high-frequency content from the displayed image data. This means that during encryption, the high-frequency content of the privacy-preserving displayed data is extracted before encryption. Therefore, during decryption, high-frequency content is extracted from the displayed image data to obtain a high-frequency texture map. Specifically, a high-pass filter is first applied to the displayed image data:
[0080] Where: H(x, y) is the high-pass filtered image data; I aligned This refers to the corrected and aligned display data.
[0081] The high-frequency subband is obtained by performing a Fourier transform on the high-pass filtered image data, and then the high-frequency subband is transformed into the spatial domain of the display image to obtain a high-frequency texture map.
[0082] Feature extraction is performed on high-frequency texture maps to obtain the privacy features contained therein; the specific extraction method can be set according to actual needs, such as using CNN (Convolutional Neural Network) / Transformer to achieve privacy feature extraction.
[0083] The privacy features are extracted and decoded to obtain the corresponding privacy display content; the specific decoding method is determined based on the encryption method, such as restoring the corresponding privacy display content by performing the inverse operation on the conversion method.
[0084] After obtaining the privacy display content, overlay the privacy display content onto the corresponding position in the real-world image data:
[0085] Among them, I AR The final content displayed by the augmented reality device; I_world represents the real-time captured image; P' represents the privacy-preserving content.
[0086] Furthermore, in the third embodiment of the display method of the present invention based on the first embodiment of the present invention, step S130 includes the following steps: Step S134: Determine the target augmented reality device corresponding to the encryption feature; Step S135: Send the privacy display data to the target augmented reality device.
[0087] In this embodiment, point-to-point data transmission is used as a means of encrypted display; the privacy display data is sent to the target augmented reality device for direct display, thereby directly eliminating the possibility of others seeing the privacy display data through the display terminal on the physical carrier.
[0088] The encryption feature is sent from the augmented reality device to the display terminal; therefore, the corresponding target augmented reality device can be identified through the encryption feature.
[0089] The target augmented reality device is the source device for the encryption feature.
[0090] Once the target augmented reality device is identified, privacy display data is sent to the target augmented reality device.
[0091] Further, step S230 includes the following steps: Step S235: Obtain the privacy display data sent by the display terminal; Step S236: Control the screen transparency state of the augmented reality device to opaque; Step S237: Display the privacy display data.
[0092] After receiving the privacy display data sent by the display terminal, the privacy display data will be displayed.
[0093] Understandably, when the privacy display data is part of the overall display content such as the interface or page, since the privacy display data is directly transmitted to the augmented reality device, setting the screen transparency of the augmented reality device to opaque allows the user to clearly see a private display that is not visible to others, thus enhancing the immersive viewing experience.
[0094] In other embodiments, the screen transparency state can also be set to transparent. For example, when the privacy display data is specific data in the interface, the screen transparency can be adjusted to combine the basic display data for overall viewing.
[0095] Furthermore, in the fourth embodiment of the display method of the present invention based on the first embodiment of the present invention, step S210 includes the following steps: Step S211: Identify the user wearing the augmented reality device to obtain the user's corresponding identity identifier; Step S212: Generate the encryption feature corresponding to the identity identifier.
[0096] To further bind the display of privacy data to users, when a user wears an augmented reality device, the user's identity is obtained, and an encrypted feature corresponding to that identity is generated. This allows the encryption of the display terminal and the decryption of the augmented reality device to be performed based on the user's identity. When other people also wear augmented reality devices, because different users generate different encrypted features, other augmented reality devices cannot decrypt the privacy data.
[0097] An identity identifier is used to indicate the uniqueness of a user; the type of identity identifier can be set based on actual needs, such as identity code, username, etc.
[0098] The specific method of identity verification can be set according to actual needs, such as iris recognition, fingerprint recognition, voiceprint recognition, password verification, etc.
[0099] Further, step S211 includes the following steps: Step S2111: Obtain the iris image of the user; Step S2112: Perform iris recognition on the iris image to obtain the user's corresponding identity identifier.
[0100] In this embodiment, the user's identity is determined by iris recognition.
[0101] An iris image is an image obtained by capturing the user's iris.
[0102] The method of acquiring iris images can be set according to actual needs. For example, high-definition near-infrared light can be installed on the inside of the temple or the crossbeam of the frame of the augmented reality device. The wavelength can be set to 850nm or 940nm. Near-infrared light penetrates the corneal reflective layer on the surface of the eyeball and clearly illuminates the iris texture structure that is covered by pigment. Then, the iris image is acquired to obtain a high-contrast eye image, and the iris image is extracted from the eye image.
[0103] By using algorithms such as filtering and encoding, the most distinctive feature points in the iris image are extracted to obtain the corresponding binary code, i.e., iris texture features. The specific algorithm can be set according to actual needs, such as Gabor transform, deep learning, etc. The identity identifier corresponding to the iris texture features is matched in the feature library that stores the iris texture features pre-entered by the user.
[0104] The specific matching method can be set according to actual needs, such as comparing the extracted iris texture features with pre-stored template features in the database. By calculating similarity measures such as the Hamming distance between the two features, it is determined whether they match; the identity identifier corresponding to the template feature that is closest and whose similarity exceeds a set threshold is found; the specific value of the threshold can be set according to actual needs; then the identity identifier is sent to the display terminal.
[0105] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application.
[0106] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods according to the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.
[0107] This application also provides a display terminal for implementing the above-described display method, wherein the display terminal is applied to the display method described above: This application also provides an augmented reality device for implementing the above-described display method, wherein the augmented reality device is applied to the display method described above: Reference Figure 4 In terms of hardware structure, the electronic device may include components such as a communication module 10, a memory 20, and a processor 30. In the electronic device, the processor 30 is connected to both the memory 20 and the communication module 10. The memory 20 stores a computer program, which is executed by the processor 30. When the computer program is executed, it implements the steps of the above-described method embodiments.
[0108] The communication module 10 can connect to external communication devices via a network. The communication module 10 can receive requests from the external communication devices and can also send requests, instructions, and information to the external communication devices. The external communication devices can be other electronic devices, servers, or IoT devices, such as televisions, etc.
[0109] The memory 20 can be used to store software programs and various data. The memory 20 may primarily include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as retrieving data to be displayed), etc.; the data storage area may include a database, and may store data or information created based on system usage. Furthermore, the memory 20 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.
[0110] The processor 30 is the control center of the electronic device. It connects various parts of the electronic device via various interfaces and lines. By running or executing software programs and / or modules stored in the memory 20, and by calling data stored in the memory 20, it performs various functions and processes data, thereby providing overall monitoring of the electronic device. The processor 30 may include one or more processing units; optionally, the processor 30 may integrate an application processor and a modem processor. The application processor mainly handles the operating system, user interface, and applications, while the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 30.
[0111] although Figure 4 Not shown, but the above-described electronic device may further include a circuit control module for connecting to a power supply to ensure the normal operation of other components. Those skilled in the art will understand that... Figure 4 The electronic device structure shown does not constitute a limitation on the electronic device and may include more or fewer components than shown, or combine certain components, or have different component arrangements.
[0112] The present invention also proposes a computer-readable storage medium having a computer program stored thereon. The computer-readable storage medium may be... Figure 4The memory 20 in the electronic device may be at least one of ROM (Read-Only Memory) / RAM (Random Access Memory), magnetic disk, optical disk, etc. The computer-readable storage medium includes a number of instructions to cause a terminal device with a processor (which may be a television, automobile, mobile phone, computer, server, terminal, or network device, etc.) to execute the methods described in the various embodiments of the present invention.
[0113] In this invention, the terms "first," "second," "third," "fourth," and "fifth" are used for descriptive purposes only and should not be construed as indicating or implying relative importance. Those skilled in the art can understand the specific meaning of the above terms in this invention according to the specific circumstances.
[0114] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of the present invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.
[0115] Although embodiments of the present invention have been shown and described above, the scope of protection of the present invention is not limited thereto. It is understood that the above embodiments are exemplary and should not be construed as limiting the present invention. Those skilled in the art can make changes, modifications, and substitutions to the above embodiments within the scope of the present invention, and such changes, modifications, and substitutions should all be covered within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.
Claims
1. A display method, characterized in that, The display method is applied to a display terminal, and the display method includes: Obtain the data to be displayed, wherein the data to be displayed includes basic display data and privacy display data; Obtain the encryption signature of the associated augmented reality device; The basic display data is displayed, and the privacy display data is encrypted using the encryption feature, so that the augmented reality device can decrypt the privacy display data using the encryption feature, and combine the basic display data and the decrypted privacy display data to obtain a complete display screen.
2. The display method as described in claim 1, characterized in that, The step of encrypting and displaying the privacy display data using the encryption feature includes: Match the target encoding method corresponding to the encryption feature; Privacy-encoded data is obtained by encoding the privacy display data using the target encoding method. The privacy-encoded data is overlaid on the basic display data for display.
3. The display method as described in claim 2, characterized in that, The step of encoding the privacy display data using the target encoding method to obtain privacy-encoded data includes: The privacy display data is converted into a two-dimensional feature map corresponding to the display screen of the display terminal; Generate the visual noise signal corresponding to the two-dimensional feature map; The visual noise signal is used as the privacy-encoded data.
4. The display method as described in claim 2, characterized in that, The step of overlaying the privacy-encoded data onto the basic display data for display includes: The transparency of the privacy-encoded data is adjusted to a preset transparency to obtain transparent privacy-encoded data. The transparent privacy-encoded data is overlaid on the basic display data for display.
5. The display method as described in claim 1, characterized in that, The step of encrypting and displaying the privacy display data using the encryption feature includes: Identify the target augmented reality device corresponding to the encryption feature; The privacy display data is sent to the target augmented reality device.
6. A display method, characterized in that, The display method is applied to an augmented reality device, and the display method includes: The encryption feature is acquired and sent to the display terminal so that the display terminal can encrypt and display the privacy display data based on the encryption feature. Obtain the privacy display data that is encrypted and displayed on the display terminal; The privacy display content corresponding to the privacy display data is determined by the encryption features; The privacy display content is displayed and combined with the basic display content on the display terminal to obtain a complete display screen.
7. The display method as described in claim 6, characterized in that, The acquisition of encryption features includes: The user wearing the augmented reality device is identified to obtain the user's corresponding identity identifier; Generate the encryption feature corresponding to the identity identifier.
8. The display method as described in claim 7, characterized in that, The process of identifying the user wearing the augmented reality device includes: Obtain the user's iris image; Iris recognition is performed on the iris image to obtain the user's corresponding identity identifier.
9. The display method as described in claim 6, characterized in that, The step of determining the privacy display content corresponding to the privacy display data through the encryption feature includes: Acquire the display screen data in the display terminal; High-frequency extraction is performed on the displayed image data to obtain a high-frequency texture map; Privacy feature data is obtained by extracting features from the high-frequency texture map; The privacy display content is obtained by decoding the privacy feature data based on the encryption features.
10. The display method as described in claim 6, characterized in that, The step of determining the privacy display content corresponding to the privacy display data through the encryption feature includes: Obtain the privacy display data sent by the display terminal; Control the screen transparency state of the augmented reality device to be opaque; The privacy display data is displayed.
11. A display terminal, characterized in that, The display terminal is used in the display method as described in any one of claims 1 to 5.
12. An augmented reality device, characterized in that, The augmented reality device is applied to the display method as described in any one of claims 6 to 10.
13. An electronic device, characterized in that, The electronic device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the display method as described in any one of claims 1 to 5 or 6 to 10.
14. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of the display method as described in any one of claims 1 to 5 or 6 to 10.