Visual information display method and device, AR device, and storage medium

Abstract

The application relates to the technical field of optical imaging, and provides a visual information display method and device, AR equipment and a storage medium, the method comprises the following steps: acquiring a first light field corresponding to visual information output by AR equipment; performing phase encoding on the first light field to obtain a corresponding second light field; acquiring current line-of-sight focal point information of a wearer of the AR equipment; based on the line-of-sight focal point information, demodulating the second light field to obtain a corresponding third light field, and presenting the visual information to the wearer through light rays of the third light field. The embodiment of the application improves the security of visual information display based on the AR equipment.

Description

Technical Field

[0001] This application relates to the field of optical imaging technology, and in particular to a visual information display method, device, AR device, and storage medium. Background Technology

[0002] With technological advancements, AR (Augmented Reality) glasses, AR headsets, and other AR devices have been applied in various fields such as navigation, gaming, education, and healthcare, providing users with diverse services. However, current AR devices lack robust privacy protection features. For instance, with AR glasses, the privacy screen protectors commonly used on mobile phones and other devices prevent the wearer from observing the real world. Since privacy screen protectors cannot be applied to AR glasses, the content displayed can be seen not only by the wearer but also by others, posing a risk of privacy breaches. Summary of the Invention

[0003] This application provides a visual information display method, apparatus, AR device, and storage medium, aiming to improve the security of visual information display based on AR devices.

[0004] In a first aspect, this application provides a method for displaying visual information based on an AR device, the method comprising:

[0005] Obtain the first light field corresponding to the visual information output by the AR device;

[0006] Phase encoding is performed on the first optical field to obtain the corresponding second optical field;

[0007] Obtain the current gaze focus information of the wearer of the AR device;

[0008] Based on the gaze focus information, the second light field is demodulated to obtain a corresponding third light field, and the visual information is presented to the wearer through the light of the third light field.

[0009] Secondly, this application also provides an AR device, the AR device comprising:

[0010] Optical engine, which is used to output light for visual information;

[0011] A microlens array, disposed at the optomechanical emission position, is used to scatter the visual information light rays at different angles to obtain a first light field;

[0012] A phase modulation device is used to perform time-division multiplexing encoding on the phase of the first optical field to obtain a second optical field;

[0013] An eye-tracking module is used to track the eyes of the wearer of the AR device and obtain gaze focus information;

[0014] A spatial light modulator, disposed behind the phase modulation device, is used to phase modulate the second light field according to the gaze focus information to obtain a third light field, and to present visual information to the wearer through the light of the third light field.

[0015] Thirdly, this application also provides a visual information display device, which includes a memory and a processor;

[0016] The memory is used to store computer programs;

[0017] The processor is configured to execute the computer program and, when executing the computer program, implement the steps of the visual information display method based on the AR device as described above.

[0018] Fourthly, this application also provides an AR device, which includes the visual information display device as described above.

[0019] Fifthly, this application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of the above-described visual information display method based on an AR device.

[0020] This application discloses a visual information display method, device, AR device, and storage medium. By acquiring a first light field corresponding to the visual information output by the AR device, performing phase encoding on the first light field to obtain a corresponding second light field, and acquiring the current gaze focus information of the wearer of the AR device, the second light field is demodulated based on the gaze focus information to obtain a corresponding third light field. After the light from the third light field diverges, only the light rays that are directed towards the wearer converge to restore and present the visual information. The light rays that are directed in other directions cannot restore the visual information after convergence, thereby avoiding the leakage of visual information. Therefore, the security of visual information display based on AR devices is improved. Attached Figure Description

[0021] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0022] Figure 1 A flowchart illustrating a visual information display method based on an AR device, provided as an embodiment of this application;

[0023] Figure 2 A schematic diagram of a sub-process of another visual information display method based on an AR device provided in an embodiment of this application;

[0024] Figure 3 This is a schematic diagram of the structure of AR glasses provided in an embodiment of this application;

[0025] Figure 4 A schematic diagram of a sub-process of another visual information display method based on an AR device provided in an embodiment of this application;

[0026] Figure 5 A schematic diagram of a sub-process of another visual information display method based on an AR device provided in an embodiment of this application;

[0027] Figure 6 A schematic block diagram of an AR device provided in an embodiment of this application;

[0028] Figure 7 This is a schematic block diagram of a visual information display device provided in an embodiment of this application. Detailed Implementation

[0029] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0030] The flowchart shown in the attached diagram is for illustrative purposes only and does not necessarily include all content and operations / steps, nor does it necessarily have to be performed in the order described. For example, some operations / steps can be broken down, combined, or partially merged, so the actual execution order may change depending on the actual situation.

[0031] It should be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the scope of the application. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0032] It should also be understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0033] Embodiments of this application provide a visual information display method, apparatus, AR device, and storage medium to improve the security of visual information display based on AR devices.

[0034] Please see Figure 1 , Figure 1 This is a flowchart illustrating a visual information display method based on an AR device according to an embodiment of this application. This method can be applied to AR devices, including but not limited to AR glasses, AR headsets, and other electronic products. This application does not limit the application scenarios of this method.

[0035] like Figure 1 As shown, the visual information display method based on AR devices specifically includes steps S101 to S104.

[0036] S101. Obtain the first light field corresponding to the visual information output by the AR device.

[0037] The visual information includes, but is not limited to, images, video frames, and interactive interfaces; that is, the visual information that needs to be displayed on the AR device's display interface. The optical engine of the AR device outputs light corresponding to the visual information, forming a light field based on this light. For ease of description, this light field will be referred to as the first light field below. It should be noted that the first light field can be the raw light field formed by the visual information light without processing; that is, the first light field is composed of the light emitted by the optical engine. Alternatively, the first light field can be the light field formed after the visual information light has undergone light processing; this application does not impose any limitations.

[0038] For example, taking AR devices as AR glasses and visual information as images, the optical engine of the AR glasses outputs image light rays, and based on the image light rays, a first light field corresponding to the image is formed.

[0039] In some embodiments, such as Figure 2 As shown, step S101 includes sub-step S1011.

[0040] S1011. Scatter the visual information light corresponding to the visual information to obtain the first light field.

[0041] To prevent visual information from being spied on, the visual information light emitted by the optical engine of the AR device is scattered. The first light field formed by the scattered visual information light cannot reconstruct the effective visual information, thus preventing the visual information from being spied on.

[0042] In some embodiments, scattering the visual information light corresponding to the visual information to generate a first light field includes: scattering the visual information light at different angles through a microlens array to obtain the first light field.

[0043] For example, an AR device may incorporate an MLA (Microlens Array). The MLA consists of numerous microlenses with micron-sized apertures and embossed depths. After the AR device's optical engine outputs visual information light, this light is scattered at different angles by the various microlenses within the MLA. The initial light field formed by this scattered light cannot reconstruct any valid visual information, thus creating a physical barrier against peeping. Furthermore, the visual information contained in the light scattered at different angles differs; that is, the visual information contained in the light scattered by the various microlenses of the MLA varies.

[0044] For example, taking AR devices as AR glasses and visual information as images as an example, such as Figure 3 As shown, the AR glasses 100 includes lenses 10, temples 20, an optical engine 30, and an MLA 40. The optical engine 30 can be located at the temples 20 of the AR glasses 100, and the MLA 40 is located at the emission position of the optical engine 30. After the optical engine 30 outputs image light, each microlens of the MLA 40 scatters the light corresponding to the local area (pixel cluster) of the image at different angles. This is like breaking a complete image apart and cutting each fragment into smaller particles, scattering them in all directions. Therefore, for any outside observer, what is received is randomly scattered and discontinuous light, resulting in a blurry or disordered noise first light field, making it impossible to reconstruct any effective information of the image, thus preventing the image from being spied on.

[0045] S102. Perform phase encoding on the first optical field to obtain the corresponding second optical field.

[0046] In the case where the first light field is the raw light field formed by unprocessed visual information rays, valid visual information can be reconstructed from the first light field, posing a risk of being spied on. In the case where the first light field is formed after the visual information rays have been scattered, if someone with malicious intent uses professional cameras or other equipment to decipher and reconstruct the visual information through long exposures or multi-angle shooting, there is also a risk of leakage. To prevent the leakage of visual information, the first light field is phase-encoded, and its phase is spatially modulated to obtain a corresponding second light field. The second light field is essentially an "encrypted" light field, making it impossible to reconstruct visual information from it.

[0047] In some embodiments, such as Figure 4 As shown, step S102 includes sub-step S1021.

[0048] S1021. The phase of the first optical field is time-division multiplexed and encoded by a phase modulation device to obtain the second optical field.

[0049] For example, AR devices are equipped with phase modulation devices, including but not limited to LCoS (Liquid Crystal on Silicon) and SLM (Spatial Light Modulator). The phase modulation device can perform time-division multiplexing encoding of the phase of the first light field based on a corresponding frequency (e.g., a millisecond-level frequency). That is, it dynamically encodes the phase of the first light field. This means that the "encryption" of the first light field changes every instant, constantly scrambling the visual information, making it impossible to reconstruct. This constructs another physical barrier against prying eyes, preventing the leakage of visual information.

[0050] For example, taking AR devices as AR glasses and visual information as images as an example, such as Figure 3 As shown, the AR glasses 100 also includes an LCoS 50, which can be positioned behind the lens 10 of the AR glasses 100 (the side of the lens facing the user when the user wears the AR glasses). After the image light is scattered by the MLA 40, the phase of the first light field is time-division multiplexed and encoded at a millisecond frequency using the LCoS 50. This is like not only scattering and throwing out a complete image, but also constantly re-scrambling these image fragments at an extremely high speed. This makes it impossible for any photographic device, even a high-speed camera, to capture only a meaningless random light spot at any given time, and it is impossible to reconstruct the image content by accumulating or synthesizing multiple frames.

[0051] S103. Obtain the current gaze focus information of the wearer of the AR device.

[0052] The gaze focus information includes, but is not limited to, three-dimensional focus coordinates. By tracking and monitoring the wearer's gaze, information such as the gaze direction and gaze focus depth corresponding to the wearer's current gaze point is obtained. Based on the gaze direction and gaze focus depth, the wearer's current three-dimensional focus coordinates are determined.

[0053] For example, the AR device is equipped with an eye-tracking module, which can accurately track the wearer's eye movements and monitor data such as the position and rotation angle of the wearer's pupils and changes in the focal length of the lens. The eye-tracking module may consist of an infrared LED (light-emitting diode) light source and an infrared camera, or other components with equivalent functions; no specific limitations are imposed in this application.

[0054] Based on data such as the wearer's pupil position, rotation angle, and lens focal length changes monitored by the eye-tracking module, the wearer's gaze direction and focal depth can be determined. For example, by using the pupil position, rotation angle, and lens focal length changes as input to a corresponding depth calculation model, the model can output the wearer's focal depth. From the wearer's gaze direction and focal depth, the wearer's three-dimensional focal coordinates can be determined.

[0055] For example, taking AR devices as AR glasses as an example, such as Figure 3 As shown, the AR glasses 100 also includes an eye-tracking module 60, which can be composed of an infrared LED light source and an infrared camera. The eye-tracking module 60 can be positioned near the nose pad 70 of the AR glasses 100, or it can be positioned on the rear edge of the lens 10 of the AR glasses 100. The eye-tracking module 60 monitors data such as the position and rotation angle of the wearer's pupils and the focal length change of the lens. Based on this data, the wearer's gaze direction and depth of focus are determined, thereby obtaining the wearer's three-dimensional focal coordinates.

[0056] S104. Based on the gaze focus information, the second light field is demodulated to obtain the corresponding third light field, and the visual information is restored and presented to the wearer through the light of the third light field.

[0057] The second light field acts as an "encrypted" light field. The wearer's focal point information forms the "key" for "decrypting" the second light field. Based on this "key," the second light field is demodulated, resulting in the corresponding third light field. In the third light field, only the light rays directed towards the wearer's pupil are precisely corrected and restored. These corrected rays converge on the wearer's retina, forming clear and stable visual information, meaning the wearer can clearly see the visual information. Light rays directed in other directions remain in a chaotic scattered state, unable to reconstruct visual information, thus preventing the leakage of visual information.

[0058] In some embodiments, before demodulating the second light field based on the gaze focus information to obtain the corresponding third light field, the method includes: determining whether the wearer's gaze is focused; and modulating the second light field based on the gaze focus information to obtain the corresponding third light field, including: if the wearer's gaze is focused, then demodulating the second light field based on the gaze focus information to obtain the third light field.

[0059] For example, if the wearer's gaze lingers within the fixation area for more than a preset time (e.g., 200-500 milliseconds), the wearer's gaze is determined to be focused (active focusing); conversely, if the lingering time does not exceed the preset time, the wearer's gaze is determined to be unfocused. Similarly, if the wearer's 3D focus coordinates fall on an object in a virtual or real environment, the wearer's gaze is determined to be focused; conversely, if not, the wearer's gaze is determined to be unfocused.

[0060] The second light field, which acts as the "encrypted" light field, is demodulated only when the wearer's gaze is focused. In other words, it ensures that the "decryption" of the second light field is triggered only when the wearer actively focuses, thereby avoiding meaningless processing of modulating the second light field when the wearer is not focused and reducing resource consumption.

[0061] In some embodiments, such as Figure 5 As shown, step S104 includes sub-step S1041 and sub-step S1042.

[0062] S1041. Based on the three-dimensional focal coordinates provided by the eye-tracking module, determine the phase conjugate map that is opposite to the second light field;

[0063] S1042. Based on the phase conjugate diagram, the second optical field is demodulated to obtain the third optical field.

[0064] Based on the wearer's three-dimensional focal coordinates, a phase conjugate diagram completely opposite to the second light field can be calculated. This phase conjugate diagram acts like a "reverse filter," modulating the phase of the second light field. Based on the principle of destructive interference of waves, the phase of light rays striking the wearer's pupil is reversed, and scattering is canceled out. In other words, light rays striking the wearer's pupil are precisely corrected and restored, matching the phase of the original light rays. However, light rays striking other locations are not destructively interfered with and are not corrected and restored like those striking the wearer's pupil; their phases do not match the original light rays. Therefore, light rays striking the wearer's pupil converge on the wearer's retina, forming clear visual information, while any other light rays deviating from this direction continue to remain in a chaotic scattering state due to phase mismatch.

[0065] For example, demodulating the second optical field based on the phase conjugate map to obtain the third optical field includes: loading the phase conjugate map onto a spatial light modulator, controlling the second optical field to be directed toward the spatial light modulator, and using the spatial light modulator to perform phase modulation on the second optical field based on the phase conjugate map to obtain the third optical field.

[0066] The AR device is equipped with a phase conjugate image (SLM). After obtaining the phase conjugate image, the SLM loads the SLM with the phase conjugate image. The second light field is then directed towards the SLM with the phase conjugate image. The SLM modulates the phase of the second light field based on the phase conjugate image. Based on the principle of wave interference and destructive phase, only the phase of the light rays directed towards the wearer's pupil is reversed, and the scattering is canceled out. In other words, the light rays directed towards the wearer's pupil are precisely corrected and restored, matching the phase of the original light rays. Ultimately, the light rays directed towards the wearer's pupil converge on the wearer's retina, forming clear visual information. Any other light rays deviating from this direction continue to scatter chaotically due to phase mismatch, making it impossible to reconstruct the visual information, thus preventing the leakage of visual information.

[0067] For example, taking AR devices as AR glasses and visual information as images as an example, such as Figure 3 As shown, the AR glasses 100 also includes an SLM 80, which can be positioned behind the LCoS 50. By calculating a phase conjugate map completely opposite to the second light field based on the three-dimensional coordinates of the gaze focus, and loading this phase conjugate map onto the SLM 80, the second light field undergoes phase modulation through the SLM 80. Only the phase of light rays incident on the wearer's pupil is reversed, scattering is canceled, and the image is precisely corrected. Ultimately, the light rays incident on the wearer's pupil converge on the wearer's retina, forming a clear image; while any other light rays deviating from this direction continue to scatter chaotically due to phase mismatch, and cannot reconstruct the image after convergence, thus preventing image leakage.

[0068] In the above embodiments, by acquiring the first light field corresponding to the visual information output by the AR device, performing phase encoding on the first light field to obtain the corresponding second light field, and acquiring the current gaze focus information of the wearer of the AR device, demodulating the second light field based on the gaze focus information to obtain the corresponding third light field, after the light of the third light field diverges, only the light rays that are incident on the wearer converge to restore and present the visual information. The light rays that are incident on other directions cannot restore the visual information after convergence, thereby avoiding the leakage of visual information. Therefore, the security of visual information display based on AR devices is improved.

[0069] Please see Figure 6 , Figure 6 This is a schematic block diagram of an AR device provided in an embodiment of this application. The AR device includes, but is not limited to, electronic products such as AR glasses and AR headsets.

[0070] like Figure 6As shown, the AR device 1000 includes an optical engine 30, an MLA 40, an eye-tracking module 60, an SLM 80, and a phase modulation device 90. The optical engine 30 outputs visual information light, which is the information to be displayed on the AR device 1000's display interface. The optical engine 30 includes an optical engine module, which is the core optical component of the imaging system, used for image synthesis and driving. For example, the AR device 1000 is AR glasses, and the optical engine 30 is located at the temple of the AR glasses.

[0071] MLA 40 is composed of multiple microlenses arranged together. MLA 40 is positioned at the emission position of the optomechanical 30 and is used to scatter visual information light rays at different angles to obtain the first light field.

[0072] The phase modulation device 90 includes LCoS or SLM, and is used to perform time-division multiplexing encoding of the phase of the first optical field to obtain a second optical field. For example, the AR device 1000 is AR glasses, and the phase modulation device 90 is disposed behind the lenses of the AR glasses.

[0073] The eye-tracking module 60 may consist of an infrared LED light source and an infrared camera, or other components with equivalent functions. The eye-tracking module 60 is used to track the eyes of the wearer of the AR device 1000 and obtain gaze focus information, which includes, but is not limited to, three-dimensional focus coordinates. For example, the AR device 1000 is AR glasses, and the eye-tracking module 60 is positioned near the nose pads or the rear edge of the lenses of the AR glasses.

[0074] The SLM 80 is located behind the phase modulation device 90. The SLM 80 is used to phase modulate the second light field according to the focal information of the gaze to obtain a third light field, and present visual information to the wearer through the light of the third light field.

[0075] The AR device 1000 can implement the visual information display method provided in the embodiments of this application. For details, please refer to the previous embodiments, which will not be repeated here.

[0076] Please see Figure 7 , Figure 7 This is a schematic block diagram of a visual information display device provided in an embodiment of this application. Figure 7 As shown, the visual information display device 200 may include a processor 210 and a memory 220, wherein the processor 210 and the memory 220 are connected via a bus, such as an I2C (Inter-integrated Circuit) bus.

[0077] Specifically, the processor 210 can be a microcontroller unit (MCU), a central processing unit (CPU), or a digital signal processor (DSP), etc.

[0078] Specifically, the memory 220 can be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a portable hard drive, etc. The memory 220 stores various computer programs for the processor 210 to execute.

[0079] The processor 210 is configured to run a computer program stored in the memory, and to perform the following steps when executing the computer program:

[0080] Obtain the first light field corresponding to the visual information output by the AR device;

[0081] Phase encoding is performed on the first optical field to obtain the corresponding second optical field;

[0082] Obtain the current gaze focus information of the wearer of the AR device;

[0083] Based on the gaze focus information, the second light field is demodulated to obtain a corresponding third light field, and the visual information is presented to the wearer through the light of the third light field.

[0084] In some embodiments, performing phase encoding on the first optical field to obtain a corresponding second optical field includes:

[0085] The second optical field is obtained by time-division multiplexing the phase of the first optical field using a phase modulation device.

[0086] In some embodiments, the gaze focus information includes three-dimensional focus coordinates, and the processor 210, when implementing the demodulation of the second light field based on the gaze focus information to obtain the corresponding third light field, is configured to:

[0087] Based on the three-dimensional focal coordinates provided by the eye-tracking module, a phase conjugate map opposite to the second light field is determined;

[0088] Based on the phase conjugate diagram, the second optical field is demodulated to obtain the third optical field.

[0089] In some embodiments, when the processor 210 demodulates the second optical field based on the phase conjugate map to obtain the third optical field, it is configured to:

[0090] The phase conjugate map is loaded onto the spatial light modulator, and the second light field is controlled to be directed toward the spatial light modulator. The spatial light modulator modulates the phase of the second light field based on the phase conjugate map to obtain the third light field.

[0091] In some embodiments, before implementing the demodulation of the second light field based on the gaze focus information to obtain the corresponding third light field, the processor 210 is configured to perform the following:

[0092] Determine whether the wearer's gaze is focused;

[0093] When the processor 210 demodulates the second light field based on the gaze focus information to obtain the corresponding third light field, it is configured to:

[0094] If the wearer's gaze is focused, the second light field is demodulated based on the gaze focus information to obtain the third light field.

[0095] In some embodiments, when the processor 210 acquires the first light field corresponding to the visual information output by the AR device, it is configured to:

[0096] The visual information light corresponding to the visual information is scattered to obtain the first light field.

[0097] In some embodiments, when the processor 210 scatters the visual information light corresponding to the visual information to obtain the first light field, it is configured to:

[0098] The first light field is obtained by scattering the visual information light rays at different angles using a microlens array.

[0099] The visual information display device 200 can execute the visual information display method based on AR device provided in the relevant embodiments of this application. Therefore, it can achieve the beneficial effects that the visual information display method based on AR device provided in the relevant embodiments of this application can achieve. For details, please refer to the previous embodiments, which will not be repeated here.

[0100] An embodiment of this application also provides an AR device, which includes a visual information display device, the visual information display device being capable of... Figure 7 The visual information display device 200 shown is illustrated. Therefore, the AR device can achieve the beneficial effects that the visual information display method provided in the embodiments of this application can achieve, as detailed in the preceding embodiments, and will not be repeated here.

[0101] This application also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps of the visual information display method based on an AR device as described above.

[0102] The computer-readable storage medium can be an internal storage unit of the terminal or streaming system described in the foregoing embodiments, such as a hard disk or memory of the terminal or streaming system. Alternatively, the computer-readable storage medium can be an external storage device of the terminal or streaming system, such as a plug-in hard disk, smart media card (SMC), secure digital card (SD card), flash card, etc., equipped on the terminal or streaming system.

[0103] Since the computer program stored in the storage medium can execute any of the visual information display methods based on AR devices provided in the embodiments of this application, the beneficial effects that any of the visual information display methods based on AR devices provided in the embodiments of this application can achieve can be realized. For details, please refer to the previous embodiments, which will not be repeated here.

[0104] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0105] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the scope of the technology disclosed in this application, and these modifications or substitutions should all be covered within the scope of protection of this application.

Claims

1. A method for displaying visual information based on an AR device, characterized in that, The method includes: Obtain the first light field corresponding to the visual information output by the AR device; Phase encoding is performed on the first optical field to obtain the corresponding second optical field; Obtain the current gaze focus information of the wearer of the AR device; Based on the gaze focus information, the second light field is demodulated to obtain a corresponding third light field, and the visual information is presented to the wearer through the light of the third light field.

2. The method as described in claim 1, characterized in that, The step of performing phase encoding on the first optical field to obtain the corresponding second optical field includes: The second optical field is obtained by time-division multiplexing the phase of the first optical field using a phase modulation device.

3. The method as described in claim 1, characterized in that, The line-of-sight focus information includes three-dimensional focus coordinates. The step of demodulating the second light field based on the line-of-sight focus information to obtain the corresponding third light field includes: Based on the three-dimensional focal coordinates provided by the eye-tracking module, a phase conjugate map opposite to the second light field is determined; Based on the phase conjugate diagram, the second optical field is demodulated to obtain the third optical field.

4. The method as described in claim 3, characterized in that, The step of demodulating the second optical field based on the phase conjugate map to obtain the third optical field includes: The phase conjugate map is loaded onto the spatial light modulator, and the second light field is controlled to be directed toward the spatial light modulator. The spatial light modulator modulates the phase of the second light field based on the phase conjugate map to obtain the third light field.

5. The method as described in claim 1, characterized in that, Before demodulating the second light field based on the line-of-sight focus information to obtain the corresponding third light field, the process includes: Determine whether the wearer's gaze is focused; The step of demodulating the second light field based on the line-of-sight focus information to obtain the corresponding third light field includes: If the wearer's gaze is focused, the second light field is demodulated based on the gaze focus information to obtain the third light field.

6. The method according to any one of claims 1 to 5, characterized in that, The acquisition of the first light field corresponding to the visual information output by the AR device includes: The visual information light corresponding to the visual information is scattered to obtain the first light field.

7. The method as described in claim 6, characterized in that, The step of scattering the visual information light corresponding to the visual information to obtain the first light field includes: The first light field is obtained by scattering the visual information light rays at different angles using a microlens array.

8. An AR device, characterized in that, The AR device includes: Optical engine, which is used to output light for visual information; A microlens array, disposed at the optomechanical emission position, is used to scatter the visual information light rays at different angles to obtain a first light field; A phase modulation device is used to perform time-division multiplexing encoding on the phase of the first optical field to obtain a second optical field; An eye-tracking module is used to track the eyes of the wearer of the AR device and obtain gaze focus information; A spatial light modulator, disposed behind the phase modulation device, is used to demodulate the second light field according to the gaze focus information to obtain a third light field, and to present visual information to the wearer through the light of the third light field.

9. The AR device as described in claim 8, characterized in that, The phase modulation device includes a silicon-based liquid crystal or a spatial light modulator, and the eye-tracking module includes an infrared LED light source and an infrared camera.

10. The AR device as claimed in claim 8, characterized in that, The AR device is AR glasses. The optical engine is located at the temple of the AR glasses. The phase modulation device is located on the back of the lens of the AR glasses. The eye-tracking module is located near the nose pad of the AR glasses or at the rear edge of the lens.

11. A visual information display device, characterized in that, The visual information display device includes a memory and a processor; The memory is used to store computer programs; The processor is configured to execute the computer program and, in executing the computer program, implement the steps of the method as described in any one of claims 1 to 7.

12. An AR device, characterized in that, The AR device includes the visual information display device as described in claim 11.

13. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of the method as described in any one of claims 1 to 7.

Images