Visual information display method and device, AR equipment and storage medium

Abstract

The invention relates to the technical field of optical imaging, and provides a visual information display method and device, AR equipment and a storage medium, and the method comprises the steps: obtaining a first light field corresponding to visual information outputted by the AR equipment; performing phase encoding on the first light field to obtain a corresponding second light field; obtaining current sight line focus information of a wearer of the AR equipment; and demodulating the second light field based on the sight focus information to obtain a corresponding third light field, and presenting visual information to the wearer through the light of the third light field. According to the embodiment of the invention, the security of visual information display based on the AR equipment is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of optical imaging, in particular to a visual information display method and device, AR equipment and a storage medium. BACKGROUND

[0002] With the development of science and technology, AR (Augmented Reality) glasses, AR headsets and other AR equipment have been applied in navigation, games, education, medical treatment and other fields, providing various different services for users. However, the current AR equipment lacks perfect privacy protection functions, for example, for AR glasses, since the anti-peeping film commonly applied to the terminal screen of a mobile phone and the like will hinder the wearer of the AR glasses from observing the external real world, the anti-peeping film cannot be applied to the AR glasses, and the content displayed by the AR glasses can be seen by the wearer and other people, which poses a risk of privacy leakage. SUMMARY

[0003] The present application provides a visual information display method and device, AR equipment and a storage medium, aiming to improve the security of visual information display based on AR equipment.

[0004] In a first aspect, the present application provides a visual information display method based on AR equipment, comprising: obtaining a first light field corresponding to visual information output by AR equipment; phase-encoding the first light field to obtain a corresponding second light field; obtaining current visual focus point information of a wearer of the AR equipment; based on the visual focus point information, demodulating the second light field to obtain a corresponding third light field, and presenting the visual information to the wearer through light rays of the third light field.

[0005] In a second aspect, the present application also provides AR equipment, comprising: an optical machine for outputting visual information light rays; a microlens array arranged at a position of the optical machine for scattering the visual information light rays at different angles to obtain a first light field; a phase modulation device for time-division multiplexing encoding the phase of the first light field to obtain a second light field; an eye movement tracking module for tracking the eye movement of a wearer of the AR equipment to obtain visual focus point information; a spatial light modulator disposed at a rear side of the phase modulation device, configured to modulate a phase of the second light field according to the line-of-sight focal point information, to obtain a third light field, and present visual information to the wearer through light rays of the third light field.

[0006] In a third aspect, the present application also provides a visual information display device, comprising a memory and a processor; The memory is configured to store a computer program. The processor is configured to execute the computer program and implement the steps of the visual information display method based on an AR device as described above when executing the computer program.

[0007] In a fourth aspect, the present application also provides an AR device comprising the visual information display device as described above.

[0008] In a fifth aspect, the present application also provides a computer readable storage medium storing a computer program, which, when executed by a processor, implements the steps of the visual information display method based on an AR device as described above.

[0009] The present application discloses a visual information display method, device, AR device and storage medium. The visual information display method comprises the following steps: obtaining a first light field corresponding to visual information output by an AR device; performing phase encoding on the first light field to obtain a second light field; obtaining line-of-sight focal point information of a wearer of the AR device; performing demodulation on the second light field based on the line-of-sight focal point information to obtain a third light field; and presenting the visual information to the wearer through light rays of the third light field after the light rays diverge, and presenting the visual information to the wearer through light rays of the third light field after the light rays converge. The light rays that cannot be restored to the visual information after converging in other directions are avoided, thereby improving the security of visual information display based on the AR device. BRIEF DESCRIPTION OF DRAWINGS

[0010] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings needed in the embodiment description. Obviously, the drawings in the following description are some embodiments of the present application, and other drawings can also be obtained by those skilled in the art without creative labor.

[0011] Figure 1 A flowchart of a visual information display method based on an AR device provided by an embodiment of the present application is shown in the figure. Figure 2 A sub-flowchart of another visual information display method based on an AR device provided by an embodiment of the present application is shown in the figure. Figure 3A structural schematic diagram of an AR glass provided by an embodiment of the present application; Figure 4 A sub-flowchart of another AR device-based visual information display method provided by an embodiment of the present application; Figure 5 A sub-flowchart of another AR device-based visual information display method provided by an embodiment of the present application; Figure 6 A schematic block diagram of an AR device provided by an embodiment of the present application; Figure 7 A schematic block diagram of a visual information display apparatus provided by an embodiment of the present application. DETAILED DESCRIPTION

[0012] The technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of the present application.

[0013] The flowcharts shown in the drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor do they have to be executed in the order described. For example, some operations / steps can be further divided, combined or partially merged, so the actual execution order may be changed according to the actual situation.

[0014] It should be understood that the terms used in the present application specification are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the present application specification and the appended claims, unless otherwise clear from the context, the singular forms "a", "an" and "the" are intended to include the plural forms.

[0015] It should also be understood that the term "and / or" used in the present application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes these combinations.

[0016] Embodiments of the present application provide a visual information display method, apparatus, AR device and storage medium, for improving the security of visual information display based on an AR device.

[0017] Please refer to Figure 1 , Figure 1is a flowchart of a visual information display method based on an AR device provided by an embodiment of the present application. The method can be applied to an AR device, which includes but is not limited to AR glasses, AR headsets, and other electronic products. The application scenario of the method is not limited in the present application.

[0018] As shown in Figure 1 , the visual information display method based on the AR device specifically includes steps S101 to S104.

[0019] S101, obtaining a first light field corresponding to visual information output by an AR device.

[0020] The visual information includes but is not limited to images, video frames, interactive interfaces, and other content, i.e., the visual information is information that needs to be displayed on the AR device display interface. The light machine of the AR device outputs light rays corresponding to the visual information, and forms a light field corresponding to the visual information based on the visual information light rays. For ease of description, the light field is referred to as the first light field hereinafter. It should be noted that the first light field can be an original light field formed by the visual information light rays without processing, i.e., the first light field is composed of light rays emitted by the light machine. The first light field can also be a light field formed by the visual information light rays after light ray processing, which is not limited in the present application.

[0021] For example, taking the AR device as AR glasses and the visual information as an image as an example, the light machine of the AR glasses outputs image light rays, and forms a first light field corresponding to the image based on the image light rays.

[0022] In some embodiments, as shown in Figure 2 , step S101 includes sub-step S1011.

[0023] S1011, scattering the visual information light rays corresponding to the visual information to obtain the first light field.

[0024] In order to prevent the visual information from being snooped, after the light machine of the AR device outputs the visual information light rays, the visual information light rays are scattered, and the first light field formed by the scattered visual information light rays cannot reproduce effective visual information, thereby avoiding the visual information from being snooped.

[0025] In some embodiments, scattering the visual information light rays corresponding to the visual information to generate the first light field includes: scattering the visual information light rays at different angles by a microlens array to obtain the first light field.

[0026] Exemplarily, the AR device is provided with an MLA (Microlens Array), which is arranged by a plurality of micron-level light apertures and micro-lenses with a relief depth. After the AR device outputs visual information light, the visual information light is scattered by each micro-lens of the MLA at different angles. The first light field formed by the scattered visual information light cannot restore any effective visual information, thereby constructing a physical barrier for preventing peeping. Different visual information is included in the visual information light scattered at different angles, that is, the visual information included in the visual information light scattered by each micro-lens of the MLA at different angles is different.

[0027] For example, taking the AR device as AR glasses and the visual information as an image as an example, as shown in Figure 3 The AR glasses 100 include a lens 10, a temple 20, an optical machine 30, and an MLA 40. The optical machine 30 can be arranged at the temple 20 of the AR glasses 100, and the MLA 40 is arranged at the emission position of the optical machine 30. After the optical machine 30 outputs image light, the image light is scattered by each micro-lens of the MLA 40 at different angles. This is like scattering a complete image and cutting each scattered image fragment into smaller particles, which are scattered in all directions. Therefore, any outside observer receives randomly scattered and incoherent light, which is a blurred first light field or a disordered noise point, and cannot restore any effective information of the image, thereby avoiding image peeping.

[0028] In S102, the first light field is phase-encoded to obtain a corresponding second light field.

[0029] For the case that the first light field is an original light field formed by the visual information light without processing, the effective visual information can be restored through the first light field, and there is a risk of being peeped. For the case that the first light field is a light field formed by scattering the visual information light, if a person with malicious intent uses a professional camera or other equipment to restore the visual information through long-time exposure or multi-angle shooting, there may also be a risk of leakage. In order to avoid the leakage of the visual information, the first light field is phase-encoded to modulate the phase of the first light field in space, and a corresponding second light field is obtained. The second light field is an “encrypted” light field, and the visual information cannot be restored through the second light field.

[0030] In some embodiments, as shown in Figure 4 S102 includes a sub-step S1021.

[0031] In S1021, the phase of the first light field is time-division multiplexed encoded by a phase modulation device to obtain a second light field.

[0032] Exemplarily, the AR device is provided with a phase modulation device, which includes but is not limited to an LCoS (Liquid Crystal on Silicon), an SLM (Spatial Light Modulator) and the like. The phase modulation device can time-division multiplex code the phase of the first light field based on a corresponding frequency (such as a millisecond level frequency), that is, dynamically phase encode the first light field, which means that the "encryption" of the first light field changes every moment, constantly disrupting the visual information, so that the visual information cannot be restored, thereby building another physical barrier for peeping and avoiding the leakage of visual information.

[0033] For example, still taking the AR device as AR glasses and the visual information as an image as an example, as shown in FIG. 1, the AR glasses 100 further include an LCoS 50, which can be arranged at the back side of the lens 10 of the AR glasses 100 (the side of the lens facing the user when the AR glasses are worn by the user). After the image light is scattered by the MLA 40, the LCoS 50 is used to time-division multiplex code the phase of the first light field at a millisecond level frequency, which is like not only scattering and throwing out a complete image, but also constantly rearranging the image fragments at a very high speed, which makes any photographing device, even a high-speed camera, capture only a meaningless random spot at any time point, and cannot restore the image content by accumulating or synthesizing multiple frames of images. Figure 3

[0034] S103, acquiring the current line-of-sight focal point information of the wearer of the AR device.

[0035] The line-of-sight focal point information includes but is not limited to three-dimensional focal point coordinates. By tracking and monitoring the line of sight of the wearer, the line-of-sight direction, the line-of-sight focal point depth and the like corresponding to the current gaze point of the wearer are obtained, and based on the line-of-sight direction and the line-of-sight focal point depth, the three-dimensional focal point coordinates of the wearer are determined.

[0036] Exemplarily, the AR device is provided with an eye movement tracking module, by which the eye movement of the wearer can be accurately tracked, and data such as the position of the pupil, the rotation angle, the focal length change of the lens of the wearer are monitored. The eye movement tracking module can be composed of an infrared LED (light-emitting diode) light source and an infrared camera, or other components with equivalent functions, which are not specifically limited in the present application.

[0037] ​According to the data of the position, rotation angle, and focal length change of the wearer's pupil monitored by the eye movement tracking module, the line-of-sight direction and the line-of-sight focal depth of the wearer can be determined. For example, the position, rotation angle, and focal length change data of the pupil are taken as the input of the corresponding depth calculation model, and the depth calculation model can output the line-of-sight focal depth of the wearer. According to the line-of-sight direction and the line-of-sight focal depth of the wearer, the three-dimensional focal point coordinates of the wearer can be determined.

[0038] For example, still taking the AR device as AR glasses as an example, as shown in Figure 3 The AR glasses 100 also include an eye movement tracking module 60, which can be composed of an infrared LED light source and an infrared camera. The eye movement tracking module 60 can be arranged near the nose pad 70 of the AR glasses 100, or can also be arranged at the rear edge of the lens 10 of the AR glasses 100. The position, rotation angle, and focal length change data of the wearer's pupil monitored by the eye movement tracking module 60 are used to determine the line-of-sight direction and the line-of-sight focal depth of the wearer, so as to obtain the three-dimensional focal point coordinates of the wearer.

[0039] In S104, the second light field is demodulated based on the line-of-sight focal point information to obtain a corresponding third light field, and the visual information is presented to the wearer through the light rays of the third light field.

[0040] The second light field is an "encrypted" light field, and the line-of-sight focal point information of the wearer constitutes a "key" for "decrypting" the second light field. Based on the "key", the second light field is demodulated, and a corresponding third light field is obtained after demodulation. Only the light rays directed to the pupil position of the wearer are accurately corrected and restored in the third light field. These corrected light rays converge on the retina of the wearer, forming clear and stable visual information, that is, the wearer can clearly view the visual information. As for the light rays directed to other directions, they are still in a chaotic and scattered state, and cannot restore the visual information, thereby avoiding the leakage of visual information.

[0041] In some embodiments, before the second light field is demodulated based on the line-of-sight focal point information to obtain a corresponding third light field, the following steps are included: determining whether the line of sight of the wearer is focused; and based on the line-of-sight focal point information, the second light field is modulated to obtain a corresponding third light field, including: if the line of sight of the wearer is focused, the second light field is demodulated based on the line-of-sight focal point information to obtain a third light field.

[0042] For example, if the wearer's gaze stays in the gaze area for more than a preset time (such as 200-500 milliseconds), it is determined that the wearer's gaze is focused (active focus); otherwise, if the stay time does not exceed the preset time, it is determined that the wearer's gaze is not focused. For another example, if the wearer's three-dimensional focal point coordinates fall on an object in the virtual or real environment, it is determined that the wearer's gaze is focused; otherwise, it is determined that the wearer's gaze is not focused.

[0043] Only when it is determined that the wearer's gaze is focused, the second light field as the "encrypted" light field is demodulated, that is, it is ensured that only when the wearer actively focuses, the "decryption" of the second light field is triggered, thereby avoiding meaningless processing of modulating the second light field in the case where the wearer does not focus, and reducing resource consumption.

[0044] In some embodiments, as shown in Figure 5 Step S104 includes sub-step S1041 and sub-step S1042.

[0045] S1041, determining a phase conjugate pattern opposite to the second light field according to the three-dimensional focal point coordinates provided by the eye movement tracking module; S1042, demodulating the second light field based on the phase conjugate pattern to obtain a third light field.

[0046] According to the three-dimensional focal point coordinates of the wearer, a phase conjugate pattern completely opposite to the second light field can be calculated. This phase conjugate pattern is like a "reverse filter". By phase modulating the second light field through the "reverse filter", based on the interference cancellation principle of waves, the phase of the light rays directed to the wearer's pupil position is reversed and scattered is cancelled, that is, the light rays directed to the wearer's pupil position are accurately corrected and restored, and the phase of the light rays directed to the wearer's pupil position matches the original light rays; and the light rays directed to other positions are not interfered and cancelled, and are not corrected and restored like the light rays directed to the wearer's pupil position, and the light rays directed to other positions do not match the phase of the original light rays. Thus, the light rays directed to the wearer's pupil position converge on the wearer's retina, forming clear visual information, while any other light rays deviating from this direction continue to remain in a chaotic scattered state because of the mismatched phase.

[0047] For example, demodulating the second light field based on the phase conjugate pattern to obtain the third light field includes: loading the phase conjugate pattern to a spatial light modulator, controlling the second light field to be directed to the spatial light modulator, and phase modulating the second light field based on the phase conjugate pattern through the spatial light modulator to obtain the third light field.

[0048] The AR device is provided with an SLM. After the phase conjugate diagram is obtained, the phase conjugate diagram is loaded to the SLM, the second light field is shot to the SLM loaded with the phase conjugate diagram, the SLM performs phase modulation on the second light field based on the phase conjugate diagram, and only the phase of the light ray shot to the pupil position of the wearer is reversed based on the interference cancellation principle of the wave, the scattering is cancelled, that is, the light ray shot to the pupil position of the wearer is accurately corrected and restored, and matches the phase of the original light ray. Finally, the light ray shot to the pupil position of the wearer converges on the retina of the wearer, forming clear visual information; and any other light ray deviating from this direction continues to remain in a chaotic scattering state and cannot restore visual information, thereby avoiding the leakage of visual information.

[0049] For example, still taking the AR device as AR glasses and the visual information as an image as an example, as shown in Figure 3 The AR glasses 100 further include an SLM 80, which can be arranged on the back side of the LCoS 50. A phase conjugate diagram completely opposite to the second light field is calculated according to the line-of-sight focal point three-dimensional coordinates. After the phase conjugate diagram is loaded to the SLM 80, the second light field is phase-modulated by the SLM 80. Only the phase of the light ray shot to the pupil position of the wearer is reversed, the scattering is cancelled, and the light ray is accurately corrected. Finally, the light ray shot to the pupil position of the wearer converges on the retina of the wearer, forming a clear image; and any other light ray deviating from this direction continues to remain in a chaotic scattering state and cannot restore the image after convergence, thereby avoiding the leakage of the image.

[0050] In the above embodiment, the first light field corresponding to the visual information output by the AR device is obtained, the first light field is phase-encoded to obtain the corresponding second light field, the current line-of-sight focal point information of the wearer of the AR device is obtained, the second light field is demodulated based on the line-of-sight focal point information to obtain the corresponding third light field, and only the light ray shot to the wearer converges after divergence of the light ray of the third light field, and the visual information is restored. The light ray shot to other directions cannot restore the visual information after convergence, thereby avoiding the leakage of the visual information. Therefore, the security of the display of the visual information based on the AR device is improved.

[0051] Please refer to Figure 6 , Figure 6 is a schematic block diagram of an AR device provided by an embodiment of the present application. The AR device includes but is not limited to AR glasses, AR head-mounted displays and other electronic products.

[0052] As Figure 6As shown, the AR device 1000 includes an optical engine 30, an MLA 40, an eye tracking module 60, an SLM 80, and a phase modulation device 90. The optical engine 30 is configured to output visual information light rays, the visual information being information to be displayed on a display interface of the AR device 1000. The optical engine 30 includes an optical engine module, which is a core optical component of an imaging system and is configured to perform image synthesis and driving. For example, the AR device 1000 is an AR glass, and the optical engine 30 is disposed at a temple of the AR glass.

[0053] The MLA 40 is arranged by a plurality of microlenses, and is disposed at a light emitting position of the optical engine 30. The MLA 40 is configured to scatter the visual information light rays at different angles to obtain a first light field.

[0054] The phase modulation device 90 includes an LCoS or an SLM. The phase modulation device 90 is configured to perform time division multiplexing coding on a phase of the first light field to obtain a second light field. For example, the AR device 1000 is an AR glass, and the phase modulation device 90 is disposed at a back side of a lens of the AR glass.

[0055] The eye tracking module 60 can include an infrared LED light source and an infrared camera, or other components with equivalent functions. The eye tracking module 60 is configured to perform eye tracking on a wearer of the AR device 1000 to obtain a line-of-sight focal point information, which includes but is not limited to three-dimensional focal point coordinates. For example, the AR device 1000 is an AR glass, and the eye tracking module 60 is disposed near a nose pad or at a back side edge of a lens of the AR glass.

[0056] The SLM 80 is disposed at a back side of the phase modulation device 90. The SLM 80 is configured to perform phase modulation on the second light field according to the line-of-sight focal point information to obtain a third light field, and present the visual information to the wearer through light rays of the third light field.

[0057] The AR device 1000 can implement the visual information display method provided in the embodiments of the present application. For details, refer to the foregoing embodiments, which will not be repeated here.

[0058] Please refer to Figure 7 , Figure 7 is a schematic block diagram of a visual information display device provided in the embodiments of the present application. As shown in Figure 7 , the visual information display device 200 can include a processor 210 and a memory 220, where the processor 210 and the memory 220 are connected through a bus, such as an I2C (Inter-integrated Circuit) bus.

[0059] Specifically, the processor 210 can be a micro-controller unit (MCU), a central processing unit (CPU), or a digital signal processor (DSP), etc.

[0060] Specifically, the memory 220 can be a flash chip, a read-only memory (ROM) disk, an optical disk, a U disk, or a mobile hard disk, etc. The memory 220 stores various computer programs for the processor 210 to execute.

[0061] The processor 210 is configured to run the computer programs stored in the memory and implement the following steps when executing the computer programs: obtain a first light field corresponding to visual information output by an AR device; phase-encode the first light field to obtain a second light field corresponding thereto; obtain current line-of-sight focal point information of a wearer of the AR device; demodulate the second light field based on the line-of-sight focal point information to obtain a third light field corresponding thereto, and present the visual information to the wearer through light rays of the third light field.

[0062] In some embodiments, the phase-encoding the first light field to obtain a second light field corresponding thereto comprises: time-division multiplexing encode the phase of the first light field through a phase modulation device to obtain the second light field.

[0063] In some embodiments, the line-of-sight focal point information includes three-dimensional focal point coordinates, and the processor 210, when implementing the demodulating the second light field based on the line-of-sight focal point information to obtain a third light field corresponding thereto, is configured to: determine a phase conjugate map opposite to the second light field according to the three-dimensional focal point coordinates provided by an eye movement tracking module; demodulate the second light field based on the phase conjugate map to obtain the third light field.

[0064] In some embodiments, the processor 210, when implementing the demodulating the second light field based on the phase conjugate map to obtain the third light field, is configured to: load the phase conjugate map to a spatial light modulator, control the second light field to be incident on the spatial light modulator, and modulate the phase of the second light field based on the phase conjugate map through the spatial light modulator to obtain the third light field.

[0065] In some embodiments, the processor 210, when implementing the obtaining the third light field corresponding to the second light field based on the line-of-sight focal point information, is configured to: determine whether the wearer focuses the line of sight; The processor 210, when implementing the obtaining the third light field corresponding to the second light field based on the line-of-sight focal point information, is configured to: If the wearer focuses the line of sight, the third light field is obtained by demodulating the second light field based on the line-of-sight focal point information.

[0066] In some embodiments, the processor 210, when implementing the obtaining the first light field corresponding to the visual information output by the AR device, is configured to: scatter the visual information light corresponding to the visual information to obtain the first light field.

[0067] In some embodiments, the processor 210, when implementing the scattering the visual information light corresponding to the visual information to obtain the first light field, is configured to: scatter the visual information light at different angles by a microlens array to obtain the first light field.

[0068] The visual information display device 200 can execute the AR device-based visual information display method provided by the embodiments of the present application, and thus can achieve the beneficial effects that the AR device-based visual information display method provided by the embodiments of the present application can achieve. Details are described in the foregoing embodiments and will not be described here.

[0069] In the embodiments of the present application, an AR device is also provided, which comprises a visual information display device, which can be the visual information display device 200 shown in Figure 7 Therefore, the AR device can achieve the beneficial effects that the visual information display method provided by the embodiments of the present application can achieve. Details are described in the foregoing embodiments and will not be described here.

[0070] The embodiments of the present application also provide a computer readable storage medium, and the computer readable storage medium stores a computer program. When the computer program is executed by a processor, the steps of the AR device-based visual information display method described above are implemented.

[0071] The computer readable storage medium can be an internal storage unit of the terminal or the push system, for example, a hard disk or a memory of the terminal or the push system. The computer readable storage medium can also be an external storage device of the terminal or the push system, for example, a plug-in hard disk, a smart media card (SMC), a secure digital card (SD Card), a flash card, and the like.

[0072] Due to the computer program stored in the storage medium, any AR device-based visual information display method provided in the embodiments of the present application can be executed, thus achieving the beneficial effects of any AR device-based visual information display method provided in the embodiments of the present application. Details are described in the foregoing embodiments, which will not be repeated here.

[0073] It should be noted that, in this document, the terms "comprising", "including", or any other variant thereof are intended to cover a non-exclusive inclusion, so that a process, method, article, or system that includes a list of elements not only includes those elements, but also includes other elements not expressly listed, or inherent to such process, method, article, or system. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of additional identical elements in the process, method, article, or system that includes the element.

[0074] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of various equivalent modifications or replacements within the technical range disclosed in the present application, and these modifications or replacements should be covered within the protection scope of the present application.

Claims

1. A method for displaying visual information based on an AR device, characterized by, The method comprises: acquiring a first light field corresponding to visual information output by an AR device; phase encoding the first light field to obtain a corresponding second light field; acquiring current visual focus point information of a wearer of the AR device; based on the visual focus point information, demodulating the second light field to obtain a corresponding third light field, and presenting the visual information to the wearer through light rays of the third light field.

2. The method of claim 1, wherein, The phase encoding of the first light field to obtain a corresponding second light field comprises: time-division multiplexing encoding the phase of the first light field through a phase modulation device to obtain the second light field.

3. The method of claim 1, wherein, The visual focus point information comprises three-dimensional focus coordinates, and the demodulation of the second light field based on the visual focus point information to obtain a corresponding third light field comprises: determining a phase conjugate diagram opposite to the second light field according to the three-dimensional focus coordinates provided by an eye movement tracking module; based on the phase conjugate diagram, demodulating the second light field to obtain the third light field.

4. The method of claim 3, wherein, The demodulation of the second light field based on the phase conjugate diagram to obtain the third light field comprises: loading the phase conjugate diagram to a spatial light modulator, controlling the second light field to be shot at the spatial light modulator, and phase modulating the second light field based on the phase conjugate diagram through the spatial light modulator to obtain the third light field.

5. The method of claim 1, wherein, Before the demodulation of the second light field based on the visual focus point information to obtain a corresponding third light field, it comprises: determining whether the wearer's line of sight is focused; The demodulation of the second light field based on the visual focus point information to obtain a corresponding third light field comprises: if the wearer's line of sight is focused, demodulating the second light field based on the visual focus point information to obtain the third light field.

6. The method according to any one of claims 1 to 5, characterized in that, The acquisition of the first light field corresponding to the visual information output by the AR device comprises: scattering visual information light rays corresponding to the visual information to obtain the first light field.

7. The method of claim 6, wherein, The scattering of the visual information light rays corresponding to the visual information to obtain the first light field comprises: scattering the visual information light rays at different angles through a microlens array to obtain the first light field.

8. An AR device, comprising: The AR device comprises: an optical machine for outputting visual information light rays; a microlens array arranged at a position of the optical machine for scattering the visual information light rays at different angles to obtain a first light field; a phase modulation device for time-division multiplexing encoding the phase of the first light field to obtain a second light field; an eye movement tracking module for eye movement tracking of a wearer of the AR device to acquire visual focus point information; a spatial light modulator arranged at a rear side of the phase modulation device for phase modulating the second light field according to the visual focus point information to obtain a third light field, and presenting visual information to the wearer through light rays of the third light field.

9. The AR device of claim 8, wherein, The phase modulation device comprises a silicon-based liquid crystal or a spatial light modulator, and the eye movement tracking module comprises an infrared LED light source and an infrared camera.

10. The AR device of claim 8, wherein, The AR device is AR glasses, the light machine is arranged at a temple of the AR glasses, the phase modulation device is arranged at a back side of a lens of the AR glasses, and the eye movement tracking module is arranged near a nose pad of the AR glasses or at a back side edge position of the lens.

11. A visual information display device, characterized by The visual information display device comprises a memory and a processor. The memory is configured to store a computer program. The processor is configured to execute the computer program and implement the steps of the method according to any one of claims 1 to 7 when the computer program is executed.

12. An AR device, comprising: The AR device comprises the visual information display device according to claim 11.

13. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, and the computer program is executed by the processor to implement the steps of the method according to any one of claims 1 to 7.

Images