AR (Augmented Reality) equipment and light leakage prevention method

Abstract

The invention discloses AR (Augmented Reality) equipment and a light leakage prevention method. The AR equipment comprises an optical machine and an optical waveguide, the optical waveguide comprises a dimming module, a coupling-out area and a coupling-in area; the ray machine is used for emitting image light beams to the coupling-in area; the dimming module comprises a light-transmitting state and a light-proof state, and the dimming module is at least arranged at the corresponding position of the coupling-out area. Therefore, by adjusting the dimming module to be in the light-proof state, the situation that the image light beams in the optical waveguide are transmitted to the external environment through the dimming module is effectively reduced, so that the light leakage phenomenon of the AR equipment is effectively and simply reduced, the situation of information leakage is reduced, and the user experience feeling is effectively improved.

Description

Technical Field

[0001] The present application relates to the technical field of AR devices, and more specifically, to an AR device and a method for preventing light leakage. Background Art

[0002] Augmented Reality (AR) technology is widely used in various fields such as games, education, and medical treatment. AR display devices provide users with an immersive experience by combining virtual information with the real world. Among them, diffraction waveguides are key components in AR display devices. Diffraction waveguides use grating diffraction to couple in and out image beams.

[0003] However, when the image beam is coupled out, part of the image beam will enter the side where the user is, while other image beams will enter the side opposite to the user's side, that is, other image beams will leak to the outside, resulting in light leakage. The light leakage phenomenon not only affects the user's visual experience, but also causes information leakage, thereby affecting the user's experience.

[0004] In the related art, the grating structure is optimized to reduce light leakage, or a reflective layer is added to the surface of the optical waveguide to block the leaked light. However, these methods usually have problems such as complex process, high cost and limited effect. Therefore, there is an urgent need for a more effective and simple solution to reduce the light leakage problem in order to improve the privacy and user experience of AR devices. Summary of the invention

[0005] In view of the above problems, the present application proposes an AR device and an anti-light leakage method, which can effectively and conveniently reduce light leakage, thereby improving the privacy of the AR device and the user experience.

[0006] In a first aspect, an embodiment of the present application provides an AR device, which includes: an optical machine and an optical waveguide; the optical waveguide includes a dimming module, a coupling-out region and a coupling-in region; the optical machine is used to emit an image light beam to the coupling-in region; the dimming module includes a light-transmitting state and an opaque state, and the dimming module is at least arranged at a corresponding position of the coupling-out region.

[0007] In the second aspect, an embodiment of the present application also provides a method for preventing light leakage, which is applied to the above-mentioned AR device, and the method for preventing light leakage includes: determining the working state of the optical machine; when the optical machine is in a light-emitting state, controlling the dimming module to be in a light-opaque state; when the optical machine is in a non-light-emitting state, controlling the dimming module to be in a light-transmitting state.

[0008] The technical solution provided by the present application, the AR device includes: an optical machine and an optical waveguide; the optical waveguide includes a dimming module, an out-coupling area and an in-coupling area; the optical machine is used to emit an image beam to the in-coupling area; the dimming module includes a light-transmitting state and an opaque state, and the dimming module is at least arranged at the corresponding position of the out-coupling area. Thus, when the optical machine is in a light-emitting state, by adjusting the dimming module to an opaque state, the image beam emitted by the optical machine into the optical waveguide cannot be transmitted to the external environment through the optical waveguide due to the obstruction of the dimming module, thereby effectively and simply reducing the light leakage phenomenon of the AR device, thereby reducing the occurrence of information leakage and effectively improving the user experience, and when the optical machine is in a non-light-emitting state, by adjusting the dimming module to a light-transmitting state, the light beam in the external environment is emitted to the user through the optical waveguide, so that the user can observe the external environment, and due to the visual persistence effect of the human eye, the virtual image of the previous frame will be merged with the external environment image of the current frame, thereby achieving the effect of augmented reality and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application, not all embodiments. Based on the embodiments of the present application, all other embodiments and drawings obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0010] Figure 1 A schematic diagram of the structure of an AR device provided in an embodiment of the present application is shown.

[0011] Figure 2 A schematic diagram of the structure of another AR device provided in an embodiment of the present application is shown.

[0012] Figure 3 A structural schematic diagram of another AR device provided in an embodiment of the present application is shown.

[0013] Figure 4 A structural schematic diagram of another AR device provided in an embodiment of the present application is shown.

[0014] Figure 5 A structural schematic diagram of another AR device provided in an embodiment of the present application is shown.

[0015] Figure 6 A schematic diagram of the structure of yet another AR device provided in an embodiment of the present application is shown.

[0016] Figure 7 A schematic diagram of the structure of yet another AR device provided in an embodiment of the present application is shown.

[0017] Figure 8 A schematic flow chart of a light leakage prevention method provided in an embodiment of the present application is shown.

[0018] Fig. 9 A coordinate diagram showing the working time of the optical machine and the working time of the dimming module provided in an embodiment of the present application is shown.

[0019] Fig.10 A schematic structural diagram of a light leakage prevention device provided in an embodiment of the present application is shown.

[0020] Fig.11 A schematic diagram of the structure of a terminal device provided in an embodiment of the present application is shown.

[0021] Fig.12 A schematic diagram of the structure of a computer-readable storage medium provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0022] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0023] Augmented Reality (AR) is widely used in various fields such as games, education, and medical treatment. AR devices provide users with an immersive experience by combining virtual information with the real world. Among them, diffraction waveguides are key components in AR devices. Diffraction waveguides use grating diffraction to achieve the coupling in and out of image beams. Diffraction waveguides have become the main means to achieve efficient optical transmission. The image beam is coupled into the diffraction waveguide through a grating (coupling area), and after transmission, it is coupled out of the diffraction waveguide through another set of gratings (coupling area), and the image beam is delivered to the user's eyes to form an image in the user's eyeball.

[0024] Please refer to Figure 1 , Figure 1 FIG. 1 is a schematic diagram showing the structure of an AR device provided in an embodiment of the present application. Figure 1 As shown in the figure, when the image beam is coupled out, part of the image beam will enter the side where the user is, while other image beams will leak into the external environment, that is, other image beams will enter the side opposite to the user's side, resulting in light leakage. The light leakage phenomenon not only affects the user's visual experience, but also causes privacy leakage problems, thereby affecting the user's experience. (For example, when a user uses AR glasses to watch private content, other people outside may also see these contents through light leakage, resulting in poor privacy.) In order to solve this problem, the prior art has proposed a variety of improvement solutions. For example, by optimizing the grating structure to reduce light leakage, or adding a reflective layer on the surface of the optical waveguide to block the leaked image light beam. However, these methods usually have problems such as complex process, high cost and limited effect.

[0025] Therefore, there is an urgent need for a more effective and simple solution to address the light leakage problem of diffraction optical waveguides and improve the privacy and user experience of AR devices.

[0026] In order to improve the above-mentioned problems, the present application provides an AR device and a method for preventing light leakage, wherein the AR device includes an optical machine and an optical waveguide; the optical waveguide includes a dimming module, a coupling-out area and a coupling-in area; the optical machine is used to emit an image light beam to the coupling-in area; the dimming module includes a light-transmitting state and an opaque state, and the dimming module is at least arranged at a corresponding position of the coupling-out area.

[0027] Therefore, when the optical machine is in a working state, the dimming module is adjusted to a light-opaque state so that the image light beam emitted by the optical machine into the optical waveguide cannot be transmitted to the external environment through the light waveguide due to the obstruction of the dimming module, thereby effectively and simply reducing the light leakage of the AR device, thereby reducing the occurrence of information leakage and effectively improving the user experience. When the optical machine is in a non-working state, the dimming module is adjusted to a light-transmitting state so that the light beam in the external environment is emitted to the user through the light waveguide, so that the user can observe the external environment. Due to the visual persistence effect of the human eye, the previous frame of virtual image will be merged with the current frame of the external environment image, thereby achieving the effect of augmented reality and improving the user experience.

[0028] Please refer to the following steps for specific implementation details.

[0029] See also Figure 2 , Figure 2 FIG. 2 shows a schematic diagram of the structure of another AR device provided in an embodiment of the present application. Figure 2 As shown, the AR device includes an optical machine 1 and an optical waveguide 2. The optical waveguide 2 includes a dimming module 21, an outcoupling area 22 and an incoupling area 23. The optical machine 1 is used to emit an image light beam to the incoupling area 23; the dimming module 21 includes a light-transmitting state and an opaque state, and the dimming module 21 is at least arranged at a corresponding position of the outcoupling area 22.

[0030] When the optical machine 1 is in a light-emitting state, the optical machine 1 emits an image light beam to the optical waveguide 2 through the coupling-in region 23 . The image light beam propagates inside the optical waveguide 2 and propagates outward through the coupling-out region 22 . The user can obtain the corresponding information of the image light beam in the coupling-out region 22 .

[0031] When the dimming module 21 is in a light-proof state, the image light beam propagating inside the optical waveguide 2 cannot propagate to the external environment through the dimming module 21 , and the light beam in the external environment cannot propagate to the outcoupling region 22 through the dimming module 21 .

[0032] See also Figure 3 , Figure 3 FIG. 2 shows a structural diagram of another AR device provided in an embodiment of the present application. Figure 3 As shown, when the dimming module 21 is in a light-transmitting state, the image light beam propagating inside the optical waveguide 2 can propagate to the external environment through the dimming module 21 , and the light beam of the external environment can also propagate to the outcoupling area 22 through the dimming module 21 .

[0033] Therefore, when the optical machine 1 is in a light-emitting state, the state of the dimming module 21 is adjusted to an opaque state. The optical machine 1 emits an image light beam to the optical waveguide 2 through the coupling area 23, which cannot be transmitted to the external environment through the dimming module 21, thereby effectively and simply reducing the light leakage phenomenon of the image light beam propagating to the external environment through the optical waveguide 2, thereby reducing the occurrence of information leakage, and effectively improving the user experience.

[0034] In some embodiments, the dimming module 21 is a liquid crystal layer. The liquid crystal layer contains a plurality of liquid crystal molecules, and the arrangement direction of the liquid crystal molecules can be controlled by an electric field, thereby controlling the liquid crystal layer to be in a light-transmitting state or an opaque state. It is understood that the present application is not limited to the dimming module 21 being only a liquid crystal layer. In other embodiments, the dimming module 21 may be an electrochromic glass. In other embodiments, the dimming module 21 may be a liquid crystal dimming film.

[0035] In some embodiments, the dimming module 21 may be a smart film. The transparency of the dimming module 21 may be changed by adjusting external stimuli (e.g., electricity, heat, light) according to whether the optical machine 1 is emitting light. For example, when the optical machine 1 is in a light-emitting state, the transparency of the dimming module 21 is reduced by external stimuli to prevent the image light beam from propagating from the dimming module 21 to the external environment. For another example, when the optical machine 1 is in a non-light-emitting state, the transparency of the dimming module 21 is increased by external stimuli so that the light beam of the external environment propagates to the outcoupling area 22 through the dimming module 21.

[0036] It is worth noting that the optical machine 1 being in a non-luminous state refers to the interval in which the optical machine does not emit light within the working state.

[0037] In some embodiments, the dimming module 21 may be an adaptive photochromic lens, and the transmittance of the dimming module 21 is adjusted by detecting the external light intensity.

[0038] In some embodiments, the coupling-in region 23 and the coupling-out region 22 include one of a grating and a spectroscope. Whether the coupling-in region 23 and the coupling-out region 22 are gratings or spectroscopes is determined according to the specific conditions of the optical waveguide 2. For example, when the optical waveguide 2 is a diffraction optical waveguide, the coupling-in region 23 and the coupling-out region 22 are gratings (e.g., surface relief gratings). For another example, when the optical waveguide 2 is an array optical waveguide, the coupling-in region 23 and the coupling-out region 22 are spectroscopes.

[0039] In some embodiments, the optical machine 1 may be a micro projector. In some embodiments, the optical machine 1 includes one of a DLP projector, an LCOS projector, and a micro light emitting diode (MicroLED).

[0040] According to the persistence of vision effect of the human eye, as long as the refresh rate of the optical machine 1 is greater than 24Hz, the human eye can perceive continuous image changes, that is, the human eye will not perceive the staggered display of the virtual image and the real environment. Usually, the image refresh rate of the optical machine 1 is greater than 60Hz. The image refresh rate of the optical machine 1 can be set according to actual conditions. For example, the image refresh rate of the optical machine 1 can be 90Hz or 120Hz.

[0041] When the optical machine 1 switches from the luminous state to the non-luminous state, the dimming module 21 switches from the opaque state to the translucent state, so that the light beam of the external environment propagates through the dimming module 21 to the outcoupling area 22 of the optical waveguide 2, so that the user can observe the external environment. Due to the visual persistence effect of the human eye, the previous frame of the virtual image will be merged with the current frame of the external environment image, thereby achieving the effect of augmented reality and improving the user experience.

[0042] In some embodiments, a triangular prism or a periscope prism is also provided on the surface of the optical machine 1 so that the optical machine 1 can be placed horizontally, thereby saving the longitudinal space on the AR device architecture. The longitudinal space indicates the distance between the user's forehead and the AR device. If the optical machine 1 is placed vertically, the longitudinal space depth will be deeper, and the AR device will more easily interfere with the user's forehead, which is not conducive to the overall structural design and affects the user's experience. When the optical machine 1 is placed horizontally, the longitudinal space depth can be reduced to a certain extent, thereby reducing the interference between the AR device and the user's forehead, thereby improving the user's experience.

[0043] In some embodiments, a turning prism is further disposed on the surface of the optical engine 1. For example, the turning prism is a triangular prism, and the image light beam emitted by the optical engine 1 to the coupling-in area 23 is only reflected once by the optical engine 1.

[0044] Furthermore, in some embodiments, the AR device further includes a control module. The control module is used to determine the working state of the optical machine 1; the control module is used to control the dimming module 21 to be in a non-light-transmitting state when the optical machine 1 is in a light-emitting state; the control module is also used to control the dimming module 21 to be in a light-transmitting state when the optical machine 1 is in a non-light-emitting state.

[0045] In some implementations, the control module may be a controller, and the controller may include a control chip such as a CPU or an MCU.

[0046] In some embodiments, the control module monitors the operation of the optical engine 1 in real time, that is, the control module monitors whether the optical engine 1 is in a light-emitting state in real time. When the control module determines that the optical engine 1 is in a light-emitting state, the control module adjusts the state of the dimming module 21 to an opaque state to reduce the image light beam emitted by the optical engine 1 to the optical waveguide 2 from propagating to the external environment through the dimming module 21, thereby avoiding light leakage.

[0047] Please continue reading Figure 3 When the control module determines that the optical machine 1 is in a non-luminous state, the control module adjusts the state of the dimming module 21 to a light-transmitting state, and the external light beam propagates to the outcoupling area 22 of the optical waveguide 2 through the dimming module 21. This allows the user to observe the external environment. Due to the visual persistence effect of the human eye, the previous frame of the virtual image will be merged with the current frame of the external environment image, thereby achieving an augmented reality effect and improving the user experience.

[0048] In other embodiments, the control module includes a first control unit and a second control unit. The first control unit is connected to the optical machine 1, and the first control unit is used to determine whether the optical machine 1 is in a light-emitting state and control the working state of the optical machine 1 (for example, control the optical machine 1 to be in a light-emitting state or not in a light-emitting state). The first control unit is connected to the dimming module 21, and the second control unit is used to determine the state of controlling the dimming module 21 (that is, control the dimming module 21 to be in a light-transmitting state or a light-impermeable state).

[0049] When the first control unit determines that the optical machine 1 is in the light-emitting state, the first control unit sends a control signal to the second control unit, and the second control unit controls the dimming module 21 to be in the opaque state according to the control signal. The optical machine 1 emits the image light beam to the optical waveguide 2 through the coupling region 23, and the image light beam cannot be transmitted to the external environment through the dimming module 21, thereby effectively and simply reducing the light leakage phenomenon of the image light beam propagating to the external environment through the optical waveguide 2, thereby reducing the occurrence of information leakage, and effectively improving the user experience.

[0050] When the first control unit determines that the optical machine 1 is not in the light-emitting state, the first control unit sends a control signal to the second control unit, and the second control unit controls the dimming module 21 to be in the light-transmitting state according to the control signal. The light beam of the external environment propagates to the outcoupling area 22 of the optical waveguide 2 through the dimming module 21. This allows the user to observe the external environment. Due to the visual persistence effect of the human eye, the previous frame of the virtual image will be merged with the current frame of the external environment image, thereby achieving the effect of augmented reality and improving the user experience.

[0051] It can be seen that the control module adjusts the dimming module 21 to be in a light-transmitting state or a light-impermeable state according to whether the optical machine 1 is in a light-emitting state. This prevents the image light beam emitted by the optical machine 1 to the coupling region 23 of the optical waveguide 2 from propagating to the external environment through the optical waveguide 2 when the optical machine 1 is in a light-emitting state, that is, the dimming module 21 blocks the image light beam emitted by the optical machine 1 to the coupling region 23 of the optical waveguide 2 from propagating to the external environment, thereby avoiding light leakage, thereby improving the privacy of the AR device and the user experience.

[0052] When the optical machine 1 switches from the luminous state to the non-luminous state, the dimming module 21 switches from the opaque state to the translucent state, so that the light beam of the external environment propagates through the dimming module 21 to the outcoupling area 22 of the optical waveguide 2, so that the user can observe the external environment. Due to the visual persistence effect of the human eye, the previous frame of the virtual image will be integrated with the current frame of the external environment image, thereby achieving the effect of augmented reality and improving the user experience.

[0053] Further, in some embodiments, please continue to refer to Figure 3 The optical waveguide 2 includes a first side surface 24 and a second side surface 25 opposite to each other; the outcoupling region 22 is arranged on the first side surface 24 , and the dimming module 21 is arranged on the second side surface 25 ; the projection of the dimming module 21 onto the first side surface 24 at least covers the outcoupling region 22 .

[0054] In a specific embodiment, please continue to refer to Figure 3 , the projection of the dimming module 21 onto the first side surface 24 covers the first side surface 24. By covering the entire first side surface 24 with the projection of the dimming module 21 onto the first side surface 24, the image light beam can be more effectively prevented from propagating from the optical waveguide 2 to the external environment.

[0055] In another specific embodiment, please continue to refer to Figure 4 , Figure 4 FIG. 2 shows a structural diagram of another AR device provided in an embodiment of the present application. Figure 4As shown, the projection of the dimming module 21 onto the first side 24 covers the outcoupling area 22. Since the projection of the dimming module 21 onto the first side 24 only covers the outcoupling area 22, the material used for the dimming module 21 is effectively reduced, and the material cost of the AR device is effectively reduced.

[0056] In another specific embodiment, the coupling-in region 23 is disposed on the first side surface 24 ; the projection of the dimming module 21 onto the first side surface 24 at least covers the coupling-out region 22 and the coupling-in region 23 .

[0057] In another specific embodiment, please continue to refer to Figure 5 , Figure 5 FIG. 2 shows a structural diagram of another AR device provided in an embodiment of the present application. Figure 5 As shown, the optical waveguide 2 also includes an optical waveguide body 26; the dimming module 21 is arranged on the side of the outcoupling region 22 away from the optical waveguide body 24; the projection of the dimming module 21 onto the optical waveguide body 24 at least covers the projection of the outcoupling region 22 onto the optical waveguide body 24.

[0058] Please continue reading Figure 6 , Figure 6 FIG. 2 shows a schematic diagram of the structure of another AR device provided in an embodiment of the present application. Figure 6 As shown, when the dimming module 21 is arranged on the side of the out-coupling area 22 away from the optical waveguide body 24, when the optical machine 1 is in a non-luminous state, the light beam from the external environment enters the out-coupling area 22 through the dimming module 21, then enters the optical waveguide body 24 through the out-coupling area 22, and then reaches the user through the optical waveguide body 24.

[0059] In some embodiments, the optical waveguide body 26 may include a diffraction optical waveguide and an array optical waveguide. The diffraction optical waveguide uses the law of total reflection to allow the image light beam to propagate inside the optical waveguide body 26, and the image light beam is coupled in and out by the grating. Therefore, if the optical waveguide body 26 is a diffraction optical waveguide, the coupling-in region 23 and the coupling-out region 22 are gratings (e.g., surface relief gratings).

[0060] The array optical waveguide uses a beam splitter to propagate the image light beam. Therefore, if the optical waveguide body 26 is an array optical waveguide, the coupling-in region 23 and the coupling-out region 22 are beam splitters.

[0061] In a specific implementation, please continue to refer to Figure 7 , Figure 7 FIG. 2 shows a structural diagram of yet another AR device provided in an embodiment of the present application. Figure 7As shown, the optical waveguide 2 also includes a turning area 27. The turning area 27 turns the propagation direction of the image light beam, thereby achieving a one-dimensional pupil expansion and improving the display effect. The outcoupling area 22 and the turning area 27 are arranged on the first side 24 of the optical waveguide 2, and the turning area 27 is usually arranged between the coupling-in area 23 and the outcoupling area 22. The projection of the dimming module 21 to the first side 24 at least covers the projection of the outcoupling area 22 onto the optical waveguide body 24.

[0062] When the optical machine 1 is in a light-emitting state, the optical machine 1 emits an image light beam to the optical waveguide 2 through the coupling-in area 23. The image light beam is totally reflected multiple times in the optical waveguide 2 until it reaches the turning area 27 where the image light beam propagates. The turning area 27 then propagates the image light beam from the turning area 27 to the coupling-out area 22. Finally, the image light beam is coupled out from the coupling-out area 22. Part of the image light beam propagates to the user side to form an observable image, and part of the image light beam propagates toward the opposite side of the user and touches the dimming module 21. At this time, the dimming module 21 is in a light-proof state, and part of the image light beam propagating toward the opposite side of the user is blocked by the dimming module 21.

[0063] In a specific embodiment, the projection of the dimming module 21 onto the first side surface 24 covers the projection of the outcoupling region 22 onto the optical waveguide body 24. In a specific embodiment, the projection of the dimming module 21 onto the first side surface 24 covers the projection of the outcoupling region 22 and the projection of the turning region 27 onto the optical waveguide body 24. In a specific embodiment, the projection of the dimming module 21 onto the first side surface 24 covers the first side surface 24.

[0064] See also Figure 8 , Figure 8 FIG. 2 is a flow chart of a method for preventing light leakage provided by an embodiment of the present application. Figure 8 As shown, the method is applied to the above-mentioned AR device, and the method may include steps 210 to 230.

[0065] In step 210, the working state of the optical engine is determined.

[0066] The working state of the optical machine includes a light-emitting state and a non-light-emitting state. The non-light-emitting state refers to the interval when the optical machine does not emit light in the working state.

[0067] In some embodiments, the optical machine 1 may be a micro projector. In some embodiments, the optical machine 1 includes one of a DLP projector, an LCOS projector, and a micro light emitting diode (MicroLED).

[0068] In some embodiments, the working state of the optical machine is determined by a control module. The control module may be a controller. The control module monitors the working state of the optical machine in real time, so that in subsequent steps, the control module adjusts the dimming module to be in an opaque state or a translucent state according to the working state of the optical machine, thereby avoiding the situation where the image light beam sent by the optical machine propagates to the opposite side of the user through the light waveguide when the optical machine is in a light-emitting state, resulting in light leakage.

[0069] In other embodiments, the control module includes a first control unit and a second control unit. The first control unit is connected to the optical machine, and the first control unit is used to determine the working state of the optical machine and control the working state of the optical machine (for example, control the optical machine to be in a light-emitting state or not in a light-emitting state). The first control unit is connected to the dimming module, and the second control unit is used to determine the state of controlling the dimming module (that is, control the dimming module to be in a light-transmitting state or a light-impermeable state).

[0070] When the first control unit determines that the optical machine is in the light-emitting state, the first control unit sends a control signal to the second control unit, so that in the subsequent steps, the second control unit controls the dimming module to be in the opaque state according to the control signal.

[0071] When the first control unit determines that the optical machine is in a non-luminous state, the first control unit sends a control signal to the second control unit, so that in a subsequent step, the second control unit controls the dimming module to be in a light-transmitting state according to the control signal.

[0072] In step 220, when the light engine is in a light-emitting state, the dimming module is controlled to be in a light-proof state.

[0073] In some embodiments, when the control module determines that the optical engine is in a light-emitting state, the control module controls the dimming module to be in a light-proof state, so as to reduce the image light beam emitted by the optical engine to the optical waveguide from being transmitted to the external environment through the dimming module, thereby avoiding light leakage.

[0074] More specifically, in some embodiments, when the dimming module is in a light-proof state, the dimming module is used to block the image light beam in the optical waveguide from propagating from the dimming module to the outside world. The image light beam emitted by the optical machine to the coupling-in area of ​​the optical waveguide is transmitted in the main body of the optical waveguide. Due to the blocking of the dimming module, the image light beam in the main body of the optical waveguide cannot propagate to the external environment through the dimming module, thereby reducing the light leakage of the AR device.

[0075] In other embodiments, the first control unit determines that the optical machine is in a light-emitting state, and sends a control signal to the second control unit, and the second control unit controls the dimming module to be in a light-opaque state according to the control signal.

[0076] By determining the working state of the optical machine, the dimming module is adjusted to an opaque state when the optical machine is in a light-emitting state, so as to prevent the image light beam emitted by the optical machine to the coupling area of ​​the optical waveguide from being transmitted to the external environment through the dimming module, thereby avoiding light leakage in the AR device.

[0077] Furthermore, in some embodiments, the method further comprises the following steps: (1) Determine the current environment information.

[0078] (2) Determine the operating parameters of the optical engine and dimming module based on the current environmental information.

[0079] Among them, the current environment information includes a strong light scene, a weak light scene, and a balanced scene. The current environment information can be determined as a strong light scene, a weak light scene, or a balanced scene according to the brightness in the environment where the AR device is located. In a specific embodiment, the AR device also includes an optical sensor. The current environment information is determined by the detection data of the optical sensor.

[0080] In some embodiments, the working parameters include the light-emitting time of the light engine and the light-proof time of the dimming module, and the light-emitting time of the light engine and the light-proof time of the dimming module each account for a proportion of a working cycle.

[0081] By determining the current environmental information, the working parameters of the light machine and dimming module are adjusted.

[0082] More specifically, in some embodiments, when the current environment information is a strong light scene, the light-emitting time is determined to be a first value and the opaque time is determined to be a second value. The first value is greater than the second value. The specific values ​​of the first value and the second value can be determined according to actual conditions.

[0083] When the current environmental information is a strong light scene, the light-emitting time (first value) of the optical machine is greater than the opaque time (second value) of the dimming module. The brightness of the image light beam emitted by the optical machine through the coupling area will be brighter, while the brightness of the light beam of the external environment will be reduced. This can enhance the contrast between the virtual image and the real environment.

[0084] In some embodiments, when the current environment information is a low-light scene, the light-emitting time is determined to be a third value and the opaque time is determined to be a fourth value. The third value is less than the fourth value. The specific values ​​of the third value and the fourth value can be determined according to actual conditions.

[0085] When the current environmental information is a low-light scene, the light-emitting time (third value) of the optical machine is less than the opaque time (fourth value) of the dimming module. At this time, the transmittance of the AR device increases, and the brightness of the real environment will increase, which can make the background environment brighter and more visible.

[0086] In some embodiments, when the current environment information is a balanced scene, the light-emitting time and the opaque time are determined to be the fifth value. That is, the light-emitting time of the optical machine is equal to the opaque time of the dimming module. The specific value of the fifth value can be determined according to actual conditions. In this way, the brightness of the virtual image can be equivalent to the brightness of the real environment.

[0087] In other embodiments, when the light engine itself is emitting light, for a color light engine, it is also possible to determine whether the dimming module is in a light-transmitting state or a light-opaque state according to the working conditions of the three primary colors of RGB in its RGB color mode (RGB).

[0088] For example, taking the optical engine as a DLP projector, since the efficiency of the G primary color is usually much higher than that of the R primary color and the B primary color, that is, the brightness of the R primary color and the B primary color will be lower, when the optical engine is in the display working time of the G primary color, the dimming module is adjusted to a non-light-transmitting state. When the optical engine is in the display working time of the R primary color or the B primary color, the dimming module is adjusted to a light-transmitting state.

[0089] This is because the brightness of the R primary color or the B primary color is lower than that of the G primary color. Therefore, when the R primary color or the B primary color is in the display working time, the degree of light leakage of the AR device will be reduced to a certain extent.

[0090] In step 230, when the light engine is in a non-light-emitting state, the dimming module is controlled to be in a light-transmitting state.

[0091] In some embodiments, when the control module determines that the optical machine is in a non-luminous state, the control module controls the dimming module to be in a light-transmitting state. This allows the light beam in the external environment to propagate to the optical waveguide body through the adjustment module, and then propagate to the user through the outcoupling area. When the optical machine switches from a luminous state to a non-luminous state, the dimming module switches from an opaque state to a light-transmitting state, allowing the light beam in the external environment to propagate to the outcoupling area of ​​the optical waveguide through the dimming module, so that the user can observe the external environment. Due to the visual persistence effect of the human eye, the previous frame of the virtual image will be merged with the external environment image of the current frame, thereby achieving an augmented reality effect and improving the user experience.

[0092] That is, see Fig. 9 , Fig. 9 The coordinate diagram of the optical engine working time and the dimming module working time provided by the embodiment of the present application is shown. Fig. 9 As shown, the optical machine is in a light-emitting state and the dimming module is in a light-opaque state, while the optical machine is in a non-light-emitting state and the dimming module is in a light-transmissive state.

[0093] Through the cooperation between the optical machine and the dimming module, when the optical machine is in the light-emitting state, the optical machine emits the image light beam to the optical waveguide through the coupling-in area and then propagates to the external environment through the dimming module. When the optical machine is in the non-light-emitting state, the light beam from the external environment propagates to the optical waveguide through the dimming module and then propagates to the user side through the coupling-out area.

[0094] See also Fig.10 , Fig.10 The structure diagram of a light leakage prevention device provided in an embodiment of the present application is shown, which is applied to an AR device. The light leakage prevention device 300 includes: a determination module 310, a first control module 320 and a second control module 330. Specifically: The determination module 310 is used to determine the working state of the optical engine.

[0095] The first control module 320 is used to control the dimming module to be in a light-proof state when the light engine is in a light-emitting state.

[0096] The second control module 330 is used to control the dimming module to be in a light-transmitting state when the light engine is in a non-light-emitting state.

[0097] In some implementations, in the first control module 320 , when the dimming module is in a light-proof state, the dimming module is used to block the image light beam in the optical waveguide from propagating from the dimming module to the outside.

[0098] In some embodiments, the light leakage prevention device 300 further includes: an acquisition module and a third control module, wherein: Get module, used to determine the current environment information.

[0099] The third control module is used to determine the working parameters of the optical machine and the dimming module according to the current environmental information.

[0100] In some embodiments, the working parameters in the third control module include the light-emitting time of the light machine and the opaque time of the dimming module, the light-emitting time of the light machine and the opaque time of the dimming module each account for a proportion of a working cycle, and the third control module includes a first determining unit, a second determining unit, and a third determining unit, wherein: The first determination unit is used to determine that the luminous time is a first value and the opaque time is a second value when the current environment information is a strong light scene; the first value is greater than the second value.

[0101] The second determination unit is used to determine that the luminous time is a third value and the opaque time is a fourth value when the current environment information is a low-light scene; the third value is smaller than the fourth value.

[0102] The third determining unit is used to determine the luminous time and the opaque time as a fifth value when the current environmental information is a balanced scene.

[0103] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0104] In several embodiments provided in the present application, the coupling or direct coupling or communication connection between the modules shown or discussed may be an indirect coupling or communication connection through some interfaces, devices or modules, which may be electrical, mechanical or other forms.

[0105] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.

[0106] See also Fig.11 , Fig.11 A schematic diagram of the structure of a terminal device provided in an embodiment of the present application is shown. The terminal device 400 in the present application may include one or more of the following components: a processor 410, a memory 420, and one or more applications, wherein the one or more applications may be stored in the memory 420 and configured to be executed by one or more processors 410, and the one or more programs are configured to execute the anti-light leakage method as described in the aforementioned method embodiment.

[0107] The processor 410 may include one or more processing cores. The processor 410 uses various interfaces and lines to connect various parts of the entire terminal device 400, and executes various functions and processes data of the terminal device 400 by running or executing instructions, programs, code sets or instruction sets stored in the memory 420, and calling data stored in the memory 420. Optionally, the processor 410 can be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 410 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 410, but may be implemented separately through a communication chip.

[0108] The memory 420 may include a random access memory (RAM) or a read-only memory (ROM). The memory 420 may be used to store instructions, programs, codes, code sets, or instruction sets. The memory 420 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function, instructions for implementing the following various method embodiments, etc. The data storage area may also store data created by the terminal device 400 during use.

[0109] See also Fig.12 , Fig.12 A schematic diagram of the structure of a computer-readable storage medium provided in an embodiment of the present application is shown, wherein the computer-readable medium 500 stores program code, and the program code can be called by a processor to execute the cooking control method described in the above method embodiment.

[0110] The computer-readable storage medium 500 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk or a ROM. Optionally, the computer-readable storage medium 400 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 500 has storage space for program code 510 for executing any method steps in the above method. These program codes can be read from or written to one or more computer program devices. The program code 510 can be compressed, for example, in a suitable form.

[0111] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. An AR device, characterized in that: The AR device includes an optical machine and an optical waveguide; The optical waveguide includes a dimming module, an outcoupling region and an incoupling region; The optical machine is used to emit an image light beam to the coupling-in area; The dimming module includes a light-transmitting state and a light-impermeable state, and the dimming module is at least arranged at a corresponding position of the outcoupling area.

2. The AR device according to claim 1, characterized in that: The AR device also includes a control module; The control module is used to determine the working state of the optical machine; The control module is used to control the dimming module to be in a light-proof state when the optical machine is in operation; The control module is further used to control the dimming module to be in a light-transmitting state when the optical engine is not working.

3. The AR device according to claim 1, characterized in that: The optical waveguide includes a first side and a second side facing each other; The outcoupling area is arranged on the first side surface, and the dimming module is arranged on the second side surface; The projection of the dimming module onto the first side surface at least covers the outcoupling area.

4. The AR device according to claim 1, characterized in that: The optical waveguide further includes a turning region.

5. The AR device according to any one of claims 2 or 3, characterized in that: The coupling-in region is disposed on the first side surface; The projection of the dimming module onto the first side surface at least covers the out-coupling area and the in-coupling area.

6. The AR device according to claim 1, characterized in that: The optical waveguide further comprises an optical waveguide body; The dimming module is arranged on a side of the outcoupling region away from the optical waveguide body; The projection of the dimming module onto the optical waveguide body at least covers the projection of the outcoupling region onto the optical waveguide body.

7. A method for preventing light leakage, characterized in that: Applied to the AR device according to any one of claims 1 to 6, the method comprises: Determine the working status of the optical machine; When the optical machine is in a light-emitting state, controlling the dimming module to be in a light-proof state; When the optical machine is in a non-light-emitting state, the dimming module is controlled to be in a light-transmitting state.

8. The light leakage prevention method according to claim 7, characterized in that: When the dimming module is in a light-proof state, the dimming module is used to block the image light beam in the optical waveguide from propagating from the dimming module to the outside.

9. The light leakage prevention method according to any one of claims 7-8, characterized in that: The method further comprises: Determine current environmental information; According to the current environment information, working parameters of the optical engine and the dimming module are determined.

10. The light leakage prevention method according to claim 9, characterized in that: The working parameters include the light-emitting time of the light engine and the light-proof time of the dimming module, and the light-emitting time of the light engine and the light-proof time of the dimming module each account for a proportion of a working cycle; The determining, according to the current environment information, operating parameters of the optical engine and the dimming module includes: When the current environment information is a strong light scene, determining that the light emitting time is a first value and the light-proof time is a second value; the first value is greater than the second value; And / or, when the current environment information is a low-light scene, determining that the light-emitting time is a third value and the opaque time is a fourth value; the third value is smaller than the fourth value; And / or, when the current environment information is a balanced scene, the light emitting time and the light-proof time are determined to be a fifth value.

Images