Intelligent glasses and control method of intelligent glasses

Abstract

The embodiment of the invention provides intelligent glasses and a control method of the intelligent glasses, and relates to the technical field of head-mounted display products. The intelligent glasses comprise a glasses frame, a first optical machine, a second optical machine, a first optical waveguide lens, a second optical waveguide lens and a first phase modulator. The first optical machine, the second optical machine, the first optical waveguide lens, the second optical waveguide lens and the first phase modulator are all arranged on the spectacle frame, and the first phase modulator is arranged between the first optical machine and the first optical waveguide lens. The first light machine is used for generating a first light beam and projecting the first light beam to the first phase modulator, the first phase modulator is used for adjusting the phase of the first light beam and then enabling the first light beam to be emitted to the first optical waveguide lens, and the second light machine is used for generating a second light beam emitted to the second optical waveguide lens. Therefore, after the intelligent glasses are worn on the head of the user, images displayed in front of the left eye and the right eye of the user can be fused again.

Description

Technical Field

[0001] This application relates to the field of head-mounted display technology, and in particular to a smart glasses and a control method for the smart glasses. Background Technology

[0002] Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR) are emerging multimedia technologies with applications in many fields, including gaming, education, film, and healthcare. VR, AR, and MR modules can be combined into smart glasses, allowing images to be displayed in front of the user's eyes when worn on their head.

[0003] In related technologies, when smart glasses are worn on a user's head, the images displayed in front of the user's left and right eyes are prone to fusion problems. Summary of the Invention

[0004] This application provides a smart glasses and a control method for the smart glasses. After the smart glasses are worn on the user's head, the images displayed in front of the user's left and right eyes can be re-fused.

[0005] A first aspect of this application provides smart glasses, which include a frame, a first optical engine, a second optical engine, a first optical waveguide lens, a second optical waveguide lens, and a first phase modulator. The first optical engine, second optical engine, first optical waveguide lens, second optical waveguide lens, and first phase modulator are all disposed on the frame, with the first phase modulator positioned between the first optical engine and the first optical waveguide lens. The first optical engine generates a first light beam and projects it onto the first phase modulator. The first phase modulator adjusts the phase of the first light beam so that it is directed onto the first optical waveguide lens. The second optical engine generates a second light beam that is directed onto the second optical waveguide lens. The first optical waveguide lens displays an image in front of one of the user's left and right eyes based on the first light beam directed onto it. The second optical waveguide lens displays an image in front of the other of the user's left and right eyes based on the second light beam directed onto it. The images displayed by the first and second optical waveguide lenses are projected into the eye and imaged on the retina.

[0006] The smart glasses provided in this application embodiment, after being worn on the user's head, can adjust the phase of the first beam incident on the first optical waveguide lens through the first phase modulator. By adjusting the phase of the first beam incident on the first optical waveguide lens, the first beam incident on the first optical waveguide lens and the second beam incident on the second optical waveguide lens can be recalibrated, thereby enabling the image displayed by the first optical waveguide lens and the image displayed by the second optical waveguide lens to be re-fused.

[0007] Since the images displayed by the first and second waveguide lenses do not require adjustment of their relative positions after the smart glasses are worn on the user's head, the frame does not need to include adjustment mechanisms for these components, thus reducing the size and weight of the smart glasses. Furthermore, the absence of positional adjustments for these components allows for a more secure and stable fit. Additionally, the smart glasses do not generate noise during adjustments to the relative positions of the first and second waveguide lenses, and the second waveguide lens itself, after the images are re-fused to their positions. Furthermore, it eliminates the need for a large space to allow relative movement between the first optical engine and the first optical waveguide lens, as well as between the second optical engine and the second optical waveguide lens. This allows for a wider range of phase adjustment of the first beam while maintaining a small size and compact layout in the smart glasses. This facilitates the recalibration of the first beam incident on the first optical waveguide lens and the second beam incident on the second optical waveguide lens over a larger range.

[0008] In addition, compared to the scheme of firmly assembling the first optical engine and the first optical waveguide lens, and the second optical engine and the second optical waveguide lens, the relative positions of the first optical engine, the first optical waveguide lens, the second optical engine, and the second optical waveguide lens can be flexibly adjusted. It is not necessary to firmly assemble the first optical engine and the first waveguide lens, and the second optical engine and the second optical waveguide lens, which is conducive to reducing the thickness of the frame and improving wearing comfort.

[0009] In one possible implementation, the first phase modulator is an electrically controlled phase modulator, which is used to adjust the phase of the first beam according to the received electrical signal. This facilitates control of the first phase modulator via a processing component, making its control more convenient.

[0010] An electronically controlled phase modulator refers to a phase modulator in which the physical relative positions and physical coordination relationships between its various components remain unchanged when adjusting the phase of a light wave. This facilitates a compact and stable assembly of the first phase modulator, reducing the size and weight of smart glasses. Furthermore, the first phase modulator is less prone to generating significant noise when adjusting the phase of the first beam, improving the user experience. Additionally, it allows for a larger phase adjustment range while maintaining a relatively small size.

[0011] In one possible implementation, the first phase modulator has a first refractive index tunable layer. A first optomechanical system projects a first light beam onto the first refractive index tunable layer, which allows the first light beam to pass through. The first phase modulator adjusts the phase of the first light beam passing through the first refractive index tunable layer by adjusting its refractive index. Thus, by changing the refractive index of the first refractive index tunable layer, the amount of phase adjustment of the first light beam passing through it can be adjusted, thereby facilitating the adjustment of the phase of the first light beam.

[0012] In one possible implementation, the first phase modulator is a liquid crystal phase modulator, and the first refractive index tunable layer is a liquid crystal layer. The first refractive index tunable layer is used to change the arrangement of liquid crystal molecules according to changes in the applied electric field, thereby adjusting the refractive index of the first refractive index tunable layer. This facilitates the adjustment of the refractive index of the first refractive index tunable layer. Furthermore, the first phase modulator can have multiple adjustment regions, allowing independent adjustment of the phase adjustment amount in each adjustment region. This, in turn, allows for independent adjustment of the phase of the first beam incident on each adjustment region, facilitating high-precision adjustment of the first beam.

[0013] In one possible implementation, the frame includes a frame, a first temple, and a second temple. The first and second temples are connected to the frame. A first and second waveguide lens are both disposed on the frame. At least one of the frame and the first temple has a first phase modulator. A first optical mechanism is disposed on the first temple, and a second optical mechanism is disposed on the second temple. Thus, the first and second optical mechanisms are respectively disposed on the first and second temples, reducing the space required for frame placement and facilitating a reduction in frame size and weight. With reduced frame size and weight, the strength requirements for the frame can be lowered, allowing for the use of lower-strength and lower-cost materials to improve user comfort and reduce manufacturing costs. Furthermore, the reduced frame weight helps shift the center of gravity of the smart glasses backward, making them less likely to fall off the user's head due to a forward-leaning center of gravity. In addition, the disassembly and assembly of the first optical engine and the first optical waveguide lens, as well as the second optical engine and the second optical waveguide lens, are less likely to affect each other, which facilitates the individual maintenance and replacement of the first optical engine, the second optical engine, the first optical waveguide lens, and the second optical waveguide lens.

[0014] In one possible implementation, the first phase modulator is disposed on the first temple. This facilitates electrical connection between the first phase modulator and the mainboard and power supply located within the first temple, making assembly of the first phase modulator easier. Furthermore, because the distance between the first optical engine and the first phase modulator is small, the first beam generated by the first optical engine is more concentrated at the first phase modulator, resulting in less space required for the first phase modulator to process the first beam, thus reducing the size of the first phase modulator.

[0015] In one possible implementation, the first phase modulator is disposed on the frame. This provides ample space on the frame for arranging components, making the placement of the first phase modulator easier. Furthermore, the smaller distance between the first phase modulator and the first waveguide lens reduces the likelihood of interference with the first beam of light regulated by the modulator and directed onto the waveguide lens, facilitating phase control. Additionally, this arrangement allows for convenient placement of the first phase modulator on the waveguide lens. When the first phase modulator is placed on the waveguide lens, it shares the transparent substrate of the waveguide lens with the first phase modulator. The transparent substrate of the waveguide lens simultaneously supports and protects the first phase modulator, eliminating the need for a separate transparent substrate for support and protection, thus contributing to weight reduction in smart glasses.

[0016] In one possible implementation, the first temple and the second temple are hinged to the frame. Thus, the first temple can be folded to the frame, and the second temple can also be folded to the frame for easy storage of the smart glasses.

[0017] Because the phase of the first beam incident on the first optical waveguide lens can be adjusted by the first phase modulator, allowing the images displayed by the first and second optical waveguide lenses to be re-fused in the human eye, the requirements for the relative positions of the first optical engine and the first optical waveguide lens, as well as the relative positions of the second optical engine and the second optical waveguide lens, can be reduced. This makes it easier to mount the first optical engine on the first temple hinged to the lens frame and the second optical engine on the second temple hinged to the lens frame. In other words, when the first optical engine is mounted on the first temple hinged to the lens frame and the second optical engine on the second temple hinged to the lens frame, adjusting the phase of the first beam incident on the first optical waveguide lens by the first phase modulator makes it relatively easy to achieve the re-fusion of the images displayed by the first and second optical waveguide lenses.

[0018] In one possible implementation, the smart glasses further include a first detection device. The first detection device is disposed on the frame and electrically connected to a first phase modulator. The first detection device is used to detect at least one of the following: the relative position of the first optical engine and the first optical waveguide lens, the change in the relative position of the first optical engine and the first optical waveguide lens, the deformation of the frame at the first optical waveguide lens, and the deformation of the frame at the first optical engine. The first phase modulator is used to adjust the phase of the first light beam based on the data detected by the first detection device. Thus, the relative position of the first optical engine and the first optical waveguide lens can be obtained based on at least one of the following data: the relative position of the first optical engine and the first optical waveguide lens, the change in the relative position of the first optical engine and the first optical waveguide lens, the deformation of the lens frame at the first optical waveguide lens, and the deformation of the lens frame at the first optical engine. The change in the relative position relative to the first preset relative position facilitates the first phase modulator to adjust the phase of the first beam according to the change in the relative position of the first optical engine and the first optical waveguide lens relative to the first preset relative position. This enables the recalibration of the first beam incident on the first optical waveguide lens and the second beam incident on the second optical waveguide lens, so that the image displayed by the first optical waveguide lens and the image displayed by the second optical waveguide lens can be re-fused.

[0019] In one possible implementation, the smart glasses further include a second detection device disposed on the frame. The second detection device is used to detect at least one of the following: the relative position of the second optical engine and the second waveguide lens; the change in the relative position of the second optical engine and the second waveguide lens; the deformation of the frame at the second waveguide lens; and the deformation of the frame at the second optical engine. Thus, based on at least one of the following data—the relative position of the second optical engine and the second waveguide lens, the change in their relative position, the deformation of the frame at the second waveguide lens, and the deformation of the frame at the second optical engine—the change in the relative position of the second optical engine and the second waveguide lens relative to a second preset relative position can be obtained, thereby facilitating control of the smart glasses based on this change in relative position.

[0020] In one possible implementation, the second detection device is electrically connected to the first phase modulator, which adjusts the phase of the first beam based on data obtained from the first and second detection devices. Thus, the first phase modulator can adjust the phase of the first beam by combining changes in the relative positions of the first optical engine and the first optical waveguide lens relative to a first preset relative position, and changes in the relative positions of the second optical engine and the second optical waveguide lens relative to a second preset relative position. This improves the accuracy of phase adjustment and facilitates the re-fusion of the images displayed on the first and second optical waveguide lenses. Furthermore, it also facilitates the recalibration of the first beam incident on the first optical waveguide lens and the second beam incident on the second optical waveguide lens simply by adjusting the phase of the first beam.

[0021] In one possible implementation, the smart glasses further include a second phase modulator disposed on the frame and between the second optical engine and the second optical waveguide lens. The second optical engine projects a second beam of light onto the second phase modulator, and the second phase modulator adjusts the phase of the second beam to direct it onto the second optical waveguide lens. Thus, after the smart glasses are worn on the user's head, the phase of the first beam incident on the first optical waveguide lens can be adjusted by the first phase modulator, and the phase of the second beam incident on the second optical waveguide lens can be adjusted by the second phase modulator. This allows for simultaneous adjustment of the phases of both beams, enabling recalibration of the first and second optical waveguide lenses. This simplifies the recalibration process, making it easier and more accurate, and facilitates recalibration over a wider range. Ultimately, this allows for the fusion of the images displayed on the first and second optical waveguide lenses in the human eye.

[0022] In one possible implementation, the second phase modulator is electrically connected to the second detection device of the smart glasses. The second phase modulator is used to adjust the phase of the second beam based on the data detected by the second detection device. This allows the second phase modulator to adjust the phase of the second beam according to the change in the relative position of the second optical engine and the second optical waveguide lens relative to a second preset relative position. This facilitates the recalibration of the first beam incident on the first optical waveguide lens and the second beam incident on the second optical waveguide lens, enabling the images displayed on the first and second optical waveguide lenses to be re-fused.

[0023] In one possible implementation, the second phase modulator is also electrically connected to the first detection device of the smart glasses. The second phase modulator is used to adjust the phase of the second beam based on data obtained from the first and second detection devices. Thus, the second phase modulator can combine the changes in the relative positions of the first optical engine and the first optical waveguide lens relative to a first preset relative position, and the changes in the relative positions of the second optical engine and the second optical waveguide lens relative to a second preset relative position, to adjust the phase of the second beam. This improves the accuracy of phase adjustment of the second beam and facilitates the re-fusion of the images displayed by the first and second optical waveguide lenses.

[0024] This application provides a control method for smart glasses, which can be any of the smart glasses described in the above embodiments. The method includes: acquiring first data, wherein the first data is used to obtain the change in the relative position of a first optical engine and a first optical waveguide lens relative to a first preset relative position, the first preset relative position being a preset relative position of the first optical engine and the first optical waveguide lens; and forming a first control command based on first state parameters, wherein the first state parameters include the first data, and the first control command is used to instruct a first phase modulator to adjust a phase adjustment amount from a first preset adjustment amount to a first target adjustment amount, the first preset adjustment amount being the phase adjustment amount of the first phase modulator when the first optical engine and the first optical waveguide lens are in the first preset relative position, and the first target adjustment amount being determined based on the first state parameters. Thus, after the smart glasses are worn on the user's head, the phase of the first beam incident on the first optical waveguide lens can be adjusted by the first phase modulator. By adjusting the phase of the first beam incident on the first optical waveguide lens, the first beam incident on the first optical waveguide lens and the second beam incident on the second optical waveguide lens can be recalibrated, thereby enabling the images displayed by the first optical waveguide lens and the images displayed by the second optical waveguide lens to be re-fused.

[0025] In one possible implementation, a first control command instructs the first phase modulator to adjust the refractive index of the first tunable layer from a first preset refractive index to a first target refractive index, thereby adjusting the phase adjustment amount of the first phase modulator from a first preset adjustment amount to a first target adjustment amount. The first preset refractive index is the refractive index of the first tunable layer when the first optical engine and the first optical waveguide lens are in a first preset relative position, and the first target refractive index is determined according to a first state parameter. Thus, by controlling the refractive index of the first tunable layer, the adjustment amount of the phase of the first beam passing through the first tunable layer can be controlled, thereby facilitating the control of the phase of the first beam.

[0026] In one possible implementation, the first phase modulator is a liquid crystal phase modulator, and the first refractive index tunable layer is a liquid crystal layer. A first control command instructs the first phase modulator to adjust the arrangement of the liquid crystal molecules in the first refractive index tunable layer, thereby adjusting the refractive index of the first refractive index tunable layer from a first preset refractive index to a first target refractive index. This facilitates the adjustment of the refractive index of the first refractive index tunable layer. Furthermore, the first phase modulator can have multiple first adjustment regions, allowing independent adjustment of the phase adjustment amount in each first adjustment region. This, in turn, allows for independent adjustment of the phase of the first beam incident on each first adjustment region, facilitating high-precision adjustment of the first beam.

[0027] In one possible implementation, the first phase modulator includes multiple first adjustment regions. A first preset adjustment amount includes multiple first sub-preset adjustment amounts corresponding one-to-one with each of the multiple first adjustment regions. Each first sub-preset adjustment amount is the phase adjustment amount of the corresponding first adjustment region when the first optical engine and the first optical waveguide lens are in a first preset relative position. A first target adjustment amount includes multiple first sub-target adjustment amounts corresponding one-to-one with each of the multiple first adjustment regions. The first sub-target adjustment amounts are determined according to a first state parameter. A first control command is used to instruct the first phase modulator to adjust the phase adjustment amount of each first adjustment region from the corresponding first sub-preset adjustment amount to the corresponding first sub-target adjustment amount. In this way, the phase adjustment amount of each first adjustment region can be adjusted independently, enabling independent adjustment of the phase of the first beam corresponding to each first adjustment region, thereby facilitating high-precision adjustment of the first beam.

[0028] In one possible implementation, the first data includes at least one of the following: relative position data between the first optical engine and the first optical waveguide lens, angular deflection of the relative position between the first optical engine and the first optical waveguide lens relative to a first preset relative position, displacement of the relative position between the first optical engine and the first optical waveguide lens relative to the first preset relative position, and deformation of the frame. This allows for obtaining the change in the relative position between the first optical engine and the first optical waveguide lens relative to the first preset relative position.

[0029] In one possible implementation, the first state parameter further includes first wavelength data, which indicates the wavelength of the first beam. This facilitates adjustment of the phase modulation of the first phase modulator based on the wavelength of the first beam, enabling fusion of the images displayed by the first and second optical waveguide lenses.

[0030] In one possible implementation, forming a first control command based on a first state parameter includes: determining a first phase compensation amount based on the first state parameter. The first control command is then formed based on the first phase compensation amount, and a first target adjustment amount is determined based on the first phase compensation amount and a first preset adjustment amount. This facilitates the determination of the first target adjustment amount. Furthermore, when the relative positions of the first optical engine and the first optical waveguide lens are the same, it is convenient to adjust the first target adjustment amount by changing the first preset adjustment amount.

[0031] In one possible implementation, acquiring the first data includes acquiring the first data multiple times within a preset time period. The first state parameter includes the multiple first data acquired within the preset time period. Thus, a first target adjustment amount can be determined based on the multiple first data acquired within the preset time period, resulting in higher adjustment accuracy for the first phase modulator 410.

[0032] In one possible implementation, the first optical engine includes a plurality of first pixels, which are used to generate a first light beam. The method further includes: forming a first emission command based on an acquired display command, the first emission command instructing the first optical engine to cause each target first pixel to generate the first light beam sequentially, wherein the target first pixel is a first pixel to be emitted, determined according to the display command. In this way, each target first pixel generates monochromatic light sequentially, which can reduce the dispersion effect generated after the first light beam passes through the first phase modulator.

[0033] In one possible implementation, forming a first control command based on a first state parameter includes: obtaining a first target adjustment amount corresponding to each target first pixel based on the first state parameter and a display command, and forming the first control command. The first control command is used to instruct a first phase modulator to adjust the phase adjustment amount from a first preset adjustment amount to the first target adjustment amount corresponding to the currently emitting target first pixel when the target first pixel emits a first beam. In this way, the first phase modulator can make corresponding adjustments when each target first pixel emits light, resulting in high precision in the phase adjustment of the first beam.

[0034] In one possible implementation, the method further includes: forming a second control command based on a first state parameter, wherein the second control command is used to instruct the first light beam to be projected onto a first target area of ​​the first optical waveguide lens, the first target area being determined according to the first state parameter. Thus, the position of the first light beam illuminating the first optical waveguide lens can be adjusted according to the first state parameter, making it less likely for the image displayed by the first optical waveguide lens to be missing.

[0035] In one possible implementation, a second control command instructs the first optical engine to generate a first beam in a second target region, so that the first beam is projected onto a first target region of the first optical waveguide lens, the second target region being determined according to a first state parameter. Thus, the position of the first beam illuminating the first optical waveguide lens can be controlled by controlling the generation position of the first beam on the first optical engine.

[0036] In one possible implementation, the method further includes: acquiring a setting instruction and entering a setting mode according to the setting instruction. In the setting mode, acquiring an adjustment instruction. In the setting mode, updating a first preset adjustment amount according to the adjustment instruction. In the setting mode, acquiring a confirmation instruction and exiting the setting mode according to the confirmation instruction. This facilitates the resetting of the first preset adjustment amount, enabling adjustment of the first preset adjustment amount even when the user's fusion range is inconsistent, thus meeting the needs of different users.

[0037] In one possible implementation, the method further includes: acquiring second data, wherein the second data is used to obtain the change in the relative position of the second optical engine and the second optical waveguide lens relative to a second preset relative position, the second preset relative position being a preset relative position of the second optical engine and the second optical waveguide lens. The first state parameter also includes the second data. Thus, the first phase modulator can combine the first data and the second data to adjust the phase of the first beam, which helps to improve the accuracy of adjusting the phase of the first beam and facilitates the re-fusion of the images displayed by the first optical waveguide lens and the second optical waveguide lens. Furthermore, it also facilitates the recalibration of the first beam incident on the first optical waveguide lens and the second beam incident on the second optical waveguide lens simply by adjusting the phase of the first beam.

[0038] In one possible implementation, the method further includes: acquiring second data, wherein the second data is used to obtain the change in the relative position of the second optical engine and the second optical waveguide lens relative to a second preset relative position, the second preset relative position being a preset relative position of the second optical engine and the second optical waveguide lens. A third control command is generated based on second state parameters, wherein the second state parameters include the second data, and the third control command is used to instruct the second phase modulator to adjust the phase adjustment amount from a second preset adjustment amount to a second target adjustment amount, the second preset adjustment amount being the phase adjustment amount of the second phase modulator when the second optical engine and the second optical waveguide lens are in the second preset relative position, and the second target adjustment amount being determined based on the second state parameters. Thus, after the smart glasses are worn on the user's head, the phase of the first beam incident on the first optical waveguide lens can be adjusted by the first phase modulator, and the phase of the second beam incident on the second optical waveguide lens can be adjusted by the second phase modulator. This allows for the simultaneous adjustment of the phases of both beams, enabling recalibration of the first and second optical waveguide lenses. This makes recalibration easier and more accurate, facilitating recalibration of the beams over a wider range.

[0039] In one possible implementation, the first state parameter further includes second data, and the second state parameter further includes the first data. Thus, both the first and second phase modulators are adjusted in conjunction with the first and second data, resulting in high adjustment precision and facilitating the re-fusion of the images displayed by the first and second optical waveguide lenses.

[0040] A third aspect of this application provides a smart glasses system, which includes a memory and a processor. The memory stores computer execution instructions, and the processor executes the computer execution instructions stored in the memory, causing the processor to perform the methods described in any of the above embodiments.

[0041] A fourth aspect of this application provides a control device for smart glasses, the control device including a functional module for performing the methods in any of the above embodiments.

[0042] A fifth aspect of this application provides a computer-readable storage medium storing a computer program or instructions that, when executed, implement the method described in any of the above embodiments.

[0043] A sixth aspect of this application provides a computer program product, which includes a computer program or instructions that, when executed by a processor, implement the method described in any of the above embodiments. Attached Figure Description

[0044] Figure 1 A schematic diagram illustrating a smart glasses worn on a user's head, as provided in an embodiment of this application;

[0045] Figure 2 A schematic diagram of a smart glasses provided in an embodiment of this application;

[0046] Figure 3 A partial enlarged view of the connection between the first temple and the frame provided in an embodiment of this application;

[0047] Figure 4 This is a schematic diagram of a smart glasses in a first state provided in an embodiment of this application;

[0048] Figure 5 This is a schematic diagram of a smart glasses in a second state, provided as an embodiment of this application.

[0049] Figure 6 A schematic diagram of another type of smart glasses in a first state provided in an embodiment of this application;

[0050] Figure 7 A schematic diagram of another type of smart glasses in a second state, provided in an embodiment of this application;

[0051] Figure 8 A schematic diagram of another type of smart glasses in a first state provided in an embodiment of this application;

[0052] Figure 9 A flowchart illustrating a control method for smart glasses provided in an embodiment of this application;

[0053] Figure 10 This is a schematic diagram illustrating how a first pixel of a first optical engine generates a first light beam, as provided in an embodiment of this application.

[0054] Figure 11 for Figure 10 A schematic diagram showing the first light beam generated by another first pixel of the first optical engine;

[0055] Figure 12 This is a schematic diagram of yet another type of smart glasses provided in an embodiment of this application.

[0056] Explanation of reference numerals in the attached figures:

[0057] 10. Smart glasses;

[0058] 100. Eyeglass frames;

[0059] 110. Eyeglass frame; 111. First mounting frame; 112. Second mounting frame; 113. Nose pad;

[0060] 120. First temple;

[0061] 130. Second temple;

[0062] 210. First optical waveguide lens; 220. Second optical waveguide lens;

[0063] 310. First optical engine; 311. First display screen; 312. First lens group; 320. Second optical engine;

[0064] 410. First phase modulator; 411. First refractive index tunable layer; 420. Second phase modulator; 421. Second refractive index tunable layer;

[0065] 510. First detection device; 520. Second detection device;

[0066] 610. Processor; 620. Memory; 630. Communication bus; 640. Communication port;

[0067] L1, first beam; L2, second beam. Detailed Implementation

[0068] The terminology used in the implementation section of this application is only for explaining specific embodiments of this application and is not intended to limit this application. The implementation of the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0069] Figure 1 This is a schematic diagram of smart glasses worn on a user's head, as provided in an embodiment of this application.

[0070] like Figure 1As shown, this application embodiment provides a smart glasses 10, which can be worn on a user's head and used to display images in front of the user's left and right eyes. The smart glasses 10 may include, but are not limited to, virtual reality (VR) glasses, augmented reality (AR) glasses, or mixed reality (MR) glasses. This application embodiment uses AR glasses as an example for illustration.

[0071] like Figure 1 As shown in this embodiment, the smart glasses 10 may include a frame 100, a first waveguide lens 210, and a second waveguide lens 220. Both the first and second waveguide lenses 210 and 220 are disposed on the frame 100 and arranged horizontally. The frame 100 is worn on the user's head, and the first and second waveguide lenses 210 and 220 are used to display images in front of the user's left and right eyes, respectively.

[0072] In the embodiments of this application, the descriptions of related positions such as "up", "down", "left", "right", "front", and "back" are made when the smart glasses 10 are worn on the user's head.

[0073] The first waveguide lens 210 and the second waveguide lens 220 are respectively disposed on the left and right parts of the frame 100. After the smart glasses 10 are worn on the user's head, the first waveguide lens 210 and the second waveguide lens 220 are respectively opposite to the user's left and right eyes.

[0074] The first waveguide lens 210 and the second waveguide lens 220 do not specifically refer to a single waveguide lens used to display an image in front of the user's left or right eye. When the first waveguide lens 210 is located on the left side of the frame 100 and the second waveguide lens 220 is located on the right side of the frame 100, the first waveguide lens 210 is used to display an image in front of the user's left eye, and the second waveguide lens 220 is used to display an image in front of the user's right eye. Conversely, when the first waveguide lens 210 is located on the right side of the frame 100 and the second waveguide lens 220 is located on the left side of the frame 100, the first waveguide lens 210 is used to display an image in front of the user's right eye, and the second waveguide lens 220 is used to display an image in front of the user's left eye.

[0075] Figure 2 This is a schematic diagram of a smart glasses provided in an embodiment of this application.

[0076] like Figure 2As shown, the smart glasses 10 also includes a first optical engine 310 and a second optical engine 320. Both the first optical engine 310 and the second optical engine 320 are mounted on the frame 100. The first optical engine 310 is used to generate a first light beam L1 (such as...) that is incident on the first optical waveguide lens 210. Figure 4 As shown in the diagram, the second optomechanical unit 320 is used to generate a second beam L2 incident on the second optical waveguide mirror 220 (as shown in the diagram). Figure 4 As shown in the diagram, the first optical waveguide lens 210 and the second optical waveguide lens 220 can display images in front of the user's left and right eyes, respectively. The projections of the images displayed by the first optical waveguide lens 210 and the second optical waveguide lens 220 enter the human eye and form an image on the retina.

[0077] The first optical waveguide lens 210 is used to display an image in front of one of the user's left and right eyes based on the first light beam L1 incident on the first optical waveguide lens 210, and the second optical waveguide lens 220 is used to display an image in front of the other of the user's left and right eyes based on the second light beam L2 incident on the second optical waveguide lens 220.

[0078] To fuse the images displayed in front of the user's left and right eyes, that is, to fuse the images displayed by the first optical waveguide lens 210 and the second optical waveguide lens 220, it is necessary to calibrate the first beam L1 incident on the first optical waveguide lens 210 and the second beam L2 incident on the second optical waveguide lens 220.

[0079] Image fusion refers to the fusion of the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220 in the human eye.

[0080] When the smart glasses 10 are worn on the user's head, the relative positions of the first optical engine 310 and the first optical waveguide lens 210, and the relative positions of the second optical engine 320 and the second optical waveguide lens 220, are prone to significant changes relative to the calibrated relative positions of the first beam L1 and the second beam L2. This causes the phase of the first beam L1 incident on the first optical waveguide lens 210 to change significantly relative to the calibrated phase, and the phase of the second beam L2 incident on the second optical waveguide to change significantly relative to the calibrated phase. Consequently, the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220 are prone to fusion problems.

[0081] In related technologies, at least one of a first optical engine and a first optical waveguide lens can be connected to a frame via a corresponding adjustment mechanism. The relative positions of the first optical engine and the first optical waveguide lens can be adjusted using this mechanism to adjust the phase of the first light beam incident on the first optical waveguide lens. Similarly, at least one of a second optical engine and a second optical waveguide lens can be connected to a frame via a corresponding adjustment mechanism. The relative positions of the second optical engine and the second optical waveguide lens can be adjusted using this mechanism to adjust the phase of the second light beam incident on the second optical waveguide lens. Thus, after the smart glasses are worn on the user's head, the first and second light beams can be recalibrated, allowing the images displayed by the first and second optical waveguide lenses to be re-fused.

[0082] However, in related technologies, at least some components of the first optical engine, second optical engine, first waveguide lens, and second waveguide lens need to be movably connected to the frame. The stability of the assembly of these movably connected components is relatively poor; that is, the assembly stability of at least some components of the first optical engine, second optical engine, first waveguide lens, and second waveguide lens is poor. Furthermore, the structure of the adjustment mechanism is often quite complex, resulting in a larger size and heavier weight for the smart glasses. Additionally, adjusting the relative positions of the first optical engine and the first waveguide lens, and adjusting the relative positions of the second optical engine and the second waveguide lens, using the adjustment mechanism easily generates significant noise, leading to a poor user experience. Furthermore, the amount of phase adjustment of the first beam is limited by the change in the relative position of the first optical engine and the first optical waveguide lens, and the amount of phase adjustment of the second beam is limited by the change in the relative position of the second optical engine and the second optical waveguide lens. When the space of the smart glasses is relatively compact, the amount of phase adjustment of the first and second beams is small, and the range for recalibrating the first and second beams is small. Conversely, when the phase of the first and second beams needs to be adjusted over a larger range, a larger space needs to be reserved for relative movement between the first optical engine and the first optical waveguide lens, as well as between the second optical engine and the second optical waveguide lens, which will make the size of the smart glasses larger.

[0083] Figure 3 This is a partial enlarged view of the connection between the first temple and the frame, provided in an embodiment of this application.

[0084] like Figure 3 Based on this, in this embodiment of the application, the smart glasses 10 further includes a first phase modulator 410, which is disposed on the frame 100 and between the first optical engine 310 and the first optical waveguide lens 210.

[0085] Figure 4 This is a schematic diagram of a smart glasses in a first state according to an embodiment of this application. Figure 5 This is a schematic diagram illustrating a smart glasses device in a second state according to an embodiment of this application. In the first state, the first optical engine 310 and the first waveguide lens 210 are in a first preset relative position, and the second optical engine 320 and the second waveguide lens 220 are in a second preset relative position. In the second state, the first optical engine 310 and the first waveguide lens 210 are not in the first preset relative position, and the second optical engine 320 and the second waveguide lens 220 are not in the second preset relative position. The first preset relative position is a preset relative position of the first optical engine 310 and the first waveguide lens 210, and the second preset relative position is a preset relative position of the second optical engine 320 and the second waveguide lens 220.

[0086] like Figure 4 , Figure 5 As shown, the first optical engine 310 is used to generate a first beam L1 and project the first beam L1 onto the first phase modulator 410. The first phase modulator 410 is used to adjust the phase of the first beam L1 and then direct the first beam L1 onto the first optical waveguide lens 210.

[0087] In this way, after the smart glasses 10 are worn on the user's head, the phase of the first beam L1 incident on the first optical waveguide lens 210 can be adjusted by the first phase modulator 410. By adjusting the phase of the first beam L1 incident on the first optical waveguide lens 210, the first beam L1 incident on the first optical waveguide lens 210 and the second beam L2 incident on the second optical waveguide lens 220 can be recalibrated, thereby enabling the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220 to be re-fused.

[0088] Since the images displayed by the first optical waveguide lens 210 and the second optical waveguide lens 220 do not need to be adjusted to re-fuse after the smart glasses 10 are worn on the user's head, the relative positions of the first optical engine 310 and the first optical waveguide lens 210, and the relative positions of the second optical engine 320 and the second optical waveguide lens 220 do not need to be adjusted on the frame 100, so that the adjustment mechanism for adjusting the positions of the first optical engine 310, the second optical engine 320, the first optical waveguide lens 210 and the second optical waveguide lens 220 is not required, which helps to reduce the size and weight of the smart glasses 10. Furthermore, the positions of the first optical engine 310, the second optical engine 320, the first waveguide lens 210, and the second waveguide lens 220 do not require adjustment, allowing all three components to be fixedly mounted to the frame 100. This facilitates a secure assembly of the first optical engine 310, the second optical engine 320, the first waveguide lens 210, and the second waveguide lens 220. Additionally, the smart glasses 10 do not generate noise when adjusting the relative positions of the first optical engine 310 and the first waveguide lens 210, or the second optical engine 320 and the second waveguide lens 220, thus improving the user experience. Furthermore, there is no need to reserve a large space for relative movement between the first optical engine 310 and the first optical waveguide lens 210, and between the second optical engine 320 and the second optical waveguide lens 220. This allows for a larger range of phase adjustment of the first beam L1 within a relatively small size and compact arrangement space of the smart glasses 10. This facilitates the recalibration of the first beam L1 incident on the first optical waveguide lens 210 and the second beam L2 incident on the second optical waveguide lens 220 within a larger range.

[0089] In addition, compared to the scheme of firmly assembling the first optical mechanism 310 with the first optical waveguide lens 210 and the second optical mechanism 320 with the second optical waveguide lens 220, the relative positions between the first optical mechanism 310, the first optical waveguide lens 210, the second optical mechanism 320, and the second optical waveguide lens 220 can be flexibly adjusted. It is not necessary to firmly assemble the first optical mechanism 310 with the first waveguide lens 210 and the second optical mechanism 320 with the second optical waveguide lens 220, which is conducive to reducing the thickness of the frame 110 of the eyeglass frame 100 and improving wearing comfort.

[0090] like Figure 1 , Figure 2 As shown, the eyeglass frame 100 includes a first temple 120, a second temple 130, and a frame 110. The first temple 120 and the second temple 130 are connected to the frame 110. The first temple 120 and the second temple 130 are located at the left and right ends of the frame 110, respectively. The first temple 120 and the second temple 130 are used to hook onto the user's left and right ears, respectively. The frame 110 can be placed on the user's nose and supported by the user's nose.

[0091] The first temple 120 and the second temple 130 do not specifically refer to either the left or right end of the frame 110. When the first temple 120 is located at the left end of the frame 110, and the second temple 130 is located at the right end of the frame 110, the first temple 120 is used to hook onto the user's left ear, and the second temple 130 is used to hook onto the user's right ear. When the second temple 130 is located at the left end of the frame 110, and the first temple 120 is located at the right end of the frame 110, the first temple 120 is used to hook onto the user's right ear, and the second temple 130 is used to hook onto the user's left ear.

[0092] The first waveguide lens 210 and the second waveguide lens 220 are both disposed on the frame 110. The first waveguide lens 210 is arranged near the first temple 120, and the second waveguide lens 220 is arranged near the second temple 130. For example, when the first temple 120 is located at the left end of the frame 110, the first waveguide lens 210 is disposed on the left part of the frame 110, the second temple 130 is located at the right end of the frame 110, and the second waveguide lens 220 is disposed on the right part of the frame 110. Similarly, when the first temple 120 is located at the right end of the frame 110, the first waveguide lens 210 is disposed on the right part of the frame 110, the second temple 130 is located at the left end of the frame 110, and the second waveguide lens 220 is disposed on the left part of the frame 110.

[0093] The eyeglass frame 110 may include a first mounting frame 111, a second mounting frame 112, and a nose pad 113. The left and right ends of the nose pad 113 are fixedly connected to the first mounting frame 111 and the second mounting frame 112, respectively. A first optical waveguide lens 210 is disposed in the first mounting frame 111, and a second optical waveguide lens 220 is disposed in the second mounting frame 112. A first temple 120 is connected to the end of the first mounting frame 111 that is away from the nose pad 113, and a second temple 130 is connected to the end of the second mounting frame 112 that is away from the nose pad 113. The nose pad 113 is used to be placed on the user's nose.

[0094] For example, the first mounting frame 111, the second mounting frame 112, and the nose pad 113 can be an integral structure.

[0095] For example, at least one of the frame 110 and the first temple 120 is provided with a first phase modulator 410 to facilitate the installation of the first phase modulator 410.

[0096] like Figure 2As shown, in some possible embodiments, the first optical mechanism 310 is located on the first temple 120. This reduces the space required for the frame 110 compared to a solution where the first optical mechanism 310 is located on the frame 110, thus reducing the size and weight of the frame 110. With reduced size and weight, the strength requirements for the frame 110 can be lowered, allowing for the use of lower-strength and lower-cost materials to improve user comfort and reduce manufacturing costs. Furthermore, the reduced weight of the frame 110 helps shift the center of gravity of the smart glasses 10 backward, making it less likely to fall off the user's head due to a forward center of gravity and reducing pressure on the bridge of the nose. Additionally, the assembly and disassembly of the first optical mechanism 310 on the first temple 120 and the first waveguide lens 210 on the frame 110 are less likely to interfere with each other, facilitating individual maintenance and replacement of both components.

[0097] Of course, in some other possible implementations, the first optical engine 310 and the first phase modulator 410 may both be mounted on the frame 110.

[0098] like Figure 2 As shown, in some possible embodiments, the second optical mechanism 320 is located on the second temple 130. This reduces the space required for the frame 110 compared to a solution where the second optical mechanism 320 is located on the frame 110, allowing for a reduction in the size and weight of the frame 110. The reduced size and weight of the frame 110 lowers the strength requirements, allowing for the use of lower-strength and lower-cost materials, thus improving user comfort and reducing manufacturing costs. Furthermore, the lighter frame 110 helps shift the center of gravity of the smart glasses 10 backward, preventing it from falling off the user's head due to a forward center of gravity and reducing pressure on the bridge of the nose. Additionally, the assembly and disassembly of the second optical mechanism 320 on the second temple 130 and the second waveguide lens 220 on the frame 110 are less likely to interfere with each other, facilitating separate maintenance and replacement of the second optical mechanism 320 and the second waveguide lens 220.

[0099] Of course, in some other possible implementations, the second optical engine 320 may also be mounted on the frame 110.

[0100] like Figure 2 As shown, in some possible embodiments, the first temple 120 and the second temple 130 are hinged to the frame 110.

[0101] In this way, the first temple 120 can be folded with the frame 110, and the second temple 130 can be folded with the frame 110 to facilitate the storage of the smart glasses 10.

[0102] Since the phase of the first beam L1 incident on the first optical waveguide lens 210 can be adjusted by the first phase modulator 410, the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220 can be re-fused, the requirements for the relative positions of the first optical engine 310 and the first optical waveguide lens 210, and the relative positions of the second optical engine 320 and the second optical waveguide lens 220 can be reduced. As a result, it is more convenient to set the first optical engine 310 on the first temple 120 hinged to the lens frame 110 and the second optical engine 320 on the second temple 130 hinged to the lens frame 110. In other words, when the first optical engine 310 is mounted on the first temple 120 hinged to the frame 110 and the second optical engine 320 is mounted on the second temple 130 hinged to the frame 110, the phase of the first beam L1 incident on the first optical waveguide lens 210 can be adjusted by the first phase modulator 410, and the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220 can be re-fused relatively easily.

[0103] In other examples, the first temple 120 and the second temple 130 may also be fixedly connected to the frame 110. For example, the first temple 120 and the second temple 130 may be an integral structure with the frame 110.

[0104] The smart glasses 10 also includes a processing component that can be electrically connected to the first optical engine 310, the second optical engine 320 and the first phase modulator 410, and can be used to control the first optical engine 310, the second optical engine 320 and the first phase modulator 410.

[0105] For example, the processing component may include a first motherboard disposed within the first temple 120. The first motherboard may be electrically connected to the first optical engine 310 and the first phase modulator 410. The first motherboard may be used to control the first optical engine 310 and the first phase modulator 410.

[0106] In some examples, the first motherboard can also be electrically connected to the second optical engine 320, and the first motherboard can also be used to control the second optical engine 320.

[0107] In some examples, the processing component may also include a second motherboard disposed within the second temple 130. The second motherboard may be electrically connected to the second optical engine 320 and may be used to control the second optical engine 320.

[0108] The smart glasses 10 also includes a power supply component, which can be electrically connected to the first optical engine 310, the second optical engine 320, the first phase modulator 410 and the processing component, and can be used to supply power to the first optical engine 310, the second optical engine 320 and the first phase modulator 410 and the processing component.

[0109] For example, the power supply assembly may include a first power supply disposed within the first temple 120. The first power supply may be electrically connected to the first optical engine 310 and the first phase modulator 410, and may be used to supply power to the first optical engine 310 and the first phase modulator 410.

[0110] In some examples, the first power supply can also be electrically connected to the second optical engine 320, and the first power supply can also be used to supply power to the second optical engine 320.

[0111] In some examples, the power supply assembly may also include a second power supply located within the second temple 130. The second power supply may be electrically connected to the second optical engine 320 and may be used to supply power to the second optical engine 320.

[0112] In some examples, the second power supply may also be electrically connected to the first optomechanical system 310 and the first phase modulator 410, and the second power supply may also be used to supply power to the first optomechanical system 310 and the first phase modulator 410.

[0113] In some possible implementations, the first phase modulator 410 is an electrically controlled phase modulator, which is used to adjust the phase of the first beam L1 according to the received electrical signal.

[0114] This makes it easier to control the first phase modulator 410 through the processing component, and the control of the first phase modulator 410 is more convenient.

[0115] An electrically controlled phase modulator refers to a phase modulator in which the physical relative positions and physical coordination relationships between its various components do not change when adjusting the phase of a light wave. This facilitates a compact and stable assembly of the first phase modulator 410, reducing the size and weight of the smart glasses 10. Furthermore, the first phase modulator 410 is less prone to generating significant noise when adjusting the phase of the first beam L1, thus improving the user experience. Additionally, it allows the first phase modulator 410 to achieve a large phase adjustment range while maintaining a relatively small size.

[0116] In other possible implementations, the first phase modulator 410 may also be a phase modulator that adjusts the phase of the beam by changing the physical relative position or physical fit between the components.

[0117] like Figure 4 , Figure 5As shown, in some possible embodiments, the first phase modulator 410 has a first refractive index tunable layer 411. A first optomechanical system 310 projects a first beam L1 onto the first refractive index tunable layer 411, the first refractive index tunable layer 411 allows the first beam L1 to pass through, and the first phase modulator 410 adjusts the phase of the first beam L1 passing through the first refractive index tunable layer 411 by adjusting the refractive index of the first refractive index tunable layer 411.

[0118] In this way, the phase adjustment of the first beam L1 passing through the first refractive index adjustable layer 411 can be adjusted by changing the refractive index of the first refractive index adjustable layer 411, thereby making it easier to adjust the phase of the first beam L1.

[0119] In some possible implementations, the first phase modulator 410 is a liquid crystal phase modulator, and the first refractive index adjustable layer 411 is a liquid crystal layer. The first refractive index adjustable layer 411 is used to change the arrangement state of liquid crystal molecules with the change of the applied electric field, so as to adjust the refractive index of the first refractive index adjustable layer 411.

[0120] This facilitates the adjustment of the refractive index of the first refractive index adjustable layer 411. Furthermore, the first phase modulator 410 can have multiple first adjustment regions, allowing for independent adjustment of the phase adjustment amount in each first adjustment region. This enables independent adjustment of the phase of the light beam L1 incident on each first adjustment region, facilitating higher-precision adjustment of the first beam L1.

[0121] In other possible implementations, the first phase modulator 410 may also be an acousto-optic phase modulator, a magneto-optic phase modulator, a thermo-optic phase modulator, or an electro-optic phase modulator. An acousto-optic phase modulator can adjust the phase of a light wave by generating ultrasonic waves. A magneto-optic phase modulator can adjust the phase of a light wave by generating a magnetic field. A thermo-optic phase modulator can adjust the phase of a light wave by changing the refractive index of the phase modulator through temperature. An electro-optic phase modulator can adjust the phase of a light wave passing through a crystal by applying an external electric field to change the refractive index of certain crystals (such as lithium niobate LiNbO3). In this case, the first refractive index tunable layer 411 can be a crystal layer.

[0122] like Figure 4 , Figure 5 As shown, in some possible implementations, the first phase modulator 410 is disposed on the first temple 120.

[0123] This facilitates the electrical connection between the first phase modulator 410 and the first main board and first power supply located within the first temple 120, making the assembly of the first phase modulator 410 more convenient (for example, when the first temple 120 is hinged to the frame 110, the first phase modulator 410 does not need to be connected across the hinge to the first main board and first power supply located within the first temple 120). Furthermore, because the distance between the first optical engine 310 and the first phase modulator 410 is small, the first beam L1 generated by the first optical engine 310 is more concentrated at the first phase modulator 410, resulting in less space required for the first phase modulator 410 to process the first beam L1, thus reducing the size of the first phase modulator 410.

[0124] like Figure 4 As shown, in some possible embodiments, the smart glasses 10 further includes a first detection device 510. The first detection device 510 is disposed on the frame 100, specifically on at least one of the frame 110 and the first temple 120. The first detection device 510 is electrically connected to the first phase modulator 410. The first detection device 510 is used to detect at least one of the following: the relative position of the first optical engine 310 and the first optical waveguide lens 210; the change in the relative position of the first optical engine 310 and the first optical waveguide lens 210; the deformation of the frame 100 at the first optical waveguide lens 210; and the deformation of the frame 100 at the first optical engine 310. The first phase modulator 410 is used to adjust the phase of the first beam L1 based on the data detected by the first detection device 510.

[0125] In this way, based on at least one of the following data, the relative position of the first optical engine 310 and the first optical waveguide lens 210, the change in the relative position of the first optical engine 310 and the first optical waveguide lens 210, the deformation of the frame 100 at the first optical waveguide lens 210, and the deformation of the frame 100 at the first optical engine 310, the change in the relative position of the first optical engine 310 and the first optical waveguide lens 210 relative to the first preset relative position can be obtained. This facilitates the first phase modulator 410 to adjust the phase of the first beam L1 based on the change in the relative position of the first optical engine 310 and the first optical waveguide lens 210 relative to the first preset relative position. This enables the recalibration of the first beam L1 incident on the first optical waveguide lens 210 and the second beam L2 incident on the second optical waveguide lens 220, so that the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220 can be re-fused.

[0126] For example, the first detection device 510 may include one or more of a distance sensor, an angle sensor, a stress sensor, etc.

[0127] For example, a power supply assembly is electrically connected to the first detection device 510, and the power supply assembly can be used to supply power to the first detection device 510. For instance, a first power supply can be electrically connected to the first detection device 510, and the first power supply can supply power to the first detection device 510. Alternatively, a second power supply can be electrically connected to the first detection device 510, and the second power supply can supply power to the first detection device 510.

[0128] For example, the first detection device 510 can be electrically connected to the processing component, so that the first detection device 510 can be electrically connected to the first phase modulator 410 through the processing component. The processing component can acquire the data detected by the first detection device 510 and control the first phase modulator 410 to adjust the phase of the first beam L1 based on the data detected by the first detection device 510. For example, the first detection device 510 can be electrically connected to the first motherboard, so that the first detection device 510 can be electrically connected to the first phase modulator 410 through the first motherboard. The first motherboard can acquire the data detected by the first detection device 510 and control the first phase modulator 410 to adjust the phase of the first beam L1 based on the data detected by the first detection device 510.

[0129] In some possible implementations, the smart glasses 10 further includes a second detection device 520. The second detection device 520 is disposed on the frame 100, specifically on at least one of the frame 110 and the second temple 130. The second detection device 520 is used to detect at least one of the following: the relative position of the second optical engine 320 and the second waveguide lens 220; the change in the relative position of the second optical engine 320 and the second waveguide lens 220; the deformation of the frame 100 at the second waveguide lens 220; and the deformation of the frame 100 at the second optical engine 320.

[0130] In this way, the change in the relative position of the second optical engine 320 and the second optical waveguide lens 220 relative to a second preset relative position can be obtained based on at least one of the following data: the relative position of the second optical engine 320 and the second optical waveguide lens 220, the change in the relative position of the second optical engine 320 and the second optical waveguide lens 220, the deformation of the frame 100 at the second optical waveguide lens 220, and the deformation of the frame 100 at the second optical engine 320. This allows the smart glasses 10 to be controlled based on the change in the relative position of the second optical engine 320 and the second optical waveguide lens 220 relative to the second preset relative position.

[0131] For example, the second detection device 520 may include one or more of a distance sensor, an angle sensor, a stress sensor, etc.

[0132] For example, a power supply assembly is electrically connected to the second detection device 520, and the power supply assembly can be used to supply power to the second detection device 520. For example, a first power supply can be electrically connected to the second detection device 520, and the first power supply can supply power to the second detection device 520. As another example, a second power supply can be electrically connected to the second detection device 520, and the second power supply can supply power to the second detection device 520.

[0133] For example, the second detection device 520 can be electrically connected to the processing component, which can acquire the data detected by the second detection device 520 and control the smart glasses 10 based on the data detected by the second detection device 520.

[0134] In some possible implementations, the second detection device 520 is electrically connected to the first phase modulator 410, which is used to adjust the phase of the first beam L1 based on the data obtained by the first detection device 510 and the second detection device 520.

[0135] In this way, the first phase modulator 410 can adjust the phase of the first beam L1 by combining the changes in the relative positions of the first optical engine 310 and the first optical waveguide lens 210 relative to the first preset relative position, and the changes in the relative positions of the second optical engine 320 and the second optical waveguide lens 220 relative to the second preset relative position. This improves the accuracy of adjusting the phase of the first beam L1 and facilitates the re-fusion of the images displayed by the first optical waveguide lens 210 and the second optical waveguide lens 220. Furthermore, it also facilitates the recalibration of the first beam L1 incident on the first optical waveguide lens 210 and the second beam L2 incident on the second optical waveguide lens 220 simply by adjusting the phase of the first beam L1.

[0136] For example, the phase of the first beam L1 can be adjusted based on the difference between the change in the relative position of the first optical engine 310 and the first optical waveguide lens 210 relative to the first preset relative position and the change in the relative position of the second optical engine 320 and the second optical waveguide lens 220 relative to the second preset relative position.

[0137] In some examples, the second detection device 520 can be electrically connected to the first motherboard, so that the second detection device 520 can be electrically connected to the first phase modulator 410 through the first motherboard. The first motherboard can acquire the data detected by the first detection device 510 and the second detection device 520, and control the first phase modulator 410 to adjust the phase of the first beam L1 according to the data detected by the first detection device 510 and the second detection device 520.

[0138] Figure 6 This is a schematic diagram illustrating another type of smart glasses in a first state, as provided in an embodiment of this application. Figure 7 This is a schematic diagram of another type of smart glasses in a second state, provided in an embodiment of this application.

[0139] like Figure 6 , Figure 7 As shown, in some possible embodiments, the smart glasses 10 further includes a second phase modulator 420, which is disposed on the frame 100 and between the second optical engine 320 and the second optical waveguide lens 220. The second optical engine 320 projects a second beam L2 onto the second phase modulator 420, and the second phase modulator 420 adjusts the phase of the second beam L2 so that the second beam L2 is directed onto the second optical waveguide lens 220.

[0140] Thus, after the smart glasses 10 are worn on the user's head, the phase of the first beam L1 incident on the first optical waveguide lens 210 can be adjusted by the first phase modulator 410, and the phase of the second beam L2 incident on the second optical waveguide lens 220 can be adjusted by the second phase modulator 420. This allows for simultaneous adjustment of the phases of both the first beam L1 and the second beam L2 incident on the first optical waveguide lens 210, thereby controlling the phase of the first beam L1 incident on the first optical waveguide lens 210. The recalibration of the first beam L1 and the second beam L2 incident on the first optical waveguide lens 210 and the second beam L2 incident on the second optical waveguide lens 220 makes the recalibration of the first beam L1 incident on the first optical waveguide lens 210 and the second beam L2 incident on the second optical waveguide lens 220 easier and more accurate. This facilitates the recalibration of the first beam L1 incident on the first optical waveguide lens 210 and the second beam L2 incident on the second optical waveguide lens 220 over a larger range, so as to realize the re-fusion of the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220 in the human eye.

[0141] For example, at least one of the frame 110 and the second temple 130 is provided with a second phase modulator 420 to facilitate the installation of the second phase modulator 420.

[0142] When the second optical engine 320 is mounted on the lens frame 110, the second phase modulator 420 is mounted on the lens frame 110.

[0143] The power supply assembly can also be electrically connected to the second phase modulator 420, and can also be used to supply power to the second phase modulator 420. For example, a first power supply can be electrically connected to the second phase modulator 420, and the first power supply can supply power to the second phase modulator 420. Similarly, a second power supply can be electrically connected to the second phase modulator 420, and the second power supply can supply power to the second phase modulator 420.

[0144] The processing component is also electrically connected to the second phase modulator 420 to enable control of the second phase modulator 420.

[0145] In some examples, the first mainboard located in the first temple 120 can also be electrically connected to the second phase modulator 420. The first mainboard can also be used to control the second phase modulator 420. That is, the first mainboard can be used to control the first phase modulator 410 and the second phase modulator 420.

[0146] In some examples where a second mainboard is provided within the second temple 130, the second mainboard can also be electrically connected to the second phase modulator 420, and the second mainboard can also be used to control the second phase modulator 420. In this case, the first mainboard can be used to control the first phase modulator 410, and the second mainboard can be used to control the second phase modulator 420.

[0147] In some possible implementations, the second phase modulator 420 is an electrically controlled phase modulator, which is used to adjust the phase of the second beam L2 according to the received electrical signal.

[0148] This facilitates control of the second phase modulator 420 via the processing components, making control of the second phase modulator 420 more convenient. Furthermore, it facilitates a compact and robust assembly of the second phase modulator 420, reducing the size and weight of the smart glasses 10. Additionally, the second phase modulator 420 is less prone to generating significant noise when adjusting the phase of the second beam L2, thus improving the user experience. Moreover, it allows the second phase modulator 420 to achieve a large phase adjustment range while maintaining a relatively small size.

[0149] In other possible implementations, the second phase modulator 420 may also be a phase modulator that adjusts the phase of the beam by changing the physical relative position or physical fit between the components.

[0150] In some possible implementations, the second phase modulator 420 has a second refractive index tunable layer 421. A second optomechanical system 320 projects a second beam L2 onto the second refractive index tunable layer 421, through which the second beam L2 passes. The second phase modulator 420 adjusts the phase of the second beam L2 passing through the second refractive index tunable layer 421 by adjusting its refractive index.

[0151] In this way, the phase adjustment of the second beam L2 passing through the second refractive index adjustable layer 421 can be adjusted by changing the refractive index of the second refractive index adjustable layer 421, thereby making it easier to adjust the phase of the second beam L2.

[0152] In some possible implementations, the second phase modulator 420 is a liquid crystal phase modulator, and the second refractive index adjustable layer 421 is a liquid crystal layer. The second refractive index adjustable layer 421 is used to change the arrangement state of liquid crystal molecules with the change of the applied electric field, so as to adjust the refractive index of the second refractive index adjustable layer 421.

[0153] This facilitates the adjustment of the refractive index of the second refractive index adjustable layer 421. Furthermore, the second phase modulator 420 can have multiple second adjustment regions, allowing for independent adjustment of the phase adjustment amount in each second adjustment region. This, in turn, enables independent adjustment of the phase of the light beam L2 incident on each second adjustment region, facilitating high-precision adjustment of the second beam L2.

[0154] In other possible implementations, the second phase modulator 420 may also be a phase modulator based on the acousto-optic effect, or a phase modulator based on the magneto-optic effect, or a phase modulator based on the thermo-optic effect, or a phase modulator based on the electro-optic effect. When the second phase modulator 420 is a phase modulator based on the electro-optic effect, the second refractive index tunable layer 421 may be a crystal layer.

[0155] In some possible implementations, the second phase modulator 420 is disposed on the second temple 130.

[0156] This facilitates the electrical connection between the second phase modulator 420 and the second main board and second power supply located within the second temple 130, making the assembly of the second phase modulator 420 more convenient (for example, when the second temple 130 is hinged to the frame 110, the second phase modulator 420 does not need to be connected across the hinge to the second main board and second power supply located within the second temple 130). Furthermore, because the distance between the second optical engine 320 and the second phase modulator 420 is small, the second beam L2 generated by the second optical engine 320 is more concentrated at the second phase modulator 420, resulting in less space required for the second phase modulator 420 to process the second beam L2, thus reducing the size of the second phase modulator 420.

[0157] In some possible implementations, the second phase modulator 420 is electrically connected to the second detection device 520 of the smart glasses 10, and the second phase modulator 420 is used to adjust the phase of the second beam L2 based on the data detected by the second detection device 520.

[0158] This allows the second phase modulator 420 to adjust the phase of the second beam L2 based on the relative position of the second optomechanical unit 320 and the second optical waveguide lens 220 relative to the second preset relative position. This facilitates the recalibration of the first beam L1 incident on the first optical waveguide lens 210 and the second beam L2 incident on the second optical waveguide lens 220, so that the images displayed by the first optical waveguide lens 210 and the images displayed by the second optical waveguide lens 220 can be re-fused.

[0159] The second phase modulator 420 can be electrically connected to the second detection device 520 via a processing component. The processing component can acquire the data detected by the second detection device 520 and control the second phase modulator 420 to adjust the phase of the second beam L2 based on the data detected by the second detection device 520. For example, when a second main board is provided inside the second temple 130, the second phase modulator 420 can be electrically connected to the second detection device 520 via the second main board. The second main board can acquire the data detected by the second detection device 520 and control the second phase modulator 420 to adjust the phase of the second beam L2 based on the data detected by the second detection device 520.

[0160] In some possible implementations, the second phase modulator 420 is also electrically connected to the first detection device 510 of the smart glasses 10. The second phase modulator 420 is used to adjust the phase of the second beam L2 based on the data obtained from the first detection device 510 and the second detection device 520.

[0161] In this way, the second phase modulator 420 can combine the changes in the relative positions of the first optical engine 310 and the first optical waveguide lens 210 relative to the first preset relative position, and the changes in the relative positions of the second optical engine 320 and the second optical waveguide lens 220 relative to the second preset relative position, to adjust the phase of the second beam L2. This helps to improve the accuracy of adjusting the phase of the second beam L2 and facilitates the re-fusion of the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220.

[0162] For example, the phase of the second beam L2 can be adjusted based on the difference between the change in the relative position of the first optical engine 310 and the first optical waveguide lens 210 relative to the first preset relative position and the change in the relative position of the second optical engine 320 and the second optical waveguide lens 220 relative to the second preset relative position.

[0163] For example, the first detection device 510 can also be electrically connected to the second motherboard, so that the first detection device 510 can be electrically connected to the second phase modulator 420 through the second motherboard. The second motherboard can acquire the data detected by the first detection device 510 and the second detection device 520, and control the second phase modulator 420 to adjust the phase of the second beam L2 according to the data detected by the first detection device 510 and the second detection device 520.

[0164] Figure 8 This is a schematic diagram of another type of smart glasses provided in the embodiments of this application in a first state.

[0165] In some other possible implementations, the first phase modulator 410 is disposed on the frame 110.

[0166] In this way, the space on the frame 110 for arranging devices is relatively large, making it easier to arrange the first phase modulator 410. Furthermore, the small distance between the first phase modulator 410 and the first optical waveguide lens 210 means that the first beam L1, after being adjusted by the first phase modulator 410 and incident on the first optical waveguide lens 210, is less susceptible to interference, facilitating phase control of the first beam L1 incident on the first optical waveguide lens 210. Additionally, it facilitates the placement of the first phase modulator 410 on the first optical waveguide lens 210. When the first phase modulator 410 is placed on the first optical waveguide lens 210, it can share the transparent substrate (e.g., glass) of the first optical waveguide lens 210. The transparent substrate of the first optical waveguide lens 210 can simultaneously support and protect the first phase modulator 410, eliminating the need for a separate transparent substrate for support and protection, thus contributing to weight reduction in smart glasses.

[0167] In some other examples of smart glasses 10, a second phase modulator 420 is provided on the frame 110.

[0168] In this way, the space on the frame 110 for arranging devices is relatively large, making it easier to arrange the second phase modulator 420. Furthermore, the small distance between the second phase modulator 420 and the second waveguide lens 220 means that the second beam L2, after being adjusted by the second phase modulator 420 and incident on the second waveguide lens 220, is less susceptible to interference, facilitating phase control of the second beam L2 incident on the second waveguide lens 220. Additionally, it facilitates the placement of the second phase modulator 420 on the second waveguide lens 220. When the second phase modulator 420 is placed on the second waveguide lens 220, it can share the transparent substrate (e.g., glass) of the second waveguide lens 220. The transparent substrate of the second waveguide lens 220 can simultaneously support and protect the second phase modulator 420, eliminating the need for a separate transparent substrate for support and protection, thus contributing to weight reduction in smart glasses.

[0169] This application embodiment also provides a control method for smart glasses 10, which can be executed by smart glasses 10. For example, the method can be executed by the processing component of smart glasses 10, and smart glasses 10 can be any of the smart glasses 10 described above.

[0170] Figure 9 A flowchart illustrating a control method for smart glasses provided in this application embodiment.

[0171] like Figure 9 As shown, the method includes:

[0172] S100: Acquire first data. The first data is used to obtain the change in the relative position of the first optical engine 310 and the first optical waveguide lens 210 relative to a first preset relative position. The first preset relative position is a preset relative position of the first optical engine 310 and the first optical waveguide lens 210.

[0173] For example, the first data includes at least one of the following: relative position data between the first optical engine 310 and the first optical waveguide lens 210, angular deflection of the relative position between the first optical engine 310 and the first optical waveguide lens 210 relative to a first preset relative position, displacement of the relative position between the first optical engine 310 and the first optical waveguide lens 210 relative to the first preset relative position, and deformation of the frame 100. The deformation of the frame 100 may include at least one of the following: deformation of the frame 110 at the first optical waveguide lens 210 and deformation of the first temple 120 at the first optical engine 310. This allows for obtaining the change in the relative position between the first optical engine 310 and the first optical waveguide lens 210 relative to the first preset relative position.

[0174] For example, the first data can be detected by the first detection device 510.

[0175] For example, after acquiring the first data, the smart glasses 10 can process the first data to obtain the change data of the relative position of the first optical engine 310 and the first optical waveguide lens 210 relative to the first preset relative position.

[0176] S200: A first control command is generated based on the first state parameters, wherein the first state parameters include first data, and the first control command is used to instruct the first phase modulator 410 to adjust the phase adjustment amount from the first preset adjustment amount to the first target adjustment amount.

[0177] The first target adjustment amount is determined according to the first state parameter. The first target adjustment amount is the phase adjustment amount by which the first phase modulator 410 enables the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220 to be fused.

[0178] The first preset adjustment amount is the phase adjustment amount of the first phase modulator 410 when the first optical engine 310 and the first optical waveguide lens 210 are in the first preset relative position. That is, when the first optical engine 310 and the first optical waveguide lens 210 are in the first preset relative position, after the first phase modulator 410 adjusts the first beam L1 according to the first preset adjustment amount, the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220 can be fused. At this time, the first target adjustment amount is equal to the first preset adjustment amount.

[0179] In this way, after the smart glasses 10 are worn on the user's head, the phase of the first beam L1 incident on the first optical waveguide lens 210 can be adjusted by the first phase modulator 410. By adjusting the phase of the first beam L1 incident on the first optical waveguide lens 210, the first beam L1 incident on the first optical waveguide lens 210 and the second beam L2 incident on the second optical waveguide lens 220 can be recalibrated, thereby enabling the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220 to be re-fused.

[0180] Since the images displayed by the first optical waveguide lens 210 and the second optical waveguide lens 220 do not need to be adjusted to re-fuse after the smart glasses 10 are worn on the user's head, the relative positions of the first optical engine 310 and the first optical waveguide lens 210, and the relative positions of the second optical engine 320 and the second optical waveguide lens 220 do not need to be adjusted on the frame 100, so that the adjustment mechanism for adjusting the positions of the first optical engine 310, the second optical engine 320, the first optical waveguide lens 210 and the second optical waveguide lens 220 is not required, which helps to reduce the size and weight of the smart glasses 10. Furthermore, the positions of the first optical engine 310, the second optical engine 320, the first waveguide lens 210, and the second waveguide lens 220 do not require adjustment, allowing all three components to be fixedly mounted to the frame 100. This facilitates a secure assembly of the first optical engine 310, the second optical engine 320, the first waveguide lens 210, and the second waveguide lens 220. Additionally, the smart glasses 10 do not generate noise when adjusting the relative positions of the first optical engine 310 and the first waveguide lens 210, or the second optical engine 320 and the second waveguide lens 220, thus improving the user experience. Furthermore, there is no need to reserve a large space for relative movement between the first optical engine 310 and the first optical waveguide lens 210, and between the second optical engine 320 and the second optical waveguide lens 220. This allows for a larger range of phase adjustment of the first beam L1 within a relatively small size and compact arrangement space of the smart glasses 10. This facilitates the recalibration of the first beam L1 incident on the first optical waveguide lens 210 and the second beam L2 incident on the second optical waveguide lens 220 within a larger range.

[0181] In some possible implementations, step S200 includes:

[0182] S210: Determine the first phase compensation amount based on the first state parameters.

[0183] S220: A first control command is generated based on the first phase compensation amount. The first target adjustment amount is determined based on the first phase compensation amount and the first preset adjustment amount.

[0184] This facilitates the determination of the first target adjustment amount. Furthermore, when the relative positions of the first optical engine 310 and the first optical waveguide lens 210 are the same, it is convenient to adjust the first target adjustment amount by changing the first preset adjustment amount.

[0185] In some other possible implementations, the first target adjustment amount can also be determined based on the change in the relative position of the first optical engine 310 and the first optical waveguide lens 210 relative to the first preset relative position. For example, each relative position of the first optical engine 310 and the first optical waveguide lens 210 can correspond to a determined first target adjustment amount.

[0186] In some examples where the first phase modulator 410 has a first refractive index adjustable layer 411, a first control command is used to instruct the first phase modulator 410 to adjust the refractive index of the first refractive index adjustable layer 411 from a first preset refractive index to a first target refractive index, so as to adjust the phase adjustment amount of the first phase modulator 410 from a first preset adjustment amount to a first target adjustment amount.

[0187] The first target refractive index is determined according to the first state parameter. The first target refractive index is the refractive index at which the first refractive index adjustable layer 411 enables the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220 to be fused.

[0188] The first preset refractive index is the refractive index of the first refractive index adjustable layer 411 when the first optical engine 310 and the first optical waveguide lens 210 are in the first preset relative position. That is, when the first optical engine 310 and the first optical waveguide lens 210 are in the first preset relative position, after the first beam L1 passes through the first refractive index adjustable layer 411 with the first preset refractive index, the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220 can be fused. At this time, the first target refractive index is equal to the first preset refractive index.

[0189] In this way, by controlling the refractive index of the first refractive index adjustable layer 411, the adjustment amount of the phase of the first beam L1 passing through the first refractive index adjustable layer 411 can be controlled, thereby making it easier to control the phase of the first beam L1.

[0190] Step S220 includes:

[0191] S221: Obtain the first refractive index compensation amount based on the first phase compensation amount.

[0192] S222: A first control command is generated based on the first refractive index compensation amount, and the first target refractive index is determined based on the first refractive index compensation amount and the first preset refractive index.

[0193] In some examples where the first phase modulator 410 is a liquid crystal phase modulator and the first refractive index adjustable layer 411 is a liquid crystal layer, the first control command is used to instruct the first phase modulator 410 to adjust the arrangement of liquid crystal molecules in the first refractive index adjustable layer 411 so as to adjust the refractive index of the first refractive index adjustable layer 411 from the first preset refractive index to the first target refractive index.

[0194] This facilitates the adjustment of the refractive index of the first refractive index adjustable layer 411. Furthermore, the first phase modulator 410 can have multiple first adjustment regions, allowing for independent adjustment of the phase adjustment amount in each first adjustment region. This enables independent adjustment of the phase of the light beam L1 incident on each first adjustment region, facilitating higher-precision adjustment of the first beam L1.

[0195] In some possible implementations, the first phase modulator 410 includes a plurality of first adjustment regions, and the first target adjustment amount includes a plurality of first sub-target adjustment amounts corresponding one-to-one with the plurality of first adjustment regions. The first sub-target adjustment amounts are determined according to a first state parameter. The first sub-target adjustment amount is: the phase adjustment amount of the corresponding first adjustment region that enables the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220 to be fused.

[0196] The first preset adjustment amount includes multiple first sub-preset adjustment amounts that correspond one-to-one with multiple first adjustment regions. The first sub-preset adjustment amount is the phase adjustment amount of the corresponding first adjustment region when the first optical engine 310 and the first optical waveguide lens 210 are in a first preset relative position. At this time, the first sub-target adjustment amount corresponding to the first adjustment region is equal to the corresponding first sub-preset adjustment amount.

[0197] The first control command is used to instruct the first phase modulator 410 to adjust the phase adjustment amount of each first adjustment region from the corresponding first sub-preset adjustment amount to the corresponding first sub-target adjustment amount.

[0198] In this way, the phase adjustment amount of each first adjustment region can be adjusted independently, and the phase of the first beam corresponding to each first adjustment region can be adjusted independently, so as to achieve high-precision adjustment of the first beam L1.

[0199] In some examples where the first phase modulator 410 includes multiple first adjustment regions, step S210 includes:

[0200] S211: Determine the first sub-phase compensation amount corresponding to each first adjustment region based on the first state parameters.

[0201] Step S220 includes:

[0202] Step S223: Generate a first control command based on the first sub-phase compensation amount corresponding to each first adjustment region. The first sub-target adjustment amount corresponding to each first adjustment region is determined based on the corresponding first sub-phase compensation amount and the corresponding first sub-preset adjustment amount.

[0203] In some examples where the first control command instructs the first phase modulator 410 to adjust the refractive index of the first refractive index adjustable layer 411 from a first preset refractive index to a first target refractive index, the first refractive index adjustable layer 411 includes multiple first adjustment regions. The first target refractive index includes multiple first sub-target refractive indices corresponding one-to-one with the multiple first adjustment regions, and the first sub-target refractive indices are determined according to a first state parameter. The first sub-target refractive index is the refractive index of the corresponding first adjustment region that allows the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220 to be fused. The first preset refractive index includes multiple first sub-preset refractive indices corresponding one-to-one with the multiple first adjustment regions. The first sub-preset refractive index is the refractive index of the corresponding first adjustment region when the first optical engine 310 and the first optical waveguide lens 210 are in a first preset relative position. At this time, the first sub-target refractive index corresponding to the first adjustment region is equal to the corresponding first sub-preset refractive index. The first control command is used to instruct the first phase modulator 410 to adjust the refractive index of each first adjustment region from the corresponding first sub-preset refractive index to the corresponding first sub-target refractive index, so as to adjust the phase adjustment amount of each first adjustment region from the first sub-preset adjustment amount to the first sub-target adjustment amount.

[0204] In some examples where the first refractive index tunable layer 411 includes multiple first adjustment regions, step S223 includes:

[0205] S2231: The corresponding first sub-refractive index compensation is obtained based on the first sub-phase compensation amount corresponding to each first adjustment region.

[0206] S2232: A first control command is formed based on the first sub-refractive index compensation amount corresponding to each first adjustment region. The first sub-target refractive index corresponding to each first adjustment region is determined based on the corresponding first sub-refractive index compensation amount and the corresponding first sub-preset refractive index.

[0207] In some possible implementations, the first state parameter may further include first wavelength data, which is used to indicate the wavelength of the first beam L1.

[0208] This facilitates the adjustment of the phase of the first phase modulator 410 according to the wavelength of the first beam L1, so as to achieve image fusion of the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220.

[0209] The first optical engine 310 and the first phase modulator 410 are mounted on the first temple 120. The first data includes the angular deflection α of the relative position of the first optical engine 310 and the first optical waveguide lens 210 relative to a first preset relative position (e.g., ...). Figure 5 Taking the example shown, Φ1=2*π*w1*sin(a) / λl, where, Φ1 represents the first sub-phase compensation amount corresponding to the first adjustment region, w1 represents the distance between the first adjustment region and the first zero-point position on the first phase modulator 410, and λl represents the wavelength of the first beam incident on the first adjustment region. The first zero-point position can be any defined location on the light-emitting surface of the first phase modulator 410; for example, it can be the left or right end of the light-emitting surface of the first refractive index tunable layer 411. The first zero-point position can serve as the zero point of the coordinate system of the first phase modulator 410.

[0210] In some possible implementations, step S100 includes: acquiring the first data multiple times within a preset time period.

[0211] The first state parameter includes multiple first data points acquired within a preset time period.

[0212] In this way, the first target adjustment amount can be determined based on multiple first data obtained within a preset time period, which can make the adjustment accuracy of the first phase modulator 410 higher.

[0213] In some possible implementations, the first optical engine 310 includes a plurality of first pixels, which are used to generate a first light beam L1, and the first light beam L1 generated by the first pixels is monochromatic light.

[0214] For example, the first beam L1 generated by each first pixel is a parallel beam of light emitted from the first optical engine 310.

[0215] Figure 10 This is a schematic diagram illustrating the generation of a first light beam by a first pixel of a first optical engine, as provided in an embodiment of this application.

[0216] like Figure 10 As shown, for example, the first optical engine 310 includes a first display screen 311 and a first lens group 312. The first lens group 312 is disposed on the light-emitting side of the first display screen 311. The first display screen 311 includes a plurality of first pixels. The first lens group 312 is used to focus the first light beam L1 generated by the first pixels into parallel light rays and emit them from the first optical engine 310.

[0217] Figure 11 for Figure 10 A schematic diagram showing the first beam generated by another first pixel of the first optical engine.

[0218] like Figure 11 As shown, and see Figure 10 In some examples, the first light beams L1 generated by different first pixels on the first display screen 311 are focused by the first lens group 312 and emitted from the first optical engine 310 in different directions.

[0219] The method also includes:

[0220] S300: A first light-emitting instruction is formed according to the acquired display instruction. The first light-emitting instruction is used to instruct the first optical engine 310 to generate a first light beam L1 from each of the target first pixels. The target first pixel is the first pixel to be emitted according to the display instruction.

[0221] In this way, each target first pixel point generates monochromatic unidirectional parallel light one by one, which can reduce the dispersion effect generated after the first beam L1 passes through the first phase modulator 410.

[0222] The display command includes information about the image that the first optical engine 310 needs to project. The display command can be generated by the user pressing a button on the smart glasses or operating an external control device (e.g., a mobile phone or remote control).

[0223] For example, when each target first pixel emits light, the first beam L1 incident on the first optical waveguide lens 210 is a monochromatic parallel ray.

[0224] For example, the first emission command is used to instruct the first optomechanical system 310 to cause the first pixel to generate a first light beam L1 according to the first target timing sequence.

[0225] In some examples, the first target timing can be determined based on the display command. In other examples, the first target timing can also be a preset fixed timing.

[0226] In some possible implementations, step S200 includes:

[0227] S230: Obtain the first target adjustment amount corresponding to each target first pixel according to the first state parameter and the display instruction, and form a first control instruction, wherein the first control instruction is used to instruct the first phase modulator 410 to adjust the phase adjustment amount from the first preset adjustment amount to the first target adjustment amount corresponding to the currently emitting target first pixel when the target first pixel generates the first beam L1.

[0228] In this way, the first phase modulator 410 can make corresponding adjustments when each target first pixel emits light, so that the phase adjustment of the first beam L1 is highly accurate.

[0229] For example, step 230 includes:

[0230] S231: Determine the first phase compensation amount corresponding to the first pixel of each target based on the first state parameter and the display instruction.

[0231] S232: A first control command is generated based on the first phase compensation amount corresponding to each target first pixel. The first target adjustment amount corresponding to the target first pixel is determined based on the first preset adjustment amount and the corresponding first phase compensation amount.

[0232] In some possible implementations, the method further includes:

[0233] S400: A second control command is formed based on the first state parameters, wherein the second control command is used to instruct the first beam L1 to be projected into the first target area of ​​the first optical waveguide lens 210, and the first target area is determined based on the first state parameters.

[0234] In this way, the position of the first beam L1 illuminating the first optical waveguide lens 210 can be adjusted according to the first state parameters, so that the image displayed by the first optical waveguide lens 210 is less likely to be missing.

[0235] For example, the first target area can be determined based on the first state parameters and the acquired display instructions, so as to improve the adjustment accuracy of the position of the first beam L1 illuminating the first optical waveguide lens 210, making the image displayed by the first optical waveguide lens 210 less prone to loss.

[0236] In some possible implementations, the second control command is used to instruct the first optomechanical system 310 to generate a first beam L1 in the second target region, so that the first beam L1 is projected into the first target region of the first optical waveguide lens 210, the second target region being determined according to the first state parameter.

[0237] In this way, the position of the first beam L1 illuminating the first optical waveguide lens 210 can be controlled by controlling the generation position of the first beam L1 on the first optical engine 310.

[0238] The first pixel of the target is located within the second target area.

[0239] For example, the second target area can be determined based on the first state parameters and the acquired display instructions, so as to improve the control accuracy of the generation position of the first beam L1 on the first optomechanical 310, and thus improve the control accuracy of the position of the first beam L1 illuminating the first optical waveguide lens 210.

[0240] In some possible implementations, the method further includes:

[0241] S510: Obtains setting instructions and enters setting mode according to the setting instructions.

[0242] S520: In setting mode, obtain adjustment commands.

[0243] S530: In setting mode, update the first preset adjustment amount according to the adjustment command.

[0244] S540: In setup mode, obtain a confirmation command and exit setup mode based on the confirmation command.

[0245] This facilitates the resetting of the first preset adjustment amount, enabling adjustment of the first preset adjustment amount when the user's fusion range is inconsistent, thus meeting the needs of different users.

[0246] For example, setting instructions, adjustment instructions, and confirmation instructions can be generated by the user pressing a button on the smart glasses or operating an external control device (e.g., a mobile phone or remote control).

[0247] In some possible implementations, the relative positions of the second optical engine 320 and the second optical waveguide lens 220 are fixed, and the first target adjustment amount can be determined based on the change in the relative position of the first optical engine 310 and the first optical waveguide lens 210 relative to the first preset relative position.

[0248] In some other possible implementations, the relative positions of the second optical engine 320 and the second optical waveguide lens 220, and the relative positions of the first optical engine 310 and the first optical waveguide lens 210, are set to change symmetrically with respect to the plane of symmetry of the frame 100. In this case, the change in the relative position of the second optical engine 320 and the second optical waveguide lens 220 relative to the second preset relative position can be obtained based on the change in the relative position of the first optical engine 310 and the first optical waveguide lens 210 relative to the first preset relative position. The first target adjustment amount is determined based on the changes in the relative positions of the first optical engine 310 and the first optical waveguide lens 210 relative to the first preset relative position, and the changes in the relative positions of the second optical engine 320 and the second optical waveguide lens 220 relative to the second preset relative position.

[0249] The first waveguide lens 210 and the second waveguide lens 220 are located on both sides of the plane of symmetry of the frame 100.

[0250] The second preset relative position is the preset relative position between the second optical engine 320 and the second optical waveguide lens 220.

[0251] In some possible implementations, the method further includes:

[0252] S600: Acquire second data, wherein the second data is used to obtain the change in the relative position of the second optical engine 320 and the second optical waveguide lens 220 relative to the second preset relative position.

[0253] This makes it easier to control the smart glasses 10 based on the change in the relative position of the second optical engine 320 and the second optical waveguide lens 220 relative to the second preset relative position.

[0254] For example, the second data includes at least one of the following: relative position data between the second optical engine 320 and the second optical waveguide lens 220; angular deflection of the relative position between the second optical engine 320 and the second optical waveguide lens 220 relative to a second preset relative position; displacement of the relative position between the second optical engine 320 and the second optical waveguide lens 220 relative to the second preset relative position; and deformation of the frame 100. The deformation of the frame 100 may include at least one of the following: deformation of the frame 110 at the second optical waveguide lens 220 and deformation of the temple 130 at the second optical engine 320. This allows for obtaining the change in the relative position between the second optical engine 320 and the second optical waveguide lens 220 relative to the second preset relative position.

[0255] For example, the second data can be detected by the second detection device 520.

[0256] For example, after acquiring the second data, the smart glasses 10 can process the second data to obtain the change data of the relative position of the second optical engine 320 and the second optical waveguide lens 220 relative to the second preset relative position.

[0257] In some examples, the first state parameter also includes second data.

[0258] In this way, the first phase modulator 410 can combine the first data and the second data to adjust the phase of the first beam L1, which helps to improve the accuracy of the phase adjustment of the first beam L1 and facilitates the re-fusion of the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220. In addition, it also facilitates the recalibration of the first beam L1 incident on the first optical waveguide lens 210 and the second beam L2 incident on the second optical waveguide lens 220 by adjusting only the phase of the first beam L1.

[0259] In some examples where the first state parameter includes the second data, a first control command can be formed based on the difference between the first and second data. The first target adjustment amount is determined based on the difference between the first and second data.

[0260] In some possible implementations, when the smart glasses 10 includes a second phase modulator 420, the method further includes:

[0261] S700: A third control command is generated based on the second state parameters, wherein the second state parameters include second data, and the third control command is used to instruct the second phase modulator 420 to adjust the phase adjustment amount from the second preset adjustment amount to the second target adjustment amount.

[0262] The second target adjustment amount is determined according to the second state parameter. The second target adjustment amount is the phase adjustment amount by which the second phase modulator 420 enables the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220 to be fused.

[0263] The second preset adjustment amount is the phase adjustment amount of the second phase modulator 420 when the second optical engine 320 and the second optical waveguide lens 220 are in the second preset relative position. That is, when the second optical engine 320 and the second optical waveguide lens 220 are in the second preset relative position, after the second phase modulator 420 adjusts the second beam L2 according to the second preset adjustment amount, the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220 can be fused. At this time, the second target adjustment amount is equal to the second preset adjustment amount.

[0264] In this way, after the smart glasses 10 are worn on the user's head, the phase of the first beam L1 incident on the first optical waveguide lens 210 can be adjusted by the first phase modulator 410, and the phase of the second beam L2 incident on the second optical waveguide lens 220 can be adjusted by the second phase modulator 420. This allows for the simultaneous adjustment of the phases of the first beam L1 incident on the first optical waveguide lens 210 and the second beam L2 incident on the second optical waveguide lens 220, thereby enabling the recalibration of the first beam L1 incident on the first optical waveguide lens 210 and the second beam L2 incident on the second optical waveguide lens 220. This makes the recalibration of the first beam L1 incident on the first optical waveguide lens 210 and the second beam L2 incident on the second optical waveguide lens 220 easier and more accurate, which is beneficial for recalibrating the first beam L1 incident on the first optical waveguide lens 210 and the second beam L2 incident on the second optical waveguide lens 220 over a larger range.

[0265] In some possible implementations, step 700 includes:

[0266] S710: Determine the second phase compensation amount based on the second state parameters.

[0267] S720: A third control command is generated based on the second phase compensation amount. The second target adjustment amount is determined based on the second phase compensation amount and the second preset adjustment amount.

[0268] This facilitates the determination of the second target adjustment amount. Furthermore, when the relative positions of the second optomechanical unit 320 and the second optical waveguide lens 220 are the same, it is convenient to adjust the second target adjustment amount by changing the second preset adjustment amount.

[0269] In some other possible implementations, the second target adjustment amount can also be determined based on the change in the relative position of the second optical engine 320 and the second optical waveguide lens 220 relative to the second preset relative position. For example, each relative position of the second optical engine 320 and the second optical waveguide lens 220 can correspond to a determined second target adjustment amount.

[0270] In some examples where the second phase modulator 420 has a second refractive index adjustable layer 421, a third control command is used to instruct the second phase modulator 420 to adjust the refractive index of the second refractive index adjustable layer 421 from a second preset refractive index to a second target refractive index, so as to adjust the phase adjustment amount of the second phase modulator 420 from a second preset adjustment amount to a second target adjustment amount.

[0271] The second target refractive index is determined according to the second state parameter. The second target refractive index is the refractive index of the second refractive index adjustable layer 421 that enables the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220 to be fused.

[0272] The second preset refractive index is the refractive index of the second refractive index adjustable layer 421 when the second optical engine 320 and the second optical waveguide lens 220 are in the second preset relative position. That is, when the second optical engine 320 and the second optical waveguide lens 220 are in the second preset relative position, after the second beam L2 passes through the second refractive index adjustable layer 421 with the second preset refractive index, the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220 can be fused. At this time, the second target refractive index is equal to the second preset refractive index.

[0273] In this way, by controlling the refractive index of the second refractive index adjustable layer 421, the phase adjustment of the second beam L2 passing through the second refractive index adjustable layer 421 can be controlled, thereby making it easier to control the phase of the second beam L2.

[0274] Step 7920 includes:

[0275] S721: The second refractive index compensation is obtained based on the second phase compensation.

[0276] S722: A third control command is generated based on the second refractive index compensation amount, and the second target refractive index is determined based on the second refractive index compensation amount and the second preset refractive index.

[0277] In some examples where the second phase modulator 420 is a liquid crystal phase modulator and the second refractive index adjustable layer 421 is a liquid crystal layer, the third control command is used to instruct the second phase modulator 420 to adjust the arrangement of liquid crystal molecules in the second refractive index adjustable layer 421 so as to adjust the refractive index of the second refractive index adjustable layer 421 from the second preset refractive index to the second target refractive index.

[0278] This facilitates the adjustment of the refractive index of the second refractive index adjustable layer 421. Furthermore, the second phase modulator 420 can have multiple second adjustment regions, allowing for independent adjustment of the phase adjustment amount in each second adjustment region. This, in turn, enables independent adjustment of the phase of the light beam L2 incident on each second adjustment region, facilitating high-precision adjustment of the second beam L2.

[0279] In some possible implementations, the second phase modulator 420 includes a plurality of second adjustment regions, and the second target adjustment amount includes a plurality of second sub-target adjustment amounts corresponding one-to-one with the plurality of second adjustment regions. The second sub-target adjustment amounts are determined according to a second state parameter. The second sub-target adjustment amount is: the phase adjustment amount of the corresponding second adjustment region that enables the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220 to be fused.

[0280] The second preset adjustment amount includes multiple second sub-preset adjustment amounts that correspond one-to-one with multiple second adjustment regions. The second sub-preset adjustment amount is the phase adjustment amount of the corresponding second adjustment region when the second optical engine 320 and the second optical waveguide lens 220 are in a second preset relative position. At this time, the second sub-target adjustment amount corresponding to the second adjustment region is equal to the corresponding second sub-preset adjustment amount.

[0281] The third control command is used to instruct the second phase modulator 420 to adjust the phase adjustment amount of each second adjustment region from the corresponding second sub-preset adjustment amount to the corresponding second sub-target adjustment amount.

[0282] In this way, the phase adjustment amount of each second adjustment region can be adjusted independently, and the phase of the second beam corresponding to each second adjustment region can be adjusted independently, so as to achieve high-precision adjustment of the second beam L2.

[0283] In some examples where the second phase modulator 420 includes multiple second adjustment regions, step S710 includes:

[0284] S711: Determine the second sub-phase compensation amount corresponding to each second adjustment region based on the second state parameters.

[0285] Step S720 includes:

[0286] Step S723: Generate a third control command based on the second sub-phase compensation amount corresponding to each second adjustment region. The second sub-target adjustment amount corresponding to each second adjustment region is determined based on the corresponding second sub-phase compensation amount and the corresponding second sub-preset adjustment amount.

[0287] In some examples where the third control command instructs the second phase modulator 420 to adjust the refractive index of the second refractive index adjustable layer 421 from a second preset refractive index to a second target refractive index, the second refractive index adjustable layer 421 includes multiple second adjustment regions. The second target refractive index includes multiple second sub-target refractive indices corresponding one-to-one with the multiple second adjustment regions, and the second sub-target refractive indices are determined according to a second state parameter. The second sub-target refractive index is the refractive index of the corresponding second adjustment region that allows the images displayed by the first optical waveguide lens 210 and the second optical waveguide lens 220 to fuse. The second preset refractive index includes multiple second sub-preset refractive indices corresponding one-to-one with the multiple second adjustment regions. The second sub-preset refractive index is the refractive index of the corresponding second adjustment region when the second optical engine 320 and the second optical waveguide lens 220 are in a second preset relative position. At this time, the second sub-target refractive index corresponding to the second adjustment region is equal to the corresponding second sub-preset refractive index. The third control command is used to instruct the second phase modulator 420 to adjust the refractive index of each second adjustment region from the corresponding second sub-preset refractive index to the corresponding second sub-target refractive index, so as to adjust the phase adjustment amount of each second adjustment region from the second sub-preset adjustment amount to the second sub-target adjustment amount.

[0288] In some examples where the second refractive index tunable layer 421 includes multiple second adjustment regions, step S723 includes:

[0289] S7231: The corresponding second sub-refractive index compensation is obtained based on the second sub-phase compensation amount corresponding to each second adjustment region.

[0290] S7232: A third control command is formed based on the second sub-refractive index compensation amount corresponding to each second adjustment region. The second sub-target refractive index corresponding to each second adjustment region is determined based on the corresponding second sub-refractive index compensation amount and the corresponding second sub-preset refractive index.

[0291] In some possible implementations, the second state parameter also includes second wavelength data, which is used to indicate the wavelength of the second beam L2.

[0292] This facilitates the adjustment of the phase of the second phase modulator 420 according to the wavelength of the second beam L2, so as to achieve image fusion of the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220.

[0293] Taking the second optical engine 320 and the second phase modulator 420 as being mounted on the second temple 130, and the second data including the angular deflection b of the relative position of the second optical engine 320 and the second optical waveguide lens 220 relative to a second preset relative position as an example. Φ2=2*π*w*sin(b) / λ2, where, Φ2 represents the second sub-phase compensation amount corresponding to the second adjustment region, w2 represents the distance between the second adjustment region and the second zero-point position on the second phase modulator 420, and λ2 represents the wavelength of the second beam incident on the second adjustment region. The second zero-point position can be any defined location on the light-emitting surface of the second phase modulator 420; for example, it can be the left or right end of the light-emitting surface of the second refractive index tunable layer 421. The second zero-point position can serve as the zero point of the coordinate system of the second phase modulator 420.

[0294] In some possible implementations, step S600 includes: acquiring second data multiple times within a preset time period.

[0295] The second state parameter includes multiple second data acquired within a preset time period.

[0296] In this way, the second target adjustment amount can be determined based on multiple second data acquired within a preset time period, which can make the adjustment accuracy of the second phase modulator 420 higher.

[0297] In some possible implementations, the second optomechanism 320 includes a plurality of second pixels for generating a second beam L2, wherein the second beam L2 generated by the second pixels is monochromatic light.

[0298] For example, the second beam L2 generated by each second pixel is a parallel beam of light emitted from the second optical engine 320.

[0299] For example, the second optical engine 320 includes a second display screen and a second lens group. The second lens group is disposed on the light-emitting side of the second display screen. The second display screen includes a plurality of second pixels. The second lens group is used to focus the second light beam L2 generated by the second pixels into parallel light rays and emit them from the second optical engine 320.

[0300] In some examples, the second beams L2 generated by different second pixels on the second display screen are focused by the second lens group and emitted from the second optomechanism in different directions.

[0301] The method also includes:

[0302] S800: A second light-emitting instruction is formed according to the acquired display instruction. The second light-emitting instruction is used to instruct the second optical engine 310 to generate a second beam L2 from each of the target second pixel points. The target second pixel point is the second pixel point to be illuminated determined according to the display instruction.

[0303] In this way, each target second pixel point generates monochromatic, unidirectional parallel light one by one, which can reduce the dispersion effect generated after the second beam L2 passes through the second phase modulator 420.

[0304] The display instructions include information about the image that the second optical engine 320 needs to project.

[0305] For example, when each target second pixel emits light, the second beam L2 incident on the second optical waveguide lens 220 is a monochromatic parallel ray.

[0306] For example, the second emission command is used to instruct the second optomechanical system 320 to cause the second pixel to generate a second beam L2 in accordance with the second target timing.

[0307] In some examples, the second target timing can be determined based on display instructions. In other examples, the second target timing can also be a preset fixed timing.

[0308] In some possible implementations, step S700 includes:

[0309] S730: Based on the second state parameters and the display command, the second target adjustment amount corresponding to each target second pixel is obtained, and a third control command is formed. The third control command is used to instruct the second phase modulator 420 to adjust the phase adjustment amount from the second preset adjustment amount to the second target adjustment amount corresponding to the currently emitting target second pixel when the target second pixel generates the second beam L2.

[0310] In this way, the second phase modulator 420 can make corresponding adjustments when each target second pixel emits light, resulting in high precision in the phase adjustment of the second beam L2.

[0311] For example, step 730 includes:

[0312] S731: Determine the second phase compensation amount corresponding to the second pixel of each target based on the second state parameter and the display instruction.

[0313] S732: A third control command is generated based on the second phase compensation amount corresponding to the second pixel of each target. The second target adjustment amount corresponding to the second pixel of the target is determined based on the second preset adjustment amount and the corresponding second phase compensation amount.

[0314] In some possible implementations, the method further includes:

[0315] S900: A fourth control command is formed based on the second state parameters, wherein the fourth control command is used to instruct the second beam L2 to be projected into the third target area of ​​the second optical waveguide lens 220, and the third target area is determined based on the second state parameters.

[0316] In this way, the position of the second beam L2 illuminating the second optical waveguide lens 220 can be adjusted according to the second state parameters, so that the image displayed by the second optical waveguide lens 220 is less likely to be missing.

[0317] For example, the third target area can be determined based on the second state parameters and the acquired display instructions, so as to improve the adjustment accuracy of the position of the second beam L2 illuminating the second optical waveguide lens 220, making the image displayed by the second optical waveguide lens 220 less likely to be missing.

[0318] In some possible implementations, the fourth control command is used to instruct the second optomechanical system 320 to generate a second beam L2 in a fourth target region, so that the second beam L2 is projected into a third target region of the second optical waveguide lens 220, the fourth target region being determined according to the second state parameters.

[0319] In this way, the position of the second beam L2 illuminating the second optical waveguide lens 220 can be controlled by controlling the generation position of the second beam L2 on the second optical engine 320.

[0320] The second pixel of the target is located within the fourth target area.

[0321] For example, the fourth target area can be determined based on the second state parameters and the acquired display instructions, so as to improve the control accuracy of the generation position of the second beam L2 on the second optomechanical 320, and thus improve the control accuracy of the position of the second beam L2 illuminating the second optical waveguide lens 220.

[0322] When the smart glasses 10 includes a second phase modulator 420, step S530 includes:

[0323] S531: In setting mode, update the first preset adjustment amount and the second preset adjustment amount according to the adjustment command.

[0324] This facilitates the resetting of the first and second preset adjustment values, enabling adjustment of the first and second preset adjustment values ​​even when the user's image fusion range is inconsistent, thus meeting the needs of different users.

[0325] In some possible implementations, the second state parameter may also include the first data.

[0326] In this way, the second phase modulator 420 can combine the first data and the second data to adjust the phase of the second beam L2, which helps to improve the accuracy of adjusting the phase of the second beam L2 and facilitates the re-fusion of the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220.

[0327] In some examples where the second state parameter also includes the first data, a third control command can be formed based on the difference between the first and second data. The second target adjustment amount is determined based on the difference between the first and second data.

[0328] In some possible implementations, the first state parameter includes first data and second data, and the second state parameter includes both first data and second data. Thus, both the first phase modulator 410 and the second phase modulator 420 are adjusted in conjunction with the first and second data, resulting in high adjustment precision and facilitating the re-fusion of the image displayed by the first optical waveguide lens 210 and the image displayed by the second optical waveguide lens 220.

[0329] In some other examples of smart glasses 10 including a second phase modulator 420, the first state parameter includes first data but excludes second data, and the second parameter includes second data but excludes first data. This reduces data processing and makes data processing easier.

[0330] This application also provides a control device for smart glasses, which includes functional modules for performing the steps of the above-described method embodiments. The control device provided in this application performs the steps of the above-described method embodiments, achieving the technical effects described in the above-described method embodiments. Refer to the relevant descriptions in the above-described method embodiments for further information.

[0331] Figure 12 This is a schematic diagram of yet another type of smart glasses provided in an embodiment of this application.

[0332] like Figure 12 As shown, this application embodiment also provides a smart glasses 10, which may include a processor 610 (e.g., CPU) and a memory 620. The processor 610 may be the processing component described above, and the memory 620 may include high-speed random-access memory (RAM) or non-volatile memory (NVM). The memory 620 may store various instructions for performing various processing functions and implementing the method steps of this application.

[0333] Optionally, the smart glasses 10 involved in this application may further include a communication bus 630 and a communication port 640. The communication port 640 is used to enable communication between the smart glasses 10 and other peripherals. In this embodiment, the memory 620 is used to store computer-executable program code, which includes instructions; when the processor 610 executes the instructions, the instructions cause the processor 610 of the smart glasses 10 to perform the actions in the above method embodiment. The implementation principle and technical effect are similar, and will not be described again here.

[0334] It should be noted that the modules or components described in the above embodiments can be one or more integrated circuits configured to implement the above methods, such as one or more application-specific integrated circuits (ASICs), one or more digital signal processors (DSPs), or one or more field-programmable gate arrays (FPGAs), etc. Furthermore, when a module is implemented through processing element scheduler code, the processing element can be a general-purpose processor, such as a central processing unit (CPU) or other processors capable of calling program code, such as a controller. Additionally, these modules can be integrated together to implement a system-on-a-chip (SOC).

[0335] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this application is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., a solid-state disk (SSD)).

[0336] In the description of the embodiments of this application, it should be noted that, unless otherwise explicitly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, an indirect connection through an intermediate medium, or the internal communication of two components or the interaction between two components. Those skilled in the art can understand the specific meaning of the above terms in the embodiments of this application according to the specific circumstances.

[0337] The devices or elements referred to in the embodiments of this application or implied herein must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be construed as limiting the embodiments of this application. In the description of the embodiments of this application, "a plurality of" means two or more, unless otherwise precisely specified.

[0338] The terms "first," "second," "third," "fourth," etc. (if present) in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of the present application described herein can be implemented, for example, in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0339] The term "multiple" in this article refers to two or more. The term "and / or" in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. Furthermore, the character " / " in this article generally indicates an "or" relationship between the preceding and following related objects; in formulas, the character " / " indicates a "division" relationship between the preceding and following related objects.

[0340] It is understood that the various numerical designations used in the embodiments of this application are merely for descriptive convenience and are not intended to limit the scope of the embodiments of this application.

[0341] It is understood that, in the embodiments of this application, the order of the above-mentioned process numbers does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

Claims

1. A smart glasses (10), characterized in that, It includes a frame (100), a first optical engine (310), a second optical engine (320), a first optical waveguide lens (210), a second optical waveguide lens (220), and a first phase modulator (410); The first optical engine (310), the second optical engine (320), the first optical waveguide lens (210), the second optical waveguide lens (220), and the first phase modulator (410) are all disposed on the frame (100), and the first phase modulator (410) is disposed between the first optical engine (310) and the first optical waveguide lens (210). The first optical engine (310) is used to generate a first beam (L1) and project the first beam (L1) onto the first phase modulator (410). The first phase modulator (410) is used to adjust the phase of the first beam (L1) and then direct the first beam (L1) onto the first optical waveguide lens (210). The second optical engine (320) is used to generate a second beam (L2) that is directed onto the second optical waveguide lens (220). The first optical waveguide lens (210) is used to display an image in front of one of the user's left and right eyes based on the first beam (L1) directed onto the first optical waveguide lens (210). The second optical waveguide lens (220) is used to display an image in front of the other of the user's left and right eyes based on the second beam (L2) directed onto the second optical waveguide lens (220).

2. The smart glasses (10) according to claim 1, characterized in that, The first phase modulator (410) is an electrically controlled phase modulator, which is used to adjust the phase of the first beam (L1) according to the received electrical signal.

3. The smart glasses (10) according to claim 1 or 2, characterized in that, The first phase modulator (410) has a first refractive index tunable layer (411); The first optical engine (310) is used to project the first beam (L1) onto the first refractive index tunable layer (411), the first refractive index tunable layer (411) is used to allow the first beam (L1) to pass through, and the first phase modulator (410) is used to adjust the phase of the first beam (L1) passing through the first refractive index tunable layer (411) by adjusting the refractive index of the first refractive index tunable layer (411).

4. The smart glasses (10) according to claim 3, characterized in that, The first phase modulator (410) is a liquid crystal phase modulator, and the first refractive index adjustable layer (411) is a liquid crystal layer. The first refractive index adjustable layer (411) is used to change the arrangement state of liquid crystal molecules with the change of the applied electric field, so as to adjust the refractive index of the first refractive index adjustable layer (411).

5. The smart glasses (10) according to any one of claims 1-4, characterized in that, The frame (100) includes a frame (110), a first temple (120), and a second temple (130); The first temple (120) and the second temple (130) are connected to the frame (110). The first optical waveguide lens (210) and the second optical waveguide lens (220) are both disposed on the frame (110). The first optical engine (310) is disposed on the first temple (120), and the second optical engine (320) is disposed on the second temple (130). At least one of the frame (110) and the first temple (120) is provided with the first phase modulator (410).

6. The smart glasses (10) according to claim 5, characterized in that, The first phase modulator (410) is disposed on the first temple (120).

7. The smart glasses (10) according to claim 5, characterized in that, The first phase modulator (410) is disposed on the frame (110).

8. The smart glasses (10) according to any one of claims 5-7, characterized in that, The first temple (120) and the second temple (130) are hinged to the frame (110).

9. The smart glasses (10) according to any one of claims 1-8, characterized in that, It also includes a first detection device (510); The first detection device (510) is disposed on the frame (100), and the first detection device (510) is electrically connected to the first phase modulator (410); The first detection device (510) is used to detect at least one of the following: the relative position of the first optical engine (310) and the first optical waveguide lens (210), the change in the relative position of the first optical engine (310) and the first optical waveguide lens (210), the deformation of the frame (100) at the first optical waveguide lens (210), and the deformation of the frame (100) at the first optical engine (310). The first phase modulator (410) is used to adjust the phase of the first beam (L1) based on the data detected by the first detection device (510).

10. The smart glasses (10) according to claim 9, characterized in that, It also includes a second detection device (520); The second detection device (520) is disposed on the eyeglass frame (100); The second detection device (520) is used to detect at least one of the following: the relative position of the second optical engine (320) and the second optical waveguide lens (220), the change in the relative position of the second optical engine (320) and the second optical waveguide lens (220), the deformation of the frame (100) at the second optical waveguide lens (220), and the deformation of the frame (100) at the second optical engine (320).

11. The smart glasses (10) according to claim 10, characterized in that, The second detection device (520) is electrically connected to the first phase modulator (410), and the first phase modulator (410) is used to adjust the phase of the first beam (L1) based on the data obtained by the first detection device (510) and the second detection device (520).

12. The smart glasses (10) according to any one of claims 1-11, characterized in that, It also includes a second phase modulator (420); The second phase modulator (420) is disposed on the frame (100), and the second phase modulator (420) is disposed between the second optical engine (320) and the second optical waveguide lens (220); The second optical engine (320) is used to project the second beam (L2) onto the second phase modulator (420), and the second phase modulator (420) is used to adjust the phase of the second beam (L2) so that the second beam (L2) is directed onto the second optical waveguide lens (220).

13. The smart glasses (10) according to claim 12, characterized in that, The second phase modulator (420) is electrically connected to the second detection device (520) of the smart glasses (10). The second phase modulator (420) is used to adjust the phase of the second beam (L2) according to the data detected by the second detection device (520).

14. The smart glasses (10) according to claim 13, characterized in that, The second phase modulator (420) is also electrically connected to the first detection device (510) of the smart glasses (10), and the second phase modulator (420) is used to adjust the phase of the second beam (L2) based on the data obtained by the first detection device (510) and the second detection device (520).

15. A control method for smart glasses (10), characterized in that, The smart glasses (10) include a frame (100), a first optical engine (310), a second optical engine (320), a first optical waveguide lens (210), a second optical waveguide lens (220), and a first phase modulator (410); The first optical engine (310), the second optical engine (320), the first optical waveguide lens (210), the second optical waveguide lens (220), and the first phase modulator (410) are all disposed on the frame (100), and the first phase modulator (410) is disposed between the first optical engine (310) and the first optical waveguide lens (210). The first optical engine (310) is used to generate a first beam (L1) and project the first beam (L1) onto the first phase modulator (410). The first phase modulator (410) is used to adjust the phase of the first beam (L1) and then direct the first beam (L1) onto the first optical waveguide lens (210). The second optical engine (320) is used to generate a second beam (L2) that is directed onto the second optical waveguide lens (220). The first optical waveguide lens (210) is used to display an image in front of one of the user's left and right eyes based on the first beam (L1) directed onto the first optical waveguide lens (210). The second optical waveguide lens (220) is used to display an image in front of the other of the user's left and right eyes based on the second beam (L2) directed onto the second optical waveguide lens (220). The method includes: Acquire first data, wherein the first data is used to obtain the change of the relative position of the first optical engine (310) and the first optical waveguide lens (210) relative to a first preset relative position, the first preset relative position being a preset relative position of the first optical engine (310) and the first optical waveguide lens (210). A first control command is generated based on the first state parameters, wherein the first state parameters include the first data, and the first control command is used to instruct the first phase modulator (410) to adjust the phase adjustment amount from a first preset adjustment amount to a first target adjustment amount. The first preset adjustment amount is the phase adjustment amount of the first phase modulator (410) when the first optical engine (310) and the first optical waveguide lens (210) are in the first preset relative position, and the first target adjustment amount is determined based on the first state parameters.

16. The method according to claim 15, characterized in that, The first phase modulator (410) has a first refractive index tunable layer (411), the first optomechanical unit (310) is used to project the first beam (L1) onto the first refractive index tunable layer (411), and the first refractive index tunable layer (411) is used to allow the first beam (L1) to pass through. The first control command is used to instruct the first phase modulator (410) to adjust the refractive index of the first refractive index adjustable layer (411) from the first preset refractive index to the first target refractive index, so as to adjust the phase adjustment amount of the first phase modulator (410) from the first preset adjustment amount to the first target adjustment amount. The first preset refractive index is the refractive index of the first refractive index adjustable layer (411) when the first optical engine (310) and the first optical waveguide lens (210) are in the first preset relative position. The first target refractive index is determined according to the first state parameter.

17. The method according to claim 16, characterized in that, The first phase modulator (410) is a liquid crystal phase modulator, and the first refractive index adjustable layer (411) is a liquid crystal layer; The first control command is used to instruct the first phase modulator (410) to adjust the arrangement of liquid crystal molecules in the first refractive index adjustable layer (411) so as to adjust the refractive index of the first refractive index adjustable layer (411) from the first preset refractive index to the first target refractive index.

18. The method according to any one of claims 15-17, characterized in that, The first phase modulator (410) includes a plurality of first adjustment regions; The first preset adjustment amount includes a plurality of first sub-preset adjustment amounts that correspond one-to-one with a plurality of first adjustment regions. The first sub-preset adjustment amount is the phase adjustment amount of the corresponding first adjustment region when the first optical engine (310) and the first optical waveguide lens (210) are in the first preset relative position. The first target adjustment amount includes a plurality of first sub-target adjustment amounts that correspond one-to-one with a plurality of first adjustment regions, and the first sub-target adjustment amounts are determined according to the first state parameters; The first control command is used to instruct the first phase modulator (410) to adjust the phase adjustment amount of each of the first adjustment regions from the corresponding first sub-preset adjustment amount to the corresponding first sub-target adjustment amount.

19. The method according to any one of claims 15-18, characterized in that, The first data includes at least one of the following: the relative position data of the first optical engine (310) and the first optical waveguide lens (210), the angular deflection of the relative position of the first optical engine (310) and the first optical waveguide lens (210) relative to a first preset relative position, the displacement of the relative position of the first optical engine (310) and the first optical waveguide lens (210) relative to the first preset relative position, and the deformation of the frame (100).

20. The method according to any one of claims 15-19, characterized in that, The first state parameter also includes first wavelength data, which is used to indicate the wavelength of the first beam (L1).

21. The method according to any one of claims 15-20, characterized in that, The step of generating the first control command based on the first state parameters includes: The first phase compensation amount is determined based on the first state parameter; The first control command is generated based on the first phase compensation amount, and the first target adjustment amount is determined based on the first phase compensation amount and the first preset adjustment amount.

22. The method according to any one of claims 15-21, characterized in that, The acquisition of the first data includes: The first data is acquired multiple times within a preset time period; The first status parameter includes multiple sets of the first data acquired within the preset time period.

23. The method according to any one of claims 15-22, characterized in that, The first optical engine (310) includes a plurality of first pixels, which are used to generate the first beam (L1); The method further includes: A first light-emitting instruction is formed according to the acquired display instruction. The first light-emitting instruction is used to instruct the first optical engine (310) to generate the first light beam (L1) one by one from the target first pixel. The target first pixel is the first pixel to be emitted according to the display instruction.

24. The method according to claim 23, characterized in that, The step of generating the first control command based on the first state parameters includes: The first target adjustment amount corresponding to each target first pixel is obtained according to the first state parameter and the display instruction, and the first control instruction is formed. The first control instruction is used to instruct the first phase modulator (410) to adjust the phase adjustment amount from the first preset adjustment amount to the first target adjustment amount corresponding to the currently emitting target first pixel when the target first pixel generates the first beam (L1).

25. The method according to any one of claims 15-24, characterized in that, Also includes: A second control command is generated based on the first state parameter, wherein the second control command is used to instruct the first beam (L1) to be projected onto a first target area of ​​the first optical waveguide lens (210), and the first target area is determined based on the first state parameter.

26. The method according to claim 25, characterized in that, The second control command is used to instruct the first optical engine (310) to generate the first beam (L1) in the second target region, so that the first beam (L1) is projected onto the first target region of the first optical waveguide lens (210), the second target region being determined according to the first state parameter.

27. The method according to any one of claims 15-26, characterized in that, Also includes: Obtain the setting command and enter the setting mode according to the setting command; In the setting mode, obtain the adjustment command; In the setting mode, the first preset adjustment amount is updated according to the adjustment command; In the setting mode, obtain a confirmation command and exit the setting mode according to the confirmation command.

28. The method according to any one of claims 15-27, characterized in that, Also includes: Acquire second data, wherein the second data is used to obtain the change of the relative position of the second optical engine (320) and the second optical waveguide lens (220) relative to a second preset relative position, the second preset relative position being a preset relative position of the second optical engine (320) and the second optical waveguide lens (220); The first state parameter also includes the second data.

29. The method according to any one of claims 15-27, characterized in that, The smart glasses (10) further includes a second phase modulator (420), which is disposed on the frame (100) and between the second optical engine (320) and the second optical waveguide lens (220). The second optical engine (320) is used to project the second beam (L2) onto the second phase modulator (420), and the second phase modulator (420) is used to adjust the phase of the second beam (L2) so that the second beam (L2) is directed onto the second optical waveguide lens (220). The method further includes: Acquire second data, wherein the second data is used to obtain the change of the relative position of the second optical engine (320) and the second optical waveguide lens (220) relative to a second preset relative position, the second preset relative position being a preset relative position of the second optical engine (320) and the second optical waveguide lens (220); A third control command is generated based on the second state parameter, wherein the second state parameter includes the second data. The third control command is used to instruct the second phase modulator (420) to adjust the phase adjustment amount from the second preset adjustment amount to the second target adjustment amount. The second preset adjustment amount is the phase adjustment amount of the second phase modulator (420) when the second optical engine (320) and the second optical waveguide lens (220) are in the second preset relative position. The second target adjustment amount is determined according to the second state parameter.

30. The method according to claim 29, characterized in that, The first state parameter further includes the second data, and the second state parameter further includes the first data.

31. A smart glasses (10), characterized in that, Includes memory (620) and processor (610); The memory (620) stores computer-executed instructions; The processor (610) executes computer execution instructions stored in the memory (620) to cause the processor (610) to perform the method as described in any one of claims 15-30.

32. A control device for smart glasses (10), characterized in that, Includes a functional module for performing the method as described in any one of claims 15-30.

33. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program or instructions that, when executed, implement the method as described in any one of claims 15-30.

34. A computer program product, characterized in that, It includes a computer program or instructions that, when executed by a processor, implement the method as described in any one of claims 15-30.

Images