Image position calibration system, method, and device for glasses, and ar glasses

Abstract

The present invention relates to the technical field of AR glasses, and discloses an image position calibration system, method, and device for glasses, and AR glasses. According to the present invention, after an in-coupling grating, a hardware structure of a light valve and a reflector is added. By means of the light transmission properties of the grating, light transmitted through the grating passes through the light valve to reach the reflector to be reflected, the reflected light is transmitted to an optical engine to generate second imaging light to obtain a second image, and the offset amount between the second image and a first image obtained by first imaging light emitted by the optical engine is determined.

Description

Glasses image position calibration system, method, device and AR glasses

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to Chinese Patent Application No. 202410144079.9 filed on February 1, 2024, the contents of which are incorporated herein by reference in their entirety. Technical Field

[0003] The present invention relates to the technical field of AR glasses, and in particular to a glasses image position calibration system, method, device and AR glasses. Background Art

[0004] For AR glasses, whether the consistency of binocular image display meets the requirements of human visual synthesis is an important factor in whether the human eye can view AR images normally and whether AR glasses can work normally.

[0005] During AR glasses production, the consistency of binocular display images is strictly controlled to ensure that the human eye can see the images normally when shipped. However, during use, due to factors such as different head circumferences, usage habits, and the aging of the glasses themselves, the inconsistency of the binocular display images can gradually become more serious, ultimately resulting in the human eye being unable to see the AR images normally. Conventional AR binocular display images require unified measurement and calibration using specialized equipment and professional personnel, which is time-consuming and untimely, and cannot meet the needs of consumers for normal wear.

[0006] Summary of the Invention

[0007] In view of this, the present invention provides a glasses image position calibration system, method, device and AR glasses to solve the problem that AR display images need to be calibrated by professionals, and untimely calibration cannot meet the normal wearing needs of consumers.

[0008] In a first aspect, the present invention provides an eyeglass image position calibration system, the system comprising an optical engine, a waveguide, an incoupling grating, an outcoupling grating, a light valve, and a reflector, wherein the light valve is located between the incoupling grating and the reflector,

[0009] The controller controls the light emitted by the optical engine to couple a first imaging light into the waveguide through a coupling grating for total reflection, and then guide it into the user's eyes through an outcoupling grating to obtain a first image. The light emitted by the optical engine includes the first imaging light and the grating transmitted light. The controller controls the light valve to be in an open state so that the grating transmitted light passes through the light valve and is irradiated onto the reflector for reflection, and then is transmitted to the optical engine through the light valve and the coupling grating. The grating transmitted light is irradiated onto the display chip of the optical engine through each refractive element of the optical engine to generate a second imaging light. The second imaging light is then coupled into the waveguide through reflection from the display chip to obtain a second image, so that the user can determine the offset between the first image and the second image. The controller adjusts the image position of the optical engine based on the offset between the first image and the second image determined by the user.

[0010] The present invention adds a hardware structure of a light valve and a reflector after coupling the grating. Utilizing the characteristics of the grating transmitting light, the grating transmitted light is irradiated on the reflector through the light valve for reflection, and then transmitted to the optical engine to regenerate a second imaging light to obtain a second image and determine the offset between the second image and the first image obtained by the first imaging light emitted by the optical engine, thereby realizing the automatic calibration function of the AR glasses and meeting the normal wearing needs of consumers.

[0011] In an optional embodiment, when the glasses are in an uncalibrated state, the controller controls the light valve to be in a closed state, so that the light valve absorbs the light transmitted by the grating.

[0012] When the glasses are in an uncalibrated state, the present invention controls the light valve to be in a closed state so that the light valve absorbs the light transmitted by the grating, thereby ensuring that the optical machine is in a normal working state.

[0013] In an optional embodiment, the reflector is a solid reflector or a reflective optical film-coated reflective mirror.

[0014] The reflector designed in the present invention is a solid reflector or a reflector-coated optical film to improve the ability of reflecting light.

[0015] In an optional embodiment, the light valve is a liquid crystal light valve, or the light valve is a combination of a polarizer and a phase modulator.

[0016] In an optional embodiment, the first image and the second image are both grid line diagrams, and the grid line diagrams include coordinate points of horizontal and vertical lines, and the origin of the coordinate points is the center point of the first image, so that the user can determine the offset between the first image and the second image based on the coordinate value of the center point of the second image.

[0017] The present invention enables the user to accurately determine the offset between the first image and the image by designing the coordinate points of the horizontal and vertical lines in the grid line diagram, thereby improving the accuracy of adjusting the image display position of the optical engine.

[0018] In a second aspect, the present invention provides a glasses image position calibration method, which is applied to the glasses image position calibration system according to the first aspect or any corresponding embodiment thereof, the method comprising:

[0019] The light emitted by the optical engine is controlled to couple a first imaging light into the waveguide through a coupling grating for total reflection, and then is introduced into the user's eyes through an out-coupling grating to obtain a first image. The light emitted by the optical engine includes the first imaging light and the grating transmitted light. The light valve is controlled to be in an open state so that the grating transmitted light passes through the light valve and is irradiated onto the reflector for reflection. The grating transmitted light is then irradiated onto the display chip of the optical engine through various refractive devices of the optical engine to generate a second imaging light. The second imaging light is then coupled into the waveguide through reflection from the display chip to obtain a second image, so that the user can determine the offset between the first image and the second image. The optical engine image position is adjusted based on the offset between the first image and the second image determined by the user.

[0020] In an optional embodiment, the method further includes: when it is detected that the glasses are in a normal display state, controlling the light valve to be in a closed state, so that the light valve absorbs the light transmitted by the grating.

[0021] In a third aspect, the present invention provides a device for calibrating the position of glasses images, the device comprising:

[0022] a first image display module, configured to control light emitted by the optical engine to couple a first imaging light into the waveguide through an in-coupling grating for total reflection, and then to be directed into a user's eye through an out-coupling grating to obtain a first image, wherein the light emitted by the optical engine includes the first imaging light and the grating transmitted light;

[0023] The light reflection module is used to control the light valve to be in an open state, so that the light transmitted by the grating passes through the light valve and is reflected on the reflector, and then transmitted to the optical engine through the light valve and the coupled grating;

[0024] A second image display module is configured to illuminate the grating transmitted light onto the display chip of the optical engine through the refractive components of the optical engine to generate a second imaging light, and then couple the second imaging light into the waveguide through reflection from the display chip to obtain a second image, so that the user can determine the offset between the first image and the second image;

[0025] The image position adjustment module is used to adjust the optical engine image position based on the offset between the first image and the second image determined by the user.

[0026] In a fourth aspect, the present invention provides an AR glasses, which includes the glasses image position calibration system of the above-mentioned first aspect or any corresponding embodiment thereof.

[0027] In a fifth aspect, the present invention provides an electronic device comprising: a memory and a processor, the memory and the processor being communicatively connected to each other, the memory storing computer instructions, and the processor executing the eyeglass image position calibration method of the second aspect or any corresponding embodiment thereof by executing the computer instructions. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the specific embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0029] FIG1 is a structural block diagram of a glasses image position calibration system according to an embodiment of the present invention;

[0030] FIG2 is an exemplary structural diagram of a glasses image position calibration system according to an embodiment of the present invention;

[0031] FIG3 is an exemplary diagram of the working principle of a reflective grating according to an embodiment of the present invention;

[0032] 4 is an exemplary diagram of the installation positions of a light valve and a reflecting mirror according to an embodiment of the present invention;

[0033] 5 is an exemplary diagram illustrating the relative positions of the outermost optical surface of an optical engine and a waveguide according to an embodiment of the present invention;

[0034] FIG6 is an exemplary diagram of relative positions of a first image and a second image according to an embodiment of the present invention;

[0035] FIG7 is another diagram illustrating relative positions of a first image and a second image according to an embodiment of the present invention;

[0036] FIG8 is a schematic flow chart of a method for calibrating the position of glasses images according to an embodiment of the present invention;

[0037] FIG9 is a flowchart illustrating an example of a method for calibrating the position of glasses images according to an embodiment of the present invention;

[0038] FIG10 is a block diagram of the structure of AR glasses according to an embodiment of the present invention;

[0039] FIG11 is a structural block diagram of a device for calibrating glasses image position according to an embodiment of the present invention;

[0040] FIG12 is a schematic diagram of the hardware structure of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0041] To make the purpose, technical solutions, and advantages of the embodiments of the present invention more clear, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative efforts shall fall within the scope of protection of the present invention.

[0042] During long-term use of AR glasses by consumers, due to aging of structural parts, wearing methods and other reasons, the binocular images no longer match, making it impossible for visual perception to fuse the binocular images, making it impossible to wear.

[0043] Currently, the most commonly used binocular image matching solution involves optical module manufacturers using AR equipment to measure binocular images while assembling the modules to ensure binocular image matching. This requires specialized equipment and personnel to ensure that the two images on a pair of AR glasses match. Therefore, binocular image matching is guaranteed when the glasses leave the factory. However, image mismatches caused by glasses in use require return to the factory for resolution. Furthermore, in the early stages of image mismatch, the human eye cannot directly detect image display errors and instead actively adjusts its eye state to adapt to the erroneous display. Short-term viewing can cause visual fatigue and dizziness, while prolonged use can potentially cause visual damage.

[0044] The main reason for binocular image inconsistency during wear is a change in the relative spatial position of the optical engine and waveguide. This change causes the waveguide's output image size and position to deviate from the ideal position, preventing binocular images from merging. In diffraction waveguides, light propagates through them by total internal reflection.

[0045] Based on the above problems, an embodiment of the present invention provides an eyeglass image position calibration system. As shown in Figure 1, the system includes a controller 1, an optical engine 2, a waveguide 3, an in-coupling grating 4, a light valve 5, a reflector 6 and an out-coupling grating 7, wherein the light valve 5 is located between the in-coupling grating 4 and the reflector 6.

[0046] Specifically, the controller 1 controls the light emitted by the optical engine 2 to couple the first imaging light into the waveguide plate 3 through the coupling grating 4 for total reflection, and then guide it into the user's eyes through the coupling grating 7 to obtain a first image. The light emitted by the optical engine 2 includes the first imaging light and the grating transmitted light; the controller 1 controls the light valve 5 to be in an open state, so that the grating transmitted light passes through the light valve 5 and is irradiated on the reflector 6 for reflection, and then is transmitted to the optical engine 2 through the light valve 5 and the coupling grating 4; the grating transmitted light is irradiated onto the display chip of the optical engine 2 through each refractive device of the optical engine 2 to generate a second imaging light, and then the second imaging light is coupled into the waveguide plate 3 through reflection of the display chip to obtain a second image, so that the user can determine the offset between the first image and the second image; the controller 1 adjusts the image position of the optical engine 2 based on the offset between the first image and the second image determined by the user.

[0047] The embodiment of the present invention takes AR glasses as an example. The optical engine 2 can be installed on the temples of the AR glasses or on the AR glasses frame, without limitation. The waveguide plate 3 is a diffraction light waveguide, as shown in FIG2 . The coupling grating 4 is a reflective grating. After the light emitted by the optical engine 2 is coupled into the grating 4, as shown in FIG3 , the light emitted by the optical engine 2 is divided into positive first-order diffraction light, grating transmission light and negative first-order diffraction light. Among them, the positive first-order diffraction light is the target light or imaging light. After entering the waveguide plate 3 and undergoing total reflection, it is introduced into the user's eyes through the coupling grating 7 to display the first Image, grating transmitted light, and negative first-order diffracted light are all referred to as stray light. As shown in FIG4 , an embodiment of the present invention is designed with a light valve 5 and a reflector 6 after coupling into the grating 4. The reflector 6 reflects the light transmitted from the light valve 5 back into the light valve 5. When the AR glasses are in the calibration state, the controller 1 controls the light valve 5 to be open. The grating transmitted light can pass through the light valve 5 and illuminate the plane reflector 6 for reflection. The reflected grating transmitted light is then coupled back into the waveguide 3 through the light valve 5 and the coupling-in grating 4 and transmitted to the optical engine 2. The grating transmitted light can then be illuminated by the various refractive elements of the optical engine 2 onto the display chip of the optical engine 2. The display chip receives the illuminated grating transmitted light, forms an image, and reflects it into the waveguide 3 in the form of imaging light, undergoes total internal reflection, and is then directed into the user's eye through the outcoupling grating 7 to form a second image. At this point, the user can visually see the first image displayed by the first imaging light emitted by the optical engine 2, and the second image formed by reflection from the reflector 6 can also be seen.

[0048] In this embodiment of the present invention, when the optical engine 2 and the waveguide 3 are in a parallel positional relationship, thus meeting the binocular image consistency requirement, the optical engine 2 emits light parallel to the optical axis of the optical engine 2 and couples it into the waveguide 3 to form a first image. The grating-transmitted light passes through the light valve 5 and is reflected by the reflector 6. After that, it is transmitted to the optical engine 2 in a direction perpendicular to the waveguide 3 through the light valve 5 and the coupling grating 4. At this point, the grating-transmitted light is also parallel to the optical axis of the optical engine 2. The grating-transmitted light is then irradiated onto the display chip of the optical engine 2 by the various refractive elements of the optical engine 2, generating a second imaging light. The second imaging light can then be reflected by the display chip and re-coupled into the waveguide 3 in a direction parallel to the optical axis of the optical engine 2 to display a second image. At this point, the first and second images completely overlap. In FIG. 2 of this embodiment of the present invention, the thick solid line represents the path of the light reflected by the reflector 6, the thin solid line represents the path of the first imaging light emitted by the optical engine 2, and the thin dashed line represents the path of the second imaging light regenerated by the optical engine 2 after receiving the light reflected by the reflector 6. In actual applications, these three light paths propagate along overlapping paths.

[0049] In the embodiment of the present invention, when an angle α is generated between the optical engine 2 and the waveguide plate 3, that is, when the optical axis of the optical engine 2 is deflected at an angle α, as shown in FIG5 , the optical engine 2 can be controlled to emit light. Due to the change in the angle α between the optical engine 2 and the waveguide plate 3, that is, the change in the angle α between the outermost optical surface of the optical engine 2 and the waveguide plate 3, the angle α between the first imaging light emitted by the optical engine 2 and the waveguide plate 3 also changes. The image obtained by coupling the first imaging light into the waveguide plate 3 and passing through the outcoupling grating 7 is the first image with the angle α changed.

[0050] At this point, the grating-transmitted light emitted by the optical engine 2 still passes perpendicularly through the light valve 5 and strikes the reflector 6. The reflector 6 reflects the grating-transmitted light and transmits it to the optical engine 2 through the light valve 5 and the coupling-in grating 4 in a direction perpendicular to the waveguide 3. Due to the change in angle α between the optical engine 2 and the waveguide 3, the grating-transmitted light reflected by the reflector 6 also changes in angle α with the optical engine 2. The light then passes through the various refractive components of the optical engine 2 and strikes the display chip, generating a second imaging light. After another reflection from the display chip, the second imaging light reflected by the chip changes in angle 2α with the waveguide 3. The image obtained by coupling into the waveguide 3 and passing through the coupling-out grating 7 is a second image with a change in angle 2α. Therefore, there is an α-angle deviation between the first image with the change in angle α and the second image with the change in angle 2α, which is exactly the same as the α-angle deviation between the optical engine 2 and the waveguide 3. This creates an offset between the first and second images perceived by the user.

[0051] The user can input the determined offset between the two images into the feedback record box, wherein the feedback record box can be in the user's mobile phone device end. Before the user wears the AR glasses, the mobile phone or other device end needs to establish a connection with the AR glasses. After the user inputs the offset into the feedback record box, the device end sends the feedback offset to the controller 1 of the AR glasses, so that the controller 1 adjusts the image display position of the optical engine 2 based on the offset to complete the calibration of the binocular image consistency. The user can also directly input the determined offset in the AR glasses, so that the controller 1 of the AR glasses directly adjusts the image display position of the optical engine 2 based on the offset. The offset can be a number, or the user can directly take screenshots of the two images and feed back the screenshots to the feedback record table. The controller 1 determines the offset between the two images and then adjusts the image display position of the optical engine 2. This is not limited and is only used as an example.

[0052] The present invention adds a hardware structure of a light valve 5 and a reflector 6 after coupling the grating 4. By utilizing the characteristics of the grating transmitting light, the grating transmitted light is irradiated on the reflector 6 through the light valve 5 for reflection, and is transmitted to the optical engine 2 to regenerate a second imaging light to obtain a second image and determine the offset between the second image and the first image obtained by the first imaging light emitted by the optical engine 2, thereby realizing the automatic calibration function of the AR glasses and meeting the normal wearing needs of consumers.

[0053] Specifically, when the glasses are in an uncalibrated state, the controller 1 controls the light valve 5 to be in a closed state, so that the light valve 5 absorbs the light transmitted by the grating.

[0054] In an embodiment of the present invention, the controller 1 monitors whether the AR glasses are in a calibration state, wherein the AR glasses are in a calibration state when they are turned on and it is monitored that the user has completed wearing the AR glasses; the AR glasses are not in a calibration state when they are turned off or in a normal display state. For example only, when the controller 1 monitors that the AR glasses are in a normal display state, it can control the light valve 5 to be in a closed state so that the light valve 5 absorbs the light transmitted by the grating to ensure that the optical machine is in a normal operating state.

[0055] Specifically, the reflector 6 is a solid reflector or a reflective optical film-coated reflective mirror.

[0056] In the embodiment of the present invention, the reflector 6 may be designed to be a solid reflector or coated with a reflective optical film to improve the light reflection capability.

[0057] Specifically, the light valve 5 is a liquid crystal light valve, or the light valve 5 is a combination of a polarizer and a phase modulator.

[0058] In the embodiment of the present invention, the light valve 5 functions to control whether light passes through. The ON state allows light to pass through, while the OFF state absorbs light. It can be a liquid crystal light valve or a combination of a polarizer and a phase modulator, for example.

[0059] Specifically, the first image and the second image are both grid line diagrams, which include coordinate points of horizontal and vertical lines, and the origin of the coordinate points is the center point of the first image, so that the user can determine the offset between the first image and the second image based on the coordinate value of the center point of the second image.

[0060] As shown in FIG6 , the first image and the second image emitted by the optical engine 2 are both grid line images, the first image is a solid line grid image, and the second image is a dotted line grid image. When the optical engine 2 and the waveguide plate 3 are in a parallel positional relationship, that is, when the binocular image consistency requirement is met, the solid line grid image and the dotted line grid image completely overlap.

[0061] As shown in FIG. 7 , when an angle α is formed between the optical engine 2 and the waveguide plate 3 , that is, when the optical axis of the optical engine 2 is deflected by an angle α, an offset occurs between the solid line grid diagram and the dotted line grid diagram.

[0062] In an embodiment of the present invention, coordinate points of horizontal and vertical lines can be added to the displayed grid line diagram. The center point of the first image can be used as the coordinate origin, so that the user can determine the offset between the first image and the second image based on the coordinates of the center point of the second image. Any vertex of the four vertices of the first image can also be used as the coordinate origin, so that the user can determine the coordinate value of the same vertex in the second image to determine the offset between the first image and the second image. This is not limited and is only used as an example.

[0063] According to an embodiment of the present invention, an embodiment of a method for calibrating the image position of glasses is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0064] In some embodiments, a glasses image position calibration method is provided, which can be used in the glasses image position calibration system described above. FIG8 is a flow chart of the glasses image position calibration method according to an embodiment of the present invention. As shown in FIG8 , the flow chart includes the following steps:

[0065] Step S801: Control the light emitted by the optical engine to couple the first imaging light into the waveguide through the coupling-in grating for total reflection, and then guide it into the user's eyes through the coupling-out grating to obtain a first image.

[0066] The light emitted by the optical engine includes a first imaging light and a grating transmission light.

[0067] In an embodiment of the present invention, when it is monitored that the AR glasses are turned on and worn by the user, or when a glasses calibration command triggered by the user is received, for example, the light emitted by the optical engine can be controlled to couple the first imaging light into the waveguide through the coupling grating for total reflection, and then be guided into the user's eyes through the coupling grating to obtain the first image.

[0068] Step S802 , controlling the light valve to be in an open state, so that the light transmitted by the grating passes through the light valve and is irradiated on the reflector for reflection, and then is transmitted to the optical engine through the light valve and the coupled grating.

[0069] In an embodiment of the present invention, when the AR glasses are in a calibration state, the light valve can be controlled to be in an open state. At this time, the grating transmitted light can pass through the light valve to illuminate the reflector for reflection. The reflected grating transmitted light is then coupled into the waveguide through the light valve and the coupling grating again and transmitted to the optical engine.

[0070] In step S803, the grating-transmitted light is irradiated onto the display chip of the optical engine through the refractive components of the optical engine to generate a second imaging light. The second imaging light is then coupled into the waveguide through reflection from the display chip to obtain a second image, so that the user can determine the offset between the first image and the second image.

[0071] In the embodiment of the present invention, the grating transmitted light can be irradiated onto the display chip of the optical engine through the various refractive devices of the optical engine. The display chip receives the grating transmitted light to form an image and reflects it into the waveguide in the form of imaging light for total reflection and is introduced into the user's eyes through the out-coupling grating to form a second image. At this time, the first image displayed by the first imaging light emitted by the optical engine can be visually seen, and the second image formed by reflection from the reflector can also be seen.

[0072] Step S804: adjusting the optical engine image position based on the offset between the first image and the second image determined by the user.

[0073] In the embodiment of the present invention, the controller may adjust the position of the optical engine image based on the offset of the first image and the second image fed back by the user.

[0074] In one embodiment, when it is detected that the glasses are in a normal display state, the light valve is controlled to be in a closed state so that the light valve absorbs the light transmitted by the grating.

[0075] When the embodiment of the present invention detects that the glasses are in a normal display state, the light valve can be controlled to be in a closed state, so that the light valve absorbs the light transmitted by the grating, thereby ensuring the normal use of the optical engine.

[0076] The embodiment of the present invention adds a light valve and a reflector, utilizes the wasted grating transmitted light, and transmits it to the optical engine after reflection through the reflector. The optical engine generates a second imaging light based on the grating transmitted light, couples it into the waveguide again to display the second image, and compares it with the first image to determine the offset, and then adjusts the position of the image displayed by the optical engine. This not only rationally utilizes the wasted light resources, but also can automatically calibrate the AR glasses in real time to meet the wearing needs of consumers.

[0077] In a specific embodiment, as shown in FIG9 , in response to the user fully wearing the AR glasses and the AR glasses are in the power-on state or in the calibration state, the optical engine is controlled to display the calibration image, and the light valve is opened. The grating transmitted light is reflected by the reflector and transmitted to the optical engine to generate a second imaging light. The second imaging light is then coupled into the waveguide again to display a second image. The user makes a visual consistency judgment based on the two images. If the two images are inconsistent, the user can visually read the offset and input the offset into the AR glasses. The host, i.e., the controller, controls the display position of the optical engine and repeats the step of controlling the optical engine to display the calibration image. If the two calibration images are consistent, the user can directly enter the power-on screen and start using the AR glasses. This solution is also applicable to diffraction light waveguides made of transmission gratings. For detailed description, please refer to the above embodiment and will not be repeated here.

[0078] Compared with previous solutions, this function can be completed using a hardware system, and calibration can be completed after wearing, avoiding the difference between wearing and not wearing. This difference may cause accurate calibration when not wearing, but image mismatch after wearing due to stress on the temples.

[0079] In some embodiments, an AR glasses is further provided, as shown in FIG10 , and the AR glasses include the glasses image position calibration system of the above embodiment.

[0080] In some embodiments, a device for calibrating eyeglass image positions is also provided. This device is used to implement the above-mentioned embodiments and preferred implementations, and details already described will not be repeated. As used below, the term "module" may refer to a combination of software and / or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementation using hardware, or a combination of software and hardware, is also possible and contemplated.

[0081] In some embodiments, a glasses image position calibration device is provided, as shown in FIG11 , comprising:

[0082] A first image display module 1101 is configured to control light emitted by the optical engine to couple a first imaging light into the waveguide through an in-coupling grating for total internal reflection, and then to be directed into the user's eyes through an out-coupling grating to obtain a first image. The light emitted by the optical engine includes the first imaging light and the grating transmitted light.

[0083] The light reflection module 1102 is used to control the light valve to be in an open state, so that the light transmitted by the grating passes through the light valve and is reflected by the reflector, and then transmitted to the optical engine through the light valve and the coupled grating;

[0084] The second image display module 1103 is configured to illuminate the grating transmitted light onto the display chip of the optical engine through the refractive components of the optical engine to generate a second imaging light, and then couple the second imaging light into the waveguide through reflection from the display chip to obtain a second image, so that the user can determine the offset between the first image and the second image;

[0085] The image position adjustment module 1104 is configured to adjust the optical engine image position based on an offset between the first image and the second image determined by a user.

[0086] In some optional implementations, the glasses image position calibration device further includes:

[0087] The light valve closing module is used to control the light valve to be in a closed state when it is detected that the glasses are in a normal display state, so that the light valve absorbs the light transmitted by the grating.

[0088] The further functional description of each of the above modules and units is the same as that of the above corresponding embodiments and will not be repeated here.

[0089] In some embodiments, the eyeglass image position calibration device is presented in the form of a functional unit, where the unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and memory that executes one or more software or fixed programs, and / or other devices that can provide the above functions.

[0090] An embodiment of the present invention further provides an electronic device having the glasses image position calibration device shown in FIG. 11 .

[0091] Please refer to Figure 12, which is a schematic diagram of the structure of an electronic device provided in an optional embodiment of the present invention. As shown in Figure 12, the electronic device includes: one or more processors 10, memory 20, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. The various components communicate with each other using different buses and can be installed on a common motherboard or in other ways as needed. The processor can process instructions executed within the electronic device, including instructions stored in or on the memory for displaying graphical information of a GUI on an external input / output device (such as a display device coupled to the interface). In some optional embodiments, if desired, multiple processors and / or multiple buses can be used with multiple memories and multiple storage devices. Similarly, multiple electronic devices can be connected, with each device providing some of the necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 12 uses a single processor 10 as an example.

[0092] The processor 10 may be a central processing unit, a network processor, or a combination thereof. The processor 10 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit, a programmable logic device, or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic, or any combination thereof.

[0093] The memory 20 stores instructions that can be executed by at least one processor 10, so that the at least one processor 10 executes the method shown in the above embodiment.

[0094] The memory 20 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and applications required for at least one function; the data storage area may store data created based on the use of the electronic device, etc. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 20 may optionally include a memory remotely located relative to the processor 10, and these remote memories may be connected to the electronic device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0095] The memory 20 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid-state drive; the memory 20 may also include a combination of the above types of memory.

[0096] The electronic device further includes an input device 30 and an output device 40. The processor 10, the memory 20, the input device 30, and the output device 40 may be connected via a bus or other means, with FIG12 taking the bus connection as an example.

[0097] The input device 30 can receive input digital or character information and generate signal input related to user settings and function control of the electronic device, such as a touch screen, a keypad, a mouse, a trackpad, a touch pad, an indicator stick, one or more mouse buttons, a trackball, a joystick, etc. The output device 40 can include a display device, an auxiliary lighting device (e.g., an LED), and a tactile feedback device (e.g., a vibration motor). The above-mentioned display device includes but is not limited to a liquid crystal display, a light emitting diode, a display, and a plasma display. In some optional embodiments, the display device can be a touch screen.

[0098] The embodiment of the present invention also provides a computer-readable storage medium. The above-mentioned method according to the embodiment of the present invention can be implemented in hardware, firmware, or implemented as a computer code that can be recorded in a storage medium, or implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and downloaded through a network and will be stored in a local storage medium, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state drive, etc.; further, the storage medium can also include a combination of the above-mentioned types of memory. It can be understood that a computer, a processor, a microprocessor controller or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor or hardware, the method shown in the above embodiment is implemented.

Claims

1. A glasses image position calibration system, wherein: The system includes an optical engine, a waveguide, an incoupling grating, an outcoupling grating, a light valve and a reflector, wherein the light valve is located between the incoupling grating and the reflector, The controller controls the light emitted by the optical engine to couple a first imaging light into the waveguide through the coupling-in grating for total reflection, and then to be directed into the user's eyes through the coupling-out grating to obtain a first image, wherein the light emitted by the optical engine includes the first imaging light and the grating transmitted light; The controller controls the light valve to be in an open state, so that the light transmitted by the grating passes through the light valve and is reflected by the reflector, and then is transmitted to the optical engine through the light valve and the coupled grating; The grating transmitted light is irradiated onto the display chip of the optical engine through each refractive element of the optical engine to generate a second imaging light, and the second imaging light is then coupled into the waveguide through reflection from the display chip to obtain a second image, so that the user can determine the offset between the first image and the second image; and The controller adjusts the optical engine image position based on an offset between the first image and the second image determined by a user.

2. The system according to claim 1, wherein: When the glasses are in an uncalibrated state, the controller controls the light valve to be in a closed state, so that the light valve absorbs the light transmitted by the grating.

3. The system according to claim 1, wherein: The reflector is a solid reflector or a reflective optical film-coated reflective mirror.

4. The system according to claim 1, wherein: The light valve is a liquid crystal light valve, or the light valve is a combination of a polarizer and a phase modulator.

5. The system according to claim 1, wherein: The first image and the second image are both grid line diagrams, which include coordinate points of horizontal and vertical lines. The origin of the coordinate points is the center point of the first image, so that the user can determine the offset between the first image and the second image based on the coordinate value of the center point of the second image.

6. A method for calibrating the position of glasses images, wherein: Applied to the glasses image position calibration system according to claims 1-5, the method comprises: The light emitted by the optical engine is controlled to couple the first imaging light into the waveguide through the coupling grating for total reflection, and then is introduced into the user's eyes through the coupling grating to obtain a first image. The light emitted by the optical engine includes the first imaging light and The grating transmits light; Control the light valve to be in an open state so that the light transmitted by the grating passes through the light valve and is reflected by the reflector, and then is transmitted to the optical engine through the light valve and the coupled grating; The grating transmitted light is irradiated onto the display chip of the optical engine through each refractive element of the optical engine to generate a second imaging light, and the second imaging light is then coupled into the waveguide through reflection from the display chip to obtain a second image, so that the user can determine the offset between the first image and the second image; and The optical engine image position is adjusted based on an offset between the first image and the second image determined by a user.

7. The method according to claim 6, wherein: The method further comprises: When it is detected that the glasses are in a normal display state, the light valve is controlled to be in a closed state so that the light valve absorbs the light transmitted by the grating.

8. A glasses image position calibration device, wherein: The device comprises: a first image display module, configured to control light emitted by the optical engine to couple a first imaging light into the waveguide through an in-coupling grating for total reflection, and then to be directed into a user's eye through an out-coupling grating to obtain a first image, wherein the light emitted by the optical engine includes the first imaging light and the grating transmitted light; The light reflection module is used to control the light valve to be in an open state, so that the light transmitted by the grating passes through the light valve and is reflected on the reflector, and then transmitted to the optical engine through the light valve and the coupled grating; a second image display module, configured to illuminate the grating transmitted light onto the display chip of the optical engine through the refractive components of the optical engine to generate a second imaging light, and then couple the second imaging light into the waveguide through reflection from the display chip to obtain a second image, so that the user can determine the offset between the first image and the second image; and The image position adjustment module is used to adjust the optical engine image position based on the offset between the first image and the second image determined by the user.

9. AR glasses, wherein: The AR glasses include the glasses image position calibration system according to any one of claims 1 to 5.

10. An electronic device, wherein: include: A memory and a processor, wherein the memory and the processor are connected to each other in communication, and the memory stores There are computer instructions, and the processor executes the glasses image position calibration method according to any one of claims 6 to 7 by executing the computer instructions.

Images