An eyeglass image position calibration system, method, device and AR eyeglass

Abstract

The application relates to the technical field of AR glasses, and discloses a glasses image position calibration system, method, device and AR glasses. The application adds the hardware structure of a light valve and a mirror after a coupling-in grating, utilizes the characteristics of grating transmission light, the grating transmission light is reflected on the mirror through the light valve, is transmitted to an optical engine to regenerate second imaging light to obtain a second image and determine the offset between the first image obtained by the first imaging light emitted by the optical engine, realizes the function of automatic calibration of the AR glasses, and meets the demand of normal wearing of consumers.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of AR glasses, in particular to a glasses image position calibration system, method, device and AR glasses. BACKGROUND

[0002] Whether the performance of binocular image display consistency meets the requirements of human eye vision is an important factor for the human eye to normally watch AR image and for the AR glasses to normally work.

[0003] In the production of AR glasses, the consistency of binocular display image is strictly controlled to ensure that the human eye can normally watch the image when shipped. However, in use, due to different head circumference of glasses wearers, use habits, and aging of glasses structure, etc., the binocular display image inconsistency gradually becomes serious, eventually causing the human eye to be unable to normally watch the AR image. Common AR binocular display image needs to be uniformly measured and calibrated by special equipment and professional personnel, which wastes a long time and cannot meet the normal wearing needs of consumers. SUMMARY

[0004] Therefore, the present application provides a glasses image position calibration system, method, device and AR glasses to solve the problem that AR display image needs to be calibrated by professional personnel and cannot meet the normal wearing needs of consumers.

[0005] In a first aspect, the present application provides a glasses image position calibration system, which comprises an optical engine, a waveguide sheet, a coupling-in grating, a coupling-out grating, a light valve and a mirror, and the light valve is between the coupling-in grating and the mirror.

[0006] The controller controls the light emitted by the optical engine to be coupled into the waveguide sheet through the coupling-in grating to be totally reflected and then introduced into the user's eyes through the coupling-out grating to obtain a first image, wherein the light emitted by the optical engine includes first imaging light and grating transmission light; the controller controls the light valve to be in an open state so that the grating transmission light is transmitted to the mirror through the light valve to be reflected and then transmitted to the optical engine through the light valve and the coupling-in grating; the grating transmission light is irradiated to the display chip of the optical engine through the refractive devices of the optical engine to generate second imaging light, and then the second imaging light is coupled into the waveguide sheet through the reflection of the display chip to obtain a second image, so that the user determines the offset amount of the first image and the second image; and the controller adjusts the image position of the optical engine based on the offset amount of the first image and the second image determined by the user.

[0007] The application adds the hardware structure of the light valve and the mirror after the coupling-in grating, utilizes the characteristics of the grating transmission light, and transmits the grating transmission light to the mirror to be reflected, is transmitted to the optical engine to regenerate the second imaging light to obtain the second image and determine the offset between the first image obtained by the first imaging light emitted by the optical engine, realizes the function of the automatic calibration of the AR glasses, and meets the needs of normal wearing of consumers.

[0008] In an optional embodiment, when the glasses are in the uncalibrated state, the controller controls the light valve to be in the closed state, so that the light valve absorbs the grating transmission light.

[0009] The application controls the light valve to be in the closed state when the glasses are in the uncalibrated state, so that the light valve absorbs the grating transmission light, and ensures that the optical engine is in the normal working state.

[0010] In an optional embodiment, the mirror is a solid mirror or a mirror optical film.

[0011] The designed mirror of the application is a solid mirror or a mirror optical film, so as to improve the reflection ability of light.

[0012] In an optional embodiment, the light valve is a liquid crystal light valve, or the light valve is a combination of a polarizer and a phase modulator.

[0013] In an optional embodiment, the first image and the second image are both grid line graphs, the grid line graph includes coordinate points of horizontal and vertical lines, and the origin of the coordinate points is the center point of the first image, so that the user determines the offset between the first image and the second image based on the coordinate value of the center point of the second image.

[0014] The application designs the coordinate points of horizontal and vertical lines in the grid line graph, so that the user can accurately determine the offset between the first image and the image, and then improve the accuracy of adjusting the image display position of the optical engine.

[0015] In a second aspect, the application provides a glasses image position calibration method, which is applied to the glasses image position calibration system of the first aspect or any of the corresponding embodiments, and the method comprises the following steps.

[0016] The light emitted by the optical engine is controlled to pass through the coupling-in grating to couple the first imaging light into the waveguide sheet to be totally reflected and then pass through the coupling-out grating to be introduced into the eyes of the user to obtain the first image, the light emitted by the optical engine including the first imaging light and grating transmission light; the light valve is controlled to be in an open state to enable the grating transmission light to pass through the light valve to be reflected on the mirror and then pass through the refractive elements of the optical engine to be irradiated on the display chip of the optical engine to generate the second imaging light, and then the second imaging light is reflected by the display chip to be coupled into the waveguide sheet to obtain the second image, so that the user determines the offset of the first image and the second image; and the image position of the optical engine is adjusted based on the offset of the first image and the second image determined by the user.

[0017] In an optional implementation, the method further includes: when it is monitored that the glasses are in the normal display state, controlling the light valve to be in a closed state to enable the light valve to absorb the grating transmission light.

[0018] In a third aspect, the present application provides a glasses image position calibration device, the device comprising:

[0019] a first image display module configured to control the light emitted by the optical engine to pass through the coupling-in grating to couple the first imaging light into the waveguide sheet to be totally reflected and then pass through the coupling-out grating to be introduced into the eyes of the user to obtain the first image, the light emitted by the optical engine including the first imaging light and grating transmission light;

[0020] a light reflection module configured to control the light valve to be in an open state to enable the grating transmission light to pass through the light valve to be reflected on the mirror and then pass through the light valve and the coupling-in grating to be transmitted to the optical engine;

[0021] a second image display module configured to pass the grating transmission light through the refractive elements of the optical engine to irradiate on the display chip of the optical engine to generate the second imaging light, and then couple the second imaging light into the waveguide sheet through the reflection of the display chip to obtain the second image, so that the user determines the offset of the first image and the second image;

[0022] an image position adjustment module configured to adjust the image position of the optical engine based on the offset of the first image and the second image determined by the user.

[0023] In a fourth aspect, the present application provides an AR glasses, the AR glasses comprising the glasses image position calibration system of the first aspect or any of the corresponding implementation modes thereof.

[0024] In a fifth aspect, the present application provides an electronic device, comprising a memory and a processor, the memory and the processor being communicatively connected with each other, the memory storing computer instructions, and the processor executing the computer instructions to perform the glasses image position calibration method of the second aspect or any of the corresponding implementation modes thereof. Attached Figure Description

[0025] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0026] Figure 1 This is a structural block diagram of a glasses image position calibration system according to an embodiment of the present invention;

[0027] Figure 2 This is an example structural diagram of a glasses image position calibration system according to an embodiment of the present invention;

[0028] Figure 3 This is an example diagram illustrating the working principle of a reflective grating according to an embodiment of the present invention;

[0029] Figure 4 This is an example diagram showing the installation positions of the light valve and the reflector according to an embodiment of the present invention;

[0030] Figure 5 This is an example diagram showing the relative positions of the outermost optical surface of the optical engine and the waveguide sheet according to an embodiment of the present invention;

[0031] Figure 6 This is an example diagram showing the relative positions of the first image and the second image according to an embodiment of the present invention;

[0032] Figure 7 This is another example diagram illustrating the relative positions of a first image and a second image according to an embodiment of the present invention;

[0033] Figure 8 This is a schematic flowchart of a glasses image position calibration method according to an embodiment of the present invention;

[0034] Figure 9 This is a flowchart illustrating a method for calibrating the position of an eyeglass image according to an embodiment of the present invention.

[0035] Figure 10 This is a structural block diagram of AR glasses according to an embodiment of the present invention;

[0036] Figure 11 This is a structural block diagram of a glasses image position calibration device according to an embodiment of the present invention;

[0037] Figure 12 This is a schematic diagram of the hardware structure of an electronic device according to an embodiment of the present invention. Detailed Implementation

[0038] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative work fall within the protection scope of the present application.

[0039] During long-term use of AR glasses by consumers, due to aging of structural parts, wearing methods and other reasons, binocular images no longer match, so that the eyes cannot fuse binocular images, resulting in the glasses cannot be worn.

[0040] The commonly used binocular image matching scheme is that, in the optical module production factory, during the module assembly process, an AR device is used to measure binocular images and assemble at the same time, so as to ensure binocular image matching. Only professional equipment and professional staff can ensure that the two images on a pair of AR glasses match. Therefore, when the glasses are shipped, binocular image matching can be ensured. However, the image mismatch caused during use of the glasses needs to be returned to the factory to be solved. In the early stage of image mismatch, the eyes cannot directly judge the image display error, but try to adjust the eye state to adapt to the error display. Short-time viewing can cause eye strain, dizziness and other problems, and long-time use can cause eye damage.

[0041] During wearing, the main reason for binocular image inconsistency is that the relative spatial position relationship of the optical engine part and the waveguide part changes. When the change occurs, the exit image size and position of the waveguide deviate from the ideal position, causing the eyes to not be able to converge when observing binocularly, and the waveguide diffracts light, which propagates in it in the form of total reflection.

[0042] Based on the above problems, the embodiments of the present application provide a glasses image position calibration system, as shown in Figure 1 The system includes a controller 1, an optical engine 2, a waveguide sheet 3, a coupling-in grating 4, a light valve 5, a mirror 6 and a coupling-out grating 7, wherein the light valve 5 is between the coupling-in grating 4 and the mirror 6.

[0043] Specifically, the controller 1 controls the light emitted by the optical engine 2 to be coupled into the waveguide sheet 3 through the coupling-in grating 4 to form the first imaging light to be totally reflected and then guided into the eyes of the user through the coupling-out grating 7 to form the first image, and the light emitted by the optical engine 2 includes the first imaging light and grating transmission light; the controller 1 controls the light valve 5 to be in an open state, so that the grating transmission light is transmitted through the light valve 5 to be reflected on the mirror 6 and then transmitted to the optical engine 2 through the light valve 5 and the coupling-in grating 4; the grating transmission light is irradiated on the display chip of the optical engine 2 through the refractive devices of the optical engine 2 to form the second imaging light, and then the second imaging light is coupled into the waveguide sheet 3 through the reflection of the display chip to form the second image, so that the user determines the offset between the first image and the second image; and the controller 1 adjusts the image position of the optical engine 2 based on the offset between the first image and the second image determined by the user.

[0044] The AR glasses are taken as an example in the embodiment of the present application, the optical engine 2 can be installed on the leg of the AR glasses or the frame of the AR glasses, and is not limited, the waveguide sheet 3 is a diffractive optical waveguide, as shown in Figure 2 The coupling-in grating 4 is a reflective grating, and as shown in Figure 3 The light emitted by the optical engine 2 is divided into positive first-order diffractive light, grating transmission light and negative first-order diffractive light, wherein the positive first-order diffractive light is target light or imaging light, enters the waveguide sheet 3 to be totally reflected and then guided into the eyes of the user through the coupling-out grating 7 to display the first image, and the grating transmission light and the negative first-order diffractive light are called stray light, as shown in Figure 4 The embodiment of the present application designs the light valve 5 and the mirror 6 after the coupling-in grating 4, the mirror 6 reflects the light transmitted from the light valve 5 back to the light valve 5, the AR glasses are in a calibration state, the controller 1 controls the light valve 5 to be in an open state, the grating transmission light can be irradiated on the plane mirror 6 through the light valve 5 to be reflected, and the reflected grating transmission light is coupled into the waveguide sheet 3 through the light valve 5 and the coupling-in grating 4 and then transmitted to the optical engine 2. The grating transmission light can be irradiated on the display chip of the optical engine 2 through the refractive devices of the optical engine 2, the display chip forms an image by receiving the irradiated grating transmission light and reflects the image in the form of imaging light into the waveguide sheet 3 to be totally reflected and then guided into the eyes of the user through the coupling-out grating 7 to form the second image, at this time, the first image displayed by the first imaging light emitted by the optical engine 2 can be seen by the eyes, and the second image formed by the reflection of the mirror 6 can also be seen.

[0045] The embodiment of the present application is in the position relationship that the optical engine 2 and the waveguide sheet 3 are parallel, that is, in the binocular image consistency requirement, the light emitted by the optical engine 2 is coupled into the waveguide sheet 3 to form a first image, the grating transmission light is reflected by the mirror 6, and then is transmitted to the optical engine 2 through the light valve 5 and the coupling-in grating 4 in the direction perpendicular to the waveguide sheet 3, at this time, the grating transmission light is also parallel to the optical axis of the optical engine 2, the grating transmission light is irradiated to the display chip of the optical engine 2 through the refractive devices of the optical engine 2 to generate a second imaging light, and the second imaging light is recoupled into the waveguide sheet 3 through the reflection of the display chip in the direction parallel to the optical axis of the optical engine 2 to display a second image, at this time, the first image and the second image are completely coincident, and the embodiment of the present application Figure 2 The thick solid line in the embodiment of the present application represents the light route reflected by the mirror 6, the thin solid line represents the route of the first imaging light emitted by the optical engine 2, and the thin dotted line represents the route of the second imaging light generated by the optical engine 2 after receiving the light reflected by the mirror 6, and in actual application, the three light routes propagate in the coincident path.

[0046] When the angle α between the optical engine 2 and the waveguide sheet 3 occurs, that is, the optical axis of the optical engine 2 is deflected by the angle α, as shown in Figure 5 The optical engine 2 can emit light, and when the angle α between the optical engine 2 and the waveguide sheet 3 changes, that is, the outermost optical surface of the optical engine 2 and the waveguide sheet 3 change by the angle α, the first imaging light emitted by the optical engine 2 also changes by the angle α with the waveguide sheet 3, and the image obtained by the coupling-out grating 7 after being coupled into the waveguide sheet 3 is the first image which changes by the angle α.

[0047] At this time, the grating transmission light emitted by the optical engine 2 still vertically passes through the light valve 5 to irradiate the mirror 6, the mirror 6 reflects the grating transmission light and transmits the grating transmission light to the optical engine 2 through the light valve 5 and the coupling-in grating 4 in the direction perpendicular to the waveguide sheet 3, and when the angle α between the optical engine 2 and the waveguide sheet 3 changes, the grating transmission light reflected by the mirror 6 also changes by the angle α with the optical engine 2, and then the second imaging light is generated by irradiating the display chip through the refractive devices of the optical engine 2, the second imaging light is reflected by the display chip again, at this time, the second imaging light reflected by the chip changes by the angle 2α with the waveguide sheet 3, and the image obtained by the coupling-out grating 7 after being coupled into the waveguide sheet 3 is the second image which changes by the angle 2α, and the first image which changes by the angle α and the second image which changes by the angle 2α have the angle α deviation, and the deviation trend between the optical engine 2 and the waveguide sheet 3 is completely equal, and the first image and the second image seen by the user's eyes have a deviation.

[0048] The user can input the offset between the two determined images into the feedback record box, wherein the feedback record box can be in the mobile device end of the user, and the mobile device end needs to be connected with the AR glasses before the user wears the AR glasses, and after the user inputs the offset into the feedback record box, the device end sends the feedback offset to the controller 1 of the AR glasses, so that the controller 1 adjusts the image display position of the optical engine 2 based on the offset, completes the calibration of binocular image consistency, and the user can directly input the determined offset in the AR glasses, so that the controller 1 of the AR glasses directly adjusts the image display position of the optical engine 2 based on the offset, wherein the offset can be a number, or the user directly screens the two images, and feeds back the screenshot picture to the feedback record table, and the controller 1 determines the offset between the two images and adjusts the image display position of the optical engine 2, which is not limited and is only used as an example.

[0049] The hardware structure of the light valve 5 and the mirror 6 is added after the coupling-in grating 4, the transmitted light of the grating is used to irradiate the mirror 6 through the light valve 5 for reflection, is transmitted to the optical engine 2 to regenerate the second imaging light to obtain the second image and determine the offset between the first image obtained by the first imaging light emitted by the optical engine 2, and the function of automatic calibration of the AR glasses is realized, and the demand of normal wearing of consumers is met.

[0050] Specifically, in the uncalibrated state of the glasses, the controller 1 controls the light valve 5 to be in the closed state, so that the light valve 5 absorbs the transmitted light of the grating.

[0051] The controller 1 in the embodiment of the application monitors whether the AR glasses are in the calibrated state, wherein the AR glasses in the calibrated state are in the powered-on state, and the user has worn the AR glasses, and the uncalibrated state is in the powered-off state or in the normal display state, which is only used as an example, and the controller 1 can control the light valve 5 to be in the closed state when the AR glasses are in the normal display state, so that the light valve 5 absorbs the transmitted light of the grating, and the optical engine is in the normal running state.

[0052] Specifically, the mirror 6 is a solid mirror or a reflective optical film.

[0053] The embodiment of the application can design the mirror 6 as a solid mirror or a reflective optical film to improve the reflection ability of the light.

[0054] Specifically, the light valve 5 is a liquid crystal light valve, or the light valve 5 is a combination of a polarizing plate and a phase modulator.

[0055] The light valve 5 in the embodiment of the present application functions to realize whether light passes through or not, and the ON state enables light to pass through, and the OFF state absorbs light. The light valve 5 can be a liquid crystal light valve, or a combination of a polarizer and a phase modulator, etc., which are merely examples.

[0056] Specifically, the first image and the second image are both grid line images, and the grid line images include coordinate points of horizontal and vertical lines, and the coordinate points have a center point of the first image as an origin, so that the user determines the offset between the first image and the second image based on a coordinate value of a center point of the second image.

[0057] As shown in Figure 6 , the first image and the second image emitted by the optical engine 2 are both grid line images, the first image is a solid line grid image, and the second image is a dashed line grid image. When the optical engine 2 and the waveguide sheet 3 are in a parallel position relationship, i.e., meet the binocular image consistency requirement, the solid line grid image and the dashed line grid image completely coincide.

[0058] As shown in Figure 7 , when an angle α occurs between the optical engine 2 and the waveguide sheet 3, i.e., the optical axis of the optical engine 2 deflects by an angle α, an offset occurs between the solid line grid image and the dashed line grid image.

[0059] The embodiment of the present application can add coordinate points of horizontal and vertical lines to the displayed grid line image, and the center point of the first image can be used as the coordinate origin, so that the user determines the offset between the first image and the second image based on the coordinate of the center point of the second image. Alternatively, any one of the four top points of the first image can be used as the coordinate origin, so that the user determines the offset between the first image and the second image based on the coordinate of the same top point in the second image. The coordinate origin is not limited, and is merely an example.

[0060] According to the embodiment of the present application, an eyeglass image position calibration method is provided. It should be noted that the steps shown in the flowchart can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0061] In the embodiment, an eyeglass image position calibration method is provided, which can be used in the eyeglass image position calibration system described above. Figure 8 is a flowchart of the eyeglass image position calibration method according to the embodiment of the present application, which includes the following steps as shown in Figure 8 .

[0062] In step S801, the light emitted by the optical engine is coupled into the waveguide sheet through the coupling-in grating to be totally reflected and then introduced into the user's eyes through the coupling-out grating to obtain the first image.

[0063] The light emitted by the optical engine includes the first imaging light and the grating transmission light.

[0064] The embodiment of the present application can control the light emitted by the optical engine to be coupled into the waveguide sheet through the coupling-in grating to be totally reflected and then be guided into the eyes of the user through the coupling-out grating to obtain the first image, when it is monitored that the AR glasses are in the starting state and have been worn by the user, or in response to the glasses calibration instruction triggered by the user.

[0065] In step S802, the light valve is controlled to be in the open state, so that the grating transmission light is transmitted to the mirror through the light valve to be reflected, and then is transmitted to the optical engine through the light valve and the coupling-in grating.

[0066] In the embodiment of the present application, the light valve is controlled to be in the open state when the AR glasses are in the calibration state, so that the grating transmission light can be transmitted to the mirror through the light valve to be reflected, and then the reflected grating transmission light is coupled into the waveguide sheet through the light valve and the coupling-in grating and is transmitted to the optical engine.

[0067] In step S803, the grating transmission light is irradiated to the display chip of the optical engine through the refractive elements of the optical engine to generate the second imaging light, and then the second imaging light is coupled into the waveguide sheet through the reflection of the display chip to obtain the second image, so that the user can determine the offset between the first image and the second image.

[0068] In the embodiment of the present application, the grating transmission light is irradiated to the display chip of the optical engine through the refractive elements of the optical engine, the display chip receives the irradiated grating transmission light to form an image and reflects the image in the form of imaging light into the waveguide sheet to be totally reflected and then be guided into the eyes of the user through the coupling-out grating to form the second image, so that the first image displayed by the first imaging light emitted by the optical engine can be visually seen, and the second image formed by the reflection of the mirror can also be visually seen.

[0069] In step S804, the image position of the optical engine is adjusted based on the offset between the first image and the second image determined by the user.

[0070] In the embodiment of the present application, the controller can adjust the image position of the optical engine based on the offset between the first image and the second image fed back by the user.

[0071] In an embodiment, when it is monitored that the glasses are in the normal display state, the light valve is controlled to be in the closed state, so that the grating transmission light is absorbed by the light valve.

[0072] In the embodiment of the present application, when it is monitored that the glasses are in the normal display state, the light valve is controlled to be in the closed state, so that the grating transmission light is absorbed by the light valve, and the normal use of the optical engine is ensured.

[0073] The embodiment of the present application increases the light valve and the mirror, utilizes the wasted grating transmitted light to transmit to the optical engine after being reflected by the mirror, generates the second imaging light based on the grating transmitted light through the optical engine, displays the second image in the waveguide sheet again by coupling in the second imaging light, and determines the offset by comparing the first image and the second image, and then adjusts the display position of the optical engine, which not only reasonably utilizes the wasted light resource, but also can automatically calibrate the AR glasses in real time, and meets the wearing demand of the consumer.

[0074] In the specific embodiment, as shown in Figure 9 When the AR glasses are completely worn by the user and the AR glasses are in the state of starting or calibration, the optical engine displays the calibration image, the light valve is opened, the mirror reflects the grating transmitted light and transmits the second imaging light to the optical engine to generate the second imaging light, the second imaging light is coupled into the waveguide sheet to display the second image, the user visually judges the consistency of the two images, if the two images are inconsistent, the user can visually read the offset, the offset is input into the AR glasses, the optical engine is controlled to display the position, the step of controlling the optical engine to display the calibration image is repeated, if the two calibration images are consistent, the AR glasses can directly enter the starting screen and start to be used. The scheme is also applicable to the diffractive optical waveguide made of the transmission grating, and the details are described in the above embodiment, which will not be described here.

[0075] Compared with the previous scheme, the function can be completed by using a set of hardware system, and after being worn, the calibration can be completed, and the difference between wearing and not wearing is avoided, which may cause the calibration to be accurate when not wearing, and the image does not match after being worn due to the force on the glasses legs.

[0076] In the embodiment, an AR glasses is also provided, as shown in Figure 10 The AR glasses includes the above-mentioned embodiment of the glasses image position calibration system.

[0077] In the embodiment, a glasses image position calibration device is also provided, which is used to realize the above-mentioned embodiment and the preferred embodiment, and the description has been made. As used below, the term "module" can be a combination of software and / or hardware that realizes a predetermined function. Although the device described in the following embodiment is preferably realized by software, the realization of hardware, or the combination of software and hardware is also possible and conceived.

[0078] The embodiment provides a glasses image position calibration device, as shown in Figure 11 includes:

[0079] The first image display module 1101 is configured to control the light emitted by the optical engine to be coupled into the waveguide sheet as first imaging light through the coupling-in grating, to be totally reflected in the waveguide sheet, and to be guided into the user's eyes as a first image through the coupling-out grating, wherein the light emitted by the optical engine includes the first imaging light and grating transmission light;

[0080] The light reflection module 1102 is configured to control the light valve to be in an open state, so that the grating transmission light is transmitted to the mirror through the light valve and is reflected by the mirror, and then is transmitted to the optical engine through the light valve and the coupling-in grating;

[0081] The second image display module 1103 is configured to irradiate the grating transmission light to the display chip of the optical engine through the refractive devices of the optical engine, to generate second imaging light, and to couple the second imaging light into the waveguide sheet through the reflection of the display chip, to obtain a second image, so that the user determines the offset between the first image and the second image.

[0082] The image position adjustment module 1104 is configured to adjust the image position of the optical engine based on the offset between the first image and the second image determined by the user.

[0083] In some optional embodiments, the eyeglass image position calibration apparatus further includes:

[0084] The light valve closing module is configured to control the light valve to be in a closed state when it is monitored that the eyeglass is in a normal display state, so that the light valve absorbs the grating transmission light.

[0085] Further function descriptions of the above modules and units are the same as those of the corresponding embodiments, and will not be described here.

[0086] The eyeglass image position calibration apparatus in the embodiment is presented in the form of functional units, and the units herein refer to ASIC (Application Specific Integrated Circuit) circuits, processors and memories executing one or more software or fixed programs, and / or other devices that can provide the above functions.

[0087] The embodiment of the application further provides an electronic device with the above Figure 11 eyeglass image position calibration apparatus.

[0088] Please refer to Figure 12 , Figure 12FIG. 12 is a block diagram of an example of an electronic device provided by an alternative embodiment of the present application. The electronic device includes one or more processors 10, a memory 20, and one or more interfaces that connect the various components, including high-speed interfaces and low-speed interfaces. The various components communicate via one or more buses and can be mounted on a common motherboard or in other manners as appropriate. The processor(s) can process instructions for execution within the electronic device, including instructions stored in the memory or on storage to display graphical information for a GUI on an external input / output device, such as a display device coupled to the interface. In some alternative embodiments, multiple processors and / or multiple buses can be employed as appropriate, as well as multiple memories and types of memory. Also, various components can be connected by various interfaces as appropriate. Figure 12 The processor 10 is taken as an example in the embodiment.

[0089] The processor 10 can be a central processing unit, a network processor, or a combination thereof. The processor 10 can further include a hardware chip. The hardware chip can be an application specific integrated circuit, a programmable logic device, or a combination thereof. The programmable logic device can be a complex programmable logic device, a field programmable logic device, a general array logic, or any combination thereof.

[0090] The memory 20 stores instructions that are executable by the at least one processor 10, so as to enable the at least one processor 10 to perform the method shown in the above embodiment.

[0091] The memory 20 can include a program storage area and a data storage area. The program storage area can store an operating system and application programs required by at least one function. The data storage area can store data created according to the use of the electronic device, and the like. In addition, the memory 20 can include a high-speed random access memory, and can further include a non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state memory device. In some alternative embodiments, the memory 20 can optionally include a memory that is remotely arranged with respect to the processor 10, and these remote memories can be connected to the electronic device through a network. Examples of the network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof.

[0092] The memory 20 can include a volatile memory, such as a random access memory, and can also include a non-volatile memory, such as a flash memory, a hard disk, or a solid state disk. The memory 20 can further include a combination of the above-mentioned types of memories.

[0093] The electronic device also includes an input device 30 and an output device 40. The processor 10, the memory 20, the input device 30, and the output device 40 can be connected by a bus or other means, Figure 12 The connection by the bus is taken as an example.

[0094] The input device 30 can receive inputted digital or character information, and generate signal input related to user settings and function control of the electronic device, such as a touch screen, a keypad, a mouse, a trackpad, a touchpad, a pointing stick, one or more mouse buttons, a trackball, a joystick, etc. The output device 40 can include a display device, an auxiliary lighting device (e.g., an LED), a tactile feedback device (e.g., a vibration motor), etc. The display device includes, but is not limited to, a liquid crystal display, a light emitting diode, a display, and a plasma display. In some alternative embodiments, the display device can be a touch screen.

[0095] The embodiments of the present application also provide a computer readable storage medium, the method according to the embodiments of the present application can be implemented in hardware, firmware, or recorded in a storage medium, or stored in a remote storage medium or a non-transitory machine readable storage medium and downloaded from a network and stored in a local storage medium, so that the method described herein can be processed by such software on a storage medium using a general purpose computer, a special purpose processor, or programmable or special purpose hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only memory, a random access memory, a flash memory, a hard disk or a solid state disk, etc.; further, the storage medium can also include a combination of the above types of memories. It can be understood that the computer, processor, microprocessor controller or programmable hardware includes a storage component that can store or receive software or computer code, when the software or computer code is accessed and executed by the computer, processor or hardware, the method shown in the above embodiments is implemented.

[0096] Although the embodiments of the present application are described in conjunction with the accompanying drawings, various modifications and changes can be made by those skilled in the art without departing from the spirit and scope of the present application, and such modifications and changes fall within the scope defined by the appended claims.

Claims

1. A system for calibrating the position of an eyeglass image, comprising: The system comprises an optical engine, a waveguide sheet, a coupling-in grating, a coupling-out grating, a light valve and a mirror, the light valve is between the coupling-in grating and the mirror, the optical engine is mounted on the temple or the frame of the glasses, wherein, The controller controls the light emitted by the optical engine to couple the first imaging light into the waveguide sheet through the coupling-in grating for total reflection and then guide into the user's eyes through the coupling-out grating to obtain the first image, the light emitted by the optical engine includes the first imaging light and grating transmission light; The controller controls the light valve to be in an open state, so that the grating transmission light is irradiated onto the mirror through the light valve for reflection and then transmitted to the optical engine through the light valve and the coupling-in grating; The grating transmission light is irradiated onto the display chip of the optical engine through the refractive devices of the optical engine to generate the second imaging light, and then the second imaging light is coupled into the waveguide sheet through the reflection of the display chip to obtain the second image, so that the user determines the offset amount of the first image and the second image; The controller adjusts the image position of the optical engine based on the offset amount of the first image and the second image determined by the user.

2. The system of claim 1, wherein, When the glasses are in an uncalibrated state, the controller controls the light valve to be in a closed state, so that the light valve absorbs the grating transmission light.

3. The system of claim 1, wherein, The mirror is a solid mirror or a mirror coated with a reflective optical film.

4. The system of claim 1, wherein, The light valve is a liquid crystal light valve, or the light valve is a combination of a polarizer and a phase modulator.

5. The system of claim 1, wherein, The first image and the second image are both grid line images, the grid line image includes coordinate points of horizontal and vertical lines, and the origin of the coordinate points is the center point of the first image, so that the user determines the offset amount of the first image and the second image based on the coordinate value of the center point of the second image.

6. A method of calibrating the position of an eyeglass image, comprising: The method is applied to the glasses image position calibration system of any one of claims 1-5, and the method comprises: The controller controls the light emitted by the optical engine to couple the first imaging light into the waveguide sheet through the coupling-in grating for total reflection and then guide into the user's eyes through the coupling-out grating to obtain the first image, the light emitted by the optical engine includes the first imaging light and grating transmission light; The controller controls the light valve to be in an open state, so that the grating transmission light is irradiated onto the mirror through the light valve for reflection and then transmitted to the optical engine through the light valve and the coupling-in grating; The grating transmission light is irradiated onto the display chip of the optical engine through the refractive devices of the optical engine to generate the second imaging light, and then the second imaging light is coupled into the waveguide sheet through the reflection of the display chip to obtain the second image, so that the user determines the offset amount of the first image and the second image; The controller adjusts the image position of the optical engine based on the offset amount of the first image and the second image determined by the user.

7. The method of claim 6, wherein, The method further comprises: When it is monitored that the glasses are in a normal display state, the controller controls the light valve to be in a closed state, so that the light valve absorbs the grating transmission light.

8. An eyeglass image position calibration apparatus characterized by comprising: The device comprises: A first image display module is configured to control the light emitted by the optical engine to couple the first imaging light into the waveguide sheet through the coupling-in grating for total reflection and then guide into the user's eyes through the coupling-out grating to obtain the first image, the light emitted by the optical engine includes the first imaging light and grating transmission light; The light reflection module is configured to control the light valve to be in an open state, so that the grating transmitted light is transmitted through the light valve to the mirror for reflection, and then transmitted to the optical engine through the light valve and the in-coupling grating. The second image display module is configured to irradiate the grating transmitted light to a display chip of the optical engine through the refractive elements of the optical engine to generate second imaging light, and then couple the second imaging light into a waveguide sheet through reflection of the display chip to obtain a second image, so that a user determines an offset between the first image and the second image. The image position adjustment module is configured to adjust an image position of the optical engine based on the offset between the first image and the second image determined by the user.

9. An AR eyeglass, characterized by, The AR glasses include the glasses image position calibration system of any one of claims 1-5.

10. An electronic device, comprising: The AR glasses include the glasses image position calibration system of any one of claims 1-5. The memory and the processor are in communication connection with each other, the memory stores computer instructions, and the processor executes the computer instructions to perform the glasses image position calibration method of any one of claims 6-7.

Images