Glasses image position calibration system, method and device and AR glasses

Abstract

The invention relates to the technical field of AR (Augmented Reality) glasses, and discloses a glasses image position calibration system, method and device and AR glasses. By adding a test light-emitting device, light emitted by the test light-emitting device is controlled to be coupled into a waveguide sheet and is vertically transmitted to the surface of the outermost layer of an optical engine after being diffracted by a coupled grating; the surface of the outermost layer of the optical engine reflects and modulates the transmitted light and then couples the light into the waveguide sheet to obtain a first image, and the offset of the first image and a second image corresponding to the optical engine is determined, so that the consistency of binocular display images can be judged in real time when a user wears glasses. Therefore, binocular image display difference can be corrected at any time, normal wearing requirements of a user can be met, and user health is prevented from being affected.

Description

Technical Field

[0001] The present invention relates to the technical field of AR glasses, and in particular to a glasses image position calibration system, method, device and AR glasses. Background Art

[0002] During long-term use of AR glasses by consumers, the binocular images no longer match due to aging of structural parts and wearing methods, making it impossible for visual perception to fuse the binocular images, making the glasses unwearable.

[0003] At present, the commonly used binocular image matching solution is that the optical module manufacturer measures the binocular image while assembling the module during the module assembly process to ensure binocular image matching. However, image mismatch may occur during the long-term use of the glasses by users, and the glasses need to be returned to the factory for resolution. In addition, in the early stage of image mismatch, the human eye cannot directly determine that the image display is wrong, but tries its best to adjust the eye state to adapt to the wrong display. Short-term viewing can cause visual fatigue, dizziness and other problems, and long-term use may cause visual damage to the human eye. Summary of the invention

[0004] In view of this, the present invention provides a glasses image position calibration system, method, device and AR glasses to solve the problem that image mismatch during the use of glasses may cause visual fatigue of the human eye.

[0005] In a first aspect, the present invention provides an eyeglass image position calibration system, the system comprising: a test light emitting device, an optical engine, a waveguide, a coupling-in grating, a coupling-out grating and a controller, wherein the controller controls the light emitted by the test light emitting device to be coupled into the waveguide and vertically transmitted to the outermost optical surface of the optical engine through the diffraction action of the coupling-in grating, and the test light emitting device is installed at a position where total reflection occurs on the waveguide; the outermost optical surface of the optical engine is controlled to reflect and modulate the light diffracted by the coupling-in grating, and then coupled into the waveguide for total reflection and then introduced into the user's eyes through the coupling-out grating to obtain a first image; the controller controls the light emitted by the optical engine to be coupled into the waveguide for total reflection through the coupling-in grating and then introduced into the user's eyes through the coupling-out grating to obtain a second image, so that the user can determine the offset between the first image and the second image; the controller adjusts the image position of the optical engine based on the offset between the first image and the second image determined by the user.

[0006] The eyeglass image position correction system provided by the present invention adds a test light-emitting device, controls the light emitted by the test light-emitting device to be coupled into a waveguide plate, and then vertically transmitted to the outermost surface of the optical engine after the diffraction effect of the coupled grating, so that the outermost surface of the optical engine reflects and modulates the transmitted light and then couples it into the waveguide plate to obtain a first image, and then determines the offset with the second image corresponding to the optical engine. It can be realized that when the user wears glasses, the consistency of the binocular display image can be judged in real time, so as to correct the binocular image display difference at any time, meet the user's normal wearing needs, and avoid affecting the user's health.

[0007] In an optional implementation, the test light-emitting device includes a light source and an optical lens, wherein the light emitted by the light source is projected through the optical lens to obtain aperture light.

[0008] The present invention adds an optical lens outside the light source, does not limit the model of the light source and the light emitted, and obtains aperture light through transmission modulation of the optical lens.

[0009] In an optional implementation, the field of view angle of the image emitted by the test light emitting device is smaller than the field of view angle of the image emitted by the optical engine.

[0010] The present invention limits the viewing angle of the image emitted by the test light emitting device to be smaller than the viewing angle of the image emitted by the optical engine, thereby ensuring that the image emitted by the test light emitting device can be seen by human eyes, and then the offset of the image can be determined.

[0011] In an optional embodiment, the outermost optical surface of the optical engine is not coated or is coated with a partial reflective film.

[0012] The outermost optical surface of the optical engine designed by the present invention is not coated or is partially coated with a reflective film, which can increase the reflectivity.

[0013] In an optional embodiment, the first image is a dot map, and the second image is a grid line map, wherein the grid line map includes coordinate points of horizontal and vertical lines, so that a user can determine the offset between the first image and the second image based on the values ​​of the coordinate points.

[0014] The present invention ensures that the user can accurately judge the offset between images by adding coordinate points of horizontal and vertical lines in the displayed image, thereby improving the accuracy of calibrating the image position.

[0015] In a second aspect, the present invention provides a glasses image position calibration method, which is applied to the glasses image position calibration system of the first aspect or any corresponding embodiment thereof, and the method comprises:

[0016] The light emitted by the test light emitting device is controlled to be coupled into the waveguide and vertically transmitted to the outermost optical surface of the optical engine through the diffraction effect of the coupling-in grating, and the test light emitting device is installed at the position where total reflection occurs on the waveguide; the outermost optical surface of the optical engine is controlled to reflect and modulate the light diffracted by the coupling-in grating, and then coupled into the waveguide for total reflection, and then introduced into the user's eyes through the coupling-out grating to obtain a first image; the light emitted by the optical engine is controlled to be coupled into the waveguide through the coupling-in grating for total reflection, and then introduced into the user's eyes through the coupling-out grating to obtain a second image, so that the user can determine the offset between the first image and the second image; the image position of the optical engine is adjusted based on the offset between the first image and the second image determined by the user.

[0017] In an optional embodiment, the adjusting the optical engine image position based on the offset of the first image and the second image determined by the user includes: determining whether the offset of the first image and the second image determined by the user is greater than a preset offset threshold; if the determined offset is greater than the preset offset threshold, adjusting the optical engine image display position based on the offset; if the determined offset is not greater than the preset offset threshold, entering a screen where the optical engine displays the image.

[0018] In a third aspect, the present invention provides a device for calibrating the position of glasses images, the device comprising:

[0019] A test light control module is used to control the light emitted by the test light emitting device to be coupled into the waveguide and vertically transmitted to the outermost optical surface of the optical engine through the diffraction effect of the coupling-in grating, wherein the test light emitting device is installed at the position where the light on the optical axis of the optical engine is totally reflected on the waveguide; a first image determination module is used to control the outermost optical surface of the optical engine to reflect and modulate the light diffracted by the coupling-in grating, then couple it into the waveguide for total reflection, and then introduce it into the human eye through the coupling-out grating to obtain a first image; a second image determination module is used to control the light emitted by the optical engine to be coupled into the waveguide through the coupling-in grating for total reflection, and then introduce it into the human eye through the coupling-out grating to obtain a second image, so that the user can determine the offset between the first image and the second image; an image position adjustment module is used to adjust the image position of the optical engine based on the offset between the first image and the second image determined by the user.

[0020] In a fourth aspect, the present invention provides an AR glasses, which include the glasses image position calibration system of the first aspect or any corresponding embodiment thereof.

[0021] In a fifth aspect, the present invention provides an electronic device comprising: a memory and a processor, the memory and the processor being communicatively connected to each other, the memory storing computer instructions, and the processor executing the method for calibrating the image position of glasses according to the second aspect or any corresponding embodiment thereof by executing the computer instructions. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0023] Figure 1 is a structural block diagram of a glasses image position calibration system according to an embodiment of the present invention;

[0024] Figure 2 is an exemplary structural diagram of a glasses image position calibration system according to an embodiment of the present invention;

[0025] Figure 3 is an exemplary diagram of the installation position of the test light emitting device according to an embodiment of the present invention;

[0026] Figure 4 is an exemplary diagram of the relative positions of the outermost optical surface and the waveguide of the optical engine according to an embodiment of the present invention;

[0027] Figure 5 is a structural example diagram of a test light emitting device according to an embodiment of the present invention;

[0028] Figure 6 is an exemplary diagram of relative positions of an optical engine image and a light source according to an embodiment of the present invention;

[0029] Figure 7 is another example diagram of relative positions of an optical engine image and a light source according to an embodiment of the present invention;

[0030] Figure 8 is a schematic flow chart of a glasses image position calibration method according to an embodiment of the present invention;

[0031] Fig. 9 is a flowchart of a glasses image position calibration method according to an embodiment of the present invention;

[0032] Fig.10 is a structural block diagram of AR glasses according to an embodiment of the present invention;

[0033] Fig.11 is a structural block diagram of a glasses image position calibration device according to an embodiment of the present invention;

[0034] Fig.12 It is a schematic diagram of the hardware structure of the electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0035] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0036] For AR glasses, whether the binocular image display consistency can meet the requirements of human visual synthesis is an important factor in whether the human eye can view AR images normally and whether AR glasses can work normally. In the production of AR glasses, the consistency of binocular display images will be strictly controlled to ensure that the human eye can view the image normally when shipped. However, during use, due to factors such as different head circumferences, usage habits of glasses wearers, and aging of the glasses' own structure, the inconsistency of binocular display images will gradually become more serious, eventually resulting in the human eye being unable to view AR images normally. Common AR binocular display image inconsistency measurement solutions require special equipment and professional personnel, which cannot be completed by consumers.

[0037] In the relevant technical solution, a binocular camera is placed on the glasses box that matches the AR glasses to detect whether the image is aligned. However, when the glasses are placed in the glasses box, the legs of the glasses are folded, which is inconsistent with the state of the glasses when they are normally used. The measured state cannot fully represent the wearing state, resulting in large deviations in the results and poor accuracy in correcting image deviations. In addition, an additional hardware, the glasses box, is required to complete the calibration function. The glasses box needs to have a complete set of modules with power supply, image acquisition, and computing capabilities. It cannot achieve detection and calibration at any time and must be placed in the glasses box for calibration.

[0038] The basic structure of AR glasses generally includes two parts: the optical engine and the waveguide. The optical waveguide is the lens of the AR glasses, and the optical engine can be on the temples. During the wearing process, the main reason for the inconsistency of binocular images is that the relative spatial position relationship between the optical engine and the optical waveguide changes. When the change occurs, the size and position of the output image of the optical waveguide will deviate from the ideal position, causing the human eye to be unable to combine the images when observing with both eyes.

[0039] Optical waveguides, geometric waveguides, diffraction waveguides and other forms of optical waveguides, in which light propagates in the form of total reflection, take diffraction waveguides as an example.

[0040] Based on the above problems, an embodiment of the present invention provides a glasses image position calibration system, such as Figure 1 As shown, the system includes a test light emitting device 2, an optical engine 3, a waveguide plate 4, an in-coupling grating 5, an out-coupling grating 6 and a controller 1.

[0041] Specifically, the controller 1 controls the light emitted by the test light-emitting device 2 to be coupled into the waveguide plate 4 and vertically transmitted to the outermost optical surface of the optical engine 3 through the diffraction effect of the coupling-in grating 5. The test light-emitting device is installed at the position where the light on the optical axis of the optical engine is totally reflected on the waveguide plate; the outermost optical surface of the optical engine 3 is controlled to reflect and modulate the light diffracted by the coupling-in grating 5, and then coupled into the waveguide plate 4 for total reflection and then introduced into the user's eyes through the coupling-out grating 6 to obtain a first image; the controller 1 controls the light emitted by the optical engine 3 to be coupled into the waveguide plate 4 through the coupling-in grating 5 for total reflection and then introduced into the user's eyes through the coupling-out grating 6 to obtain a second image, so that the user can determine the offset between the first image and the second image; the controller 1 adjusts the image position of the optical engine 3 based on the offset between the first image and the second image determined by the user.

[0042] The embodiment of the present invention takes AR glasses as an example. Figure 2 As shown, the optical engine 3 can be installed on the temple of the glasses, and the coupling-in grating 5 and the coupling-out grating 6 are on the other side of the waveguide plate 4, wherein the waveguide plate is an optical waveguide, and the light emitted by the optical engine 3 enters the waveguide plate 4 through the coupling-in grating 5 for total reflection propagation, and then is introduced into the user's glasses by the coupling-out grating 6. The installation position of the test light-emitting device 2 is not limited, and can be installed at the position where the total reflection occurs on the waveguide plate 4 or at the edge of the waveguide plate 4, such as Figure 3 As shown, taking AF as an example, as long as the optical engine 3 is parallel to the waveguide 4, the light emitted by the test light-emitting device 2 is modulated into parallel light through the outermost optical surface of the optical engine 3 and coupled into the waveguide 4 at an angle parallel to the optical axis of the optical engine 3.

[0043] In the embodiment of the present invention, when the optical engine 3 and the waveguide plate 4 are at a parallel angle, that is, the light generated by the optical engine 3 displays an image normally, as shown in FIG. Figure 2 As shown, the aperture light emitted by the test light-emitting device 2 is coupled into the waveguide plate 4 from the position where the total reflection occurs on the waveguide plate 4, and after being diffracted by the coupled-in grating 5, it can be transmitted to the outermost optical surface of the optical engine 3 in a direction perpendicular to the waveguide plate 4. After the light emitted by the coupled-in grating 5 is reflected by the outermost optical surface of the optical engine 3 and modulated into parallel light, it is re-coupled into the waveguide plate 4 as collimated light parallel to the optical axis of the optical engine 3 for propagation, so that the human eye receives the image obtained by the light emitted by the test light-emitting device 2, wherein the image obtained by controlling the light emitted by the light-emitting device and the image obtained by the light emitted by the optical engine can be one or more of a black and white stripe image, a grayscale image, a black background image or a white background image, which is not limited and is only used as an example.

[0044] While controlling the test light emitting device 2 to emit light, the optical engine 3 can be controlled to emit light that is coupled into the waveguide 4 through the coupling-in grating 5 for total reflection and then introduced into the user's eyes through the coupling-out grating 6 to obtain an image. When the optical engine 3 and the waveguide 4 are at a parallel angle, that is, the light generated by the optical engine 3 is displayed normally, the image obtained by the light emitted by the test light emitting device 2 and the image obtained by the light emitted by the optical engine 3 are in a superimposed relationship, such as Figure 2 As shown, the bold dotted line is the light emitted by the test light emitting device 2 coupled into the waveguide 4, which can be transmitted to the outermost surface of the optical engine 3 in a direction perpendicular to the waveguide 4 through the diffraction effect of the coupled-in grating 5. The thin dotted line indicates that the light emitted by the coupled-in grating 5 is reflected by the outermost optical surface of the optical engine 3 and modulated into parallel light, and then re-coupled into the waveguide 4 for propagation as collimated light parallel to the optical axis of the optical engine 3. The straight black line indicates that the light emitted by the optical engine 3 is coupled into the waveguide 4 through the coupled-in grating 5 for total reflection and then introduced into the user's eyes by the coupled-out grating 6 to obtain an image. In actual applications, the three lines are overlapping lines, which are only used as an example.

[0045] In the embodiment of the present invention, when the relative positions of the optical engine 3 and the waveguide plate 4 change slightly, that is, an angle appears between the optical engine 3 and the waveguide plate 4, as shown in FIG. Figure 4 As shown, an angle of α appears between the optical engine 3 and the waveguide plate 4, and an angle of α appears correspondingly between the optical axis of the optical engine 3 and the waveguide plate 4. The light emitted by the test light-emitting device 2 is coupled into the waveguide plate 4 and is diffracted by the coupling-in grating 5 and is transmitted to the outermost optical surface of the optical engine 3 in a direction perpendicular to the waveguide plate 4. At this time, the light diffracted by the coupling-in light device undergoes an angle change of 2α after being reflected by the outermost optical surface. The light is then coupled into the waveguide plate 4 and the image obtained by the coupling-out grating 6 is an image that undergoes an angle change of 2α. This is only taken as an example.

[0046] While controlling the test light-emitting device 2 to emit light, the optical engine 3 can be controlled to emit light. Since the angle α between the optical engine 3 and the waveguide 4 changes, the angle α between the light emitted by the optical engine 3 and the waveguide 4 also changes. The image obtained by coupling into the waveguide 4 and passing through the out-coupling grating 6 is an image with an α-angle change. Therefore, the amount of change in the angle α between the image displayed by the light emitted by the optical engine 3 and the image displayed by the light emitted by the test light-emitting device 2 is completely equal to the trend of the amount of change in the angle α between the optical engine 3 and the waveguide 4.

[0047] The user can determine the offset between the image displayed by the light emitted by the optical engine 3 and the image displayed by the light emitted by the test light-emitting device 2. The user can input the determined offset between the two images into the feedback record box, wherein the feedback record box can be communicated between a device such as a mobile phone and the AR glasses. The user inputs the offset between the two images through the mobile phone, or directly enters the offset in the AR glasses. For example only, the offset can be a number, or the user can directly take screenshots of the two images and feed the screenshots back to the feedback record box. After responding to the offset input by the user, the image display position of the optical engine 3 can be adjusted according to the offset, thereby completing the calibration of the binocular image consistency.

[0048] Specifically, the test light-emitting device 2 includes a light source 21 and an optical lens 22 , wherein the light emitted by the light source 21 is projected by the optical lens 22 to obtain aperture light.

[0049] like Figure 5 As shown, the test light-emitting device 2 in the embodiment of the present invention may include a light source 21 and an optical lens 22. The light source 21 may be an LED, a laser or other light-emitting / display chip, etc., without limitation, as long as it can emit collimated light or aperture light with a certain divergence angle. The optical lens 22 is a lens designed jointly with the outermost surface of the optical engine 3, so that the light emitted by the light source 21 can form parallel light and enter the waveguide 4 after being transmitted by the optical lens 22 and reflected by the outermost surface of the optical engine 3.

[0050] Specifically, the first image is a point image, and the second image is a grid line image. The grid line image includes coordinate points of horizontal and vertical lines, so that the user can determine the offset between the first image and the second image based on the values ​​of the coordinate points.

[0051] like Figure 6 As shown, the optical engine image is a grid line diagram, and the light source image is a point diagram. When the optical engine 3 and the waveguide plate 4 are at a parallel angle, that is, the light generated by the optical engine 3 is displayed normally, the light source image is in the center of the optical engine image. This is just an example.

[0052] like Figure 7 As shown, when the relative positions of the optical engine 3 and the waveguide plate 4 change slightly, that is, an angle appears between the optical engine 3 and the waveguide plate 4, the light source image is not in the exact center of the optical engine image, resulting in an offset.

[0053] The embodiment of the present invention can add coordinate points of horizontal and vertical lines in the image displayed by the light emitted by the optical engine 3, so that the user can read the coordinate value of the light source image and the coordinate value of the center of the optical engine image, and determine the offset between the two coordinate values. The user can input the offset between the two determined coordinate values ​​into the feedback record box, and adjust the display position of the optical engine image by the degree of deviation represented by each calibrated coordinate.

[0054] Specifically, the viewing angle of the image emitted by the test light emitting device 2 is smaller than the viewing angle of the image emitted by the optical engine 3 .

[0055] The size of the field of view angle of the embodiment of the present invention determines the field of view of the optical instrument, and limits the field of view angle of the image emitted by the test light-emitting device 2 to be smaller than the field of view angle of the image emitted by the optical engine 3, thereby ensuring that the human eye can see the image emitted by the test light-emitting device 2, and then the offset of the image can be determined.

[0056] Specifically, the outermost optical surface of the optical engine 3 is not coated or is partially coated with a reflective film, which can increase the reflectivity.

[0057] The partial reflective film in the embodiment of the present invention may be a semi-reflective and semi-transmissive film, which is not limited and is only taken as an example.

[0058] The eyeglass image position correction system provided by the present invention adds a test light-emitting device, controls the light emitted by the test light-emitting device to be coupled into a waveguide plate, and then vertically transmitted to the outermost surface of the optical engine after the diffraction effect of the coupled grating, so that the outermost surface of the optical engine reflects and modulates the transmitted light and then couples it into the waveguide plate to obtain a first image, and then determines the offset with the second image corresponding to the optical engine. It can be realized that when the user wears glasses, the consistency of the binocular display image can be judged in real time, so as to correct the binocular image display difference at any time, meet the user's normal wearing needs, avoid affecting the user's health, and use a set of hardware system to complete this function.

[0059] According to an embodiment of the present invention, an embodiment of a method for calibrating the image position of glasses is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0060] In this embodiment, a glasses image position calibration method is provided, which can be used in the above-mentioned glasses image position calibration system. Figure 8 is a flow chart of a method for calibrating the position of glasses images according to an embodiment of the present invention. Figure 8 As shown, the process includes the following steps:

[0061] Step S801, controlling the light emitted by the test light emitting device to be coupled into the waveguide plate and vertically transmitted to the outermost optical surface of the optical engine through the diffraction effect of the coupled grating.

[0062] The test light emitting device is installed at a position where the light on the optical axis of the optical engine is totally reflected on the waveguide.

[0063] In response to the user putting on the AR glasses and turning on the AR glasses, the embodiment of the present invention controls the light emitted by the test light-emitting device to be coupled into the waveguide and vertically transmitted to the outermost surface of the optical engine through the diffraction effect of the coupled grating.

[0064] Step S802, controlling the outermost optical surface of the optical engine to reflect and modulate the light diffracted by the coupled-in grating, and then coupling it into the waveguide for total reflection and then introducing it into the user's eyes through the coupled-out grating to obtain a first image.

[0065] The outermost optical surface of the optical engine in the embodiment of the present invention receives the light transmitted by the coupling-in grating and performs reflection modulation, and can couple the reflected modulated light into the waveguide for total reflection, and then guide it into the user's eyes through the coupling-out grating to obtain an image displayed by the light emitted by the test light-emitting device.

[0066] Step S803, controlling the light emitted by the optical engine to be coupled into the waveguide through the coupling-in grating for total reflection and then introduced into the user's eyes through the coupling-out grating to obtain a second image, so that the user can determine the offset between the first image and the second image.

[0067] The embodiment of the present invention can control the light emitted by the optical engine to be coupled into the waveguide by the coupling-in grating for total reflection and then introduced into the user's eyes through the coupling-out grating to obtain an image displayed by the light emitted by the optical engine. When the optical engine and the waveguide are at a parallel angle, that is, the light display generated by the optical engine is normal, the image obtained by the light emitted by the test light-emitting device and the image obtained by the light emitted by the optical engine are overlapped, so the user can judge whether there is an offset between the two images and then determine the offset.

[0068] Step S804: adjusting the optical engine image position based on the offset between the first image and the second image determined by the user.

[0069] In the embodiment of the present invention, the user can input the determined offset into the mobile phone device end connected to the AR glasses, and the device end feeds back the offset to the AR glasses to adjust the optical engine image position. The user can also directly input the offset into a specific feedback record box in the AR glasses. After the AR glasses respond to the offset, they can adjust the optical engine image position based on the offset. This is not limited and is only used as an example.

[0070] In one implementation, step S804 includes:

[0071] Step S8041, determining whether the offset between the first image and the second image determined by the user is greater than a preset offset threshold.

[0072] Step S8042: If the determined offset is greater than a preset offset threshold, the optical engine image display position is adjusted based on the offset.

[0073] Step S8043: If the determined offset is not greater than the preset offset threshold, the optical engine displays the image.

[0074] After responding to the offset input by the user, the embodiment of the present invention can determine whether the offset is greater than a preset offset threshold, wherein the offset threshold is not limited and can be set according to the accuracy requirements and cost requirements of the position calibration. For example, if you want to ensure the accuracy of the optical engine display image in real time, you can set the offset threshold to zero. For example, if it is determined that the offset is greater than the preset offset threshold, the optical engine display position can be adjusted based on the offset. If it is determined that the offset is not greater than the preset offset threshold, no adjustment is required and the screen of the optical engine display image can be directly entered.

[0075] In a specific embodiment, Fig. 9 As shown, in response to the user fully wearing the AR glasses and the AR glasses are in the power-on state, or the AR glasses are in the calibration state, the optical engine is controlled to display the calibration image, and the light source is controlled to display the calibration image. The user makes a visual consistency judgment based on the two calibration images. If the two calibration images are judged to be inconsistent, the user can visually read the offset and input the offset into the AR eyes. The host, i.e., the controller, controls the display position of the optical engine and repeats the step of controlling the optical engine to display the calibration image. If the two calibration images are judged to be consistent, the power-on screen can be directly entered and the AR glasses can be started. For detailed description, please refer to the above embodiment, which will not be repeated here.

[0076] The existing solution for calibrating AR glasses requires a corresponding glasses box, and the glasses box also needs to be equipped with a binocular camera to detect whether the image is calibrated. Therefore, the existing solution requires additional hardware - the glasses box to complete the calibration function, and it needs to be placed in the glasses box for calibration. When the glasses are placed in the glasses box, the temples are in a state of folded, which is inconsistent with the state of the glasses when they are normally used. The measured state cannot fully represent the wearing state, resulting in a large deviation in the results and poor accuracy in correcting image deviations. However, this solution only requires glasses, that is, a set of hardware systems, to complete the AR glasses calibration function, and the calibration can be completed after wearing them, avoiding the difference between wearing and not wearing. This difference may cause accurate calibration when not worn, but after wearing, the image does not match due to stress on the temples.

[0077] In this embodiment, an AR glasses is also provided. Fig.10 As shown, the AR glasses include the glasses image position calibration system of the above embodiment.

[0078] In this embodiment, a glasses image position calibration device is also provided, which is used to implement the above embodiments and preferred implementations, and will not be repeated here. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the device described in the following embodiments is preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0079] This embodiment provides a glasses image position calibration device, such as Fig.11 As shown, including:

[0080] The test light control module 1101 is used to control the light emitted by the test light emitting device to be coupled into the waveguide and vertically transmitted to the outermost optical surface of the optical engine through the diffraction effect of the coupled grating. The test light emitting device is installed at the position where the light on the optical axis of the optical engine is totally reflected on the waveguide;

[0081] The first image determination module 1102 is used to control the outermost optical surface of the optical engine to reflect and modulate the light diffracted by the coupled-in grating, couple it into the waveguide for total reflection, and then introduce it into the human eye through the coupled-out grating to obtain a first image;

[0082] The second image determination module 1103 is used to control the light emitted by the optical engine to be coupled into the waveguide through the coupling grating for total reflection and then introduced into the human eye through the coupling grating to obtain a second image, so that the user can determine the offset between the first image and the second image;

[0083] The image position adjustment module 1104 is used to adjust the optical engine image position based on the offset between the first image and the second image determined by the user.

[0084] In some optional implementations, the image position adjustment module 1104 includes:

[0085] An offset determination unit, used to determine whether the offset between the first image and the second image determined by the user is greater than a preset offset threshold;

[0086] A position adjustment unit, configured to adjust the optical engine image display position based on the offset if the determined offset is greater than a preset offset threshold;

[0087] The calibration pass unit is used to enter the picture of the optical engine displaying the image if the determined offset is not greater than a preset offset threshold.

[0088] The further functional description of each of the above modules and units is the same as that of the above corresponding embodiments and will not be repeated here.

[0089] The glasses image position calibration device in this embodiment is presented in the form of a functional unit, where the unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and memory that executes one or more software or fixed programs, and / or other devices that can provide the above functions.

[0090] The embodiment of the present invention also provides an electronic device having the above Fig.11 The glasses image position calibration device shown.

[0091] See also Fig.12 , Fig.12 is a schematic diagram of the structure of an electronic device provided by an optional embodiment of the present invention, such as Fig.12 As shown, the electronic device includes: one or more processors 10, a memory 20, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. The various components are connected to each other using different buses for communication, and can be installed on a common mainboard or installed in other ways as needed. The processor can process instructions executed in the electronic device, including instructions stored in or on the memory to display graphical information of the GUI on an external input / output device (such as a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple electronic devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Fig.12 A processor 10 is taken as an example.

[0092] The processor 10 may be a central processing unit, a network processor or a combination thereof. The processor 10 may further include a hardware chip. The hardware chip may be a dedicated integrated circuit, a programmable logic device or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic or any combination thereof.

[0093] The memory 20 stores instructions executable by at least one processor 10, so that at least one processor 10 executes the method shown in the above embodiment.

[0094] The memory 20 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 20 may optionally include a memory remotely arranged relative to the processor 10, and these remote memories may be connected to the electronic device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0095] The memory 20 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid state drive; the memory 20 may also include a combination of the above types of memory.

[0096] The electronic device further includes an input device 30 and an output device 40. The processor 10, the memory 20, the input device 30 and the output device 40 may be connected via a bus or other means. Fig.12 The example of connecting through bus is taken in the following.

[0097] The input device 30 can receive input digital or character information, and generate signal input related to the user settings and function control of the electronic device, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, an indicator bar, one or more mouse buttons, a trackball, a joystick, etc. The output device 40 may include a display device, an auxiliary lighting device (e.g., an LED) and a tactile feedback device (e.g., a vibration motor), etc. The above-mentioned display device includes but is not limited to a liquid crystal display, a light emitting diode, a display and a plasma display. In some optional embodiments, the display device can be a touch screen.

[0098] The embodiment of the present invention also provides a computer-readable storage medium. The method according to the embodiment of the present invention can be implemented in hardware, firmware, or can be implemented as a computer code that can be recorded in a storage medium, or can be implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and will be stored in a local storage medium through a network download, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state hard disk, etc.; further, the storage medium can also include a combination of the above types of memories. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor, or hardware, the method shown in the above embodiment is implemented.

[0099] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A glasses image position calibration system, characterized in that: The system comprises: a test light emitting device, an optical engine, a waveguide, an incoupling grating, an outcoupling grating and a controller, wherein: The controller controls the light emitted by the test light emitting device to be coupled into the waveguide and vertically transmitted to the outermost optical surface of the optical engine through the diffraction effect of the coupled grating, and the test light emitting device is installed at the position where the light on the optical axis of the optical engine is totally reflected on the waveguide; The outermost optical surface of the optical engine is controlled to reflect and modulate the light diffracted by the coupled-in grating, and then coupled into the waveguide for total reflection, and then introduced into the user's eyes through the coupled-out grating to obtain a first image; The controller controls the light emitted by the optical engine to be coupled into the waveguide plate through the coupling-in grating for total reflection and then guided into the user's eyes through the coupling-out grating to obtain a second image, so that the user can determine the offset between the first image and the second image; The controller adjusts the optical engine image position based on an offset of the first image and the second image determined by a user.

2. The system according to claim 1, characterized in that The test light-emitting device comprises a light source and an optical lens, wherein the light emitted by the light source is projected through the optical lens to obtain aperture light.

3. The system according to claim 1, characterized in that The viewing angle of the image emitted by the test light emitting device is smaller than the viewing angle of the image emitted by the optical engine.

4. The system according to claim 1, characterized in that The outermost optical surface of the optical engine is not coated or is coated with a partial reflective film.

5. The system according to claim 1, characterized in that The first image is a point image, and the second image is a grid line image. The grid line image includes coordinate points of horizontal and vertical lines, so that a user can determine the offset between the first image and the second image based on the values ​​of the coordinate points.

6. A method for calibrating the position of glasses images, characterized in that: Applied to the glasses image position calibration system according to claims 1 to 5, the method comprises: Control the light emitted by the test light emitting device to be coupled into the waveguide and vertically transmitted to the outermost optical surface of the optical engine through the diffraction effect of the coupled grating, wherein the test light emitting device is installed at a position where the light on the optical axis of the optical engine is totally reflected on the waveguide; The outermost optical surface of the optical engine is controlled to reflect and modulate the light diffracted by the coupled-in grating, and then coupled into the waveguide for total reflection, and then introduced into the user's eyes through the coupled-out grating to obtain a first image; Control the light emitted by the optical engine to be coupled into the waveguide through the coupling-in grating for total reflection and then be introduced into the user's eyes through the coupling-out grating to obtain a second image, so that the user can determine the offset between the first image and the second image; The optical engine image position is adjusted based on an offset between the first image and the second image determined by a user.

7. The method according to claim 6, characterized in that The adjusting the optical engine image position based on the offset between the first image and the second image determined by the user comprises: Determining whether the offset between the first image and the second image determined by the user is greater than a preset offset threshold; If the determined offset is greater than a preset offset threshold, adjusting the optical engine image display position based on the offset; If the determined offset is not greater than the preset offset threshold, the optical engine displays the image.

8. A glasses image position calibration device, characterized in that: The device comprises: A test light control module, used to control the light emitted by the test light emitting device to be coupled into the waveguide and vertically transmitted to the outermost optical surface of the optical engine through the diffraction effect of the coupled grating, wherein the test light emitting device is installed at a position where the light on the optical axis of the optical engine is totally reflected on the waveguide; A first image determination module is used to control the outermost optical surface of the optical engine to reflect and modulate the light diffracted by the coupled-in grating, couple it into the waveguide for total reflection, and then introduce it into the human eye through the coupled-out grating to obtain a first image; A second image determination module, used to control the light emitted by the optical engine to be coupled into the waveguide through the coupling grating for total reflection and then introduced into the human eye through the coupling grating to obtain a second image, so that the user can determine the offset between the first image and the second image; The image position adjustment module is used to adjust the optical engine image position based on the offset of the first image and the second image determined by the user.

9. An AR glasses, characterized in that: The AR glasses include the glasses image position calibration system according to any one of claims 1-5.

10. An electronic device, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the glasses image position calibration method according to any one of claims 6 to 7 by executing the computer instructions.

Images