Intelligent glasses, image combination distance adjusting method and storage medium

Abstract

The embodiment of the invention discloses intelligent glasses, an image combination distance adjustment method and a storage medium, and the method comprises the steps: obtaining a current sight focus point of a user, determining a target image combination distance according to the current sight focus point, determining an adjustment parameter according to the target image combination distance and information related to the current image combination distance, and adjusting the image combination distance according to the adjustment parameter. The image combination distance of the left light machine and the right light machine is adjusted at least by controlling the first display area of the left micro-display to move and the second display area of the right micro-display to move, so that the display position of the target image in the visual field of the user corresponds to the current sight focus point of the user. Therefore, the dynamic adjustment of the image combination distance is realized, and the user experience is ensured.

Description

Technical Field

[0001] The present invention relates to the technical field of smart wearable devices, and more particularly, to a smart glasses, a method for adjusting the combined image distance, and a storage medium. Background Art

[0002] In recent years, with the rapid development of augmented reality (AR) and virtual reality (VR) technologies, smart glasses have gradually become an important carrier for human-computer interaction. In a near-eye display system, the ability to adjust the combined image distance (i.e., the focusing distance between the virtual image and the user's eyes) directly affects the visual comfort and immersion experience of the user. Traditional smart glasses usually adopt a fixed focal length optical design, making the virtual image appear at a preset distance. However, different users or application scenarios (such as near-distance reading, far-distance navigation) require dynamic adjustment of the combined image distance. Otherwise, it is easy to cause visual fatigue or even dizziness for the user. Summary of the Invention

[0003] In view of this, embodiments of the present invention provide a smart glasses, a method for adjusting the combined image distance, and a storage medium, which are beneficial to improving at least some of the above problems existing in the prior art.

[0004] In a first aspect, an embodiment of the present invention provides a smart glasses, including a glasses body, an optical engine, and a control circuit; the glasses body has a waveguide; the optical engine is disposed on the glasses body, the optical engine includes a left optical engine and a right optical engine, the left optical engine includes a left microdisplay, and the right optical engine includes a right microdisplay; the control circuit is electrically connected to the optical engine, and the control circuit is configured to: control the imaging light emitted by the optical engine to be coupled into the waveguide, so that the imaging light is coupled out through the reflection of the waveguide into the user's eyes to form a target image, the left microdisplay has a first display area corresponding to the target image, and the right microdisplay has a second display area corresponding to the target image; obtain the current line-of-sight focus point of the user; determine a target combined image distance according to the current line-of-sight focus point; determine an adjustment parameter according to the target combined image distance and information related to the current combined image distance; and adjust the combined image distance between the left optical engine and the right optical engine according to the adjustment parameter, so that the display position of the target image in the user's field of view corresponds to the current line-of-sight focus point of the user; wherein, adjusting the combined image distance between the left optical engine and the right optical engine includes: controlling the movement of the first display area of the left microdisplay and the movement of the second display area of the right microdisplay.

[0005] Further, determining the adjustment parameter according to the target combined image distance and the information related to the current combined image distance includes: determining the target position of the first display area and the target position of the second display area according to the target combined image distance; determining a first movement parameter of the first display area according to the target position of the first display area and the current position of the first display area, the adjustment parameter includes the first movement parameter, and the information related to the current combined image distance includes the current position of the first display area; and determining a second movement parameter of the second display area according to the target position of the second display area and the current position of the second display area, the adjustment parameter includes the second movement parameter, and the information related to the current combined image distance includes the current position of the second display area; adjusting the combined image distance between the left optical engine and the right optical engine according to the adjustment parameter includes: controlling the first display area of the left microdisplay to move according to the first movement parameter, and controlling the second display area of the right microdisplay to move according to the second movement parameter.

[0006] Further, the first movement parameter includes a first movement direction and a first number of movement pixels, and the target position of the first display area is further determined according to the total display range of the left microdisplay; the second movement parameter includes a second movement direction and a second number of movement pixels, and the target position of the second display area is further determined according to the total display range of the right microdisplay.

[0007] Further, the smart glasses further include an optical engine driving component, electrically connected to the control circuit and connected to the optical engine; the optical engine is disposed on the glasses body in a manner that can rotate relative to the waveguide through the optical engine driving component; wherein, determining the adjustment parameter according to the target combined image distance and the information related to the current combined image distance includes: determining a first target angle of the left optical engine and a second target angle of the right optical engine according to the target combined image distance; determining a first adjustment angle according to the first target angle and the current angle of the left optical engine, the adjustment parameter includes the first adjustment angle, and the information related to the current combined image distance includes the current angle of the left optical engine; and determining a second adjustment angle according to the second target angle and the current angle of the right optical engine, the adjustment parameter includes the second adjustment angle, and the information related to the current combined image distance includes the current angle of the right optical engine; adjusting the combined image distance between the left optical engine and the right optical engine according to the adjustment parameter includes: controlling the optical engine driving component to drive the left optical engine to rotate according to the first adjustment angle, and driving the right optical engine to rotate according to the second adjustment angle.

[0008] Further, the adjustment parameter is further determined according to the user's pupil distance and the horizontal field of view angle of the optical engine.

[0009] Further, the left optical machine further includes a left lens group, and the right optical machine further includes a right microdisplay and a right lens group; adjusting the image combining distance between the left optical machine and the right optical machine includes: adjusting the position of the left microdisplay and / or the position of the right microdisplay to adjust the image combining distance; and / or adjusting the position of the left lens group and / or the position of the right lens group to adjust the image combining distance.

[0010] Further, the smart glasses further include an eye movement tracking component, which is disposed on the glasses body and electrically connected to the control circuit, and the eye movement tracking component is configured to detect the eye movement information and the line-of-sight focus point of the user; the control circuit is further configured to obtain the current line-of-sight focus point through the eye movement tracking component.

[0011] In a second aspect, an embodiment of the present invention provides an image combining distance adjustment method, including the following steps: controlling the imaging light emitted by the optical machine to be coupled into the waveguide sheet, so that the imaging light is coupled out through the reflection of the waveguide sheet into the user's eyes to form a target image, where the optical machine includes a left optical machine and a right optical machine; obtaining the current line-of-sight focus point of the user; determining a target image combining distance according to the current line-of-sight focus point; determining an adjustment parameter according to the target image combining distance and information related to the current image combining distance; and adjusting the image combining distance between the left optical machine and the right optical machine according to the adjustment parameter, so that the display position of the target image in the user's field of view corresponds to the current line-of-sight focus point of the user; where adjusting the image combining distance between the left optical machine and the right optical machine includes: controlling the movement of the first display area of the left microdisplay and the movement of the second display area of the right microdisplay.

[0012] Further, determining the adjustment parameter according to the target image combining distance and information related to the current image combining distance includes: determining the target position of the first display area and the target position of the second display area according to the target image combining distance; determining a first movement parameter of the first display area according to the target position and the current position of the first display area, the adjustment parameter includes the first movement parameter, and the information related to the current image combining distance includes the current position of the first display area; and determining a second movement parameter of the second display area according to the target position and the current position of the second display area, the adjustment parameter includes the second movement parameter, and the information related to the current image combining distance includes the current position of the second display area; adjusting the image combining distance between the left optical machine and the right optical machine according to the adjustment parameter includes: controlling the movement of the first display area of the left microdisplay according to the first movement parameter, and controlling the movement of the second display area of the right microdisplay according to the second movement parameter.

[0013] Further, the first movement parameter includes a first movement direction and a first number of movement pixels, and the target position of the first display area is further determined according to the total display range of the left microdisplay; the second movement parameter includes a second movement direction and a second number of movement pixels, and the target position of the second display area is further determined according to the total display range of the right microdisplay.

[0014] Further, the determining the adjustment parameter according to the target imaging distance and the current imaging distance between the left optical engine and the right optical engine includes: determining a first target angle of the left optical engine and a second target angle of the right optical engine according to the target imaging distance; determining a first adjustment angle according to the first target angle and the current angle of the left optical engine, the adjustment parameter includes the first adjustment angle, and the information related to the current imaging distance includes the current angle of the left optical engine; and determining a second adjustment angle according to the second target angle and the current angle of the right optical engine, the adjustment parameter includes the second adjustment angle, and the information related to the current imaging distance includes the current angle of the right optical engine; the adjusting the imaging distance between the left optical engine and the right optical engine according to the adjustment parameter includes: controlling the optical engine driving component to drive the left optical engine to rotate according to the first adjustment angle, and driving the right optical engine to rotate according to the second adjustment angle.

[0015] Further, the adjusting the imaging distance between the left optical engine and the right optical engine includes: adjusting the position of the left microdisplay and / or the position of the right microdisplay to adjust the imaging distance; and / or adjusting the position of the left lens group and / or the position of the right lens group to adjust the imaging distance, where the left optical engine includes the left lens group and the right optical engine includes the right lens group.

[0016] In a third aspect, an embodiment of the present invention provides a computer-readable storage medium, on which computer program instructions are stored, and when the computer program is executed by a processor, the imaging distance control method as described in the second aspect is implemented.

[0017] In a fourth aspect, an embodiment of the present invention further provides a kind of including instructions, when the instructions run on the smart glasses, the smart glasses are enabled to execute the method as described in the second aspect.

[0018] An embodiment of the present invention provides a smart glasses, a method for adjusting the combined image distance, and a storage medium. By obtaining the current sight focus point of the user and determining the target combined image distance according to the current sight focus point, then determining the adjustment parameter according to the target combined image distance and the information related to the current combined image distance, and according to the adjustment parameter, adjusting the combined image distance between the left optical engine and the right optical engine at least by controlling the movement of the first display area of the left microdisplay and the movement of the second display area of the right microdisplay, so that the display position of the target image in the user's field of view corresponds to the current sight focus point of the user, thereby realizing the dynamic adjustment of the combined image distance and ensuring the user experience. Description of the Drawings

[0019] Through the following description of the embodiments of the present invention with reference to the drawings, the above and other objects, features, and advantages of the present invention will become clearer. In the drawings:

[0020] Figure 1 is a schematic structural diagram of a smart glasses according to an embodiment of the present invention;

[0021] Figure 2 is a schematic block diagram of a smart glasses according to an embodiment of the present invention;

[0022] Figure 3 is a detection schematic diagram of an eye movement tracking component of a smart glasses according to an embodiment of the present invention;

[0023] Figure 4 is a detection optical path schematic diagram of an eye movement tracking component of a smart glasses according to an embodiment of the present invention;

[0024] Figure 5 is a movement schematic diagram of the first display area of a smart glasses according to an embodiment of the present invention;

[0025] Figure 6 is a schematic diagram of a moving display area of a smart glasses according to an embodiment of the present invention;

[0026] Figure 7 is a schematic flowchart of a method for adjusting the combined image distance according to an embodiment of the present invention;

[0027] Figure 8 is a schematic flowchart of determining the adjustment parameter and adjusting the combined image distance according to the adjustment parameter according to an embodiment of the present invention;

[0028] Figure 9 is a schematic flowchart of determining the adjustment parameter and adjusting the combined image distance according to the adjustment parameter according to another embodiment of the present invention. Detailed Embodiments

[0029] The present application will be described based on embodiments, but the present application is not limited to these embodiments. In the following detailed description of the present application, some specific details are described in detail. Those skilled in the art can fully understand the present application without the description of these details. In order to avoid obscuring the essence of the present application, well-known methods, processes, procedures, components, and circuits are not described in detail.

[0030] In addition, those of ordinary skill in the art should understand that the accompanying drawings provided herein are for illustrative purposes only, and the drawings are not necessarily drawn to scale.

[0031] Unless the context clearly requires otherwise, words such as "including" and "comprising" in the entire application document should be interpreted in an inclusive sense rather than an exclusive or exhaustive sense; that is, in the sense of "including but not limited to".

[0032] In the description of the present application, it should be understood that terms such as "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In addition, in the description of the present application, unless otherwise specified, the meaning of "a plurality" is two or more.

[0033] In the solutions described in this specification and the embodiments, if personal information processing is involved, it will be processed on the premise of having a legal basis (such as obtaining the consent of the personal information subject, or being necessary for performing a contract, etc.), and will only be processed within the specified or agreed scope. If the user refuses to process personal information other than the necessary information required for the basic functions, it will not affect the user's use of the basic functions.

[0034] One aspect of the embodiments of the present invention provides a smart glasses, which may be a virtual reality (VR) glasses, an augmented reality (AR) glasses, or a mixed reality (MR) glasses. Referring to Figures 1-6 , the smart glasses include a glasses body 10, an optical engine 20, and a control circuit 30. The optical engine 20 is disposed in the glasses body 10, and the control circuit 30 is electrically connected to the optical engine 20 to control the operation of the optical engine 20.

[0035] The glasses body 10 has a waveguide sheet 11 for realizing efficient transmission and coupling out of virtual images. The waveguide sheet 11 is a flat optical element based on a transparent substrate (such as glass or polymer material), and a diffraction grating (such as a surface relief grating SRG or a volume holographic grating VHG, etc.) or a geometric reflection structure is integrated inside or on its surface. The control circuit 30 can control the imaging light emitted by the optical engine 20 to be coupled into the waveguide sheet 11. The waveguide sheet 11 conducts the imaging light from the optical engine 20 inside the waveguide sheet 11 through the principle of total reflection, so that the imaging light is coupled out to the user's eyes E after reflection by the waveguide sheet 11 to form a target image. The waveguide sheet 11 may include an input region, an expansion region, and an output region. The input region is located at the edge of the waveguide sheet 11, and the imaging light emitted by the optical engine 20 is coupled into the waveguide interior at a specific angle through a nano-scale grating or prism structure. The expansion region replicates and expands the imaging light horizontally or vertically. The output region couples out the expanded light beam to the human eye with uniform brightness to form a virtual image. Optionally, the waveguide sheet 11 may include a left waveguide sheet 11 corresponding to the user's left eye and a right waveguide sheet 11 corresponding to the user's right eye.

[0036] The optical engine 20, as the core display module, is used to generate high-definition virtual images and project them into the waveguide sheet 11. In this embodiment, the optical engine 20 may include a left optical engine 21 corresponding to the left waveguide sheet 11 and a right optical engine 22 corresponding to the right waveguide sheet 11. Each optical engine 20 may respectively include a display chip and a lens group. The display chip generates a high-resolution image through pixel-level modulation. The projection lens group may be composed of multiple aspherical lenses or free-form lenses, and is used to relay the image plane of the display chip to the input region of the waveguide sheet 11. The display chip may include liquid crystal on silicon, digital micromirror, or microdisplay. In this embodiment, the display chip may adopt a microdisplay. The control circuit 30 controls the left optical engine 21 and the right optical engine 22 to emit imaging light and couple it into the corresponding waveguide sheet 11. According to actual needs, the optical engine 20 may also include structures such as a light source and a lens focusing component to realize the function of projecting virtual images onto the waveguide sheet 11.

[0037] Since the line-of-sight focus points of different users are different, or the line-of-sight focus points of the same user in different application scenarios are different. In this embodiment, the control circuit 30 obtains the current line-of-sight focus point of the user, and then adjusts the image synthesis distance between the left optical engine 21 and the right optical engine 22 according to the line-of-sight focus point of the user, so that the display position of the target image in the user's field of view corresponds to the current line-of-sight focus point of the user, providing a better visual effect for the user. In some embodiments, after obtaining the current line-of-sight focus point of the user, the control circuit 30 determines the target image synthesis distance according to the current line-of-sight focus point, and then determines the adjustment parameter for adjusting the image synthesis distance between the left optical engine 21 and the right optical engine 22 according to the target image synthesis distance and the information related to the current image synthesis distance between the left optical engine 21 and the right optical engine 22. In this embodiment, the current line-of-sight focus point of the user can be on the middle plane of the smart glasses. The ideal image synthesis distance between the left optical engine 21 and the right optical engine 22 (i.e., the target image synthesis distance in the embodiment of the present invention) is the perpendicular distance from the current line-of-sight focus point to the line connecting the user's two eyes. When the image synthesis distance is adjusted to the target image synthesis distance, the virtual image output by the optical engine 20 falls on the plane where the current line-of-sight focus point of the user is located, improving the user's viewing experience.

[0038] In some embodiments, the smart glasses further include an eye movement tracking component 50, which is disposed on the glasses body 10 and electrically connected to the control circuit 30. The eye movement tracking component 50 is used to dynamically detect the eye movement state and the fixation point position of the user, so as to provide dynamic feedback control for image synthesis distance adjustment, interactive control and display optimization. The control circuit 30 can obtain the eye movement state and the current line-of-sight focus point of the user through the eye movement tracking component 50.

[0039] In one embodiment, referring to Figures 2-4 , the eye movement tracking component 50 may include an infrared light emitter 51 and a sensing unit 52. The infrared light emitter 51 emits a detection infrared light B, and the detection infrared light B irradiates the surface of the eyeball, and forms a reflected infrared light C through reflection by the cornea and the pupil. The detection infrared light B is invisible light with a wavelength between 850 nm and 940 nm, which can avoid interfering with the user's visual experience. The sensing unit 52 may include an infrared camera. The sensing unit 52 can capture the displacement change of the reflected infrared light C formed by the reflection of the cornea and the pupil, and then enable the processor of the eye movement tracking component 50 to calculate the current line-of-sight focus point of the user based on a specific gaze estimation algorithm. Optionally, at least a part of the eye movement tracking component 50 may be fixed to the waveguide plate 11 or integrated with the waveguide plate 11. For example, referring to Figure 4, the eye movement tracking component 50 can utilize a partial area of the waveguide 11 to detect the infrared light B coupled into the waveguide 11 at a specific angle, so that the detected infrared light B is coupled out to the user's eye E after being reflected by the waveguide 11. Thus, the light transmission for imaging by the optical engine 20 and eye movement tracking can share the waveguide 11, realizing a compact design of the optical path system of the smart glasses, which is beneficial to reducing the volume and weight of the smart glasses.

[0040] In some embodiments, the adjustment of the combined image distance between the left optical engine 21 and the right optical engine 22 can be achieved by adjusting the angle of the optical engine 20. The optical engine 20 is arranged on the glasses body 10 in a manner that can rotate relative to the waveguide 11. By rotating the optical engine 20 to adjust the angle of the optical engine 20, the angle of the imaging light of the optical engine 20 coupled into the coupling area of the waveguide 11 can be adjusted, thereby changing the combined image distance between the left optical engine 21 and the right optical engine 22. In one embodiment, the smart glasses further include an optical engine driving component 40 connected to the optical engine 20, and the control circuit 30 is electrically connected to the optical engine driving component 40 and can control the optical engine driving component 40 to operate to drive the optical engine 20 to rotate relative to the waveguide 11. The optical engine driving component 40 can include a left optical engine driving module connected to the left optical engine 21 and a right optical engine driving module connected to the right optical engine 22. The control circuit 30 can respectively control the left optical engine driving module and the right optical engine driving module to respectively adjust the angles of the left optical engine 21 and the right optical engine 22. The optical engine driving component 40 can adopt a power source such as a motor, a hydraulic driving device, a pneumatic driving device, etc., and a transmission mechanism can also be arranged between the power source and the optical engine 20. The transmission mechanism can transmit the power of the power source to the optical engine 20 through one or more of gear transmission, shaft transmission, chain rotation, belt transmission or other feasible transmission methods, so that the optical engine 20 deflects relative to the waveguide 11.

[0041] Specifically, the control circuit 30 can determine a first target angle of the left optical machine 21 and a second target angle of the right optical machine 22 according to the target combined image distance. The first target angle represents the angle that the left optical machine 21 needs to be adjusted to in order to make the combined image distance match the current line-of-sight focus point of the user; the second target angle represents the angle that the right optical machine 22 needs to be adjusted to in order to make the combined image distance match the current line-of-sight focus point of the user. In this embodiment, the information related to the current combined image distance includes the current angle of the left optical machine 21 and the current angle of the right optical machine 22, and the adjustment parameters include a first adjustment angle for the left optical machine 21 to rotate and a second adjustment angle for the right optical machine 22 to rotate. The control circuit 30 determines the first adjustment angle according to the first target angle and the current angle of the left optical machine 21, and determines the second adjustment angle according to the second target angle and the current angle of the right optical machine 22. Then, the control circuit 30 drives the left optical machine 21 to rotate according to the first adjustment angle by controlling the optical machine driving assembly 40, and drives the right optical machine 22 to rotate according to the second adjustment angle by controlling the optical machine driving assembly 40, so as to adjust the combined image distance between the left optical machine 21 and the right optical machine 22. Optionally, the current line-of-sight focus point of the user can be on the middle plane of the smart glasses, and the driving of the left optical machine 21 to rotate and the right optical machine 22 to rotate by the optical machine driving assembly 40 can be symmetrical with respect to the middle plane of the smart glasses, and the numerical values of the first adjustment angle and the second adjustment angle can be equal.

[0042] Referring to Figure 5 and Figure 6 , the left microdisplay 211 has a first display area 23 corresponding to the target image, and the right microdisplay 221 has a second display area 24 corresponding to the target image. In some embodiments, by moving the position of the first display area 23 on the left microdisplay 211, the relative position between the first display area 23 and the optical axis of the left lens group 212 is changed, and by moving the position of the second display area 24 on the right microdisplay 221, the relative position between the second display area 24 and the optical axis of the right lens group 222 is changed, whereby the combined image distance can be changed. For example, referring to Figure 5 , Figure 5 as shown below, the first display area 23 on the left microdisplay 211 has moved rightward by a distance D1 relative to Figure 5 upward, Figure 5 as shown below, the second display area 24 on the right microdisplay 221 has moved leftward by a distance D2 relative to Figure 5 downward. Referring to Figure 6, taking the right micro display 221 as an example, when the second display area 24 is on the left, the imaging light is A1, and the target image formed by combining with the imaging optical machine 20 of the left optical machine 21 is S1; when the second display area 24 is on the right, the imaging light is A2, and the target image formed by combining with the imaging optical machine 20 of the left optical machine 21 is S2. The combined image distances corresponding to the target image M2 and the target image M1 are different. In one implementation, the control circuit 30 can determine the target positions of the first display area 23 and the second display area 24 according to the target combined image distance. When the positions of the first display area 23 and the second display area 24 are respectively adjusted to the target positions, the combined image distance of the left optical machine 21 and the right optical machine 22 can reach or be closer to the target combined image distance. Determine the first movement parameter of the first display area 23 according to the target position of the first display area 23 and the current position of the first display area 23, and determine the second movement parameter of the second display area 24 according to the target position of the second display area 24 and the current position of the second display area 24. The adjustment parameters include the first movement parameter and the second movement parameter. The control circuit 30 controls the movement of the first display area 23 of the left micro display 211 according to the first movement parameter, and controls the movement of the second display area 24 of the right micro display 221 according to the second movement parameter.

[0043] The first movement parameter includes a first movement direction and a first movement pixel number. The first movement direction represents the movement direction of the first display area 23 from the current position to the target position, and the first movement pixel number represents the number of pixels that the first display area 23 needs to move from the current position to the target position. The second movement parameter includes a second movement direction and a second movement pixel number. The second movement direction represents the movement direction of the second display area 24 from the current position to the target position, and the second movement pixel number represents the number of pixels that the second display area 24 needs to move from the current position to the target position. Similar to the first movement parameter, the second movement parameter includes a second movement direction and a second movement pixel number. Optionally, the first movement direction and the second movement direction are opposite, and the first movement pixel number and the second movement pixel number can be equal. Optionally, the first movement parameter can also be determined according to the total display range of the left micro display 211, and the second movement parameter is also determined according to the total display range of the right micro display 221, so as to prevent the first display area 23 from moving beyond the total display range of the left micro display 211 or the second display area 24 from moving beyond the total display range of the right micro display 221, resulting in incomplete display of the target image.

[0044] In some embodiments, multiple adjustment methods can work together. For example, the positions of the first display area 23 and the second display area 24 can be adjusted simultaneously, and the left optical engine 21 and the right optical engine 22 can be driven to rotate by the optical engine driving assembly 40 at the same time to achieve a faster adjustment of the convergence distance, or a larger adjustment range of the convergence distance can be achieved. The adjustment parameters are also determined according to the user's interpupillary distance and the horizontal field of view angle of the optical engine 20. In this embodiment, the first moving direction and the second moving direction are opposite, the first moving pixel number and the second moving pixel number are equal, the angle values of the first adjustment angle and the second adjustment angle are equal, and the change amount of the convergence distance can be calculated by the following formula:

[0045] L = ipd / (2 * tan(θ * n / w + ρ))

[0046] Wherein, ipd is the user's interpupillary distance, θ is the horizontal field of view angle (fov) of the optical engine 20, w is the total number of horizontal pixels in the display range of the right microdisplay 221, n is the first moving pixel number / the second moving pixel number, and ρ is the angle value of the first adjustment angle / the second adjustment angle.

[0047] In some embodiments, by adjusting the position of the left microdisplay 211 and / or the position of the right microdisplay 221, the relative position between the image of the left microdisplay 211 and the optical axis of the left lens group 212 and / or the relative position between the image of the right microdisplay 221 and the optical axis of the right lens group 222 can be changed, so that the convergence distance between the left optical engine 21 and the right optical engine 22 can be adjusted.

[0048] In some embodiments, the adjustment of the convergence distance can be achieved by adjusting the left lens group 212 and the right lens group 222. In one implementation, the left lens group 212 and the right lens group 222 are set as adjustable focus structures, and the focal lengths of the left lens group 212 and the right lens group 222 can be adjusted by the lens focusing assembly. Optionally, the lens focusing assembly can drive the left lens group 212 to move relative to the left microdisplay 211, and drive the right lens group 222 to move relative to the right microdisplay 221. Thus, the adjustment of the convergence distance can be achieved by adjusting the position of the left lens group 212 and / or the position of the right lens group 222.

[0049] The embodiment of the present invention also provides a method for adjusting the convergence distance, which can be used for dynamically adjusting the convergence distance in smart glasses. In some application scenarios, this method for adjusting the convergence distance can be applied to the smart glasses in at least some of the above embodiments and executed by the control circuit 30 of the smart glasses. Referring to Figure 7 , this method for adjusting the convergence distance includes the following steps S100 to step S500:

[0050] Step S100: Control the imaging light emitted by the optical engine to be coupled into the waveguide sheet, so that the imaging light is coupled out through the reflection of the waveguide sheet into the user's eyes to form a target image.

[0051] Among them, the optical engine 20 includes a left optical engine 21 and a right optical engine 22. The control circuit 30 controls the left optical engine 21 and the right optical engine 22 to respectively emit corresponding imaging light to be coupled into the waveguide sheet 11. The waveguide sheet 11 conducts the imaging light from the optical engine 20 within the waveguide sheet 11 through the total reflection principle, so that the imaging light is coupled out through the reflection of the waveguide sheet 11 into the user's eyes E to form a target image.

[0052] Step S200: Obtain the current gaze focus point of the user.

[0053] In this embodiment, the current gaze focus point of the user can be monitored and obtained through the eye movement tracking component 50 of the smart glasses.

[0054] Step S300: Determine the target convergence distance according to the current gaze focus point.

[0055] Taking the example that the current gaze focus point of the user can be on the middle plane of the smart glasses, the target convergence distance can be equal to the vertical distance from the current gaze focus point to the line connecting the user's two eyes. When the convergence distance is adjusted to the target convergence distance, the virtual image output by the optical engine 20 falls on the plane where the current gaze focus point of the user is located, improving the user's viewing experience.

[0056] Step S400: Determine the adjustment parameter according to the target convergence distance and the information related to the current convergence distance.

[0057] The control circuit 30 determines the gap between the current convergence distance and the target convergence distance according to the target convergence distance and the information related to the current convergence distance, so as to determine the amplitude and method of adjusting the convergence distance of the left optical engine 21 and the right optical engine 22.

[0058] Step S500: Adjust the convergence distance of the left and right optical engines according to the adjustment parameter, so that the display position of the target image in the user's field of view corresponds to the current gaze focus point of the user.

[0059] The convergence distance of the left optical engine 21 and the right optical engine 22 can be adjusted in one or more ways. In some embodiments, the convergence distance can be adjusted by adjusting the position of the left microdisplay 211 and / or the position of the right microdisplay 221, and the adjustment parameter can include the moving distance and moving direction of the left microdisplay 211 and the right microdisplay 221. In other embodiments, the convergence distance can be adjusted by adjusting the position of the left lens group 212 and / or the position of the right lens group 222, and the adjustment parameter can include the moving distance and moving direction of the left lens group 212 and the right lens group 222.

[0060] In some embodiments, the left optical engine 21 includes a left microdisplay 211, and the left microdisplay 211 has a first display area 23 corresponding to the target image; the right optical engine 22 includes a right microdisplay 221, and the right microdisplay 221 has a second display area 24 corresponding to the target image; the relative position between the first display area 23 and the optical axis of the left lens group 212 can be changed by moving the position of the first display area 23 on the left microdisplay 211, and the relative position between the second display area 24 and the optical axis of the right lens group 222 can be changed by moving the position of the second display area 24 on the right microdisplay 221, so as to change the image combining distance. Refer to Figure 8 , step S400 may include the following steps S401 to S403:

[0061] Step S401, determine the target position of the first display area and the target position of the second display area according to the target image combining distance.

[0062] The control circuit 30 may determine the target position of the first display area 23 and the target position of the second display area 24 according to the target image combining distance. When the positions of the first display area 23 and the second display area 24 are respectively adjusted to the target positions, the image combining distance of the left optical engine 21 and the right optical engine 22 can reach or be closer to the target image combining distance. The first movement parameter may also be determined according to the total display range of the left microdisplay 211, and the second movement parameter is also determined according to the total display range of the right microdisplay 221, so as to prevent the first display area 23 from moving beyond the total display range of the left microdisplay 211 or the second display area 24 from moving beyond the total display range of the right microdisplay 221, resulting in incomplete display of the target image.

[0063] Step S402, determine the first movement parameter of the first display area according to the target position of the first display area and the current position of the first display area.

[0064] Wherein, in one embodiment, the first movement parameter includes a first movement direction and a first number of movement pixels. The first movement direction represents the movement direction of the first display area 23 from the current position to the target position, and the first number of movement pixels represents the number of pixels that the first display area 23 needs to move from the current position to the target position.

[0065] Step S403, determine the second movement parameter of the second display area according to the target position of the second display area and the current position of the second display area.

[0066] Among them, in one embodiment, the second movement parameter includes a second movement direction and a second number of movement pixels. The second movement direction represents the movement direction of the second display area 24 from the current position to the target position, and the second number of movement pixels represents the number of pixels that the second display area 24 needs to move from the current position to the target position. Optionally, the first movement direction and the second movement direction are opposite, and the first number of movement pixels and the second number of movement pixels may be equal, that is, the position adjustment of the second display area 24 may be mirror-symmetrical to the position adjustment of the first display area 23.

[0067] Referring to Figure 8 , corresponding to steps S401 - S403, step S500 may include the following step S501:

[0068] Step S501: Control the movement of the first display area of the left microdisplay according to the first movement parameter, and control the movement of the second display area of the right microdisplay according to the second movement parameter.

[0069] In some embodiments, the adjustment of the combined image distance between the left optical engine 21 and the right optical engine 22 can be achieved by adjusting the angle of the optical engine 20. The optical engine 20 is arranged on the glasses body 10 in a manner that can rotate relative to the waveguide sheet 11. By rotating the optical engine 20 to adjust the angle of the optical engine 20, the angle of the imaging optical coupling of the optical engine 20 into the coupling area of the waveguide sheet 11 can be adjusted, thereby changing the combined image distance between the left optical engine 21 and the right optical engine 22. Referring to Figure 9 , step S400 may include the following steps S411 to S413:

[0070] Step S411: Determine a first target angle of the left optical engine and a second target angle of the right optical engine according to the target combined image distance.

[0071] The first target angle represents the angle that the left optical machine 21 needs to be adjusted to in order to make the combined image distance match the current line-of-sight focus point of the user; the second target angle represents the angle that the right optical machine 22 needs to be adjusted to in order to make the combined image distance match the current line-of-sight focus point of the user. In this embodiment, the information related to the current combined image distance includes the current angles of the left optical machine 21 and the right optical machine 22, and the adjustment parameters include the first adjustment angle of rotation of the left optical machine 21 and the second adjustment angle of rotation of the right optical machine 22. The control circuit 30 can determine the first target angle of the left optical machine 21 and the second target angle of the right optical machine 22 according to the target combined image distance. When the current angle of the left optical machine 21 reaches the first target angle and the current angle of the right optical machine 22 reaches the second target angle, the combined image distance of the left optical machine 21 and the right optical machine 22 can reach or be closer to the target combined image distance. The determination of the first target angle and the second target angle also needs to be determined according to the range of rotation of the left optical machine 21 and the right optical machine 22 driven by the optical machine drive assembly 40, so as to avoid the first target angle and the second target angle exceeding the allowable rotation range of the left optical machine 21 and the right optical machine 22.

[0072] Step S412: Determine the first adjustment angle according to the first target angle and the current angle of the left optical machine.

[0073] Optionally, the first adjustment angle can be the difference between the first target angle and the current angle of the left optical machine 21.

[0074] Step S413: Determine the second adjustment angle according to the second target angle and the current angle of the right optical machine.

[0075] Optionally, the second adjustment angle can be the difference between the second target angle and the current angle of the right optical machine 22.

[0076] Corresponding to steps S411 - S413, step S500 may include the following step S511:

[0077] Step S511: Control the optical machine drive assembly to drive the left optical machine to rotate according to the first adjustment angle, and drive the right optical machine to rotate according to the second adjustment angle.

[0078] Due to the limited total display range of the left micro display 211 and the right micro display 221, there are certain limitations on the rotation range of the left optical engine 21 and the right optical engine 22. Therefore, when the target image synthesis distance is a relatively large value or a relatively small value, relying solely on one adjustment method may not be able to adjust the image synthesis distance between the left optical engine 21 and the right optical engine 22 to the expected effect where the display position of the target image in the user's field of view corresponds to the user's current line of sight focus point. In addition, when the gap between the current image synthesis distance of the left optical engine 21 and the right optical engine 22 and the target image synthesis distance is relatively large, relying solely on one adjustment method may result in a slow speed of dynamic adjustment of the image synthesis distance. To solve this problem, according to the needs of the actual application scenario, multiple adjustment methods can be used in cooperation. In one embodiment, the positions of the first display area 23 and the second display area 24 can be adjusted simultaneously and the left optical engine 21 and the right optical engine 22 can be driven to rotate by the optical engine drive assembly 40 at the same time to achieve a faster adjustment of the image synthesis distance, or a larger adjustment range of the image synthesis distance can be achieved. For example, the adjustment amplitude ratios of different adjustment methods for adjusting the image synthesis distance can be determined in advance, so that multiple adjustment methods make up the gap between the target image synthesis distance and the current image synthesis distance according to the adjustment amplitude ratio.

[0079] In an embodiment of the present invention, the current line of sight focus point of the user is obtained, the target image synthesis distance is determined according to the current line of sight focus point, and then the adjustment parameter is determined according to the target image synthesis distance and the information related to the current image synthesis distance. According to the adjustment parameter, the image synthesis distance between the left optical engine 21 and the right optical engine 22 is adjusted at least by controlling the movement of the first display area 23 of the left micro display 211 and the movement of the second display area 24 of the right micro display 221, so that the display position of the target image in the user's field of view corresponds to the user's current line of sight focus point, thereby realizing the dynamic adjustment of the image synthesis distance and ensuring the user experience.

[0080] Those skilled in the art should understand that the embodiments of the present application can be provided as methods, devices (equipment) or computer program products. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware aspects. Moreover, the present application can be implemented as a computer program product on one or more computer-readable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0081] These computer program instructions can be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured article including an instruction device, and the instruction device implements the process Figure 1 the functions specified in one process or multiple processes.

[0082] These computer program instructions may also be provided to a processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce means for implementing the functions specified in one process Figure 1 or in multiple processes.

[0083] Another embodiment of the present invention relates to a non-volatile storage medium for storing a computer-readable program, and the computer-readable program is used for a computer to execute the above-mentioned partial or all method embodiments.

[0084] That is, those skilled in the art can understand that all or part of the steps in implementing the methods of the above embodiments can be completed by specifying relevant hardware through a program. The program is stored in a storage medium and includes several instructions to enable a device (which may be a single-chip microcomputer, a chip, etc.) or a processor to execute all or part of the steps of the methods described in the embodiments of the present application. The foregoing storage medium includes: USB flash drives, mobile hard disks, read-only memories (ROMs), random access memories (RAMs), magnetic disks, optical disks, and other various media that can store program codes. In an application scenario, the non-volatile storage medium storing the above computer program product may be a part of the control circuit 30 of the smart glasses.

[0085] The foregoing are only the preferred embodiments of the present application and are not used to limit the present application. For those skilled in the art, various changes and modifications can be made to the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included within the protection scope of the present application.

Claims

1. An intelligent glasses, characterized in that, Comprising: A glasses body having a waveguide sheet; An optical engine disposed in the glasses body, the optical engine including a left optical engine and a right optical engine, the left optical engine including a left microdisplay, and the right optical engine including a right microdisplay; And A control circuit electrically connected to the optical engine, the control circuit being configured to: Control the imaging light emitted by the optical engine to be coupled into the waveguide sheet, so that the imaging light is coupled out through the reflection of the waveguide sheet into the user's eyes to form a target image, the left microdisplay having a first display area corresponding to the target image, and the right microdisplay having a second display area corresponding to the target image; Obtain the current line-of-sight focus point of the user; Determine a target convergence distance according to the current line-of-sight focus point; Determine an adjustment parameter according to the target convergence distance and information related to the current convergence distance; And Adjust the convergence distance between the left optical engine and the right optical engine according to the adjustment parameter, so that the display position of the target image in the user's field of view corresponds to the current line-of-sight focus point of the user; Wherein, adjusting the convergence distance between the left optical engine and the right optical engine includes: Controlling the movement of the first display area of the left microdisplay and the movement of the second display area of the right microdisplay.

2. The smart glasses according to claim 1, characterized in that, The determining the adjustment parameter according to the target convergence distance and information related to the current convergence distance includes: Determining a target position of the first display area and a target position of the second display area according to the target convergence distance; Determining a first movement parameter of the first display area according to the target position of the first display area and the current position of the first display area, the adjustment parameter including the first movement parameter, and the information related to the current convergence distance including the current position of the first display area; and Determining a second movement parameter of the second display area according to the target position of the second display area and the current position of the second display area, the adjustment parameter including the second movement parameter, and the information related to the current convergence distance including the current position of the second display area; The adjusting the convergence distance between the left optical engine and the right optical engine according to the adjustment parameter includes: Controlling the movement of the first display area of the left microdisplay according to the first movement parameter, and controlling the movement of the second display area of the right microdisplay according to the second movement parameter.

3. The smart glasses according to claim 2, characterized in that, The first movement parameter includes a first movement direction and a first number of movement pixels, and the target position of the first display area is further determined according to the total display range of the left microdisplay; The second movement parameter includes a second movement direction and a second number of movement pixels, and the target position of the second display area is further determined according to the total display range of the right microdisplay.

4. The smart glasses according to claim 1 or 2, characterized in that, Further comprising: An optical engine driving assembly electrically connected to the control circuit and connected to the optical engine; The optical engine is disposed in the glasses body in a manner that can rotate relative to the waveguide sheet through the optical engine driving assembly; Wherein, the determining the adjustment parameter according to the target convergence distance and information related to the current convergence distance includes: Determine a first target angle of the left optical machine and a second target angle of the right optical machine according to the target combined imaging distance; Determine a first adjustment angle according to the first target angle and the current angle of the left optical machine, the adjustment parameter includes the first adjustment angle, and the information related to the current combined imaging distance includes the current angle of the left optical machine; and Determine a second adjustment angle according to the second target angle and the current angle of the right optical machine, the adjustment parameter includes the second adjustment angle, and the information related to the current combined imaging distance includes the current angle of the right optical machine; The adjusting the combined imaging distance between the left optical machine and the right optical machine according to the adjustment parameter includes: Controlling the optical machine driving component to drive the left optical machine to rotate according to the first adjustment angle and drive the right optical machine to rotate according to the second adjustment angle.

5. The smart glasses according to claim 1, characterized in that The adjustment parameter is also determined according to the user's pupil distance and the horizontal field of view angle of the optical machine.

6. The smart glasses according to claim 1, characterized in that The left optical machine further includes a left lens group, and the right optical machine further includes a right lens group; The adjusting the combined imaging distance between the left optical machine and the right optical machine includes: Adjusting the position of the left microdisplay and / or the position of the right microdisplay to adjust the combined imaging distance; and / or Adjusting the position of the left lens group and / or the position of the right lens group to adjust the combined imaging distance.

7. The smart glasses according to claim 1, characterized in that, The smart glasses further include: An eye movement tracking component, which is arranged on the glasses body and electrically connected to the control circuit, and the eye movement tracking component is configured to detect the user's eye movement information and the line-of-sight focus point; The control circuit is further configured to obtain the current line-of-sight focus point through the eye movement tracking component.

8. A method for adjusting the combined image distance, characterized in that, Includes: Controlling the imaging light emitted by the optical machine to be coupled into the waveguide sheet, so that the imaging light is coupled out through the reflection of the waveguide sheet into the user's eyes to form a target image. The optical machine includes a left optical machine and a right optical machine. The left optical machine includes a left microdisplay, and the left microdisplay has a first display area corresponding to the target image. The right optical machine includes a right microdisplay, and the right microdisplay has a second display area corresponding to the target image; Obtain the user's current line-of-sight focus point; Determine the target combined imaging distance according to the current line-of-sight focus point; Determine the adjustment parameter according to the target combined imaging distance and the information related to the current combined imaging distance; And Adjust the combined imaging distance between the left optical machine and the right optical machine according to the adjustment parameter, so that the display position of the target image in the user's field of view corresponds to the user's current line-of-sight focus point; Wherein, the adjusting the combined imaging distance between the left optical machine and the right optical machine includes: Controlling the movement of the first display area of the left microdisplay and the movement of the second display area of the right microdisplay.

9. The method for adjusting the coincidence distance according to claim 8, wherein The determining the adjustment parameter according to the target combined imaging distance and the information related to the current combined imaging distance includes: Determine the target position of the first display area and the target position of the second display area according to the target combined imaging distance; Determine a first movement parameter of the first display area according to the target position and the current position of the first display area. The adjustment parameter includes the first movement parameter, and the information related to the current image combining distance includes the current position of the first display area; and Determine a second movement parameter of the second display area according to the target position and the current position of the second display area. The adjustment parameter includes the second movement parameter, and the information related to the current image combining distance includes the current position of the second display area; The adjusting the image combining distance between the left optical engine and the right optical engine according to the adjustment parameter includes: Controlling the movement of the first display area of the left microdisplay according to the first movement parameter, and controlling the movement of the second display area of the right microdisplay according to the second movement parameter.

10. The method for adjusting the coincidence distance according to claim 9, wherein, The first movement parameter includes a first movement direction and a first number of movement pixels, and the target position of the first display area is further determined according to the total display range of the left microdisplay; The second movement parameter includes a second movement direction and a second number of movement pixels, and the target position of the second display area is further determined according to the total display range of the right microdisplay.

11. The co-image distance adjustment method according to claim 8 or 9, characterized in that The determining the adjustment parameter according to the target image combining distance and the current image combining distance between the left optical engine and the right optical engine includes: Determining a first target angle of the left optical engine and a second target angle of the right optical engine according to the target image combining distance; Determine a first adjustment angle according to the first target angle and the current angle of the left optical engine. The adjustment parameter includes the first adjustment angle, and the information related to the current image combining distance includes the current angle of the left optical engine; and Determine a second adjustment angle according to the second target angle and the current angle of the right optical engine. The adjustment parameter includes the second adjustment angle, and the information related to the current image combining distance includes the current angle of the right optical engine; The adjusting the image combining distance between the left optical engine and the right optical engine according to the adjustment parameter includes: Controlling the optical engine drive assembly to drive the left optical engine to rotate according to the first adjustment angle, and drive the right optical engine to rotate according to the second adjustment angle.

12. The method for adjusting the coincidence distance according to claim 8, wherein The adjusting the image combining distance between the left optical engine and the right optical engine includes: Adjusting the position of the left microdisplay and / or the position of the right microdisplay to adjust the image combining distance; and / or Adjusting the position of the left lens group and / or the position of the right lens group to adjust the image combining distance, wherein the left optical engine includes the left lens group, and the right optical engine includes the right lens group.

13. A computer-readable storage medium having computer program instructions stored thereon, characterized in that, When the computer program is executed by a processor, it implements the image combining distance control method according to any one of claims 8-12.

14. A computer program product comprising instructions, characterized in that, When the instruction runs on the smart glasses, the smart glasses execute the method according to any one of claims 8-12.

Images