Smart glasses, image convergence distance adjustment method, and storage medium
By using the control circuit of smart glasses to obtain the focal point of the gaze and dynamically adjust the optical-mechanical imaging distance, the problem of visual fatigue in traditional smart glasses under different application scenarios is solved, thus improving the user experience.
Patent Information
- Application Number
- PCT/CN2026/084569
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-05-09
- Filing Date
- 2026-03-19
- Publication Date
- 2026-11-12
AI Technical Summary
The fixed focal length design of traditional smart glasses causes visual fatigue and dizziness for users in different application scenarios, and the focusing distance cannot be dynamically adjusted.
The smart glasses' control circuitry acquires the user's current focal point and dynamically adjusts the image-combining distance between the left and right optical engines, including moving the display area and adjusting the optical engine angles, to ensure that the target image corresponds to the user's focal point.
It enables dynamic adjustment of the image-merging distance of smart glasses in different application scenarios, improving users' visual comfort and immersion.
Smart Images

Figure CN2026084569_12112026_PF_FP_ABST
Abstract
Description
Smart glasses, image merging distance adjustment method and storage medium
[0001] This application claims priority to Chinese Patent Application No. 202510602484.5, filed on May 9, 2025, entitled "Smart Glasses, Method for Adjusting Image Convergence Distance and Storage Medium", the entire contents of which are incorporated herein by reference. Technical Field
[0002] This invention relates to the field of smart wearable device technology, and more specifically, to a smart pair of glasses, a method for adjusting the image-to-image distance, and a storage medium. Background Technology
[0003] In recent years, with the rapid development of augmented reality (AR) and virtual reality (VR) technologies, smart glasses have gradually become an important medium for human-computer interaction. In near-eye display systems, the ability to adjust the focusing distance (i.e., the focal distance between the virtual image and the user's eyes) directly affects the user's visual comfort and immersion. Traditional smart glasses typically employ a fixed-focal-length optical design, which presents the virtual image at a preset distance. However, different users or application scenarios (such as near-field reading and long-distance navigation) require dynamic adjustment of the focusing distance; otherwise, it can easily lead to visual fatigue or even dizziness. Summary of the Invention
[0004] In view of this, embodiments of the present invention provide smart glasses, a method for adjusting the merging distance, and a storage medium, which are beneficial to improving at least some of the problems existing in the prior art.
[0005] In a first aspect, embodiments of the present invention provide smart glasses, including a glasses body, an optical engine, and a control circuit; the glasses body has a waveguide; the optical engine is disposed on the glasses body, the optical engine includes a left optical engine and a right optical engine, the left optical engine includes a left micro-display, and the right optical engine includes a right micro-display; the control circuit is electrically connected to the optical engine, and the control circuit is configured to: control the imaging light emitted by the optical engine to couple into the waveguide, so that the imaging light is reflected by the waveguide and coupled out to the user's eye to form a target image, the left micro-display has a first display area corresponding to the target image, and the right micro-display has a first display area corresponding to the target image. The device has a second display area corresponding to the target image; acquires the user's current gaze focus point; determines the target alignment distance based on the current gaze focus point; determines adjustment parameters based on the target alignment distance and information related to the current alignment distance; and adjusts the alignment distance between the left optical engine and the right optical engine based on the adjustment parameters so that the display position of the target image in the user's field of vision corresponds to the user's current gaze focus point; wherein, adjusting the alignment distance between the left optical engine and the right optical engine includes: controlling the movement of the first display area of the left microdisplay and the movement of the second display area of the right microdisplay.
[0006] Further, determining the adjustment parameters based on the target merging distance and information related to the current merging distance includes: determining the target position of the first display area and the target position of the second display area based on the target merging distance; determining a first movement parameter of the first display area based on the target position of the first display area and the current position of the first display area, wherein the adjustment parameter includes the first movement parameter and the information related to the current merging distance includes the current position of the first display area; and determining a second movement parameter of the second display area based on the target position of the second display area and the current position of the second display area, wherein the adjustment parameter includes the second movement parameter and the information related to the current merging distance includes the current position of the second display area; adjusting the merging distance between the left optical engine and the right optical engine based on the adjustment parameters includes: controlling the movement of the first display area of the left microdisplay based on the first movement parameter and controlling the movement of the second display area of the right microdisplay based on the second movement parameter.
[0007] Furthermore, the first movement parameter includes a first movement direction and a first number of movement pixels, and the target position of the first display area is also determined based on the total display range of the left microdisplay; the second movement parameter includes a second movement direction and a second number of movement pixels, and the target position of the second display area is also determined based on the total display range of the right microdisplay.
[0008] Furthermore, the smart glasses also include an optical engine drive assembly, electrically connected to the control circuit and connected to the optical engine; the optical engine is mounted on the glasses body in a rotatable manner relative to the waveguide plate via the optical engine drive assembly; wherein, determining the adjustment parameters based on the target alignment distance and information related to the current alignment distance includes: determining a first target angle of the left optical engine and a second target angle of the right optical engine based on the target alignment distance; determining a first adjustment angle based on the first target angle and the current angle of the left optical engine, the adjustment parameter including the first adjustment angle, and the information related to the current alignment distance including the current angle of the left optical engine; and determining a second adjustment angle based on the second target angle and the current angle of the right optical engine, the adjustment parameter including the second adjustment angle, and the information related to the current alignment distance including the current angle of the right optical engine; adjusting the alignment distance between the left and right optical engines based on the adjustment parameters includes: controlling the optical engine drive assembly to drive the left optical engine to rotate according to the first adjustment angle, and driving the right optical engine to rotate according to the second adjustment angle.
[0009] Furthermore, the adjustment parameters are also determined based on the user's interpupillary distance and the horizontal field of view of the optical engine.
[0010] Furthermore, the left optical engine further includes a left lens group, and the right optical engine further includes a right microdisplay and a right lens group; adjusting the image-merging distance between the left and right optical engines includes: adjusting the position of the left microdisplay and / or the position of the right microdisplay to adjust the image-merging distance; and / or adjusting the position of the left lens group and / or the position of the right lens group to adjust the image-merging distance.
[0011] Furthermore, the smart glasses also include an eye-tracking component, which is disposed on the main body of the glasses and electrically connected to the control circuit. The eye-tracking component is configured to detect the user's eye movement information and gaze focus point; the control circuit is also configured to obtain the current gaze focus point through the eye-tracking component.
[0012] Secondly, embodiments of the present invention provide a method for adjusting the image merging distance, comprising the following steps: controlling an imaging light emitted by an optical engine to couple into a waveguide plate, so that the imaging light is reflected by the waveguide plate and coupled out into the user's eye to form a target image, wherein the optical engine includes a left optical engine and a right optical engine; acquiring the user's current gaze focus point; determining the target image merging distance based on the current gaze focus point; determining adjustment parameters based on the target image merging distance and information related to the current image merging distance; and adjusting the image merging distance between the left optical engine and the right optical engine according to the adjustment parameters, so that the display position of the target image in the user's field of vision corresponds to the user's current gaze focus point; wherein adjusting the image merging distance between the left optical engine and the right optical engine includes: controlling the movement of a first display area of the left microdisplay and the movement of a second display area of the right microdisplay.
[0013] Further, determining the adjustment parameters based on the target merging distance and information related to the current merging distance includes: determining the target position of the first display area and the target position of the second display area based on the target merging distance; determining a first movement parameter of the first display area based on the target position of the first display area and the current position of the first display area, wherein the adjustment parameter includes the first movement parameter and the information related to the current merging distance includes the current position of the first display area; and determining a second movement parameter of the second display area based on the target position of the second display area and the current position of the second display area, wherein the adjustment parameter includes the second movement parameter and the information related to the current merging distance includes the current position of the second display area; adjusting the merging distance between the left optical engine and the right optical engine based on the adjustment parameters includes: controlling the movement of the first display area of the left microdisplay based on the first movement parameter and controlling the movement of the second display area of the right microdisplay based on the second movement parameter.
[0014] Furthermore, the first movement parameter includes a first movement direction and a first number of movement pixels, and the target position of the first display area is also determined based on the total display range of the left microdisplay; the second movement parameter includes a second movement direction and a second number of movement pixels, and the target position of the second display area is also determined based on the total display range of the right microdisplay.
[0015] Further, determining the adjustment parameters based on the target alignment distance and the current alignment distance between the left and right optical engines includes: determining a first target angle of the left optical engine and a second target angle of the right optical engine based on the target alignment distance; determining a first adjustment angle based on the first target angle and the current angle of the left optical engine, wherein the adjustment parameters include the first adjustment angle and the information related to the current alignment distance includes the current angle of the left optical engine; and determining a second adjustment angle based on the second target angle and the current angle of the right optical engine, wherein the adjustment parameters include the second adjustment angle and the information related to the current alignment distance includes the current angle of the right optical engine; adjusting the alignment distance between the left and right optical engines based on the adjustment parameters includes: controlling the optical engine drive assembly to drive the left optical engine to rotate according to the first adjustment angle and to drive the right optical engine to rotate according to the second adjustment angle.
[0016] Furthermore, adjusting the image-combining distance between the left optical engine and the right optical engine includes: adjusting the position of the left microdisplay and / or the position of the right microdisplay to adjust the image-combining distance; and / or adjusting the position of the left lens group and / or the position of the right lens group to adjust the image-combining distance, wherein the left optical engine includes the left lens group and the right optical engine includes the right lens group.
[0017] Thirdly, embodiments of the present invention provide a computer-readable storage medium storing computer program instructions thereon, wherein the computer program, when executed by a processor, implements the image-combination distance control method as described in the second aspect.
[0018] Fourthly, embodiments of the present invention also provide an instruction that, when executed on smart glasses, causes the smart glasses to perform the method described in the second aspect.
[0019] This invention provides smart glasses, a method for adjusting the image merging distance, and a storage medium. The method acquires the user's current focal point and determines the target image merging distance based on it. Then, it determines adjustment parameters based on the target image merging distance and information related to the current image merging distance. According to these parameters, the image merging distance between the left and right optical engines is adjusted by controlling the movement of the first display area of the left micro-display and the second display area of the right micro-display. This ensures that the display position of the target image in the user's field of vision corresponds to the user's current focal point, thereby achieving dynamic adjustment of the image merging distance and guaranteeing a better user experience. Attached Figure Description
[0020] The above and other objects, features and advantages of the present invention will become clearer from the following description of embodiments of the invention with reference to the accompanying drawings, in which:
[0021] Figure 1 is a schematic diagram of the structure of smart glasses according to an embodiment of the present invention;
[0022] Figure 2 is a schematic block diagram of smart glasses according to an embodiment of the present invention;
[0023] Figure 3 is a detection schematic diagram of the eye-tracking component of smart glasses according to an embodiment of the present invention;
[0024] Figure 4 is a schematic diagram of the detection optical path of the eye-tracking component of a smart glasses according to an embodiment of the present invention;
[0025] Figure 5 is a schematic diagram of the movement of the first display area of smart glasses according to an embodiment of the present invention;
[0026] Figure 6 is a schematic diagram of the movable display area of smart glasses according to an embodiment of the present invention;
[0027] Figure 7 is a flowchart illustrating a method for adjusting the image merging distance according to an embodiment of the present invention;
[0028] Figure 8 is a schematic diagram of the process of determining adjustment parameters and adjusting the image combination distance according to the adjustment parameters according to an embodiment of the present invention;
[0029] Figure 9 is a schematic diagram of the process of determining adjustment parameters and adjusting the image combination distance according to the adjustment parameters in another embodiment of the present invention. Detailed Implementation
[0030] The present application is described below based on embodiments, but it is not limited to these embodiments. In the detailed description of the present application below, certain specific details are described in detail. Those skilled in the art can fully understand the present application without these details. To avoid obscuring the substance of the present application, well-known methods, processes, flows, elements, and circuits are not described in detail.
[0031] Furthermore, those skilled in the art should understand that the accompanying drawings provided herein are for illustrative purposes only and are not necessarily drawn to scale.
[0032] Unless the context explicitly requires it, words such as "including" or "contains" throughout the application should be interpreted as including rather than exclusive or exhaustive; that is, meaning "including but not limited to".
[0033] In the description of this application, it should be understood that the terms "first," "second," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance. Furthermore, in the description of this application, unless otherwise stated, "a plurality of" means two or more.
[0034] The solutions described in this specification and embodiments, if involving the processing of personal information, will be processed only on the premise of having a legal basis (such as obtaining the consent of the personal information subject, or being necessary for the performance of a contract), and will only be processed within the scope stipulated or agreed upon. A user's refusal to process personal information beyond what is necessary for basic functions will not affect the user's use of basic functions.
[0035] One aspect of this invention provides a smart glasses system, which can be a virtual reality (VR) glasses system, an augmented reality (AR) glasses system, or a mixed reality (MR) glasses system. Referring to Figures 1-6, the smart glasses system includes a glasses body 10, an optical engine 20, and a control circuit 30. The optical engine 20 is disposed on the glasses body 10, and the control circuit 30 is electrically connected to the optical engine 20 to control the operation of the optical engine 20.
[0036] The main body 10 of the glasses has a waveguide 11 for efficient transmission and coupling of virtual images. The waveguide 11 is a flat optical element based on a transparent substrate (such as glass or polymer material), and its interior or surface integrates diffraction gratings (such as surface relief gratings SRG or volume holographic gratings VHG) or geometric reflection structures. The control circuit 30 can control the imaging light emitted by the optomechanism 20 to be coupled into the waveguide 11. The waveguide 11 conducts the imaging light from the optomechanism 20 within the waveguide 11 through the principle of total internal reflection, so that the imaging light is coupled out through the reflection of the waveguide 11 to the user's eye E to form a target image. The waveguide 11 may include a coupling region, an extension region, and a coupling out region. The coupling region is located at the edge of the waveguide 11 and couples the imaging light emitted by the optomechanism 20 into the waveguide at a specific angle through a nanoscale grating or prism structure. The extension region replicates and extends the imaging light laterally or longitudinally, and the coupling out region couples the extended beam out to the human eye with uniform brightness to form a virtual image. Optionally, the waveguide 11 may include a left waveguide 11 corresponding to the user's left eye and a right waveguide 11 corresponding to the user's right eye.
[0037] The optical engine 20, as the core display module, is used to generate high-definition virtual images and project them onto the waveguide plate 11. In this embodiment, the optical engine 20 may include a left optical engine 21 corresponding to the left waveguide plate 11 and a right optical engine 22 corresponding to the right waveguide plate 11. Each optical engine 20 may include a display chip and a lens group. The display chip generates a high-resolution image through pixel-level modulation, and the projection lens group may be composed of multiple aspherical lenses or freeform lenses, used to relay the image plane of the display chip to the coupling area of the waveguide plate 11. The display chip may include a liquid crystal on silicon, a digital micromirror, or a microdisplay. In this embodiment, the display chip may be a microdisplay. The control circuit 30 controls the left optical engine 21 and the right optical engine 22 to emit imaging light that is coupled into the corresponding waveguide plate 11. Depending on actual needs, the optical engine 20 may also include a light source, a lens focusing assembly, and other structures to realize the function of projecting virtual images onto the waveguide plate 11.
[0038] Because different users have different focal points, or the same user has different focal points in different application scenarios, in this embodiment, the control circuit 30 obtains the user's current focal point and then adjusts the merging distance between the left optical engine 21 and the right optical engine 22 according to the user's focal point, so that the display position of the target image in the user's field of vision corresponds to the user's current focal point, thus providing the user with a better visual effect. In some embodiments, after obtaining the user's current focal point, the control circuit 30 determines the target merging distance of the target image based on the current focal point, and then determines the adjustment parameters for adjusting the merging distance between the left optical engine 21 and the right optical engine 22 based on the target merging distance and information related to the current merging distance between the left optical engine 21 and the right optical engine 22. In this embodiment, the user's current gaze focus can be on the middle plane of the smart glasses. The ideal image-combining distance between the left optical engine 21 and the right optical engine 22 (that is, the target image-combining distance in this embodiment) is the vertical distance from the current gaze focus to the line connecting the user's eyes. When the image-combining distance is adjusted to the target image-combining distance, the virtual image output by the optical engine 20 falls on the plane where the user's current gaze focus is located, thus improving the user's viewing experience.
[0039] In some embodiments, the smart glasses further include an eye-tracking component 50, disposed on the glasses body 10 and electrically connected to the control circuit 30. The eye-tracking component 50 is used to dynamically detect the user's eye movement state and gaze point position, thereby providing dynamic feedback control for image merging distance adjustment, interactive control, and display optimization. The control circuit 30 can obtain the user's eye movement state and current gaze focus point through the eye-tracking component 50.
[0040] In one embodiment, referring to Figures 2-4, the eye-tracking component 50 may include an infrared light emitter 51 and a sensing unit 52. The infrared light emitter 51 emits detection infrared light B, which illuminates the surface of the eyeball and forms reflected infrared light C through reflection by the cornea and pupil. The detection infrared light B is invisible light with a wavelength between 850nm and 940nm, which can avoid interfering with the user's visual experience. The sensing unit 52 may include an infrared camera, which can capture the displacement changes of the reflected infrared light C formed by reflection by the cornea and pupil, thereby enabling the processor of the eye-tracking component 50 to calculate the user's current gaze focus point based on a specific gaze estimation algorithm. Optionally, at least a portion of the eye-tracking component 50 may be fixed to or integrated with the waveguide 11. For example, referring to Figure 4, the eye-tracking component 50 may utilize a portion of the waveguide 11 to couple the detection infrared light B into the waveguide 11 at a specific angle, so that the detection infrared light B is reflected by the waveguide 11 and coupled out to the user's eye E. Therefore, the light transmission for imaging and eye tracking of the optomechanical system 20 can share the waveguide 11, realizing a compact design of the optical path system of the smart glasses, which helps to reduce the size and weight of the smart glasses.
[0041] In some embodiments, the adjustment of the image-combining distance between the left optical engine 21 and the right optical engine 22 can be achieved by adjusting the angle of the optical engine 20. The optical engine 20 is rotatably mounted on the main body 10 of the glasses. By rotating the optical engine 20 and adjusting its angle, the angle of the coupling region of the imaging light of the optical engine 20 coupled into the waveguide 11 can be adjusted, thereby changing the image-combining distance between the left optical engine 21 and the right optical engine 22. In one embodiment, the smart glasses also include an optical engine driving assembly 40 connected to the optical engine 20. The control circuit 30 is electrically connected to the optical engine driving assembly 40 and can control the operation of the optical engine driving assembly 40 to drive the optical engine 20 to rotate relative to the waveguide 11. The optical engine driving assembly 40 may include a left optical engine driving module connected to the left optical engine 21 and a right optical engine driving module connected to the right optical engine 22. The control circuit 30 can control the left and right optical engine driving modules respectively to adjust the angles of the left and right optical engines 21 and 22 respectively. The optomechanical drive assembly 40 can use a power source including, for example, a motor, a hydraulic drive device, or a pneumatic drive device. A transmission mechanism can also be provided between the power source and the optomechanical 20. The transmission mechanism can transmit the power from the power source to the optomechanical 20 through one or more of the following methods: gear transmission, shaft transmission, chain rotation, belt transmission, or other feasible transmission methods, so that the optomechanical 20 deflects relative to the waveguide plate 11.
[0042] Specifically, the control circuit 30 can determine a first target angle for the left optical camera 21 and a second target angle for the right optical camera 22 based on the target alignment distance. The first target angle represents the angle that the left optical camera 21 needs to be adjusted to achieve in order to match the alignment distance with the user's current line of sight focus; the second target angle represents the angle that the right optical camera 22 needs to be adjusted to achieve in order to match the alignment distance with the user's current line of sight focus. In this embodiment, the information related to the current alignment distance includes the current angles of the left optical camera 21 and the right optical camera 22, and the adjustment parameters include a first adjustment angle for the rotation of the left optical camera 21 and a second adjustment angle for the rotation of the right optical camera 22. The control circuit 30 determines the first adjustment angle based on the first target angle and the current angle of the left optical camera 21, and determines the second adjustment angle based on the second target angle and the current angle of the right optical camera 22. Then, the control circuit 30 controls the optical engine drive assembly 40 to drive the left optical engine 21 to rotate according to the first adjustment angle, and controls the optical engine drive assembly 40 to drive the right optical engine 22 to rotate according to the second adjustment angle, thereby adjusting the image-combining distance between the left optical engine 21 and the right optical engine 22. Optionally, the user's current gaze focus point can be on the central plane of the smart glasses, and the rotation of the left optical engine 21 and the right optical engine 22 driven by the optical engine drive assembly 40 can be symmetrical with respect to the central plane of the smart glasses, and the angle values of the first adjustment angle and the second adjustment angle can be equal.
[0043] Referring to Figures 5 and 6, the left microdisplay 211 has a first display area 23 corresponding to the target image, and the right microdisplay 221 has a second display area 24 corresponding to the target image. In some embodiments, by moving the position of the first display area 23 on the left microdisplay 211, the relative position between the first display area 23 and the optical axis of the left lens group 212 is changed; by moving the position of the second display area 24 on the right microdisplay 221, the relative position between the second display area 24 and the optical axis of the right lens group 222 is changed, thereby changing the image-joining distance. For example, referring to Figure 5, the first display area 23 on the left microdisplay 211 shown below Figure 5 is moved to the right by a distance D1 relative to the top of Figure 5, and the second display area 24 on the right microdisplay 221 shown below Figure 5 is moved to the left by a distance D2 relative to the bottom of Figure 5. Referring to Figure 6, taking the right microdisplay 221 as an example, when the second display area 24 is to the left, the imaging ray is A1, and the target image formed by combining with the imaging optical engine 20 of the left optical engine 21 is S1; when the second display area 24 is to the right, the imaging ray is A2, and the target image formed by combining with the imaging optical engine 20 of the left optical engine 21 is S2. The combination distances corresponding to target image M2 and target image M1 are different. In one implementation, the control circuit 30 can determine the target position of the first display area 23 and the target position of the second display area 24 according to the target combination distance. When the positions of the first display area 23 and the second display area 24 are respectively adjusted to the target positions, the combination distance between the left optical engine 21 and the right optical engine 22 can reach or be closer to the target combination distance. A first movement parameter of the first display area 23 is determined according to the target position and the current position of the first display area 23, and a second movement parameter of the second display area 24 is determined according to the target position and the current position of the second display area 24. The adjustment parameters include the first movement parameter and the second movement parameter. The control circuit 30 controls the first display area 23 of the left micro-display 211 to move according to the first movement parameter, and controls the second display area 24 of the right micro-display 221 to move according to the second movement parameter.
[0044] The first movement parameter includes a first movement direction and a first number of moving pixels. The first movement direction indicates the direction in which the first display area 23 moves from its current position to the target position, and the first number of moving pixels indicates the number of pixels that the first display area 23 needs to move from its current position to the target position. The second movement parameter includes a second movement direction and a second number of moving pixels. The second movement direction indicates the direction in which the second display area 24 moves from its current position to the target position, and the second number of moving pixels indicates the number of pixels that the second display area 24 needs to move from its current position to the target position. Similar to the first movement parameter, the second movement parameter includes a second movement direction and a second number of moving pixels. Optionally, the first movement direction and the second movement direction are opposite, and the first number of moving pixels and the second number of moving pixels can be equal. Optionally, the first movement parameter can also be determined based on the total display area of the left microdisplay 211, and the second movement parameter can also be determined based on the total display area of the right microdisplay 221, to avoid the first display area 23 moving beyond the total display area of the left microdisplay 211 or the second display area 24 moving beyond the total display area of the right microdisplay 221, resulting in incomplete display of the target image.
[0045] In some embodiments, multiple adjustment methods can work together. For example, the positions of the first display area 23 and the second display area 24 can be adjusted simultaneously, and the left optical engine 21 and the right optical engine 22 can be driven to rotate simultaneously through the optical engine drive assembly 40, thereby achieving faster image merging distance adjustment or a larger image merging distance adjustment range. The adjustment parameters are also determined based on the user's interpupillary distance and the horizontal field of view of the optical engine 20. In this embodiment, the first and second movement directions are opposite, the number of first and second moving pixels is equal, the first adjustment angle and the second adjustment angle have equal angular values, and the change in image merging distance can be calculated by the following formula: L=ipd / (2*tan(θ*n / w+ρ))
[0046] Wherein, ipd is the user's interpupillary distance, θ is the horizontal field of view (fov) of the optical engine 20, w is the total horizontal pixel count of the right microdisplay 221, n is the first moving pixel count / the second moving pixel count, and ρ is the angle value of the first adjustment angle / the second adjustment angle.
[0047] In some embodiments, the relative position between the image of the left microdisplay 211 and the optical axis of the left lens group 212 and / or the relative position between the image of the right microdisplay 221 and the optical axis of the right lens group 222 can be changed by adjusting the position of the left microdisplay 211 and / or the position of the right microdisplay 221, thereby adjusting the image-combining distance between the left optical engine 21 and the right optical engine 22.
[0048] In some embodiments, the image-merging distance can be adjusted by adjusting the left lens group 212 and the right lens group 222. In one embodiment, the left lens group 212 and the right lens group 222 are configured as adjustable-focus structures, and the focal lengths of the left lens group 212 and the right lens group 222 can be adjusted by a lens focusing assembly. Optionally, the lens focusing assembly can drive the left lens group 212 to move relative to the corresponding left microdisplay 211, and drive the right lens group 222 to move relative to the right microdisplay 221, thereby adjusting the position of the left lens group 212 and / or the position of the right lens group 222 to adjust the image-merging distance.
[0049] This invention also provides a method for adjusting the merging distance, which can be used in smart glasses to dynamically adjust the merging distance. In some application scenarios, this merging distance adjustment method can be applied to the smart glasses in at least some of the embodiments described above and executed by the control circuit 30 of the smart glasses. Referring to FIG7, the merging distance adjustment method includes the following steps S100 to S500:
[0050] Step S100: The imaging light emitted by the control optomechanism is coupled into the waveguide plate so that the imaging light is reflected by the waveguide plate and coupled out to the user's eye to form a target image.
[0051] The optical engine 20 includes a left optical engine 21 and a right optical engine 22. The control circuit 30 controls the left optical engine 21 and the right optical engine 22 to emit corresponding imaging light, which is coupled into the waveguide 11. The waveguide 11 conducts the imaging light from the optical engine 20 within the waveguide 11 through the principle of total internal reflection, so that the imaging light is reflected out through the waveguide 11 and coupled into the user's eye E to form a target image.
[0052] Step S200: Obtain the user's current gaze focus.
[0053] In this embodiment, the user's current gaze focus can be obtained by monitoring the eye-tracking component 50 of the smart glasses.
[0054] Step S300: Determine the target image-alignment distance based on the current line-of-sight focus point.
[0055] Taking the example where the user's current focal point is on the central plane of the smart glasses, the target merging distance can be equal to the vertical distance from the current focal point to the line connecting the user's eyes. When the merging distance is adjusted to the target merging distance, the virtual image output by the optical engine 20 falls on the plane where the user's current focal point is located, improving the user's viewing experience.
[0056] Step S400: Determine the adjustment parameters based on the target image merging distance and information related to the current image merging distance.
[0057] The control circuit 30 determines the difference between the current image merging distance and the target image merging distance based on the target image merging distance and information related to the current image merging distance, thereby determining the magnitude and method of adjusting the image merging distance between the left optical engine 21 and the right optical engine 22.
[0058] Step S500: Adjust the image-combining distance between the left and right optical engines according to the adjustment parameters so that the display position of the target image in the user's field of vision corresponds to the user's current line of sight focus.
[0059] The image-merging distance between the left optical engine 21 and the right optical engine 22 can be adjusted in one or more ways. In some embodiments, the image-merging distance can be adjusted by adjusting the position of the left microdisplay 211 and / or the right microdisplay 221, and the adjustment parameters may include the moving distance and moving direction of the left microdisplay 211 and the right microdisplay 221. In other embodiments, the image-merging distance can be adjusted by adjusting the position of the left lens group 212 and / or the right lens group 222, and the adjustment parameters may include the moving distance and moving direction of the left lens group 212 and the right lens group 222.
[0060] In some embodiments, the left optical engine 21 includes a left microdisplay 211, which has a first display area 23 corresponding to the target image; the right optical engine 22 includes a right microdisplay 221, which has a second display area 24 corresponding to the target image; the relative position between the first display area 23 and the optical axis of the left lens group 212 can be changed by moving the position of the first display area 23 on the left microdisplay 211, and the relative position between the second display area 24 and the optical axis of the right lens group 222 can be changed by moving the position of the second display area 24 on the right microdisplay 221, thereby changing the image-merging distance. Referring to FIG8, step S400 may include the following steps S401 to S403:
[0061] Step S401: Determine the target position in the first display area and the target position in the second display area based on the target image merging distance.
[0062] The control circuit 30 can determine the target position of the first display area 23 and the target position of the second display area 24 based on the target image merging distance. When the positions of the first display area 23 and the second display area 24 are adjusted to the target positions, the image merging distance of the left optical engine 21 and the right optical engine 22 can reach or be closer to the target image merging distance. The first movement parameter can also be determined based on the total display range of the left micro-display 211, and the second movement parameter can also be determined based on the total display range of the right micro-display 221, so as to avoid the first display area 23 moving beyond the total display range of the left micro-display 211 or the second display area 24 moving beyond the total display range of the right micro-display 221, resulting in incomplete display of the target image.
[0063] Step S402: Determine the first movement parameter of the first display area based on the target position of the first display area and the current position of the first display area.
[0064] In one embodiment, the first movement parameter includes a first movement direction and a first number of moving pixels. The first movement direction indicates the movement direction of the first display area 23 from its current position to its target position, and the first number of moving pixels indicates the number of pixels that the first display area 23 needs to move from its current position to its target position.
[0065] Step S403: Determine the second movement parameter of the second display area based on the target position of the second display area and the current position of the second display area.
[0066] In one embodiment, the second movement parameter includes a second movement direction and a second number of moved pixels. The second movement direction indicates the direction in which the second display area 24 moves from its current position to the target position, and the second number of moved pixels indicates the number of pixels required for the second display area 24 to move from its current position to the target position. Optionally, the first movement direction and the second movement direction are opposite, and the first number of moved pixels and the second number of moved pixels can be equal. That is, the position adjustment of the second display area 24 can be mirror-symmetrical to the position adjustment of the first display area 23.
[0067] Referring to Figure 8, corresponding to steps S401-S403, step S500 may include the following step S501:
[0068] Step S501: Control the first display area of the left micro-display to move according to the first movement parameter, and control the second display area of the right micro-display to move according to the second movement parameter.
[0069] In some embodiments, the adjustment of the image-combining distance between the left optical engine 21 and the right optical engine 22 can be achieved by adjusting the angle of the optical engine 20. The optical engine 20 is rotatably mounted on the eyeglass body 10 relative to the waveguide 11. By rotating the optical engine 20 and adjusting its angle, the angle of the coupling region of the imaging light of the optical engine 20 coupled into the waveguide 11 can be adjusted, thereby changing the image-combining distance between the left optical engine 21 and the right optical engine 22. Referring to FIG9, step S400 may include the following steps S411 to S413:
[0070] Step S411: Determine the first target angle of the left optical camera and the second target angle of the right optical camera based on the target image merging distance.
[0071] The first target angle represents the angle that the left optical camera 21 needs to be adjusted to achieve in order to match the image merging distance with the user's current line of sight focus; the second target angle represents the angle that the right optical camera 22 needs to be adjusted to achieve in order to match the image merging distance with the user's current line of sight focus. In this embodiment, the information related to the current image merging distance includes the current angle of the left optical camera 21 and the current angle of the right optical camera 22, and the adjustment parameters include the first adjustment angle of the left optical camera 21 and the second adjustment angle of the right optical camera 22. The control circuit 30 can determine the first target angle of the left optical camera 21 and the second target angle of the right optical camera 22 according to the target image merging distance. When the current angle of the left optical camera 21 reaches the first target angle and the current angle of the right optical camera 22 reaches the second target angle, the image merging distance of the left optical camera 21 and the right optical camera 22 can reach or be closer to the target image merging distance. The determination of the first target angle and the second target angle also needs to be based on the range of rotation of the left optical engine 21 and the right optical engine 22 driven by the optical engine drive assembly 40, so as to avoid the first target angle and the second target angle exceeding the range of rotation allowed for the left optical engine 21 and the right optical engine 22.
[0072] Step S412: Determine the first adjustment angle based on the first target angle and the current angle of the left optical machine.
[0073] Optionally, the first adjustment angle can be the difference between the first target angle and the current angle of the left optical unit 21.
[0074] Step S413: Determine the second adjustment angle based on the second target angle and the current angle of the right optical machine.
[0075] Optionally, the second adjustment angle can be the difference between the second target angle and the current angle of the right optical machine 22.
[0076] Corresponding to steps S411-S413, step S500 may include the following step S511:
[0077] Step S511: Control the optical engine drive assembly to drive the left optical engine to rotate according to the first adjustment angle, and drive the right optical engine to rotate according to the second adjustment angle.
[0078] Because the total display area of the left microdisplay 211 and the right microdisplay 221 is limited, the rotation range of the left optical engine 21 and the right optical engine 22 is also limited. Therefore, when the target image-alignment distance is a large or small value, relying solely on one adjustment method may not be able to adjust the image-alignment distance between the left optical engine 21 and the right optical engine 22 to achieve the expected effect where the display position of the target image in the user's field of vision corresponds to the user's current focal point. Furthermore, when the difference between the current image-alignment distance between the left optical engine 21 and the right optical engine 22 and the target image-alignment distance is large, relying solely on one adjustment method may result in a slow dynamic adjustment speed for the image-alignment distance. To solve this problem, depending on the needs of the actual application scenario, multiple adjustment methods can work together. In one embodiment, the positions of the first display area 23 and the second display area 24 can be adjusted simultaneously, and the left optical engine 21 and the right optical engine 22 can be rotated simultaneously via the optical engine drive component 40, achieving faster image-alignment distance adjustment or a larger range of image-alignment distance adjustment. For example, the adjustment range of different adjustment methods on the image merging distance can be predetermined, so that multiple adjustment methods can compensate for the gap between the target image merging distance and the current image merging distance according to the adjustment range ratio.
[0079] This invention, through obtaining the user's current focal point and determining the target image merging distance based on that focal point, then determines adjustment parameters based on the target image merging distance and information related to the current image merging distance. Based on these adjustment parameters, the image merging distance between the left optical engine 21 and the right optical engine 22 is adjusted at least by controlling the movement of the first display area 23 of the left micro-display 211 and the second display area 24 of the right micro-display 221. This ensures that the display position of the target image in the user's field of vision corresponds to the user's current focal point, thereby achieving dynamic adjustment of the image merging distance and guaranteeing a better user experience.
[0080] Those skilled in the art will understand that embodiments of this application can be provided as methods, apparatus (devices), or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-readable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0081] These computer program instructions may be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means that implement the functions specified in one or more flowcharts.
[0082] These computer program instructions may also be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which are executed by the processor of the computer or other programmable data processing apparatus, produce means for implementing the functions specified in one or more flows of the flowchart.
[0083] Another embodiment of the present invention relates to a non-volatile storage medium for storing a computer-readable program for use by a computer to execute some or all of the above-described method embodiments.
[0084] That is, those skilled in the art will understand that all or part of the steps in the methods of the above embodiments can be implemented by specifying relevant hardware through a program. This program is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods described in the embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as a USB flash drive, a portable hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk. In one application scenario, the non-volatile storage medium storing the above-mentioned computer program product can be part of the control circuit 30 of the smart glasses.
[0085] The above description is merely a preferred embodiment of this application and is not intended to limit this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.
Claims
1. A type of smart glasses, characterized in that, include: The main body of the glasses has a waveguide plate; An optical engine is disposed in the main body of the glasses. The optical engine includes a left optical engine and a right optical engine. The left optical engine includes a left micro-display, and the right optical engine includes a right micro-display. as well as A control circuit, connected to the opto-mechanical system, is configured to: The imaging light emitted by the optical engine is coupled into the waveguide plate so that the imaging light is reflected by the waveguide plate and coupled out to the user's eye to form a target image. The left micro-display has a first display area corresponding to the target image, and the right micro-display has a second display area corresponding to the target image. Obtain the user's current gaze focus; Determine the target image alignment distance based on the current line-of-sight focus point; The adjustment parameters are determined based on the target alignment distance and information related to the current alignment distance; as well as The image-combining distance between the left and right optical engines is adjusted according to the adjustment parameters so that the display position of the target image in the user's field of vision corresponds to the user's current focal point of gaze. The adjustment of the image-combining distance between the left optical engine and the right optical engine includes: Control the movement of the first display area of the left micro-display and the movement of the second display area of the right micro-display.
2. The smart glasses according to claim 1, characterized in that, The step of determining the adjustment parameters based on the target alignment distance and information related to the current alignment distance includes: The target positions of the first display area and the second display area are determined based on the target image merging distance. Based on the target position and the current position of the first display area, a first movement parameter of the first display area is determined, wherein the adjustment parameter includes the first movement parameter, and the information related to the current image merging distance includes the current position of the first display area; and Based on the target position of the second display area and the current position of the second display area, a second movement parameter of the second display area is determined. The adjustment parameter includes the second movement parameter, and the information related to the current image merging distance includes the current position of the second display area. The step of adjusting the image-combining distance between the left optical engine and the right optical engine according to the adjustment parameters includes: The first display area of the left micro-display is moved according to the first movement parameter, and the second display area of the right micro-display is moved according to the second movement parameter.
3. The smart glasses according to claim 2, characterized in that, The first movement parameters include a first movement direction and a first number of movement pixels, and the target position of the first display area is also determined based on the total display range of the left micro-display. The second movement parameter includes a second movement direction and a second number of movement pixels, and the target position of the second display area is also determined based on the total display range of the right microdisplay.
4. The smart glasses according to claim 1 or 2, characterized in that, Also includes: An optomechanical drive assembly is electrically connected to the control circuit and connected to the optomechanical system. The optical engine is mounted on the main body of the glasses in a manner that allows it to rotatably relative to the waveguide plate via the optical engine drive assembly; The step of determining the adjustment parameters based on the target alignment distance and information related to the current alignment distance includes: The first target angle of the left optical engine and the second target angle of the right optical engine are determined based on the target alignment distance. Based on the first target angle and the current angle of the left optical engine, a first adjustment angle is determined, wherein the adjustment parameter includes the first adjustment angle, and the information related to the current alignment distance includes the current angle of the left optical engine; and A second adjustment angle is determined based on the second target angle and the current angle of the right optical engine. The adjustment parameter includes the second adjustment angle, and the information related to the current image merging distance includes the current angle of the right optical engine. The step of adjusting the image-combining distance between the left optical engine and the right optical engine according to the adjustment parameters includes: The optomechanical drive assembly is controlled to drive the left optomechanical unit to rotate according to the first adjustment angle, and to drive the right optomechanical unit to rotate according to the second adjustment angle.
5. The smart glasses according to claim 1, characterized in that, The adjustment parameters are also determined based on the user's interpupillary distance and the horizontal field of view of the optical engine.
6. The smart glasses according to claim 1, characterized in that, The left optical engine also includes a left lens group, and the right optical engine also includes a right lens group; The adjustment of the image-combining distance between the left optical engine and the right optical engine includes: Adjust the position of the left microdisplay and / or the position of the right microdisplay to adjust the image merging distance; and / or Adjust the position of the left lens group and / or the position of the right lens group to adjust the image-combining distance.
7. The smart glasses according to claim 1, characterized in that, The smart glasses also include: An eye-tracking component is disposed on the main body of the glasses and electrically connected to the control circuit. The eye-tracking component is configured to detect the user's eye movement information and gaze focus point. The control circuit is also configured to acquire the current gaze focus point through the eye-tracking component.
8. A method for adjusting the image combination distance, characterized in that, include: The imaging light emitted by the control optical engine is coupled into a waveguide plate so that the imaging light is reflected by the waveguide plate and coupled out to the user's eye to form a target image. The optical engine includes a left optical engine and a right optical engine. The left optical engine includes a left micro-display with a first display area corresponding to the target image. The right optical engine includes a right micro-display with a second display area corresponding to the target image. Obtain the user's current gaze focus; Determine the target image alignment distance based on the current line-of-sight focus point; The adjustment parameters are determined based on the target alignment distance and information related to the current alignment distance; as well as The image-combining distance between the left and right optical engines is adjusted according to the adjustment parameters so that the display position of the target image in the user's field of vision corresponds to the user's current focal point of gaze. The adjustment of the image-combining distance between the left optical engine and the right optical engine includes: Control the movement of the first display area of the left micro-display and the movement of the second display area of the right micro-display.
9. The method for adjusting the image merging distance according to claim 8, characterized in that, The step of determining the adjustment parameters based on the target alignment distance and information related to the current alignment distance includes: The target positions of the first display area and the second display area are determined based on the target image merging distance. Based on the target position and the current position of the first display area, a first movement parameter of the first display area is determined, wherein the adjustment parameter includes the first movement parameter, and the information related to the current image merging distance includes the current position of the first display area; and Based on the target position of the second display area and the current position of the second display area, a second movement parameter of the second display area is determined. The adjustment parameter includes the second movement parameter, and the information related to the current image merging distance includes the current position of the second display area. The step of adjusting the image-combining distance between the left optical engine and the right optical engine according to the adjustment parameters includes: The first display area of the left micro-display is moved according to the first movement parameter, and the second display area of the right micro-display is moved according to the second movement parameter.
10. The method for adjusting the image merging distance according to claim 9, characterized in that, The first movement parameters include a first movement direction and a first number of movement pixels, and the target position of the first display area is also determined based on the total display range of the left micro-display. The second movement parameter includes a second movement direction and a second number of movement pixels, and the target position of the second display area is also determined based on the total display range of the right microdisplay.
11. The method for adjusting the image merging distance according to claim 8 or 9, characterized in that, The step of determining the adjustment parameters based on the target alignment distance and the current alignment distance between the left and right optical machines includes: The first target angle of the left optical engine and the second target angle of the right optical engine are determined based on the target alignment distance. Based on the first target angle and the current angle of the left optical engine, a first adjustment angle is determined, wherein the adjustment parameter includes the first adjustment angle, and the information related to the current alignment distance includes the current angle of the left optical engine; and A second adjustment angle is determined based on the second target angle and the current angle of the right optical engine. The adjustment parameter includes the second adjustment angle, and the information related to the current image merging distance includes the current angle of the right optical engine. The step of adjusting the image-combining distance between the left optical engine and the right optical engine according to the adjustment parameters includes: The control optomechanical drive assembly drives the left optomechanical unit to rotate according to the first adjustment angle, and drives the right optomechanical unit to rotate according to the second adjustment angle.
12. The method for adjusting the image merging distance according to claim 8, characterized in that, The adjustment of the image-combining distance between the left optical engine and the right optical engine includes: Adjust the position of the left microdisplay and / or the position of the right microdisplay to adjust the image merging distance; and / or Adjusting the position of the left lens group and / or the position of the right lens group to adjust the image-combining distance, wherein the left optical engine includes the left lens group and the right optical engine includes the right lens group.
13. A computer-readable storage medium storing computer program instructions thereon, characterized in that, When the computer program is executed by the processor, it implements the image merging distance control method as described in any one of claims 8-12.
14. A computer program product comprising instructions, characterized in that, When the instructions are executed on the smart glasses, the smart glasses cause the smart glasses to perform the method as described in any one of claims 8-12.
