Intelligent glasses leg with oblique input eye display function

Abstract

The invention discloses an intelligent glasses leg with oblique input eye display. The intelligent glasses leg comprises a glasses leg main body and a near-eye display module. The glasses leg main body is attached to the glasses frame through a detachable structure. The near-to-eye display module comprises a micro-display sub-module and a dynamic adjustable light path sub-module. The micro-display sub-module is used for generating image light; the dynamic adjustable light path sub-module comprises a light modulation unit for collimating and shrinking the image light; the optical axis reflection deflection unit is used for deflecting light into eyes and comprises an adjustable reflector; the eyeball tracking unit is used for acquiring eyeball posture data of the user; and a control unit. The control unit drives the adjustable reflector according to the eyeball posture data and dynamically adjusts the eye entering position and angle of the image light, so that the image light is always projected into the eyes at the angle inclined to the front view direction of the user and is imaged in a visual field residual light area, and it is ensured that the front visual field is not blocked. According to the invention, ambient light is not shielded, the energy utilization rate and miniaturization are improved, and the wearing comfort of a user is further ensured.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of display technology and micro-nano structure, in particular to a smart mirror leg for oblique eye display. BACKGROUND

[0002] Near-eye display technology covers augmented reality (AR) and virtual reality (VR). Among them, augmented reality is an interactive technology that fuses virtual information with the real world, providing users with an enhanced perception experience by superimposing computer-generated virtual elements on the real environment. In contrast, virtual reality completely immerses users in a virtual environment. Augmented reality enables users to interact with the real environment by superimposing virtual elements on the real world. Its core goal is to provide users with rich information and enhanced perception capabilities, thereby improving user interaction and understanding of the surrounding environment. With the help of AR technology, users can view and interact with virtual elements in real time through display devices such as smartphones, head-mounted displays, or smart glasses. These elements include images, videos, 3D models, sounds, and other computer-generated information.

[0003] In recent years, most AR wearable devices have adopted waveguide technology, leading to rapid development in miniaturization. However, the internal total reflection within the optical waveguide causes a large amount of energy dissipation, resulting in low light energy utilization in existing devices. This problem further extends to issues such as device heating affecting wear comfort, battery endurance anxiety affecting user experience, and the imaging position of optical waveguide technology AR wearable devices being in front of the eyes, which causes inconvenience in scenarios requiring high concentration of user attention, such as driving scenarios, which can lead to traffic accidents.

[0004] Therefore, there is an urgent need to develop an AR wearable optical structure that is miniaturized, has high energy utilization, and does not block ambient light. Through optimization of light path design and light modulation scheme, the functional performance bottleneck and use scenario expansion of existing technology can be addressed. SUMMARY

[0005] In view of the above-mentioned part of the defects of the prior art, the technical problem to be solved by the present application is to provide a smart mirror leg for oblique eye display, which aims to ensure that ambient light is not blocked while improving energy utilization and miniaturization, thereby ensuring user wear comfort.

[0006] To achieve the above-mentioned purpose, the present application provides a smart mirror leg for oblique eye display, which comprises:

[0007] a mirror leg body configured to be attached to a frame through a detachable structure;

[0008] A temple near-eye display module integrated on the temple main body, comprising a micro display sub-module and a dynamic adjustable light path sub-module;

[0009] The micro display sub-module is configured to generate image light according to a display signal.

[0010] The dynamic adjustable light path sub-module is configured to receive and modulate the image light emitted by the micro display sub-module and project the image light into the eye in a direction oblique to the user's forward line of sight axis; the dynamic adjustable light path sub-module comprises:

[0011] An optical modulation unit comprising at least one optical element for changing the direction of the optical axis, for collimating and beam-reducing the image light.

[0012] An optical axis reflection deflection unit for deflecting the beam-reduced image light to enter the user's eye; the optical axis reflection deflection unit comprises an adjustable mirror, which dynamically adjusts the exit angle of the image light through electrically controlled deflection.

[0013] An eye tracking unit for acquiring real-time eye pose data of the user.

[0014] A control unit electrically connected to the optical axis reflection deflection unit and the eye tracking unit, configured to generate a control signal to drive the optical axis reflection deflection unit according to the eye pose data, to dynamically adjust the eye entry position and angle of the image light.

[0015] Optionally, the optical axis reflection deflection unit controls the exit angle of the image light, so that the included angle between the eye entry optical axis of the modulated image light and the line of sight axis of the user's forward view is greater than or equal to 10°, thereby ensuring that the image light is imaged in the user's field of view and does not block the forward view.

[0016] Optionally, the micro display sub-module is composed of a micro display screen composed of micro display chips, a driving circuit and a power supply part, the micro display chip comprises one of Micro-LED, Micro-QLED, Micro-OLED, Micro-PeLED, Nano-LED, Nano-QLED, Nano-OLED, Nano-PeLED, and the micro display screen comprises a single-layer structure and a multi-layer structure.

[0017] Optionally, the optical element of the optical modulation unit comprises one of a geometric optical lens, a liquid crystal lens, a microlens array, a super surface with focusing function, and a physical optical superlens.

[0018] Optionally, when the optical element of the light modulation unit is a monolithic first lens, the parameters of the first lens are defined by the geometric parameters and material properties of the first lens, and the specific formula is: wherein f is the focal length of the first lens, n and n0 are the refractive indexes of the material of the first lens and the incident end, respectively, and R1 and R2 are the radii of curvature of the incident end and the exit end of the first lens, respectively.

[0019] Optionally, when the optical element of the light modulation unit is a monolithic second lens, the corresponding shrunk image light satisfies wherein θ represents the half convergence angle of the focused light, D represents the diameter of the incident light beam, n represents the refractive index of the material of the exit end of the second lens, and R1 and R2 are the radii of curvature of the incident end and the exit end of the second lens, respectively.

[0020] Optionally, the dynamic adjustable optical path sub-module further comprises a refractive optical axis deflection unit for deflecting the shrunk image light into the user's eye by refractive means; the refractive optical axis deflection unit comprises at least one of a liquid crystal lens, a metasurface with beam deflection function, and a physical optical superlens.

[0021] Optionally, the adjustable mirror is a two-dimensional MEMS micromirror, and corresponding voltages are applied to the two axes of the two-dimensional MEMS micromirror to control the angle deflection in the pitch and yaw dimensions.

[0022] Optionally, when the optical element is only a monolithic lens, the element adjusts the depth, size, and brightness information of the image observable by the human eye by adjusting the refractive index parameters of the optical element and the position of the optical element in the optical path; when the optical element is multi-piece, the light adjustment unit adjusts the depth, size, and brightness information of the image by adjusting the front and back positions of different elements, replacing elements, adjusting the refractive index parameters of the optical element, etc.

[0023] Optionally, the control unit is configured to support at least two display modes:

[0024] Peripheral light prompt mode: when the eye tracking unit detects that the user's gaze is directly in front, the micro display sub-module is controlled to display simplified prompt information, and the image light is maintained in the peripheral light area of the user's field of view;

[0025] Full information mode: when the eye tracking unit detects that the user's eye turns to the display area, the micro display group module is controlled to display complete information, and the optical axis reflection deflection unit is driven to move the image light to the center of the user's field of view.

[0026] The beneficial effects of the present application are: 1. The present application ensures that the display information is always projected into the eye from the side of the visual field (the angle with the normal axis is greater than or equal to 10 degrees) through the oblique incidence optical architecture. When the user looks straight ahead, the main visual field is completely free of any virtual information obstruction, solving the problem that mainstream AR glasses easily cause interference in scenarios where the user needs to be highly concentrated. 2. The present application discards the light waveguide technology with serious light energy loss, and adopts free space light path design based on geometric optics or super surface, so that the light energy utilization rate is greatly improved. This not only directly brings higher display brightness and longer battery life, but also fundamentally reduces the heat generation of the system, improves the wearing comfort and equipment reliability. 3. The picture position of the traditional near-eye display device is fixed, and the user needs to actively move the line of sight to a specific area to see clearly, which is stiff and easy to cause eye and neck fatigue. The present application realizes real-time following of the display picture with the eye movement through the cooperation of the adjustable mirror and the eye tracking. When the user moves the line of sight, the picture can intelligently adjust the position and always remain in the comfortable area of the visual field. This makes the interaction change from "people actively adapt to equipment" to "equipment intelligently adapt to people", greatly reducing the visual and cognitive load brought by searching for targets and repeatedly focusing, and the observation is smooth and natural, and it is not easy to be tired after a long time of use. 4. The present application integrates eye tracking and dynamic adjustable light path (such as MEMS micromirror) to realize intelligent switching of display mode and real-time following of the picture. Through the double-mode interaction logic of "remaining light prompt - active viewing", complete information can be provided when needed, and the interaction process does not need to be manual and intuitive, which greatly improves the user experience. 5. The present application highly integrates functions such as camera, display, calculation and communication in a single temple, and through modular design, it can be flexibly adapted to various glasses worn by users in daily life. Such a form greatly improves the universality and user acceptance of the product. At the same time, the platform provides the possibility for integrating more sensors and AI functions, and has excellent scalability. 6. Thanks to the micro-nano optical elements and highly integrated optical and mechanical design, the entire optical system can be packaged in a lightweight temple, the overall weight is greatly reduced compared to traditional AR devices, the appearance is closer to daily glasses, and the smart wearable device is realized. The pursuit of normalization.

[0027] In summary, the present application realizes the improvement of energy utilization rate and miniaturization while not obstructing the ambient light, thereby ensuring the wearing comfort of the user. BRIEF DESCRIPTION OF DRAWINGS

[0028] Figure 1 is a structure schematic diagram of an intelligent temple for oblique projection eye display provided by a specific embodiment of the present application, which includes an optical path;

[0029] Figure 2 is a structure schematic diagram of a bilateral temple for oblique projection eye display provided by a specific embodiment of the present application, which includes an optical path;

[0030] Figure 3 is a structure diagram of a smart mirror leg for oblique eye display provided by a specific embodiment of the present application. DETAILED DESCRIPTION

[0031] The present application discloses a smart mirror leg for oblique eye display, and those skilled in the art can improve technical details according to the content herein. It should be particularly pointed out that all similar substitutions and changes are obvious to those skilled in the art, and they are considered to be included in the present application. The device and application of the present application have been described by the preferred embodiment, and the relevant personnel can obviously modify or appropriately change and combine the device and application described herein without departing from the content, spirit and scope of the present application, to realize and apply the present application technology.

[0032] The applicant found that in recent years, AR wearable devices mostly use waveguide technology to achieve high-speed development in the direction of miniaturization. However, the internal total reflection in the optical waveguide leads to a large amount of energy dissipation, so the existing devices have the problem of low light energy utilization. This problem further extends to the problems of device heating affecting wearing comfort, battery endurance anxiety affecting use experience, and so on. Moreover, the imaging position of the optical waveguide technology AR wearable device is in front of the eyes, which is not convenient to use in scenarios that require high concentration of user attention, such as driving scenarios, which can easily cause traffic accidents. It is urgent to develop an AR wearable optical structure that has miniaturization, high energy utilization, and an imaging position that does not block ambient light, and to optimize the light path design and light modulation scheme to solve the functional performance bottleneck and use scenario expansion of the existing technology.

[0033] Therefore, the embodiment of the present application provides a smart mirror leg for oblique eye display, as shown in Figure 1 and Figure 3 The smart mirror leg comprises:

[0034] a mirror leg body configured to be attached to a frame 107 by a detachable structure;

[0035] a mirror leg near-eye display module integrated on the mirror leg body, comprising a micro display sub-module 101 and a dynamic adjustable light path sub-module;

[0036] The micro display sub-module 101 is used to generate image light according to a display signal;

[0037] The dynamic adjustable light path sub-module is used to receive and modulate the image light emitted by the micro display sub-module 101, and project the image light into the eye in a direction inclined to the user's forward line of sight axis. The dynamic adjustable light path sub-module comprises:

[0038] The optical modulation unit 102 includes at least one optical element for changing the direction of the optical axis, used for collimating and beam-contracting the image light;

[0039] The optical axis reflection deflection unit is used to deflect the compressed image light so that it enters the user's eye; the optical axis reflection deflection unit includes an adjustable mirror 103, which dynamically adjusts the exit angle of the image light through electronic deflection.

[0040] Eye-tracking unit 108 is used to acquire the user's eye posture data in real time;

[0041] The control unit, electrically connected to the optical axis reflection deflection unit and the eye tracking unit 108, is configured to generate control signals based on eye posture data to drive the optical axis reflection deflection unit and dynamically adjust the position and angle of the image light entering the eye.

[0042] exist Figure 1 In the diagram, 101 is the micro-display submodule, 102 is the light modulation unit, 103 is the adjustable reflector, 104 is the modulated image light, 105 is the human eye, 106 is the ambient light, 107 is the frame, and 108 is the eye-tracking unit.

[0043] exist Figure 3 In the diagram, 101 is a microdisplay submodule, 102 is a light modulation unit, 103 is an adjustable reflector, 104 is modulated image light, 105 is the human eye, 106 is ambient light, 107 is a frame, 108 is an eye-tracking unit, 309 is an integrated module, 310 is the connection between the integrated module and external devices, 311 is the microdisplay submodule driving circuit and chip, 312 is a microdisplay screen, 313 is a collimating optical element integrated into the microdisplay screen, 314 is collimated light information, 315 is an optical element, 316 is modulated light information, and 319 is an external device connected to the embodiment of the present invention. Figure 3 The diagram illustrates a specific embodiment of the present invention connected to an external device.

[0044] In this specific embodiment, the micro-display submodule 101 is a micro-screen capable of emitting full-color RGB light, with a maximum brightness of not less than 1000 nits, and the maximum brightness does not exceed the limit of human eye health range. The screen size is not greater than 0.32 inches. The focusing lens of the dynamically adjustable optical path submodule of the light modulation unit 102 is a geometric lens, which can be a single lens or a cemented doublet lens, with a focusing efficiency greater than 90%, a three-color light focusing color difference of not more than 5 degrees, a focal length of 4-6mm, and a lens size not smaller than the size of the micro-display screen. The adjustable reflector 103 is a convex reflector with a reflection efficiency greater than 95%, and the reflector size is not smaller than the lens size. The geometric centers of the micro-display submodule 101 and the light adjustment unit are located on a straight line. The temple frame is entirely black.

[0045] In this specific embodiment, the light modulation unit 102 is a metasurface optical structure composed of an array of micro-nano units selected from at least one of a two-dimensional grating, a three-dimensional grating, or a cylindrical particle type metasurface.

[0046] In this specific embodiment, the micro display sub-module 101 is composed of a micro display screen composed of a micro display chip, a driving circuit and a power supply part, the micro display chip including one of Micro-LED, Micro-QLED, Micro-OLED, Micro-PeLED, Nano-LED, Nano-QLED, Nano-OLED, Nano-PeLED, and the micro display screen including a single-layer structure and a multi-layer structure.

[0047] It should be noted that the micro display chip includes but is not limited to a smart chip integrated with eye movement tracking function, a smart chip integrated with artificial intelligence automatic switching display information, a highly integrated chip capable of connecting multiple devices to switch display, etc. The micro display screen in the micro display sub-module is mainly used to generate the light information required by the proposed optical structure, and can integrate an eye movement tracking system. By identifying whether the human eye is tilted, the system can automatically switch between simple information prompts and complete light information. When the micro display screen in the micro display sub-module can integrate a light adjustment unit, the light adjustment unit can be integrated with the micro display sub-module. The integrated light adjustment unit can be a light modulation element larger than or equal to the clear aperture of the micro display sub-module directly covering the micro display sub-module, which can realize the functions of collimation and focusing of the entire light information, or it can be a single micro structure corresponding to each pixel point on the micro display sub-module, and each pixel point can be adjusted individually. In addition, it can also display additional images by interconnecting with other smart devices, including but not limited to navigation devices, image devices, alarm devices, and other display devices. When the micro display as a light source is a single-layer full-color structure, full-color display can be achieved by dispersing or closely arranging red, green, and blue three-primary-color pixels; or by using white light pixels in combination with three-color filters of corresponding sizes to achieve full-color display, or by using blue light pixels in combination with red and green quantum dots, red and green fluorescent powder, and red and green perovskite color conversion layers to achieve full-color display. In addition, red, green, and blue monochromatic light can be generated by using a micro-nano unit array structure to achieve color display. When the micro display screen is a multi-layer structure composed of multiple micro display screens, RGB full-color display can be achieved by stacking three micro display screens displaying red, green, and blue colors respectively; further, full-color display can also be achieved by combining a two-color micro display screen with another monochromatic micro display screen. When the micro display screen is composed of only a single layer and can only display monochromatic images, the display screen is composed of a micro display screen with collimating function, control chip, and driving power supply. If the structure is composed of only a single layer and can display full-color images, the micro display screen can be composed of a full-color light-emitting pixel with focusing function, a control chip, and a driving power supply. In addition, it can also be composed of a micro display screen with focusing function, a control chip, and a driving power supply. Further, the arrangement of the light-emitting pixels in the micro display screen can be a variety of planar array forms such as regular rectangular planar array, interpenetrating planar array, circular planar array, and rhombic planar array. At this time, the superimposed eye image is a synchronous image picture with different brightness or an image picture with different depth information. When the brightness of the external environment light changes, the display should automatically match and adjust the micro display brightness according to different lighting conditions.

[0048] In this specific embodiment, the device further comprises a dynamic adjustment unit, the eye tracking unit 108 is used to detect the rotation position of the human eye, and the dynamic adjustment module is used to adjust the focal length, optical axis or numerical aperture of the light path modulation structure according to the detection result, so as to realize the mydriasis effect; the eye tracking unit 108 is selected from at least one of an infrared eye tracking unit 108, an optical eye tracking unit 108 or a transparent image sensor, and the dynamic adjustment module comprises a programmable metasurface or a liquid crystal lens array.

[0049] In this specific embodiment, the smart temple can realize both information prompting function and slanted projection AR function, and the switching of the two functions depends on the eye tracking unit 108. When the information prompting function is realized, the smart temple provides simple light information such as specific color or flickering information, and at this time the human eye directly looks forward, and the eye point of the human eye is captured by the eye tracking unit 108; when the slanted projection AR function is realized, the smart temple emits complete image information, and at this time the human eye deviates the line of sight, and the eye point of the human eye is captured by the eye tracking unit 108.

[0050] In this specific embodiment, an artificial intelligence interaction module is further included, the artificial intelligence interaction module supports gesture recognition or voice recognition, and is used to control the switching of display content or the adjustment of optical parameters.

[0051] In this specific embodiment, the spectral range of the smart temple covers 400 nm to 700 nm, and the display color gamut is not less than 120% of the sRGB standard.

[0052] In this specific embodiment, when the smart temple works, when the human eye directly looks forward, only slow flickering light can be observed at the edge of the field of view of the human eye, the user is prompted by color transformation, and the human eye can completely observe the environmental information without obstruction; when the information prompting appears color transformation or flickering speedup, the user decides whether to deviate the eye point to view complete information, such as when the eye tracking unit 108 monitors the change of the eye point of the human eye, complete image information is provided.

[0053] In this specific embodiment, the shell of the smart temple can be made of the same material, or can be assembled by two or more different materials, the micro display screen and the light adjustment unit are packaged in the temple, and a light hole is reserved on the light emitting area of the shell or a transparent material is separately used at the light hole to ensure that the light beam cannot be blocked.

[0054] In this specific embodiment, the optical axis reflection deflection unit controls the exit angle of the image light, so that the included angle between the in-eye optical axis of the modulated image light and the line of sight axis of the user looking straight ahead is greater than or equal to 10°, thereby ensuring that the image light is imaged in the residual light area of the user's field of view without blocking the forward field of view.

[0055] It should be noted that the embodiment ensures that the picture can accurately enter the user's glasses, while not blocking the forward field of view.

[0056] In this specific embodiment, the optical element of the light modulation unit 102 includes one of a geometric lens, a liquid crystal lens, a microlens array, a metasurface with focusing function, and a physical optical superlens.

[0057] In this specific embodiment, when the optical element of the light modulation unit 102 is a single-piece first lens, the parameters of the first lens are defined by its geometric parameters and material properties, and the specific formula is: where f is the focal length of the first lens, n and n0 are the refractive indices of the material of the first lens and the incident end, respectively, and R1 and R2 are the radii of curvature of the incident end and the exit end of the first lens, respectively.

[0058] It should be noted that when a plano-convex lens is used, the above formula can be simplified as: The intelligent temple can also adjust the focal length and other optical information of the temple by adjusting the position of the micro display sub-module, which is determined by the Gaussian formula as follows: where f is the focal length, v is the image distance, and u is the object distance; when the intelligent temple realizes the entry into the eye by presenting a virtual image, it needs to satisfy u < f and the image and the object are on the same side of the principal plane. Therefore, the total optical length of the intelligent temple is composed of the focal length and the object distance, the object distance is the distance from the micro display sub-module to the light adjustment unit, and the focal length is the distance from the light adjustment unit to the eye. To meet the near-eye display requirements, the overall structure of the temple is determined by the lens curvature, the lens material, the distance from the lens to the eye, and the distance from the micro display sub-module to the lens.

[0059] In this specific embodiment, when the optical element of the light modulation unit 102 is a single-piece second lens, the corresponding condensed image light satisfies where θ represents the half convergence angle of the focused light, D represents the diameter of the incident light beam, n represents the refractive index of the material at the exit end of the second lens, and R1 and R2 are the radii of curvature of the incident end and the exit end of the second lens, respectively.

[0060] It should be noted that when the light adjustment unit of the temple uses a superlens, the above formula should be modified as: where μ represents the object distance, v represents the distance (determines the focal point position), λ represents the wavelength, the rotation angle gradient is represented by C, and △φres represents the processing error.

[0061] The dynamic adjustable light path sub-module further includes a refractive optical axis deflection unit for deflecting the condensed image light into the user's eye by refractive means; the refractive optical axis deflection unit includes at least one of a liquid crystal lens, a metasurface with beam deflection function, and a physical optical superlens.

[0062] It should be noted that the optical axis reflection deflection unit and the refractive optical axis deflection unit both realize the function of deflecting the image light after beam narrowing to make it enter the user's eyes. Both of them include but are not limited to geometric optical lens, liquid crystal lens, microlens array, metasurface with focusing function, physical optical superlens, etc. When the optical elements are all or partially liquid crystal lenses, the liquid crystal lenses can be single-piece liquid crystal lenses, double-layer or multi-layer liquid crystal lenses, or a liquid crystal lens array composed of multiple small liquid crystal lenses arranged closely, etc. The driving electrode material of the liquid crystal lens used can be indium tin oxide (ITO) or other transparent electrode materials with good conductivity. The structure of the driving electrode includes but is not limited to the commonly used single-hole electrode type, strip electrode type, ring-disk electrode type, and other improved electrode structures that facilitate the realization of the lens function in the light adjustment unit and the compensation module. Liquid crystal lenses are used as inspiration to expand to other optical components with variable focal length, which belongs to the scope of the present patent. Further, the optical structure can be a programmable metasurface or other artificial super materials combined with machine learning artificial intelligence, which can adjust the focusing and deflection direction in combination with sensing devices, thereby ensuring the dynamic adjustment of the entire optical system.

[0063] In this specific embodiment, when the optical element is a single lens, the element adjusts the depth, size, and brightness information of the image observed by the human eye by adjusting the refractive index parameters of the optical element and the position of the optical element in the optical path. When the optical element is multiple pieces, the light adjustment unit adjusts the depth, size, and brightness information of the image by adjusting the front and back positions of different elements, replacing elements, adjusting the refractive index parameters of the optical element, etc.

[0064] In this specific embodiment, the adjustable mirror 103 is a two-dimensional torsional MEMS mirror, and the two axes of the two-dimensional torsional MEMS mirror are controlled by corresponding voltages to make it deflect in the pitch and yaw dimensions.

[0065] In this specific embodiment, the control unit is configured to support at least two display modes:

[0066] Peripheral light prompt mode: when the eye tracking unit 108 detects that the user's gaze is directly in front, the control micro display sub-module 101 displays simplified prompt information, and the image light is maintained in the peripheral light area of the user's field of view;

[0067] Full information mode: when the eye tracking unit 108 detects that the user's eye turns to the display area, the control micro display group module displays complete information, and drives the optical axis reflection deflection unit to move the image light to the center of the user's field of view.

[0068] In this specific embodiment, the adjustable mirror 103 can adjust the size of the image by controlling the concave-convex degree of the mirror. Since the focal length f of the spherical mirror is only determined by the radius of curvature R, unlike the lens which needs to consider the refractive index of the material, the formula of the focal length is: When the mirror is a concave mirror, the spherical center C and the focal point f are on the side of the incident light, the radius of curvature R > 0, the focal length f > 0, and the light rays can be converged. When the mirror is a convex mirror, the spherical center C and the focal point f are on the side of the reflected light extension line, the radius of curvature R < 0, the focal length f < 0, and the light rays can be diverged. At this time, the convergence and divergence angles of the reflected light are also defined by the concave-convex degree of the mirror, and the specific definition is as follows: let the vertex of the mirror be the origin O, the principal axis be the x-axis, the spherical center C be at x = R, R < 0, let the height of the incident light be h, and the coordinates of the incident point P be approximately (0, h), the intersection of the reflected light ray extension line and the principal axis is the virtual focal point F, because the focal length satisfies Therefore, the convergence and divergence angles of the reflected light satisfy h = |f||β|. When the reflected light is diverged, the diameter of the light hole of the intelligent mirror leg should be greater than or equal to the diameter of the light spot of the diverged light or transparent material is used at the light hole to ensure that the light information can be unobstructed into the eye. When the adjustable mirror 103 is a super surface or a grating structure with reflection function, the deflection angle of the light can be additionally controlled by adjusting the structure parameters. The function of this module is to reflect the light information that meets the near-eye display after being adjusted by the light adjustment unit to the post-processing module through the adjustable mirror 103.

[0069] The embodiment of the present application can operate independently or cooperatively with other intelligent modules through the integrated module in specific applications, has functional expandability, and includes but is not limited to image devices, audio devices, car devices, intelligent helmets, intelligent glasses, etc. When combined with image devices, the system can dynamically modulate and call image device lenses. When the integrated module is combined with audio devices, the system parameters can be adjusted according to voice instructions. When the integrated module is combined with car devices, the car system information can be called to display key information such as navigation and vehicle remaining power. The integrated module can be placed in the proposed intelligent temple optical structure or externally placed on the outside of the intelligent temple or other positions through magnetic attraction. The eye tracking unit includes but is not limited to infrared eye tracking, optical eye tracking, and transparent image sensors. The augmented reality near-eye display intelligent temple optical structure can be clamped by a specific mechanical structure, placed in a helmet, glasses, or other wearable devices, and adjusted in real time according to eye tracking and mechanical structure to achieve the effect of pupil expansion. Similarly, magnetic materials can be combined with the optical structure to achieve the effect of pupil expansion by generating a specific magnetic field on the helmet, glasses, and adjusting the position of the optical structure through eye tracking. When the optical structure is combined with optical waveguide augmented reality glasses, transparent display smart head-mounted devices, and geometric optical smart head-mounted devices, the optical structure needs to be adjusted in the additional light path to achieve functions including but not limited to image splicing, display conversion, light information superposition, and image depth modulation. When the optical structure is applied to non-intelligent glasses, it can be adsorbed on the glasses frame through magnetic attraction. The optical module can be interconnected with other intelligent devices through the integrated module line of sight, and the functions include but are not limited to calling car camera, calling car sensor parameters when the optical structure is interconnected with the car intelligent system; integrating audio and AI to achieve voice control when the optical structure is interconnected with a smart phone; achieving underwater warning and information exchange when the optical structure is interconnected with a diving wearable device; and displaying health index parameters in medical devices in real time when the optical device is interconnected with medical glasses.

[0070] In this specific embodiment, the light adjustment unit of the temple can have other optical lenses (including but not limited to traditional myopia, hyperopia, focusing, and blue light correction optical lenses) between the human eye. At this time, the light adjustment unit should extend beyond the area of the frame 107, and display information by changing the reflection of the light path element and passing through the optical lens into the eye. At this time, the light adjustment unit should have compensation elements to optimize corresponding to myopia, hyperopia, focusing, and blue light correction. Other optical lenses can provide additional functions including but not limited to focal length reconstruction and magnification multiplication for the intelligent temple. When the other optical lens is a single plano-convex lens, the overall focal length F of the optical system in the intelligent temple can be represented as: Where f1 and f2 are the focal lengths of the optical adjustment unit and the other optical lens respectively, and d is the distance between the two. When the other optical lens is a plurality of thin lenses and the distance is much smaller than the thickness of the lenses, the other optical lens can be regarded as a lens, and the combined focal length F1 can be defined as: The system magnification can be defined by the formula D is the total length of the intelligent temple optical system plus the distance from the optical system to the human eye, and F is the equivalent focal length of the entire intelligent temple. Further, at this time, the optical path elements can be adjusted to other angles to reflect the display information to other inclined positions into the eye, and other elements can also be set to realize image splicing and superposition. The other elements can include but are not limited to optical elements with magnification function, optical gratings that can deflect light beams, lens elements that can focus light beams, etc., to additionally realize image magnification, deflection of image angle into the eye, and depth information, etc.

[0071] In this specific embodiment, the intelligent temple shell can be made of the same material, or can be assembled by two or more different materials, and the micro display screen and the optical adjustment unit are packaged in the temple. A light hole should be reserved at the light exit area of the shell or a transparent material should be used separately at the light exit hole to ensure that the light beam into the eye cannot be blocked. Whether integrated or made of multiple materials, the refractive index should be considered when designing each component.

[0072] In this specific embodiment, when the intelligent temple is applied to a head-mounted smart device, the reflection angle can be adjusted to the frame 107, and additional light modulation elements can be placed on the frame 107 to guide the light emitted from the single temple to the center of the pupil of the other eye, realizing binocular unified imaging. It can also be directly installed on both sides to perform separate imaging. In addition, the optical structure can also display images to the left eye or the right eye alone. At the same time, the optical system can also display different image information to the left eye and the right eye at the same time to realize stereoscopic display, and the optical structure can combine infrared cameras, zoom cameras, etc. Special lenses to switch display / project infrared images, long-range images, close-range images, etc. It can be applied to military tactical helmets, etc.; The head-mounted near-eye display device made of the optical structure, such as smart glasses, smart helmets, etc., can be combined with sensors and cameras to capture iris information, realize identity verification and health monitoring, etc.

[0073] In this specific embodiment, the intelligent temple is configured to be paired with another identical temple for use, and displays images with parallax to the user's left eye and right eye respectively to realize stereoscopic display.

[0074] Further, as shown in Figure 2 Figure 2 ​The middle right intelligent temple extends forward to block part of the right field of view, and the light information emitted by the right micro display screen can be spliced or superimposed with the projection image emitted by the left micro display screen in the left eye field of view after light path modulation and optical axis design.

[0075] Figure 2 The schematic diagram of the symmetrical structure applied in glasses, Figure 2 In the middle, 101 is the left micro display submodule, 102 is the left light modulation unit, 103 is the left adjustable mirror, 104 is the left modulated image light, 105 is the left eye, 106 is the ambient light, 107 is the frame, 108 is the eye tracking unit. 209: right modulated image light. 210: projection light information spliced / overlaid with left projection light information after reflection, 211: right micro display submodule, 212: right light modulation unit, 213: right adjustable mirror.

[0076] Figure 2 In the middle, when the intelligent temple works, the right micro display screen emits light information, which passes through the right light adjustment unit. In addition to modulating the focal length of the light signal, the right light modulation unit can also eliminate the depth of field difference of the right two light information. The right mirror can reflect the right light information to the mirror on the left frame. After the light is deflected again, it enters the eye together with the left light information. At this time, the human eye can observe the image above and to the left. The eye movement tracking device function is the same as in the first embodiment.

[0077] In this embodiment, the intelligent temple is connected with the car system. When the user wears the intelligent temple, the vehicle-mounted system adjusts the information prompt signal of the intelligent temple according to the radar information at the blind area. The chip of the intelligent temple micro display screen and the eye tracking unit together control the display content of the intelligent temple.

[0078] When there is no obstruction in the visual blind area when the user is driving the vehicle, the micro display screen in the intelligent temple is in standby sleep state, saving energy.

[0079] When there is an obstruction in the visual blind area when the user is driving the vehicle, the micro display screen in the intelligent temple emits a flickering light spot. After the light information passes through the collimating optical element and the light adjustment unit, it is deflected by the mirror into the eye.

[0080] When there is an obstruction in the visual blind area when the user is driving the vehicle, the user finds that the intelligent temple is providing information prompts in the peripheral light area. The user deflects the line of sight. At this time, the eye tracking unit detects the change of the user's visual point. The micro display screen chip displays the visual blind area image provided by the car system radar according to the eye tracking unit detection information. The user can observe the visual blind area image by only deflecting the line of sight, and the intelligent detection blind area safety situation.

[0081] It should be noted that, asFigure 3 As shown, when the intelligent mirror leg is connected with the vehicle machine system, Figure 3 The external device 319 in the vehicle machine system 310 is connected with the integrated module.

[0082] The embodiment of the application ensures that display information is always projected into the eye from the side of the field of view (the angle with the normal axis is greater than or equal to 10 degrees) through the oblique incidence optical architecture. When the user directly looks forward, the main field of view is completely free of any virtual information obstruction, solving the problem that mainstream AR glasses easily cause interference in the scene where the user needs to be highly concentrated.

[0083] The embodiment of the application discards the light waveguide technology with serious light energy loss, and adopts free space light path design based on geometric optics or super surface, so that the light energy utilization rate is greatly improved. This not only directly brings higher display brightness and longer battery life, but also fundamentally reduces the heat generation of the system, and improves the wearing comfort and equipment reliability.

[0084] The picture position of the traditional near-eye display device is fixed, and the user needs to actively move the line of sight to a specific area to see clearly, which is harsh and easy to cause eye and neck fatigue. The embodiment of the application realizes that the display picture follows the eye movement in real time through the cooperation of the adjustable mirror 103 and the eye tracking. When the user moves the line of sight, the picture can intelligently adjust the position and always remain in the comfortable area of the field of view. This makes the interaction change from “people actively adapt to equipment” to “equipment intelligently adapt to people”, greatly reducing the visual and cognitive load caused by searching for targets and repeatedly focusing, and the observation is smooth and natural, and it is not easy to be tired after long time use.

[0085] The embodiment of the application integrates eye tracking and dynamic adjustable light path (such as MEMS micromirror), realizes intelligent switching of display mode and real-time following of the picture. Through the double-mode interaction logic of “remaining light prompt-active viewing”, complete information can be provided when needed, and the interaction process does not need to be manually and intuitively natural, which greatly improves the user experience.

[0086] The embodiment of the application highly integrates functions such as camera shooting, display, calculation and communication in a single mirror leg, and through modular design, it can be flexibly adapted to various glasses worn by users in daily life. Such a form greatly improves the universality and user acceptance of the product. At the same time, the platform provides the possibility for integrating more sensors and AI functions, and the scalability is excellent.

[0087] Thanks to the micro-nano optical elements and highly integrated optical and mechanical design, the entire optical system can be packaged in a light mirror leg, the overall weight is greatly reduced compared with traditional AR equipment, the appearance is closer to daily glasses, and the smart wearable device is realized. The pursuit of normalization.

[0088] In conclusion, the embodiment of the present application realizes the non-occlusion of ambient light, improves the energy utilization rate and miniaturization, and further ensures the comfort of the user.

[0089] It should be noted that the relational terms herein such as first and second and the like are used solely to distinguish one from another entity or action, without necessarily requiring or implying any actual relationship or order between such entities or actions. Moreover, the terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by "comprises... a" does not, without more constraints, exclude the existence of additional identical elements in the process, method, article, or apparatus that comprises the element.

[0090] Each of the embodiments in the present specification is described in a relevant manner, and the same or similar parts between the embodiments can be referred to each other. Each embodiment focuses on the difference from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the part of the method embodiment.

[0091] The above only describes the preferred embodiments of the present application and is not intended to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A smart temple with an obliquely projecting eye display, characterized in that, The smart temples include: The temple body is configured to be attached to the frame via a detachable structure; The temple near-eye display module is integrated on the temple body and includes a micro-display sub-module and a dynamically adjustable optical path sub-module. The micro-display submodule is used to generate image light according to the display signal; The dynamically adjustable light path submodule is used to receive and modulate the image light emitted by the microdisplay submodule, and project the image light into the eye at a direction inclined to the user's line of sight; the dynamically adjustable light path submodule includes: The optical modulation unit includes at least one optical element for changing the direction of the optical axis, used for collimating and beam-contracting the image light; An optical axis reflection deflection unit is used to deflect the compressed image light so that it enters the user's eye; the optical axis reflection deflection unit includes an adjustable mirror, which dynamically adjusts the exit angle of the image light through electronic deflection. An eye-tracking unit is used to acquire the user's eye posture data in real time; The control unit, electrically connected to the optical axis reflection deflection unit and the eye tracking unit, is configured to generate a control signal based on the eye posture data to drive the optical axis reflection deflection unit and dynamically adjust the entry position and angle of the image light into the eye.

2. The intelligent temple with oblique eye-viewing display according to claim 1, characterized in that, The optical axis reflection deflection unit controls the emission angle of the image light so that the angle between the entrance optical axis of the modulated image light and the line of sight of the user looking straight ahead is greater than or equal to 10°, thereby ensuring that the image light is imaged in the user's peripheral vision area without obstructing the direct line of sight.

3. The intelligent temple with oblique eye-viewing display according to claim 1, characterized in that, The micro-display submodule consists of a micro-display screen composed of micro-display chips, a driving circuit, and a power supply section. The micro-display chips include one of Micro-LED, Micro-QLED, Micro-OLED, Micro-PeLED, Nano-LED, Nano-QLED, Nano-OLED, and Nano-PeLED. The micro-display screen includes single-layer and multi-layer structures.

4. The intelligent temple with oblique eye-viewing display according to claim 1, characterized in that, The optical elements of the optical modulation unit include one of the following: a geometrical light lens, a liquid crystal lens, a microlens array, a metasurface with focusing function, and a physical optical metalens.

5. The intelligent temple of the oblique-view display according to claim 1, characterized in that, When the optical element of the optical modulation unit is a monolithic first lens, its parameters are defined by the geometric parameters and material properties of the first lens, and the specific formula is as follows: Where f is the focal length of the first lens, n and n0 are the refractive indices of the first lens material and the incident end material, respectively, and R1 and R2 are the radii of curvature of the incident end and the exit end of the first lens, respectively.

6. The intelligent temple with oblique eye-viewing display according to claim 1, characterized in that, When the optical element of the optical modulation unit is a monolithic second lens, the corresponding beam-constricted image light satisfies Where θ represents the half-convergence angle of the focused light, D represents the diameter of the incident beam, n represents the refractive index of the material at the exit end of the second lens, and R1 and R2 are the radii of curvature at the incident and exit ends of the second lens, respectively.

7. The intelligent temple of the oblique-view display according to claim 1, characterized in that, The dynamically adjustable optical path submodule further includes: a refractive optical axis deflection unit, used to deflect the compressed image light through refraction so that it enters the user's eye; the refractive optical axis deflection unit includes at least one of a liquid crystal lens, a metasurface with beam deflection function, and a physical optical metalens.

8. The intelligent temple of the oblique-view display according to claim 1, characterized in that, The adjustable mirror is a two-dimensional torsional MEMS micromirror. The two axes of the two-dimensional torsional MEMS micromirror are controlled by corresponding voltages, so that it can deflect in both pitch and yaw dimensions.

9. The intelligent temple of the oblique-view display according to claim 1, characterized in that, When the optical element is a single lens, the element adjusts the depth, size, and brightness information of the image that can be observed by the human eye by adjusting the refractive index parameter of the optical element and the position of the optical element in the optical path; when the optical element is multiple, the light adjustment unit adjusts the depth, size, and brightness information of the image by adjusting the front and rear positions of different elements, replacing elements, and adjusting the refractive index parameter of the optical elements.

10. The intelligent temple with oblique eye-viewing display according to claim 1, characterized in that, The control unit is configured to support at least two display modes: Peripheral light prompt mode: When the eye-tracking unit detects that the user is looking straight ahead, it controls the micro-display submodule to display simplified prompt information and keeps the image light in the peripheral light area of ​​the user's field of vision; Full Information Mode: When the eye-tracking unit detects that the user's eye is turning towards the display area, it controls the micro-display module to display full information and drives the optical axis reflection deflection unit to move the image light to the center of the user's field of vision.

Images