Diffraction waveguide display system, adjustment method, vehicle-mounted HUD and AR glasses
By combining an adjustable optical engine module and an eye-tracking module, the incident position of the light beam is adjusted in real time, solving the problems of light energy loss and image loss caused by changes in eye position in the diffractive waveguide system. This achieves efficient light energy utilization and a wide field of view display, thus improving the user experience.
Patent Information
- Application Number
- CN202611614257.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-10-19
- Publication Date
- 2026-11-17
AI Technical Summary
Existing diffractive waveguide systems suffer from light energy loss, image loss, and color inconsistencies due to changes in the observer's eye position causing the light beam to deviate from the entrance pupil. Furthermore, they are unable to meet the requirements of a large field of view, resulting in low light energy utilization and negatively impacting the user experience.
The system combines an adjustable optomechanical module and an eye-tracking module. The eye-tracking module acquires real-time images of the observer's eyes, and the control unit adjusts the posture of the optomechanical module based on the eye position information. This ensures that the exit pupil formed after the beam is transmitted within the waveguide substrate is aligned with the observer's eyes. The design of the long strip-shaped coupling grating provides a margin of space for changes in the posture of the optomechanical module.
It effectively solves the problems of light energy loss and image loss caused by beam deviation from the entrance pupil, improves light energy utilization and eye position adaptation range, and enhances the user experience.
Smart Images

Figure CN123113075A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of optical display technology, and more specifically, to a diffraction waveguide display system, an adjustment method, an in-vehicle HUD, and AR glasses. Background Technology
[0002] With the rapid development of in-vehicle driver assistance and augmented reality (AR) technologies, head-up displays (HUDs) and head-mounted display devices have become key carriers for enhancing information interaction experiences. Diffractive waveguide technology, with its advantages of being lightweight, thin, and having a large potential field of view, is gradually replacing traditional reflective optical solutions. However, in practical applications, due to individual differences among observers (such as height and posture) and the unavoidable external vibrations that affect the device during operation, the observer's eye position will shift in real time.
[0003] Existing diffractive waveguide systems typically employ a fixed assembly method between the optomechanic and the waveguide. This rigid structure limits the system's display area (i.e., the eye-box range). When the observer's eye position shifts significantly, due to the lack of an effective feedback adjustment mechanism, the emitted light from the optomechanism often fails to accurately couple into the waveguide's effective transmission area, leading to increased light energy loss. This results in problems such as a sudden drop in screen brightness, uneven color distribution, and even partial image loss. Furthermore, traditional solutions often rely on increasing the physical size of optical components to meet the demands of large field-of-view applications. This not only increases the overall size and weight of the structure but also leads to low light energy utilization, severely impacting the user's immersion and display consistency, and failing to meet the practical needs of current high-dynamic and complex application scenarios. Summary of the Invention
[0004] This application provides a diffractive waveguide display system, an adjustment method, an in-vehicle HUD, and AR glasses, which can improve the eye position adaptation range of the diffractive waveguide display system.
[0005] In a first aspect, embodiments of this application provide a diffractive waveguide display system, the diffractive waveguide display system comprising: a waveguide substrate, an optomechanical module, an eye-tracking module, and a control unit; The optical-mechanical module's output port faces the waveguide substrate, and the waveguide substrate is provided with an elongated coupling grating. The optical-mechanical module is configured to project a light beam onto the elongated coupling grating. The output angle and / or relative position of the optical-mechanical module are adjustable so that the incident position of the light beam on the elongated coupling grating changes accordingly. The dimension of the elongated coupling grating in the length direction is larger than the dimension of the output light spot of the optical-mechanical module in the length direction when it is located on the elongated coupling grating. The optomechanical module is configured to project a light beam onto the elongated coupling grating, and the light output angle and / or relative position of the optomechanical module are adjustable so that the incident position of the light beam on the elongated coupling grating changes accordingly. The field of view of the eye-tracking module shall at least cover: a position that can acquire the observer's eye area to acquire the observer's eye image, for real-time acquisition of the observer's eye position information; The control unit is connected to the eye-tracking module and the optomechanical module respectively, and is used to control the optomechanical module to perform attitude adjustment according to the eye position information of the eye image, so that the exit pupil formed after the beam is transmitted in the waveguide substrate is aligned with the observer's eye.
[0006] Optionally, the optical engine module includes: a base, an optical engine body, and a driving component; the driving component includes a coarse adjustment driving module and a fine adjustment driving module; The coarse adjustment drive module is fixedly mounted on the base, the fine adjustment drive module is fixedly mounted above the coarse adjustment drive module, and the optical engine body is fixedly mounted above the fine adjustment drive module. The control unit is connected to both the coarse adjustment drive module and the fine adjustment drive module.
[0007] Optionally, the number of optomechanical modules in the diffraction waveguide display system is two or more; The light output ports of the two or more optical engine modules are respectively oriented towards different positions disposed on the elongated coupling grating, and the two or more optical engine modules are respectively configured to project light beams to different sections of the elongated coupling grating; The control unit is connected to two or more of the aforementioned optical engine modules and is used to control the two or more optical engine modules to work alternately in a time-division multiplexing manner so as to stitch together a wide field-of-view image at the exit pupil.
[0008] Secondly, embodiments of this application also provide an adjustment method for a diffraction waveguide display system, applied to a control unit in the diffraction waveguide display system as described in any of the first aspects, the method comprising: The observer's eye images are acquired through an eye-tracking module; The eye image is analyzed to obtain the three-dimensional coordinates of the observer's pupil; Based on the three-dimensional coordinates of the observer's pupil and the preset reference eye position coordinates, calculate the offset of the observer's eye position relative to the reference eye position. The optimal optomechanical attitude is determined based on the offset and the preset eye position and attitude mapping model. According to the optimal optomechanical attitude, the optomechanical module is controlled to adjust its attitude so as to project the light beam to the corresponding position of the elongated coupling grating, so that after the light beam is coupled into the waveguide substrate through the elongated coupling grating for transmission, the resulting exit pupil is aligned with the observer's eye.
[0009] Optionally, determining the optimal optomechanical attitude based on the offset and a preset eye position and attitude mapping model includes: Based on the offset and the eye position and attitude mapping model, generate two or more candidate optomechanical attitudes; Calculate the color uniformity index corresponding to each of the candidate optomechanical postures; Based on the color uniformity index and preset color uniformity threshold corresponding to each candidate optical mechanism posture, each candidate optical mechanism posture is screened to determine the candidate optical mechanism posture that meets the preset color uniformity threshold. Among the candidate optomechanical postures that meet the preset color uniformity threshold, the exit pupil brightness corresponding to each candidate optomechanical posture is compared. The candidate optomechanical attitude with the highest exit pupil brightness is selected as the optimal optomechanical attitude.
[0010] Optionally, the optimal optomechanical attitude includes the tilt angle and longitudinal translation distance of the optomechanical body relative to the elongated coupling grating; the step of controlling the optomechanical module to adjust its attitude according to the optimal optomechanical attitude includes: Based on the longitudinal translation distance, the coarse adjustment drive module drives the fine adjustment drive module above it and the entire optomechanical body to perform a longitudinal translation: After completing the longitudinal translation, the fine-tuning drive module is controlled to drive the optomechanical body to adjust the tilt angle according to the tilt angle.
[0011] Optionally, after the control optomechanical module performs attitude adjustment, the method further includes: The observer's current eye position information is re-acquired through the eye-tracking module; Based on the current eye position information, determine whether the current offset of the current eye position relative to the reference eye position exceeds a preset offset threshold. If the offset threshold is exceeded, the step of determining the optimal optomechanical attitude based on the offset and the preset eye position and attitude mapping model is re-executed.
[0012] Optionally, the method further includes: Control two or more of the aforementioned optomechanical modules to project light beams into different sections of the elongated coupling grating in different orientations; Control two or more of the aforementioned optomechanical modules to work cyclically in a time-division multiplexing manner, so as to use the visual persistence effect to stitch together two or more images with different field of view into a complete wide field of view image; After acquiring eye position information, the tilt angles of two or more optical engine modules are adjusted in real time according to changes in eye position, so that the center of the spliced field of view is aligned with the observer's gaze point.
[0013] Thirdly, embodiments of this application also provide an in-vehicle HUD, the in-vehicle HUD including the diffractive waveguide display system as described in any of the first aspects; The diffraction waveguide display system is installed inside the vehicle's dashboard; the eye-tracking module is located on the dashboard housing facing the driver's eyes; the light output port of the optomechanical module faces the vehicle's windshield.
[0014] Fourthly, embodiments of this application also provide AR glasses, the AR glasses including a frame and a diffractive waveguide display system as described in any of the first aspects.
[0015] This application provides a diffractive waveguide display system, adjustment method, vehicle-mounted HUD, and AR glasses. The diffractive waveguide display system mainly consists of a waveguide substrate, an optomechanical module, an eye-tracking module, and a control unit. The optomechanical module's output port faces the waveguide substrate and is used to project a light beam onto a long strip-shaped coupling grating on the waveguide substrate. The length dimension of the long strip-shaped coupling grating is larger than the length dimension of the output light spot of the optomechanical module when it is located on the long strip-shaped coupling grating, thus providing sufficient space for the incident position shift caused by changes in the optomechanical module's attitude. Simultaneously, the output angle and / or relative position of the optomechanical module are adjustable, thereby actively changing the incident position of the light beam on the long strip-shaped coupling grating. Furthermore, the eye-tracking module's field of view covers at least the observer's eye area to acquire real-time images of the observer's eyes. The control unit connects to both the eye-tracking module and the optomechanical module, controlling the optomechanical module's attitude adjustment based on the acquired eye images. This dynamically matches the optical path, ensuring that the exit pupil formed after the beam propagates within the waveguide substrate is always aligned with the observer's eyes. The design of the elongated coupling grating and the adjustable exit beam angle and position of the optomechanical module provides ample margin for beam incident position deviation, effectively solving the problem of light energy loss and image loss caused by beam deviation from the entrance pupil due to optomechanical tilt in existing technologies, thus improving light energy utilization. Simultaneously, the closed-loop coordination between the eye-tracking module and the control unit actively controls the optomechanical module's dynamic attitude adjustment based on real-time acquired eye images, ensuring the exit pupil is always aligned with the observer's eyes, significantly improving the eye alignment range and user experience. Attached Figure Description
[0016] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.
[0017] Figure 1 This is a schematic diagram of a conventional waveguide layout provided in an embodiment of this application; Figure 2 This is a schematic diagram of the optical path when the optomechanic is in a horizontal position, as provided in an embodiment of this application. Figure 3 This is a schematic diagram of the optical path during optical engine tilting and translation provided in the embodiments of this application; Figure 4 This is a schematic diagram of the structure of a diffraction waveguide display system provided in an embodiment of this application; Figure 5 This application provides a schematic diagram of the hierarchical structure of an optomechanical module in a diffraction waveguide display system. Figure 6 This is a schematic diagram of the optomechanical driving structure provided in the embodiments of this application; Figure 7 This is a schematic diagram of the combination of a piezoelectric ceramic actuator and an optomechanic provided in an embodiment of this application; Figure 8 This is a schematic diagram of another diffraction waveguide display system provided in an embodiment of this application; Figure 9 A schematic diagram of the multi-optical-mechanical waveguide grating layout provided in an embodiment of this application; Figure 10 This is a schematic diagram illustrating a usage scenario of an in-vehicle HUD provided in an embodiment of this application; Figure 11 A schematic diagram of a waveguide grating layout for AR glasses provided in an embodiment of this application; Figure 12 A schematic flowchart illustrating an adjustment method for a diffraction waveguide display system provided in an embodiment of this application; Figure 13 A flowchart illustrating the multi-objective optimization process in an adjustment method for a diffraction waveguide display system provided in an embodiment of this application; Figure 14 A schematic diagram of the two-degree-of-freedom driven adjustment process in an adjustment method for a diffraction waveguide display system provided in an embodiment of this application; Figure 15 A schematic diagram of the closed-loop feedback adjustment process in an adjustment method for a diffraction waveguide display system provided in an embodiment of this application; Figure 16This is a schematic diagram of the process of multi-optical-mechanical time-division multiplexing splicing in the adjustment method of a diffraction waveguide display system provided in an embodiment of this application. Detailed Implementation
[0018] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. The components of the embodiments of this application described and shown in the accompanying drawings can generally be arranged and designed in various different configurations.
[0019] Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely to illustrate selected embodiments of the application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.
[0020] It should be noted that similar labels and letters in the following figures indicate similar items. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures.
[0021] Before providing a detailed explanation of this application, let's first introduce its application scenarios.
[0022] Diffraction waveguide display systems belong to near-eye display optical systems and can be adapted to various display applications that require projecting virtual images directly in front of the viewer's eyes. In actual use, due to various real-world factors such as individual user differences, equipment assembly deviations, equipment vibration and impact, and user posture changes, the observer's eye position may dynamically shift. When the eye position deviates from the ideal observation position, the optical exit pupil and the viewer's eye become misaligned, resulting in undesirable display phenomena such as partial image loss, reduced brightness, and uneven color distribution within the field of view.
[0023] Figure 1 This is a schematic diagram of a conventional waveguide layout provided in an embodiment of this application. In the prior art, a fixed-position optomechanism is typically used in conjunction with a fixed-area grating and pupil expander structure; the output angle and relative position of the optomechanism are not adjustable. The output port of the optomechanism and the entrance pupil area on the waveguide substrate are similar, such as... Figure 1 As shown, light enters the waveguide substrate through the entrance pupil and is then transmitted to the exit pupil via the pupil expansion structure. When it is necessary to adapt to changes in the eye position of different observers (such as differences in driver height and seat position adjustment in a car HUD) or to expand the field of view, existing technologies can only passively accommodate the optomechanical exit pupil by increasing the area of the grating and pupil expansion structure.
[0024] Figure 2 This is a schematic diagram of the optical path when the optomechanic is in a horizontal position, as provided in an embodiment of this application. Figure 2 As shown, when the exit angle of the optical engine is consistent with the coupling angle of the waveguide design, the beam is in a forward horizontal propagation state, and can completely and smoothly enter the small entrance pupil area, and propagate to the exit pupil along the preset path. This indicates that the existing solution can only guarantee good display results under the ideal condition where the relative positions of the optical engine and the waveguide are fixed.
[0025] Figure 3 This is a schematic diagram of the optical path during tilting and translation of the optomechanical system, as provided in an embodiment of this application. (Combined with...) Figure 2 and Figure 3 It is known that if the observer's eye position changes, the optical engine will tilt and longitudinally shift to adapt to the new eye position, altering the direction of beam propagation. Some light rays will deviate directly from the effective range of the expanded pupil area, resulting in light energy loss, image defects, or color inconsistencies. Furthermore, due to the small entrance pupil size, the beam emitted by the optical engine is prone to deviating from the effective area. In addition, it can be seen that simply increasing the entrance pupil area, due to the changed angle of light incidence, still cannot ensure that the beam completely enters the expanded pupil area, resulting in poor eyebox utilization and poor display consistency. The eyebox is the three-dimensional observation space defined by the diffraction waveguide display system; when the observer's eye is within this three-dimensional observation space, the entire virtual image can be observed completely; when the eye extends beyond the boundary of this three-dimensional observation space, display defects such as image defects, decreased brightness, and degraded color consistency will occur.
[0026] Addressing the shortcomings of existing technologies where simply increasing the area or using rigid adjustment with a small entrance pupil fails to balance adjustment range and light energy utilization, this application provides a diffraction waveguide display system, adjustment method, automotive HUD, and AR glasses. The diffraction waveguide display system mainly comprises a waveguide substrate, an optomechanical module, an eye-tracking module, and a control unit. The optomechanical module's output port faces the waveguide substrate, projecting a light beam onto a long strip-shaped coupling grating on the waveguide substrate. The length dimension of the long strip-shaped coupling grating is larger than the length dimension of the output light spot of the optomechanical module when it is located on the long strip-shaped coupling grating, thus providing sufficient space for the incident position shift caused by changes in the optomechanical module's attitude. Simultaneously, the output angle and / or relative position of the optomechanical module are adjustable, thereby actively changing the incident position of the light beam on the long strip-shaped coupling grating. In addition, the eye-tracking module's field of view covers at least the observer's eye area to acquire real-time images of the observer's eyes. The control unit is connected to both the eye-tracking module and the optomechanical module. Based on the acquired eye images, it controls the optomechanical module to adjust its posture, thereby dynamically matching the optical path. This ensures that the exit pupil formed after the beam propagates within the waveguide substrate is always aligned with the observer's eyes. This effectively solves the problem of light energy loss and image loss caused by the beam deviating from the entrance pupil due to optomechanical tilt in existing technologies. It improves light energy utilization and ensures that the exit pupil is always aligned with the observer's eyes, significantly improving the eye position adaptation range and the user experience.
[0027] The present application will now be described in detail with reference to the accompanying drawings and several embodiments.
[0028] Figure 4 This is a schematic diagram of the structure of a diffraction waveguide display system provided in an embodiment of this application. Figure 4 As shown, the diffraction waveguide display includes: a waveguide substrate, an optomechanical module, an eye-tracking module, and a control unit. The light-emitting port of the optomechanical module faces the waveguide substrate, which has an elongated coupling grating. The optomechanical module is configured to project a light beam onto the elongated coupling grating, and its emission angle and / or relative position are adjustable to change the incident position of the light beam on the elongated coupling grating accordingly.
[0029] Specifically, the optical engine module is used to generate and project a beam carrying image information. It can be a micro-projection optical engine, specifically a micro-projection optical engine based on a micro-light-emitting diode (Micro-LED) solution, or a micro-projection optical engine based on a liquid crystal on silicon (LCoS) or digital light processing (DLP) solution. This application does not limit the specific projection scheme of the optical engine module. The elongated coupling grating has a length direction and a width direction perpendicular to that length direction. The length dimension of the elongated coupling grating is larger than the length dimension of the output beam spot of the optical engine module when it is located on the elongated coupling grating, thus reserving sufficient space for translation and tilt adjustment of the optical engine module in the length direction. Simultaneously, the width dimension of the elongated coupling grating matches the output port size of the optical engine module (e.g., equal to or slightly larger than the output port diameter). This width design ensures that the beam projected by the optical engine in the width direction can be completely covered, and the beam will not be truncated or wasted in the width direction, thus ensuring the integrity of the light energy when entering the waveguide.
[0030] When the optical engine tilts and translates longitudinally, the incident position of the beam on the long strip-shaped coupling grating (entrance pupil) will shift accordingly. However, since the entrance pupil has sufficient extension space in the length direction, the beam can always be completely illuminated in the effective diffraction area.
[0031] The eye-tracking module's field of view covers at least the observer's eye area, enabling real-time acquisition of eye images. Optionally, the eye-tracking module can employ a near-infrared camera, a depth camera, or other sensors capable of acquiring eye position information; this application does not limit this choice. A control unit is connected to both the eye-tracking module and the optomechanical module. The control unit receives eye images transmitted by the eye-tracking module, calculates the observer's eye position offset based on these images, and then controls the optomechanical module to adjust its attitude based on this offset, ensuring that the exit pupil formed after the beam propagates within the waveguide substrate is always aligned with the observer's eye, achieving active closed-loop adaptive adjustment.
[0032] In this embodiment, the design of the elongated coupling grating and the adjustable light angle and position of the optomechanical module provides sufficient space for the offset of the beam incident position, effectively solving the problem of light energy loss and image loss caused by the beam deviating from the entrance pupil due to the tilt of the optomechanical module in the prior art, and improving the light energy utilization rate. At the same time, combined with the closed-loop cooperation of the eye tracking module and the control unit, the optomechanical module can be actively controlled to perform dynamic posture adjustment based on the real-time acquired eye images, so that the exit pupil is always aligned with the observer's eyes, greatly improving the eye position adaptation range and the user experience.
[0033] In the above Figure 4Based on the corresponding embodiments, in order to more clearly demonstrate the specific structure of the optomechanical module for attitude adjustment, this application also provides a possible implementation of the optomechanical module structure in a diffraction waveguide display system. Figure 5 This is a schematic diagram of the hierarchical structure of an optomechanical module in a diffraction waveguide display system provided in an embodiment of this application.
[0034] like Figure 5 As shown, the optical engine module includes a base, an optical engine body, and a drive assembly. The drive assembly includes a coarse adjustment drive module and a fine adjustment drive module. The base, coarse adjustment drive module, fine adjustment drive module, and optical engine body are connected in series from bottom to top.
[0035] Specifically, the coarse adjustment drive module is fixedly mounted on the base, the fine adjustment drive module is fixedly mounted above the coarse adjustment drive module, and the optical engine body is fixedly mounted above the fine adjustment drive module. The control unit is connected to both the coarse adjustment drive module and the fine adjustment drive module.
[0036] Optionally, the coarse adjustment drive module can be a motor-driven displacement platform or other mechanical drive structures capable of achieving large-stroke linear displacement; this application does not limit this. The fine adjustment drive module can be a piezoelectric ceramic actuator or other micro-drive structures capable of achieving high-precision micro-displacement and angular deflection; this application does not limit this.
[0037] Figure 6 This is a detailed schematic diagram of the optomechanical driving structure provided in an embodiment of this application. For example... Figure 6 As shown, the optical engine body (such as a miniature projection optical engine) is positioned above the fine-tuning drive module (such as a piezoelectric ceramic actuator), the fine-tuning drive module is positioned above the coarse-tuning drive module (such as a displacement platform), and the coarse-tuning drive module is positioned above the base. The optical engine is configured with an adjustable tilt angle. (i.e., the angle between the light output direction of the optomechanism and the normal to the waveguide substrate); the optomechanism is set to an adjustable longitudinal translation distance. (That is, the amount of displacement of the optomechanic parallel to the waveguide substrate and along the length of the long strip coupling grating).
[0038] Specifically, the coarse adjustment drive module drives the fine adjustment drive module above it and the entire optomechanical unit to perform a large-stroke translation along the longitudinal direction. When the eye-tracking module detects a significant change in the observer's eye position, the control unit sends a control command to the coarse adjustment drive module. The coarse adjustment drive module responds to this command, driving the entire upper module to move longitudinally (i.e.,...) Figure 6 The longitudinal translation distance shown The coarse adjustment drive module moves rapidly in the direction of the target to achieve initial coarse alignment. Because of its long travel, it can cover a wide range of eye position differences caused by different observers.
[0039] Furthermore, the fine-tuning drive module is used to drive the optical engine body to perform tilt angle adjustment and / or micro-translation compensation within a local range after the coarse-tuning drive module completes a large-stroke translation. Once the coarse adjustment is complete, the control unit sends a control command to the fine-tuning drive module (i.e., the piezoelectric ceramic actuator), which responds to the command by driving the optical engine body through its own micro-deformation. Figure 7 The tilt angle shown The system performs angular deflection in the direction of rotation and simultaneously compensates for minute displacements. The fine-tuning drive module can eliminate residual errors on top of the coarse-tuning and effectively suppress the impact of high-frequency vibrations on the optical path during the use of the optomechanical system.
[0040] In this embodiment, the coarse adjustment drive module and the fine adjustment drive module are connected in series to achieve a complementary advantage of wide-range adjustment and high-precision fine adjustment. This separate design takes into account both the adjustment range and the adjustment accuracy, enabling the diffraction waveguide display system to complete the attitude adjustment in a very short time.
[0041] In the above Figure 6 Based on the corresponding embodiments, in order to more clearly illustrate the specific connection relationship and driving method between the fine-tuning drive module and the optical engine body, this application also provides a detailed schematic diagram of the fine-tuning drive module. Figure 7 This is a schematic diagram illustrating the combination of a piezoelectric ceramic actuator and an optomechanic provided in an embodiment of this application. Figure 7 As shown, the fine-tuning drive module (piezoelectric ceramic actuator) consists of two fixed planes, A and B, and a drive device between the two fixed planes.
[0042] Specifically, surface A of the piezoelectric ceramic actuator is connected to the optomechanical body, and the normal direction of surface A (i.e., the direction of the dashed arrow) is the axis of the piezoelectric ceramic actuator. When the optomechanical body is installed, there is an angle between its light emission direction and the axis of the piezoelectric ceramic actuator (the direction of the dashed arrow), which is the tilt angle of the optomechanical body. When the control unit deforms the piezoelectric ceramic actuator, surface A tilts as a whole, causing the optomechanical body to rotate synchronously. This changes the actual angle between the light output direction of the optomechanical body and the normal to the waveguide substrate, thereby achieving control over the tilt angle. Dynamic adjustment. The B-side of the piezoelectric ceramic actuator is connected to the displacement platform (coarse adjustment drive module), serving as a fixed base to support the components above.
[0043] In one possible implementation, the drive mechanism between the two fixed planes can control the tilt angle and short-distance displacement of surface A. When the control unit sends a control command to the fine-tuning drive module, the drive mechanism undergoes a slight deformation (such as bending or stretching) according to the applied voltage signal, thereby causing surface A (i.e., the optomechanical body) to tilt. Adjustment and micro-translation compensation. Due to the millisecond-level response speed of piezoelectric ceramics, it can quickly eliminate residual errors caused by coarse adjustment after the displacement platform has completed a large-stroke translation, and suppress high-frequency vibrations during the use of the optomechanical system, effectively ensuring the absolute stability of the optomechanical output posture.
[0044] In this embodiment, by rigidly connecting the A-side of the piezoelectric ceramic to the optomechanical body and aligning their normal directions, the light output direction of the optomechanical system is ensured to be free from interference by the physical structure during the driving adjustment process, thereby improving the reliability of the system's optical path and further enhancing the overall adjustment accuracy of the system.
[0045] In the above Figure 4 Based on the corresponding embodiments, in order to further expand the observer's field of view, this application also provides a possible implementation of multiplexed optical modules. Figure 8 This is a schematic diagram of another diffraction waveguide display system provided in an embodiment of this application. Figure 9 This is a schematic diagram of the multi-optical waveguide grating layout provided in an embodiment of this application.
[0046] like Figure 8 As shown, in this embodiment, the number of optical engine modules is two or more.
[0047] Specifically, the output ports of two or more optomechanical modules face different positions of the elongated coupling grating, and the two or more optomechanical modules are configured to project beams onto different sections of the elongated coupling grating. In one possible implementation, the optomechanism is a miniature projection optomechanism, and the three optomechanisms output images with the same resolution. Each optomechanism is equipped with an independent driving assembly, which is arranged sequentially along the length of the elongated coupling grating. Since the length dimension of the elongated coupling grating is larger than the length dimension of the output beam spot of the optomechanical module when it is located on the elongated coupling grating, its internal space is sufficient to accommodate the three optomechanisms to be incident at different positions, thereby achieving spatial multiplexing of the optical path on the same waveguide substrate. The three optomechanisms are responsible for the center field of view, the upper field of view, and the lower field of view, respectively. The control unit is connected to the three optomechanical modules to control the three optomechanical modules to work alternately in a time-division multiplexing mode, so as to stitch together a wide field of view image at the exit pupil. Optionally, the number of optical engine modules can be adaptively adjusted according to the actual field of view requirements, and this application does not limit this.
[0048] Furthermore, combined Figure 9As shown, to ensure the thinness of the single-layer waveguide and avoid the risks of optical path crosstalk and excessive power consumption caused by simultaneous lighting of multiple optical engines, the control unit is used to control two or more optical engine modules to work alternately in a time-division multiplexing manner. In one possible implementation, the alternation cycle of the three optical engines is 4ms (i.e., 250Hz): Optical engine 1 works from 0-2ms, responsible for displaying the central field of view; optical engine 2 works from 2-4ms, responsible for displaying the upper field of view; optical engine 3 works from 4-6ms, responsible for displaying the right / lower field of view, and so on. Due to the persistence of vision of the human eye (approximately 16-20ms), the images rapidly projected by the three optical engines will be fused into a single complete wide field of view image in the human eye, achieving a doubling of the effective field of view of a single eye (e.g., expanding from 20° to 60°).
[0049] Simultaneously, after acquiring the observer's eye position information, the control unit adjusts the tilt angle of the optical engine module in real time according to changes in eye position, ensuring that the center of the stitched field of view is always aligned with the observer's gaze point. For example, when the user's gaze angle shifts upward, the control unit dynamically adjusts the tilt angles of optical engines 2 and 3, achieving dynamic shift of the field of view center. This time-division multiplexing combined with dynamic gaze point adjustment significantly reduces overall power consumption while solving the problems of limited field of view for single optical engines and bulky equipment caused by multi-layer waveguide stacking, greatly enhancing the user's immersive viewing experience.
[0050] In this embodiment, by integrating two or more optomechanical modules into different sections of the same elongated coupling grating, the spatial margin of the elongated entrance pupil is fully utilized, achieving multi-channel spatial multiplexing on a single-layer waveguide. Compared to the traditional multi-layer waveguide stacking scheme, this effectively expands the field of view while avoiding an increase in device size and weight, ensuring the slimness of the AR display device, and effectively reducing the risk of optical path crosstalk when multiple optomechanical modules are working simultaneously.
[0051] The specific connection methods and functional implementation methods of each component in the above embodiments can be arbitrarily combined, replaced, or modified by those skilled in the art based on actual design requirements after reading this application specification. There are no mutually exclusive limitations between the embodiments. Those skilled in the art can reasonably combine the technical features disclosed in different embodiments according to the needs of actual application scenarios without creative effort, and the new technical solutions formed are all within the protection scope of this application.
[0052] Based on the embodiments of the diffraction waveguide display system provided in any of the above embodiments, in order to more clearly demonstrate the specific application of the diffraction waveguide display system provided in this application in the vehicle scenario, this application also provides a possible implementation of a vehicle HUD. Figure 10This is a schematic diagram illustrating a usage scenario for an in-vehicle HUD provided in an embodiment of this application. Figure 10 As shown, the vehicle-mounted HUD includes a diffractive waveguide display system.
[0053] Specifically, the diffraction waveguide display system is installed inside the vehicle's dashboard. An eye-tracking module is positioned on the dashboard housing facing the driver's eyes to collect real-time eye position information. Optionally, the eye-tracking module can be a near-infrared camera or a sensor capable of detecting the driver's pupil range, such as radar; this application does not limit this choice. Such an in-vehicle HUD allows the diffraction waveguide display system to automatically complete eye position calibration after power-on and continuously track changes in the driver's eye position during driving. It should be noted that the control unit... Figure 10 As not specifically shown, it can be a hardware module with data processing and logic control capabilities, such as an in-vehicle domain controller, an application-specific integrated circuit (ASIC), or a microprocessor. This application does not limit the specific hardware form of the control unit.
[0054] The light output port of the optomechanical module faces the waveguide substrate. The image beam projected by the optomechanical module is coupled into the waveguide substrate through a long strip coupling grating, and after total internal reflection within the waveguide, it is coupled out by the exit pupil structure. The coupled beam is directly projected onto the windshield, and after being reflected by the windshield, it enters the driver's eyes, thus forming a clear, high-brightness suspended virtual image in front of the driver's field of vision, i.e., an augmented reality image.
[0055] In this embodiment, by placing the eye-tracking module on the dashboard housing facing the driver's eyes, it is ensured that the driver remains within the tracking field of vision under normal driving posture, thus guaranteeing the real-time and accuracy of eye position acquisition. Simultaneously, by directing the light output port of the optical engine module towards the windshield, the vehicle's existing optical reflective surfaces are fully utilized, eliminating the need for additional complex reflector assemblies. This results in a highly integrated hardware structure for the entire vehicle HUD, reducing its footprint and assembly complexity.
[0056] With the in-vehicle HUD, the driver does not need to manually adjust the device. The diffraction waveguide display system can adjust the posture of the optomechanical module by driving the control unit according to the collected eye position information, so that the exit pupil is always aligned with the driver's eyes. This achieves an augmented reality display effect with a large eye box, high color uniformity and high brightness, which greatly improves the safety and convenience of information interaction during driving.
[0057] In one possible implementation for automotive HUD applications, the waveguide substrate is made of 8-inch optical glass with a thickness of 1mm. A long strip-shaped coupling grating is etched into the upper left side of the waveguide substrate. The dimensions of the long strip-shaped coupling grating region are: length 10D (along the waveguide longitudinal direction) and width 1.1D (perpendicular to the waveguide longitudinal direction), where D is the output diameter of the micro-projection optical engine. This length is greater than the output diameter of the micro-projection optical engine, representing the tilt angle of the optical engine. Ample margin is provided for both vertical adjustment (±5° range) and longitudinal translation adjustment (±25mm range). The micro-projection optical engine adopts a Micro-LED solution with a circular light output port. The entire optical engine is mounted on a dual-degree-of-freedom drive module. The coarse adjustment layer (displacement platform) is motor-driven, with a longitudinal translation stroke (parallel to the long side of the elongated entrance pupil) of ±25mm and a positioning accuracy of 1mm. The fine adjustment layer (piezoelectric ceramic actuator) is installed between the displacement platform and the optical engine, providing a tilt angle adjustment range of ±5° and an angular resolution of 0.1°; it also provides micro-translation compensation with a stroke of ±1mm and an accuracy of 50μm. The coarse and fine adjustments work in series: the micro-displacement platform first quickly moves the optical engine to near the target position, and then the piezoelectric ceramic actuator performs tilt angle and micro-translation compensation. Through the above specific parameter configuration, it is possible to achieve a large eye position adaptation range while utilizing 10 The D's ultra-long entrance pupil space margin and precise graded drive adjustment further improve the image stability and light energy utilization of the vehicle HUD in the actual vehicle environment.
[0058] Based on the embodiments of the diffractive waveguide display system provided in any of the above embodiments, in order to more clearly demonstrate the specific application of the diffractive waveguide display system provided in this application in a head-mounted device scenario, this application also provides a possible implementation of AR glasses. The AR glasses include a frame and a diffractive waveguide display system.
[0059] Specifically, the diffractive waveguide display system is mounted on the eyeglass frame, with the waveguide substrate serving as the lens area for the AR glasses. An eye-tracking module is positioned on the bridge of the nose facing the user's eyes to collect real-time eye position information. An optomechanical module is mounted on one side of the frame to project a light beam onto a long strip-shaped coupling grating within the lens area.
[0060] Figure 11 This is a schematic diagram of the waveguide grating layout for AR glasses provided in an embodiment of this application. Figure 11 As shown, unlike the elongated coupling grating design in the above-mentioned vehicle head-up display system embodiment, in this embodiment, in order to adapt to the thinner and lighter requirements of AR glasses, the elongated coupling grating is designed to be more slender. The slender elongated coupling grating occupies very little space on the left side of the waveguide substrate, leaving sufficient arrangement area for the pupil expansion structure on the right side.
[0061] In one possible implementation, the diffraction waveguide display system in the AR glasses is equipped with three miniature projection optical engines. Each optical engine has an independent driving component and is located at a different position in the elongated entrance pupil, each responsible for projecting images from different fields of view. Because the width of the elongated coupling grating is much smaller than the entrance pupil width of conventional automotive solutions, the beams emitted by the optical engines can be confined to their respective small, independent areas, greatly reducing the risk of optical path crosstalk when multiple optical engines are working simultaneously.
[0062] More specifically, because the entrance pupil is designed to be sufficiently elongated, the lateral space originally occupied by the entrance pupil is freed up, allowing for a significant increase in the area of the pupil-expanding structure (coupled-out grating) on the waveguide substrate. This increased pupil size means that the light beam has a greater chance of being coupled out to the user's eye during total internal reflection propagation within the waveguide, further improving the brightness and uniformity of the exit pupil. It also provides a wider physical space for splicing large field-of-view images. Combined with the time-division multiplexing of three optical engines (e.g., utilizing the persistence of vision effect), the effective field of view for a single eye can be significantly expanded, for example, from the traditional 20° to 60°.
[0063] In this embodiment, by designing the entrance pupil to be elongated to fit AR glasses and utilizing its spatial advantages to expand the pupil structure, not only is multi-optical engine splicing display achieved, significantly widening the user's field of view, but the problems of bulky device size and increased weight caused by traditional multi-layer waveguide stacking schemes are also avoided. Combined with an eye-tracking module to dynamically track the user's gaze point, the diffraction waveguide display system can adjust the tilt angle of the optical engine in real time to ensure that the spliced image is always aligned with the center of gaze, greatly enhancing the user's immersion and visual comfort when wearing AR glasses.
[0064] In one possible implementation for AR glasses applications, the waveguide substrate for a single lens is made of optical glass with a refractive index of 2.0 and a thickness of 0.8 mm. The waveguide size for a single eye is 85 mm × 70 mm. A long strip-shaped coupling grating is etched on the upper left side of the waveguide substrate. This entrance pupil grating is a rectangular diffraction grating region. The aforementioned entrance pupil size is 30 mm in length (along the longitudinal direction of the waveguide) and 3 mm in width. This entrance pupil length is sufficient to accommodate the incident position shift of three micro-projection optical engines at different tilt angles, providing space for field-of-view stitching. The size of the expanding pupil structure is designed according to the size of the entrance pupil and is located on the right side of the entrance pupil; the exit pupil structure is located below the expanding pupil. A schematic diagram of the waveguide grating structure layout is shown below. Figure 11As shown, the diffraction waveguide display system is equipped with three micro-projection optical engines, all using a Micro-LED scheme, with a circular light output aperture of 2mm in diameter. Each optical engine is equipped with an independent driving assembly, and the three driving assemblies are integrated inside the temple of the AR glasses: Optical Engine 1 (center FOV): reference posture, θ=0°, responsible for displaying the central 20° field of view; Optical Engine 2 (upward FOV): θ=-15°, responsible for displaying the upper 20° field of view, with a vertical translation of +5mm; Optical Engine 3 (downward FOV): θ=+15°, responsible for displaying the right 20° field of view, with a vertical translation of -5mm. The driving assembly includes a series combination of a micro-displacement platform (coarse adjustment) and a piezoelectric ceramic actuator (fine adjustment), where the micro-displacement platform has a stroke of ±6mm, and the piezoelectric ceramic angle adjustment range is ±6°. The above scheme provides a theoretical design framework. In practical applications, the design parameters need to be optimized through experiments and simulations to meet the specific application requirements. Three miniature optical engines are incident at different angles on different positions of the elongated entrance pupil, corresponding to three spliced sub-images, and finally present a 30° FOV at the exit pupil.
[0065] This embodiment combines a long-strip entrance pupil, multi-optical-engine time-division scanning, and human eye tracking technology in AR glasses, significantly improving the field of view and viewing immersion. Commonly available single-optical-engine waveguide devices, constrained by imaging chips and waveguide optical parameters, offer a maximum single-eye viewing angle of only 40°, resulting in a narrow field of view and hindering immersive experiences. This embodiment utilizes the extra internal space of the long-strip entrance pupil to integrate three micro-projection modules on one side of the lens. The three optical engines each handle 20° of the field of view in the middle, above, and below, respectively. By using time-division alternating scanning to stitch the images together, the effective field of view for each eye is increased to 60°, more closely matching the natural viewing range of the human eye. Users can clearly see the superimposed virtual images without frequently turning their heads, resulting in a more natural blending of virtual and real images. It also supports dynamic gaze adjustment. As the human eye looks at objects in different directions and at varying distances, the line of sight continuously changes. The device uses an eye-tracking module to locate the eye's focus position and fine-tunes the tilt angle of the three optical engines in real time. For example, when the gaze moves upward, the corresponding optical engine tilt angle is adjusted synchronously, and the center of the overall image moves upward in sync with the gaze, so that the high-definition image area always matches the position of human eye focus, solving the shortcomings of poor image edge clarity and low usage efficiency of traditional fixed field-of-view solutions.
[0066] Meanwhile, traditional entrance pupils are only used to match the output size of a single optical engine, with a one-to-one correspondence and limited functionality. This application's embodiment redesigns the entrance pupil usage method; the elongated structure can accommodate three optical engines with different tilt angles and positions for zoned illumination, achieving segmented spatial utilization and time-division multiplexing. The entrance pupil's multi-optical-engine structural design effectively improves the space utilization of a single waveguide. Most multi-optical-engine products on the market adopt a synchronous lighting mode, resulting in high overall power consumption and easy optical path crosstalk between modules. In one possible implementation, this application uses 250Hz time-division scanning, with three optical engines alternately lighting up within a 4ms frame period. The single-module single-operation time is only 2ms, which can reduce power consumption, extend device battery life, and eliminate optical path crosstalk; synchronized with the 240Hz eye-tracking signal frame, the field of view center of each frame can be dynamically adjusted according to the real-time eye position.
[0067] Based on the diffraction waveguide display system provided in the above embodiments, the specific steps of the adjustment method of the diffraction waveguide display system applied to the diffraction waveguide display system will be described in detail below. Figure 12 A flowchart illustrating an adjustment method for a diffraction waveguide display system provided in this application embodiment is shown below. Figure 12 As shown, the adjustment method of the diffraction waveguide display system is applied to the control unit of the diffraction waveguide display system, and the method includes: S101, acquires the observer's eye image through the eye-tracking module.
[0068] First, the control unit receives real-time images of the observer's eyes from the eye-tracking module.
[0069] Optionally, the eye-tracking module can employ a near-infrared camera, or a depth camera or radar, or other sensors capable of detecting the observer's pupil area; this application does not limit the choice. The eye-tracking module is positioned to acquire images of the observer's eyes (e.g., on the housing of a vehicle dashboard or the bridge of AR glasses), and its field of view at least covers the observer's eye area. The control unit responds to the received eye image data and initiates the eye position analysis process.
[0070] S102, analyze the eye image to obtain the three-dimensional coordinates of the observer's pupil.
[0071] Specifically, the control unit incorporates an image processing algorithm. It performs grayscale and binarization on the eye image to filter out background interference; then, it uses a pupil center localization algorithm to extract the pupil region and calculate its geometric center. Combining this with a pre-defined spatial coordinate system mapping, the pixel coordinates in the image coordinate system are transformed to real physical space, thereby obtaining the three-dimensional coordinates of the observer's current pupil in space. Three-dimensional coordinates are used to accurately represent the observer's current actual eye position.
[0072] S103, calculate the offset of the observer's eye position relative to the reference eye position based on the three-dimensional coordinates of the observer's pupil and the preset reference eye position coordinates.
[0073] Specifically, during power-on initialization, the diffraction waveguide display system first performs a reference eye position calibration on the observer and pre-stores the reference eye position coordinates in the control unit's memory. The control unit then acquires the current three-dimensional coordinates of the pupil. The three-dimensional spatial difference is calculated by comparing the observer's eye position with the pre-stored reference eye position coordinates to obtain the offset of the observer's eye position in three spatial directions (vertical, horizontal, and depth). The offset is used to quantify the change in displacement of the observer relative to its initial position.
[0074] S104. Determine the optimal optomechanical attitude based on the offset and the preset eye position and attitude mapping model.
[0075] Specifically, the control unit has multiple pre-stored mapping models between optomechanical attitude and eye position, which are used to characterize the eye position offset. With optomechanical attitude parameters The mapping relationship between them. When eye tracking detects a change in eye position, the control unit quickly generates multiple sets of candidate pose combinations based on this mapping model. Subsequently, the control unit evaluates multiple candidate posture combinations according to preset display effect evaluation rules and selects the optimal optomechanical posture, and finally drives optomechanical adjustment based on the optimal optomechanical posture.
[0076] S105, according to the optimal optomechanical attitude, controls the optomechanical module to adjust its attitude so as to project the beam to the corresponding position of the elongated coupling grating, so that after the beam is coupled into the waveguide substrate through the elongated coupling grating for transmission, the resulting exit pupil is aligned with the observer's eye.
[0077] Specifically, the control unit will determine the optimal optomechanical attitude (including the target tilt angle). longitudinal translation distance of the target The beam is converted into specific drive control commands and sent to the optomechanical module through its connection with the drive component. The optomechanical module responds to the drive commands, performing two-degree-of-freedom drive adjustment to change the position and angle of the optical engine's output port, thereby guiding the projected beam to the corresponding position on the elongated coupling grating. Because the length dimension of the elongated coupling grating is larger than the length dimension of the optical engine module's output beam spot when it is located on the elongated coupling grating, it provides ample space for optical engine attitude adjustment. Therefore, the beam incident position varies with... The beam dynamically shifts along the long strip, yet it still manages to completely illuminate the effective area of the long strip-shaped coupling grating, undergoing total internal reflection for transmission. Finally, the beam is transmitted through the pupil expansion structure to the exit pupil and couples out, allowing a complete, uniform, and high-brightness AR image to enter the viewer's eye. The exit pupil remains aligned with the observer's eye, ensuring the integrity and brightness of the displayed image.
[0078] In this embodiment, the device can automatically adapt to eye position shifts caused by different observers without human intervention. This effectively solves the problem in the prior art where the beam deviates from the effective area of the entrance pupil due to the tilt of the optical engine, resulting in severe light energy loss, image loss, or uneven color. By actively controlling the optical engine module to perform dynamic attitude adjustment, the exit pupil is always aligned with the observer's eyes, greatly improving the eye position adaptation range and the user experience.
[0079] In the above Figure 11 Based on the corresponding embodiments, in order to more clearly demonstrate the specific implementation logic of the optimal optomechanical attitude, this application also provides a possible implementation of the adjustment method of the diffraction waveguide display system. Figure 13 This is a flowchart illustrating the multi-objective optimization process in an adjustment method for a diffraction waveguide display system provided in an embodiment of this application, as shown below. Figure 13 As shown, in S104 above, the optimal optomechanical attitude is determined based on the offset and the preset eye position and attitude mapping model, including: S210 generates two or more candidate optomechanical attitudes based on the offset and the eye position and attitude mapping model.
[0080] Specifically, the control unit has a pre-stored eye position and attitude mapping model. This model is a lookup table pre-built and stored in the laboratory stage using optical tracking software and experimental measurement results, covering the allowable tilt angle and longitudinal translation distance range (e.g., tilt angle ±5°, step size 0.1°; longitudinal translation distance ±25mm, step size 0.5mm). Since there are more than two different combinations of optomechanical tilt angles and longitudinal translation distances that can achieve the physical effect of realigning the exit pupil with the eye, the control unit will generate more than two candidate optomechanical attitude combinations after inputting the calculated offset into the model.
[0081] S220 calculates the color uniformity index corresponding to each candidate optomechanical attitude.
[0082] Specifically, the control unit calculates the color uniformity index for each candidate posture based on pre-stored display effect data from laboratory measurements. In one possible implementation, the color uniformity index is measured using color difference (color difference value). The control unit uses a color space conversion formula to convert the brightness data of the red, green, and blue channels corresponding to the candidate posture to the color space and calculates the color difference value between it and the standard white field to quantitatively evaluate the degree of color deviation under that posture.
[0083] S230: Based on the color uniformity index corresponding to each candidate optical engine posture and the preset color uniformity threshold, the candidate optical engine postures are screened to determine the candidate optical engine postures that meet the preset color uniformity threshold.
[0084] Specifically, the control unit has a preset color uniformity threshold (e.g., color difference value ≤ 3). The control unit compares the calculated color uniformity index of each candidate posture with the color uniformity threshold one by one: if the color uniformity index of a candidate posture does not meet the color uniformity threshold requirement, it is determined that the color reproduction of the image under that posture is distorted, and this candidate combination is directly eliminated; if it meets the color uniformity threshold requirement, the candidate combination is retained, and the candidate posture is determined to be a candidate optomechanical posture that meets the preset color uniformity threshold.
[0085] S240: Among the candidate optomechanical postures that meet the preset color uniformity threshold, compare the exit pupil brightness corresponding to each candidate optomechanical posture.
[0086] Specifically, after screening based on the color uniformity index, the remaining candidate combinations are all in a state of acceptable color reproduction. At this point, the control unit further extracts the exit pupil brightness data corresponding to all candidate poses that meet the color uniformity threshold requirements, and compares these exit pupil brightness data with each other to find the option with the highest brightness.
[0087] S250 selects the candidate optomechanical attitude with the highest exit pupil brightness as the optimal optomechanical attitude.
[0088] Specifically, the control unit compares and identifies candidate optomechanical postures that meet the color uniformity threshold and have the highest exit pupil brightness, and ultimately determines this as the optimal optomechanical posture. The optimal optomechanical posture ensures that image brightness is maximized while maintaining accurate color reproduction.
[0089] In this embodiment, by introducing a multi-objective optimization decision-making strategy that prioritizes color uniformity and then exit pupil brightness, it is possible to maximize the use of light energy and improve exit pupil brightness while ensuring accurate color reproduction and no color distortion (i.e., color difference meets the threshold requirement). This effectively solves the contradiction between color uniformity and light energy efficiency during the dynamic adjustment of the optical engine, and significantly improves the picture quality and user experience of the adaptive display system.
[0090] In the above Figure 11 Based on the corresponding embodiments, in order to more clearly demonstrate the specific execution steps of controlling the optomechanical module to adjust its attitude, this application also provides a possible implementation of the adjustment method for a diffraction waveguide display system. Figure 14 This is a schematic diagram of the two-degree-of-freedom driven adjustment process in an adjustment method for a diffraction waveguide display system provided in an embodiment of this application, as shown below. Figure 14 As shown, in S105 above, controlling the optical-mechanical module to adjust its attitude according to the optimal optical-mechanical attitude includes: In this embodiment, the optimal optomechanical orientation includes the tilt angle of the optomechanical body relative to the elongated coupling grating and the longitudinal translation distance.
[0091] S310 controls the coarse adjustment drive module to drive the fine adjustment drive module above it and the entire optical engine body to perform longitudinal translation based on the longitudinal translation distance.
[0092] Specifically, tilt angle and longitudinal translation distance These are two independent degrees of freedom, which work together to determine the incident position and angle of the beam at the entrance pupil. The control unit adjusts the longitudinal translation distance in the optimal optomechanical attitude. The commands are converted into coarse adjustment control commands and sent to the coarse adjustment drive module (displacement platform). The coarse adjustment drive module responds to the commands, driving the fine adjustment drive module above it and the entire optomechanical body to perform a large-stroke translation along the longitudinal direction. This large-stroke translation is used to handle the large longitudinal translation of the entire optomechanical system, quickly responding to significant changes in eye position (such as switching between drivers of different heights), thereby initially altering the incident position of the beam on the elongated coupling grating.
[0093] After completing the longitudinal translation, the S320 controls the fine-tuning drive module to drive the optical engine body to adjust the tilt angle according to the tilt angle.
[0094] Specifically, after the coarse adjustment drive module completes the initial longitudinal translation, the control unit adjusts the tilt angle in the optimal optomechanical posture. The signal is converted into a fine-tuning control command and sent to the fine-tuning drive module via its connection. The fine-tuning drive module responds to the received fine-tuning control command by adjusting the tilt angle of the optical engine body through its own minute deformation. The adjustment allows the output angle of the optomechanical body to match the coupling angle of the elongated coupling grating, achieving alignment of the target position. Optionally, the fine-tuning drive module can employ a piezoelectric ceramic driver with millisecond-level response speed; this application does not limit this to a specific type.
[0095] Optionally, the fine-tuning drive module is not only used to adjust the tilt angle, but also to drive the optomechanical body to perform micro-translation compensation based on the fine compensation amount of the longitudinal translation distance. This further eliminates the positional error caused by the step accuracy limitation of the coarse-tuning displacement platform and suppresses the influence of high-frequency vibration on the optical path in real time during operation. The angle adjustment and micro-translation compensation work together to ultimately determine the incident position and angle of the beam on the elongated coupling grating.
[0096] In this embodiment, a series architecture of the coarse adjustment drive module and the fine adjustment drive module achieves a separate design for coarse and fine adjustments, balancing adjustment range and accuracy. The overall response time meets the real-time tracking requirements in dynamic scenarios. The large-stroke translation of the coarse adjustment solves the response speed problem for large eye position deviations; the fine adjustment is not only responsible for high-precision tilt angle adjustment, but also performs micro-translation compensation, eliminating residual errors and vibration interference from the coarse adjustment, ensuring that the beam is always coupled into the long strip entrance pupil, and significantly improving the display stability of HUD and AR devices in complex dynamic environments.
[0097] In the above Figure 11 Based on the corresponding embodiments, in order to more clearly demonstrate how the system achieves continuous dynamic tracking and closed-loop feedback adjustment, this application also provides a possible implementation of the adjustment method for a diffraction waveguide display system. Figure 15 This is a schematic diagram of the closed-loop feedback adjustment process in an adjustment method for a diffraction waveguide display system provided in an embodiment of this application, as shown below. Figure 15 As shown, in S105, after controlling the optical-mechanical module to perform attitude adjustment, the method further includes: S410 re-acquires the observer's current eye position information through the eye-tracking module.
[0098] Specifically, after beam coupling and exit pupil display are completed, the control logic does not terminate, but enters a continuous monitoring state.
[0099] The eye-tracking module remains operational in real-time, acquiring images of the observer's eye area again and transmitting these images to the control unit to obtain the observer's latest eye position information at the current moment. The control unit then analyzes this current eye position information to obtain the latest three-dimensional coordinates of the observer's pupils, ensuring that any minute displacement changes that occur after the initial accommodation are detected.
[0100] S420, based on the current eye position information, determine whether the current offset of the current eye position relative to the reference eye position exceeds a preset offset threshold.
[0101] Specifically, the control unit calculates the current offset of the current eye position relative to the preset reference eye position coordinates based on the reacquired current eye position information.
[0102] Subsequently, the control unit compares the current offset with a preset offset threshold stored internally. Optionally, the preset offset threshold can be a tolerance range used to define under what operating conditions a readjustment needs to be triggered (e.g., tolerable small displacements or high-frequency vibrations), which is not limited in this application. If the current offset does not exceed the offset threshold, it means that the current exit pupil can still be aligned with the observer's eye. The current posture is maintained, and S410 is continuously executed in a loop to maintain real-time monitoring.
[0103] S430, if the offset threshold is exceeded, the step of determining the optimal optomechanical attitude based on the offset and the preset eye position and attitude mapping model is re-executed.
[0104] Specifically, when the control unit determines that the current offset has exceeded the offset threshold, it means that the observer's eye position has been significantly displaced (e.g., the driver turns his head or the vehicle is violently jolted), and the current exit pupil can no longer be accurately aligned with the eye.
[0105] At this point, the control unit immediately triggers the closed-loop feedback mechanism, re-executes the aforementioned step S104 (i.e., redetermines the optimal optomechanical attitude based on the current offset and the preset eye position and attitude mapping model), and then proceeds to execute S105 to complete a new round of optomechanical attitude compensation and beam alignment.
[0106] In this embodiment, by introducing a continuous monitoring and threshold judgment mechanism after the initial adjustment, a complete closed-loop feedback system is constructed. Instead of ending after a one-time adjustment, it can capture changes in eye position caused by the observer's minute movements or high-frequency vibrations during vehicle movement in real time, and automatically trigger a new round of adjustment. This ensures that the displayed image remains stable and clear under different dynamic conditions, solves the defect of existing technologies that cannot actively adapt to dynamic vibrations that cause exit pupil deviation, and greatly improves the reliability and comfort during driving or wearing.
[0107] In the above Figure 11 Based on the corresponding embodiments, in order to more clearly demonstrate the specific implementation logic of multi-optical-mechanical module collaborative splicing display, this application also provides a possible implementation of the adjustment method of the diffraction waveguide display system. Figure 16 This is a schematic diagram of the multi-optical-mechanical time-division multiplexing splicing process in the adjustment method of a diffraction waveguide display system provided in an embodiment of this application, as shown below. Figure 16 As shown, the method also includes: S510 controls two or more optomechanical modules to project beams onto different sections of a long strip-shaped coupling grating in different orientations.
[0108] Specifically, in embodiments containing two or more optomechanical modules, since the length dimension of the elongated coupling grating is larger than the length dimension of the emitted light spot of the optomechanical module when it is located on the elongated coupling grating, it is divided into two or more different projection sections.
[0109] The control unit is connected to two or more optical engine modules and controls each module to project beams onto different sections of the elongated coupling grating with its own independent orientation (i.e., different tilt angles and longitudinal translation distances). In one possible implementation, a single-eye waveguide is configured with three miniature projection optical engines. The three optical engines are responsible for projecting images along the elongated coupling grating at the center field of view, the upper field of view, and the lower field of view, respectively, thus realizing multi-channel spatial multiplexing on a single-layer waveguide.
[0110] S520 controls two or more optomechanical modules to work in a time-division multiplexing mode to stitch together images from two or more different field of view angles into a complete wide field of view image by utilizing the persistence of vision effect.
[0111] Specifically, in order to avoid optical path crosstalk and excessive power consumption caused by lighting up two or more optical engines at the same time, the control unit controls two or more optical engine modules to work in a time-division multiplexing manner.
[0112] In one possible implementation, three optical engines operate alternately at a frequency of 250Hz. For example, optical engine 1 operates during the 0-2ms time period, optical engine 2 during the 2-4ms time period, optical engine 3 during the 4-6ms time period, and so on in a cyclical manner. Due to the persistence of vision in the human eye (approximately 16-20ms), the low-frequency sub-images rapidly projected by the three optical engines will naturally merge and stitch together into a single, complete wide-field-of-view image in the observer's eyes. By combining this time-division multiplexing method with the persistence of vision effect, the field of view, which was originally only 20° for a single optical engine, is stitched together and expanded to 60°. This ensures the device's slimness and achieves a wide-field-of-view display without the need for multiple waveguide layers.
[0113] After acquiring eye position information, the S530 adjusts the tilt angle of two or more optical engine modules in real time according to changes in eye position, so that the center of the spliced field of view is aligned with the observer's gaze point.
[0114] Specifically, once the eye-tracking module acquires the observer's real-time eye position information, the control unit dynamically adjusts the tilt angles of two or more optomechanical modules based on the current gaze direction (fixation point). .
[0115] For example, when the user's gaze moves upward, the control unit will fine-tune the tilt angles of the upper optical magnifier (optical engine 2) and the lower optical magnifier (optical engine 3) in real time. This allows the center of the stitched field of view to dynamically shift according to the user's gaze point. Through adjustment, it ensures that the area the user is looking at is always in the center of the image with the clearest and most uniform brightness, effectively avoiding the problems of poor clarity and brightness attenuation that exist at the edges of a large field of view in traditional fixed stitched images. For example, when the user's viewing angle moves upward, the tilt angle of the optical engine 2... The tilt angle of optical engine 1 was adjusted from -5° to -3°. Adjusting from 0° to +2° allows for dynamic shifting of the center of the stitched field of view.
[0116] In this embodiment, the combination of long strip entrance pupil spatial multiplexing and two or more optomechanical time-division scanning splicing technologies significantly expands the field of view. At the same time, the alternating operation of the time sequence significantly reduces the power consumption of the whole machine and eliminates optical path crosstalk. Combined with dynamic gaze point control based on eye tracking, the user's immersion and visual comfort are greatly improved.
[0117] Based on the above embodiments, the technical effects of using the vehicle-mounted HUD provided in this application will be explained.
[0118] Traditional fixed optical engine eye boxes only support ±5mm eye position offset. This application, however, can be equipped with a 35mm long strip-shaped coupling grating, allowing the optical engine to achieve ±5° tilt adjustment and ±25mm vertical translation, extending the effective eye position adaptation range to ±60mm vertically and ±20mm horizontally. Drivers between 150cm and 190cm in height can see a complete and clear AR image after adjusting their seat positions, eliminating the need for manual HUD adjustment. Regarding display performance, the solution employs multi-objective closed-loop control, prioritizing a color difference ΔE ≤ 3, and optimizing brightness across various optical engine postures. When the eye position is within the adaptation range, the color difference at the center of the image is consistently below 2.5, the color difference at the edges is no greater than 3, and brightness fluctuations are controlled within 20%. Compared to the reference eye position, a conventional fixed optical engine eye position offset of 10mm will produce significant color cast, a color difference greater than 8, and a brightness decrease of 30%~50%. The elongated coupling grating can adapt to the beam deflection caused by the optical engine deflection. Combined with a pupil expansion structure that matches the tilted optical path, the light energy utilization rate of the device can reach over 90% in all working states. In existing solutions, after the optical engine tilts, a large amount of light leaves the effective pupil expansion area, and the light energy utilization rate is generally less than 60%, which not only wastes power consumption but also easily causes dark edges and image defects.
[0119] In the description of the embodiments of the present invention, unless otherwise explicitly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in the present invention based on the specific circumstances.
[0120] The above are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A diffraction waveguide display system, characterized in that, The diffraction waveguide display system includes: a waveguide substrate, an optomechanical module, an eye-tracking module, and a control unit; The optical-mechanical module's output port faces the waveguide substrate, and the waveguide substrate is provided with an elongated coupling grating. The optical-mechanical module is configured to project a light beam onto the elongated coupling grating. The output angle and / or relative position of the optical-mechanical module are adjustable so that the incident position of the light beam on the elongated coupling grating changes accordingly. The dimension of the elongated coupling grating in the length direction is larger than the dimension of the output light spot of the optical-mechanical module in the length direction when it is located on the elongated coupling grating. The eye-tracking module's field of view covers at least the observer's eye area to acquire images of the observer's eyes. The control unit is connected to the eye-tracking module and the optomechanical module respectively, and is used to control the optomechanical module to perform attitude adjustment according to the eye image, so that the exit pupil formed after the beam is transmitted in the waveguide substrate is aligned with the observer's eye.
2. The diffraction waveguide display system according to claim 1, characterized in that, The optical engine module includes: a base, an optical engine body, and a driving component; the driving component includes a coarse adjustment driving module and a fine adjustment driving module. The coarse adjustment drive module is fixedly mounted on the base, the fine adjustment drive module is fixedly mounted above the coarse adjustment drive module, and the optical engine body is fixedly mounted above the fine adjustment drive module. The control unit is connected to both the coarse adjustment drive module and the fine adjustment drive module.
3. The diffraction waveguide display system according to claim 1, characterized in that, The number of optomechanical modules in the diffraction waveguide display system is two or more; The light output ports of the two or more optical engine modules are respectively oriented toward different positions of the elongated coupling grating, and the two or more optical engine modules are respectively configured to project light beams to different sections of the elongated coupling grating; The control unit is connected to two or more of the aforementioned optical engine modules and is used to control the two or more optical engine modules to work alternately in a time-division multiplexing manner so as to stitch together a wide field-of-view image at the exit pupil.
4. An adjustment method for a diffraction waveguide display system, applied to the control unit of the diffraction waveguide display system according to any one of claims 1-3, characterized in that, The method includes: The observer's eye images are acquired through an eye-tracking module; The eye image is analyzed to obtain the three-dimensional coordinates of the observer's pupil; Based on the three-dimensional coordinates of the observer's pupil and the preset reference eye position coordinates, calculate the offset of the observer's eye position relative to the reference eye position. The optimal optomechanical attitude is determined based on the offset and the preset eye position and attitude mapping model. According to the optimal optomechanical attitude, the optomechanical module is controlled to adjust its attitude so as to project the light beam to the corresponding position of the elongated coupling grating, so that after the light beam is coupled into the waveguide substrate through the elongated coupling grating for transmission, the resulting exit pupil is aligned with the observer's eye.
5. The method according to claim 4, characterized in that, The step of determining the optimal optomechanical attitude based on the offset and a preset eye position and attitude mapping model includes: Based on the offset and the eye position and attitude mapping model, generate two or more candidate optomechanical attitudes; Calculate the color uniformity index corresponding to each of the candidate optomechanical postures; Based on the color uniformity index and preset color uniformity threshold corresponding to each candidate optical mechanism posture, each candidate optical mechanism posture is screened to determine the candidate optical mechanism posture that meets the preset color uniformity threshold. Among the candidate optomechanical postures that meet the preset color uniformity threshold, the exit pupil brightness corresponding to each candidate optomechanical posture is compared. The candidate optomechanical attitude with the highest exit pupil brightness is selected as the optimal optomechanical attitude.
6. The method according to claim 4, characterized in that, The optimal optomechanical attitude includes the tilt angle and longitudinal translation distance of the optomechanical body relative to the elongated coupling grating; the step of controlling the optomechanical module to adjust its attitude according to the optimal optomechanical attitude includes: Based on the longitudinal translation distance, the coarse adjustment drive module drives the fine adjustment drive module above it and the entire optomechanical body to perform a longitudinal translation: After completing the longitudinal translation, the fine-tuning drive module is controlled to drive the optomechanical body to adjust the tilt angle according to the tilt angle.
7. The method according to claim 4, characterized in that, After the optical-mechanical module performs attitude adjustment, the method further includes: The observer's current eye position information is re-acquired through the eye-tracking module; Based on the current eye position information, determine whether the current offset of the current eye position relative to the reference eye position exceeds a preset offset threshold. If the offset threshold is exceeded, the step of determining the optimal optomechanical attitude based on the offset and the preset eye position and attitude mapping model is re-executed.
8. The method according to claim 4, characterized in that, The method further includes: Control two or more of the aforementioned optomechanical modules to project light beams into different sections of the elongated coupling grating in different orientations; Control two or more of the aforementioned optomechanical modules to work cyclically in a time-division multiplexing manner, so as to use the visual persistence effect to stitch together two or more images with different field of view into a complete wide field of view image; After acquiring eye position information, the tilt angles of two or more optical engine modules are adjusted in real time according to changes in eye position, so that the center of the spliced field of view is aligned with the observer's gaze point.
9. A vehicle-mounted HUD, characterized in that, The vehicle-mounted HUD includes the diffraction waveguide display system as described in any one of claims 1-3; The diffraction waveguide display system is installed inside the vehicle's dashboard; the eye-tracking module is located on the dashboard housing facing the driver's eyes; the light output port of the optomechanical module faces the vehicle's windshield.
10. An AR glasses, characterized in that, The AR glasses include a frame and a diffractive waveguide display system as described in any one of claims 1-3.
