Near-to-eye display system and near-to-eye display device

Abstract

The invention provides a near-to-eye display system and near-to-eye display equipment. The near-to-eye display system comprises a light source, the light source comprises a display light machine and an infrared illumination module, the infrared illumination module is arranged on the display light machine, the display light machine is used for emitting image light, and the infrared illumination module is used for emitting infrared light; the waveguide assembly is arranged on the light emitting side of the light source, the waveguide assembly is used for transmitting the image light and the infrared light eyeball tracking camera, and the eyeball tracking camera is used for receiving the infrared light reflected by the eyeball area. The invention discloses a near-to-eye display system and near-to-eye display equipment, which can realize efficient multiplexing of a limited space.

Description

Technical Field

[0001] This invention relates to the field of near-eye display technology, and more particularly to a near-eye display system and a near-eye display device. Background Technology

[0002] As augmented reality (AR) display devices become thinner and lighter, eye tracking has become a key technology for enhancing the interactive experience. However, simultaneously placing a display and eye-tracking module within a limited space, while balancing display quality and wearing comfort, remains a significant challenge.

[0003] In the current mainstream AR glasses solutions, display gratings and eye-tracking gratings are integrated on a single waveguide. However, due to the different working bands of visible light and infrared light, the grating designs are mutually constrained, making it difficult to balance display brightness and tracking sensitivity. In some cases, it is even necessary to add an additional independent module, which makes the near-eye display device thicker and heavier.

[0004] Therefore, how to effectively separate the display light path from the eye-tracking light path and achieve efficient integration of structural components while ensuring that near-eye display devices are thin and light has become an urgent problem to be solved. Summary of the Invention

[0005] This application provides a near-eye display system and a near-eye display device that effectively separates and integrates the display light path and the eye-tracking light path, balancing display brightness and tracking sensitivity.

[0006] This application provides a near-eye display system, including: The light source includes a display optical engine and an infrared illumination module. The infrared illumination module is mounted on the display optical engine, which emits image light. The infrared illumination module emits infrared light. A waveguide assembly is disposed on the light-emitting side of the light source, and the waveguide assembly is used to transmit the image light and the infrared light; An eye-tracking camera, wherein the eye-tracking camera is used to receive infrared light reflected from the eye region.

[0007] In some embodiments, the waveguide assembly includes a first waveguide substrate, a second waveguide substrate, and a first transmission component. The first waveguide substrate is disposed on the light-emitting side of the display optical engine and is used to transmit the image light within it in the form of total internal reflection. The second waveguide substrate is disposed on one side of the first waveguide substrate along the thickness direction of the first waveguide substrate. The first transmission component is disposed on the second waveguide substrate and is used to couple the light reflected from the eye region into the second waveguide substrate and transmit it to the eye-tracking camera via the second waveguide substrate.

[0008] In some embodiments, the surface of the second waveguide substrate is planar or curved, and the first transmission component is attached to the inner or outer side of the second waveguide substrate.

[0009] In some embodiments, the first transmission component includes one or more first coupling gratings and one or more first coupling gratings, the one or more first coupling gratings being used to couple light reflected from the eye region into the second waveguide substrate, and the one or more first coupling gratings being used to receive light reflected from the eye region from the second waveguide substrate and couple it out to the eye-tracking camera.

[0010] In some embodiments, the waveguide assembly further includes a second transmission component disposed on the first waveguide substrate or the second waveguide substrate. The second transmission component includes one or more second coupling-in gratings and one or more second coupling-out gratings. The one or more second coupling-in gratings are used to receive light emitted by the infrared illumination module and transmit it to the first waveguide substrate. The one or more second coupling-out gratings are used to receive light transmitted by the first waveguide substrate and couple it out to the eye region.

[0011] In some embodiments, one or more of the second coupled gratings have optical power.

[0012] In some embodiments, the near-eye display system further includes one or more third coupling gratings and one or more third coupling out gratings, the third coupling gratings and the third coupling out gratings being disposed on the first waveguide substrate, the one or more third coupling gratings being used to receive image light emitted by the display optical engine and transmit it to the first waveguide substrate, the one or more third coupling out gratings being used to receive image light transmitted by the first waveguide substrate and couple it out to the eye region.

[0013] In some embodiments, the near-eye display system further includes a deflection element disposed between the display optical engine and the waveguide assembly.

[0014] In some embodiments, the near-eye display system further includes a relay lens disposed between the waveguide assembly and the transition element.

[0015] In some embodiments, the infrared illumination module includes one or more infrared light sources disposed on the display optical engine, and a portion of the infrared light emitted by the infrared light source is reflected by the eye region and enters the waveguide assembly.

[0016] In some embodiments, the infrared illumination module further includes at least one collimating lens, which is disposed on the light-emitting side of the infrared light source.

[0017] This application embodiment also provides a near-eye display device, including: A frame, wherein the frame is disposed on the front side of the eyeball region; A near-eye display system, wherein the near-eye display system is the aforementioned near-eye display system, and the near-eye display system is mounted on the frame; An eye-tracking camera is mounted on the frame of the glasses.

[0018] In some embodiments, the eyeglass frame includes two frames, a nose bridge, and two temples. The nose bridge is connected to the two frames, and the two temples are connected to the two frames. The first waveguide substrate is connected to the frames. The display optical engine is disposed at the nose bridge, and the eye-tracking camera is disposed at the temples.

[0019] In some embodiments, the near-eye display device further includes a deflection element disposed between the display optical engine and the waveguide assembly, and the deflection element is disposed at the lens frame or the bridge of the nose.

[0020] The near-eye display system and device provided in this application integrate the infrared illumination module directly onto the display optical engine, allowing the image light and infrared light to share the same light source structure, thus achieving efficient space reuse. Specifically, the infrared light source does not require a separate optical path for eye tracking, nor does it need an additional independent illumination module. This allows the near-eye display system to maintain a slim profile while simultaneously ensuring display brightness and tracking sensitivity, providing a more flexible integration approach for the miniaturization of near-eye display devices. Attached Figure Description

[0021] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0022] Figure 1 This is a schematic diagram of a first structure of a near-eye display system provided in an embodiment of this application.

[0023] Figure 2 This is a schematic diagram of the structure of the display optical engine provided in an embodiment of this application.

[0024] Figure 3 This is a schematic diagram of a second structure of the near-eye display system provided in an embodiment of this application.

[0025] Figure 4 This is a schematic diagram of a third structure of the near-eye display system provided in an embodiment of this application.

[0026] Figure 5 This is a schematic diagram of a fourth structure of the near-eye display system provided in the embodiments of this application.

[0027] Figure 6 This is a fifth structural schematic diagram of the near-eye display system provided in the embodiments of this application.

[0028] Figure 7 This is a schematic diagram of the structure of the light source provided in an embodiment of this application.

[0029] Figure 8 This is a sixth structural schematic diagram of the near-eye display system provided in the embodiments of this application.

[0030] Figure 9 This is a seventh structural schematic diagram of the near-eye display system provided in the embodiments of this application.

[0031] Figure 10 This is a schematic diagram of a first structure of a near-eye display device provided in an embodiment of this application.

[0032] Figure 11 This is a schematic diagram of a second structure of a near-eye display device provided in an embodiment of this application. Detailed Implementation

[0033] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of this application.

[0034] This application provides a near-eye display system and a near-eye display device. While ensuring the near-eye display device is thin and light, it effectively separates and integrates the display light path and the eye-tracking light path, balancing display brightness and tracking sensitivity. The following is a detailed description with reference to the accompanying drawings.

[0035] Please see Figure 1 , Figure 1 This is a schematic diagram of a first structure of a near-eye display system provided in an embodiment of this application.

[0036] This application provides a near-eye display system 100. This near-eye display system 100 projects image light onto the human eye to form a virtual image in the user's field of vision. It can be applied to near-eye display devices such as Augmented Reality (AR), Virtual Reality (VR), and Mixed Reality (MR), for example, AR glasses and MR headsets.

[0037] The near-eye display system 100 includes a light source 101, a waveguide assembly, and an eye-tracking camera 300.

[0038] The light source 101 includes a display optical engine and an infrared illumination module. The infrared illumination module is mounted on the display optical engine, which emits image light, while the infrared illumination module emits infrared light. Integrating the infrared illumination module into the display optical engine helps to control the overall size and structural complexity of the near-eye display system 100 while achieving eye-tracking functionality.

[0039] A waveguide assembly is positioned on the light-emitting side of the light source and is used to transmit image light and infrared light. The image light, after being guided by the waveguide assembly, enters the human eye to form a virtual image; the infrared light is used for active illumination of the eye region. An eye-tracking camera 300 receives the infrared light reflected from the eye region and analyzes the gaze direction or eye position based on this light signal.

[0040] By integrating the display optical engine and infrared illumination module into the light source 101, the near-eye display system 100 achieves miniaturization and weight reduction, realizing efficient space reuse. Specifically, the infrared light source does not require a separate optical path for eye tracking, nor does it require an additional independent illumination module. In this way, the near-eye display system 100 can maintain a slim profile while simultaneously ensuring display brightness and tracking sensitivity, providing a more flexible integration approach for the miniaturization of near-eye display devices.

[0041] The waveguide assembly includes a first waveguide substrate 20, a second waveguide substrate 30, and a first transmission component 40. The first waveguide substrate 20 is used to transmit image light, and the second waveguide substrate 30 is used to transmit infrared light reflected from the eye. The two are stacked and arranged so that their optical paths do not interfere with each other. The first transmission component 40 is disposed on the second waveguide substrate 30 and is used to couple the light reflected from the eye region into the second waveguide substrate 30 and transmit it to the eye-tracking camera 300.

[0042] Please see Figure 2 , Figure 2 This is a schematic diagram of the structure of a display optical engine provided in an embodiment of this application. The display optical engine 10 is used to emit image light and is an optical engine for generating image information. Specifically, the display optical engine 10 typically includes a display chip 11 and an imaging lens group 12.

[0043] The display chip 11 can be selected from micro-displays such as micro-light-emitting diodes (Micro-LEDs), organic light-emitting diodes (OLEDs), or liquid crystal on silicon (LCoS) to generate a beam of light carrying image information.

[0044] An imaging lens is also called a lens. The imaging lens group 12 is used to collimate or focus the light beam and project it onto subsequent optical elements.

[0045] The first waveguide substrate 20 is disposed on the light-emitting side of the display optical engine 10. The first waveguide substrate 20 is used to transmit image light within it in the form of total internal reflection. After the image light is coupled into the first waveguide substrate 20, it propagates within the first waveguide substrate 20 through total internal reflection and finally enters the human eye through coupling out, forming a virtual image. At the same time, ambient light can pass through the first waveguide substrate 20 and directly enter the human eye, forming a real image of the real scene. The virtual image light and the ambient light enter the eye region 200 in the same direction and are superimposed on the human eye's retina to form an image. After processing by the visual center, the user can perceive the fused visual effect of virtual information superimposed on the real scene.

[0046] The second waveguide substrate 30 is disposed on one side of the first waveguide substrate 20 along the thickness direction of the first waveguide substrate 20, forming a stacked structure with the first waveguide substrate 20. The second waveguide substrate 30 is independent of the first waveguide substrate 20 and is used to transmit light related to eye tracking.

[0047] The first transmission component 40 is disposed on the second waveguide substrate 30. The first transmission component 40 couples the light reflected from the eye region 200 into the second waveguide substrate 30, and then transmits it to the eye-tracking camera 300 via the second waveguide substrate 30. The eye region 200 refers to the area where the eyes of the wearer of the near-eye display device are located, including the pupil, iris, and surface of the eyeball, and is the target area monitored by the eye-tracking system. The light reflected from the eye region 200 carries information about the eye's position and posture, and after being transmitted through the second waveguide substrate 30, it is received by the eye-tracking camera 300 for subsequent image analysis and gaze tracking.

[0048] Through the above structure, this solution confines the image light transmission path and the infrared light transmission path within the waveguide to the first waveguide substrate 20 and the second waveguide substrate 30, respectively, achieving separation and integration of the two optical paths in vertical space. On the one hand, it avoids the problem of mutual interference between light of different wavelengths within the same waveguide, ensuring independent optimization of display brightness and tracking sensitivity; on the other hand, the stacked arrangement of the first waveguide substrate 20 and the second waveguide substrate 30 effectively utilizes the thickness space, achieving functional expansion while maintaining a slim and lightweight form factor.

[0049] Please see Figure 3 , Figure 3 This is a schematic diagram of a second structure of the near-eye display system provided in an embodiment of this application.

[0050] In some embodiments, the near-eye display system 100 further includes a deflection element 51 disposed between the display optical engine 10 and the waveguide assembly, for example, between the display optical engine 10 and the first waveguide substrate 20, for changing the propagation direction of the image light so that it couples into the first waveguide substrate 20 at a preset angle.

[0051] Please see Figure 4 as well as Figure 5 , Figure 4 This is a schematic diagram of a third structure of the near-eye display system provided in the embodiments of this application. Figure 5 This is a schematic diagram of a fourth structure of the near-eye display system provided in this application embodiment. The turning element 51 can be a reflector or a prism. The reflector changes the light path through mirror reflection, which is simple in structure and low in cost; the prism uses the principle of total internal reflection or refraction to turn the light path, and can also be integrated with peripheral optical elements, which is beneficial to the miniaturization of the near-eye display system 100.

[0052] For further information, please refer to [link / reference]. Figure 4 as well as Figure 5 In some embodiments, the near-eye display system 100 further includes a relay lens 52 disposed between the waveguide assembly and the transition element 51, for example, between the first waveguide substrate 20 and the transition element 51. The relay lens 52 is used to perform secondary collimation or beam shaping of the image light to match the spatial position requirements of the first waveguide substrate 20.

[0053] In this implementation, please continue to refer to Figure 5 When the transition element 51 is a prism, the relay lens 52 can be optically combined or physically integrated with the prism. For example, the relay lens 52 can be attached and fixed to the incident or exit surface of the prism to form a combined optical element, or the relay lens 52 can be integrally formed with the prism. Through this integration method, the volume of the near-eye display system 100 can be further reduced.

[0054] In some embodiments, please continue reading Figure 1 as well as Figure 3 The surface of the second waveguide substrate 30 is planar or curved, and the first transmission component 40 is attached to the inner or outer side of the second waveguide substrate 30. Specifically, as shown... Figure 1 The second waveguide substrate 30 has two planar sides, or, as... Figure 3 The inner side of the second waveguide substrate 30 near the first waveguide substrate 20 is flat, and the outer side away from the first waveguide substrate 20 is curved.

[0055] Understandably, the flat mounting method is suitable for the planar second waveguide substrate 30, which is simple to manufacture and easy to mass-produce; while the curved mounting method is suitable for the curved second waveguide substrate 30, which can better match the physiological curvature of the eye region 200 or the lens appearance design requirements, and improve wearing comfort and optical performance.

[0056] In addition, such as Figure 3 The first transmission component 40 can also be embedded inside the second waveguide substrate 30.

[0057] It should be noted that the second waveguide substrate 30 can also be called an eye-tracking cover plate or simply a cover plate.

[0058] Please continue reading for more details. Figure 1 as well as Figure 3 The first transmission component 40 includes one or more first coupling gratings 41 and one or more first coupling gratings 42. The one or more first coupling gratings 41 are used to couple the light reflected from the eye region 200 into the second waveguide substrate 30, and the one or more first coupling gratings 42 are used to receive the light reflected from the eye region 200 by the second waveguide substrate 30 and couple it out to the eye-tracking camera 300. Through the division of labor and cooperation between the first coupling gratings 41 and the first coupling gratings 42, the directional transmission and extraction of the light reflected from the eye region 200 within the second waveguide substrate 30 are realized.

[0059] In some embodiments, please continue reading Figure 6 as well as Figure 7 , Figure 6 This is a schematic diagram of the fifth structure of the near-eye display system provided in the embodiments of this application. Figure 7 This is a schematic diagram of the structure of the light source provided in an embodiment of this application.

[0060] The light source 101 also includes an infrared illumination module 60, which emits infrared light into the eye region 200 to improve the imaging quality and tracking stability of the eye-tracking camera 300 under different ambient lighting conditions. Part of the infrared light emitted by the infrared illumination module 60 is reflected by the eye region 200, carrying the position and attitude information of the eye region 200, and enters the second waveguide substrate 30, and is then transmitted to the eye-tracking camera 300 via the first transmission component 40.

[0061] The infrared illumination module 60 can achieve the following technical effects: First, it provides sufficient illumination for the eye area 200 when the ambient light is low, ensuring that the eye-tracking camera 300 can clearly capture pupil images; second, it forms specific reflection characteristics through active illumination, which facilitates the algorithm to accurately calculate the direction of the gaze point; and third, the illumination light path and the display light path are independent of each other, avoiding interference with the visible light display.

[0062] Please continue reading for more details. Figure 6 as well as Figure 7 The infrared illumination module 60 includes one or more infrared light sources 61, which are disposed on the display optical engine 10. It is understood that integrating the infrared light source 61 into the interior or surface of the display optical engine 10 allows the infrared illumination light path and the display light path to share some optical components, reducing the number of independent optical components, which is beneficial for improving system integration and saving space.

[0063] A portion of the infrared light emitted from the infrared light source 61 is reflected by the eye region 200 and then enters the second waveguide substrate 30. Specifically, the infrared light emitted from the infrared light source 61 is projected onto the eye region 200 for illumination after passing through at least a portion of the optical elements of the display optical engine 10; the infrared light reflected by the eye region 200 enters the second waveguide substrate 30, is received by the first transmission component 40, and is transmitted to the eye-tracking camera 300.

[0064] For some feasible implementation methods, please refer to [link / reference]. Figure 6 The infrared light source 61 can be positioned outside the display area of ​​the display chip 11. The display chip 11 is a key component in the display optical engine 10 used to generate image information, and its display area is the effective light-emitting area. By arranging the infrared light source 61 close to the display area on the periphery of the chip, the infrared light and the image light can share the subsequent imaging lens group 12.

[0065] For other feasible implementations, please refer to [link / reference needed]. Figure 7 The infrared light source 61 can be set at the edge of the light-emitting surface of the imaging lens group 12, which makes it easy to independently adjust the position and emission angle of the infrared light source 61, so as to make its optical path separation from the image light higher and reduce the potential interference of infrared illumination on the display optical path.

[0066] Please continue reading for more details. Figure 6 as well as Figure 7The infrared illumination module 60 also includes at least one collimating lens 62, which is correspondingly disposed on the light-emitting side of the infrared light source 61. The collimating lens 62 is used to collimate the diverging beam emitted from the infrared light source 61, adjusting the divergence angle and spot diameter of the beam to meet the transmission requirements of the subsequent optical path. With the cooperation of the collimating lens 62, the illumination efficiency can be improved, while reducing light energy loss during total internal reflection transmission within the second waveguide substrate 30.

[0067] Please continue reading. Figure 1 , Figure 6 as well as Figure 8 , Figure 8 This is a sixth structural schematic diagram of the near-eye display system provided in the embodiments of this application. The waveguide assembly further includes a second transmission assembly 70. The second transmission assembly 70 is disposed on the first waveguide substrate 20 or the second waveguide substrate 30. The second transmission assembly 70 includes one or more second coupling gratings 71 and one or more second coupling gratings 72. The one or more second coupling gratings 71 are used to receive the light emitted by the infrared illumination module 60 and transmit it to the first waveguide substrate 20. The one or more second coupling gratings 72 are used to receive the light transmitted by the first waveguide substrate 20 and couple it out to the eye region 200 to realize active infrared illumination of the eye region 200.

[0068] It should be noted that both the second transmission component 70 and the first transmission component 40 are designed for the infrared band. Since infrared light and image light have different bands, and the gratings of the transmission components on the first waveguide substrate 20 and the second waveguide substrate 30 are designed to be effective only for infrared light and transparent to visible light, the infrared illumination light path and the image display light path do not interfere with each other, ensuring that the normal display of the image light is not affected.

[0069] In some embodiments, one or more second coupling gratings 71 have optical power, and / or one or more second coupling gratings 72 have optical power. Optical power is a measure of the ability of an optical element to converge or diverge a beam of light. Optical power is typically expressed as the reciprocal of the focal length. The second coupling grating 72 is specifically a diffraction grating. For a diffraction grating, by changing its structural characteristics (such as a periodic distribution or the use of an aperiodic structure), it can be made to have a specific optical power, thereby controlling the focusing or divergence of the transmitted or diffracted beam.

[0070] When the second coupling grating 71 has optical power, the infrared light emitted by the infrared illumination module 60 can be pre-controlled before entering the first waveguide substrate 20. When the second coupling grating 72 has optical power, the infrared light coupled from the first waveguide substrate 20 can be controlled to project onto the eye region 200 at the desired divergence angle or convergence state. When both the second coupling grating 71 and the second coupling grating 72 have optical power, they can work together to form a complete beam control link.

[0071] As mentioned earlier, the infrared illumination module 60 is equipped with a collimating lens 62, which collimates the diverging beam emitted from the infrared light source 61, making the infrared light entering the first waveguide substrate 20 approximately a parallel beam. When the collimated infrared light passes through the second coupling grating 71 or the second coupling grating 72, the second coupling grating 71 and the second coupling grating 72, which have optical power, further converge or diverge the infrared light, thereby improving the accuracy of infrared light control.

[0072] It is understood that by adjusting the structural features of the second coupling grating 71 and / or the second coupling grating 72 (such as periodic distribution or a non-periodic structure), the emission angle and divergence angle of the second coupling grating 71 and the second coupling grating 72 are adjusted, thereby changing the optical power of the second coupling grating 72, so that the distance between the virtual light source imaged at the eye region 200 and the eye region 200 is less than or equal to the distance between one or more second coupling gratings 72 and the eye.

[0073] Therefore, by changing the divergence angle and deflection angle of the second coupling grating 71 and / or the second coupling grating 72, as much light as possible can be directed onto the eye region 200. This design can improve illumination efficiency, reduce the number of infrared light sources 61 used, thereby effectively reducing energy consumption, and maintain a suitable close distance between the infrared light sources 61 and the eye region 200, so that the eye is less likely to exceed the light coverage area when the eye region 200 rotates naturally.

[0074] Please see Figure 9 , Figure 9 This is a seventh structural schematic diagram of the near-eye display system provided in the embodiments of this application. The near-eye display system 100 further includes one or more third coupling gratings 80 and one or more third coupling gratings 90, the third coupling gratings 80 and the third coupling gratings 90 being disposed on the first waveguide substrate 20.

[0075] One or more third coupling gratings 80 are used to receive image light emitted by the display optical engine 10 and transmit it to the first waveguide substrate 20, and one or more third coupling gratings 90 are used to receive image light transmitted by the first waveguide substrate 20 and couple it out to the eye region 200.

[0076] Specifically, the third coupling grating 80 is located on the first waveguide substrate 20 corresponding to the light-emitting side of the display optical engine 10. It is used to receive the image light emitted by the display optical engine 10 and couple the image light into the interior of the first waveguide substrate 20 through diffraction. The image light after entering the waveguide satisfies the total internal reflection condition, and thus propagates forward in the form of total internal reflection inside the first waveguide substrate 20 until it reaches the region where the third output grating 90 is located.

[0077] The third coupling grating 90 is located on the first waveguide substrate 20 at a position corresponding to the eye region 200. It is used to receive the image light transmitted through total internal reflection inside the first waveguide substrate 20, and to diffract and couple it out from the first waveguide substrate 20, ultimately guiding it to the eye region 200 to form a virtual image on the human retina.

[0078] Please continue reading. Figure 10 as well as Figure 11 , Figure 10 This is a schematic diagram of a first structure of a near-eye display device provided in an embodiment of this application. Figure 11 This is a schematic diagram of a second structure of a near-eye display device provided in an embodiment of this application.

[0079] This application embodiment also provides a near-eye display device 1, which refers to integrating the near-eye display system 100 described in this application into a wearable structure to form a complete product form that can be actually used by users, such as AR glasses, AR headsets, MR headsets, etc.

[0080] like Figure 11 The near-eye display device 1 includes a frame 400, a near-eye display system 100, and an eye-tracking camera 300.

[0081] The frame 400 is the supporting structure for the near-eye display device 1, used to support and fix optical components, electronic devices, housing, etc. The frame 400 is positioned in front of the user's face when worn, similar to the frame structure of ordinary eyeglasses.

[0082] The near-eye display system 100 is the near-eye display system 100 in any of the above embodiments, and the near-eye display system 100 is mounted on the eyeglass frame 400. Specifically, the display optical engine 10, the first waveguide substrate 20, the second waveguide substrate 30, and the related transmission components in the near-eye display system 100 are all integrated and fixed to the corresponding positions of the eyeglass frame 400.

[0083] An eye-tracking camera 300 is mounted on the frame 400 and is used to capture images of the eye region 200. Combined with the first transmission component 40 and the second waveguide substrate 30 in the aforementioned near-eye display system 100, the eye-tracking camera 300 can receive the reflected light from the eyeball transmitted through the second waveguide substrate 30, thereby achieving real-time monitoring of the eyeball position and gaze direction.

[0084] Specifically, the frame 400 includes two frames, a nose bridge 410, and two temples. The nose bridge 410 is connected to each of the two frames, and the two temples are connected to each of the two frames, forming a wearing structure similar to ordinary eyeglasses. However, the frame 400 is a hollow structure, meaning that the two frames, the nose bridge 410, and the two temples are at least partially hollow and interconnected, allowing for the housing of optical display devices or other components.

[0085] The first waveguide substrate, located on the lens, is connected to the frame and used to transmit image light to the human eye area. Specifically, the first waveguide substrate 20 can be attached to the surface of the lens, and the lens is connected to the frame; the connection method can be detachable or fixed. The display optical engine 10 is located at the bridge of the nose 410, specifically within the cavity of the bridge of the nose 410. This layout hides the display optical engine at the bridge of the nose, avoiding increasing the size of the temples and contributing to the thinning of the near-eye display device 1. The eye-tracking camera 300 is located at the temple, specifically within the temple cavity. This location allows for the acquisition of a frontal image of the eye area 200, reducing occlusion and deformation and improving tracking accuracy.

[0086] The near-eye display device 1 also includes a deflection element 51, which is disposed between the display optical engine 10 and the waveguide assembly, for example, between the display optical engine 10 and the first waveguide substrate 20, to change the propagation direction of the image light so that it meets the requirements of the coupling angle, coupling position, etc. of the first waveguide substrate 20.

[0087] Since the display optical engine 10 is located at the nose bridge 410, the output optical axis of the display optical engine 10 is often difficult to align directly with the coupling area of ​​the first waveguide substrate 20 due to the limited space and structural shape of this area. If the incident angle of the image light deviates from the coupling angle design range of the waveguide grating, it will lead to a decrease in coupling efficiency, uneven image brightness, or even the inability of light to enter the waveguide. The introduction of the deflection element 51 can achieve optical path deflection within a limited space, adjusting the image light to a preset angle range to ensure that it meets the total internal reflection condition to enter the first waveguide substrate 20, thereby ensuring display quality.

[0088] The deflection element 51 is located at the frame or nose bridge 410, matching the position of the display optical engine 10. This position is close to the light outlet of the display optical engine 10, and can complete the deflection before the light enters the waveguide, avoiding light energy loss and stray light interference caused by long-distance free space propagation, and achieving efficient optical path deflection in a compact layout.

[0089] For example, the deflection element 51 can be disposed at the lens frame and fixedly connected to the lens frame. At this time, the optical axis direction of the display optical engine 10 is matched with the extension direction of the lens frame, and the optical path is deflected to the first waveguide substrate 20 by the deflection element 51.

[0090] The deflection element 51 can be a mirror or a prism. When the deflection element 51 is a prism, the relay lens 52 can be optically combined or physically integrated with the prism. Specifically, the relay lens 52 can be attached and fixed to the incident or exit surface of the prism to form a combined optical element; or an integral molding process can be used to manufacture the relay lens 52 and the prism into an integral structure.

[0091] This integration eliminates the need for a separate air gap or additional lens barrel support between the relay lens 52 and the prism, thus removing the structural frame of the optical path bend. This not only reduces the space occupied by optical components but also lowers the accumulation of assembly tolerances, improves optical path stability, and further compresses the overall size of the near-eye display device 1 to meet the compact layout requirements at the nose bridge 410.

[0092] In some embodiments, the near-eye display system 100 further includes one or more third coupling gratings 80 and one or more third coupling gratings 90, the third coupling gratings 80 and the third coupling gratings 90 being disposed on the first waveguide substrate 20.

[0093] One or more third coupling gratings 80 are used to receive image light emitted by the display optical engine 10 and transmit it to the first waveguide substrate 20, and one or more third coupling gratings 90 are used to receive image light transmitted by the first waveguide substrate 20 and couple it out to the eye region 200.

[0094] With the above structure, image light emitted from the display optical engine 10 enters the waveguide via the third coupling grating 80, undergoes total internal reflection within the waveguide, and then exits through the third coupling grating 90 into the human eye, forming a complete display optical path. This design fully utilizes the total internal reflection characteristics of the first waveguide substrate 20 to transmit image light from the display optical engine 10 located at the nose bridge 410 to the front of the human eye, achieving a long-distance layout of the display optical engine 10 and avoiding the bulky size problem caused by directly setting the display optical engine 10.

[0095] In the near-eye display system 100 and near-eye display device 1 provided in this application embodiment, by setting the transmission paths of image light and eye-tracking light in the first waveguide substrate 20 and the second waveguide substrate 30 respectively, not only is the mutual interference of the two light paths in the same medium avoided, and the efficient utilization of the internal vertical space is achieved, but the imaging angle and image quality of the eye-tracking camera 300 are also effectively guaranteed.

[0096] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0097] In the description of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, features defined with "first" and "second" may explicitly or implicitly include one or more features.

[0098] The near-eye display system and near-eye display device provided in the embodiments of this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application, and the descriptions of the embodiments above are only for the purpose of helping to understand this application. Furthermore, those skilled in the art will recognize that, based on the ideas of this application, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A near-eye display system, characterized in that, include: The light source includes a display optical engine and an infrared illumination module. The infrared illumination module is mounted on the display optical engine, which emits image light. The infrared illumination module emits infrared light. A waveguide assembly is disposed on the light-emitting side of the light source, and the waveguide assembly is used to transmit the image light and the infrared light; An eye-tracking camera, wherein the eye-tracking camera is used to receive infrared light reflected from the eye region.

2. The near-eye display system according to claim 1, characterized in that, The waveguide assembly includes a first waveguide substrate, a second waveguide substrate, and a first transmission component. The first waveguide substrate is disposed on the light-emitting side of the display optical engine and is used to transmit the image light within it in the form of total internal reflection. The second waveguide substrate is disposed on one side of the first waveguide substrate along the thickness direction of the first waveguide substrate. The first transmission component is disposed on the second waveguide substrate and is used to couple the light reflected from the eye region into the second waveguide substrate and transmit it to the eye-tracking camera via the second waveguide substrate.

3. The near-eye display system according to claim 2, characterized in that, The surface of the second waveguide substrate is planar or curved, and the first transmission component is attached to the inner or outer side of the second waveguide substrate.

4. The near-eye display system according to claim 3, characterized in that, The first transmission component includes one or more first coupling gratings and one or more first coupling out gratings. The one or more first coupling gratings are used to couple light reflected from the eye region into the second waveguide substrate, and the one or more first coupling out gratings are used to receive light reflected from the eye region from the second waveguide substrate and couple it out to the eye-tracking camera.

5. The near-eye display system according to claim 2, characterized in that, The waveguide assembly further includes a second transmission assembly, which is disposed on the first waveguide substrate or the second waveguide substrate. The second transmission assembly includes one or more second coupling gratings and one or more second coupling gratings. The one or more second coupling gratings are used to receive the light emitted by the infrared illumination module and transmit it to the first waveguide substrate. The one or more second coupling gratings are used to receive the light transmitted by the first waveguide substrate and couple it out to the eye region.

6. The near-eye display system according to claim 5, characterized in that, One or more of the second coupled gratings have optical power.

7. The near-eye display system according to claim 2, characterized in that, It also includes one or more third coupling-in gratings and one or more third coupling-out gratings, the third coupling-in gratings and the third coupling-out gratings being disposed on the first waveguide substrate. The one or more third coupling-in gratings are used to receive image light emitted by the display optical engine and transmit it to the first waveguide substrate. The one or more third coupling-out gratings are used to receive image light transmitted by the first waveguide substrate and couple it out to the eye region.

8. The near-eye display system according to any one of claims 1 to 7, characterized in that, It also includes a transition element disposed between the display optical engine and the waveguide assembly.

9. The near-eye display system according to claim 8, characterized in that, It also includes a relay lens, which is disposed between the waveguide assembly and the transition element.

10. The near-eye display system according to any one of claims 1 to 7, characterized in that, The infrared illumination module includes one or more infrared light sources, which are disposed on the display optical engine. Part of the infrared light emitted by the infrared light source is reflected by the eye region and then enters the waveguide assembly.

11. The near-eye display system according to claim 10, characterized in that, The infrared illumination module further includes at least one collimating lens, which is disposed on the light-emitting side of the infrared light source.

12. A near-eye display device, characterized in that, include: Eyeglass frames; A near-eye display system, wherein the near-eye display system is the near-eye display system according to any one of claims 1 to 11, and the near-eye display system is mounted on the frame; An eye-tracking camera is mounted on the frame of the glasses.

13. The near-eye display device according to claim 12, characterized in that, The eyeglass frame includes two frames, a nose bridge, and two temples. The nose bridge is connected to the two frames, and the two temples are connected to the two frames. The display optical engine is located at the nose bridge, and the eye-tracking camera is located at the temples.

14. The near-eye display device according to claim 13, characterized in that, It also includes a turning element, which is disposed between the display optical engine and the waveguide assembly, and the turning element is disposed at the lens frame or nose bridge.

Images