Optical module and head-mounted display device

Abstract

The application discloses an optical module and a head-mounted display device. The optical module comprises an optical lens, a screen, and a light source and a sensor built in the screen. The light source is used for emitting light to an eye region of a user through the optical lens. The sensor is used for receiving light reflected by the eye region to locate the position of the eye of the user. The application reduces the complexity, cost and weight of the optical module by building the light source and the sensor for locating the position of the eye in the screen.

Description

Technical Field

[0001] This application relates to the field of extended reality technology, specifically to an optical module and a head-mounted display device. Background Technology

[0002] With the development of technologies such as Extended Reality (XR), Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), head-mounted displays utilizing these technologies are becoming a hot topic in the consumer electronics field, serving as a medium for merging the real and virtual worlds. The optical module is one of the key components for achieving this fusion. Primarily composed of a screen and optical lenses, the optical module's performance directly impacts image quality, brightness uniformity, and user experience.

[0003] In extended reality or virtual reality systems, the eyes are not only the organs of visual perception but also play a role in interacting with the system. Eye movement information serves as input signals to the system, and the system's optical performance, such as brightness and color uniformity and pupil drift, is closely related to the position of the pupil and the gaze point. Therefore, quickly and accurately capturing eye position and gaze point is crucial for optimizing the user experience of head-mounted display devices.

[0004] Currently, the main method for locating eyes is through an external infrared light source combined with an external infrared camera to capture images. This method increases the complexity, cost, and weight of the system. Summary of the Invention

[0005] This application provides an optical module and a head-mounted display device, which reduces the complexity, cost and weight of the optical module by embedding the light source and sensor used to locate the eye position inside the screen.

[0006] On one hand, embodiments of this application provide an optical module, the optical module comprising:

[0007] Optical lenses;

[0008] Screen;

[0009] The screen includes a built-in light source and a sensor. The light source emits light through the optical lens to the user's eye area, and the sensor receives the light reflected from the eye area to locate the user's eye position.

[0010] On the other hand, embodiments of this application provide a head-mounted display device, which includes the optical module as described in any of the above embodiments.

[0011] This application provides an optical module and a head-mounted display device. The optical module includes an optical lens, a screen, and a light source and sensor built into the screen. The light source emits light through the optical lens to the user's eye area, and the sensor receives the light reflected from the eye area to locate the user's eye position. By embedding the light source and sensor for locating the eye position within the screen, this application significantly simplifies the overall structure of the optical module compared to traditional external light source and sensor solutions, reducing additional hardware components and complex assembly processes. The built-in light source and sensor design reduces reliance on external components, lowers raw material and manufacturing costs, and avoids the additional weight of external components, making the optical module and head-mounted display device more portable. The built-in light source and sensor can contact the user's eye area more closely, thereby improving the accuracy and stability of eye position capture. The optical module of this application provides a more comfortable and convenient user experience by simplifying the structure, reducing costs, and lightening the weight. Attached Figure Description

[0012] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0013] Figure 1 This is a first structural schematic diagram of an optical module provided in an embodiment of this application.

[0014] Figure 2 This is a schematic diagram of the second structure of the optical module provided in an embodiment of this application.

[0015] Figure 3 This is a schematic diagram of the third structure of the optical module provided in an embodiment of this application.

[0016] Figure 4 This is a schematic diagram of the fourth structure of the optical module provided in an embodiment of this application.

[0017] Figure 5 This is a fifth structural schematic diagram of the optical module provided in an embodiment of this application.

[0018] Figure 6 This is a sixth structural schematic diagram of the optical module provided in an embodiment of this application.

[0019] Figure 7 This is a seventh structural schematic diagram of the optical module provided in the embodiments of this application. Detailed Implementation

[0020] In the description of this application, it should be understood that the terms "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," and "counterclockwise," etc., indicating orientation or positional relationships based on the orientation or positional relationships shown in the accompanying drawings, are only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this application. Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, features defined with "first" and "second" may explicitly or implicitly include one or more features. In the description of this application, "multiple" means two or more, unless otherwise explicitly specified.

[0021] In the description of this application, it should be noted that, unless otherwise expressly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection, an electrical connection, or a connection that allows communication between them; they can refer to a direct connection or an indirect connection through an intermediate medium; they can refer to the internal communication between two components or the interaction between two components. Those skilled in the art can understand the specific meaning of the above terms in this application according to the specific circumstances.

[0022] In this application, unless otherwise expressly specified and limited, "above" or "below" the second feature can include direct contact between the first and second features, or contact between the first and second features through another feature between them. Furthermore, "above," "over," and "on top" of the second feature includes the first feature being directly above or diagonally above the second feature, or simply indicates that the first feature is at a higher horizontal level than the second feature. "Below," "below," and "under" the second feature includes the first feature being directly below or diagonally below the second feature, or simply indicates that the first feature is at a lower horizontal level than the second feature.

[0023] The following disclosure provides many different embodiments or examples for implementing different structures of this application. To simplify the disclosure, specific examples of components and arrangements are described below. Of course, these are merely examples and are not intended to limit the scope of this application. Furthermore, reference numerals and / or letters may be repeated in different examples; such repetition is for simplification and clarity and does not in itself indicate a relationship between the various embodiments and / or arrangements discussed. In addition, various specific examples of processes and materials are provided in this application, but those skilled in the art will recognize the application of other processes and / or the use of other materials.

[0024] The embodiments of this application can be applied to various application scenarios such as Extended Reality (XR), Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR).

[0025] First, some of the nouns or terms that appear in the description of the embodiments of this application are explained as follows:

[0026] Extended Reality (XR) is a concept that includes Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). It refers to the technology that creates an environment that connects the virtual world with the real world, allowing users to interact with that environment in real time.

[0027] Virtual Reality (VR) is a technology for creating and experiencing virtual worlds. It computationally generates a virtual environment, which is a multi-source information (virtual reality mentioned in this article includes at least visual perception, and may also include auditory perception, tactile perception, motion perception, and even taste perception, olfactory perception, etc.) that realizes the fusion of virtual environment, interactive three-dimensional dynamic visual scenes and simulation of physical behavior, allowing users to immerse themselves in the simulated virtual reality environment, and enabling applications in various virtual environments such as maps, games, videos, education, medical care, simulation, collaborative training, sales, assisted manufacturing, maintenance and repair.

[0028] Augmented Reality (AR) is a technology that calculates the camera's pose parameters in the real world (or 3D world, the real world) in real time during image capture, and adds virtual elements to the captured images based on these parameters. Virtual elements include, but are not limited to, images, videos, and 3D models. The goal of AR technology is to overlay the virtual world onto the real world on a screen for interactive experiences.

[0029] Mixed Reality (MR) is a simulated scene that integrates computer-created sensory input (e.g., virtual objects) with sensory input or its representation from a physical setting. In some MR scenes, the computer-created sensory input can adapt to changes in sensory input from the physical setting. Additionally, some electronic systems used to present MR scenes can monitor orientation and / or position relative to the physical setting, enabling virtual objects to interact with real objects (i.e., physical elements from the physical setting or their representations). For example, the system can monitor motion so that virtual plants appear stationary relative to physical buildings.

[0030] Virtual reality devices, the terminals that enable virtual reality effects, can typically be provided in the form of glasses, head-mounted displays (HMDs), or contact lenses to achieve visual perception and other forms of perception. Of course, the form of virtual reality devices is not limited to these, and they can be further miniaturized or enlarged as needed.

[0031] The virtual reality devices described in this application may include, but are not limited to, the following types:

[0032] PC-based virtual reality (PCVR) devices utilize a PC for calculations and data output related to virtual reality functions. External PC-based virtual reality devices then use the data output from the PC to achieve the virtual reality effect.

[0033] Mobile virtual reality devices support setting up mobile terminals (such as smartphones) in various ways (such as head-mounted displays with dedicated card slots). Through wired or wireless connections with the mobile terminal, the mobile terminal performs calculations related to virtual reality functions and outputs data to the mobile virtual reality device, such as watching virtual reality videos through a mobile terminal's app.

[0034] All-in-one virtual reality devices have a processor for performing virtual functions, thus possessing independent virtual reality input and output capabilities. They do not require connection to a PC or mobile terminal, offering a high degree of freedom of use.

[0035] The following sections provide detailed descriptions of each example. It should be noted that the order in which the embodiments are described is not intended to limit the priority of the embodiments.

[0036] Please see Figures 1 to 7 This application provides an optical module 100. The optical module 100 includes an optical lens 10, a screen 20, and a light source 30 and a sensor 40 built into the screen 20.

[0037] The optical lens 10 is a key component for light transmission, responsible for focusing and guiding the light emitted from the light source 30 to the user's eye area 200. Its design must consider optical properties such as refraction and scattering to ensure accurate light transmission and focusing. For example, the optical lens 10 is typically made of materials with high light transmittance and low dispersion, such as glass or high refractive index plastic, to reduce light loss and distortion during transmission.

[0038] Among them, the screen 20 is not only the main component for displaying images, but also integrates the light source 30 and the sensor 40, realizing the dual functions of display and eye position capture.

[0039] The light source 30 and sensor 40 are built into the screen 20. The light source 30 is used to emit light to the user's eye area 200 through the optical lens 10, and the sensor 40 is used to receive the light reflected from the eye area 200 to locate the user's eye position.

[0040] For example, light emitted from light source 30 shines through optical lens 10 onto the pupil of the eye in eye region 200. The light reflected from the pupil enters the corresponding sensor 40. Sensor 40 converts the received light signal into an electrical signal. Then, by performing data processing or image processing on the light signal output by sensor 40, the position of the user's pupil can be calculated.

[0041] For example, the light source 30 can be an infrared pixel 31, which can be manufactured using conventional screen 20 pixel manufacturing methods, such as liquid crystal display (LCD), light-emitting diode (LED), micro light-emitting diode (Micro LED) with infrared backlight, or organic light-emitting diode (OLED) with infrared light-emitting materials. These technologies ensure that the infrared pixel 31 is effectively integrated into the screen 20 and maintains good luminous performance.

[0042] For example, the sensor 40 can be an infrared light sensor 41, which can be manufactured using complementary metal-oxide-semiconductor (CMOS) technology (such as a silicon-based backplane) or thin-film transistor (TFT) technology (such as a glass-based backplane or a polyimide (PI)-based backplane). Both of these processes are currently widely used in the manufacture of optoelectronic sensors, ensuring that the infrared light sensor 41 has high sensitivity and a good signal-to-noise ratio, thereby accurately capturing and processing infrared light information reflected from the user's eyes.

[0043] Through the above design, the optical module 100 provided in this application embodiment not only simplifies the structure and reduces cost and weight, but also improves the accuracy of eye position capture, providing a more efficient eye-tracking solution for head-mounted display devices such as AR, VR and MR.

[0044] In some embodiments, such as Figures 4 to 7 As shown, screen 20 includes:

[0045] Multiple display pixels 21 are used to emit visible light in at least one wavelength;

[0046] An optical modulation film 22, covering multiple display pixels 21, is used to adjust the propagation direction of visible light.

[0047] For example, display pixels 21 are the basic building blocks of screen 20, responsible for emitting visible light in at least one wavelength. They combine to emit light of different colors and intensities to form a complete image. Display pixels 21 can be implemented using various technologies, such as LCD, LED, and OLED. Each technology has its unique light-emitting principle and display characteristics. Display pixels 21 can be configured to emit light in multiple wavelengths to reproduce rich colors. Display pixels 21 are typically evenly distributed within the display area of ​​screen 20 to provide a continuous and consistent image display.

[0048] For example, an optical modulation film 22 covers multiple display pixels 21, and its main function is to adjust the propagation direction of visible light. This adjustment helps control the distribution and direction of light to optimize the display effect, such as improving contrast, preventing glare, or enhancing viewing angle stability. Common optical modulation films 22 include circular polarizers, color filters, etc. These films modulate light by changing the polarization state or color composition of light.

[0049] In some embodiments, such as Figure 2 or Figure 4 As shown, the optical modulation film 22 is configured in a layout that does not cover the light source 30 and the sensor 40.

[0050] For example, the display area of ​​screen 20 is generally covered with optical modulation films 22, such as circular polarizers, but the surfaces of the light source 30 (e.g., infrared light pixel 31) and the corresponding sensor 40 (e.g., infrared light sensor 41) are not covered with these optical modulation films 22. This deliberate design ensures that the infrared light emitted by the light source 30 and the reflected light received by the sensor 40 are not affected by the optical modulation films, thereby ensuring that the sensor 40 can accurately capture the light reflected from the eye region 200 to achieve precise eye position positioning. By avoiding the optical modulation films 22 covering the light source 30 and sensor 40, the loss and interference of light during propagation can be reduced, thereby improving the light transmittance. At the same time, this also helps to improve the signal-to-noise ratio of the sensor 40, because it reduces external factors that may affect sensor performance, such as noise caused by light scattering or reflection.

[0051] The design of the infrared light pixel 31 and the infrared light sensor 41 allows them to operate without being affected by the optical modulation film 22, enabling high-precision eye tracking. The infrared light emitted by the infrared light pixel 31 can directly illuminate the pupil of the eye region 200, while the infrared light sensor 41 can accurately capture the infrared light reflected back from the pupil, thereby achieving precise positioning of the user's eye.

[0052] In some embodiments, the optical module 100 further includes an optional transparent protective layer covering the optical modulation film 22 and the light source 30 and sensor 40 components not covered by the optical modulation film 22.

[0053] For example, this transparent protective layer protects the screen 20 from scratches, impacts, and other forms of physical damage, thereby extending the lifespan of the optical module 100 and maintaining its optimal operating condition. The transparent protective layer not only covers the display pixels 21 areas covered by the optical modulation film 22 but also extends over the light source 30 and sensor 40 components not covered by the optical modulation film 22. This means that both the display pixels 21 used to display visible light and the light source 30 and sensor 40 used for eye tracking are effectively protected.

[0054] For example, the transparent protective layer may be made of materials with high transparency, high hardness, and good abrasion resistance, such as glass, tempered glass, plastic, or special optical films. The choice of these materials is designed to ensure that light can pass through the protective layer smoothly while providing sufficient protection. By introducing a transparent protective layer, the durability and reliability of the optical module 100 are significantly improved. Users can enjoy high-quality display effects and accurate eye-tracking functions with greater peace of mind when using head-mounted displays without worrying about screen damage.

[0055] In some embodiments, such as Figure 3 ,as well as Figures 5 to 7 As shown, the optical modulation film 22 is configured to cover the light source 30 and the sensor 40.

[0056] For example, when the light source 30 (such as infrared pixel 31) has a high luminous intensity and the sensor 40 (such as infrared sensor 41) has a correspondingly high sensitivity, even if the optical modulation film 22 covers the light source 30 and the sensor 40, it may not significantly affect the emission and reception of light. This is because a high-intensity light source can penetrate the optical modulation film 22, while a highly sensitive sensor 40 can detect the weak reflected light after penetrating the film layer.

[0057] In this configuration, the optical modulation film 22 provides additional benefits, such as enhancing the overall display effect of the screen, providing an extra protective layer, or improving light uniformity. However, this configuration requires careful consideration of the performance parameters of the light source 30 and sensor 40, as well as the material and thickness of the optical modulation film 22, to ensure that the accuracy and stability of the eye-tracking function are not affected. In this configuration, the material and properties of the optical modulation film 22 also need to be rigorously selected to ensure that it does not interfere with the normal operation of the light source 30 and sensor 40. For example, the optical modulation film 22 can be made of a film material with low absorptivity and high transmittance to reduce light attenuation.

[0058] For example, if the optical modulation film 22 is designed to allow only infrared light of a specific wavelength to pass through, the optical modulation film 22 covers the light source 30 and the sensor 40, and can filter out most of the visible light and other wavelengths of light to reduce the interference of ambient light on the sensor 40.

[0059] In some embodiments, such as Figures 2 to 5 As shown, the light source 30 is an infrared light pixel 31, and the sensor 40 is an infrared light sensor 41. The infrared light pixel 31 and the infrared light sensor 41 are arranged around or outside the screen 20.

[0060] For example, infrared pixels 31 and infrared sensors 41 are positioned around or around the periphery of screen 20. This arrangement takes into account that when using a head-mounted display device, the user's eyes primarily focus on the central area of ​​screen 20; therefore, the central area of ​​the screen requires a higher pixel density to provide a clear image display. Because the human eye has higher visual sensitivity to the central area of ​​the screen, the central area of ​​screen 20 requires a higher pixel density to meet the demands of high-resolution display. Positioning infrared pixels 31 and infrared sensors 41 around or around the screen allows for eye-tracking functionality without affecting the pixel density in the central area.

[0061] By arranging a ring of infrared light pixels 31 and corresponding infrared light sensors 41 around or around the perimeter of the screen 20, the position and gaze point of the user's eyes can be effectively captured without adding an additional sensor in the center of the screen, thus avoiding interference with the display effect. The infrared light emitted by the infrared light pixels 31 is irradiated onto the pupil of the eye area 200 through the optical lens 10, and the infrared light reflected from the pupil is received by the corresponding infrared light sensor 41. By processing the data received by the sensor 41, the position of the user's pupil can be accurately calculated.

[0062] Placing the infrared light pixels 31 and infrared light sensor 41 around or around the screen helps optimize the design of the entire optical module 100, reducing system complexity and cost, while also lightening the weight of the head-mounted display and improving user comfort. This layout improves the accuracy and flexibility of eye tracking because the infrared light pixels 31 and infrared light sensor 41 can cover a larger area that the user's eyes may be focused on, thus achieving more comprehensive eye tracking. By placing the infrared light pixels 31 and infrared light sensor 41 around or around the screen 20, the optical module 100 can adapt to different users' visual habits and different usage scenarios, providing a more personalized and comfortable user experience.

[0063] To ensure effective propagation and reception of infrared light, the surfaces of the infrared light pixel 31 and the infrared light sensor 41 are typically not covered with optical modulation films such as circular polarizers. This increases the transmittance of infrared light, enhances the signal-to-noise ratio of the infrared light sensor, and thus improves the accuracy and reliability of eye detection.

[0064] In some embodiments, such as Figures 4 to 5 As shown, the infrared light pixel 31 and the infrared light sensor 41 are embedded in the display pixels 21 around or around the screen 20, and the infrared light pixel 31 and the infrared light sensor 41 correspond one-to-one with each display pixel 21 around or around the screen.

[0065] For example, the infrared light pixels 31 and the infrared light sensor 41 are not only cleverly positioned around or in the outer area of ​​the screen 20, but they are also directly embedded in the display pixels 21 in these areas. This design achieves a one-to-one correspondence between the infrared light pixels 31, the infrared light sensor 41, and the display pixels 21, providing users with a more accurate and efficient eye-tracking experience.

[0066] Specifically, the infrared light pixel 31 and the infrared light sensor 41 are carefully integrated into the display pixel 21 of the screen 20. This means that each infrared light pixel 31 and infrared light sensor 41 is associated with a specific display pixel 21, and they share the same spatial location. This one-to-one correspondence not only improves the accuracy of eye tracking but also significantly increases the density of the infrared light pixel 31 and infrared light sensor 41.

[0067] However, since the infrared light pixel 31 and the infrared light sensor 41 occupy part of the space of the display pixel 21, the aperture ratio (i.e., the proportion of the effective display area) of the display pixel 21 of the screen 20 will be compressed to a certain extent. The reduction in aperture ratio may affect the brightness and contrast of the screen, thus having a certain negative impact on the display effect.

[0068] Nevertheless, this design still has its unique advantages. By increasing the density of the infrared light pixels 31 and the infrared light sensor 41, the device can more accurately capture the user's eye movements, thus achieving more precise eye tracking. This is especially important for applications requiring high-precision eye tracking, such as virtual reality and augmented reality.

[0069] To balance display quality and eye-tracking accuracy, careful consideration must be given to the layout and size of the infrared light pixels 31, infrared light sensor 41, and display pixels 21. Optimizing these parameters allows for high-precision eye-tracking while maintaining display quality. For example, the size of the infrared light pixels 31 and infrared light sensor 41 can be reduced to minimize their footprint on the display pixels 21. Alternatively, the infrared light pixels 31 and infrared light sensor 41 can be embedded in the gaps between the display pixels 21, rather than directly occupying their space, thus maximizing the screen's aperture ratio. A denser layout can be used around the perimeter or outer areas of the screen 20 to increase the number of infrared light pixels 31 and infrared light sensor 41, thereby improving eye-tracking accuracy. Advanced semiconductor manufacturing processes, such as micro / nano fabrication, can be used to create smaller and more precise infrared light pixels 31 and infrared light sensor 41. High-transmittance, low-absorption optical materials can be used to reduce light loss during transmission.

[0070] In some embodiments, such as Figure 6 As shown, the light source 30 is an infrared light pixel 31, and the sensor 40 is an infrared light sensor 41. The infrared light pixel 31 and the infrared light sensor 41 are embedded in the display pixels 21 of the entire display area of ​​the screen 20. The infrared light pixel 31 and the infrared light sensor 41 correspond one-to-one with each display pixel 21 in the entire display area.

[0071] For example, the infrared light pixels 31 and infrared light sensors 41 are not only embedded in the display pixels 21 around or around the periphery of the screen 20, but also distributed throughout the entire display area of ​​the screen 20. This design ensures that the infrared light pixels 31 and infrared light sensors 41 correspond one-to-one with each display pixel 21 in the entire display area. By integrating the infrared light pixels 31 and infrared light sensors 41 throughout the entire display area of ​​the screen 20, a higher density of infrared light pixels and sensors can be achieved, thereby providing more accurate and comprehensive eye tracking.

[0072] Since the infrared light pixels 31 and infrared light sensors 41 are distributed throughout the entire screen display area, the imaging area is maximized, which helps to capture all possible positions and movements of the user's eyes in front of the screen, providing more comprehensive user interaction data.

[0073] Integrating the infrared light pixel 31 and the infrared light sensor 41 into each display pixel 21 results in a reduced aperture ratio for the display pixel 21. This reduced aperture ratio may negatively impact screen brightness and image quality, necessitating design optimization to compensate for this effect. Various measures can be taken to mitigate the impact of reduced aperture ratio on display performance, such as increasing the brightness of the backlight system, optimizing backlight distribution, using more efficient luminescent materials, or adjusting the design of the display pixel 21 to improve luminous efficiency. This design requires striking a balance between eye-tracking accuracy and display performance. While integrating the infrared light pixel 31 and the infrared light sensor 41 improves tracking accuracy, it is also essential to ensure that the display performance of the screen 20 meets user requirements.

[0074] This design is particularly suitable for High Dynamic Range (HDR) display technology because it allows for the integration of high-precision eye-tracking functionality while maintaining high contrast and color accuracy. This integrated design offers greater design flexibility and scalability, allowing the number and layout of the infrared pixels 31 and infrared sensors 41 to be adjusted according to different application needs, adapting to various display technologies and user interaction requirements.

[0075] In some embodiments, such as Figure 7 As shown, the light source 30 is the display pixel 21, and the sensor 40 can respond to the visible light emitted by the display pixel 21. The sensor 40 is embedded in the display pixels 21 of the entire display area of ​​the screen 20, and the sensor 40 corresponds one-to-one with each display pixel 21 in the entire display area.

[0076] For example, the optical module 100 employs an innovative design in which the light source 30 is served by the display pixels 21 of the screen 20 itself, while the sensor 40 responds to the visible light emitted by these display pixels.

[0077] In this design, the display pixels 21 of screen 20 not only display images but also act as light sources. The red (R), green (G), and blue (B) light emitted by the display pixels 21 is used not only to form visible images but also as a light source to track the user's eye position. Sensor 40 is designed to respond to the visible light emitted by the display pixels 21, meaning that sensor 40 can capture light emitted directly from the display pixels 21 or light reflected back from the user's eyes. Sensor 40 is embedded in the display pixels 21 throughout the entire display area of ​​screen 20, corresponding one-to-one with each display pixel 21. This design allows each display pixel 21 to have a corresponding sensor 40, thus achieving a high-density sensor layout. Because the sensors 40 are distributed throughout the entire display area of ​​screen 20, the sensor density and imaging area are maximized, which helps to provide more accurate and comprehensive eye-tracking data.

[0078] Integrating the sensor 40 into each display pixel 21 reduces the aperture ratio of the display pixel 21, which may affect screen brightness and image quality. Therefore, measures such as optimizing the backlight system and improving display efficiency are needed to compensate for this effect.

[0079] Unlike designs that require additional infrared light pixels 31, this design directly uses the display pixels 21 of the screen 20 as the light source, reducing the need for infrared light pixels and simplifying the system design.

[0080] To mitigate the impact of reduced aperture ratio on display performance, various measures can be taken, such as increasing the brightness of the backlight system, optimizing the backlight distribution, using more efficient luminescent materials, or adjusting the design of the display pixels 21 to improve light efficiency.

[0081] This design is particularly suitable for High Dynamic Range (HDR) display technology because it allows for the integration of high-precision eye-tracking capabilities while maintaining high contrast and color accuracy. This integrated design offers greater design flexibility and scalability, allowing the number and layout of the sensors 40 to be adjusted to suit different display technologies and user interaction requirements.

[0082] In some embodiments, the light source 30 is an infrared light pixel 31 in a transparent or semi-transparent state, and the sensor 40 is an infrared light sensor 41 in a transparent or semi-transparent state. The infrared light pixel 31 and the infrared light sensor 41 are embedded in the entire display area of ​​the screen 20.

[0083] For example, the infrared light pixel 31 and the infrared light sensor 41 are designed to be transparent or semi-transparent, so that they do not significantly block or interfere with the display content of the screen 20 when they are working. This design allows light to pass through the components, enabling both the emission of infrared light and the reception of reflected light, while allowing visible light to pass through to maintain the normal display function of the screen 20.

[0084] Infrared pixels 31 and infrared sensors 41 are embedded throughout the entire display area of ​​screen 20, rather than being limited to the edges or periphery of the screen. This layout provides a wider coverage area, allowing eye tracking across the entire screen. Because infrared pixels 31 and infrared sensors 41 are distributed throughout the entire display area, they are able to track the user's eye position and gaze point more accurately, maintaining continuity and accuracy in tracking regardless of how the user's eyes move.

[0085] Transparent or semi-transparent designs reduce the impact on the aperture ratio of display pixels 21 because these infrared components do not completely block light. However, design optimization is still needed to ensure that screen brightness and image quality are not significantly affected. For example, integrating microlenses above infrared light pixels 31 and infrared light sensor 41 can focus infrared light, improving light utilization while allowing more visible light to pass through, thus reducing the impact on the aperture ratio of display pixels 21. For example, using time-multiplexing technology allows infrared light pixels 31 and display pixels 21 to operate at different times, sharing the same spatial position, reducing aperture occupancy. For example, optimizing the backlight system, such as using more efficient LEDs as a backlight source, or employing local dimming technology, can maintain screen brightness while reducing the impact on infrared light pixels 31 and infrared light sensor 41.

[0086] Designing transparent or semi-transparent infrared light pixels 31 and infrared light sensors 41 requires overcoming technical challenges, including ensuring sufficient light intensity for effective eye tracking while maintaining component transparency. For example, selecting or developing highly efficient infrared emitting and receiving materials that can provide sufficient light intensity for effective eye tracking while maintaining transparency. For example, efficiently transmitting infrared light to the desired location through carefully designed optical paths, such as using waveguides or fiber optic technology, while minimizing light loss. For example, by increasing the sensitivity of the infrared light sensor 41, effective tracking can be achieved at lower light intensities, thereby reducing the need for higher infrared light intensity.

[0087] Achieving transparent or semi-transparent infrared light pixels 31 and infrared light sensors 41 may require special materials and manufacturing processes to ensure their transparency and sensitivity within the desired wavelength range. For example, using nanotechnology to fabricate infrared light pixels 31 and infrared light sensors 41 allows for precise control of the optical properties of the materials, achieving transparency and sensitivity within a specific wavelength range. For instance, using thin-film deposition techniques to fabricate infrared light pixels 31 and infrared light sensors 41 on transparent substrates allows these films to be designed to be transparent to infrared light while absorbing or reflecting visible light, achieving the desired optical properties. For example, advanced photolithography techniques can be used to precisely define the shape and size of infrared light pixels 31 and infrared light sensors 41 to ensure they possess efficient photoelectric conversion characteristics while maintaining transparency.

[0088] By using transparent or semi-transparent infrared light pixels 31 and sensor 41, eye tracking can be provided without sacrificing display quality, enhancing the user's immersion and experience.

[0089] In some embodiments, the light source 30 is an infrared light pixel 31, the sensor 40 is an infrared light sensor 41, and the infrared light pixel 31 and the infrared light sensor 41 are embedded in the display pixels 21 of the screen 20 in an alternating arrangement. This method can achieve a uniform distribution of infrared light pixels 31 and sensor 40 while maintaining a high density of display pixels 21, thereby improving the accuracy and stability of eye position capture.

[0090] For example, the alternating arrangement is pixel-level alternation. Each pixel unit is designed as a composite pixel containing a display pixel 21, an infrared light pixel 31, and an infrared light sensor 41. For example, each pixel unit can be divided into four quadrants, with three quadrants occupied by the display pixel 21 and the remaining quadrant alternately configured with either the infrared light pixel 31 or the infrared light sensor 41.

[0091] For example, the alternating arrangement can be a row-column alternating pattern. In the rows or columns of screen 20, infrared light pixels 31 and infrared light sensors 41 can be arranged alternately. For example, the first row can be entirely configured with infrared light pixels 31, the second row entirely with infrared light sensors 41, and this pattern can be repeated. Alternatively, within each row, infrared light pixels 31 and infrared light sensors 41 can be arranged alternately.

[0092] For example, the alternating arrangement can be a checkerboard pattern. Using a checkerboard pattern, the infrared light pixels 31 and the infrared light sensor 41 are arranged alternately in a checkerboard pattern across the entire screen 20. This ensures that the infrared light pixels 31 and the infrared light sensor 41 are evenly distributed both horizontally and vertically.

[0093] In some embodiments, the optical module 100 employs Micro LED technology to integrate the light source 30 and sensor 40 into the screen 20, thereby achieving high brightness and uniform infrared light emission while maintaining the screen's thinness and aesthetics.

[0094] For example, micro LEDs or micro LED arrays, due to their high brightness, small size, and low power consumption, are directly embedded in the backlight layer or display layer of screen 20 as infrared light sources 30. This integration method allows screen 20 to provide uniformly distributed infrared light while maintaining a thin and light profile.

[0095] For example, an infrared light sensor 41 is integrated into the edge or a specific area of ​​the screen 20, and is manufactured using CMOS (Complementary Metal-Oxide-Semiconductor) or TFT (Thin Film Transistor) technology. This layout helps reduce interference with the screen display area while enabling effective capture of infrared light reflected from the eye.

[0096] Optical lens 10 is used to focus infrared light emitted from the micro-LED or Micro LED array, as well as collect infrared light reflected back from the eye. This enhances the strength and quality of the signal received by sensor 40, improving the accuracy of eye tracking.

[0097] Micro LEDs or micro LED arrays can provide higher brightness infrared light, and due to their small size and scalability, they can achieve uniform emission of infrared light on the screen 20, effectively improving the accuracy and reliability of eye tracking.

[0098] Embedding micro-LEDs or Micro LED arrays within the screen 20, rather than as external components, helps maintain the device's slim design and aesthetic appeal. Furthermore, integrating the sensor 40 into the screen edge or a specific area also contributes to reducing the overall size of the device. The high efficiency and low power consumption of micro-LEDs or Micro LED technology help reduce the overall system's energy consumption. Simultaneously, because the infrared light sensor 41 is integrated into the screen edge or a specific area, thermal management is more effective, preventing overheating from affecting performance. This design is particularly suitable for devices requiring high-performance displays and high-precision eye tracking, such as high-end VR / AR headsets, smartphones, and tablets, enabling innovative user interaction while providing a superior visual experience.

[0099] In some embodiments, quantum dot light-emitting diode (QLED) technology is used in the optical module 100 to integrate the light source 30 and the sensor 40.

[0100] For example, quantum dot materials are used as a light source 30 due to their unique optoelectronic properties. These materials can emit light of specific wavelengths, including visible and infrared light, when electrically excited, thus allowing them to be directly embedded in the screen 20 as a light source. Quantum dot materials can not only emit visible light but also, depending on their size and composition, emit infrared light. This property allows quantum dot materials to be used simultaneously to emit and receive infrared light reflected from the eye.

[0101] The high color purity and wide color gamut offered by QLED technology are among its main advantages. The light emitted by quantum dots is pure in color and highly saturated, which enables the screen 20 to display more vivid and lifelike colors.

[0102] Utilizing the infrared light emission and reception capabilities of quantum dot materials, sensor 40 can precisely capture the position of the user's eyes. The miniaturization of quantum dot materials allows for seamless integration of the light source 30 and sensor 40 into the screen 20, requiring no additional space or complex structures, contributing to the device's compactness and slimness. QLED technology is generally more energy efficient than traditional display technologies, and quantum dot materials contain no harmful substances, making this technology more environmentally friendly. This design is particularly suitable for mobile devices requiring precise eye tracking, offering the dual advantages of superior color performance and user interaction.

[0103] In some embodiments, the light source 30 and sensor 40 employ flexible display technology, integrating the infrared light pixel 31 and sensor 40 onto a flexible substrate, which is then bonded to the display layer of the screen 20. This method allows the screen 20 to be bent and folded, making it suitable for wearable devices or portable AR / VR / MR devices, thus improving the user experience and comfort.

[0104] For example, the infrared pixel 31 and sensor 40 are integrated onto a flexible substrate, typically made of flexible materials such as plastic or specific films, allowing the entire assembly to be bent and folded. The flexible substrate integrating the infrared pixel 31 and sensor 40 is bonded to the display layer of the screen 20; this bonding technology ensures optical alignment and electrical connection between the two. By using a flexible substrate, the screen 20 can be designed to be bent or foldable, providing greater flexibility in device design and enabling it to adapt to more usage scenarios and user needs.

[0105] Flexible screen technology is particularly well-suited for wearable devices, such as smart glasses or head-mounted displays, as it can conform to the contours of a user's face, providing a more comfortable wearing experience. For portable AR / VR / MR devices, flexible screen technology makes the device easier to carry and store when not in use, while providing a wider field of view and a more comfortable experience when in use. Flexible screens can better adapt to the shape of a user's head and face, reducing pressure and improving comfort during extended use. Flexible screen technology can also improve the device's impact resistance and environmental adaptability, making it more suitable for outdoor activities or use in changing environments.

[0106] In some embodiments, the light source 30 and the sensor 40 are made of transparent conductive material and are directly printed or deposited on the transparent substrate of the screen 20. This method can make the light source 30 and the sensor 40 transparent without affecting the display effect of the screen 20, while maintaining high capture accuracy and stability.

[0107] For example, transparent conductive materials such as indium tin oxide (ITO) or silver nanowires (AgNW) are used to fabricate the light source 30 and the sensor 40. These materials have high transparency and conductivity, making them suitable for optoelectronic components that require both transparency and conductivity.

[0108] The light source 30 and sensor 40 can be applied to the transparent substrate of the screen 20 through direct printing or deposition processes. This process allows the desired circuitry and optoelectronic structures to be formed while maintaining the transparency of the substrate.

[0109] Using transparent conductive materials ensures the transparency of the light source 30 and sensor 40, meaning they will not block or interfere with the display content of the screen 20 during operation, thus not affecting the normal display effect of the screen. Due to the transparency of the light source 30 and sensor 40, the screen 20 can maintain its original brightness, contrast, and color performance, even when the tracking function is integrated.

[0110] The light source 30 and sensor 40, made of transparent conductive materials, can provide photoelectric performance similar to that of non-transparent materials, maintaining high capture accuracy and stability, which is crucial for applications such as eye tracking. Transparent conductive materials can also reduce ambient light and electromagnetic interference, improving the durability and reliability of the device.

[0111] In addition to infrared light sensors, transparent conductive materials can also be used to manufacture ambient light sensors, further enhancing the sensing capabilities of devices.

[0112] All of the above technical solutions can be combined in any way to form optional embodiments of this application, and will not be described in detail here.

[0113] This application provides an optical module 100, which includes an optical lens 10, a screen 20, and a light source 30 and a sensor 40 built into the screen 20. The light source 30 emits light through the optical lens 10 to the user's eye region 200, and the sensor 40 receives the light reflected from the eye region 200 to locate the user's eye position. By embedding the light source 30 and sensor 40 for locating the eye position within the screen 20, this application significantly simplifies the overall structure of the optical module 100 compared to traditional external light source 30 and sensor 40 solutions, reducing additional hardware components and complex assembly processes. The built-in light source 30 and sensor 40 design reduces reliance on external components, lowers raw material and manufacturing costs, and avoids the additional weight of external components, making the optical module 100 and the head-mounted display device more portable. The built-in light source 30 and sensor 40 can contact the user's eye region 200 more closely, thereby improving the accuracy and stability of eye position capture. The optical module 100 of this application provides users with a more comfortable and convenient user experience by simplifying the structure, reducing costs and lightening the weight.

[0114] On the other hand, embodiments of this application provide a head-mounted display device, which includes the optical module as described in any of the above embodiments. The specific structure of the optical module can be referenced to the above exemplary embodiments, or a combination of the above exemplary embodiments can be used without conflict.

[0115] In some embodiments, the head-mounted display device can be a virtual reality device. The head-mounted display device also includes eyeglasses, which include a frame and temples, the temples being perpendicular to the extending direction of the frame. Optical modules can be deployed on the frame, enabling the head-mounted display device to image at a near-eye position.

[0116] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application.

Claims

1. An optical module, characterized in that, The optical module includes: Optical lenses; Screen; The screen includes a built-in light source and a sensor. The light source emits light through the optical lens to the user's eye area, and the sensor receives the light reflected from the eye area to locate the user's eye position.

2. The optical module as described in claim 1, characterized in that, The screen includes: Multiple display pixels are used to emit visible light in at least one wavelength; An optical modulation film, covering the plurality of display pixels, is used to adjust the propagation direction of the visible light.

3. The optical module as described in claim 2, characterized in that, The optical modulation film is configured in a layout that does not cover the light source and the sensor.

4. The optical module as described in claim 2, characterized in that, The optical modulation film is configured to cover the light source and the sensor.

5. The optical module as described in claim 3 or 4, characterized in that, The light source is an infrared light pixel, the sensor is an infrared light sensor, and the infrared light pixel and the infrared light sensor are disposed around or on the periphery of the screen.

6. The optical module as described in claim 5, characterized in that, The infrared light pixels and the infrared light sensor are embedded in the display pixels around or around the screen, and the infrared light pixels and the infrared light sensor correspond one-to-one with each display pixel around or around the screen.

7. The optical module as described in claim 3 or 4, characterized in that, The light source is an infrared light pixel, and the sensor is an infrared light sensor. The infrared light pixel and the infrared light sensor are embedded in the display pixels of the entire display area of ​​the screen, and the infrared light pixel and the infrared light sensor correspond one-to-one with each display pixel in the entire display area.

8. The optical module as described in claim 3 or 4, characterized in that, The light source is the display pixel, the sensor can respond to the visible light emitted by the display pixel, the sensor is embedded in the display pixels of the entire display area of ​​the screen, and the sensor corresponds one-to-one with each display pixel in the entire display area.

9. The optical module as described in claim 1, characterized in that, The light source is a transparent or semi-transparent infrared light pixel, and the sensor is a transparent or semi-transparent infrared light sensor. The infrared light pixel and the infrared light sensor are embedded in the entire display area of ​​the screen.

10. A head-mounted display device, characterized in that, The head-mounted display device includes the optical module as described in any one of claims 1-9.

Images