Direct view transparent near-eye display optical structure
By combining a focusing module, a display module, a compensation module, and a light switch module in a near-eye display device, the problems of energy loss and high brightness requirements in traditional near-eye display technology have been solved, resulting in a thin, light-efficiency near-eye display device that improves the user experience of augmented reality, virtual reality, and mixed reality devices.
Patent Information
- Application Number
- CN202410864553.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-01
- Publication Date
- 2025-11-21
- Estimated Expiration
- 2044-07-01
AI Technical Summary
Traditional near-eye display technology suffers from problems such as large energy loss, high brightness requirements, and high structural energy consumption in its optical architecture, which affect wearing comfort and device battery life.
It adopts a direct-view transparent near-eye display optical structure that includes a focusing module, a display module, a compensation module, an optical switch module, and a vision correction optical lens, arranged sequentially from the eyeball outwards. The focusing lens concentrates light information to the center of the pupil or presents a virtual image in front of the eyes. The compensation module cancels out the deflection of ambient light. Combined with the liquid crystal lens and the optical switch module, it realizes AR/MR/VR switching.
It achieves a thin, light-efficiency near-eye display device, optimizes device size and weight, improves user experience, and is suitable for smart helmets and smart glasses for augmented reality, virtual reality, and mixed reality.
Smart Images

Figure CN118466032B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application belongs to the field of display devices and augmented reality technology, and particularly relates to a direct-view type transparent near-eye display optical structure. BACKGROUND
[0002] Near-eye display technology currently includes augmented reality (AR) and virtual reality (VR). Augmented reality is an interactive technology that combines virtual information with the real world, and provides users with an enhanced perception experience by superimposing computer-generated virtual elements on the real environment. Virtual reality, on the other hand, completely immerses users in a virtual environment. Augmented reality allows users to interact with the real environment by superimposing virtual elements on it. The fundamental goal of augmented reality technology is to provide users with rich information and enhanced perceptual abilities to improve their interaction and understanding of the surrounding environment. Through the use of AR technology, users can view and interact with virtual elements in real time through display devices such as smartphones, head-mounted displays, or glasses. These elements can include images, videos, 3D models, sounds, or other computer-generated information.
[0003] The optical architecture of the augmented reality display scheme in traditional near-eye display mainly includes half-mirror, Birdbath structure, free-form surface structure, retina scanning, and optical waveguide scheme. From the perspective of the propagation of image source light, these schemes can be divided into transmission, reflection, and diffraction. In these schemes, there is a considerable loss of energy and brightness during the propagation of image source light, which requires a relatively high brightness of the image source. At the same time, it increases the energy consumption of the overall structure, which may cause heating and affect the comfort of wearing and the endurance of the augmented reality device. SUMMARY
[0004] In view of this, in order to fill the gap in the prior art, the present application provides a direct-view type transparent near-eye display optical structure. The system includes, in order from the eyeball outwardly: a focusing module, a display module, a compensation module, a light switch module, and a vision correction optical lens. The present application uses a focusing lens to converge the light information emitted by the transparent display screen to the center of the pupil and then image it on the retina, or to present a virtual image of the display screen light at a certain distance in front of the eye for observation by the human eye. The combination of the compensation lens module and the focusing module can offset the deflection of the system to the ambient light, so that the environmental object observed by the human eye through the system is consistent with the object in the real environment. The present system has the advantages of being light and thin and having high light efficiency. It can be applied to near-eye display devices such as augmented reality, virtual reality, mixed reality smart helmets, smart glasses, etc. It can optimize the size and weight of the near-eye display device and improve the user experience.
[0005] The technical scheme specifically adopted by the present application to solve its technical problems is:
[0006] A direct-view transparent near-eye display optical structure,
[0007] From the direction of the human eye, it successively includes a focusing module, a display module, a compensation module, a light switch module, and an optical lens;
[0008] The focusing module adopts a focusing lens or a focusing lens group composed of multiple lenses, which is used to focus the light rays of the display screen on the pupil center and image on the retina, or focus the light rays of the display screen to a virtual image at a certain distance in front of the eye.
[0009] As a preferred, the lens structure of the focusing module includes but is not limited to liquid crystal lens, super surface or super lens structure, Fresnel lens, holographic optical element or other thin lens structure. When the module is a lens group with a near focusing function, the lens structure includes but is not limited to a free combination of liquid crystal lens, super surface or super lens structure, Fresnel lens, and holographic optical element. The focusing module can converge the collimated light emitted by each light-emitting pixel of the display screen in the display module to the center of the human eye pupil, thereby forming a retina projection display. At this time, the lens structure of the focusing module has a fixed focal length, and the focal length should be equivalent to the average distance from the human eye pupil to the glasses. At the same time, the focusing module can also use aspherical lenses, Fresnel lenses, free-form surfaces, and other lenses used in VR devices to magnify the image of the transparent display screen and form a virtual image at a distance for the human eye to observe. The principle should be equivalent to the optical lens group of the VR device. When the focusing module uses a liquid crystal lens (or other adjustable focal length lens), a corresponding control and driving circuit is needed to adjust the liquid crystal lens. The average distance from the human eye pupil to the glasses should be within the adjustable range of the focal length of the liquid crystal lens.
[0010] The display module includes a transparent display screen with a collimating structure. The transparent display screen has transparency and is used to display color or monochrome images and form parallel light beams through the collimating structure for the focusing module to focus.
[0011] It also generally has a control chip and a driving power supply. The transparent display screen of the display module includes but is not limited to organic light-emitting diode (OLED), micro light-emitting diode (Micro-LED), nano light-emitting diode (Nano-LED), nano light-emitting display (NLED), transparent quantum dot film, and display screen based on liquid crystal device, etc. micro monochrome or color display screen.
[0012] The compensation module is composed of one or more lenses, which is used to eliminate the deflection effect of the focusing module on the ambient light, so that the ambient light remains along the original light path after passing through the overall optical structure. The lens of the compensation module includes but is not limited to Fresnel lens, liquid crystal lens, super surface or super lens structure, holographic optical element, etc.
[0013] The light switch module controls the blocking or passing of ambient light by electric field, thereby constructing an AR / MR system, or blocks ambient light from entering the human eye, thereby constructing a VR system. When constructing a VR system, a light-blocking soft pad needs to be set between the frame and the face to block light from entering the human eye from the area between the frame and the face, thereby improving the VR experience.
[0014] The light switch module can be composed of liquid crystal light valves, electrochromic films, and electrodes, or other physical light-blocking devices such as light-blocking pieces that can be vertically or horizontally moved and light-blocking pieces that can be folded and stored, which are controlled by electric signals.
[0015] The system constructs an AR / MR system by entering the human eye to superimpose or mix the real environment and the virtual environment, or constructs a VR system by blocking ambient light from entering the human eye; when constructing a VR system, a light-blocking soft pad needs to be set between the frame and the face to block light from entering the human eye from the area between the frame and the face, thereby improving the VR experience.
[0016] The lens structure of the focusing module includes but is not limited to liquid crystal lenses, metasurfaces or superlens structures, Fresnel lenses, holographic optical elements, or other thin lens structures; when the module is a lens group with a near-focusing function, the lens structure includes but is not limited to a free combination of liquid crystal lenses, metasurfaces or superlens structures, Fresnel lenses, and holographic optical elements.
[0017] Further, the focusing module is used to converge the collimated light emitted by each light-emitting pixel of the display screen in the display module to the center of the human eye pupil, thereby forming retinal projection display; the lens structure has a fixed focal length, and the focal length should be equivalent to the average distance from the human eye pupil to the glasses.
[0018] Further, the lens of the focusing module adopts a liquid crystal lens, which is used to magnify the image of the transparent display screen to form a virtual image at a distance for the human eye to observe, and the average distance from the human eye pupil to the glasses is within the adjustable range of the focal length of the liquid crystal lens.
[0019] The transparent display screen of the display module includes but is not limited to organic light-emitting diodes (OLED), micro light-emitting diodes (Micro-LED), nano light-emitting diodes (Nano-LED), nano light-emitting display (NLED), transparent quantum dot film, and display screens based on liquid crystal devices.
[0020] The transparent display screen in the display module can be a single-layer monochrome or full-color structure, or a multi-layer full-color structure composed of multiple transparent display screens; when the transparent display screen is a single-layer full-color structure, the transparent display screen can realize full-color by dispersing or closely arranging red, green and blue three-primary-color pixels, or by using white light pixels and corresponding size three-color filters to realize full-color display, or by using blue light pixels and corresponding size red, green and blue color conversion layers such as red, green and blue quantum dots, red, green and blue fluorescent powder, and red, green and blue perovskite to realize full-color display, or by using micro-nano materials and structures to generate red, green and blue monochrome light to realize color display; when the transparent display screen is a multi-layer structure composed of multiple transparent display screens, RGB full-color can be realized by stacking three transparent display screens respectively displaying red, green and blue colors, and further, full-color display can be realized by a double-color transparent display screen displaying two colors of red, green and blue colors and another single-color transparent display screen.
[0021] Further, the transparent display screen has a brightness adjustment function, and in the use scenario of outdoor environment with a brightness of 3000 nits on a sunny day, the transparent display screen can achieve a brightness of at least 10000 nits, and the adjustable brightness range is at least 0-10000 nits; in different distances between different application scenarios and eyes, the angular resolution of the transparent display should at least reach 60 PPD to meet the minimum scale that can be distinguished by the human eye.
[0022] When the transparent display screen structure is only composed of a single-layer structure and can only display a monochrome image, the display module is composed of a transparent display screen with dispersed arrangement of monochrome light emitting pixels with collimating structure, a control chip and a driving power supply; when the structure is only composed of a single-layer structure and can display a full-color image, the display module can be composed of a transparent display screen with dispersed arrangement of full-color light emitting pixels (such as vertically stacked color pixel structure) with collimating structure, a control chip and a driving power supply, or can be composed of a transparent display screen with three monochrome light emitting pixels tiled in the same layer with dispersed arrangement of pixels, a control chip and a driving power supply.
[0023] Further, the collimating structure attached to the light emitting pixels in the transparent display screen of the display module is a micro-collimating structure matched with the size of the light emitting pixels.
[0024] The micro-collimating structure includes but is not limited to geometric optical elements such as microlenses, TIR lenses, and light cup, or diffractive optical elements such as metasurface or superlens, photonic crystal, and collimating grating, and at least one or more of the above elements is selected to form an array structure.
[0025] The transparent display screen of the display module is used to generate a display image; the arrangement mode of the light-emitting pixels in the transparent display screen of the display module can be a neat rectangular planar array distribution, a planar array distribution with interpenetration, a circular planar array distribution, a rhombic planar array distribution, or other planar array distribution modes.
[0026] Further, when the optical structure imaging principle is retinal projection, the light-emitting pixels in the transparent display screen can be distributed in a center-dense and peripheral-dispersed distribution mode with a large pixel spacing in the center and a small pixel spacing around the center according to the distribution of two different types of retinal cells of the human eye; the total area occupied by all the light-emitting pixels in a unit area of the transparent display screen of the display module is not more than 50% of the total area.
[0027] That is, the pixel filling factor of the transparent display screen is not more than 50%; when the light-emitting pixels in the transparent display screen of the display module are composed of three single-color light pixels, the three single-color light pixels can be arranged in a close or dispersed single layer or a horizontal arrangement, a vertical arrangement, and a "pin" arrangement across multiple layers.
[0028] The collimation structure attached to the transparent display screen in the display module can be a single layer or a multi-layer structure, which can be attached to the surface of the transparent display screen or embedded in the transparent display screen, or can be placed alone as a single layer or a multi-layer structure in the gap between the transparent display screen and the focusing module, and can also be a single layer or a multi-layer structure attached to the surface of the focusing module close to the transparent display screen and the surface close to the human eye, or can be placed alone as a single layer or a multi-layer structure in the space between the focusing module and the human eye to realize the function of collimation.
[0029] The compensation module is composed of one or more lenses, wherein the structure of the lens includes but is not limited to Fresnel optical surface, metasurface or superlens, folded light path, Pancake, double cementation, active optical zoom structure, etc.; when all or part of the lenses in the compensation module use liquid crystal lenses, a corresponding control and driving circuit needs to be used to adjust the liquid crystal lenses; the compensation module not only can eliminate the deflection effect of the focusing module on ambient light, but also can correct the refractive power for different human eyes with myopia, hypermetropia, astigmatism, etc.
[0030] Further, the focusing module uses a liquid crystal lens, combined with the human eye recognition module and the eye movement tracking module to adjust the focal length and optical axis of the liquid crystal lens, so that the display image generated by the display module can be observed when the human eye rotates to different positions, thereby realizing the effect of pupil expansion.
[0031] The eye movement tracking module includes, but is not limited to, infrared eye movement tracking, optical eye movement tracking, transparent image sensor, etc. As an alternative, the direct-viewing type transparent near-eye display optical structure can be clamped by a specific mechanical structure, placed in a helmet with a transparent window in a circular or semicircular shape, and adjusted in real time according to eye movement tracking and mechanical structure to achieve the effect of pupil dilation. Similarly, magnetic materials can also be used in combination with the optical structure to achieve the effect of pupil dilation by generating a specific magnetic field on the helmet and adjusting the position of the optical structure through eye movement tracking.
[0032] When the lenses of the focusing module and the compensation module are all or partially made of liquid crystal lenses, the liquid crystal lenses can be single-piece liquid crystal lenses, or liquid crystal lenses composed of double or multiple layers of liquid crystal, or liquid crystal lens arrays composed of multiple small liquid crystal lenses arranged closely, etc. The driving electrode material of the liquid crystal lenses used can be indium tin oxide (ITO) or other transparent electrode materials with good conductivity. The structure of the driving electrode includes, but is not limited to, the commonly used single-hole electrode type, strip electrode type, and ring-disk electrode type, which are improved electrode structures for realizing the functions of the lenses in the focusing module and the compensation module. Liquid crystal lenses are used as inspiration to expand to other optical components with variable focal length, which are within the scope of this patent.
[0033] The optical structure includes a focusing module, a display module, a compensation module, a light switch module, and a vision correction optical lens. The optical structure can be encapsulated in a complete optical block material, which can serve as an external protective layer for the optical structure. The block material includes, but is not limited to, glass, plastic, resin, crystal material, etc. However, the refractive index should be considered when designing the focusing module, the compensation module, and the vision correction optical lens.
[0034] The optical structure does not have a fixed size and can be directly made into a large-area whole structure covering the visual area of the eye. At the same time, multiple small optical structures can be combined to form a large-area structure.
[0035] Further, when applied to a head-mounted near-eye display device, the displayed image is displayed by two or more groups of the optical structure in a dispersed or closely connected manner. The optical structure is used to synthesize a complete image on the retina or form an image with higher brightness by using the principle of retinal projection. The effective display area of the transparent display screen in the display module is less than or equal to the minimum area of the effective apertures of the focusing module, the compensation module, and the light switch module.
[0036] and typically, the geometric centers of the above modules should be on a straight line, and the boundary of the transparent display screen should be limited within the boundary of the focusing module and the compensation module; when the optical structure constitutes a VR system, the light switch module needs to cover the entire lens or head-mounted helmet surface to selectively pass or block ambient light into the eye to improve the VR system experience; when the transparent part of the optical structure does not occupy the entire lens, the non-display area can be doped with specific impurities or treated by frosting process to change the transparency of the non-display area, so as to achieve the uniform transparency of the entire lens area. It can also combine a micro camera to shoot the real environment, superimpose the real environment and virtual patterns in the area of the optical structure, and balance the brightness difference between the display area and the non-display area.
[0037] When the optical structure is applied to a head-mounted near-eye display device, the optical structure can be a group, which displays images to the left eye or the right eye separately; meanwhile, the optical structure can also be two groups, which displays images to the left eye and the right eye simultaneously.
[0038] Further, the design process is as follows: first, the lens aperture, focal length and material in the focusing module are optimized to have focusing effect to form retinal projection or virtual image, then the lens parameters of the focusing module are fixed, an equivalent transparent flat plate is used to replace the transparent display screen, the size of the lens group in the compensation module is set according to the size of the focusing lens, and finally the focal length of the entire optical system including the focusing module, the transparent display screen and the compensation module is optimized to infinity by increasing or decreasing the number of lenses in the compensation module, so that the deflection effect of the overall optical structure on ambient light is minimized.
[0039] When the optical structure transparent flat plate is thin enough, the total focal length of the lens group is when the design is performed using three lens groups while ignoring the influence of the transparent flat plate. wherein , are the focal lengths of the three lenses, are the combined focal lengths of the first two lenses, are the distances between the first lens and the second lens and between the second lens and the third lens, respectively, in order to make the total focal length tend to infinity, the denominator term in the formula needs to tend to 0 to achieve the compensation effect.
[0040] The light switch module controls ambient light by electric field to make ambient light enter human eyes through the system to build an AR / MR system, or to prevent ambient light from entering human eyes to build a VR system; when building a VR system, a light-blocking soft pad needs to be set between the frame and the face to prevent light from entering human eyes from the area between the frame and the face, thereby improving the VR experience; the light switch module can be composed of liquid crystal light valves, electrochromic films and electrodes, or other physical light-blocking devices that can be controlled by electric signals, such as light-blocking sheets that can be vertically or horizontally moved and light-blocking sheets that can be folded and stored.
[0041] When the lens part of the optical structure is not all liquid crystal lenses, the optical lens adopts vision correction optical lenses, which can be traditional myopia, hyperopia, focusing, and blue light correction optical lenses, or new thin devices including but not limited to liquid crystal lenses, super surfaces or super lens structures, Fresnel lenses, and holographic optical elements, which are designed for myopia, hyperopia, focusing, and blue light correction to achieve the effect of correction.
[0042] Further, when designing the optical structure, the focal length of the optical system including the focusing module, the transparent display screen, and the compensation module is optimized to infinity, and after adding the vision correction optical lens, the imaging effect of the environmental image and the display image of the overall optical system is investigated, and the entire optical system is optimized accordingly; when the overall optical structure images the display image, the modulation transfer function at the cutoff frequency of 30 lp / mm is greater than 0.4, the distortion of the imaging system where the display image is located is not greater than 5%, and the optical efficiency is greater than 70%; when the overall optical structure images the environmental image, the modulation transfer function at the cutoff frequency of 30 lp / mm is greater than 0.3, the distortion of the entire optical structure to the environmental image is not greater than 5%, and the optical efficiency is greater than 50%.
[0043] The optical structure can be combined with infrared cameras, zoom cameras, and other special lenses to switch between displaying infrared images, long-range images, and close-range images, and can be applied to military tactical helmets and the like; the head-mounted near-eye display device made of the optical structure, such as smart glasses and smart helmets, can be combined with sensors and cameras to capture iris information, implement identity verification and health monitoring, and the like.
[0044] The main feature of the optical structure is a direct-view light and thin and high light efficiency near-eye display optical structure combining transparent display and new thin device. The optical structure contains the following features: the focusing module realizes the adjustable focal length function by combining thin devices such as liquid crystal lenses; the compensation module compensates for the compensation of the light path to the ambient light to eliminate the influence of other optical structures; the light switch module is introduced to realize the switching of MR / AR and VR display systems; the vision correction optical lens is introduced to improve the experience of users with different refractive powers; and finally, the display, eye recognition, health detection and other functions are expanded in combination with other existing technologies.
[0045] Compared with the prior art, the present application and the preferred scheme thereof converge the light information emitted by the transparent display screen to the pupil center and then image on the retina through the focusing lens, or the focused display screen light rays present a virtual image at a certain distance in front of the eye for the human eye to observe; the combination of the compensation lens module and the focusing module can offset the deflection of the system to the ambient light, so that the environmental object observed by the human eye through the system is consistent with the object in the real environment. The system has the advantages of lightness, thinness and high light efficiency, and can be applied to near-eye display devices such as augmented reality, virtual reality, mixed reality smart helmets, smart glasses, etc., can well optimize the size and weight of the near-eye display device, and improve the use experience. BRIEF DESCRIPTION OF DRAWINGS
[0046] The present application will be further described in detail below in combination with the drawings and specific embodiments:
[0047] Figure 1 The structure of the first embodiment of the present application is shown in the upper part of the figure, the light switch module prevents the ambient light from passing through the structure shown in the middle part of the figure, and the light switch module allows the ambient light to pass through the structure shown in the lower part of the figure when the transparent display screen is not working
[0048] Figure 2 The Zemax simulation effect diagram of the structure of the first embodiment of the present application is shown in the figure, the direction of light propagation is from left to right, in addition to the light, the structures contained from left to right are, in turn, the positive lens of the compensation module, the negative lens of the compensation module, the transparent display screen, the focusing module, the image plane, and the light switch module is in the state of allowing ambient light to pass through, which is ignored in the simulation, and the transparent flat plate is used to replace the transparent display screen in the simulation, wherein:
[0049] (1) is the simulation effect diagram of parallel ambient light passing through the entire structure and the simulation effect diagram of image light rays being parallel emitted from the transparent display screen and then focused to the image plane,
[0050] (2) is the simulation effect diagram of parallel ambient light passing through the entire optical structure,
[0051] (3) is the simulation effect diagram of image light rays being parallel emitted from the transparent display screen and then focused to the image plane,
[0052] (4) Simulation effect diagram for the inclined parallel light passing through the whole optical structure,
[0053] (5) Simulation effect diagram for the 5 light rays with different angles passing through the whole optical structure
[0054] Figure 3 Structure schematic diagram of the second embodiment of the present application
[0055] Figure 4 Structure schematic diagram (left) and structure sectional view (right) of the third embodiment of the present application
[0056] Figure 5 Flowchart of the present application
[0057] The reference signs in the drawings are explained as follows:
[0058] Figure 1 : 101: human eye, 102: image light, 103: ambient light, 104: focusing module, 105: transparent display screen, 106: collimated light-emitting pixel attached to the transparent display screen, 107: compensation module, 108: light switch module, 109: vision correction optical lens
[0059] Figure 3 : 201: human eye, 202: image light, 203: ambient light, 2041: first optical structure, 2042: second optical structure, 2043: third optical structure, 2044: fourth optical structure
[0060] Figure 4 : 301: helmet, 302: transparent window, 303: optical structure, 3031: first optical structure, 3032: second optical structure, 304: transparent window fixing structure. DETAILED DESCRIPTION
[0061] In order to make the features and advantages of the present patent more obvious and easy to understand, the following specific embodiments are described in detail as follows:
[0062] It should be noted that the following detailed description is exemplary and is intended to provide further explanation of the present application. Unless otherwise specified, all technical and scientific terms used in the present description have the same meaning as generally understood by those skilled in the art to which the present application belongs.
[0063] It should be noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the exemplary embodiments according to this application. As used herein, the singular form is intended to include the plural form as well, unless the context clearly indicates otherwise. Furthermore, it should be understood that when the terms "comprising" and / or "including" are used in this specification, they indicate the presence of features, steps, operations, devices, components, and / or combinations thereof.
[0064] Example 1
[0065] like Figure 1 As shown, the present invention provides a direct-view transparent near-eye display optical structure. The system, from the eyeball outwards, includes: a focusing module, a display module, a compensation module, a light switch module, and vision-correcting optical lenses. The focusing module 104 is a single lens layer with near-field focusing function, or it can be a lens group composed of multiple lenses with near-field focusing function, used to focus the light from the display screen at the center of the pupil. The display module consists of a transparent display screen 105 with a collimation structure, its control chip, and a driving power supply. The transparent display screen 105 has a certain degree of transparency and can display specific color or monochrome patterns, and forms a parallel beam of light through the collimation structure for the focusing module to focus. The compensation module 107... Composed of one or more lenses, the compensation module 107 can eliminate the effect of the focusing module on the deflection of ambient light, so that the ambient light continues to propagate along the original optical path after passing through the proposed direct-view transparent near-eye display optical structure; the optical switch module 108 has the function of allowing or blocking light to pass through by using an electrical signal, and is used to switch the optical structure to work in AR, MR and VR modes; the vision correction optical lens 109 is used to adapt to people with different vision correction needs such as myopia, hyperopia, focusing, glaucoma correction, etc. The vision correction optical lens 109 can be composed of traditional optical lenses, or it can be composed of new thin devices including but not limited to liquid crystal lenses, metasurface or metalens structures, Fresnel lenses and holographic optical elements.
[0066] The focusing module 104 in this embodiment is used to focus the light from the display screen to the center of the pupil. The lens structure of the module includes, but is not limited to, liquid crystal lenses, metasurface or superlens structures, Fresnel lenses, holographic optical elements, or other thin lens structures. When the focusing module 104 is a lens group with near-focusing function, the lens structure includes, but is not limited to, a free combination of liquid crystal lenses, metasurface or superlens structures, Fresnel lenses, and holographic optical elements. When the focusing module 104 uses a liquid crystal lens, corresponding control and driving circuits are required to adjust the liquid crystal lens simultaneously, and the average distance from the human pupil to the glasses is within the adjustable focal length range of the liquid crystal lens. When the focusing module 104 is composed of Fresnel lenses, metasurface or superlens structures, holographic optical elements, or other fixed focal length thin lens structures, the lens structure should have a fixed focal length, which is the average distance from the human pupil to the glasses.
[0067] The display module of the embodiment is used for displaying a specific color or monochrome pattern and forming a parallel light beam for focusing by the focusing module through a collimation structure, and is composed of a transparent display screen 105 with a collimation structure and a control chip and a driving power supply thereof; wherein the transparent display screen 105 can be made of micro monochrome or color display screens including but not limited to organic light emitting diode (OLED), micro light emitting diode (Micro-LED), nano light emitting diode (Nano-LED), nano light emitting display (NLED), transparent quantum dot film, display screen based on liquid crystal device, etc.; the transparent display screen 105 in the display module can be a single-layer monochrome or full-color structure, or a multi-layer full-color structure composed of multiple transparent display screens; when the embodiment is used for displaying a monochrome image, the display module is composed of a transparent display screen 105 with a collimation structure and a control chip and a driving power supply thereof, which is composed of a single-color light emitting pixel dispersed arrangement; meanwhile, the embodiment can also be used for displaying a full-color image, at this time, the display module can be composed of a transparent display screen 105 with a collimation structure and a control chip and a driving power supply thereof, which is composed of a full-color light emitting pixel dispersed arrangement, or can be composed of a transparent display screen 105 with a collimation structure and a control chip and a driving power supply thereof, which is composed of a light emitting pixel dispersed arrangement of three single-color light pixels mixed.
[0068] The compensation module 107 of the embodiment can eliminate the deflection influence of the focusing module on ambient light, so that the ambient light keeps propagating along the original light path after passing through the proposed direct-view type transparent near-eye display optical structure, and can be composed of one or more lenses; wherein the structure of the lens of the compensation module 107 includes but is not limited to Fresnel optical surface, metasurface or superlens, folded light path, Pancake, double cementation, movable optical zoom structure, etc.; when the lens in the compensation module 107 uses liquid crystal lens in whole or in part, a corresponding control and driving circuit needs to be used to adjust the liquid crystal lens. The compensation module 107 can not only eliminate the deflection influence of the focusing module on ambient light, but also correct the refractive power for different people's myopia, hypermetropia, astigmatism, etc.
[0069] The area of the transparent display screen 105 in the display module in the optical structure of the embodiment is less than or equal to the minimum area among the focusing module 104, the compensation module 107 and the optical switch module 108, and the geometric center of the optical structure is on a straight line. When the focusing module 104 and the compensation module 107 overlap with the transparent display screen in the display module in any shape, the boundaries of the two modules can contain or coincide with the area of the transparent display screen 105 in the display module. When the optical structure constitutes a VR system, the optical switch module 108 needs to cover the entire lens or head-mounted helmet surface to selectively pass or block ambient light into the eye, thereby improving the experience of the VR system. When the transparent part of the optical structure does not occupy the entire lens, the non-display area can be doped with a specific impurity or processed by frosting and other processes to change the transparency of the non-display area, so as to unify the transparency of the entire lens area. The optical structure can also be combined with a micro camera to capture the real environment and superimpose the real environment and virtual patterns in the area of the optical structure, thereby balancing the brightness difference between the display area and the non-display area.
[0070] When the optical structure of the embodiment is applied to a head-mounted near-eye display device, the optical structure can be a group, and image display is performed on the left eye or the right eye separately. Meanwhile, the optical structure can also be two groups, and image display is performed on the left eye and the right eye simultaneously.
[0071] As shown in Figure 2 , it is a Zemax simulation effect diagram of the optical structure of the embodiment, wherein the direction of light propagation in the diagram is from left to right. In addition to the light, the structures contained from left to right in the diagram are, in sequence, a positive lens of the compensation module, a negative lens of the compensation module, a transparent display screen, a focusing module and an image plane. The optical switch module 108 is in a state of allowing ambient light to pass through and is ignored in the simulation. The lenses involved in the diagram are ideal lenses with a thickness of 0. The transparent display screen uses a flat plate of material BK7 instead, and a surface light source is added to the surface of the flat plate to emit simulated parallel image light. It can be seen that the optical structure can focus parallel image light without affecting ambient light of other angles.
[0072] The working process of the optical structure is as shown in Figure 5 , and the specific working state is as follows:
[0073] After the optical device is started, the light-emitting pixels 106 on the transparent display screen 105 of the display module generate collimated display image light (solid arrow) 102, which then enters the focusing module 104, converges to the pupil center of the human eye 101 through the focusing module 104 to form a display, and at the same time, the ambient light (dashed arrow) 103 directly passes through the vision correction optical lens 109 and the optical switch module 108, is deflected by the compensation module 107, then passes through the transparent display screen 105, and is deflected back to the original light path by the focusing module 104 and enters the human eye 101.
[0074] Example 2
[0075] like Figure 3 As shown, the present invention provides a direct-view transparent near-eye display optical structure. The system comprises, from the eyeball outwards, a focusing module, a display module, a compensation module, an optical switch module, and a vision-correcting optical lens. The optical structure includes the focusing module, display module, compensation module, optical switch module, and vision-correcting optical lens. This optical structure can be encapsulated in a complete optical bulk material, which can serve as an outer protective layer for the optical structure. The bulk material includes, but is not limited to, glass, plastic, resin, and crystal materials. However, the influence of refractive index should be considered when designing the focusing module, compensation module, and vision-correcting optical lens.
[0076] The optical structural features referred to in this embodiment are similar to those in Embodiment 1, and will not be repeated here.
[0077] The optical structure in this embodiment has no fixed area size and can be directly made into a large-area integral structure to cover the visible area of the eye. At the same time, multiple miniaturized optical structures can be pieced together to form a large-area structure. When the optical structure is applied to a head-mounted near-eye display device, the displayed image can be displayed by two or more sets of optical structures in a dispersed or closely connected manner, and the corresponding complete image can be synthesized on the retina through the principle of retinal projection. At the same time, the displayed image can also be displayed simultaneously by two or more sets of optical structures in a dispersed or closely connected manner, and the images can be strictly overlapped on the retina through the principle of retinal projection to form a brighter image.
[0078] In this example, the encapsulated structure of the direct-view transparent near-eye display optical structure uses... Figure 3 The flat panel on the right side of the middle section is replaced by: a first optical structure 2041, a second optical structure 2042, a third optical structure 2043 and a fourth optical structure 2044. When displaying an image using four optical structures pieced together, the image can be divided into four parts by region, and each part can be displayed using one of the four optical structures. The image light rays (solid arrows) 202 formed by the four optical structures are projected onto the retina through the pupil of the human eye 201 to synthesize a complete image.
[0079] The working process of the optical structure is as follows: Figure 5 As shown, the working state of this embodiment is as follows:
[0080] When the optical device is activated, the first optical structure 2041, the second optical structure 2042, the third optical structure 2043 and the fourth optical structure 2044 respectively converge the image light rays (solid arrows) 202 of the four different parts of the image to the center of the pupil of the human eye 201, while the ambient light rays (dashed arrows) 203 continue to propagate to the eye through the optical structure along the original light path.
[0081] Example 3
[0082] like Figure 4 As shown, the present invention provides a direct-view transparent near-eye display optical structure. The system comprises, from the eyeball outwards, a focusing module, a display module, a compensation module, an optical switch module, and a vision-correcting optical lens. The optical structure includes the focusing module, display module, compensation module, optical switch module, and vision-correcting optical lens. This optical structure can be encapsulated in a complete optical bulk material, which can serve as an outer protective layer for the optical structure. The bulk material includes, but is not limited to, glass, plastic, resin, and crystal materials. However, the influence of refractive index should be considered when designing the focusing module, compensation module, and vision-correcting optical lens.
[0083] The optical structural features referred to in this embodiment are similar to those in Embodiment 1, and will not be repeated here.
[0084] The optical structure 303 of this embodiment can be clamped by a specific mechanical structure and placed in a helmet 301 with a transparent window 302 that is circular or semi-circular. The optical structure can be adjusted in real time according to eye tracking and the mechanical structure to achieve the pupil dilation effect. Similarly, magnetic materials can be used to combine with the optical structure 303. Special magnetic materials can be added inside or around the optical structure 303. The optical structure 303 can be placed in the transparent window 302 of the helmet 301 and filled with a liquid of a specific density. This allows the optical structure 303 to maintain its position relative to the transparent window 302 when the helmet 301 is shaking or stationary. The relative position of the optical structure 303 on the transparent window 302 can only be controlled by a magnetic field generator located at the edge of the transparent window 302. The pupil dilation effect is achieved by generating a specific magnetic field on the helmet 301 and adjusting the position of the optical structure by eye tracking. The eye tracking module includes, but is not limited to, infrared eye tracking, optical eye tracking, transparent image sensors, etc.
[0085] The working process of the optical structure is as follows: Figure 5 As shown, the working state of this embodiment is as follows:
[0086] The optical device is activated when a person wears the helmet 301 mentioned in the embodiment, the first optical structure 3031 and the second optical structure 3032 in the transparent window 302 correspond to the right eye and the left eye respectively, and emit convergent image light to the retina or focus the image of the display screen through the lens to a certain distance in front of the eye for the person to observe; at the same time, the ambient light continues to propagate to the front of the eye along the original light path through the optical structure. When the eye movement tracking module combined with the helmet 301 captures the change of the eye direction, an electric signal is transmitted to the driving processor, and the processor controls the electromagnetic field generating device to emit a specific magnetic field to change the position of the first optical structure 3031 and the second optical structure 3032 relative to the transparent window 302, so that the geometric centers of the two optical structures 303 are respectively aligned with the pupil centers of the eyes.
[0087] The above is only the preferred embodiment of the present application, and is not intended to limit the other forms of the present application. Any person skilled in the art can use the disclosed technical content to make changes or modifications to equivalent embodiments. However, any simple modification, equivalent change and modification of the above embodiments without departing from the technical solution of the present application, according to the technical essence of the present application, still belongs to the protection scope of the technical solution of the present application.
[0088] The present patent is not limited to the above best embodiment, and anyone can derive other various forms of a direct-view transparent near-eye display optical structure under the inspiration of the present patent. Any equivalent change and modification made within the scope of the present patent application should be covered by the present patent.
Claims
1. A direct-view transparent near-eye display optical structure, characterized in that: From the direction of the human eye outwards, the components are arranged in the following order: focusing module, display module, compensation module, light switch module, and optical lens; The focusing module uses a single focusing lens or a focusing lens group composed of multiple lenses to focus the light from the display screen at the center of the pupil and image it on the retina, or to focus the light from the display screen to form a virtual image at a certain distance in front of the eyes. The display module includes a transparent display screen with a collimation structure; the transparent display screen has transparency for displaying color or monochrome images, and forms a parallel beam of light through the collimation structure for the focusing module to focus. The compensation module consists of one or more lenses, used to eliminate the deflection effect of the focusing module on ambient light, so that the ambient light continues to propagate along the original optical path after passing through the overall optical structure. The optical switch module blocks or allows ambient light to pass through by controlling an electric field. The transparent display screen has a brightness adjustment function. In a sunny outdoor environment with a brightness of 3000 nits, the transparent display screen can achieve a brightness of at least 10000 nits, and the adjustable brightness range is at least 0-10000 nits; the angular resolution of the transparent display screen should be at least 60 PPD. When the optical structure imaging principle is retinal projection, the light-emitting pixels in the transparent display screen are distributed in a densely packed center and dispersed periphery pattern; the total area occupied by all light-emitting pixels per unit area in the transparent display screen of the display module does not exceed 50% of the total area; The design process is as follows: First, the lens aperture, focal length, and materials in the focusing module are optimized to achieve a focusing effect to form a retinal projection or a virtual image. Then, the lens parameters of the focusing module are fixed, and an equivalent transparent flat plate is used to replace the transparent display screen. The size of the lens group in the compensation module is set according to the size of the focusing lens. Finally, by increasing or decreasing the number of lenses in the lens group of the compensation module, the focal length of the entire optical system, including the focusing module, the transparent display screen, and the compensation module, is optimized to infinity, so that the overall optical structure has the least impact on the refraction of ambient light. When designing this optical structure, the focal length of the optical system, including the focusing module, transparent display screen, and compensation module, was optimized to infinity. After adding vision-correcting optical lenses, the imaging effect of the overall optical system on the environmental image and the displayed image was examined, and then the entire optical system was optimized accordingly. When the overall optical structure images the displayed image, the modulation transfer function at the cutoff frequency of 30 lp / mm is greater than 0.4, the distortion of the imaging system containing the displayed image is no greater than 5%, and the optical efficiency is greater than 70%. When the overall optical structure images the environmental image, the modulation transfer function at the cutoff frequency of 30 lp / mm is greater than 0.3, the distortion of the environmental image by the entire optical structure is no greater than 5%, and the optical efficiency is greater than 50%.
2. The direct-viewing transparent near-eye display optical structure according to claim 1, characterized in that: The focusing module is used to converge the collimated light emitted by each light-emitting pixel of the display screen in the display module to the center of the human eye's pupil, thereby forming a retinal projection display; the focusing lens has a fixed focal length, which should be equivalent to the average distance from the human eye's pupil to the eyeglasses.
3. The direct-viewing transparent near-eye display optical structure according to claim 1, characterized in that: The focusing module uses a liquid crystal lens to magnify the image on the transparent display screen and form a virtual image at a distance for human eyes to observe. The average distance from the human pupil to the glasses is within the adjustable focal length range of the liquid crystal lens.
4. The direct-viewing transparent near-eye display optical structure according to claim 1, characterized in that: The collimation structure attached to the light-emitting pixels in the transparent display screen of the display module is a micro-collimation structure that matches the size of the light-emitting pixels.
5. The direct-viewing transparent near-eye display optical structure according to claim 1, characterized in that: The focusing module uses a liquid crystal lens, combined with a human eye recognition module and an eye-tracking module to adjust the focal length and optical axis of the liquid crystal lens, so that the human eye can observe the display image generated by the display module when it rotates to different positions, thereby achieving the effect of pupil dilation.
6. The direct-viewing transparent near-eye display optical structure according to claim 1, characterized in that: When this optical structure is applied to a head-mounted near-eye display device, the displayed image is shown by two or more sets of the optical structure in a dispersed or closely connected manner, either separately or simultaneously, so as to synthesize a corresponding complete image on the retina or overlap to form a brighter image by utilizing the principle of retinal projection; the effective display area of the transparent display screen in the display module is less than or equal to the minimum area of the effective aperture of the focusing module, the compensation module and the optical switch module.
Citation Information
Patent Citations
Head-mounted display
CN103852891A
Head-mounted display with vision compensation function
TW201712400A