Near-to-eye display device and intelligent glasses

Abstract

The utility model belongs to the technical field of glasses, and relates to a near-to-eye display device and intelligent glasses, which comprise an optical waveguide group, the optical waveguide group comprises a waveguide substrate, and a first coupling-in and coupling-out grating group and a second coupling-in and coupling-out grating group which are arranged on the waveguide substrate, at least part of the gratings in the first coupling-in and coupling-out grating group and the second coupling-in and coupling-out grating group are located on the same side of the waveguide substrate, and the gratings located on the same side of the waveguide substrate, namely the first period grating and the second period grating are at least partially overlapped to form the composite grating. According to the intelligent glasses, light of corresponding wave bands can be coupled in or out of the same area of the same side of the waveguide substrate through the gratings of the composite grating, so that the absolute area of the gratings is effectively reduced, lightweight design is facilitated, and long-time wearing comfort is improved.

Description

Technical Field

[0001] The utility model relates to the technical field of smart glasses, and in particular to a near-eye display device and smart glasses. Background Art

[0002] Smart glasses are wearable glasses that have an independent operating system like a smartphone and can realize various functions through software installation. Taking augmented reality glasses as an example, augmented reality (AR) glasses are smart wearable devices that collect real-world information in real time, superimpose virtual information and images, and achieve real-time interaction through various interactive means, helping people to sense information that cannot be easily obtained in the real world. They have great application prospects in personal audio-visual entertainment, simulation training, education, medicine, games, military and aerospace fields.

[0003] To facilitate human-computer interaction and ensure that it is more in line with the shape of glasses, the near-eye display device of existing AR glasses generally includes a display imaging device and an eye tracking device that are independent of each other. Exemplarily, its display imaging device includes an optical machine, an optical waveguide, and a coupling-in and coupling-out grating. The virtual display image emitted by the optical machine reaches the coupling-in grating, and after diffraction by the coupling-in grating, it enters the functional layer of the optical waveguide at a specific angle, and is transmitted to the coupling-out grating for diffraction and coupling through total reflection through the functional layer of the optical waveguide, and then reaches the human eye for imaging.

[0004] In addition, existing mainstream eye tracking devices all include infrared cameras and infrared image light sources. The infrared image light source illuminates the human eye, and after being reflected by structures such as the human cornea, iris or retina, the light carrying human eye feature information will be captured by the infrared camera. After being processed by the relevant signal processor, information such as the human eye movement position can be obtained.

[0005] However, because infrared cameras need to avoid the main viewing area used for virtual display imaging, they can only be arranged around AR glasses, such as in places invisible to the human body such as the eye sockets. This makes it difficult for infrared cameras to image the entire area of ​​the human eye. Therefore, it is generally necessary to set up multiple infrared cameras on the side of the eyes of the glasses, making it difficult to achieve both lightweight AR glasses and eye tracking functions. Utility Model Content

[0006] The purpose of the embodiments of the utility model is to solve the technical problem that the existing smart glasses have an eye tracking function, which results in heavy weight and large volume, and are difficult to meet the requirements of lightweight and long-term wearing.

[0007] In order to solve the above technical problems, the embodiment of the utility model provides a near-eye display device, which adopts the following technical solution:

[0008] The near-eye display device comprises:

[0009] An optical waveguide group, comprising a waveguide substrate and a first coupling-in-coupling-out grating group and a second coupling-in-coupling-out grating group arranged on the waveguide substrate, wherein the first coupling-in-coupling-out grating group is configured to couple imaging light into and out of the waveguide substrate; and the second coupling-in-coupling-out grating group is configured to couple infrared light into and out of the waveguide substrate;

[0010] Wherein, at least some of the gratings in the first in-coupling / out-coupling grating group and the second in-coupling / out-coupling grating group are located on the same side of the waveguide substrate, and the gratings located on the same side of the waveguide substrate at least partially overlap;

[0011] On the same side of the waveguide substrate, the gratings in the first coupling-incoupling-outcoupling grating group that have overlapping positions are called first period gratings, and the gratings in the second coupling-incoupling-outcoupling grating group that overlap with the first period grating are called second period gratings; the combination of the first period grating and the corresponding second period grating is called a composite grating;

[0012] The first periodic grating and the second periodic grating both include a substrate and a plurality of microstructure units periodically arranged along a one-dimensional direction or a two-dimensional direction, and the microstructure units of the first periodic grating and the microstructure units of the second periodic grating are alternately arranged on a projection surface of the substrate, so that imaging light and infrared light are independently coupled in or out through the first periodic grating and the second periodic grating at the same side and in the same area of ​​the waveguide matrix.

[0013] In a preferred solution of some embodiments, the microstructure unit of the first periodic grating is called a first microstructure unit, and the first periodic grating includes N first microstructure units, and the N first microstructure units are arranged in a horizontal and / or vertical array;

[0014] In the first periodic grating, the length of the connecting line between the centers of two first microstructure units adjacent to each other in the transverse direction is the first transverse period length, and the length of the connecting line between the centers of two first microstructure units adjacent to each other in the longitudinal direction is the first longitudinal period length; the angle between the connecting line between the centers of two first microstructure units adjacent to each other in the transverse direction and the connecting line between the centers of two first microstructure units adjacent to each other in the longitudinal direction is the first periodic unit internal angle, and the first periodic unit internal angle is 90° to 150°;

[0015] The microstructure unit of the second periodic grating is called a second microstructure unit; the second periodic grating includes M second microstructure units; the M second microstructure units are arranged in a horizontal and / or vertical array;

[0016] In the second periodic grating, the length of the connecting line of the centers of two transversely adjacent second microstructure units is the second transverse period length, and the length of the connecting line of the centers of two longitudinally adjacent second microstructure units is the second longitudinal period length; the angle between the connecting line of the centers of two transversely adjacent second microstructure units and the connecting line of the centers of two longitudinally adjacent second microstructure units is the second periodic unit internal angle, and the second periodic unit internal angle is 90° to 150°;

[0017] In the composite grating, the substrate of the overlapping parts of the first period grating and the second period grating is common.

[0018] In a preferred solution of some embodiments, in the composite grating, the first microstructure units of the first periodic grating and the second microstructure units of the second periodic grating are alternately arranged at intervals on the projection surface of the substrate;

[0019] Alternatively, the first microstructure units and the second microstructure units are alternately arranged on the projection surface of the substrate, and in the height direction of the substrate, at least part of the first microstructure units are highly overlapped with the corresponding second microstructure units.

[0020] In order to solve the above technical problems, the embodiment of the utility model further provides a pair of smart glasses, which adopts the following technical solution: the smart glasses include a frame and the above near-eye display device;

[0021] The eyeglass frame comprises an eye socket and a connecting portion, wherein the eye socket is embedded with an optical waveguide group of the near-eye display device; the connecting portion is arranged on one side of the eye socket in the pupil distance direction and forms an installation cavity for installing an imaging optical group and an eye tracking optical group of the near-eye display device.

[0022] In a preferred solution of some embodiments, the enhanced display glasses further include temples, and the temples are connected to the eye sockets through the connecting portion;

[0023] Alternatively, the smart glasses further include a strap that can be tied to the head, one end of the strap is connected to one of the connecting parts of the frame, and the other end of the strap is connected to another connecting part of the frame.

[0024] In a preferred solution of some embodiments, the temple and the connecting portion are integrally formed; or, the temple and the connecting portion are pivotally connected.

[0025] Compared with the prior art, the near-eye display device and smart glasses provided by the embodiments of the present invention mainly have the following beneficial effects:

[0026] The near-eye display device not only allows imaging light and infrared light to at least share a common waveguide substrate for propagation, but also allows the first coupling-in coupling-out coupling grating group and the second coupling-in coupling-out coupling grating group to at least partially be located on the same side of the waveguide substrate, and the gratings located on the same side at least partially overlap, so that the gratings on the same side and overlapping are combined to form a composite grating, thereby combining the substrates of the first period grating and the second period grating in the composite grating into one, and alternately arranging the microstructure units of the two on the projection surface of the substrate, so that by adjusting the size, period interval, profile, height, inclination size, and different incident angles of different bands of the microstructure units of each grating in the composite grating, the light of the corresponding band can be independently coupled in or coupled out in the same area on the same side of the waveguide substrate through each grating of the composite grating, thereby effectively reducing the absolute area of ​​the grating, realizing the miniaturized design of the optical waveguide group, and further ensuring the lightweight design of the smart glasses, which is conducive to greatly improving the wearing comfort of the user and meeting the long-term wearing requirements. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the technical solution of the utility model, the following is a brief introduction to the drawings required for the description of the embodiments. Obviously, the drawings described below are some embodiments of the utility model or corresponding prior art. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. Among them:

[0028] Figure 1 1 is a working principle diagram of the smart glasses in the first specific implementation mode of the first embodiment of the utility model; in this figure, the second coupling-in grating and the first coupling-out grating are in the same plane and completely overlap, and the second coupling-out grating and the first coupling-in grating are in the same plane and partially overlap;

[0029] Figure 2 This is a schematic diagram of the principle of combining the first periodic grating and the second periodic grating of the smart glasses in the first embodiment of the utility model; in this figure, the first periodic grating and the second periodic grating have the same period and are completely alternately arranged;

[0030] Figure 3 yes Figure 2 A schematic diagram of the planar structure of a composite grating formed by combining the first periodic grating and the second periodic grating of the smart glasses;

[0031] Figure 4 1 is a schematic diagram of the position arrangement between the first periodic grating and the second periodic grating of the smart glasses in the first embodiment of the utility model; in this figure, the first periodic grating and the second periodic grating have the same period and are completely alternately arranged;

[0032] Figure 5This is another principle schematic diagram of the composite of the first periodic grating and the second periodic grating of the smart glasses in the first embodiment of the utility model; in this figure, the periods of the first periodic grating and the second periodic grating are different, and the height of the microstructure units of the two overlaps at the overlapping position;

[0033] Figure 6 This is a distribution diagram of the plane morphology of a microstructure unit of a composite grating in the enhanced display glasses in the embodiment of the utility model; wherein in this diagram, the horizontal axis represents the position of the microstructure unit, and the vertical axis represents the height of the microstructure unit;

[0034] Figure 7 1 is a working principle diagram of the smart glasses in the second specific implementation mode of the first embodiment of the utility model; in this diagram, the second coupling-in grating and the first coupling-out grating are in the same plane and completely overlap, and the second coupling-out grating is in a different plane from the first coupling-in grating;

[0035] Figure 8 is a working principle diagram of the smart glasses in the third specific implementation mode of the first embodiment of the utility model; in this figure, the second coupling-in grating and the first coupling-out grating are not in the same plane, and the second coupling-out grating and the first coupling-in grating are in the same plane and partially overlap;

[0036] Fig. 9 This is a schematic diagram of the distribution of the composite grating of the smart glasses on the waveguide substrate in the first specific implementation manner of the first embodiment of the utility model;

[0037] Fig.10 This is a schematic diagram of the distribution of the composite grating of the smart glasses on the waveguide substrate in the second specific implementation manner and the third specific implementation manner of the first embodiment of the utility model;

[0038] Fig.11 This is a working principle diagram of the smart glasses in the second embodiment of the utility model; in this diagram, there is at least one composite grating, and a third coupling-in grating and a third coupling-out grating are newly added to couple the light path of the light source to the waveguide matrix;

[0039] Fig.12 Schematic diagram of the distribution of the composite grating of the smart glasses on the waveguide substrate in the second embodiment of the utility model;

[0040] Fig.13 A working principle diagram of the smart glasses in the third embodiment of the present utility model; in this diagram, the image lens of the image imaging unit in the imaging light group is replaced by a metasurface lens;

[0041] Fig.14 A working principle diagram of smart glasses in the first specific implementation mode of the fourth embodiment of the utility model; in this diagram, the pupil imaging device of the eye tracking optical group is merged into the imaging optical group, and the second coupling-out grating is coplanar with the first coupling-in grating and is located within the position of the first coupling-in grating;

[0042] Fig.15 A working principle diagram of smart glasses in the second specific implementation mode of the fourth embodiment of the utility model; in this diagram, the pupil imaging device of the eye tracking light group is merged into the imaging light group, and the second coupling-out grating is coplanar with the first coupling-in grating and completely overlaps;

[0043] Fig.16 Schematic diagram of the distribution of the composite grating of the smart glasses on the waveguide substrate in the first specific implementation mode of the fourth embodiment of the utility model;

[0044] Fig.17 Schematic diagram of the distribution of the composite grating of the smart glasses on the waveguide substrate in the second specific implementation manner of the fourth embodiment of the utility model;

[0045] Fig.18 A working principle diagram of the smart glasses in the fifth embodiment of the utility model; in this diagram, the waveguide substrate is a multi-layer wave plate;

[0046] Fig.19 Schematic diagram of the distribution of the composite grating of the smart glasses on the waveguide substrate in the fifth embodiment of the application;

[0047] Fig. 20 It is a three-dimensional exploded schematic diagram of the main parts of the smart glasses in the embodiment of the utility model;

[0048] Fig.21 It is a three-dimensional structural schematic diagram of the smart glasses in the embodiment of the utility model. DETAILED DESCRIPTION

[0049] Unless otherwise defined, all technical and scientific terms used in this document have the same meaning as commonly understood by technicians in the technical field of the present invention; the terms used in this specification are only for the purpose of describing specific embodiments and are not intended to limit the present invention. For example, the directions or positions indicated by terms such as "length", "width", "up", "down", "left", "right", "front", "back", "vertical", "horizontal", "top", "bottom", "inside", and "outside" are based on the directions or positions shown in the drawings, which are only for the convenience of description and cannot be understood as limitations on the present technical solution.

[0050] The terms "including" and "having" and any variations thereof in the specification and claims of the present utility model and the above-mentioned drawings are intended to cover non-exclusive inclusions; the terms "first", "second", etc. in the specification and claims of the present utility model or the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. "Multiple" means two or more, unless otherwise clearly and specifically defined.

[0051] In the specification and claims of the utility model and the above-mentioned drawings, when an element is referred to as being "fixed on" or "mounted on" or "disposed on" or "connected to" another element, it may be directly or indirectly located on the other element. For example, when an element is referred to as being "connected to" another element, it may be directly or indirectly connected to the other element.

[0052] In addition, the reference to "embodiment" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiment may be included in at least one embodiment of the present invention. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0053] An embodiment of the utility model provides a near-eye display device 100, which mainly adopts eye tracking technology based on a traditional infrared imaging camera. It can not only realize the eye tracking function, but also has a small overall size and weight, which can meet the requirements of lightweight and long-term wearing of smart glasses 1000.

[0054] like Figure 1 , Figure 7 and Figure 8 As shown, the near-eye display device 100 includes an optical waveguide group 1, wherein the optical waveguide group 1 includes a waveguide substrate 11 and a first coupling-in coupling-out coupling grating group and a second coupling-in coupling-out coupling grating group disposed on the waveguide substrate 11, the first coupling-in coupling-out coupling grating group is configured to couple the imaging light 500 into and out of the waveguide substrate 11; the second coupling-in coupling-out coupling grating group is configured to couple the infrared light 600 into and out of the waveguide substrate 11. It can be understood that both the imaging light 500 and the infrared light 600 are totally reflected within the functional energy of the waveguide substrate 11, so that the two share at least part of the optical path for propagation, thereby helping to reduce the volume and weight of the near-eye display device 100.

[0055] Moreover, in order to further reduce the volume and weight of the near-eye display device 100, at least some of the gratings in the first coupling-in-coupling-out grating group and the second coupling-in-coupling-out grating group are located on the same side of the waveguide substrate 11, and the gratings located on the same side of the waveguide substrate 11 at least partially overlap. Specifically, on the same side of the waveguide substrate 11, the gratings in the first coupling-in-coupling-out grating group that have overlapping positions are called first period gratings 121, and the gratings in the second coupling-in-coupling-out grating group that have overlapping positions with the first period gratings 121 are called second period gratings 122; the combination of the first period grating 121 and the corresponding second period grating 122 is called a composite grating 12.

[0056] In the embodiment of the present utility model, Figure 2 , Figure 3 and Figure 5 As shown, the first periodic grating 121 and the second periodic grating 122 both include a substrate 123 and a plurality of microstructure units periodically arranged along a one-dimensional direction or a two-dimensional direction, and the microstructure units of the first periodic grating 121 and the microstructure units of the second periodic grating 122 are alternately arranged on the projection surface of the substrate 123, so that the imaging light 500 and the infrared light 600 are independently coupled in or out through the first periodic grating 121 and the second periodic grating 122 in the same area on the same side of the waveguide matrix 11.

[0057] It can be understood that at least one composite grating 12 is disposed on the waveguide substrate 11. By combining the substrates 123 of multiple gratings into one and arranging the microstructure units of the multiple gratings alternately, the size, period interval, profile, height, inclination of the microstructure units of each grating in the composite grating 12 and the different incident angles of different bands can be designed in the same area of ​​the same surface, so that different bands can be independently coupled in or out in the same area on the same side. In this way, while controlling the different bands separately, the absolute area of ​​the grating can be effectively reduced, which is conducive to the miniaturization design of the optical waveguide group 1.

[0058] Exemplarily, in an embodiment of the utility model, at least one composite grating 12 is arranged on the waveguide substrate 11, wherein, through the size, period interval, profile, height, inclination angle of the microstructure units of the first period grating 121 and the second period grating 122 of the composite grating 12, and the different incident angles of the imaging light 500 and the infrared light 600, the imaging light 500 and the infrared light 600 can be modulated respectively, so as to realize the independent coupling in or out of the imaging light 500 and the infrared light 600 in the same area on the same side.

[0059] It should be noted that the first periodic grating 121 and the second periodic grating 122 can both be one-dimensional gratings or two-dimensional gratings. In addition, the first periodic grating 121 can modulate the imaging light 500 alone, for example, it can modulate the visible light of 492nm to 577nm but not limited to this band; the second periodic grating 122 can modulate the infrared light 600, for example, it can modulate the infrared light of 750nm to 1000nm but not limited to this band.

[0060] For example, in the embodiment of the present invention, the imaging light 500 is generally visible light. In addition, to ensure the overall lightweight design of the smart glasses 1000, the thickness of the waveguide matrix 11 is 0.2 mm to 10 mm.

[0061] It should be noted that the waveguide matrix 11 is usually made of a transparent material, specifically, the transparent material includes but is not limited to glass, plastic, etc. Of course, the waveguide matrix 11 can also be made of a material with a specific color, and the material of the waveguide matrix 11 is not particularly limited here.

[0062] In summary, compared with the prior art, the near-eye display device 100 has at least the following beneficial effects:

[0063] The near-eye display device 100 not only allows the imaging light 500 and the infrared light 600 to propagate through at least the common waveguide substrate 11, but also allows the first coupling-in coupling-out coupling grating group and the second coupling-in coupling-out coupling grating group to be at least partially located on the same side of the waveguide substrate 11, and the gratings located on the same side at least partially overlap, so that the gratings on the same side and overlapping are combined to form a composite grating 12, thereby combining the substrate 123 of the first periodic grating 121 and the second periodic grating 122 in the composite grating 12 into one, and the microstructure units of the two are projected on the substrate 123. The optical waveguide group 1000 is alternately arranged on the top, so that by adjusting the size, periodic interval, profile, height, inclination angle of the microstructure unit of each grating in the composite grating 12, and the different incident angles of different bands and other parameters, the light of the corresponding band can be independently coupled into or coupled out through each grating of the composite grating 12 in the same area on the same side of the waveguide substrate 11, thereby effectively reducing the absolute area of ​​the grating, realizing the miniaturization design of the optical waveguide group 1, and further ensuring the lightweight design of the smart glasses 1000, which is conducive to greatly improving the wearing comfort of the user and meeting the long-term wearing requirements.

[0064] Embodiment 1 of the near-eye display device 100 of the present invention

[0065] In order to make the technical personnel in this field better understand the present utility model scheme, the following will be combined with the attached Figures 1 to 10 , clearly and completely describe the technical solution in Example 1 of the utility model.

[0066] In a specific implementation of the first embodiment of the present utility model, as Figure 2 , Figure 3 and Figure 5 As shown, in the composite grating 12, for the convenience of explanation, the microstructure unit of the first periodic grating 121 is called the first microstructure unit 124, and the microstructure unit of the second periodic grating 122 is called the second microstructure unit 125. In order to realize the staggered arrangement of the microstructure units when the first periodic grating 121 and the second periodic grating 122 are composited, the first periodic grating 121 includes N first microstructure units 124, and the N first microstructure units 124 are arranged in a horizontal and / or vertical array; correspondingly, the second periodic grating 122 includes M second microstructure units 125, and the M second microstructure units 125 are arranged in a horizontal and / or vertical array.

[0067] like Figure 4 As shown, in a first periodic grating 121, the length of the center line connecting two first microstructure units 124 adjacent in the transverse direction is the first transverse period length A1, and the length of the center line connecting two first microstructure units 124 adjacent in the longitudinal direction is the first longitudinal period length A2. In addition, the angle between the center line connecting two first microstructure units 124 adjacent in the transverse direction and the center line connecting two first microstructure units 124 adjacent in the longitudinal direction is the first periodic unit internal angle a, and the first periodic unit internal angle a is 90° to 150°.

[0068] Correspondingly, Figure 4 As shown, in a second period grating 122, the length of the line connecting the centers of two transversely adjacent second microstructure units 125 is the second transverse period length B1, and the length of the line connecting the centers of two longitudinally adjacent second microstructure units 125 is the second longitudinal period length B2; the angle between the line connecting the centers of two transversely adjacent second microstructure units 125 and the line connecting the centers of two longitudinally adjacent second microstructure units 125 is the second period unit internal angle b, and the second period unit internal angle b is 90° to 150°.

[0069] It can be understood that when designing the composite grating 12, light of different bands can be modulated directly by adjusting the first transverse period length A1, the first longitudinal period length A2, the first period unit inner angle a of the first period grating 121, and the second transverse period length B1, the second longitudinal period length B2, the second period unit inner angle b of the second period grating 122. Light of each band can be independently coupled in or out in the same area on the same side of the waveguide matrix 11.

[0070] Preferably, in order to simplify the composite structure of the first periodic grating 121 and the second periodic grating 122, the second transverse period length B1, the second longitudinal period length B2, and the second period unit internal angle b of the second periodic grating 122 are respectively the same as the first transverse period length A1, the first longitudinal period length A2, and the first period unit internal angle a of the first periodic grating 121. Among them, the first transverse period length A1 of the first periodic grating 121 is preferably 150nm~2um, and the first longitudinal period length A2 is preferably 150nm~2um. Therefore, the second transverse period length B1 of the second periodic grating 122 is preferably 150nm~2um, and the second longitudinal period length B2 is preferably 150nm~2um.

[0071] It should be noted that Figure 4The circles in the figure represent the positions of the microstructure units on the substrate 123, and do not represent the shape, size, height, etc. of the microstructures. In addition, in the composite grating 12, the shapes of the first periodic grating 121 and the second periodic grating 122 include but are not limited to circular, elliptical, quadrilateral, hexagonal or other irregular shapes.

[0072] For example, in the first embodiment of the present invention, Figure 2 and Figure 5 As shown, the first microstructure unit 124 of the first periodic grating 121 and the second microstructure unit 125 of the second periodic grating 122 are both in the shape of a column with a quadrilateral cross section. Specifically, the side length of the first microstructure unit 124 is preferably 150nm~2um, and the height is preferably 10nm~2um. Correspondingly, for the structure of the simple composite grating 12, the side length of the second microstructure unit 125 of the second periodic grating 122 is also preferably 150nm~2um, and the height is also preferably 10nm~2um, that is, the first microstructure unit 124 of the first periodic grating 121 and the second microstructure unit 125 of the second periodic grating 122 can be the same or similar in shape, and the size can be the same or different, but they are all within the same limited range, and the size of each parameter can be adjusted according to actual needs.

[0073] In the first embodiment of the present invention, in order to facilitate the combination of the first periodic grating 121 and the second periodic grating 122, simplify the structure of the composite grating 12, and reduce the absolute area and volume of the composite grating 12, in the composite grating 12, the substrate 123 of the overlapping part of the first periodic grating 121 and the second periodic grating 122 is shared.

[0074] Exemplarily, when the first periodic grating 121 and the second periodic grating 122 completely overlap, the substrate 123 of the formed composite grating 12 is the substrate 123 of the first periodic grating 121 or the second periodic grating 122 .

[0075] Alternatively, when the projection of the second periodic grating 122 on the waveguide matrix 11 is completely within the position range of the first periodic grating 121 but the sizes of the two are different, the substrate 123 of the formed composite grating 12 is the substrate 123 of the first periodic grating 121.

[0076] Alternatively, when the first periodic grating 121 and the second periodic grating 122 partially overlap, the substrate 123 of the overlapping portion is the substrate 123 of the first periodic grating 121 or the second periodic grating 122, and the substrate 123 of the non-overlapping portion is still the respective substrate 123.

[0077] Preferably, in order to reduce the volume of the composite grating 12 and facilitate the lightweight design of the smart glasses 1000, the thickness of the first periodic grating 121 and the second periodic grating 122 is 10 nm to 2 um.

[0078] In the composite grating 12, in order to realize the alternating arrangement and compounding of the microstructure units of the first periodic grating 121 and the second periodic grating 122, as shown in FIG. Figure 2 and Figure 3 As shown, in the first specific implementation of the first embodiment of the utility model, the first microstructure units 124 of the first periodic grating 121 and the second microstructure units 125 of the second periodic grating 122 are alternately arranged with gaps on the projection surface of the substrate 123, so that the first microstructure units 124 and the second microstructure units 125 are only periodically compounded in the same area of ​​the substrate 123, but are not overlapped in height, that is, the first microstructure units 124 and the second microstructure units 125 still maintain the original shape and size.

[0079] Alternatively, in the second specific implementation of the first embodiment of the present utility model, as Figure 5 As shown, the first microstructure units 124 and the second microstructure units 125 are alternately arranged on the projection surface of the substrate 123, and in the height direction of the substrate 123, at least part of the first microstructure units 124 and the corresponding second microstructure units 125 are highly overlapped. It can be understood that the first microstructure units 124 and the second microstructure units 125 will overlap on the projection surface of the substrate 123, and at this time, the height of the overlapping parts will be superimposed together.

[0080] Exemplarily, when the first periodic grating 121 and the second periodic grating 122 are both one-dimensional gratings, in the composite grating 12, the total height H(x) of the microstructure unit at x satisfies the shape condition constraint of the following formula 1, wherein the formula 1 is specifically as follows:

[0081] H(x)=G1(x)+G2(x)………………………………Formula 1

[0082] In Formula 1, G1(x) represents the height of the first microstructure unit 124 of the first periodic grating 121 at x; G2(x) represents the height of the second microstructure unit 125 of the second periodic grating 122 at x. G1(x) and G2(x) satisfy the following Formula 2 and Formula 3 respectively:

[0083]

[0084] In Formula 2, h1 represents the height of the first microstructure unit 124 of the first periodic grating 121, x1 represents the lateral offset distance of the first microstructure unit 124, and P1 represents the period of the first periodic grating 121. Formula 2 indicates that if the remainder obtained by subtracting the lateral offset distance x1 from the abscissa x of the position where the first microstructure unit 124 is located and divided by the period P1 of the first periodic grating 121 is less than or equal to half of the period of the first periodic grating 121, then the height of the first microstructure unit 124 at x is h1, otherwise it is 0.

[0085] Similarly, in Formula 3, h2 represents the height of the second microstructure unit 125, x2 represents the lateral offset distance of the second microstructure unit 125, and P2 represents the period of the second periodic grating 122. Formula 3 indicates that if the absolute difference obtained by subtracting the lateral offset distance x2 from the horizontal coordinate x of the position where the second microstructure unit 125 is located, and the remainder obtained by dividing it by the period P2 of the second periodic grating 122 is less than or equal to half of the period of the second periodic grating 122, then the height of the second microstructure unit 125 at x is h2, otherwise it is 0.

[0086] In the composite grating 12, the first periodic grating 121 and the second periodic grating 122 also satisfy the following formula 4:

[0087] P(sini±sinθ)=mλ………………………………Formula 4

[0088] Specifically, in Formula 4, P represents the grating period, i represents the incident angle of the corresponding light; ± represents different types of diffraction spectra, and when the incident light and the diffracted light are on the same side of the corresponding grating normal, a positive sign is taken; otherwise, when they are on opposite sides, a negative sign is taken; θ represents the diffraction angle of the corresponding light; m represents the diffraction order, which is generally +1 or -1; λ represents the wavelength of the incident light of the corresponding light.

[0089] More specifically, the diffraction angle θ of the corresponding light must satisfy the following: the diffraction angle of the imaging light 500 is greater than the critical angle of total reflection of the waveguide matrix, and the incident angle of the infrared light 600 is greater than the critical angle of total reflection of the waveguide matrix.

[0090] In addition, taking the first periodic grating 121 and the second periodic grating 122 as an example, both are one-dimensional gratings, the total reflection law satisfies the following formula 5:

[0091] sinθ0=1 / n………………………………Formula 5

[0092] In Formula 5, θ0 represents the critical angle of total reflection of the waveguide matrix, and n represents the refractive index of the medium. For example, if the refractive index of the medium is n=1.5, the critical angle of total reflection of the waveguide matrix θ0=41.8°.

[0093] For example, if the incident angle of the imaging light 500 is a, the diffraction angle is b, and the incident angle of the infrared light 600 with pupil information is c, and the diffraction angle is d, then: b>θ0, c>θ0.

[0094] It should be noted that, through the above formulas 1 to 5, the diffraction efficiency of the first period grating 121 and the second period grating 122 can be optimized and designed to ultimately obtain a suitable grating shape and output effect, and a total distribution law diagram of the height of a composite grating 12, that is, the morphology of the microstructure unit in the composite grating 12, can be ultimately obtained.

[0095] Exemplarily, if the period of the first period grating 121 is selected to be 490nm, the imaging light 500 enters the waveguide matrix 11 at an incident angle of 0° to 20° that satisfies the total reflection condition, the lateral offset distance x1 of the first microstructure unit 124 of the first period grating 121 is 310nm, and the height h1 of the first period grating 121 is 400nm; correspondingly, the period of the second period grating 122 is selected to be 735nm, the infrared light 600 enters the waveguide matrix 11 at an incident angle of 42° to 80°, and is diffracted out of the waveguide matrix 11 at 20° to 35°, the lateral offset distance x2 of the second microstructure unit 125 of the second period grating 122 is 410nm, and the height h2 of the second period grating 122 is 510nm. The height distribution law diagram of the composite grating 12 finally obtained can be referred to Figure 6 .

[0096] It should be noted that if the first periodic grating 121 and the second periodic grating 122 are both two-dimensional gratings, their recombination principles along the x and y directions are the same as those of one-dimensional gratings, and will not be described in detail here.

[0097] In the first embodiment of the present invention, Figure 1 , Figure 7 and Figure 8 As shown, the waveguide matrix 11 can generally be a single-layer wave plate. Of course, in other embodiments, the waveguide matrix 11 can also be a multi-layer wave plate. The structure of the waveguide matrix 11 is not particularly limited here.

[0098] In the first embodiment of the present invention, Figure 1 , Figure 7 and Figure 8 As shown, the near-eye display device 100 further includes an imaging light group 2 and an eye tracking light group 3 disposed on the same peripheral side of the eye 700, wherein the imaging light group 2 is configured to emit an imaging light 500 with image information, and project it into the user's field of view through optical components such as the optical waveguide group 1, so as to superimpose and display the virtual image and the real world image, thereby achieving an augmented reality effect. The eye tracking light group 3 is configured to emit an infrared light 600 and receive an infrared light 600 with pupil information.

[0099] Understandably, the first coupling-in coupling-out grating group is configured to couple the imaging light 500 carrying virtual image information emitted by the imaging light group 2 into and out of the waveguide matrix 11, so as to project the imaging light 500 from the position of the waveguide matrix 11 directly opposite the eye 700 to the eye 700, so as to be superimposed and displayed with the image of the real world received by the eye 700, thereby improving the user's augmented reality experience.

[0100] Similarly, the second coupling-incoupling-out grating group is configured to couple the infrared light 600 and the infrared light 600 carrying pupil information into and out of the waveguide matrix 11, so as to couple the infrared light 600 directly emitted by the eye tracking light group 3, or the infrared light 600 carrying pupil information reflected by the eye 700 into and out of the waveguide matrix 11, so that the eye tracking light group 3 and the imaging light group 2 at least share part of the waveguide matrix 11 for signal transmission, and finally transmit the infrared light 600 carrying pupil information to the imaging light group 2 side.

[0101] Exemplarily, when the infrared light 600 is projected directly from the imaging light group 2 side to the corresponding eye 700, the second coupling-in-coupling-out grating group is mainly used to couple the infrared light 600 with pupil information reflected from the eye 700 into and out of the waveguide matrix 11, so as to be projected to the optical device corresponding to the eye tracking light group 3 located on the imaging light group 2 side. When the infrared light 600 is projected from the imaging light group 2 side to the eye 700 through the waveguide matrix 11, the second coupling-in-coupling-out grating group is not only mainly used to couple the infrared light 600 into and out of the waveguide matrix 11, so as to be projected to the eye 700, but also used to couple the infrared light 600 with pupil information reflected from the eye 700 to the waveguide matrix 11 into and out of the waveguide matrix 11, so as to be projected to the optical device corresponding to the eye tracking light group 3 located on the imaging light group 2 side.

[0102] It can be further understood that the near-eye display device 100 arranges the first coupling-in coupling-out coupling grating group and the second coupling-in coupling-out coupling grating group on the waveguide substrate 11 located directly in front of the eye 700, and fully utilizes the diffraction grating design principle of the waveguide substrate 11, so that at least part of the optical path of the imaging light group 2 and the eye tracking light group 3 is propagated through the waveguide substrate 11, so that each light coupled out from the waveguide substrate 11 is projected from directly in front of the eye 700 to the eye 700, and the infrared light 600 with pupil information reflected from the eye 700 can be projected to the waveguide substrate 1 1 is transmitted to be projected to the eye tracking light group 3, so that the quality of the infrared light 600 with pupil information captured by the eye tracking light group 3 is improved, so as to have a better viewing angle range, illumination range and illumination angle, and solve the pain point that the pupil imaging device 32 of the eye tracking light group 3 cannot be arranged in the center of the eye, and it is also beneficial for the eye tracking light group 3 to use fewer light sources 31 and / or pupil imaging devices 32 to achieve the same or better eye tracking effect as the traditional solution, and it is also beneficial to further reduce the weight, volume and manufacturing cost of the smart glasses 1000.

[0103] In addition, if Figure 1 , Figure 7 and Figure 8 As shown, to realize the eye tracking function, the eye tracking optical group 3 includes a light source 31 and a pupil imaging device 32, and the light source 31 is mainly used to emit infrared light 600 to the eye 700. Specifically in the first embodiment, the light source 31 directly emits the infrared light 600 to the eye 700. The pupil imaging device 32 is mainly used to receive the infrared light 600 with pupil information emitted from the waveguide matrix 11, so as to perform gaze point tracking, eye movement analysis, and eyeball parameter measurement on the user in combination with sensors and corresponding algorithms.

[0104] It should be noted that, in the embodiment of the present utility model, the imaging light 500 may be visible light, specifically light with a wavelength of 400nm-650nm. The infrared light 600 may be infrared light, specifically light with a wavelength of 700nm-1200nm. Of course, in other embodiments, the imaging light 500 and the infrared light 600 may also be other types of light, which are not particularly limited here.

[0105] Exemplarily, when the infrared light 600 is infrared light, the light source 31 of the eye tracking light group 3 is usually an infrared light source, and the pupil imaging device 32 is usually an infrared camera or an infrared video camera.

[0106] In this embodiment 1, if Figure 1 , Figure 7 and Figure 8As shown, in order to project the imaging light 500 emitted by the imaging light group 2 to the eye 700 through the waveguide matrix 11, the first coupling-in coupling-out grating group includes a first coupling-in grating 13 and a first coupling-out grating 14 located on the same side of the waveguide matrix 11. Specifically, the first coupling-in grating 13 and the first coupling-out grating 14 are both located on the side of the waveguide matrix 11 away from the eye 700.

[0107] In addition, in order to project the infrared light 600 carrying pupil information reflected by the eye 700 to the pupil imaging device 32 through the waveguide matrix 11, the second coupling-in coupling-out grating group includes a second coupling-in grating 15 and a second coupling-out grating 16. The second coupling-in grating 15 is used to couple the infrared light 600 reflected by the eye 700 to the waveguide matrix 11 for transmission, and the second coupling-out grating 16 is mainly used to couple the infrared light 600 transmitted by the waveguide matrix 11 out of the waveguide matrix; the pupil imaging device 32 is mainly used to receive the infrared light 600 carrying pupil information emitted from the waveguide matrix.

[0108] And if Figure 1 , Figure 7 and Figure 8 As shown, the first outcoupling grating 14 is located directly in front of the eye 700, so that the imaging light 500 with virtual image information emitted by the imaging light group 2 can be projected to the eye 700 directly in front of the eye 700 when it is coupled out of the waveguide matrix 11 through the first outcoupling grating 14, thereby facilitating a better virtual reality effect.

[0109] In addition, the second coupling grating 15 is also located directly in front of the eye 700 so that the infrared light 600 carrying pupil information reflected by the eye 700 is directed toward the second coupling grating 15. This, on the one hand, is beneficial for the pupil imaging device 32 of the eye tracking optical group 3 to obtain the infrared light 600 carrying pupil information from directly in front of the eye 700, thereby solving the pain point that the pupil imaging device 32 cannot be arranged in the center of the eye of the eye, thereby facilitating the use of a smaller number of pupil imaging devices 32 to obtain the same or better eye tracking effect, thereby reducing the weight and cost of the smart glasses 1000; on the other hand, it is also beneficial to reduce the illumination range and illumination angle requirements of the light source 31 of the eye tracking optical group 3.

[0110] It should be noted that, in the embodiment of the present invention, the first coupling-in grating 13 and the first coupling-out grating 14 may be reflective diffraction gratings, and when the second coupling-out grating 16 is coplanar with the first coupling-in grating 13, the second coupling-out grating 16 is a reflective diffraction grating.

[0111] Alternatively, when the second out-coupling grating 16 is not in the same plane as the first in-coupling grating 13, the second out-coupling grating 16 is a transmission-type diffraction grating.

[0112] Alternatively, when the second coupling-in grating 15 is coplanar with the first coupling-out grating 14, the second coupling-in grating 15 is a reflective diffraction grating.

[0113] Alternatively, when the second coupling-in grating 15 is not in the same plane as the first coupling-out grating 14, the second coupling-in grating 15 is a transmission-type diffraction grating.

[0114] It is understandable that in the first embodiment of the present invention, the first coupling grating 13 and the first coupling grating 14 of the first coupling grating group, and the second coupling grating 15 and the second coupling grating 16 of the second coupling grating group have multiple arrangements on the waveguide substrate 11, and the specific structures of each grating are also multiple, which are not listed here. However, no matter how the gratings are arranged, at least one composite grating 12 must be formed on the waveguide substrate 11, and there are multiple ways to form the composite grating 12, specifically at least the following:

[0115] In a first specific implementation of the first embodiment, the second coupling grating 15 is coplanar with the first coupling grating 14 and at least partially overlaps, and the second coupling grating 16 is coplanar with the first coupling grating 13. The second coupling grating 15 and the first coupling grating 14 may partially overlap or completely overlap; similarly, the second coupling grating 16 and the first coupling grating 13 may partially overlap, completely overlap, or completely staggered, which may be determined according to actual needs.

[0116] It can be understood that if the second coupling-in grating 15 is coplanar with the first coupling-out grating 14 and at least partially overlaps, the second coupling-in grating 15 and the first coupling-out grating 14 together form a composite grating 12, and the first coupling-out grating 14 and the second coupling-in grating 15 are respectively the first period grating 121 and the second period grating 122 of the composite grating 12. Similarly, if the second coupling-out grating 16 and the first coupling-in grating 13 are coplanar with the first coupling-in grating 13 and at least partially overlaps, the second coupling-out grating 16 and the first coupling-in grating 13 together form another composite grating 12, and the first coupling-in grating 13 and the second coupling-out grating 16 are respectively the first period grating 121 and the second period grating 122 of the other composite grating 12. That is, in this case, two composite gratings 12 can be provided on the waveguide substrate 11.

[0117] It should be noted that if Figure 1 and Fig. 9 As shown, for the convenience of explanation and reasonable arrangement of the gratings with the composite grating 12 in the waveguide matrix 11, the area in the waveguide matrix 11 corresponding to the eye 700 is called the viewing area 113; the area in the waveguide matrix 11 corresponding to the connecting portion 220 of the lens frame 200 is called the blind area 114 because it is not visible to the eye 700. Fig. 9As shown, the area in the visual area 113 that is located directly in front of the eye 700 and is provided with a grating is called a first grating area 1131 ; the area in the blind area 114 that is provided with a grating is called a second grating area 1141 .

[0118] Specifically, the area corresponding to the first coupling grating 13 is called the first visible grating area 131, which is located in the second grating area 1141; the area corresponding to the first coupling grating 14 is called the second visible grating area 141, which is located in the first grating area 1131; the area corresponding to the second coupling grating 15 is called the first infrared grating area 151, which is located in the first grating area 1131; the area corresponding to the second coupling grating 16 is called the second infrared grating area 161, which is located in the second grating area 1141. That is, the first grating area 1131 corresponds to the second visible grating area 141 and the first infrared grating area 151, and the second grating area 1141 corresponds to the first visible grating area 131 and the second infrared grating area 161.

[0119] For example, Figure 1 and Fig. 9 As shown, the second coupling grating 15 is coplanar with the first coupling grating 14 and completely overlaps with it, and the second coupling grating 16 is coplanar with the first coupling grating 13 and at least partially overlaps with it.

[0120] Specifically, in this example, Figure 1 and Fig. 9 As shown, the first out-coupling grating 14, the second visible grating area 141 corresponding to the first out-coupling grating 14, the second in-coupling grating 15 and the first infrared grating area 151 corresponding to the second in-coupling grating 15 are all located in the first grating area 1131 of the viewing area 113 of the waveguide matrix 11 and are located directly in front of the eye 700; the second in-coupling grating 15 and the first out-coupling grating 14 are located on the same side of the waveguide matrix 11, and the first infrared grating area 151 corresponding to the second in-coupling grating 15 and the second visible grating area 141 corresponding to the first out-coupling grating 14 completely overlap.

[0121] The first coupling-in grating 13, the first visible grating area 131 corresponding to the first coupling-in grating 13, the second coupling-out grating 16 and the second infrared grating area 161 corresponding to the second coupling-out grating 16 are all located in the second grating area 1141 of the blind area 114 of the waveguide substrate 11. The second coupling-out grating 16 and the first coupling-in grating 13 are located on the same side of the waveguide substrate 11, and the projection of the second infrared grating area 161 corresponding to the second coupling-out grating 16 is located in the first visible grating area 131 corresponding to the first coupling-in grating 13 (see FIG. 1 ). Fig. 9 ), that is, the second outcoupling grating 16 partially overlaps with the first incoupling grating 13.

[0122] Also exemplarily, in the first specific implementation of the present embodiment 1, the first coupling-in grating 13 and the first coupling-out grating 14 are both reflective diffraction gratings, and the second coupling-in grating 15 and the second coupling-out grating 16 are both reflective diffraction gratings, wherein the reflective diffraction gratings here include but are not limited to surface relief gratings or volume holographic gratings, etc.

[0123] In the second specific implementation of the first embodiment, as Figure 7 and Fig.10 As shown, the difference from the first specific implementation is that the second coupling grating 15 and the first coupling grating 14 are in the same plane and at least partially overlap, and the second coupling grating 16 and the first coupling grating 13 are not in the same plane.

[0124] Among them, in the second specific implementation, the second coupling grating 15 and the first coupling grating 14 can partially overlap or completely overlap; similarly, the second coupling grating 16 and the first coupling grating 13 can partially overlap, completely overlap, or be completely staggered when they are in different planes, which can be determined according to actual needs.

[0125] Understandably, in the second specific embodiment, since only the second coupling-in grating 15 is coplanar with the first coupling-out grating 14, only when the second coupling-in grating 15 is coplanar with the first coupling-out grating 14 and partially overlaps, or is coplanar with the first coupling-out grating 14 and completely overlaps, the second coupling-in grating 15 and the first coupling-out grating 14 together form a composite grating 12. In short, the present specific embodiment may have a composite grating 12, and the second coupling-in grating 15 and the first coupling-out grating 14 together form the composite grating 12, and the first coupling-out grating 14 and the second coupling-in grating 15 are the first period grating 121 and the second period grating 122 of the composite grating 12, respectively.

[0126] For example, Figure 7 and Fig.10 As shown, the second coupling-in grating 15 is coplanar with the first coupling-out grating 14 and completely overlaps with it, and the second coupling-out grating 16 is skewed with the first coupling-in grating 13 and partially overlaps with it.

[0127] Specifically, in this example, Figure 7 and Fig.10 As shown, the first out-coupling grating 14, the second visible grating area 141 corresponding to the first out-coupling grating 14, the second in-coupling grating 15 and the first infrared grating area 151 corresponding to the second in-coupling grating 15 are all located in the first grating area 1131 of the viewing area 113 of the waveguide matrix 11 and are located directly in front of the eye 700; the second in-coupling grating 15 and the first out-coupling grating 14 are located on the same side of the waveguide matrix 11, and the first infrared grating area 151 corresponding to the second in-coupling grating 15 and the second visible grating area 141 corresponding to the first out-coupling grating 14 completely overlap.

[0128] The first coupling-in grating 13, the first visible grating area 131 corresponding to the first coupling-in grating 13, the second coupling-out grating 16 and the second infrared grating area 161 corresponding to the second coupling-out grating 16 are all located in the second grating area 1141 of the blind area 114 of the waveguide substrate 11. The second coupling-out grating 16 and the first coupling-in grating 13 are located on the opposite side of the waveguide substrate 11, and the projection of the second infrared grating area 161 corresponding to the second coupling-out grating 16 is partially located in the first visible grating area 131 corresponding to the first coupling-in grating 13 (see FIG. 1 ). Fig.10 ).

[0129] Also exemplarily, the first coupling-in grating 13 and the first coupling-out grating 14 are both reflective diffraction gratings, and the second coupling-in grating 15 is a reflective diffraction grating, and the second coupling-out grating 16 is a transmissive diffraction grating, wherein the reflective diffraction gratings herein include but are not limited to surface relief gratings or volume holographic gratings, and the transmissive diffraction gratings include but are not limited to surface relief gratings or volume holographic gratings, etc.

[0130] In the third specific implementation of the first embodiment, as Figure 8 and Fig.10 As shown, the difference from the first specific embodiment is that the second coupling grating 15 is not in the same plane as the first coupling grating 14, and the second coupling grating 16 is in the same plane as the first coupling grating 13 and at least partially overlaps.

[0131] Among them, in the third specific implementation, the second coupling grating 15 and the first coupling grating 14 can be completely staggered, partially overlapped, or completely overlapped; to form a composite grating 12, the second coupling grating 16 and the first coupling grating 13 can be partially overlapped or completely overlapped when they are on the same plane, which can be determined according to actual needs.

[0132] Understandably, in the third specific embodiment, since only the second out-coupling grating 16 is coplanar with the first in-coupling grating 13, only when the second out-coupling grating 16 is coplanar with the first in-coupling grating 13 and partially overlaps, or is coplanar with the first in-coupling grating 13 and completely overlaps, the second out-coupling grating 16 and the first in-coupling grating 13 together form a composite grating 12. In short, the present specific embodiment may have a composite grating 12, and the second out-coupling grating 16 and the first in-coupling grating 13 together form the composite grating 12, and the first in-coupling grating 13 and the second out-coupling grating 16 are the first period grating 121 and the second period grating 122 of the composite grating 12, respectively.

[0133] For example, Figure 8 and Fig.10 As shown, the second coupling-in grating 15 is not in the same plane as the first coupling-out grating 14 and completely overlaps with it, and the second coupling-out grating 16 is in the same plane as the first coupling-in grating 13 and partially overlaps with it.

[0134] Specifically, in this example, Figure 8 and Fig.10 As shown, the first out-coupling grating 14, the second visible grating area 141 corresponding to the first out-coupling grating 14, the second in-coupling grating 15 and the first infrared grating area 151 corresponding to the second in-coupling grating 15 are all located in the first grating area 1131 of the viewing area 113 of the waveguide matrix 11 and are located directly in front of the eye 700; the second in-coupling grating 15 and the first out-coupling grating 14 are located on opposite sides of the waveguide matrix 11, and the first infrared grating area 151 corresponding to the second in-coupling grating 15 and the second visible grating area 141 corresponding to the first out-coupling grating 14 completely overlap.

[0135] The first coupling-in grating 13, the first visible grating area 131 corresponding to the first coupling-in grating 13, the second coupling-out grating 16 and the second infrared grating area 161 corresponding to the second coupling-out grating 16 are all located in the second grating area 1141 of the blind area 114 of the waveguide substrate 11. The second coupling-out grating 16 and the first coupling-in grating 13 are located on the same side of the waveguide substrate 11, and the projection of the second infrared grating area 161 corresponding to the second coupling-out grating 16 is partially located in the first visible grating area 131 corresponding to the first coupling-in grating 13 (see FIG. 1 ). Fig.11 ).

[0136] Also exemplarily, the first coupling-in grating 13 and the first coupling-out grating 14 are both reflective diffraction gratings, the second coupling-in grating 15 is a transmission diffraction grating, and the second coupling-out grating 16 is a reflective diffraction grating. The reflective diffraction gratings include but are not limited to surface relief gratings or volume holographic gratings, and the transmission diffraction gratings include but are not limited to surface relief gratings or volume holographic gratings.

[0137] In the first embodiment of the present invention, Figure 1 , Figure 7 and Figure 8 As shown, the imaging light group 2 includes an image source 21 and an image imaging unit 22. The image imaging unit 22 is mainly used to image the imaging light 500 emitted by the image source 21 and project the imaged imaging light 500 onto the first coupling grating 13 arranged on the waveguide substrate 11.

[0138] In addition, the image imaging unit 22 includes an image lens 221, wherein the image lens 221 is arranged on the light-emitting side of the image source 21 in the mounting cavity of the connecting portion 220 of the lens frame 200, corresponding to the blind area 114 of the waveguide matrix 11, that is, the image lens 221 is located between the image source 21 and the waveguide matrix 11. Preferably, in order to obtain a better image effect, the image lens 221 is perpendicular to the image source 21 and the waveguide matrix 11.

[0139] It should be noted that the image source 21 may be a chip such as a micro LED chip, an OLED chip, an LCOS chip, an SLM chip, etc. Specifically in this embodiment, the image source 21 is preferably a self-luminous chip, such as a micro LED chip.

[0140] In the first embodiment of the present invention, Figure 1 , Figure 7 and Figure 8 As shown, the pupil imaging device 32 of the eye tracking optical group 3 includes a pupil camera 321, wherein, in order to obtain a better eye movement effect, the pupil camera 321 is arranged side by side with the imaging optical group 2 on the side of the imaging optical group 2 of the frame 200, in the mounting cavity of the same connecting portion 220 of the frame 200. Preferably, the pupil camera 321 is arranged perpendicular to the corresponding waveguide matrix 11 corresponding to the blind area 114 of the waveguide matrix 11.

[0141] It should be noted that the pupil camera 321 can be one or more of various environmental detection cameras such as TOF (Time-Of-Flight) camera, RGB camera, etc. for achieving posture tracking and positioning, and is not particularly limited here.

[0142] Embodiment 2 of the near-eye display device 100 of the present invention

[0143] The main technical features of the second embodiment are substantially the same as those of the first embodiment. The main difference between the second embodiment and the first embodiment is that:

[0144] like Fig.11 As shown, the second coupling-in and coupling-out grating group further includes a third coupling-in grating 17 and a third coupling-out grating 18 disposed on the waveguide substrate 11, wherein the third coupling-in grating 17 is located on the same side or the opposite side of the first coupling-in grating 13; and the third coupling-out grating 18 is located on the same side or the opposite side of the first coupling-out grating 14. The third coupling-in grating 17 is mainly used to couple the infrared light 600 emitted by the light source 31 into the waveguide substrate 11; and the third coupling-out grating 18 is mainly used to couple the infrared light 600 transmitted by the waveguide substrate 11 out of the waveguide substrate 11 to be incident on the eye 700.

[0145] Understandably, in the second embodiment, the infrared light 600 emitted by the light source 31 of the eye tracking optical group 3 will propagate through the waveguide matrix 11 and then be projected to the eye 700, rather than being directly projected into the eye 700. In other words, the illumination optical path of the light source 31 is also integrated into the optical path of the waveguide matrix 11, and is projected to the eye 700 from the front of the eye 700 through the third outcoupling grating 18. Obviously, compared with the solution in which the light source 31 projects the infrared light 600 obliquely toward the eye 700, the infrared light 600 emitted by the light source 31 of the second embodiment has better illumination angle, illumination range and uniformity, which is conducive to the eye tracking optical group 3 using fewer light sources 31 and / or pupil imaging devices 32, and achieving the same or better eye tracking effect as the traditional solution, thereby further reducing the weight and volume of the smart glasses 1000, simplifying the arrangement of devices on the frame 200 near the eye, and reducing manufacturing costs.

[0146] In the second embodiment, the area corresponding to the third coupling-in grating 17 is called the third infrared grating area 171, which is located in the second grating area 1141 within the blind area 114 of the waveguide matrix 11; the area corresponding to the third coupling-out grating 18 is called the fourth infrared grating area 181, which is located in the first grating area 1131 within the viewing area 113 of the waveguide matrix 11.

[0147] Among them, when the third coupling grating 17 and the first coupling grating 13 are located on the same side of the same waveguide substrate 11, in the second grating area 1141 of the blind area 114, the area range of the third infrared grating area 171 corresponding to the third coupling grating 17 and the first visible grating area 131 corresponding to the first coupling grating 13 can be completely overlapped, partially overlapped, or completely staggered. Similarly, when the third coupling-out grating 18 and the first coupling-out grating 14 are located on the same side of the same waveguide substrate 11, in the first grating area 1131 of the viewing area 113, the area range of the fourth infrared grating area 181 corresponding to the third coupling-out grating 18 and the second visible grating area 141 corresponding to the first coupling-out grating 14 can be completely overlapped, partially overlapped, or completely staggered. In short, it is only necessary to ensure that the distribution area of ​​each grating and the coupling-out angle of the corresponding light can avoid optical path interference or shielding between the infrared light 600 and the imaging light 500.

[0148] It should be noted that if the third coupling grating 17 and the first coupling grating 13 are located on the same side of the same waveguide substrate 11, and the area range of the third infrared grating area 171 corresponding to the third coupling grating 17 partially overlaps or completely overlaps with the area range of the first visible grating area 131 corresponding to the first coupling grating 13, then the third coupling grating 17 and the first coupling grating 13 can also be combined to form a composite grating 12. If the third outcoupling grating 18 and the first outcoupling grating 14 are located on the same side of the same waveguide substrate 11, and the fourth infrared grating area 181 corresponding to the third outcoupling grating 18 partially overlaps or completely overlaps with the second visible grating area 141 corresponding to the first outcoupling grating 14, then the third outcoupling grating 18 and the first outcoupling grating 14 can also be combined to form a composite grating 12, so as to facilitate the infrared light 600 directly emitted by the light source 31 and the first grating carrying image information to be independently coupled into and / or coupled out of the waveguide substrate 11 in the same area of ​​the composite grating 12.

[0149] For example, Fig.11 As shown, compared with the working principle of the smart glasses 1000 of the first embodiment, the working principle of the smart glasses 1000 of the second embodiment mainly differs in that the light source 31 of the eye tracking light group 3 projects the infrared light 600 to the eye 700 in a different manner, as follows:

[0150] In the second embodiment, Fig.11 As shown, the light source 31 of the eye tracking optical group 3 projects infrared light 600 (specifically, infrared light) in the installation cavity toward the third coupling grating 17 arranged in the blind area 114 of the waveguide matrix 11. The third coupling grating 17 couples the infrared light 600 into the functional layer of the waveguide matrix 11, and propagates to the first grating area 1131 in the viewing area 113 of the waveguide matrix 11 at a specific incident angle through total reflection. The infrared light 600 is coupled out of the waveguide matrix 11 in front of the eye 700 through the third coupling grating 18 in the first grating area 1131, so that the infrared light 600 is finally projected directly from the front of the eye 700 to the eye 700.

[0151] Also illustratively, if Fig.11 As shown, taking the first specific implementation based on the first embodiment as an example, the third coupling-in grating 17 is on the opposite side of the first coupling-in grating 13 , and the third coupling-out grating 18 is on the opposite side of the first coupling-out grating 14 .

[0152] Specifically, if Fig.11 and Fig.12As shown, the third coupling grating 17, the third infrared grating area 171 corresponding to the third coupling grating 17, the second coupling grating 16, the second infrared grating area 161 corresponding to the second coupling grating 16, the first coupling grating 13, and the first visible grating area 131 corresponding to the first coupling grating 13 are all located in the second grating area 1141 of the blind area 114 of the waveguide substrate 11, wherein the light source 31 of the eye tracking optical group 3 and the imaging optical group 2 are located on the same side of the waveguide substrate 11, the third coupling grating 17 is located on the opposite side of the first coupling grating 13 and the second coupling grating 16, and the third infrared grating area 171 corresponding to the third coupling grating 17 is completely staggered with the second infrared grating area 161 corresponding to the second coupling grating 16 (see FIG. Fig.12 ).

[0153] The third out-coupling grating 18, the fourth infrared grating area 181 corresponding to the third out-coupling grating 18, the second in-coupling grating 15, the first infrared grating area 151 corresponding to the second in-coupling grating 15, the first out-coupling grating 14, and the second visible grating area 141 corresponding to the first out-coupling grating 14 are all located in the first grating area 1131 of the viewing area 113 of the waveguide substrate 11, wherein the third out-coupling grating 18 is located on the opposite side of the first out-coupling grating 14 and the second in-coupling grating 15, and the fourth infrared grating area 181 corresponding to the third out-coupling grating 18 is completely staggered with the first infrared grating area 151 corresponding to the second in-coupling grating 15 (see FIG. Fig.12 ).

[0154] In the second embodiment, the first coupling-in grating 13 and the first coupling-out grating 14 are reflective diffraction gratings. In addition, when the second coupling-in grating 15 is on the same side as the first coupling-out grating 14, the second coupling-in grating 15 is a reflective diffraction grating; or, when the second coupling-in grating 15 is on the opposite side to the first coupling-out grating 14, the second coupling-in grating 15 is a transmissive diffraction grating.

[0155] When the second outcoupling grating 16 is on the same side as the first incoupling grating 13, the second outcoupling grating 16 is a reflective diffraction grating; or, when the second outcoupling grating 16 is on the opposite side to the first incoupling grating 13, the second outcoupling grating 16 is a transmissive diffraction grating.

[0156] When the third coupling grating 17 is on the same side as the first coupling grating 13, the third coupling grating 17 is a reflective diffraction grating; or, when the third coupling grating 17 is on the opposite side to the first coupling grating 13, the third coupling grating 17 is a transmissive diffraction grating.

[0157] When the third outcoupling grating 18 is on the same side as the first outcoupling grating 14, the third outcoupling grating 18 is a reflective diffraction grating; or, when the third outcoupling grating 18 is on the opposite side to the first outcoupling grating 14, the third outcoupling grating 18 is a transmissive diffraction grating.

[0158] Exemplarily, in the first specific implementation of the second embodiment, the first coupling-in grating 13 and the first coupling-out grating 14 are both reflective diffraction gratings, wherein the reflective diffraction gratings include but are not limited to surface relief gratings or volume holographic gratings, etc. The second coupling-in grating 15, the second coupling-out grating 16, the third coupling-in grating 17, and the third coupling-out grating 18 are all transmission-type diffraction gratings, wherein the transmission-type diffraction gratings include but are not limited to surface relief gratings or volume holographic gratings, etc.

[0159] It should be noted that in the second specific implementation of the second embodiment, the light source 31 of the eye tracking light group 3 and the imaging light group 2 can also be located on opposite sides of the waveguide substrate 11. The working principle of the second specific implementation is the same as that of the first specific implementation, and will not be repeated here.

[0160] Embodiment 3 of the near-eye display device 100 of the present invention

[0161] The main technical features of the third embodiment are substantially the same as those of the first and second embodiments, and the main difference lies in the specific structure of the imaging light group 2, which is as follows:

[0162] like Fig.13 As shown, in order to further simplify the structure of the smart glasses 1000 to reduce its volume and weight, the image imaging unit 22 of the imaging light group 2 includes at least one metasurface lens 222, wherein the metasurface lens 222 is arranged on the light output side of the image source 21.

[0163] It can be understood that in this fourth embodiment, one or more metasurface lenses 222, or a combination of an ordinary lens and at least one metasurface lens 222, are mainly used to replace the image lens 221 of the image imaging unit 22 in the above-mentioned first and second embodiments, so as to further reduce the volume and weight of the smart glasses 1000, which is conducive to further improving the wearing comfort of the user.

[0164] Embodiment 4 of the near-eye display device 100 of the present invention

[0165] The main technical features of the fourth embodiment are substantially the same as those of the first, second and third embodiments described above, and the main difference lies in the different structures and arrangements of the pupil imaging device 32 of the eye tracking optical group 3, as follows:

[0166] like Figures 14 to 17As shown, in the fourth embodiment, in order to further simplify the arrangement of devices near the eye of the frame 200 of the smart glasses 1000, that is, on the eye socket 210, the pupil imaging device 32 of the eye tracking optical group 3 includes a dichroic mirror 322 and a pupil photosensitive element 323, wherein, at a position corresponding to the blind spot 114 of the waveguide matrix 11, the imaging light 500 emitted by the image source 21 of the imaging light group 2 is transmitted through the dichroic mirror 322 into the image imaging unit 22 of the imaging light group 2; the infrared light 600 is coupled out of the waveguide matrix 11 through the second coupling grating 16, and then sequentially enters the image imaging unit 22 and the dichroic mirror 322, and reaches the pupil photosensitive element 323 after being reflected by the dichroic mirror 322.

[0167] It can be understood that in this fourth embodiment, the pupil imaging device 32 of the eye tracking optical group 3 is merged into the imaging optical group 2. Specifically, the image lens 221 of the pupil imaging device 32 is replaced by a dichroic mirror 322 and a pupil photosensitive element 323, and the dichroic mirror 322 and the pupil photosensitive element 323 are arranged between the image source 21 and the image imaging unit 22 of the imaging optical group 2 to integrate the pupil imaging functional parts of the pupil imaging device 32 into the imaging optical group 2, so as to reduce the number of pupil cameras 321 of the eye tracking optical group 3 and simplify the arrangement of devices on the eye socket 210.

[0168] For example, Fig.14 and Fig.15 As shown, compared with the working principles of the smart glasses 1000 in the above-mentioned first, second and third embodiments, the working principles of the smart glasses 1000 in the fourth embodiment are mainly different in that the way and path of the imaging light 500 emitted by the image source 21 projecting to the first coupling grating 13, and the way and path of the pupil imaging device 32 of the eye tracking optical group 3 receiving the infrared light 600 with pupil information are different, as follows:

[0169] The imaging light 500 (specifically visible light) with virtual image information emitted by the image source 21 needs to first penetrate the dichroic mirror 322, and then pass through the image imaging unit 22 of the imaging light group 2 to enter the second grating area 1141 in the blind area 114 of the waveguide matrix 11, and then be coupled in by the first coupling grating 13, propagated by total reflection of the functional layer of the waveguide matrix 11, and coupled out of the waveguide matrix 11 by the first coupling grating 14, and finally achieve eye 700 imaging.

[0170] In addition, the infrared light 600 carrying pupil information reflected by the eye 700 is sequentially coupled by the second coupling grating 15, propagated by total reflection of the functional layer of the waveguide matrix 11, coupled out of the waveguide matrix 11 by the second coupling grating 16, and then incident on the dichroic mirror 322 through the image imaging unit 22 of the imaging light group 2, and is reflected by the dichroic mirror 322 to the pupil photosensitive element 323 for imaging.

[0171] It should be noted that, in the imaging light group 2, since the light-outgoing path of the imaging light 500 is partially identical to the light-incoming path of the infrared light 600, in order to ensure the compactness of the structure of the smart glasses 1000 and to reduce the overall weight and volume, in the blind area 114 of the waveguide substrate 11, the first visible grating area 131 corresponding to the first coupling grating 13 and the second infrared grating area 161 corresponding to the second coupling grating 16 at least partially overlap.

[0172] Specifically, in the first specific implementation, if Fig.14 and Fig.16 As shown, the projection of the second outcoupling grating 16 is completely located in the first visible grating area 131 corresponding to the first coupling grating 13 , and the area of ​​the second infrared grating area 161 corresponding to the second outcoupling grating 16 is smaller than the area of ​​the first visible grating area 131 corresponding to the first coupling grating 13 .

[0173] Alternatively, in a second specific embodiment, Fig.15 and Fig.17 As shown, the first visible light grating region 131 corresponding to the first coupling-in grating 13 and the second infrared light grating region 161 corresponding to the second coupling-out grating 16 completely overlap.

[0174] It should also be noted that the pupil photosensitive element 323 can well image light in the 400nm-1200nm band. Preferably, the pupil photosensitive element 323 can be a CMOS or a CCD. In addition, the dichroic mirror 322 has been specially coated, and Fig.14 and Fig.15 As shown, specifically in the fourth embodiment, the dichroic mirror 322 is placed at 45° between the light emitting surface of the image source 21 of the imaging light group 2 and the image forming unit 22 .

[0175] Embodiment 5 of the near-eye display device 100 of the present invention

[0176] The main technical features of the fifth embodiment are substantially the same as those of the first, second, third and fourth embodiments, and the main difference is that the structure of the waveguide matrix 11 is different. Correspondingly, the propagation optical path of the infrared light 600 carrying pupil information in the waveguide matrix 11 is different, as follows:

[0177] like Fig.18 and Fig.19 As shown, in the fifth embodiment, the waveguide substrate 11 is a multi-layer wave plate, wherein the first coupling-in coupling-out grating group is located between two adjacent layers of wave plates. It should be noted that the fifth embodiment has the same effect as the first embodiment, except that the overall volume of the smart glasses 1000 is slightly increased, but the technical difficulty is reduced.

[0178] In addition, in order to form the composite grating 12 on the waveguide substrate 11 and further reduce the volume and weight of the smart glasses 1000, illustratively, as Fig.18 As shown, the second coupling-incoupling-outcoupling grating group is also located between two adjacent wave plates, and is arranged with at least one grating corresponding to the first coupling-incoupling-outcoupling grating group being coplanar and partially overlapping.

[0179] Preferably, if Fig.18 As shown, when the waveguide matrix 11 is a multi-layer wave plate, the waveguide matrix 11 includes a first waveguide layer 111 and a second waveguide layer 112, and the second waveguide layer 112 is stacked on the first waveguide layer 111 along the thickness direction. The first coupling grating 13 and the first coupling grating 14 are arranged on a side of the first waveguide layer 111 facing the second waveguide layer 112, that is, they are located between the first waveguide layer 111 and the second waveguide layer 112. The second coupling grating 15 is coplanar with the first coupling grating 14 and at least partially overlaps, and / or the second coupling grating 16 is coplanar with the first coupling grating 13 and at least partially overlaps.

[0180] It can be understood that the second coupling-in grating 15 and the second coupling-out grating 16 are both disposed between the first waveguide layer 111 and the second waveguide layer 112 , that is, on the same plane as the first coupling-out grating 14 and the first coupling-in grating 13 , respectively.

[0181] For example, Fig.18 As shown, between the first waveguide layer 111 and the second waveguide layer 112 , the first coupling grating 13 and the second coupling grating 16 are coplanar but completely offset, and the first coupling grating 14 and the second coupling grating 15 are coplanar and completely overlapped to form another composite grating 12 .

[0182] Understandably, if Fig.18 and Fig.19 As shown, the first coupling-in grating 13, the first visible grating area 131 corresponding to the first coupling-in grating 13, the second coupling-out grating 16, and the second infrared grating area 161 corresponding to the second coupling-out grating 16 are all located in the second grating area 1141 of the blind area 114, and the first visible grating area 131 and the second infrared grating area 161 are completely staggered; the first coupling-out grating 14, the second visible grating area 141 corresponding to the first coupling-out grating 14, the second coupling-in grating 15, and the first infrared grating area 151 corresponding to the second coupling-in grating 15 are all located in the first grating area 1131 of the viewing area 113.

[0183] Of course, in other cases, the first coupling grating 13 and the second coupling grating 16 can also be in the same plane and at least partially overlap to form a composite grating 12, and the first coupling grating 14 and the second coupling grating 15 can be in the same plane and completely overlap or partially overlap to form another composite grating 12.

[0184] In summary, it can be understood that in order to achieve lightweight smart glasses 1000 on the basis of having an eye tracking function, smart glasses 1000 can replace and use at least two combinations of the above-mentioned embodiments one, two, three, four, five and the prior art, for example, different distribution area settings of the grating, different illumination modes of the light source 31 of the eye tracking light group 3, a two-in-one design of the pupil imaging device 32 of the eye tracking light group 3 and the imaging light group 2, a metasurface lens 222 replacing the image lens 221, a multi-layer wave plate replacing a single-layer wave plate, etc.

[0185] Based on the above-mentioned near-eye display device 100, as Fig. 20 and Fig.21 As shown, an embodiment of the utility model further provides a smart glasses 1000, which include a frame 200 and the above-mentioned near-eye display device 100, wherein the frame 200 includes an eye socket 210 and a connecting portion 220, and the eye socket 210 is embedded with an optical waveguide group 1 of the near-eye display device 100; the connecting portion 220 is arranged on one side of the eye socket 210 in the pupil distance direction.

[0186] For example, Fig. 20 and Fig.21 As shown, the frame 200 includes two eye sockets 210, one is a left eye socket 210, and the other is a right eye socket 210. The middle parts of the left eye socket 210 and the right eye socket 210 are both provided with frame holes 211, wherein the left eye socket 210 is embedded with an optical waveguide group 1 at a position corresponding to the frame hole 211, and a connecting portion 220 is provided on the left side of the left eye socket 210; the right eye socket 210 is also embedded with an optical waveguide group 1 at a position corresponding to the frame hole 211, and a connecting portion 220 is also provided on the right side of the right eye socket 210, so that the two connecting portions 220 are respectively located on the left and right sides of the frame 200 in the pupil distance direction.

[0187] It should be noted that if Fig. 20 As shown, the smart glasses 1000 further include a diopter 410 and a rubber ring 420. For example, the diopter 410 is stacked with the optical waveguide group 1 along its thickness direction to form a composite lens 400 with corresponding functions, so that through the combination of the optical waveguide group 1 and different types of diopter 410, a composite pair of glasses with the function of solving corresponding visual problems such as myopia, hyperopia, astigmatism, presbyopia, etc. is formed, so as to expand the user group of the smart glasses 1000. In addition, the rubber ring 420 is arranged at the embedding position of the lens 400 and the eye socket 210 to improve the stability of the lens 400 installation, reduce the friction between the lens 400 and the eye socket 210, and prevent impurities from entering the gap between the lens 400 and the eye socket 210 to interfere with vision and make it inconvenient to clean the lens 400.

[0188] In addition, based on the integrated structure of eye tracking and virtual display hardware, in order to achieve a lightweight design, each connecting portion 220 of the frame 200 is formed with an installation cavity (not shown), wherein the imaging light group 2 and the eye tracking light group 3 of the near-eye display device 100 are both installed in the installation cavity. In this way, the smart glasses 1000 are arranged on the imaging light group 2 side of the frame 200, that is, on the left and right sides of the frame 200, instead of at the eye socket 210, which is conducive to greatly reducing the thickness and weight of the eye socket 210, improving the wearing comfort of the user, and also conveniently greatly reducing the difficulty of arranging components at the eye socket 210.

[0189] Of course, in actual applications, various electronic components such as flexible circuit boards, speakers, microphones, batteries, antennas, etc. can also be placed in the installation cavity to realize the corresponding functions of the smart reality glasses. In the embodiment of the utility model, the specific electronic components built into the installation cavity and the installation details of the electronic components are not particularly limited here.

[0190] Understandably, in the embodiments of the present invention, Fig. 20 and Fig.21 As shown, each eye 700 corresponds to an eye socket 210 , a connecting portion 220 , a waveguide matrix 11 , an imaging optical group 2 and an eye tracking optical group 3 .

[0191] In summary, compared with the prior art, the smart glasses 1000 have at least the following beneficial effects: the smart glasses 1000 adopt the above-mentioned near-eye display device 100, and by arranging the imaging light group 2 and the eye tracking light group 3 in the mounting cavity of the connecting portion 220 of the frame 200, the eye tracking light group 3 is gathered to the imaging light group 2 side of the frame 200, so that it is located at the periphery of the near-eye part of the frame 200, thereby reducing the volume and weight of the near-eye part of the frame 200, which is conducive to realizing the lightweight design of the smart glasses 1000 and improving the user's usage experience. It not only has the eye tracking function, but also can meet the user's long-term wearing requirements.

[0192] In some embodiments of the present invention, Fig.21 As shown, the smart glasses 1000 further include temples 300, wherein, in a specific embodiment, the temples 300 are connected to the eye sockets 210 via the connecting portion 220. Exemplarily, the temples 300 and the connecting portion 220 may be integrally formed, or the temples 300 and the connecting portion 220 may be pivotally connected via a pivoting structure, so that the temples 300 can be folded to facilitate the storage of the smart glasses 1000.

[0193] Alternatively, in another specific embodiment, the smart glasses 1000 further include a strap (not shown) that can be tied to the head, wherein one end of the strap is connected to a connecting portion 220 of the frame 200, and the other end is connected to another connecting portion 220 of the frame 200. Specifically, the strap may preferably be an elastic or bendable strip-shaped strap.

[0194] For example, the left end of the belt is connected to the connection part 220 at the left end of the frame 200, and the right end of the belt is connected to the connection part 220 at the right end of the frame 200. In addition, for easy wearing, the middle section of the belt is detachable, that is, the belt includes two small strips of straps, wherein the two strips of straps can be detachably connected by Velcro, or connected by a buckle pin and a buttonhole, etc. Of course, the middle section of the belt can also be non-detachable, that is, the belt is a whole strip of straps.

[0195] It should be noted that the temple 300 and the frame 200 may be made of materials including but not limited to pure metal, alloy, plastic or resin, and the structure of the temple 300 may not be limited to Fig.21 The structure of the diagram.

[0196] The above description is only a preferred embodiment of the utility model and is not intended to limit the utility model. For those skilled in the art, the utility model may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the utility model shall be included in the scope of the claims of the utility model.

Claims

1. A near-eye display device, characterized in that: The near-eye display device comprises: An optical waveguide group, comprising a waveguide substrate and a first coupling-in-coupling-out grating group and a second coupling-in-coupling-out grating group arranged on the waveguide substrate, wherein the first coupling-in-coupling-out grating group is configured to couple imaging light into and out of the waveguide substrate; and the second coupling-in-coupling-out grating group is configured to couple infrared light into and out of the waveguide substrate; Wherein, at least some of the gratings in the first in-coupling / out-coupling grating group and the second in-coupling / out-coupling grating group are located on the same side of the waveguide substrate, and the gratings located on the same side of the waveguide substrate at least partially overlap; On the same side of the waveguide substrate, the gratings in the first coupling-incoupling-outcoupling grating group that have overlapping positions are called first period gratings, and the gratings in the second coupling-incoupling-outcoupling grating group that overlap with the first period grating are called second period gratings; the combination of the first period grating and the corresponding second period grating is called a composite grating; The first periodic grating and the second periodic grating both include a substrate and a plurality of microstructure units periodically arranged along a one-dimensional direction or a two-dimensional direction, and the microstructure units of the first periodic grating and the microstructure units of the second periodic grating are alternately arranged on a projection surface of the substrate, so that imaging light and infrared light are independently coupled in or out through the first periodic grating and the second periodic grating at the same side and in the same area of ​​the waveguide matrix.

2. The near-eye display device according to claim 1, characterized in that: The microstructure unit of the first periodic grating is called a first microstructure unit, and the first periodic grating includes N first microstructure units, and the N first microstructure units are arranged in a horizontal and / or vertical array; In the first periodic grating, the length of the connecting line between the centers of two first microstructure units adjacent to each other in the transverse direction is the first transverse period length, and the length of the connecting line between the centers of two first microstructure units adjacent to each other in the longitudinal direction is the first longitudinal period length; the angle between the connecting line between the centers of two first microstructure units adjacent to each other in the transverse direction and the connecting line between the centers of two first microstructure units adjacent to each other in the longitudinal direction is the first periodic unit internal angle, and the first periodic unit internal angle is 90° to 150°; The microstructure unit of the second periodic grating is called a second microstructure unit; the second periodic grating includes M second microstructure units; the M second microstructure units are arranged in a horizontal and / or vertical array; In the second periodic grating, the length of the connecting line of the centers of two transversely adjacent second microstructure units is the second transverse period length, and the length of the connecting line of the centers of two longitudinally adjacent second microstructure units is the second longitudinal period length; the angle between the connecting line of the centers of two transversely adjacent second microstructure units and the connecting line of the centers of two longitudinally adjacent second microstructure units is the second periodic unit internal angle, and the second periodic unit internal angle is 90° to 150°; In the composite grating, the substrate of the overlapping parts of the first period grating and the second period grating is common.

3. The near-eye display device according to claim 2, characterized in that: In the composite grating, the first microstructure units of the first periodic grating and the second microstructure units of the second periodic grating are alternately arranged at intervals on the projection surface of the substrate; Alternatively, the first microstructure units and the second microstructure units are alternately arranged on the projection surface of the substrate, and in the height direction of the substrate, at least part of the first microstructure units are highly overlapped with the corresponding second microstructure units.

4. The near-eye display device according to claim 3, characterized in that: The total height H(x) of the microstructure unit at position x in the composite grating satisfies the shape condition constraint of the following formula 1, which is specifically as follows: H(x)=G1((x)+G2(x) Wherein, G1(x) represents the height of the first microstructure unit at x; G2(x) represents the height of the second microstructure unit at x; and G1(x) and G2(x) satisfy the following formula 2 and formula 3 respectively: Wherein, in the formula 2, h1 represents the height of the first microstructure unit, x1 represents the lateral offset distance of the first microstructure unit, and P1 represents the period of the first periodic grating; in the formula 3, h2 represents the height of the second microstructure unit, x2 represents the lateral offset distance of the second microstructure unit, and P2 represents the period of the second periodic grating; In the composite grating, the diffraction angle of the imaging light is greater than the critical angle of total reflection of the waveguide matrix, and the incident angle of the infrared light is greater than the critical angle of total reflection of the waveguide matrix; the first period grating and the second period grating both satisfy the following formula 4: P(sini±sinθ)=mλ Wherein, in Formula 4, P represents the grating period, i represents the incident angle of the corresponding light; ± represents different diffraction spectrum types, and when the incident light and the diffracted light are on the same side of the corresponding grating normal, a positive sign is taken; when they are on opposite sides, a negative sign is taken; θ represents the diffraction angle of the corresponding light, m ​​represents the diffraction order, and λ represents the wavelength of the incident light of the corresponding light.

5. The near-eye display device according to claim 2, characterized in that: The first transverse period length is 150nm-2um, and the first longitudinal period length is 150nm-2um.

6. The near-eye display device according to claim 2, characterized in that: The side length of the first microstructure unit is 150nm-2um, and the height is 10nm-2um.

7. The near-eye display device according to claim 2, characterized in that: The second transverse period length, the second longitudinal period length and the second period unit inner angle of the second period grating are respectively the same as the first transverse period length, the first longitudinal period length and the first period unit inner angle.

8. The near-eye display device according to claim 1, characterized in that: The thickness of the first periodic grating and the second periodic grating is 10 nm to 2 um.

9. The near-eye display device according to any one of claims 1 to 8, characterized in that: The near-eye display device further comprises an imaging light group and an eye-tracking light group arranged on the same peripheral side of the eye, wherein the imaging light group is configured to emit imaging light with image information, and the eye-tracking light group is configured to emit infrared light and receive infrared light with pupil information; the eye-tracking light group comprises a light source and a pupil imaging device, wherein the light source is used to emit infrared light to the eye; The first coupling-in and coupling-out grating group comprises a first coupling-in grating and a first coupling-out grating located on the same side of the waveguide substrate, and the first coupling-out grating is located directly in front of the eye; The second coupling-in and coupling-out grating group includes a second coupling-in grating and a second coupling-out grating, the second coupling-in grating is used to couple the infrared light reflected from the eye to the waveguide matrix for transmission, and the second coupling-out grating is used to couple the infrared light transmitted by the waveguide matrix out of the waveguide matrix; the pupil imaging device is used to receive the infrared light emitted from the waveguide matrix and carrying pupil information.

10. The near-eye display device according to claim 9, characterized in that: The second coupling-in grating is located in front of the eye; the second coupling-in grating is not in the same plane as the first coupling-out grating, and the second coupling-out grating is in the same plane as the first coupling-in grating and at least partially overlaps with the first coupling-in grating; Alternatively, the second coupling-in grating is in the same plane as the first coupling-out grating and at least partially overlaps with the first coupling-out grating, and the second coupling-out grating is in the same plane as or out of the same plane as the first coupling-in grating.

11. The near-eye display device according to claim 10, characterized in that: The second coupling-in grating is coplanar with the first coupling-out grating and completely overlaps with it, and the second coupling-out grating is coplanar with the first coupling-in grating and at least partially overlaps with it.

12. The near-eye display device according to claim 10, characterized in that: The light source emits the infrared light directly toward the eyes; Alternatively, the second coupling-in coupling-out grating group further comprises a third coupling-in grating and a third coupling-out grating arranged on the waveguide substrate, the third coupling-in grating is located on the same side or the opposite side of the first coupling-in grating; the third coupling-out grating is located on the same side or the opposite side of the first coupling-out grating; The third coupling-in grating is used to couple the infrared light emitted by the light source into the waveguide matrix; the third coupling-out grating is used to couple the infrared light transmitted by the waveguide matrix out of the waveguide matrix so as to be incident on the eye.

13. The near-eye display device according to claim 12, characterized in that: The imaging light group includes an image source and an image imaging unit, and the image imaging unit is used to image the imaging light emitted by the image source and make the imaged imaging light reach the first coupling grating; The image forming unit comprises an image lens, and the image lens is arranged on the light emitting side of the image source; Alternatively, the image imaging unit includes at least one metasurface lens, and the metasurface lens is arranged on the light output side of the image source.

14. The near-eye display device according to claim 13, characterized in that: The pupil imaging device comprises a pupil camera, and the pupil camera is arranged side by side with the imaging light group; Alternatively, the pupil imaging device comprises a dichroic mirror and a pupil photosensitive element, and the imaging light emitted by the image source is linearly transmitted through the dichroic mirror into the image imaging unit; The infrared light is coupled out of the waveguide matrix through the second outcoupling grating and then incident on the image imaging unit and the dichroic mirror in sequence, and reaches the pupil photosensitive element after being reflected by the dichroic mirror.

15. The near-eye display device according to claim 9, characterized in that: The waveguide substrate is a single-layer wave plate; Alternatively, the waveguide matrix is ​​a multi-layer wave plate, and the first coupling-incoupling-outcoupling grating group is located between two adjacent waveguide matrices.

16. The near-eye display device according to claim 15, characterized in that: When the waveguide matrix is ​​a multi-layer wave plate, the waveguide matrix includes a first layer of waveguide and a second layer of waveguide stacked on the first layer of waveguide, the first coupling-in grating and the first coupling-out grating are arranged on a side of the first layer of waveguide facing the second layer of waveguide; the second coupling-in grating is coplanar with the first coupling-out grating and at least partially overlaps with it, and / or the second coupling-out grating is coplanar with the first coupling-in grating and at least partially overlaps with it.

17. The near-eye display device according to claim 1, characterized in that: The thickness of the waveguide substrate is 0.2 mm to 10 mm.

18. A pair of smart glasses, characterized in that: The smart glasses include a frame and a near-eye display device according to any one of claims 1 to 17; The eyeglass frame comprises an eye socket and a connecting portion, wherein the eye socket is embedded with an optical waveguide group of the near-eye display device; the connecting portion is arranged on one side of the eye socket in the pupil distance direction and forms an installation cavity for installing an imaging optical group and an eye tracking optical group of the near-eye display device.

19. The smart glasses according to claim 18, characterized in that: The smart glasses also include temples, which are connected to the eye sockets through the connecting parts; Alternatively, the smart glasses further include a strap that can be tied to the head, one end of the strap is connected to one of the connecting parts of the frame, and the other end of the strap is connected to another connecting part of the frame.

20. The smart glasses according to claim 19, characterized in that: The temples and the connecting portion are integrally formed; or, the temples and the connecting portion are pivotally connected.

Images