Intelligent glasses

Abstract

The utility model belongs to the technical field of intelligent glasses, and relates to intelligent glasses, which comprise a glasses frame, a display imaging device and an eye movement tracking device, the glasses frame comprises eye sockets and a connecting part, the connecting part is arranged on one side of the eye sockets in the interpupillary distance direction, and an accommodating cavity is formed; the display imaging device comprises a lens and an imaging light group which is arranged in the accommodating cavity and emits imaging light with image information. The lens comprises an optical waveguide sheet, a first coupling-in coupling-out grating group and a second coupling-in coupling-out grating group, wherein the first coupling-in coupling-out grating group and the second coupling-in coupling-out grating group are arranged on the optical waveguide sheet. The eye movement tracking device comprises a luminous source and a pupil imaging device which are arranged in the accommodating cavity; and the second coupling-in and coupling-out grating group is used for coupling the infrared light or the infrared light reflected by the eye into and out of the optical waveguide sheet, so that the eye movement tracking device and the display imaging device at least share the optical waveguide sheet for transmission, and the infrared light with eye information is finally transmitted to the pupil imaging device. The intelligent glasses not only have an eye movement tracking function, but also realize lightweight design.

Description

Technical Field

[0001] The utility model relates to the technical field of smart glasses, in particular to a pair of smart glasses. Background Art

[0002] Smart glasses are wearable eyewear devices that have an independent operating system like a smartphone and can realize various functions through software installation. Taking augmented reality glasses as an example, augmented reality (AR) glasses are mainly used to collect real-world information in real time through the eyes, and project virtual information, images and other virtual reality content into the eyes to combine with real-world information to provide users with an immersive experience. Eye tracking technology is a technology that obtains and analyzes eye position and gaze points by tracking human eye movements. It has been widely used in interpersonal interaction, user interface design and other fields. Today, AR glasses integrated with eye tracking technology are expected to become a new generation of human-computer information interaction terminals after personal computers and smartphones, and have broad application prospects.

[0003] However, existing AR glasses capable of eye tracking are large in size and heavy in weight, which greatly affects the wearing comfort of users. For example:

[0004] First, compared with ordinary refractive glasses and sunglasses, ordinary AR glasses have additional optical and electronic components. AR glasses are obviously heavier as a whole, and long-term wearing can easily cause fatigue. The added components will also take up a certain volume, which can easily cause discomfort due to excessive contact between the glasses and the face when worn, and can also easily block the user's field of vision.

[0005] Secondly, at present, several mainstream types of eye tracking technology, such as pupil corneal reflection method, retinal imaging method, structured light modeling eye structure method, retinal reflected light intensity determination eye movement direction method, corneal reflected light intensity determination eye movement direction method, etc., all use structures that need to include infrared light sources and infrared cameras, among which the infrared light source is mainly used to illuminate the eyes, and obtains reflected light images containing real-world information through eye reflection; infrared cameras are mainly used to capture eye images reflected by the eyes through different optical paths. Because the main visual area of ​​the eye is mainly used for virtual display imaging, it is generally impossible to configure the infrared camera directly in front of the human eye. Therefore, in order to realize the eye tracking function in AR glasses, multiple infrared cameras are generally set on the side of the eye of a single eye to synthesize and capture eye movements at different angles, but setting an infrared light source and multiple infrared cameras on the eye socket will obviously increase the thickness and weight of the eye socket of AR glasses, greatly reducing the user's wearing comfort.

[0006] Therefore, there is an urgent need for a lightweight AR glasses with eye tracking function. Utility Model Content

[0007] The purpose of the embodiments of the utility model is to solve the technical problem that the existing smart glasses with eye tracking function are large in size and heavy in weight, resulting in poor wearing comfort for users.

[0008] In order to solve the above technical problems, the present utility model provides a smart glasses, which adopts the following technical solutions:

[0009] The smart glasses include:

[0010] The frame comprises an eye socket and a connecting portion, wherein the connecting portion is arranged at one side of the eye socket in the pupil distance direction and is formed with a receiving cavity;

[0011] The display imaging device comprises a lens embedded in the eye socket and an imaging light group arranged in the accommodating cavity and emitting imaging light with image information, wherein the lens comprises an optical waveguide and a first coupling-in-coupling-out grating group arranged on the optical waveguide; the first coupling-in-coupling-out grating group is used to couple the imaging light into and out of the optical waveguide;

[0012] An eye tracking device, comprising a light source and a pupil imaging device arranged in the accommodating cavity; the light source is used to emit infrared light;

[0013] Among them, the lens also includes a second coupling-in coupling-out grating group arranged on the optical waveguide plate, and the second coupling-in coupling-out grating group is used to couple the infrared light or the infrared light reflected by the eye into and out of the optical waveguide plate, so that the eye tracking device and the display imaging device at least share the optical waveguide plate for transmission, and finally transmit the infrared light carrying eye information to the pupil imaging device.

[0014] In a preferred solution of some embodiments of the utility model, the first coupling-in coupling-out grating group includes a first coupling-in grating and a first coupling-out grating located on the same side of the optical waveguide plate;

[0015] The second coupling-in coupling-out grating group comprises a second coupling-in grating and a second coupling-out grating, and the second coupling-in grating and the first coupling-out grating are both located directly in front of the eye;

[0016] The second coupling grating is used to couple the infrared light with eye information reflected by the eye to the optical waveguide for transmission;

[0017] The second outcoupling grating is used to couple the infrared light transmitted by the optical waveguide plate out of the optical waveguide plate for reception by the pupil imaging device.

[0018] In a preferred solution of some embodiments of the utility model, the light source emits the infrared light directly toward the eye;

[0019] Alternatively, the second coupling-in coupling-out grating group further includes a third coupling-in grating and a third coupling-out grating arranged on the optical waveguide plate, wherein the third coupling-in grating is located on the same side or the opposite side of the first coupling-in grating; and the third coupling-out grating is located on the same side or the opposite side of the first coupling-out grating;

[0020] The third coupling-in grating is used to couple the infrared light emitted by the light source into the optical waveguide plate; the third coupling-out grating is used to couple the infrared light transmitted by the optical waveguide plate out of the optical waveguide plate to be incident on the eye.

[0021] In a preferred solution of some embodiments of the present invention, the second coupling-in grating is located on the opposite side of the first coupling-out grating; the second coupling-out grating is located on the opposite side of the first coupling-in grating.

[0022] Alternatively, the second coupling-in grating is located at an opposite side of the first coupling-out grating; the second coupling-out grating is located at the same side of the first coupling-in grating.

[0023] Alternatively, the second coupling-in grating is located on the same side as the first coupling-out grating; the second coupling-out grating is located on the same side as the first coupling-in grating.

[0024] In a preferred solution of some embodiments of the utility model, the first coupling-in grating and the first coupling-out grating are reflective diffraction gratings;

[0025] When on the same side as the first coupling-in grating, the second coupling-out grating is a reflective diffraction grating, and the third coupling-in grating is a reflective diffraction grating;

[0026] When on the opposite side to the first coupling-in grating, the second coupling-out grating is a transmission-type diffraction grating, and the third coupling-in grating is a transmission-type diffraction grating;

[0027] When on the same side as the first out-coupling grating, the second in-coupling grating is a reflective diffraction grating, and the third out-coupling grating is a reflective diffraction grating;

[0028] When located on the opposite side to the first out-coupling grating, the second in-coupling grating is a transmission-type diffraction grating, and the third out-coupling grating is a transmission-type diffraction grating.

[0029] In a preferred solution of some embodiments of the utility model, the imaging light group includes an image source and an image imaging unit, and the image imaging unit is used to perform virtual imaging on the imaging light emitted by the image source, and make the imaging light with virtual image information reach the first coupling grating;

[0030] The image forming unit comprises an image lens, and the image lens is arranged on the light exiting side of the image source;

[0031] Alternatively, the image imaging unit includes at least one metasurface lens, and the metasurface lens is arranged on the light output side of the image source.

[0032] In a preferred solution of some embodiments of the utility model, the pupil imaging device includes a pupil camera, and the pupil camera and the imaging light group are arranged side by side;

[0033] Alternatively, the pupil imaging device includes a dichroic mirror and a pupil photosensitive element, the imaging light emitted by the image source is linearly transmitted through the dichroic mirror into the image imaging unit; the infrared light is coupled out of the optical waveguide plate through the second out-coupling grating and then sequentially incident on the image imaging unit and the dichroic mirror, and reaches the pupil photosensitive element after being reflected by the dichroic mirror.

[0034] In a preferred solution of some embodiments of the utility model, the optical waveguide plate is a single-layer wave plate;

[0035] Alternatively, the optical waveguide plate is a multi-layer wave plate, the first coupling-incoupling-outcoupling grating group is located between two adjacent layers of wave plates, and the second coupling-incoupling-outcoupling grating group is not in the same plane as the first coupling-incoupling-outcoupling grating group.

[0036] In a preferred solution of some embodiments of the present invention, when the optical waveguide plate is a multi-layer waveguide, the optical waveguide plate includes a first layer of waveguide and a second layer of waveguide stacked on the first layer of waveguide, the first coupling-incoupling-outcoupling grating group is arranged on a side of the first layer of waveguide facing the second layer of waveguide; the second coupling-incoupling-outcoupling grating group is arranged on a side of the second layer of waveguide facing away from the first layer of waveguide, and / or a side of the first layer of waveguide facing away from the second layer of waveguide.

[0037] In a preferred solution of some embodiments of the present invention, the thickness of the optical waveguide sheet is 0.2 mm to 10 mm.

[0038] In a preferred solution of some embodiments of the utility model, the smart glasses further include temples, and the temples are connected to the eye sockets through the connecting portion;

[0039] Alternatively, the smart glasses further include a strap that can be tied to the head, one end of the strap is connected to one of the connecting parts of the frame, and the other end of the strap is connected to another connecting part of the frame.

[0040] In a preferred solution of some embodiments of the utility model, the temple and the connecting portion are integrally formed; or, the temple and the connecting portion are pivotally connected.

[0041] Compared with the prior art, the smart glasses provided by the embodiment of the utility model mainly have the following beneficial effects:

[0042] The smart glasses arrange the imaging light group of the display imaging device, the light source of the eye tracking device and the pupil imaging device in the accommodating cavity of the connecting part, so as to gather the main optical parts of the eye tracking device to the installation position of the display imaging device, specifically, the display imaging device side of the frame, that is, the left and right sides of the frame, so as to reduce the volume and weight of the eye socket and ensure the lightweight design of the smart glasses.

[0043] Moreover, the smart glasses make full use of the diffraction grating design principle of the optical waveguide plate by arranging the first coupling-in coupling-out grating group and the second coupling-in coupling-out grating group on the optical waveguide plate located directly in front of the eye, so that at least part of the optical path of the display imaging device and the eye tracking device shares the optical waveguide plate for propagation. This makes it very convenient to realize that each light coupled out from the optical waveguide plate is projected from directly in front of the eye to the eye, and the infrared light with eye information reflected from the eye can be projected to the optical waveguide plate for propagation, and finally projected to the pupil imaging device, so as to improve the quality of the pupil imaging device of the eye tracking device in capturing the infrared light with eye information, so that the pupil imaging device can have a better viewing angle range, and the light source has a better illumination range and angle, which solves the pain point that the pupil imaging device cannot be arranged in the center of the eye, and is also conducive to the eye tracking device using fewer light sources and pupil imaging devices to achieve the same or better eye tracking effect as the traditional solution, and is also conducive to further reducing the weight, volume and manufacturing cost of the smart glasses.

[0044] In summary, the smart glasses in the embodiment of the utility model not only realize the eye tracking function, but also greatly reduce the weight, volume and manufacturing cost, achieve a lightweight design, and greatly improve the wearing comfort of the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the scheme of the utility model, the following is a brief introduction to the drawings required for the description of the embodiments. Obviously, the drawings described below are some embodiments of the utility model or corresponding prior art. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. Among them:

[0046] Figure 1 It is a three-dimensional exploded schematic diagram of the main parts of the smart glasses in the embodiment of the utility model;

[0047] Figure 2 1 is a working principle diagram of the smart glasses in the first embodiment of the utility model; in this diagram, the second coupling-in grating is located on the opposite side of the first coupling-out grating, and the second coupling-out grating is located on the opposite side of the first coupling-in grating;

[0048] Figure 3This is another working principle diagram of the smart glasses in the utility model; in this diagram, the second coupling-in grating is located on the opposite side of the first coupling-out grating, and the second coupling-out grating is located on the same side as the first coupling-in grating;

[0049] Figure 4 This is another working principle diagram of the smart glasses in the utility model; in this diagram, the second coupling-in grating is located on the same side as the first coupling-out grating, and the second coupling-out grating is located on the same side as the first coupling-in grating;

[0050] Figure 5 yes Figure 2 or Figure 3 Grating distribution diagram on the optical waveguide;

[0051] Figure 6 yes Figure 4 Grating distribution diagram on the optical waveguide;

[0052] Figure 7 This is a working principle diagram of the smart glasses in the second embodiment of the utility model; in this diagram, a third coupling-in grating and a third coupling-out grating are newly added to couple the light path of the light source to the optical waveguide;

[0053] Figure 8 This is a working principle diagram of the smart glasses in the third embodiment of the utility model; in this diagram, the pupil imaging device is merged into the imaging light group;

[0054] Fig. 9 yes Figure 7 Grating distribution diagram on the optical waveguide;

[0055] Fig.10 yes Figure 8 Grating distribution diagram on the optical waveguide;

[0056] Fig.11 This is a working principle diagram of the smart glasses in the fourth embodiment of the utility model; in this diagram, the image lens of the image imaging unit in the imaging light group is replaced by a metasurface lens;

[0057] Fig.12 This is a working principle diagram of the smart glasses in the fifth embodiment of the utility model; in this figure, the optical waveguide plate is a multi-layer wave plate;

[0058] Fig.13 It is a three-dimensional structural schematic diagram of the smart glasses in the embodiment of the utility model.

[0059] The reference numerals in the accompanying drawings are as follows:

[0060] 100, smart glasses; 200, imaging light / visible light; 300, infrared light; 400, eyes;

[0061] 1. Spectacle frame; 11. Eye socket; 111. Frame hole; 12. Connecting part;

[0062] 2. Display imaging device; 21. Lens; 211. Optical waveguide; 2111. First waveguide layer; 2112. Second waveguide layer; 2113. Viewing area; 2114. Blind area; 2115. First grating area; 2116. Second grating area; 212. First coupling-in grating; 2121. First visible grating area; 213. First coupling-out grating; 2131. Second visible grating area; 214. Second coupling-in grating; 2141. First infrared grating area; 215. Second coupling-out grating; 2151. Second infrared grating area; 216. Third coupling-in grating; 2161. Third infrared grating area; 217. Third coupling-out grating; 2171. Fourth infrared grating area; 218. Rubber ring; 219. Refractive lens;

[0063] 22. Imaging light group; 221. Image source; 222. Image imaging unit; 2221. Image lens; 2222. Metasurface lens;

[0064] 3. Eye tracking device; 31. Light source; 32. Pupil imaging device; 321. Pupil camera; 322. Dichroic mirror; 323. Pupil photosensitive element; 4. Temple. DETAILED DESCRIPTION

[0065] Unless otherwise defined, all technical and scientific terms used in this document have the same meaning as commonly understood by technicians in the technical field of the present invention; the terms used in this specification are only for the purpose of describing specific embodiments and are not intended to limit the present invention. For example, the directions or positions indicated by terms such as "length", "width", "up", "down", "left", "right", "front", "back", "vertical", "horizontal", "top", "bottom", "inside", and "outside" are based on the directions or positions shown in the drawings, which are only for the convenience of description and cannot be understood as limitations on the present technical solution.

[0066] The terms "including" and "having" and any variations thereof in the specification and claims of the present utility model and the above-mentioned drawings are intended to cover non-exclusive inclusions; the terms "first", "second", etc. in the specification and claims of the present utility model or the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. "Multiple" means two or more, unless otherwise clearly and specifically defined.

[0067] In the specification and claims of the utility model and the above-mentioned drawings, when an element is referred to as being "fixed on" or "mounted on" or "disposed on" or "connected to" another element, it may be directly or indirectly located on the other element. For example, when an element is referred to as being "connected to" another element, it may be directly or indirectly connected to the other element.

[0068] In addition, the reference to "embodiment" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiment may be included in at least one embodiment of the present invention. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0069] The embodiment of the utility model provides a smart glasses 100, which mainly adopts the eye tracking technology based on the traditional infrared imaging camera, and not only has the eye tracking function, but also has a small overall volume and weight, thereby achieving a lightweight design.

[0070] like Figures 1 to 4 As shown, the smart glasses 100 include a frame 1, a display imaging device 2 and an eye tracking device 3. The frame 1 includes an eye socket 11 and a connecting portion 12. The connecting portion 12 is arranged on one side of the eye socket 11 in the pupil distance direction. Figure 1 As shown, the frame 1 generally includes two eye sockets 11, one is a left eye socket and the other is a right eye socket, wherein a connecting portion 12 is provided on the left side of the left eye socket and a connecting portion 12 is provided on the right side of the right eye socket 11, so that the two connecting portions 12 are respectively located on the left and right sides of the frame 1.

[0071] In the embodiment of the present utility model, Figures 1 to 4 As shown, the display imaging device 2 includes an imaging light group 22 and a lens 21, wherein the imaging light group 22 is mainly used to emit imaging light 200 with virtual image information, and project it into the user's field of view through optical components such as the lens 21, so as to superimpose the virtual image and the real world image for display, thereby achieving an augmented reality effect.

[0072] like Figure 1 As shown, a frame hole 111 is usually formed in the middle of each eye socket 11 (see Figure 1 ), each lens 21 is embedded in the corresponding eye socket 11 at the position of the corresponding frame hole 111. Each lens 21 includes an optical waveguide plate 211, wherein the optical waveguide plate 211 can be a single-layer wave plate or a multi-layer wave plate, which is not particularly limited here.

[0073] In some cases, such as Figure 1As shown, the lens 21 may also include a diopter 219 and a rubber ring 218, wherein the diopter 219 and the optical waveguide sheet 211 are stacked in the thickness direction to form a composite lens 21 with corresponding functions. Exemplarily, the diopter 219 may have the function of correcting visual problems such as myopia, hyperopia, astigmatism, and presbyopia. Taking the diopter 219 as an example of a myopia lens 21, the composite lens 21 formed by the myopia lens 21 and the optical waveguide sheet 211 can be used by myopic users. In other words, in this case, the smart glasses 100 not only have an eye tracking function, but can also be used by users with myopia problems, that is, by configuring different diopters 219 and the optical waveguide sheet 211 for composite use, users with different refractive problems can use the smart glasses 100, which is conducive to expanding the user group of the smart glasses 100.

[0074] In addition, a rubber ring 218 is usually arranged at the embedding position of the lens 21 and the eye socket 11, so as to ensure the stability of the installation of the lens 21 through the setting of the rubber ring 218, reduce the friction between the lens 21 and the eye socket 11, so as to protect the lens 21 from damage. In addition, it can also prevent dust, dirt and other impurities from entering the gap between the lens 21 and the eye socket 11, facilitate the cleaning of the lens 21, and reduce interference with vision.

[0075] In the embodiment of the present utility model, Figures 2 to 4 As shown, in order to realize the eye tracking function, the eye tracking device 3 includes a light source 31 and a pupil imaging device 32, wherein the light source 31 is mainly used to emit infrared light 300, and the pupil imaging device 32 is mainly used to receive infrared light 300 with eye information, so as to combine sensors and corresponding algorithms to track the user's gaze point, analyze eye movements, and measure eye parameters.

[0076] It should be noted that, in the embodiment of the utility model, the imaging light 200 may be visible light, specifically light with a wavelength of 400nm-650nm. The infrared light 300 may specifically be light with a wavelength of 700nm-1200nm. Of course, in other embodiments, the imaging light 200 and the infrared light 300 may also be other types of light or light with suitable wavelengths, which are not particularly limited here.

[0077] In addition, since each eye 400 corresponds to an eye socket 11, a connecting portion 12, a display imaging device 2 and an eye tracking device 3, for the convenience of explanation, this article mainly takes one of the eyes 400 as an example for explanation.

[0078] In the embodiment of the utility model, on the basis of realizing the eye tracking function, in order to ensure the lightweight design of the smart glasses 100, each connecting portion 12 of the frame 1 is formed with a housing cavity (not shown), wherein the imaging light group 22 of the display imaging device 2, the light source 31 of the eye tracking device 3 and the pupil imaging device 32 are all arranged in the corresponding housing cavity. Obviously, by arranging the light source 31 of the eye tracking device 3 and the pupil imaging device 32 on the imaging light group 22 side of the frame 1, that is, on the left and right sides of the frame 1, instead of at the eye socket 11, it is beneficial to greatly reduce the thickness and weight of the eye socket 11, improve the wearing comfort of the user, and also facilitate to greatly reduce the difficulty of arranging components at the eye socket 11.

[0079] It should be noted that, in some cases, the accommodating cavity may also accommodate various electronic components such as a flexible circuit board, a speaker, a microphone, a battery, an antenna, etc., to realize the corresponding functions of the smart reality glasses. In the embodiment of the utility model, the specific electronic components built into the accommodating cavity and the installation details of the electronic components are not particularly limited here.

[0080] In the embodiment of the utility model, in order to project the imaging light 200 with virtual image information emitted by the imaging light group 22 of each display imaging device 2 to the corresponding eye 400, each lens 21 also includes a first coupling-in coupling-out grating group arranged on the optical waveguide plate 211, wherein the first coupling-in coupling-out grating group is mainly used to couple the imaging light 200 emitted by the imaging light group 22 of the display imaging device 2 into and out of the optical waveguide plate 211, so as to project the imaging light 200 from the position of the optical waveguide plate 211 directly opposite the eye 400 to the eye 400, so as to be superimposed and displayed with the real world image received by the eye 400, so as to provide the user with an enhanced reality experience.

[0081] Similarly, in order to project the infrared light 300 directly emitted by the light source 31 of each eye tracking device 3 or the infrared light 300 reflected by the eye 400 to the pupil imaging device 32 located on the imaging light group 22 side of the frame 1 (specifically, the left or right side of the frame 1), each lens 21 also includes a second coupling-in coupling-out grating group arranged on the optical waveguide plate 211, wherein the second coupling-in coupling-out grating group is mainly used to couple the infrared light 300 or the infrared light 300 reflected by the eye 400 into and out of the optical waveguide plate 211, so that the eye tracking device 3 and the display imaging device 2 at least share the optical waveguide plate 211 for transmission, and finally transmit the infrared light 300 carrying eye information to the pupil imaging device 32.

[0082] Exemplarily, when the light source 31 directly projects infrared light 300 to the corresponding eye 400 on the imaging light group 22 side of the frame 1, the second coupling-in-coupling-out grating group is mainly used to couple the infrared light 300 with eye information reflected by the eye 400 into and out of the optical waveguide plate 211, so as to be projected to the pupil imaging device 32 located on the imaging light group 22 side of the frame 1. When the light source 31 directly projects infrared light 300 to the optical waveguide plate 211 on the imaging light group 22 side of the frame 1, the second coupling-in-coupling-out grating group is mainly used not only to couple the infrared light 300 emitted by the light source 31 into and out of the optical waveguide plate 211, so as to be projected to the eye 400, but also to couple the infrared light 300 with eye information reflected by the eye 400 to the optical waveguide plate 211 into and out of the optical waveguide plate 211, so as to be projected to the pupil imaging device 32 located on the imaging light group 22 side of the frame 1.

[0083] In summary, compared with the prior art, especially the case where the light source 31 of the eye tracking device 3 and the pupil imaging device 32 can only be arranged in a place around the eye socket 11 that is invisible to the eye 400, the smart glasses 100 have at least the following beneficial effects:

[0084] The smart glasses 100 arrange the imaging light group 22 of the display imaging device 2, the light source 31 of the eye tracking device 3 and the pupil imaging device 32 in the accommodating cavity of the connecting portion 12, so as to gather the main optical components of the eye tracking device 3 to the installation position of the display imaging device 2, specifically to the imaging light group 22 side of the frame 1, that is, the left and right sides of the frame 1, so as to reduce the volume and weight of the eye socket 11 and ensure the lightweight design of the smart glasses 100.

[0085] Moreover, the smart glasses 100 also make full use of the diffraction grating design principle of the optical waveguide plate 211 by arranging the first coupling-in coupling-out coupling grating group and the second coupling-in coupling-out coupling grating group on the optical waveguide plate 211 located directly in front of the eye 400, so that at least part of the optical path of the display imaging device 2 and the eye tracking device 3 is transmitted through the optical waveguide plate 211, thereby making it very convenient to realize that each light coupled out from the optical waveguide plate 211 is projected from directly in front of the eye 400 to the eye 400, and the infrared light 300 with eye information reflected from the eye 400 can be projected to the optical waveguide plate 211 for transmission. The infrared light 300 carrying eye information is finally projected onto the pupil imaging device 32, thereby improving the quality of the pupil imaging device 32 of the eye tracking device 3 in capturing the infrared light 300, so that the pupil imaging device 32 can have a better viewing angle range, and the light source 31 has a better lighting range and angle, which solves the pain point that the pupil imaging device 32 cannot be arranged in the center of the eye, and is also beneficial for the eye tracking device 3 to use fewer light sources 31 and / or pupil imaging devices 32 to achieve the same or better eye tracking effect as the traditional solution, and is also beneficial to further reduce the weight, volume and manufacturing cost of the smart glasses 100.

[0086] In summary, the smart glasses 100 in the embodiment of the utility model not only realize the eye tracking function, but also greatly reduce the weight, volume and manufacturing cost, realize a lightweight design, and help to greatly improve the wearing comfort of the user.

[0087] Embodiment 1 of the smart glasses 100 of the present invention

[0088] In order to make the technical personnel in this field better understand the present utility model scheme, the following will be combined with the attached Figures 1 to 6 , clearly and completely describe the technical solution in Example 1 of the utility model.

[0089] In this embodiment, if Figures 2 to 4 As shown, on the imaging light group 22 side of the frame 1, that is, on the left and right sides of the frame 1, the light source 31 of the eye tracking device 3 directly emits infrared light 300 to the eye 400. It can be understood that in this embodiment, the infrared light 300 emitted by the light source 31 to the eye 400 can be projected to the optical waveguide sheet 211 for propagation after being reflected by the eye 400.

[0090] In this embodiment, if Figures 2 to 4 As shown, the optical waveguide plate 211 is a single-layer wave plate. Of course, in other embodiments, the optical waveguide plate 211 can also be a multi-layer wave plate, and the structure of the optical waveguide plate 211 is not particularly limited. In addition, to ensure the overall lightweight design of the smart glasses 100, the thickness of the optical waveguide plate 211 is 0.2 mm to 10 mm.

[0091] It should be noted that the optical waveguide sheet 211 is usually made of a transparent material, specifically, the transparent material includes but is not limited to glass, plastic, etc. Of course, the optical waveguide sheet 211 can also be made of a material with a specific color, and the material of the optical waveguide sheet 211 is not particularly limited.

[0092] Exemplarily, when the infrared light 300 is infrared light, the light source 31 of the eye tracking device 3 is usually an infrared light source, and the pupil imaging device 32 is usually an infrared camera or an infrared video camera.

[0093] In this embodiment, if Figures 2 to 4 As shown, in order to project the imaging light 200 emitted by the imaging device 2 to the eye 400 through the optical waveguide plate 211, the first coupling-in coupling-out grating group includes a first coupling-in grating 212 and a first coupling-out grating 213, wherein the first coupling-in grating 212 and the first coupling-out grating 213 are located on the same side of the optical waveguide plate 211, for example, both are located on the side of the optical waveguide plate 211 away from the eye 400.

[0094] Correspondingly, when the light source 31 of the eye tracking device 3 emits the infrared light 300 toward the eye 400, in order to project the infrared light 300 carrying eye information reflected by the eye 400 to the pupil imaging device 32 through the optical waveguide plate 211, the second coupling-in coupling-out grating group includes a second coupling-in grating 214 and a second coupling-out grating 215, wherein the second coupling-in grating 214 is mainly used to couple the infrared light 300 carrying eye information reflected by the eye 400 to the optical waveguide plate 211 for transmission, and the second coupling-out grating 215 is mainly used to couple the infrared light 300 carrying eye information transmitted by the optical waveguide plate 211 out of the optical waveguide plate 211 for reception by the pupil imaging device 32.

[0095] In addition, it should be noted that in this embodiment, Figures 2 to 4 As shown, the first outcoupling grating 213 is located directly in front of the eye 400, so as to facilitate the imaging light 200 with virtual image information emitted by the display imaging device 2 to be coupled out of the optical waveguide plate 211 through the first outcoupling grating 213, so as to be projected to the eye 400 directly in front of the eye 400, thereby facilitating obtaining a better virtual reality effect.

[0096] Similarly, the second coupling grating 214 is also located directly in front of the eye 400, so that the infrared light 300 carrying eye information reflected by the eye 400 is directed toward the second coupling grating 214. This is beneficial for the pupil imaging device 32 of the eye tracking device 3 to obtain the infrared light 300 carrying eye information from directly in front of the eye 400, thereby solving the problem that the pupil imaging device 32 cannot be arranged in the center of the eye, thereby facilitating the use of a smaller number of pupil imaging devices 32 to obtain the same or better eye tracking effect, thereby reducing the weight and cost of the smart glasses 100; on the other hand, it is also beneficial to reduce the lighting range and lighting angle requirements of the light source 31 of the eye tracking device 3.

[0097] It should be noted that, for the convenience of explanation and the reasonable arrangement of the gratings of the optical waveguide plate 211, as shown in FIG. Figure 1 As shown, the area of ​​the optical waveguide sheet 211 corresponding to the eye 400 is called the visual area 2113; the area of ​​the optical waveguide sheet 211 corresponding to the connecting portion 12 of the lens frame 1 is called the blind area 2114 because it cannot be seen by the eye 400. Figure 1 , Figure 5 and Figure 6 As shown, the area in the visual area 2113 that is located directly in front of the eye 400 and is provided with a grating is called a first grating area 2115; the area in the blind area 2114 that is provided with a grating is called a second grating area 2116.

[0098] Specifically, the area corresponding to the first coupling-in grating 212 is called the first visible grating area 2121, which is located in the second grating area 2116; the area corresponding to the first coupling-out grating 213 is called the second visible grating area 2131, which is located in the first grating area 2115; the area corresponding to the second coupling-in grating 214 is called the first infrared grating area 2141, which is located in the first grating area 2115; the area corresponding to the second coupling-out grating 215 is called the second infrared grating area 2151, which is located in the second grating area 2116.

[0099] In the first grating area 2115, the area range of the first infrared grating area 2141 corresponding to the second coupling grating 214 and the second visible grating area 2131 corresponding to the first coupling grating 213 can be completely overlapped, partially overlapped, or completely staggered. In the second grating area 2116, the area range of the second infrared grating area 2151 corresponding to the second coupling grating 215 and the first visible grating area 2121 corresponding to the first coupling grating 212 can be completely overlapped, partially overlapped, or completely staggered, as long as the distribution area of ​​each grating and the coupling-in and coupling-out angles of the corresponding light can avoid the infrared light 300 and the imaging light 200 from interfering with or blocking the light path.

[0100] For example, in this embodiment 1, Figures 2 to 4 As shown, the overall working principle of the smart glasses 100 is as follows:

[0101] The imaging light 200 (specifically, visible light) with virtual image information emitted by the display imaging device 2 is incident on the second grating area 2116 in the blind area 2114 of the optical waveguide plate 211, and is coupled into the functional layer of the optical waveguide plate 211 through the first coupling grating 212 in the second grating area 2116. The imaging light 200 with virtual image information is totally reflected by the functional layer of the optical waveguide plate 211 and propagates to the first grating area 2115 in the visual area 2113 of the optical waveguide plate 211, and is coupled out of the optical waveguide plate 211 through the first coupling grating 213 in the first grating area 2115, so as to be projected to the eye 400 directly in front of the eye 400.

[0102] Correspondingly, Figures 2 to 4As shown, the light source 31 of the eye tracking device 3 directly emits infrared light 300 (specifically infrared light) in the accommodating cavity (corresponding to the blind area 2114) to the corresponding eye 400, and the eye 400 converts the received infrared light 300 into infrared light 300 with eye information, and reflects the infrared light 300 with eye information to the first grating area 2115 in the viewing area 2113 of the optical waveguide plate 211, so as to be coupled into the functional layer of the optical waveguide plate 211 through the second coupling grating 214 in the first grating area 2115, and the infrared light 300 with eye information is totally reflected by the functional layer of the optical waveguide plate 211 and propagates to the second grating area 2116 in the blind area 2114 of the optical waveguide plate 211, so as to be coupled out of the optical waveguide plate 211 through the second coupling grating 215 in the second grating area 2116, and finally reaches the pupil imaging device 32 of the eye tracking device 3 to obtain the eye movement information.

[0103] It should be noted that in order to avoid mutual interference between the imaging light 200 (specifically visible light, i.e. the solid line that propagates through total reflection in the optical waveguide 211) and the infrared light 300 (specifically infrared light, i.e. the dotted line that propagates through total reflection in the optical waveguide 211) when they share the same optical waveguide 211, the grating vectors of the first coupling-in / out coupling-out grating group and the second coupling-in / out coupling-out grating group are different.

[0104] In the embodiment of the present invention, the first coupling-in grating 212 and the first coupling-out grating 213 can be reflective diffraction gratings. In addition, when the second coupling-out grating 215 and the first coupling-in grating 212 are located on the same side of the optical waveguide plate 211 (see Figure 3 and Figure 4 ), the second outcoupling grating 215 is a reflective diffraction grating.

[0105] Alternatively, when the second out-coupling grating 215 and the first in-coupling grating 212 are located at opposite sides of the optical waveguide plate 211 (see Figure 2 ), the second outcoupling grating 215 is a transmission type diffraction grating.

[0106] Alternatively, when the second coupling-in grating 214 is on the same side as the first coupling-out grating 213 (see Figure 4 ), the second coupling grating 214 is a reflective diffraction grating.

[0107] Alternatively, when the second coupling-in grating 214 is on the opposite side of the first coupling-out grating 213 (see Figure 2 and Figure 3 ), the second coupling grating 214 is a transmission type diffraction grating.

[0108] It can be understood that in this embodiment, the first coupling-in grating 212 and the first coupling-out grating 213 of the first coupling-in coupling-out grating group, and the second coupling-in grating 214 and the second coupling-out coupling grating 215 of the second coupling-in coupling-out grating group have various arrangements on the optical waveguide plate 211, and the specific structures of each grating are also various, and the others are not listed here one by one. For the convenience of explanation, three examples are given below:

[0109] In the first specific implementation of this embodiment 1, as Figure 2 and Figure 5 As shown, the second coupling-in grating 214 is located on the opposite side of the first coupling-out grating 213 , and the second coupling-out grating 215 is located on the opposite side of the first coupling-in grating 212 .

[0110] For example, Figure 2 and Figure 5 As shown, the first out-coupling grating 213 and the second visible grating area 2131 corresponding to the first out-coupling grating 213 are located in the first grating area 2115 of the viewing area 2113 of the optical waveguide plate 211 and are located directly in front of the eye 400. The second in-coupling grating 214 and the first infrared grating area 2141 corresponding to the second in-coupling grating 214 are also located in the first grating area 2115 of the viewing area 2113 of the optical waveguide plate 211 and directly in front of the eye 400, and the second in-coupling grating 214 and the first out-coupling grating 213 are located on opposite sides of the optical waveguide plate 211, and the first infrared grating area 2141 corresponding to the second in-coupling grating 214 and the second visible grating area 2131 corresponding to the first out-coupling grating 213 completely overlap.

[0111] The first coupling-in grating 212 and the first visible grating area 2121 corresponding to the first coupling-in grating 212 are located in the second grating area 2116 of the blind area 2114 of the optical waveguide plate 211. The second coupling-out grating 215 and the second infrared grating area 2151 corresponding to the second coupling-out grating 215 are also located in the second grating area 2116 of the blind area 2114 of the optical waveguide plate 211. The second coupling-out grating 215 and the first coupling-in grating 212 are located at opposite sides of the optical waveguide plate 211. The second infrared grating area 2151 corresponding to the second coupling-out grating 215 is completely staggered with the first visible grating area 2121 corresponding to the first coupling-in grating 212 (see FIG. 2 ). Figure 5 ).

[0112] Also exemplarily, in the first specific embodiment, the first coupling-in grating 212 and the first coupling-out grating 213 are both reflective diffraction gratings, wherein the reflective diffraction gratings include but are not limited to surface relief gratings or volume holographic gratings, etc. The second coupling-in grating 214 and the second coupling-out grating 215 are both transmissive diffraction gratings, wherein the transmissive diffraction gratings include but are not limited to surface relief gratings or volume holographic gratings, etc.

[0113] In the second specific implementation of the first embodiment, as Figure 3 and Figure 5 As shown, the difference from the first specific implementation is that the second coupling grating 214 is located on the opposite side of the first coupling grating 213 , but the second coupling grating 215 is located on the same side of the first coupling grating 212 .

[0114] It should be noted that when the second out-coupling grating 215 is located on the same side of the first in-coupling grating 212, and the second infrared grating area 2151 corresponding to the second out-coupling grating 215 partially overlaps or completely overlaps with the first visible grating area 2121 corresponding to the first in-coupling grating 212, the different wavelengths of the imaging light 200 and the infrared light 300 can be utilized to realize the independent coupling into and out-coupling of the imaging light 200 and the infrared light 300 of the optical waveguide 211 under the condition of sharing the coupling grating. The specific method and structure are not particularly limited herein.

[0115] For example, Figure 3 and Figure 5 As shown, in the second specific embodiment, the first out-coupling grating 213, the second visible grating area 2131 corresponding to the first out-coupling grating 213, the second in-coupling grating 214 and the first infrared grating area 2141 corresponding to the second in-coupling grating 214 are all located in the first grating area 2115 of the viewing area 2113 of the optical waveguide plate 211 and are located directly in front of the eye 400; the second in-coupling grating 214 and the first out-coupling grating 213 are located on opposite sides of the optical waveguide plate 211, and the first infrared grating area 2141 corresponding to the second in-coupling grating 214 completely overlaps with the second visible grating area 2131 corresponding to the first out-coupling grating 213.

[0116] The first coupling-in grating 212, the first visible grating area 2121 corresponding to the first coupling-in grating 212, the second coupling-out grating 215, and the second infrared grating area 2151 corresponding to the second coupling-out grating 215 are all located in the second grating area 2116 of the blind area 2114 of the optical waveguide plate 211. The second coupling-out grating 215 and the first coupling-in grating 212 are located on the same side of the optical waveguide plate 211, and the second infrared grating area 2151 corresponding to the second coupling-out grating 215 is completely staggered with the first visible grating area 2121 corresponding to the first coupling-in grating 212 (see FIG. 2 ). Figure 5 ).

[0117] Also exemplarily, in the second specific embodiment, the first coupling-in grating 212 and the first coupling-out grating 213 are both reflective diffraction gratings, the second coupling-in grating 214 is a transmissive diffraction grating, and the second coupling-out grating 215 is a reflective diffraction grating, wherein the reflective diffraction grating and the transmissive diffraction grating herein include but are not limited to surface relief gratings or volume holographic gratings, etc.

[0118] In the third specific implementation of the first embodiment, as Figure 4 and Figure 6 As shown, the difference from the first specific implementation is that the second coupling grating 214 is located on the same side as the first coupling grating 213 , and the second coupling grating 215 is located on the same side as the first coupling grating 212 .

[0119] It should be noted that, when the second coupling-in grating 214 is located on the same side of the first coupling-out grating 213, the area range of the first infrared grating area 2141 corresponding to the second coupling-in grating 214 partially overlaps or completely overlaps with the area range of the second visible grating area 2131 corresponding to the first coupling-out grating 213, and when the second coupling-out grating 215 is located on the same side of the first coupling-in grating 212, the area range of the second infrared grating area 2151 corresponding to the second coupling-out grating 215 partially overlaps or completely overlaps with the area range of the first visible grating area 2121 corresponding to the first coupling-in grating 212, the different wavelengths of the imaging light 200 and the infrared light 300 can be utilized to realize the independent coupling-in and coupling-out optical waveguide 211 of the imaging light 200 and the infrared light 300 under the condition of sharing the coupling grating, and the specific method and structure are not particularly limited herein.

[0120] For example, Figure 4 and Figure 6 As shown, in the third specific embodiment, the first out-coupling grating 213, the second visible grating area 2131 corresponding to the first out-coupling grating 213, the second in-coupling grating 214 and the first infrared grating area 2141 corresponding to the second in-coupling grating 214 are all located in the first grating area 2115 of the viewing area 2113 of the optical waveguide plate 211 and are located directly in front of the eye 400; the second in-coupling grating 214 and the first out-coupling grating 213 are located on the same side of the optical waveguide plate 211, and the first infrared grating area 2141 corresponding to the second in-coupling grating 214 completely overlaps with the second visible grating area 2131 corresponding to the first out-coupling grating 213.

[0121] The first coupling-in grating 212, the first visible grating area 2121 corresponding to the first coupling-in grating 212, the second coupling-out grating 215 and the second infrared grating area 2151 corresponding to the second coupling-out grating 215 are all located in the second grating area 2116 of the blind area 2114 of the optical waveguide plate 211. The second coupling-out grating 215 and the first coupling-in grating 212 are located on the same side of the optical waveguide plate 211, and the projection of the second infrared grating area 2151 corresponding to the second coupling-out grating 215 is located in the first visible grating area 2121 corresponding to the first coupling-in grating 212 (see FIG. 2 ). Figure 6 ).

[0122] Also exemplarily, in the third specific embodiment, the first coupling-in grating 212 and the first coupling-out grating 213 are both reflective diffraction gratings, and the second coupling-in grating 214 and the second coupling-out grating 215 are both reflective diffraction gratings, wherein the reflective diffraction gratings here include but are not limited to surface relief gratings or volume holographic gratings, etc.

[0123] In this embodiment 1, Figures 2 to 4 As shown, in order to achieve a virtual reality effect, the imaging light group 22 of the display imaging device 2 includes an image source 221 and an image imaging unit 222, wherein the image imaging unit 222 is mainly used to perform virtual imaging on the imaging light 200 emitted by the image source 221, and to make the imaging light 200 carrying the virtual image information reach the first coupling grating 212 arranged on the optical waveguide plate 211.

[0124] In addition, the image imaging unit 222 includes an image lens 2221, wherein, exemplarily, to obtain a better virtual reality effect, in the receiving groove of the connecting portion 12 of the frame 1, corresponding to the blind area 2114 of the optical waveguide sheet 211, the image lens 2221 is vertically arranged on the light emitting side of the image source 221, that is, the image lens 2221 is located between the image source 221 and the optical waveguide sheet 211, and is also perpendicular to the optical waveguide sheet 211.

[0125] It should be noted that the image source 221 may be a chip such as a micro LED chip, an OLED chip, an LCOS chip, an SLM chip, etc. Specifically in this embodiment, the image source 221 is preferably a self-luminous chip, such as a micro LED chip.

[0126] In this embodiment 1, Figures 2 to 4 As shown, the pupil imaging device 32 of the eye tracking device 3 includes a pupil camera 321, wherein, in order to obtain a better eye movement effect, the pupil camera 321 is arranged side by side with the imaging light group 22 on the side of the frame 1, preferably, in the receiving groove of the same connecting portion 12 of the frame 1. Exemplarily, the pupil camera 321 is arranged on the corresponding optical waveguide sheet 211 corresponding to the blind area 2114 of the optical waveguide sheet 211.

[0127] In this embodiment 1, Figure 1 and Fig.13 As shown, the smart glasses 100 further include temples 4, wherein, in a specific embodiment, the temples 4 are connected to the eye sockets 11 via the connecting portion 12. Exemplarily, the temples 4 and the connecting portion 12 may be integrally formed, or the temples 4 and the connecting portion 12 may be pivotally connected via a pivot structure, so that the temples 4 can be folded to facilitate the storage of the smart glasses 100.

[0128] Alternatively, in another specific embodiment, the smart glasses 100 further include a strap (not shown) that can be tied to the head, wherein one end of the strap is connected to a connection portion 12 of the frame 1, and the other end is connected to another connection portion 12 of the frame 1. Specifically, the strap may preferably be an elastic or bendable strip-shaped strap.

[0129] For example, the left end of the belt is connected to the connection part 12 at the left end of the frame 1, and the right end of the belt is connected to the connection part 12 at the right end of the frame 1. In addition, for easy wearing, the middle section of the belt is detachable, that is, the belt includes two small strips of straps, wherein the two strips of straps can be detachably connected by Velcro, or connected by a buckle pin and a buttonhole, etc. Of course, the middle section of the belt can also be non-detachable, that is, the belt is a whole strip of straps.

[0130] It should be noted that the temple 4 and the frame 1 can be made of materials including but not limited to pure metal, alloy, plastic or resin, and the structure of the temple 4 can be limited to Fig.13 The structure of the diagram.

[0131] Embodiment 2 of the smart glasses 100 of the present invention

[0132] like Figure 7 and Fig. 9 As shown, the main technical features of the second embodiment are substantially the same as those of the first embodiment, and the main difference between the second embodiment and the first embodiment is that:

[0133] like Figure 7 As shown, the second coupling-in and coupling-out grating group further includes a third coupling-in grating 216 and a third coupling-out grating 217 disposed on the optical waveguide plate 211, wherein the third coupling-in grating 216 is located on the same side or the opposite side of the first coupling-in grating 212; and the third coupling-out grating 217 is located on the same side or the opposite side of the first coupling-out grating 213. The third coupling-in grating 216 is mainly used to couple the infrared light 300 emitted by the light source 31 of the eye tracking device 3 into the optical waveguide plate 211; and the third coupling-out grating 217 is mainly used to couple the infrared light 300 transmitted by the optical waveguide plate 211 out of the optical waveguide plate 211 to be incident on the eye 400.

[0134] Understandably, in the second embodiment, the infrared light 300 emitted by the light source 31 of the eye tracking device 3 will propagate through the optical waveguide sheet 211 and then be projected to the eye 400, rather than being directly projected into the eye 400. In other words, the illumination light path of the light source 31 is also integrated into the light path of the optical waveguide sheet 211, and is projected to the eye 400 from the front of the eye 400 through the third out-coupling grating 217. Obviously, compared with the solution in which the light source 31 projects the infrared light 300 obliquely toward the eye 400, the infrared light 300 emitted by the light source 31 of the second embodiment has better illumination angle, illumination range and uniformity, etc., which is conducive to the eye tracking device 3 using fewer light sources 31 and / or pupil imaging devices 32 to achieve the same or better eye tracking effect as the traditional solution, thereby further reducing the weight and volume of the smart glasses 100, simplifying the arrangement of devices on the frame 1 near the eye, and reducing manufacturing costs.

[0135] In the second embodiment, the area corresponding to the third coupling-in grating 216 is called the third infrared grating area 2161, which is located in the second grating area 2116 within the blind area 2114 of the optical waveguide plate 211; the area corresponding to the third coupling-out grating 217 is called the fourth infrared grating area 2171, which is located in the first grating area 2115 within the viewing area 2113 of the optical waveguide plate 211.

[0136] When the third coupling-in grating 216 and the first coupling-in grating 212 are located at the same side of the same optical waveguide plate 211, in the second grating area 2116 of the blind area 2114, the area range of the third infrared grating area 2161 corresponding to the third coupling-in grating 216 and the first visible grating area 2121 corresponding to the first coupling-in grating 212 may completely overlap, partially overlap, or completely stagger. Similarly, when the third coupling-out grating 217 and the first coupling-out grating 213 are located at the same side of the same optical waveguide plate 211, in the first grating area 2115 of the viewing area 2113, the area range of the fourth infrared grating area 2171 corresponding to the third coupling-out grating 217 and the second visible grating area 2131 corresponding to the first coupling-out grating 213 may completely overlap, partially overlap, or completely stagger. In summary, it is only necessary to ensure that the distribution area of ​​each grating and the coupling-in and coupling-out angles of the corresponding light can avoid optical path interference or shielding between the infrared light 300 and the imaging light 200 .

[0137] It should be noted that, when the third coupling-in grating 216 and the first coupling-in grating 212 are located on the same side of the same optical waveguide plate 211, and the area range of the third infrared grating area 2161 corresponding to the third coupling-in grating 216 partially overlaps or completely overlaps with the area range of the first visible grating area 2121 corresponding to the first coupling-in grating 212, and when the third coupling-out grating 217 and the first coupling-out grating 213 are located on the same side of the same optical waveguide plate 211, and the area range of the fourth infrared grating area 2171 corresponding to the third coupling-out grating 217 partially overlaps or completely overlaps with the area range of the second visible grating area 2131 corresponding to the first coupling-out grating 213, the different wavelengths of the imaging light 200 and the infrared light 300 can be utilized to realize the independent coupling-in and coupling-out optical waveguide plate 211 of the imaging light 200 and the infrared light 300 under the condition of sharing the coupling grating, and the specific method and structure are not particularly limited herein.

[0138] For example, Figure 7 As shown, compared with the working principle of the smart glasses 100 in the first embodiment, the working principle of the smart glasses 100 in the second embodiment mainly differs in that the light source 31 of the eye tracking device 3 projects the infrared light 300 to the eye 400 in a different manner, as follows:

[0139] In the second embodiment, Figure 7 As shown, the light source 31 of the eye tracking device 3 projects an infrared light 300 in the accommodating cavity toward the third coupling grating 216 disposed in the blind area 2114 of the optical waveguide plate 211. The third coupling grating 216 couples the infrared light 300 into the functional layer of the optical waveguide plate 211, and propagates to the first grating area 2115 in the visual area 2113 of the optical waveguide plate 211 through total reflection at a specific incident angle, so as to couple the infrared light 300 out of the optical waveguide plate 211 in front of the eye 400 through the third coupling grating 217 in the first grating area 2115, so that the infrared light 300 is finally projected directly from the front of the eye 400 to the eye 400.

[0140] Also illustratively, in the first specific implementation of the second embodiment, as Figure 7As shown in FIG. 1 , the third coupling grating 216, the third infrared grating area 2161 corresponding to the third coupling grating 216, the second outcoupling grating 215, the second infrared grating area 2151 corresponding to the second outcoupling grating 215, the first coupling grating 212, and the first visible grating area 2121 corresponding to the first coupling grating 212 are all located in the second grating area 2116 of the blind area 2114 of the optical waveguide plate 211, wherein the light source 31 of the eye tracking device 3 and the imaging light group 22 of the display imaging device 2 are located on the same side of the optical waveguide plate 211, the third coupling grating 216 is located on the opposite side of the first coupling grating 212 and on the same side of the second outcoupling grating 215, and the third infrared grating area 2161 corresponding to the third coupling grating 216 and the second infrared grating area 2151 corresponding to the second outcoupling grating 215 are completely staggered (see FIG. 1 ). Fig. 9 ).

[0141] The third out-coupling grating 217, the fourth infrared grating area 2171 corresponding to the third out-coupling grating 217, the second in-coupling grating 214, the first infrared grating area 2141 corresponding to the second in-coupling grating 214, the first out-coupling grating 213, and the second visible grating area 2131 corresponding to the first out-coupling grating 213 are all located in the first grating area 2115 of the viewing area 2113 of the optical waveguide plate 211, wherein the third out-coupling grating 217 is located on the opposite side of the first out-coupling grating 213 and on the same side of the second in-coupling grating 214, and the fourth infrared grating area 2171 corresponding to the third out-coupling grating 217 is completely staggered with the first infrared grating area 2141 corresponding to the second in-coupling grating 214 (see FIG. 2 ). Fig. 9 ).

[0142] In the second embodiment, the first coupling-in grating 212 and the first coupling-out grating 213 are reflective diffraction gratings. In addition, when the second coupling-in grating 214 is on the same side as the first coupling-out grating 213, the second coupling-in grating 214 is a reflective diffraction grating; or, when the second coupling-in grating 214 is on the opposite side to the first coupling-out grating 213, the second coupling-in grating 214 is a transmissive diffraction grating.

[0143] When the second out-coupling grating 215 is on the same side as the first in-coupling grating 212, the second out-coupling grating 215 is a reflective diffraction grating;

[0144] Alternatively, when the second out-coupling grating 215 is on the opposite side of the first in-coupling grating 212, the second out-coupling grating 215 is a transmission-type diffraction grating.

[0145] When the third coupling grating 216 is on the same side as the first coupling grating 212, the third coupling grating 216 is a reflective diffraction grating;

[0146] Alternatively, when the third coupling grating 216 is on the opposite side of the first coupling grating 212, the third coupling grating 216 is a transmission diffraction grating.

[0147] When the third out-coupling grating 217 is on the same side as the first out-coupling grating 213, the third out-coupling grating 217 is a reflective diffraction grating;

[0148] Alternatively, when the third outcoupling grating 217 is on the opposite side of the first outcoupling grating 213 , the third outcoupling grating 217 is a transmission-type diffraction grating.

[0149] Exemplarily, in the first specific implementation of the second embodiment, the first coupling-in grating 212 and the first coupling-out grating 213 are both reflective diffraction gratings, wherein the reflective diffraction gratings include but are not limited to surface relief gratings or volume holographic gratings, etc. The second coupling-in grating 214, the second coupling-out grating 215, the third coupling-in grating 216, and the third coupling-out grating 217 are all transmission-type diffraction gratings, wherein the transmission-type diffraction gratings include but are not limited to surface relief gratings or volume holographic gratings, etc.

[0150] It should be noted that in the second specific implementation of the second embodiment, the light source 31 of the eye tracking device 3 and the imaging light group 22 of the display imaging device 2 can also be located on opposite sides of the optical waveguide sheet 211. The working principle of the second specific implementation is the same as that of the first specific implementation, and will not be repeated here.

[0151] Embodiment 3 of the smart glasses 100 of the present invention

[0152] like Figure 8 and Fig.10 As shown, the main technical features of the third embodiment are substantially the same as those of the first and second embodiments, and the main difference lies in the different structure and arrangement of the pupil imaging device 32 of the eye tracking device 3, as follows:

[0153] In the third embodiment, in order to further simplify the arrangement of components near the eye of the frame 1 of the smart glasses 100, that is, on the eye socket 11, as shown in FIG. Figure 8 As shown, the pupil imaging device 32 of the eye tracking device 3 includes a dichroic mirror 322 and a pupil photosensitive element 323, wherein, at a position corresponding to the blind area 2114 of the optical waveguide plate 211, the imaging light 200 emitted by the image source 221 of the imaging light group 22 of the display imaging device 2 is linearly transmitted through the dichroic mirror 322 into the image imaging unit 222 of the imaging light group 22; the infrared light 300 is coupled out of the optical waveguide plate 211 through the second coupling grating 215, and then is incident on the image imaging unit 222 and the dichroic mirror 322 in sequence, and reaches the pupil photosensitive element 323 after being reflected by the dichroic mirror 322.

[0154] It can be understood that in this third embodiment, the pupil imaging device 32 of the eye tracking device 3 is incorporated into the imaging light group 22 of the display imaging device 2. Specifically, the image lens 2221 of the pupil imaging device 32 is replaced by a dichroic mirror 322 and a pupil photosensitive element 323, and the dichroic mirror 322 and the pupil photosensitive element 323 are arranged between the image source 221 and the image imaging unit 222 of the imaging light group 22 to integrate the pupil imaging functional parts of the pupil imaging device 32 into the imaging light group 22, thereby reducing the number of pupil cameras 321 of the eye tracking device 3 and simplifying the arrangement of devices on the eye socket 11.

[0155] For example, Figure 8 As shown, compared with the working principles of the smart glasses 100 in the first and second embodiments, the working principles of the smart glasses 100 in the third embodiment are mainly different in that the way and path of the imaging light 200 emitted by the image source 221 of the display imaging device 2 projecting to the first coupling grating 212, and the way and path of the pupil imaging device 32 of the eye tracking device 3 receiving the infrared light 300 with eye information are different, as follows:

[0156] The imaging light 200 (specifically visible light) with virtual image information emitted by the image source 221 of the display imaging device 2 needs to first penetrate the dichroic mirror 322, and then pass through the image imaging unit 222 of the imaging light group 22 to enter the second grating area 2116 in the blind area 2114 of the optical waveguide plate 211, and then be coupled in by the first coupling grating 212, propagated by total reflection from the functional layer of the optical waveguide plate 211, and coupled out of the optical waveguide plate 211 by the first coupling grating 213, and finally achieve imaging of the eye 400.

[0157] In addition, the infrared light 300 carrying eye information reflected by the eye 400 is sequentially coupled by the second coupling grating 214, propagated by total reflection of the functional layer of the optical waveguide plate 211, coupled out of the optical waveguide plate 211 by the second coupling grating 215, and then incident on the dichroic mirror 322 through the image imaging unit 222 of the imaging light group 22, and is reflected by the dichroic mirror 322 to the pupil photosensitive element 323 for imaging.

[0158] It should be noted that, in the imaging light group 22 of the display imaging device 2, since the light-outgoing path of the imaging light 200 is partially the same as the light-incoming path of the infrared light 300, in order to ensure the compactness of the structure of the smart glasses 100 and reduce the overall weight and volume, in the blind area 2114 of the optical waveguide sheet 211, the first visible grating area 2121 corresponding to the first coupling grating 212 and the second infrared grating area 2151 corresponding to the second coupling grating 215 at least partially overlap. Preferably, as Figure 8 and Fig.10As shown, the first visible light grating region 2121 corresponding to the first coupling-in grating 212 and the second infrared light grating region 2151 corresponding to the second coupling-out grating 215 completely overlap.

[0159] It should also be noted that the pupil photosensitive element 323 can well image light in the 400nm-1200nm band. Preferably, the pupil photosensitive element 323 can be a CMOS or a CCD. In addition, the dichroic mirror 322 has been specially coated, and Figure 8 As shown, specifically in this embodiment, the dichroic mirror 322 is placed at 45° between the light emitting surface of the image source 221 of the imaging light group 22 and the image forming unit 222 .

[0160] Embodiment 4 of the smart glasses 100 of the present invention

[0161] like Fig.11 As shown, the main technical features of the fourth embodiment are substantially the same as those of the first, second and third embodiments, and the main difference lies in the specific structure of the imaging light group 22 of the display imaging device 2, which is as follows:

[0162] To further simplify the structure of the smart glasses 100 and reduce its volume and weight, Fig.11 As shown, the image imaging unit 222 of the imaging light group 22 includes at least one metasurface lens 2222 , wherein the metasurface lens 2222 is arranged on the light output side of the image source 221 .

[0163] It can be understood that in this fourth embodiment, one or more metasurface lenses 2222, or a combination of an ordinary lens and at least one metasurface lens 2222, are mainly used to replace the image lens 2221 of the image imaging unit 222 in the above-mentioned first, second, and third embodiments, so as to further reduce the volume and weight of the smart glasses 100, which is conducive to further improving the wearing comfort of the user.

[0164] Embodiment 5 of the smart glasses 100 of the present invention

[0165] like Fig.12 As shown, the main technical features of the fifth embodiment are substantially the same as those of the first, second, third and fourth embodiments, and the main difference is that the structure of the optical waveguide sheet 211 is different. Correspondingly, the propagation optical path of the infrared light 300 carrying eye information in the optical waveguide sheet 211 is different, as follows:

[0166] In the fifth embodiment, Fig.12As shown, the optical waveguide plate 211 is a multi-layer wave plate, wherein the first coupling-incoupling-outcoupling grating group is located between two adjacent wave plates, and in order to reduce the mutual interference between the imaging light 200 and the infrared light 300 in the optical waveguide plate 211 and realize the separate control of the infrared light 300, the second coupling-incoupling-outcoupling grating group is not in the same plane as the first coupling-incoupling-outcoupling grating group.

[0167] It should be noted that the fifth embodiment has the same effect as the first embodiment, except that the overall volume of the smart glasses 100 is slightly increased, but the technical difficulty is reduced.

[0168] Preferably, if Fig.12 As shown, when the optical waveguide plate 211 is a multi-layer waveguide, the optical waveguide plate 211 includes a first waveguide layer 2111 and a second waveguide layer 2112, and the second waveguide layer 2112 is stacked on the first waveguide layer 2111 along the thickness direction. The first coupling-in-coupling-out grating group is arranged on a side of the first waveguide layer 2111 facing the second waveguide layer 2112, that is, between the first waveguide layer 2111 and the second waveguide layer 2112. The second coupling-in-coupling-out grating group is arranged on a side of the second waveguide layer 2112 facing away from the first waveguide layer 2111, and / or a side of the first waveguide layer 2111 facing away from the second waveguide layer 2112.

[0169] For example, Fig.12 As shown, the first coupling-in grating 212 and the second coupling-in grating 214 of the first coupling-in coupling-out grating group are both located between the first waveguide 2111 and the second waveguide 2112, and the second coupling-in grating 214 and the second coupling-in grating 214 of the second coupling-in coupling-out grating group are both located on the side of the second waveguide 2112 facing away from the first waveguide 2111, that is, the side of the optical waveguide plate 211 facing away from the eye 400. Among them, the infrared light 300 carrying eye information reflected by the eye 400 passes through the first waveguide 2111, and is incident on the second coupling grating 214 arranged on the second waveguide 2112. It is coupled into the functional layer of the second waveguide 2112 at a specific angle through the second coupling grating 214 for total reflection, so as to propagate to the second coupling grating 215 arranged on the second waveguide 2112, and then coupled out of the second waveguide 2112 through the second coupling grating 215. The infrared light 300 carrying eye information penetrates the first waveguide 2111 from the second waveguide 2112, so as to be finally projected to the pupil imaging device 32 of the eye tracking device 3.

[0170] Obviously, in this case, the imaging light 200 carrying virtual image information propagates in the first waveguide 2111, and the infrared light 300 carrying eye information can propagate in the second waveguide 2112, thereby helping to reduce signal interference between the imaging light 200 and the infrared light 300.

[0171] In summary, it can be understood that in order to achieve lightweight smart glasses 100 on the basis of having an eye tracking function, the smart glasses 100 can replace and use at least two combinations of the above-mentioned embodiments one, two, three, four, five and the prior art, for example, different distribution area settings of the grating, different illumination modes of the light source 31 of the eye tracking device 3, a two-in-one design of the pupil imaging device 32 of the eye tracking device 3 and the imaging light group 22 of the display imaging device 2, a metasurface lens 2222 replacing the image lens 2221, a multi-layer wave plate replacing a single-layer wave plate, etc.

[0172] The above description is only a preferred embodiment of the utility model and is not intended to limit the utility model. For those skilled in the art, the utility model may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the utility model shall be included in the scope of the claims of the utility model.

Claims

1. A pair of smart glasses, characterized in that: The smart glasses include: The frame comprises an eye socket and a connecting portion, wherein the connecting portion is arranged at one side of the eye socket in the pupil distance direction and is formed with a receiving cavity; The display imaging device comprises a lens embedded in the eye socket and an imaging light group arranged in the accommodating cavity and emitting imaging light with image information, wherein the lens comprises an optical waveguide and a first coupling-in-coupling-out grating group arranged on the optical waveguide; the first coupling-in-coupling-out grating group is used to couple the imaging light into and out of the optical waveguide; An eye tracking device, comprising a light source and a pupil imaging device arranged in the accommodating cavity; the light source is used to emit infrared light; Among them, the lens also includes a second coupling-in coupling-out grating group arranged on the optical waveguide plate, and the second coupling-in coupling-out grating group is used to couple the infrared light or the infrared light reflected by the eye into and out of the optical waveguide plate, so that the eye tracking device and the display imaging device at least share the optical waveguide plate for transmission, and finally transmit the infrared light carrying eye information to the pupil imaging device.

2. The smart glasses according to claim 1, characterized in that: The first coupling-in coupling-out grating group comprises a first coupling-in grating and a first coupling-out grating located on the same side of the optical waveguide plate; The second coupling-in coupling-out grating group comprises a second coupling-in grating and a second coupling-out grating, and the second coupling-in grating and the first coupling-out grating are both located directly in front of the eye; The second coupling grating is used to couple the infrared light with eye information reflected by the eye to the optical waveguide for transmission; The second outcoupling grating is used to couple the infrared light transmitted by the optical waveguide plate out of the optical waveguide plate for reception by the pupil imaging device.

3. The smart glasses according to claim 2, characterized in that: The light source emits the infrared light directly toward the eyes; Alternatively, the second coupling-in coupling-out grating group further includes a third coupling-in grating and a third coupling-out grating arranged on the optical waveguide plate, wherein the third coupling-in grating is located on the same side or the opposite side of the first coupling-in grating; and the third coupling-out grating is located on the same side or the opposite side of the first coupling-out grating; The third coupling-in grating is used to couple the infrared light emitted by the light source into the optical waveguide plate; the third coupling-out grating is used to couple the infrared light transmitted by the optical waveguide plate out of the optical waveguide plate to be incident on the eye.

4. The smart glasses according to claim 3, characterized in that: The second coupling-in grating is located at the opposite side of the first coupling-out grating; and the second coupling-out grating is located at the opposite side of the first coupling-in grating.

5. The smart glasses according to claim 3, characterized in that: The second coupling-in grating is located at the opposite side of the first coupling-out grating; and the second coupling-out grating is located at the same side of the first coupling-in grating.

6. The smart glasses according to claim 3, characterized in that: The second coupling-in grating is located on the same side as the first coupling-out grating; and the second coupling-out grating is located on the same side as the first coupling-in grating.

7. The smart glasses according to claim 3, characterized in that: The first coupling-in grating and the first coupling-out grating are reflective diffraction gratings; When on the same side as the first coupling-in grating, the second coupling-out grating is a reflective diffraction grating, and the third coupling-in grating is a reflective diffraction grating; When on the opposite side to the first coupling-in grating, the second coupling-out grating is a transmission-type diffraction grating, and the third coupling-in grating is a transmission-type diffraction grating; When on the same side as the first out-coupling grating, the second in-coupling grating is a reflective diffraction grating, and the third out-coupling grating is a reflective diffraction grating; When located on the opposite side to the first out-coupling grating, the second in-coupling grating is a transmission-type diffraction grating, and the third out-coupling grating is a transmission-type diffraction grating.

8. The smart glasses according to any one of claims 2 to 7, characterized in that: The imaging light group includes an image source and an image imaging unit, wherein the image imaging unit is used to perform virtual imaging on the imaging light emitted by the image source, and to make the imaging light with virtual image information reach the first coupling grating; The image imaging unit includes an image lens, which is arranged on the light-emitting side of the image source; or, the image imaging unit includes at least one metasurface lens, which is arranged on the light-emitting side of the image source.

9. The smart glasses according to claim 8, characterized in that: The pupil imaging device comprises a pupil camera, and the pupil camera is arranged side by side with the imaging light group; Alternatively, the pupil imaging device comprises a dichroic mirror and a pupil photosensitive element, and the imaging light emitted by the image source is linearly transmitted through the dichroic mirror into the image imaging unit; The infrared light is coupled out of the optical waveguide plate through the second coupling grating and then sequentially incident on the image forming unit and the dichroic mirror, and reaches the pupil photosensitive element after being reflected by the dichroic mirror.

10. The smart glasses according to any one of claims 1 to 7, characterized in that: The optical waveguide plate is a single-layer wave plate; Alternatively, the optical waveguide plate is a multi-layer wave plate, the first coupling-incoupling-outcoupling grating group is located between two adjacent layers of wave plates, and the second coupling-incoupling-outcoupling grating group is not in the same plane as the first coupling-incoupling-outcoupling grating group.

11. The smart glasses according to claim 10, characterized in that: When the optical waveguide plate is a multi-layer waveguide plate, the optical waveguide plate includes a first layer of waveguide and a second layer of waveguide stacked on the first layer of waveguide, the first coupling-incoupling-outcoupling grating group is arranged on a side of the first layer of waveguide facing the second layer of waveguide; the second coupling-incoupling-outcoupling grating group is arranged on a side of the second layer of waveguide facing away from the first layer of waveguide, and / or a side of the first layer of waveguide facing away from the second layer of waveguide.

12. The smart glasses according to claim 1, characterized in that: The thickness of the optical waveguide sheet is 0.2 mm to 10 mm.

13. The smart glasses according to claim 1, characterized in that: The smart glasses also include temples, which are connected to the eye sockets through the connecting parts; Alternatively, the smart glasses further include a strap that can be tied to the head, one end of the strap is connected to one of the connecting parts of the frame, and the other end of the strap is connected to another connecting part of the frame.

14. The smart glasses according to claim 13, characterized in that: The temples and the connecting portion are integrally formed; or, the temples and the connecting portion are pivotally connected.

Images