An augmented reality display system based on a diffraction integrator and a manufacturing method thereof

Abstract

The present invention discloses an augmented reality display system based on a diffraction integrator and a manufacturing method thereof, and belongs to the field of augmented reality display technology. The present invention includes a diffraction integrator, which is composed of an ultraviolet light-curing / thermo-curing resin layer with a surface relief diffraction grating, and is used to reflect a virtual image to the human eye; a diffraction integrator carrying substrate, which is used to carry the diffraction integrator; the diffraction integrator carrying substrate is transparent or partially transparent; an optical projector, which is 5 to 60 mm away from the center of the diffraction integrator, serves as an image display source, and is used to project a virtual image to the diffraction integrator. The present invention has the light and thin form of daily glasses, can be fully compatible with daily glasses, has low production cost, high flexibility, can be replicated on a large scale, and is suitable for industrial production.

Description

Technical Field

[0001] The present invention relates to the field of augmented reality display technology, and in particular to an augmented reality display system based on a diffraction integrator and a manufacturing method thereof. Background Art

[0002] Augmented reality is a new technology that overlays real-world information and virtual-world information on the same screen or space in real time. It achieves a sensory experience beyond reality by overlaying computer-generated prompt information, virtual objects or virtual scenes on the real world. Due to its ability to enhance the display output of the real environment, augmented reality has a wide range of applications in data model visualization, military weapons research and development and manufacturing, flight navigation, medical training, remote control, entertainment and art.

[0003] Display devices in augmented reality technology are divided into two categories according to the display principle: optical transmission and video transmission. Optical transmission augmented reality display systems allow users to receive virtual reality information without cutting off the display path for users to receive real-world information. Due to the advantages of high resolution, no visual deviation, no delay, and more in line with social habits, optical transmission augmented reality display systems have become mainstream. Such display systems either use transparent devices or place display devices in the user's peripheral vision. Currently available optical transmission near-eye display devices that can realize augmented reality include Epson Moverio, Google Glass, Microsoft HoloLens, and Magic Leap One.

[0004] The optical performance of the augmented reality display system is an important indicator for comprehensive performance evaluation. However, as a wearable near-eye display device, ergonomics and aesthetics are also important factors that determine whether the product can be widely accepted by the general public. The global popularity of glasses shows that if wearable devices have the light and thin form of glasses, they can meet consumers' requirements for near-eye devices in terms of ergonomics and aesthetics.

[0005] The above-mentioned and other augmented reality display devices currently on the market are too thick and lack fashion sense compared to glasses. For example, the near-eye imaging components used by Epson Moverio and Google Glass are much thicker than everyday glasses, and the limited lateral size makes the devices not meet the aesthetic requirements for wearable devices. Microsoft HoloLens uses optical waveguides as display components. Although the shape of the optical waveguides is similar to that of glasses, users who wear glasses on a daily basis need to continue wearing their glasses when using HoloLens, so the overall system is still bulky. Magic Leap One also uses optical waveguides as display components, but in order to meet its functional design, the device is not compatible with the glasses worn by users, making it impossible for users wearing glasses to obtain a normal visual experience. Ergonomic and aesthetic defects have become an important reason why all augmented reality display devices on the current market have not generated sufficient user stickiness in the consumer field.

[0006] The current augmented reality near-eye displays are too bulky and their shape is far from the ideal glasses. Although the augmented reality near-eye display with optical waveguide as the display core is similar to the shape of glasses, it cannot be used independently without glasses for users who wear glasses. Summary of the invention

[0007] In order to make up for the deficiencies of the prior art, the present invention provides an augmented reality display system based on a diffraction integrator.

[0008] The technical solution of the present invention is:

[0009] An augmented reality display system based on a diffractive integrator, comprising:

[0010] a diffractive integrator, composed of a UV-curable / thermo-curable resin layer with a surface-embossed diffraction grating, for reflecting a virtual image to the human eye;

[0011] A diffraction integrator carrying substrate, used for carrying the diffraction integrator; the diffraction integrator carrying substrate is transparent or partially transparent;

[0012] The optical mechanical projector is 5 to 60 mm away from the center of the diffraction integrator and serves as an image display source for projecting a virtual image onto the diffraction integrator.

[0013] As a preferred solution, the diffraction integrator has an arc-shaped grating with a non-constant period.

[0014] As a preferred solution, the center connecting line of the optomechanical projector and the diffraction integrator coincides with the zero-field-of-view chief ray of the optomechanical projector.

[0015] As a preferred embodiment, the diffraction integrator supporting substrate is a parallel optical flat plate with two parallel surfaces and no optical focal length, or a parallel curved plate with two parallel surfaces and no optical focal length, or a concave lens type eyeglass lens with its own optical focal length for correcting myopia, or a convex lens type eyeglass lens with its own optical focal length for correcting hyperopia.

[0016] As a preferred solution, the diffraction integrator supporting substrate is a spectacle lens, the spectacle lens comprises a left-eye lens and a right-eye lens, and the spectacle lens is fixed to a frame of a spectacle frame.

[0017] Furthermore, the diffraction integrator includes a left-eye diffraction integrator and a right-eye diffraction integrator; the left-eye diffraction integrator is fixed on the left eye lens; the right-eye diffraction integrator is fixed on the right eye lens; the optomechanical projector includes a left-eye optomechanical projector and a right-eye optomechanical projector; the left-eye optomechanical projector is fixed on the left eye frame or the left temple, for reflecting the virtual image to the user's left eye; the right-eye optomechanical projector is fixed on the right eye frame or the right temple, for reflecting the virtual image to the user's right eye.

[0018] As a preferred solution, the optical mechanical projector is a microdisplay or a combination of a microdisplay and a lens / lens group.

[0019] The manufacturing method of the augmented reality display system based on the diffraction integrator comprises the steps of:

[0020] 1) Fabricating a diffraction integrator master plate by etching;

[0021] 2) placing a chemical precursor of the elastic sub-mold in a diffractive integrator master, separating it from the diffractive integrator master after polymerization, and obtaining an elastic sub-mold, wherein the obtained elastic sub-mold includes a negative mold of the diffractive integrator structure to be transferred;

[0022] 3) Dropping ultraviolet light curing resin or heat curing resin on the supporting substrate of the diffraction integrator and applying it evenly;

[0023] 4) Pressing the elastic sub-mold onto the supporting substrate of the diffractive integrator with pressure, so that the resin is fully dispersed and fills the cavity of the elastic sub-mold, and polymerizing and curing the polymer in the imprinted area by ultraviolet light or heating;

[0024] 5) removing the elastic sub-mold from the diffractive integrator carrier substrate to fix the diffractive integrator on the diffractive integrator carrier substrate;

[0025] 6) An optomechanical projector configured to project the virtual image onto the diffractive integrator.

[0026] As a preferred solution, the elastic sub-mold is a PDMS elastic sub-mold, but it can also be other resin materials.

[0027] As a preferred solution, the etching processing method of the diffraction integrator master includes electron beam etching, reactive ion beam etching, magnetic enhanced reactive ion etching, high density plasma etching, inductively coupled plasma etching, variable voltage coupled plasma etching or electron cyclotron resonance etching.

[0028] As a preferred solution, the augmented reality display system based on the diffraction integrator further includes:

[0029] External space collector, used to obtain the real scene of the external environment;

[0030] Position sensor, used to obtain three-dimensional spatial position information of the external environment;

[0031] The computing unit is communicatively connected to the external space collector and the position sensor, and is used for receiving the real scene information of the external environment collected by the external space collector and the three-dimensional space position information of the external environment collected by the position sensor; the computing unit is also connected to the optical projector, and is used for generating virtual image signals provided to the left and right eyes and transmitting the virtual image signals to the optical projector.

[0032] Furthermore, the external space collector is composed of a single camera or multiple cameras, which are fixedly arranged on the frame or the temples;

[0033] The position sensor is composed of an accelerometer, a gyroscope, a magnetometer and a global positioning system receiver, and is fixed on the frame or the temple;

[0034] The computing unit includes a central processing unit, a graphics processing unit, a cache, a random access memory, a camera interface, a display driver, and a network interface, and is arranged on a frame or a temple or as a unit independent of the glasses; the computing unit is connected to an external space collector via a camera interface; the central processing unit of the computing unit is connected to an accelerometer, a gyroscope, a magnetometer, and a global positioning system receiver of a position sensor via a circuit.

[0035] Furthermore, the augmented reality display system based on the diffraction integrator further includes:

[0036] The remote computing system is composed of one or more processors and is connected to the computing unit by wire or wirelessly through a network interface; it is used to receive and process the real scene information and three-dimensional spatial position information of the external environment collected by the computing unit, and perform image signal processing for the computing unit.

[0037] The beneficial effects of the present invention are:

[0038] 1. The augmented reality display system based on the diffraction integrator of the present invention has a light and thin form factor like ordinary glasses and is fully compatible with ordinary glasses.

[0039] 2. The augmented reality display system based on the diffraction integrator of the present invention is easy to manufacture, has low manufacturing cost and high flexibility, can be replicated on a large scale, and is suitable for industrial production. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0041] Figure 1 A schematic diagram of the composition structure of an embodiment of an augmented reality display system based on a diffractive integrator of the present invention;

[0042] Figure 2 The hardware connection diagram of the computing unit and the external space collector, position sensor, micro display, and eye tracking camera;

[0043] Figure 3 A block diagram of the hardware connections between the computing unit and the external space collector, position sensor, microdisplay, eye tracking camera, microphone, etc.

[0044] Figure 4 A schematic cross-sectional structure diagram of a side frame and components contained therein of a first example of augmented reality glasses based on a diffractive integrator;

[0045] Figure 5 A schematic cross-sectional structure diagram of a side frame and components contained therein of a second example of augmented reality glasses based on a diffractive integrator;

[0046] Figure 6 is a schematic cross-sectional structural diagram of a side frame and components contained therein of a third example of augmented reality glasses based on a diffractive integrator;

[0047] Figure 7 is a schematic diagram of a first exemplary structure of a diffractive integrator and its supporting substrate;

[0048] Figure 8 is a schematic diagram of a second exemplary structure of a diffractive integrator and its supporting substrate;

[0049] Fig. 9 is a schematic diagram of a third exemplary structure of a diffractive integrator and its supporting substrate;

[0050] Fig.10 is a schematic diagram of a fourth exemplary structure of a diffractive integrator and a supporting substrate thereof;

[0051] Fig.11A schematic diagram of the front view structure of augmented reality glasses based on a diffractive integrator;

[0052] Fig.12 The following are the brief process steps of nanoimprinting.

[0053] Fig.13 This is a SEM test image of the first example of the diffraction integrator curved grating;

[0054] Fig.14 This is a SEM test image of the second example of the diffraction integrator curved grating;

[0055] Fig.15 This is a schematic structural diagram of an example of augmented reality glasses based on a diffractive integrator according to Example 2;

[0056] Fig.16 This is a schematic structural diagram of an example of augmented reality glasses based on a diffractive integrator in Example 3;

[0057] Fig.17 It is another hardware connection block diagram of the computing unit and the external space collector, position sensor, and micro display;

[0058] Fig.18 for Fig.17 Detailed hardware connection block diagram inside the computing unit. DETAILED DESCRIPTION

[0059] The following description is used to disclose the present invention so that those skilled in the art can implement the present invention. The preferred embodiments described below are only examples, and those skilled in the art can think of other obvious variations. The basic principles of the present invention defined in the following description can be applied to other embodiments, variations, improvements, equivalents, and other technical solutions that do not deviate from the spirit and scope of the present invention.

[0060] Those skilled in the art should understand that, in the disclosure of the present invention, the orientation or position relationship indicated by the terms "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc. are based on the orientation or position relationship shown in the drawings, which are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operate in a specific orientation. Therefore, the above terms should not be understood as limiting the present invention.

[0061] In the present invention, the term "one" in the claims and the specification should be understood as "one or more", that is, in one embodiment, the number of an element can be one, while in another embodiment, the number of the element can be multiple. Unless it is clearly indicated in the disclosure of the present invention that the number of the element is only one, the term "one" cannot be understood as unique or single, and the term "one" cannot be understood as a limitation on the quantity.

[0062] In the description of the present invention, it should be understood that "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, "connected" and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through a medium. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0063] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0064] An augmented reality display system based on a diffractive integrator, comprising:

[0065] a diffractive integrator, composed of a UV-curable / thermo-curable resin layer with a surface-embossed diffraction grating, for reflecting a virtual image to the human eye;

[0066] A diffraction integrator carrying substrate, used for carrying the diffraction integrator; the diffraction integrator carrying substrate is transparent or partially transparent;

[0067] The optical mechanical projector is 5 to 60 mm away from the center of the diffraction integrator and serves as an image display source for projecting a virtual image onto the diffraction integrator.

[0068] As a preferred solution, the diffraction integrator has an arc-shaped grating with a non-constant period.

[0069] As a preferred solution, the center connecting line of the optomechanical projector and the diffraction integrator coincides with the zero-field-of-view chief ray of the optomechanical projector.

[0070] As a preferred embodiment, the diffraction integrator supporting substrate is a parallel optical flat plate with two parallel surfaces and no optical focal length, or a parallel curved plate with two parallel surfaces and no optical focal length, or a concave lens type eyeglass lens with its own optical focal length for correcting myopia, or a convex lens type eyeglass lens with its own optical focal length for correcting hyperopia.

[0071] As a preferred solution, the diffraction integrator supporting substrate is a spectacle lens, the spectacle lens comprises a left-eye lens and a right-eye lens, and the spectacle lens is fixed to a frame of a spectacle frame.

[0072] Furthermore, the diffraction integrator includes a left-eye diffraction integrator and a right-eye diffraction integrator; the left-eye diffraction integrator is fixed on the left eye lens; the right-eye diffraction integrator is fixed on the right eye lens; the optomechanical projector includes a left-eye optomechanical projector and a right-eye optomechanical projector; the left-eye optomechanical projector is fixed on the left eye frame or the left temple, for reflecting the virtual image to the user's left eye; the right-eye optomechanical projector is fixed on the right eye frame or the right temple, for reflecting the virtual image to the user's right eye.

[0073] As a preferred solution, the optical mechanical projector is a microdisplay or a combination of a microdisplay and a lens / lens group.

[0074] The manufacturing method of the augmented reality display system based on the diffraction integrator comprises the steps of:

[0075] 1) Fabricating a diffraction integrator master plate by etching;

[0076] 2) placing a chemical precursor of the elastic sub-mold in a diffractive integrator master, separating it from the diffractive integrator master after polymerization, and obtaining an elastic sub-mold, wherein the obtained elastic sub-mold includes a negative mold of the diffractive integrator structure to be transferred;

[0077] 3) Dropping ultraviolet light curing resin or heat curing resin on the supporting substrate of the diffraction integrator and applying it evenly;

[0078] 4) Pressing the elastic sub-mold onto the supporting substrate of the diffractive integrator with pressure, so that the resin is fully dispersed and fills the cavity of the elastic sub-mold, and polymerizing and curing the polymer in the imprinted area by ultraviolet light or heating;

[0079] 5) removing the elastic sub-mold from the diffractive integrator carrier substrate to fix the diffractive integrator on the diffractive integrator carrier substrate;

[0080] 6) An optomechanical projector configured to project the virtual image onto the diffractive integrator.

[0081] As a preferred solution, the elastic sub-mold is a PDMS elastic sub-mold.

[0082] As a preferred solution, the etching processing method of the diffraction integrator master includes electron beam etching, reactive ion beam etching, magnetic enhanced reactive ion etching, high density plasma etching, inductively coupled plasma etching, variable voltage coupled plasma etching or electron cyclotron resonance etching.

[0083] Example 1

[0084] like Figure 1 , Figure 4 As shown, an augmented reality display system 101 based on a diffraction integrator includes: a left-eye diffraction integrator 102 and a right-eye diffraction integrator 103; the left-eye diffraction integrator 102 and the right-eye diffraction integrator 103 are both UV-curable / thermo-curable resin layers with surface-embossed diffraction gratings, which are used to reflect virtual images to human eyes.

[0085] The eyeglass frame 104 includes a left eye lens and a right eye lens, the left eye lens serves as a diffractive integrator bearing substrate of the left eye diffractive integrator 102, and the right eye lens serves as a diffractive integrator bearing substrate of the right eye diffractive integrator 103. The left eye lens and the right eye lens are transparent or partially transparent, and are used to allow the user to see the external real scene.

[0086] Optomechanical projectors 401 are provided on both the right temple and the left temple. The left optomechanical projector 401 is 5 to 60 mm away from the center of the left-eye diffraction integrator 102, and is used as an image display source to project a virtual image onto the left-eye diffraction integrator 102; the right optomechanical projector 401 is 5 to 60 mm away from the center of the right-eye diffraction integrator 103, and is used as an image display source to project a virtual image onto the right-eye diffraction integrator 103.

[0087] When the device of the present invention is used, the diffractive integrator carrying substrate and the diffractive integrator are located 5 to 50 mm in front of the human eye.

[0088] The etching processing methods available for the diffraction integrator master include electron beam etching, reactive ion beam etching, magnetic enhanced reactive ion etching, high density plasma etching, inductively coupled plasma etching, variable voltage coupled plasma etching and electron cyclotron resonance etching. The structure on the master can be copied into the resin material of the replica by nanoimprinting, casting, molding, injection molding, etc., to meet the needs of large-scale mass production and reducing manufacturing costs.

[0089] Diffractive integrators can be manufactured in large quantities and at low cost using nanoimprinting. The master can be obtained by the various etching methods mentioned above. The chemical precursor of the elastic sub-mold material is solidified in the master, and after polymerization, it is separated from the master to obtain an elastic sub-mold for nanoimprinting. PDMS is a common material used to make elastic sub-molds. Fig.12 The brief process steps of nanoimprinting are shown. At the beginning of the process, the elastic sub-mold 901 already contains the negative mold of the diffraction integrator structure to be transferred. The ultraviolet curing resin 903 is dripped on the carrier substrate 701, and the resin can be evenly covered on the substrate by spin coating. The elastic sub-mold is pressed onto the carrier substrate with pressure to disperse the resin and fill the cavity of the elastic sub-mold. The polymer in the imprinting area is polymerized and cured by ultraviolet light exposure of the elastic sub-mold. Finally, the elastic sub-mold is removed from the carrier substrate to achieve the transfer of the diffraction integrator structure to the carrier substrate.

[0090] Preferably, Fig.11 As shown in FIG. 1 , according to the position and direction of the microdisplay relative to the diffraction integrator in the system, and the position of the virtual image relative to the diffraction integrator, the diffraction structure of the diffraction integrator is usually designed as an arc grating with a non-constant period. The distance between the microdisplay and the diffraction integrator is generally in the range of 10 mm to 30 mm, and the setting range of the virtual image position of the augmented reality glasses is generally 25 cm to infinity.

[0091] Fig.13 , 14 The SEM test images of two examples of diffraction integrator arc gratings are shown. The diffraction integrator arc grating has the form of a surface relief grating, and the grating tooth cross section is a rectangular straight tooth. Fig.13 and Fig.14 Two examples of rectangular spur teeth with different duty cycles are shown. In addition to rectangular spur teeth, the tooth shape of the diffractive integrator can also be a free combination of two-dimensional shapes such as trapezoidal teeth and triangular teeth and spur teeth or helical teeth.

[0092] As a preferred solution, the center connecting line of the optical projector and the diffraction integrator coincides with the zero field of view principal ray of the optical projector. The spatial position of the optical projector relative to the diffraction integrator requires that the optical projector does not block the user's visible virtual field of view and visible perspective field of view.

[0093] As a preferred solution, the optical mechanical projector is a microdisplay or a combination of a microdisplay and a lens / lens group.

[0094] like Figure 4As shown, the optical projector 401 in the augmented reality display system based on the diffraction integrator in this embodiment can be placed, but not limited to, in the side frame of the glasses. In this example, the optical projector 401 is composed of a micro display 206 and a lens group 402. The image projected by the micro display 206 in the optical projector 401 on the right side is magnified by the lens group 402 and diffracted by the right eye diffraction integrator 103 before entering the right eye of the person; the image projected by the micro display 206 in the optical projector 401 on the left side is magnified by the lens group 402 and diffracted by the left eye diffraction integrator 102 before entering the left eye of the person.

[0095] The lens group 402 is composed of one or more lenses. The micro display 206 can use a transmissive liquid crystal display (LCD) to form an image by projecting and modulating the backlight by liquid crystal molecules, or a reflective modulation method, among which digital light processors (DLP) and liquid crystal on silicon (LCoS) are commonly used. The micro display 206 can also use self-luminous organic light emitting diodes (OLED) and micro light emitting diodes (Micro LED).

[0096] Of course, the optional lens or lens group composed of multiple lenses can perform various pre-processing on the image, such as: transmitting the image to infinity, or processing the image into an enlarged or reduced real image, or processing the image into an enlarged or reduced virtual image, etc.

[0097] Figure 5 Another example of an augmented reality display system based on a diffractive integrator is shown, which does not use a lens group to pre-process the image, but directly projects the image of the micro display 206 to the right eye diffractive integrator 103, and enters the human eye after diffraction. The micro display 206 uses a surface array display, including a transmissive liquid crystal display (LCD), a digital light processor (DLP), a liquid crystal on silicon (LCoS), an organic light emitting diode (OLED) and a micro light emitting diode (Micro LED).

[0098] Figure 6 The third example of an augmented reality display system based on a diffraction integrator is shown, in which a micro-electromechanical scanning galvanometer 601 (MEMS Scanning Mirror) is used as an image display source. The laser beam is transmitted to the right-eye diffraction integrator 103 through galvanometer scanning, and enters the human eye after diffraction.

[0099] like Figure 7 As shown, the supporting substrate 701 of the diffractive integrator can be a parallel optical flat plate with two parallel surfaces and no optical focal length, or can be a Figure 8 The two surfaces shown are parallel to each other and are parallel curved surfaces without optical focal length. Since the supporting substrate 701 of the diffractive integrator in these two examples has no optical focal length, it is suitable for users who do not need to wear glasses.

[0100] The supporting substrate 701 of the diffractive integrator may also have two non-parallel surfaces and a structure with optical focal length. Fig. 9 As shown in FIG. 10 , the supporting substrate 701 of the diffractive integrator can have the function of a concave lens type eyeglass used to correct myopia. Similarly, the supporting substrate 701 of the diffractive integrator can have the function of a convex lens type eyeglass used to correct hyperopia as shown in FIG.

[0101] When the diffractive integrator is located on a supporting substrate of a parallel plate, the diffractive integrator itself has no curvature in its structure, so it does not have the additional focal power due to the curved structure. At this time, the total focal power φ of the diffractive integrator comes entirely from the diffractive focal power φ of the integrator. dif , that is, the focal length f of the diffraction integrator is equal to its diffraction focal length f dif .Right now,

[0102] φ=φ dif (1)

[0103] f=f dif (2)

[0104] When the diffractive integrator is located on the curved surface of the supporting substrate, the structure of the diffractive integrator itself is conformally bent along the curvature of the substrate surface, thus bringing additional structural optical focal length φ cur , at this time the total focal length of the diffractive integrator is equal to the diffraction focal length φ dif and additional structured light power φ cur The sum of the focal length of the diffraction integrator, f, and the diffraction focal length, f dif and additional structure focal length f cur The relationship between follows equation (4).

[0105] φ=φ dif +φc ur (3)

[0106]

[0107] As a preferred solution, the augmented reality display system based on the diffraction integrator further includes:

[0108] The external space collector 107 is used to obtain the real scene of the external environment; preferably, but not limited to, it is arranged in the middle of the frame 104;

[0109] Position sensor 106, used to obtain three-dimensional spatial position information of the external environment, in this example but not limited to, arranged on the left temple;

[0110] The computing unit 105 is communicatively connected with the external space collector 107 and the position sensor 106, and in this example but not limited to, is arranged on the left temple; it is used to receive the real scene information of the external environment collected by the external space collector 107 and the three-dimensional space position information of the external environment collected by the position sensor 106; the computing unit 105 is also connected to the optical projector 401, and is used to generate virtual image signals provided to the left and right eyes and transmit the virtual image signals to the optical projector 401.

[0111] like Fig.17 , Fig.18 As shown in the figure, in this example, the computing unit 105 configured on the eyeglass frame may include a central processing unit 301, a graphics processor 302, a cache 303 and a random access memory 304, which are used for processing, caching and storing various types of data and graphics. The computing unit 105 outputs the corresponding image signals of the left and right eyes to the micro display 206 through the display driver 306, so that the user can obtain a three-dimensional stereoscopic visual experience. Figure 2 The two superimposed boxes corresponding to the microdisplay 206 represent one microdisplay for the left eye and one for the right eye.

[0112] The computing unit 105 communicates with the position sensor 106 and the external space collector 107 at the same time. Figure 2 As shown, the position sensor 106 may include an accelerometer 201, a gyroscope 202, a magnetometer 203, and a global positioning system receiver 204. The central processing unit of the computing unit 105 communicates with the accelerometer 201, the gyroscope 202, the magnetometer 203, and the global positioning system receiver 204 through a circuit (the communication connection method between the central processing unit and the accelerometer, gyroscope, magnetometer, and global positioning system receiver is all existing technology and will not be repeated). The position sensor 106 determines the position and direction of the augmented reality system in a given coordinate system, which includes the freedom of movement along the three rectangular coordinate axes and the freedom of rotation around the three coordinate axes. After processing the output of the position sensor 106, the computing unit 105 determines the output position of the virtual image in the given coordinate system, and then accurately renders the virtual image in the real world through the display interface.

[0113] The external space collector 107 may include a single or multiple cameras, which may be a combination of an RGB camera, a monochrome camera, and a depth camera. The RGB camera or the monochrome camera acquires the real scene of the external environment, and the depth camera acquires the depth information of the external scene. When the optical axes of the depth camera and other cameras are parallel and synchronized in timing, the complete information of the real scene can be obtained. In this example, the computing unit 105 is connected to the camera serving as the external space collector 107 through the camera interface 305.

[0114] like Figure 2 , Figure 3As shown, the camera interface 305 of the computing unit 105 can also be communicatively connected to the eye tracking cameras 205, one on the left and one on the right of the eye tracking cameras 205. The computing unit 105 obtains the images of the left eye and the right eye under infrared illumination from the eye tracking cameras 205 to calculate the sight direction of both eyes.

[0115] After processing the output of the external space collector 107, the computing unit 105 outputs the virtual image matching the real scene of the external environment to the micro display 206 of the optical projector; after processing the output of the position sensor 106, the computing unit 105 accurately renders the virtual image at the appropriate position of the real scene. In this way, the human eye can simultaneously observe the real scene and the virtual image matching the real scene environment and position.

[0116] The components of the position sensor 106 may be independent of the computing unit 105 and connected via circuits, or may be integrated with the computing unit 105 on a single chip.

[0117] The computing unit 105 may also be provided with an audio interface 307, a camera buffer 308, a memory control 309, etc. The memory control 309 may be connected to an external memory 311 through a circuit. The camera buffer 308 may store image information collected by the external space collector 107, and may be retrieved by the central processing unit 301 and the graphics processing unit 302; the audio interface 307 may be connected to a microphone 313 and an earphone 314.

[0118] The remote computing system 108 can communicate with the computing unit 105 at the glasses end by wire or wirelessly through the network interface 310 to provide it with additional computing power. In some embodiments, the remote computing system 108 can be composed of one or more processors to process the data collected by the position sensor 106 and / or the external space collector 107. At the same time, the remote computing system 108 can also be used to generate image signals provided to the left and right eyes.

[0119] In some embodiments, the remote computing system 108 can also be used as the only computing unit of the augmented reality system 101 to replace the computing unit 105 on the glasses. In some embodiments, all data processing can be completed entirely by the computing unit 105 on the glasses without using the remote computing system 108, making the augmented reality system 101 an integrated structure.

[0120] Example 2

[0121] like Fig.15 As shown, an augmented reality display system based on a diffractive integrator includes a diffractive integrator, a diffractive integrator carrying substrate and a micro display.

[0122] The diffractive integrator supporting substrate includes a left-eye diffractive integrator supporting substrate 8014 and a right-eye diffractive integrator supporting substrate 7014. Both the left-eye diffractive integrator supporting substrate 8014 and the right-eye diffractive integrator supporting substrate 7014 are transparent optical parallel plates without optical power.

[0123] The micro display includes a left micro display 2061 and a right micro display 2062. The left micro display 2061 and the right micro display 2062 cooperate with the left eye diffractive integrator 102 and the right eye diffractive integrator 103 respectively. The left micro display 2061 is used to project the virtual image to the left eye diffractive integrator 102, and the right micro display 2062 is used to project the virtual image to the right eye diffractive integrator 103.

[0124] The left-eye diffraction integrator 102 is fixed on the left-eye diffraction integrator carrying substrate 8014, and the right-eye diffraction integrator 103 is fixed on the right-eye diffraction integrator carrying substrate 7014. The left-eye diffraction integrator 102 and the right-eye diffraction integrator 103 are both UV-curable / thermo-curable resin layers with surface relief diffraction gratings. The left-eye diffraction integrator 102 is used to reflect the virtual image of the left micro-display 2061 to the left eye of the person, and the right-eye diffraction integrator 103 is used to reflect the virtual image of the right micro-display 2062 to the right eye of the person. The diffraction grating structures on the left-eye diffraction integrator 102 and the right-eye diffraction integrator 103 are arc gratings with non-constant periods.

[0125] Table 1 lists the relevant parameters of the micro display in this embodiment, and Table 2 lists the system parameters of this embodiment. Table 3 lists the structural parameters of this embodiment. Table 4 lists the structural parameters of the diffraction integrator grating included in this embodiment.

[0126] Table 1

[0127]

[0128] Table 2

[0129]

[0130] Table 3

[0131]

[0132] Table 4

[0133]

[0134] Example 3

[0135] like Fig.16 As shown, an augmented reality display system 101 based on a diffractive integrator includes a diffractive integrator, a diffractive integrator carrying substrate and a micro display.

[0136] The diffractive integrator supporting substrate includes a left-eye diffractive integrator supporting substrate 8014 and a right-eye diffractive integrator supporting substrate 7014. Both the left-eye diffractive integrator supporting substrate 8014 and the right-eye diffractive integrator supporting substrate 7014 are concave lenses used for correcting myopia. Fig. 9 As shown, the diffractive integrator is located near the concave surface of the eyeglass that carries the base concave lens.

[0137] The micro display includes a left micro display 2061 and a right micro display 2062. The left micro display 2061 and the right micro display 2062 cooperate with the left eye diffractive integrator 102 and the right eye diffractive integrator 103 respectively. The left micro display 2061 is used to project the virtual image to the left eye diffractive integrator 102, and the right micro display 2062 is used to project the virtual image to the right eye diffractive integrator 103.

[0138] The left-eye diffraction integrator 102 is fixed on the left-eye diffraction integrator carrying substrate 8014, and the right-eye diffraction integrator 103 is fixed on the right-eye diffraction integrator carrying substrate 7014. The left-eye diffraction integrator 102 and the right-eye diffraction integrator 103 are both UV-curable / thermo-curable resin layers with surface relief diffraction gratings. The left-eye diffraction integrator 102 is used to reflect the virtual image of the left micro-display 2061 to the left eye of the person, and the right-eye diffraction integrator 103 is used to reflect the virtual image of the right micro-display 2062 to the right eye of the person. The diffraction grating structures on the left-eye diffraction integrator 102 and the right-eye diffraction integrator 103 are arc gratings with non-constant periods.

[0139] Table 5 lists the relevant parameters of the micro display in this embodiment, and Table 6 lists the system parameters of this embodiment. Table 7 lists the structural parameters of this embodiment. Table 8 lists the structural parameters of the diffraction integrator grating included in this embodiment.

[0140] Table 5

[0141]

[0142]

[0143] Table 6

[0144]

[0145] Table 7

[0146]

[0147] Table 8

[0148]

Claims

1. An augmented reality display system based on a diffractive integrator, characterized in that: include: a diffractive integrator, composed of a UV-curable / thermo-curable resin layer with a surface-embossed diffraction grating, for reflecting a virtual image to the human eye; A diffractive integrator carrying substrate, used for carrying a diffractive integrator; the diffractive integrator carrying substrate is transparent or partially transparent; the diffractive integrator carrying substrate is a spectacle lens, the spectacle lens comprises a left eye lens and a right eye lens, and the spectacle lens is fixed to a frame of a spectacle frame; an optical mechanical projector, which is 5 to 60 mm away from the center of the diffraction integrator and serves as an image display source for projecting a virtual image onto the diffraction integrator; The center connecting line of the optical-mechanical projector and the diffraction integrator coincides with the zero-field-of-view chief ray of the optical-mechanical projector; Wherein, according to the position and direction of the micro display in the optical mechanical projector relative to the diffraction integrator, and the position of the formed virtual image relative to the diffraction integrator, the diffraction structure of the diffraction integrator is designed to have an arc grating with a non-constant period; The augmented reality display system based on the diffraction integrator also includes: External space collector, used to obtain real scene information of the external environment; Position sensor, used to obtain three-dimensional spatial position information of the external environment; A computing unit is communicatively connected to the external space collector and the position sensor to receive the real scene information of the external environment and the three-dimensional spatial position information of the external environment; the computing unit is also connected to the optical projector to generate virtual image signals provided to the left and right eyes and transmit the virtual image signals to the optical projector.

2. The augmented reality display system based on a diffractive integrator as claimed in claim 1, characterized in that: The diffraction integrator supporting substrate is a parallel optical flat plate with two parallel surfaces and no optical power, or a parallel curved plate with two parallel surfaces and no optical power, or a concave lens type spectacle lens with its own optical power for correcting myopia, or a convex lens type spectacle lens with its own optical power for correcting hyperopia.

3. The augmented reality display system based on a diffractive integrator as claimed in claim 1, characterized in that: The optical mechanical projector is a micro display or a combination of a micro display and a lens / lens group.

4. The method for manufacturing an augmented reality display system based on a diffractive integrator as claimed in claim 1, characterized in that: Includes steps: 1) Fabricating a diffraction integrator master plate by etching; 2) placing a chemical precursor of the elastic sub-mold in a diffractive integrator master, separating it from the diffractive integrator master after polymerization, and obtaining an elastic sub-mold, wherein the obtained elastic sub-mold includes a negative mold of the diffractive integrator structure to be transferred; 3) Dropping ultraviolet light curing resin or heat curing resin on the diffraction integrator supporting substrate and applying it evenly; 4) Pressing the elastic sub-mold onto the diffractive integrator supporting substrate with pressure, so that the resin is fully dispersed and fills the cavity of the elastic sub-mold, and polymerizing and curing the polymer in the imprinting area by ultraviolet light or heating; 5) removing the elastic sub-mold from the diffractive integrator carrying substrate, so as to fix the diffractive integrator on the diffractive integrator carrying substrate; 6) An optomechanical projector configured to project the virtual image onto the diffractive integrator.

5. The method for manufacturing an augmented reality display system based on a diffractive integrator as claimed in claim 4, characterized in that: The elastic sub-mold is a PDMS elastic sub-mold.

6. The method for manufacturing an augmented reality display system based on a diffractive integrator as claimed in claim 4, characterized in that: The etching processing methods of the diffraction integrator master include electron beam etching, reactive ion beam etching, magnetic enhanced reactive ion etching, high density plasma etching, inductively coupled plasma etching, variable voltage coupled plasma etching or electron cyclotron resonance etching.

Images