A free-form surface prism assembly and a near-eye display device using the same
By designing the free-surface prism set of the main prism and the auxiliary prism, the problem of insufficient stability and wear resistance of the free-surface prism set in the prior art is solved, and efficient optics in virtual reality and augmented reality head-mounted display devices are realized Improved performance and user experience.
Patent Information
- Application Number
- CN202210070844.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2016-12-08
- Filing Date
- 2017-11-27
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2037-11-27
AI Technical Summary
The existing free surface prism sets have problems with insufficient stability and wear resistance in long-term use or in complex environments, especially in virtual reality and augmented reality head-mounted display devices, which affect user experience and device life.
Design a free-surface prism group consisting of the main prism and two auxiliary prisms. The main prism realizes refractive and reflective functions through three effective optical surfaces. The auxiliary prism is used to compensate for the optical path and provide a flat surface, enhancing stability and wear resistance. And the overall flat outer surface is maintained for easy process processing.
It realizes stability and wear resistance without additional protective sheets, reduces surface complexity and design difficulty, enhances optical performance, reduces equipment thickness and volume, while improving the authenticity and accuracy of the field of view and image. sex.
Smart Images

Figure CN114325903B_ABST
Abstract
Description
[0001] This application is a divisional application of the invention patent application with application number 201780068826.3, application date November 27, 2017, and invention name “A free-form surface prism assembly and a near-eye display device using the same”. Technical Field
[0002] The present invention relates to a free-form surface prism group and a near-eye display device using the same, and in particular to a free-form surface prism group with a flat outer surface, which only requires designing a main prism to have good optical performance and facilitate various process treatments. Background Art
[0003] Since the concepts of virtual reality (VR) and augmented reality (AR) were proposed, head-mounted image display devices based on VR or AR modes have made great progress. In recent years, consumer-grade products have appeared, such as Samsung gearVR, Sony PSVR, Epson BT300, Microsoft Hololens, etc. Since these head-mounted display devices need to be worn on the observer's head when in use, compactness and lightweight have always been the unremitting pursuit of the industry in order to reduce the observer's load and improve usability.
[0004] Designed free-form surface optical elements are a feasible optical solution for VR or AR applications. The free-form surface shape can better control aberrations and obtain better image quality due to the increase in more degrees of freedom, while reducing the weight and size of the optical element. In terms of technology, for example, the injection molding process can be used to manufacture free-form surface prisms made of resin materials such as PMMA, which is conducive to mass production to reduce costs. However, resin materials are usually not comparable to glass in terms of wear resistance, especially in the long-term use of ordinary consumers or in relatively complex industrial environments. It is necessary to take necessary measures such as hardening treatment to protect the optical elements, thereby improving the stability and wear resistance of the elements. Summary of the invention
[0005] The present invention provides a free-form surface prism group that does not require an additional protective sheet and has good stability and wear resistance, and a near-eye display device using the same, including a main prism and two auxiliary prisms. The main prism is used to realize the main function of refracting / reflecting light, and the auxiliary prisms are used to compensate for the optical path and provide a relatively flat surface to facilitate process processing such as improving stability and wear resistance.
[0006] A free-form surface prism group for augmented reality near-eye display according to the present invention comprises a main prism (10), a first auxiliary prism (20), and a second auxiliary prism (30); wherein:
[0007] The main prism comprises three effective optical surfaces. The main prism receives image light from the micro display device through its first optical surface (101) as an incident surface, and propagates in the direction of its second optical surface (102) as an exit surface. During the propagation process, the image light passes through its third optical surface (103) at least once and is reflected back into the main prism. The first optical surface and the third optical surface are free-form surfaces.
[0008] The first auxiliary prism is disposed adjacent to the main prism and is configured so that image light emitted from the micro display device entering therein is not used for imaging;
[0009] The second auxiliary prism is disposed adjacent to the main prism with a predetermined gap therebetween, the adjacent surfaces of the main prism and the second auxiliary prism have a consistent free-form surface shape and are such that the image light from the micro display device that first reaches the second auxiliary prism can be totally internally reflected, and the second auxiliary prism extends in a direction perpendicular to the optical axis to cover the effective aperture range of the light emitted from the main prism and entering the second auxiliary prism;
[0010] The main prism includes an extended edge region, the surface shape of the extended edge region has a non-free-curved surface shape, and the surface shape from the free-curved surface to the non-free-curved surface shape is achieved through a smooth transition.
[0011] Preferably, the surface of the prism group facing the environment and the surface facing the exit pupil are formed into spherical or aspherical surfaces, and the surface facing the environment and the surface facing the exit pupil have a predetermined visual acuity for the user due to the difference in surface shape.
[0012] Preferably, the first auxiliary prism is fixed to the adjacent surface of the main prism by gluing.
[0013] Preferably, the predetermined gap value does not exceed 1 mm.
[0014] Preferably, the surface facing the environment and the surface facing the exit pupil are both coated with a hardening film and an anti-reflection film.
[0015] Preferably, the surface shape of the second optical surface of the main prism is a free-form surface.
[0016] Preferably, a splitter layer with a predetermined transmittance-reflection ratio is provided on the third optical surface of the main prism, and the edge region is a region beyond the free-form surface having the splitter layer, and the edge region is symmetrically arranged with respect to a vertical plane passing through the visual axis.
[0017] As a method of reducing the thickness applicable to the present invention, the surfaces (202, 302) of the first auxiliary prism and the second auxiliary prism that are not adjacent to the main prism do not exceed the outer edge of the main prism in the direction along the optical axis, so that the maximum thickness of the entire free-form surface prism group in the direction of the optical axis is determined by the maximum outer edge thickness of the main prism in this direction. In this way, the maximum thickness may not exceed 15 mm, and the free-form surface prism group can achieve a field of view of more than 50 degrees when magnifying the image displayed by the micro-display device.
[0018] The main prism may also include an extended edge area, which is defined as an area beyond the free-form surface with the spectroscopic layer, and the surface shape of the extended edge area has a non-free-form surface shape, and a smooth transition is achieved from the free-form surface shape to the non-free-form surface shape.
[0019] The present invention also relates to a near-eye display device using the free-form surface prism group of the present invention, further comprising a micro display device, wherein the micro display device is placed above the first optical surface of the main prism, and the image light emitted by the micro display device is incident into the main prism through the first optical surface of the main prism.
[0020] An opacity filter may be attached to the opposite surface of the first auxiliary prism of the free-form surface prism group which is not adjacent to the main prism, and the opacity filter is connected to a controller to achieve synchronous control with the micro display device.
[0021] According to the free-form surface prism group of the invention, the main prism is injection-molded with resin material with high precision, and the auxiliary prism for compensation does not need to be designed separately, thereby reducing the complexity of the surface shape and the difficulty of design; because the free-form surface prism group as a whole maintains a flat or nearly flat surface on both outer surfaces, when used as an optical element in a near-eye display device, it has good expandability when applying protection and attaching external devices, and the attached opacity filter can achieve pixel-level filtering control, which can effectively reduce the influence of ambient light on the enhanced display image, making image fusion more accurate and realistic. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] Figure 1 is a cross-sectional view of a free-form surface prism assembly according to an embodiment of the present invention;
[0023] Figure 2 for Figure 1 A cross-sectional view of a main prism in the free-form surface prism group shown;
[0024] Figure 3 for Figure 1 Schematic diagram of imaging distortion of the free-form surface prism group shown;
[0025] 4(a) and 4(b) are cross-sectional views of a free-form surface prism assembly after a diopter lens is added according to an embodiment of the present invention;
[0026] Figure 4(c) shows the Figure 1 A horizontal cross-sectional view along the optical axis of the free-form surface prism group after the size is expanded;
[0027] Figure 5 A cross-sectional view of a free-form surface prism assembly according to a modified example of the present invention;
[0028] Figure 6 for Figure 5 Schematic diagram of imaging distortion of the free-form surface prism group shown;
[0029] Figure 7 Schematic diagram of a near-eye display device using the free-curved prism groups of the present invention. DETAILED DESCRIPTION
[0030] The following is a detailed description of exemplary embodiments of the present invention to explain the present invention, and examples thereof are shown in the accompanying drawings, wherein the same reference numerals always represent the same components. Unless otherwise clearly indicated, it should be understood by those skilled in the art that the words "first", "second", etc. are only understood to distinguish different components, and do not include the limiting effect of the order, and in different embodiments, the component structures also referred to as the first part may also be different.
[0031] According to one embodiment of the present invention, Figure 1 As shown, the free-form surface prism group 1 needs to include at least a free-form surface main prism 10 for imaging and a free-form surface auxiliary prism 20 for compensation, and each free-form surface prism includes at least two optically effective surfaces and other auxiliary surfaces to form a body shape. The main prism has at least three optically effective surfaces, and the three effective optical surfaces of the main prism refract and / or reflect light to achieve the effect of magnifying the image.
[0032] In this embodiment, if Figure 2As shown, the first optical surface 101 of the main prism 10 has a free-form surface shape and is arranged facing the micro display device MD. The image light emitted by the micro display device MD is refracted into the main prism 10 through the first optical surface 101, and propagates toward the second optical surface 102 of the main prism 10 in the main prism 10. When the image light reaches the second optical surface 102 for the first time, the image light is totally internally reflected on the surface 102 of the main prism 10, and the reflected light is reflected again on the third optical surface 103 of the main prism 10, and is transmitted through the surface 102 of the main prism 10 to reach the exit pupil position EPD; wherein the second optical surface 102 and the third optical surface 103 are mutually opposite. The optical surfaces 103 are also free-form surfaces. The surface shape of the second optical surface 102 must satisfy the condition that the image light that reaches it for the first time is totally internally reflected. The third optical surface 103 is provided with a spectroscopic layer, such as a semi-reflective and semi-transparent film or a spectroscopic film with other transmittance-reflection ratio, so that the image light can be reflected back to the inside of the main prism 10 when it is incident on the surface 103 of the main prism 10. The spectroscopic ratio of the spectroscopic film can be selected according to the luminous brightness of the micro-display device to ensure that the image light of the micro-display device MD is used as effectively as possible and is balanced with the intensity of the external ambient light to obtain a good augmented reality image contrast. The main prism 10 is the main optical element for imaging (enlarging the virtual image) the micro-display device MD in the free-form surface prism group 1 of the present invention. The curvature of the second optical surface and the third optical surface of the main prism 10 is used to enlarge the image displayed on the micro-display device MD. The image light transmitted from the third optical surface 103 will no longer enter the human eye, and as a light energy loss, it does not contribute to the imaging. That is, the image light of the microdisplay device MD is refocused by the main prism 10 so that the image from the microdisplay device MD seen by the human eye appears to be emitted from a few feet away from the eye rather than from about an inch away (where the microdisplay device MD is actually located).
[0033] Those skilled in the art can understand that Figure 2 The main prism 10 formed by surrounding three free-form surfaces as shown in the figure improves the magnification ability of the main prism and the ability to correct image aberrations, which is a preferred method, but is not limited to this. The three effective optical surfaces of the main prism can also be formed into different surface types, for example, only the third optical surface 103 is retained as a free-form surface, and other surface types that are convenient for manufacturing are selected on the first optical surface and the second optical surface, such as using a spherical or aspherical surface on the first optical surface or the second optical surface, as long as the surface type of the second optical surface 102 satisfies the condition that the image light that reaches it for the first time is totally internally reflected. The spherical or aspherical surface type is convenient for manufacturing and reduces costs, but the aberration correction ability of the spherical or aspherical surface when magnifying the image light is significantly lower than that of the free-form surface. Therefore, it is particularly important to keep the third optical surface 103 as a free-form surface.
[0034] Based on the focusing effect of each effective optical surface of the main prism and the inconsistency of the upper and lower thickness of the main prism, the ambient light directly passes through the main prism and enters the human eye, which will cause the deformation of the ambient light imaging. Therefore, an auxiliary prism is required. The auxiliary prism 20 is placed on one side of the main prism 10. In this embodiment, Figure 1 As shown, the auxiliary prism 20 is placed on the outside of the main prism 10, that is, on the side close to the environment. The first surface 201 of the auxiliary prism 20 adjacent to the main prism 10 is an optical surface, having a surface shape consistent with the third optical surface 103 of the main prism, and is closely fitted with the third optical surface 103 of the main prism, for example, fixed together by gluing. The second surface 202 of the auxiliary prism 20 facing the environment is also an optical surface, which is used to transmit ambient light into the auxiliary prism 20 and the main prism 10. Since the second surface 202 faces the side of the environment, it is preferably a plane to facilitate protective process treatment, such as coating a protective film layer. Moreover, since the image light emitted by the micro display device MD enters the auxiliary prism 20 and is not used for imaging, the material of the auxiliary prism 20 can be different from that of the main prism. For example, the auxiliary prism can not use a special material that is conducive to reducing optical aberrations to reduce manufacturing difficulty and effectively reduce costs, but it is also feasible to use the same material as the main prism. To facilitate installation and positioning, a positioning structure such as a positioning groove can be provided on the main prism 10. The positioning structure can cooperate with the outer shape of the auxiliary prism 20, or cooperate with the positioning structure on the first surface 201 of the auxiliary prism 20, so as to conveniently determine the relative position of the auxiliary prism 20 and the main prism 10, so that the surface alignment of the main prism 10 and the auxiliary prism 20 after gluing is high, and good imaging quality can be achieved for ambient light.
[0035] Furthermore, the above embodiment of the present invention may further include another auxiliary prism 30, such as Figure 1 and Figure 2 As shown, the auxiliary prism 30 is placed on the other side of the main prism 10, that is, the auxiliary prism 30 and the auxiliary prism 20 are placed on both sides of the main prism 10, and the auxiliary prism 30 serves as further compensation for the other side of the optical path. The first surface 301 of the auxiliary prism 30 close to the main prism 10 is an optical surface, which has a surface shape consistent with the second optical surface 102 of the main prism, and has a predetermined interval with the second optical surface 102 of the main prism, and the interval value can be within a range of no more than 1mm. As a structure that is easy to implement, the gap value is determined by a spacer ring of a predetermined thickness, or by a card and a column with a fixed length and a card and a groove in a matching position therewith. The card and the column can be set on the auxiliary prism 30 or the main prism 10, and correspondingly, the card and the groove are set on the main prism 10 or the auxiliary prism 30. The card and the column and the card and the groove can be formed integrally when the prism is manufactured, or can be attached to the prism surface in an additional manner, such as bonding.
[0036] The auxiliary prism 30 has another optical surface 302, which is on the opposite side of the main prism 10, close to the exit pupil EPD (human eye position) of the free-form surface prism group. To realize a free-form surface prism group that does not introduce visual acuity to ambient light, the optical surface 302 of the auxiliary prism 30 has a surface shape consistent with the optical surface 202 of the auxiliary prism 20 facing the ambient side. In this embodiment, the optical surface 302 of the auxiliary prism 30 is also a plane. Since the image light emitted by the micro display device MD is further transmitted through the auxiliary prism 30 after passing through the main prism 10, the auxiliary prism 30 can be used to further correct aberrations. It is preferably made of an optical material that is consistent with the main prism, and the auxiliary prism 30 may not extend to cover the height of all optical surfaces 202 in the direction perpendicular to the optical axis, but only covers the effective aperture range of the outgoing light. Since the surface of the optical surface 202 tends to be inclined toward the EPD position at a position away from the optical axis, the auxiliary prism 30 using a partially covered manner can effectively reduce the overall thickness and volume of the free-form surface prism assembly 1. As a protective example, the surface 202 of the auxiliary prism 20 and the surface 302 of the auxiliary prism 30 are both coated with a hardened film and an anti-reflection film.
[0037] As a preferred method to minimize the thickness, Figure 1 As shown, the surface 202 and the surface 302 of the auxiliary prism 20 and the auxiliary prism 30 do not exceed the outer edge of the designed main prism 10 in the direction along the optical axis, so that the maximum thickness of the entire free-form surface prism group 1 in the direction of the optical axis is determined by the maximum outer edge thickness of the main prism in this direction. According to the adaptation of the main prism 10 to micro-display devices MD of different sizes, the maximum outer edge thickness of the main prism 10 will change accordingly. For example, when adapting to a micro-display device MD of a smaller size, the maximum outer edge thickness of the main prism along the optical axis can be effectively controlled, and when adapting to a micro-display device MD of a slightly larger size, the maximum outer edge thickness of the main prism along the optical axis can be appropriately expanded, that is, the maximum outer edge thickness of the main prism along the optical axis direction is adapted to the micro-display device MD to be adapted, and for the micro-display device MD, the effective maximum outer edge thickness is proportional to the size of the micro-display device MD.
[0038] According to the above embodiment of the present invention, each free-form surface can be described by an XY polynomial surface (XYpolynomial, referred to as XYP), and the description equation is as follows:
[0039]
[0040] Where c is the radius of curvature of the surface, k is the cone constant, and Ci is the polynomial coefficient.
[0041] According to the first embodiment of the present invention, a first auxiliary prism 20, a main prism 10 and a second auxiliary prism 30 are arranged in sequence from the environment side to the human eye side, and each free-form surface prism is molded using a high-precision optical resin.
[0042] 20 is integrated with the main prism by gluing, the second auxiliary prism 30 and the main prism 10 have an air gap of 0.5 mm, the entire prism group has a thickness of no more than 15 mm, and the overall field of view FOV can reach more than 50 degrees. Since the surface 201 and the surface 301 have the same surface shape as the surfaces 103 and 102 of the main prism, and the surface 202 and the surface 302 are flat, the description of the surfaces 201, 202, 301, and 302 will be omitted in the surface shapes of the first embodiment of the present invention shown in Table 1. Accordingly, for the image light provided by the micro display device MD, the image distortion of the free-form surface prism group 1 of the first embodiment of the present invention on the EPD is referred to as follows. Figure 3 shown.
[0043] Table 1
[0044] surface Radius of curvature 302,202 Plane(∞) 102,301 -130.534623433003 103,201 -44.9621213993141 101 -18.4176668625078 MD flat
[0045] Table 2
[0046]
[0047]
[0048]
[0049] According to the first embodiment of the present invention, the free-form surface prism group 1 has no visual correction effect on the transmitted ambient light because the surface facing the environment and the surface facing the exit pupil are both flat. For users who need to correct their vision, it is necessary to attach a common lens for correcting vision, as shown in Figure 4 (a). The lens 40 for correcting vision is placed on one side of the second auxiliary prism 30, close to the position of the exit pupil EPD, and opposite to the main prism 10. The lens 40 for correcting vision can be placed stably in front of the user's eyes by additional fixing devices, such as a frame and temples (not shown), or the lens 40 for correcting vision (usually two lenses are required for the left and right eyes) can be formed into a shape like a polarizing clip, and attached to the free-form surface prism group 1 that has been assembled into a whole through the snap buckles on both sides of the clip.
[0050] If one side surface of the lens 40 for correcting vision can be formed into a plane, it is possible to attach it to the second optical surface 302 of the second auxiliary prism by gluing, thereby achieving a more stable fixation. However, the flexibility of adaptation will decrease after gluing, which is not conducive to the use of users with different diopter, and also introduces the complexity of the process steps. Therefore, it can be understood by those skilled in the art that according to the above embodiment of the present invention, the lens 40 for correcting vision and the auxiliary prism 30 can be formed as a whole, as shown in Figure 4 (b), so that the auxiliary prism 30 with diopter adjustment function and the main prism 10 can be detachably assembled at a predetermined interval. At this time, the surface 302 of the auxiliary prism 30 has a surface shape that is inconsistent with the surface 202 of the auxiliary prism 20, so that the auxiliary prism has an additional diopter correction function to meet the needs of users with different diopter.
[0051] In view of the fact that the free-form surface prism group 1 in the first embodiment has flat outer surfaces 202 and 302, such a free-form surface prism group has good dimensional expandability. For example, the main prism 10 needs to meet the requirement of effectively and distortion-free magnification of the image displayed by the MD, and is required to have curved front and rear surfaces 102, 103. The front and rear surfaces 102, 103 with curvature will affect the shape of the main prism and cannot be expanded too much to the desired range (for example, it is not easy to expand to a size roughly equal to that of an ordinary corrective eyeglass lens, about 70 mm in diameter, due to the limitation of matching the MD size), because expanding the edge along the curvature will cause deformation of the magnification of the image displayed by the MD, and the expanded edge will affect the surface shape of the compensating auxiliary prism and the space outside the main prism that can be filled to achieve compensation. When the free-form surface prism group 1 has flat outer surfaces 202 and 302 as in the first embodiment, refer to Figure 4cIn the horizontal cross-sectional view along the optical axis, the effective part of the main prism 10 for image magnification in the center can have a free-form surface shape (FFS area) as described above, and a splitter layer is applied on the surface 103 within this surface shape range, and in the edge area beyond this, it can be conveniently expanded and symmetrically arranged. For example, the surface shape of the main prism 10 in the expanded area becomes a surface shape with a non-free-form surface, such as a spherical surface, an aspherical surface or a plane (S / AS / FL), and the surface shape from the free-form surface to the non-free-form surface is preferably achieved through a smooth transition (smooth transition surface SS area). Accordingly, the surfaces of the auxiliary prisms 20 and 30 adjacent to the main prism can be kept consistent with the surface shape changes of the front and rear surfaces 102, 103 of the main prism 10, so that the overall free-form surface prism group 1 still retains the flat outer surface 202, 302, and the ambient light will not be deflected in the propagation direction when passing through the free-form surface prism group 1, and the human eye can normally image the ambient light through the free-form surface prism group 1 (equivalent to wearing a planoscopic lens with a certain thickness). At this time, the free-form surface prism group 1 can have good size expandability, for example, it can be easily expanded to the desired size range without being restricted by the MD size. After the size of the free-form surface prism group is expanded, it can be easily cut into the shape desired by the user, for example, similar to ordinary corrective vision lenses.
[0052] [Modifications]
[0053] like Figure 5 As shown, according to another embodiment of the present invention, a free-form surface prism group 1A needs to include at least a free-form surface main prism 10A for imaging and a free-form surface auxiliary prism 20A for compensation, and each free-form surface prism includes at least 2 optically effective surfaces and other auxiliary surfaces to form a body shape. The main prism has at least three optically effective surfaces 101A-103A, and the three effective optical surfaces of the main prism refract and / or reflect light to achieve the magnification of the image; the surface 201A of the auxiliary prism 20A adjacent to the main prism 10A has a surface shape consistent with the adjacent surface 103A of the main prism 10A. Different from the first embodiment, the optical surface 202A of the auxiliary prism 20A facing the environment side is formed as an aspherical surface, or a spherical surface with a radius of curvature greater than 100 mm.
[0054] Similar to the first embodiment, the free-form surface prism group 1A also includes another auxiliary prism 30A, which is placed on the other side of the main prism 10A, that is, the auxiliary prism 30A and the auxiliary prism 20A are placed on both sides of the main prism 10A to further compensate for the optical path and achieve better imaging quality for ambient light. The adjacent surfaces 201A and 103A of the auxiliary prism 20A and the main prism 10A have the same free-form surface shape and are bonded together by gluing; the adjacent surfaces 301A and 102A of the auxiliary prism 30A and the main prism 10A also have the same free-form surface shape, and are detachably assembled at a predetermined interval.
[0055] Since the optical surface 202A has been formed into a spherical or aspherical surface, for the free-form surface prism group 1A of this modified example, in order to meet the needs of users with different vision, it is preferred that the surface shape of the second optical surface 302A of the auxiliary prism 30A is not limited, so that after determining the user's vision needs, the second optical surface 302A can be further processed to achieve a customized auxiliary prism 30A as a free-form surface prism group 1A that meets the user's vision needs; for users with normal vision, the second optical surface 302A has a consistent surface shape with the optical surface 202A, and for users with a certain vision, the above-mentioned determined vision is achieved through the difference between the surface shape of the second optical surface 302A and the surface shape of the optical surface 202A, so that the entire free-form surface prism group 1A meets the above-mentioned determined vision. Due to the detachability of the auxiliary prism 30A, when the user's vision changes or the auxiliary prism 30A has surface wear due to improper use, the auxiliary prism 30A can be replaced, which reduces the cost and convenience of adapting the free-form surface prism group 1A to users with different vision and extends its service life.
[0056] Similar to the first embodiment, each free-form surface according to the modified example of the present invention can also be described by an XY polynomial surface (XYP for short), as shown in Table 3 (taking the user with normal vision as an example), wherein there is an air gap of 0.4 mm between the second auxiliary prism 30A and the main prism 10A. The free-form surface prism group has a thickness of no more than 15 mm (calculated along the optical axis of the incident ambient light, from the outermost surface of the first auxiliary prism to the innermost surface of the second auxiliary prism), and the field of view FOV reaches more than 50 degrees. Correspondingly, for the image light provided by the micro display device MD, the image distortion diagram using the free-form surface prism group 1 of the modified example of the present invention on the EPD is shown in FIG. Figure 6 shown.
[0057] Similar to the first embodiment, the free-form surface prism group in the modified example can also achieve similar size expansion, except that the outer surface of the prism group is maintained as an aspherical surface, or a spherical surface with a curvature radius greater than 100 mm.
[0058] Table 3
[0059]
[0060]
[0061] Table 4
[0062]
[0063]
[0064]
[0065] [Near-eye display device]
[0066] According to another aspect of the present invention, the free-form surface prism group 1 / 1A shown in the first embodiment and the modified example can be used as an optical element of a near-eye display device. Figure 7 As shown, a typical application is to use it as a perspective near-eye display device, such as a head-mounted display (HMD), which may include a free-form surface prism group 1 / 1A and a micro display device MD of the first embodiment or a modified example of the present invention, wherein the free-form surface prism group 1 / 1A is placed in front of the user's eyes. Usually, a pair of free-form surface prism groups are provided, one for each eye. Due to the effect of the light splitting layer in the free-form surface prism group 1 / 1A, light from the real world scene 120 (i.e., ambient light), such as light 114, and light from the micro display device MD, such as light 116, merge at the user's eyes, so that the user sees an image 132. In the image 132, a part of the real scene 120, such as a grove, can be seen, as well as an image 104 for augmented reality from the micro display device, such as a flying bird that does not exist in the woods at this time. In this entertainment-oriented example, an image that is not related to the real scene can be superimposed, such as replacing a flying bird with a dolphin, so that the user can see a strange image of a dolphin flying over a tree. In an advertising-oriented example, the augmented reality image can appear as an image that you want to show to the user, such as a can of soda on a table, and can be extended to many other applications.
[0067] Generally speaking, users want to be able to wear HMD devices anywhere, including indoors and outdoors. Various pieces of information can be obtained to determine what type of augmented reality image is appropriate and where it should be provided on the overall image. For example, the user's position, the direction the user is looking, and the position of the floor, wall, and perhaps furniture (when the user is indoors) can be used to determine where to put the augmented reality image in the appropriate position in the real world scene. The position of the user's head can be tracked by using a combination of motion tracking technology and an inertial measurement unit attached to the user's head (such as via augmented reality glasses), and the direction the user is looking can be determined. Motion tracking technology uses a depth sensing camera to obtain a 3D model of the user. Similarly, a depth sensing camera can be used to obtain the position of the floor, wall, and other aspects of the user's environment. Various corresponding sensors and controllers in the prior art can be used to sense the various data required by the near-eye display device of the present invention. The controller can be a general data processing and control device, such as a central processing unit CPU or other microprocessor, etc., placed near the sensor to facilitate signal transmission and processing or connected by a cable to a position slightly away from the free-form surface prism group and each sensor.
[0068] In essence, since the micro display device MD can only increase the ambient light passing through the free-form surface prism group 1 / 1A, but cannot remove the light, it is affected by the brightness and display principle of the micro display device MD, which means that deeper colors cannot be displayed. In particular, it may be difficult to realize an enhanced display image of pure black pixels. When a dark augmented reality image is expected to be superimposed on the ambient light, the ambient light can still be felt to be translucent or ghosted at the human eye. For strong augmented reality or other mixed reality situations, it is expected to have the ability to remove ambient light from the view, so that the enhanced display image can represent a full range of colors and brightness, while making the image look more real or realistic. In order to achieve this goal, the HMD may further include an opacity filter. As a simple way in the prior art, reducing the entry of ambient light as a whole can improve the contrast of the image in a strong light environment. For example, a photochromic film layer that is maturely used on ordinary lenses is used to reduce excessively strong ambient light, which also has the effect of protecting eyesight. However, the overall removal is not precise enough and is difficult to adapt to a wider range of applications. The ability to selectively remove ambient light is required.
[0069] Since the free-form surface prism group 1 / 1A of the present invention has a flat or substantially flat surface appearance on the surface 202 / 202A on the side close to the environment, it is possible to add an opacity filter. The opacity filter 50 is attached to the surface 202 / 202A and can be a perspective LCD panel, an electrochromic film, or other devices that can act as an opacity filter. Such a perspective LCD panel can be obtained by removing the layers of the substrate, backlight, and diffuser from a traditional LCD. The LCD panel may include one or more translucent LCD chips that allow light to pass through the liquid crystal in a controlled manner. For example, such chips are used in LCD projectors. The above-mentioned various opacity filters can all include a dense pixel grid, in which the transmittance of each pixel can be individually controlled between the minimum and maximum transmittances. Although a controlled transmittance range of 0-100% is ideal, a limited range is also acceptable. As an example, a monochrome LCD panel with no more than two polarizing filters is sufficient to provide an opacity range of about 50%-80% or 90% per pixel, with the highest resolution being comparable to the resolution of the LCD. At the minimum value of 50%, the opacity filter will probably have a slightly tinted appearance, which is tolerable. 100% transmittance represents the ideal state. In actual control, an "alpha" scale can be defined from 0-100%, where 0% is the lowest transmittance (most opaque) and 100% is the highest transmittance (most transparent). This value "alpha" can be set for each pixel by the opacity filter control circuit.
[0070] When rendering a scene for an augmented reality display, it is important to note which real-world objects are in front of which augmented reality objects. If the augmented reality object is in front of the real-world object, then opacity should be turned on for the coverage area of the augmented reality object, i.e., blocking the real-world object so that the augmented display object appears to the user without stray light. If the augmented reality object is (virtually) behind the real-world object, then opacity should be turned off, and any color of that pixel should also be turned off to allow light from the real-world object to enter normally. Since coverage can be implemented on a per-pixel basis, it is possible to handle situations where part of the augmented reality object is in front of the real-world object, part of the augmented reality object is behind the real-world object, and part of the augmented reality object overlaps with the real-world object. In order to make the augmented reality image look more stable, the alignment or alignment of the pixels with increased opacity of the opacity filter and the augmented reality image is maintained. The pixel alignment, for example, the pixels of the opacity filter match the pixel distribution of the micro display device MD. Specifically, it can be achieved that when the opacity filter is attached to the surface, each pixel has a size consistent with the image of the micro display device MD at an equivalent position, and the opacity filter and the micro display device MD are driven synchronously.
[0071] The filter degree of the opacity filter can also be controlled by feedback from an ambient light sensor exposed to the housing of the near-eye display device. When the ambient light sensor is too strong, the corresponding pixel transmittance value can be set to be reduced even if it does not need to be weakened according to the current augmented reality image on the micro display device MD. The opacity filter control circuit can be, for example, a CPU or other microprocessor of the near-eye display device, or an additional control circuit, and communicates with the main CPU of the near-eye display device.
[0072] Further, the filtering degree of the opacity filter can also be feedback-controlled by other sensors, for example, an eye tracking sensor. A tracking camera placed in the housing of the near-eye display device can be used as an eye tracking sensor, and the position of the tracking camera can be used to identify the position of the user's eyes relative to the frame on which the HMD device is mounted. In general, eye tracking involves obtaining an image of the eye and using computer vision techniques to determine the position of the pupil within the eye socket. Other eye tracking techniques can use arrays of photodetectors and LEDs. Using the known mounting position of the tracking camera on the frame, the position of the eye relative to any other position fixed relative to the frame (such as an opaque filter and a free-form prism group) can be determined. Typically, it is sufficient to track the position of one of the user's eyes because the eyes move in unison. However, it is also possible to track each eye separately and use the position of each eye for the associated perspective lens to determine the position of the augmented reality image.
[0073] The enhanced display image controller can also use the feedback information of the ambient light sensor and the feedback information of the eye tracking sensor to control the enhanced display image, for example, driving the brightness of the micro display device MD to adjust according to the above feedback information.
[0074] In the absence of an augmented reality image, the opacity filter is set in a transparent state to provide a display of ambient light transmission. And when the opacity filter can also be driven asynchronously with the micro display device MD, for example, when it is set to completely block light from entering the free-form surface prism group 1 / 1A, only the image light of the micro display device MD is used, and the near-eye display device of the present invention realizes a non-transmissive HMD, that is, a virtual display HMD.
[0075] According to the free-form surface prism group and the near-eye display device using the same of the present invention, after completing the effective optical surface design of the main prism, there is no need to design the compensation prism separately, which reduces the difficulty of surface design. Since the free-form surface prism group as a whole maintains a flat or nearly flat surface on both outer surfaces, it can have good expansibility when applying protection and attaching external devices, and does not increase the overall thickness of the free-form surface prism group, which is beneficial to the safety and durability of the overall prism group. The opacity filter in the near-eye display device can achieve pixel-level filtering control, which can effectively reduce the impact of ambient light on the enhanced display image, making the image fusion more accurate and realistic.
[0076] The foregoing detailed description of the technology is for illustration and description only. It is not intended to be exhaustive or to limit the technology to the exact form disclosed. In view of the above teachings, many modifications and variations are possible. The described embodiments are only intended to best illustrate the principles of the technology and its practical application, so that others who are proficient in the technology can best utilize the technology in various embodiments, and various modifications suitable for specific purposes are also possible. The scope of the technology is defined by the appended claims.
Claims
1. A free-form surface prism assembly for augmented reality near-eye display, comprising a main prism (10), a first auxiliary prism (20), and a second auxiliary prism (30); wherein: The surfaces constituting the main prism have only three effective optical surfaces. The main prism has a first optical surface (101) as an incident surface. The first optical surface is arranged facing the micro display device and receives image light from the micro display device. The image light is transmitted into the main prism through the first optical surface. The second optical surface (102) serves as an exit surface and is arranged facing the exit pupil. The image light is reflected back into the main prism once by the third optical surface (103) during the process of propagating from the first optical surface to the second optical surface and finally exiting. The first optical surface, the second optical surface and the third optical surface are free-form surfaces. The first auxiliary prism is disposed adjacent to the main prism and is configured so that image light emitted from the micro display device entering therein is not used for imaging; The second auxiliary prism is disposed adjacent to the main prism with a predetermined gap therebetween, the adjacent surfaces of the main prism and the second auxiliary prism have a consistent free-form surface shape and are such that the image light from the micro display device that first reaches the second auxiliary prism can be totally internally reflected, and the second auxiliary prism extends in a direction perpendicular to the optical axis to cover the effective aperture range of the light emitted from the main prism and entering the second auxiliary prism; The effective optical surface of the main prism can magnify the image displayed by the micro display device to achieve a field of view of more than 50 degrees; the main prism includes an edge area that extends symmetrically on both sides from the third optical surface, and the extended edge area is not an optical surface for magnifying the image displayed by the micro display device and has a non-free-form surface shape, and the transition from the free-form surface shape to the non-free-form surface shape is achieved by a smooth transition, and the surfaces of the first auxiliary prism, the second auxiliary prism and the main prism adjacent to the surface shape change are kept consistent with the front and rear surfaces of the main prism, so that the free-form surface prism group has good size expandability without being constrained by the size of the micro display device.
2. A free-form surface prism assembly as claimed in claim 1, characterized in that: The surface of the prism group facing the environment and the surface facing the exit pupil are formed into spherical or aspherical surfaces, and the surface facing the environment and the surface facing the exit pupil have a predetermined visual acuity for the user due to the difference in surface shape.
3. A free-form surface prism assembly as claimed in claim 1, characterized in that: The first auxiliary prism is fixed to the adjacent surface of the main prism by gluing.
4. A free-form surface prism assembly as claimed in claim 1, characterized in that: The predetermined gap value does not exceed 1 mm.
5. A free-form surface prism assembly as claimed in claim 2, characterized in that: The surface facing the environment and the surface facing the exit pupil are both coated with a hardening film and an anti-reflection film.
6. A free-form surface prism assembly as claimed in claim 1, characterized in that: The third optical surface of the main prism is provided with a light-splitting layer with a predetermined transmission-reflection ratio, the edge region is a region beyond the free-form surface having the light-splitting layer, and the edge region is symmetrically arranged relative to a vertical plane passing through the visual axis.
7. A free-form surface prism assembly as claimed in claim 1, characterized in that: The surfaces (202, 302) of the first auxiliary prism and the second auxiliary prism that are not adjacent to the main prism do not extend beyond the outer edge of the main prism in the direction along the optical axis, so that the maximum thickness of the entire free-form surface prism group in the direction of the optical axis is determined by the maximum outer edge thickness of the main prism in this direction, and the maximum thickness does not exceed 15 mm, and the free-form surface prism group can achieve a field of view angle of more than 50 degrees when magnifying an image displayed by a micro-display device.
8. A near-eye display device using any free-form surface prism group as claimed in any one of claims 1 to 7, further comprising a micro-display device, wherein the micro-display device is placed above the first optical surface of the main prism, and the image light emitted by the micro-display device is incident into the main prism through the first optical surface of the main prism.
9. The near-eye display device according to claim 8, wherein: It further includes a controller and an opacity filter, wherein the opacity filter is attached to the relative surface (202) of the first auxiliary prism of the free-form surface prism group that is not adjacent to the main prism, and the opacity filter is connected to the controller to achieve synchronous control with the micro display device.
