Near-eye display device and display method thereof
By adopting a combination of multiple pixel island groups, microlens arrays and imaging lens groups in the near-eye display device, the problem of low display resolution in the prior art is solved, and higher resolution and lighter device are achieved.
Patent Information
- Application Number
- CN202180001556.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-06-18
- Publication Date
- 2025-03-07
- Estimated Expiration
- 2041-06-18
AI Technical Summary
The display resolution of existing near-eye display devices is not high and cannot meet practical needs. They are mainly limited by device thickness and display screen process accuracy.
A near-eye display device is used, including a display screen, a microlens array and an imaging lens group. The display screen consists of a plurality of pixel islands, each pixel island includes a plurality of sub-pixel units, the microlens array is located on the light exit side of the display screen for imaging, and the imaging lens group is used to collimate the imaging light. By adjusting parameters such as the distance between the microlens array and the imaging lens group, the distance between the microlens and the pixel island, the imaging field angle of the adjacent pixel island group is achieved.
The resolution of the near-eye display device is effectively improved, the angle resolution capability is improved, and the placement height of the microlens array is reduced, thus realizing the lightweight device.
Smart Images

Figure CN115715379B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of near-eye display technology, and in particular to a near-eye display device and a display method thereof. Background Art
[0002] With the continuous development of near-eye display technology, near-eye display products have been widely used in civil fields such as film and television, education, and medical care, instead of being initially used in the military field. Currently, the technologies used for near-eye display are virtual reality technology and augmented reality technology.
[0003] Limited by the thickness of the overall device of the near-eye display and the process accuracy of the display screen, the display resolution of current near-eye display devices is not high and cannot meet practical needs. Summary of the invention
[0004] According to a first aspect of an embodiment of the present disclosure, a near-eye display device is provided, comprising:
[0005] A display screen for displaying an image; the display screen comprises a plurality of pixel island groups, the pixel island group comprises at least one pixel island, and the pixel island comprises a plurality of sub-pixel units;
[0006] A microlens array, located at the light-emitting side of the display screen; the microlens array comprises a plurality of microlenses, one microlens corresponds to one pixel island; the microlens is used to image the image displayed by the corresponding pixel island; and
[0007] An imaging lens group, located on a side of the microlens array away from the display screen, and used for collimating the imaging light of the microlens;
[0008] The pixel island groups are used to display partial images, and the partial images displayed by each pixel island group constitute a complete image; the outgoing light rays of adjacent pixel island groups pass through the corresponding microlenses and the imaging field angles of the imaging lens group to be continuous with each other.
[0009] In some embodiments of the present disclosure, the distance between the pixel island and the corresponding microlens is less than one times the focal length of the microlens;
[0010] The imaging of the corresponding pixel island by the microlens is located at the focus of the imaging lens group.
[0011] In some embodiments of the present disclosure, the colors of the sub-pixel units in the same pixel island are the same, and the colors of the sub-pixel units in different pixel islands in the same pixel island group are different;
[0012] The outgoing light rays of each of the pixel islands containing sub-pixel units of the same color pass through the corresponding microlenses and the imaging lens group, and the imaging field angles are continuous with each other.
[0013] In some embodiments of the present disclosure, there is an intersection between the imaging field angles of the emergent light rays from adjacent pixel islands in the same pixel island group passing through the corresponding microlenses and the imaging lens group.
[0014] In some embodiments of the present disclosure, each pixel island group includes the same number of pixel islands; and the imaging field angles of the outgoing light rays of each pixel island group passing through the corresponding microlens and imaging lens group are equal.
[0015] In some embodiments of the present disclosure, the intersection of the imaging field of view angles of adjacent pixel islands in the same pixel island group is half of the imaging field of view angle of one pixel island.
[0016] In some embodiments of the present disclosure, two adjacent pixel islands in the same pixel island group are respectively a first pixel island and a second pixel island, wherein the first pixel island displays a first image and the second pixel island displays a second image;
[0017] The field of view angle corresponding to the first image is a first field of view angle, the field of view angle corresponding to the second image is a second field of view angle, the size of the first field of view angle is equal to the size of the second field of view angle, and the second field of view angle is half of the first field of view angle offset along a set direction; wherein the set direction is the arrangement direction of the first pixel island and the second pixel island.
[0018] In some embodiments of the present disclosure, the pixel island group includes: a blue pixel island, a red pixel island, a first green pixel island, and a second green pixel island; wherein each sub-pixel unit in the blue pixel island is blue, each sub-pixel unit in the red pixel island is red, and each sub-pixel unit in the first green pixel island and the second green pixel island is green;
[0019] The blue pixel island, the red pixel island, the first green pixel island and the second green pixel island are arranged in a square array of two rows and two columns; wherein the blue pixel island and the red pixel island are located on one diagonal line of the square array, and the first green pixel island and the second green pixel island are located on another diagonal line of the square array.
[0020] In some embodiments of the present disclosure, the sub-pixel units in the pixel island are arranged in an array, each sub-pixel unit is rectangular in shape, and one of the sides of the sub-pixel unit forms a set angle with the arrangement direction of the row where the sub-pixel unit is located.
[0021] In some embodiments of the present disclosure, the set angle is 45°.
[0022] In some embodiments of the present disclosure, the shape and size of each pixel island are the same, and the shape and size of each microlens are the same.
[0023] In some embodiments of the present disclosure, the microlens is a geometric lens, a superlens or an optical diffraction lens.
[0024] In some embodiments of the present disclosure, the display screen is a silicon-based organic light emitting diode display screen.
[0025] In some embodiments of the present disclosure, the number of sub-pixel units contained in a unit area of the display screen is 2000-3000.
[0026] In some embodiments of the present disclosure, the imaging lens group includes at least one lens;
[0027] The surface shape of the lens in the imaging lens group is one of a spherical surface, an aspherical surface, a free-form surface or a hypersurface.
[0028] In some embodiments of the present disclosure, the following further includes:
[0029] A transparent substrate, located between the display screen and the microlens array;
[0030] Wherein, the microlens array is located on the surface of the transparent substrate facing away from the display screen.
[0031] In some embodiments of the present disclosure, the material of the transparent substrate is one of silicon nitride and polymethyl methacrylate.
[0032] In some embodiments of the present disclosure, the microlens array is located on the surface of the light emitting side of the display screen.
[0033] A second aspect of an embodiment of the present disclosure provides a display method of a near-eye display device, including:
[0034] Determine the imaging field angle corresponding to each pixel island group in the display screen;
[0035] Image data within the corresponding imaging field of view is loaded into each of the pixel island groups.
[0036] In some embodiments of the present disclosure, the pixel island group includes at least a first pixel island and a second adjacent pixel island, the colors of the sub-pixel units in the first pixel island are the same, the colors of the sub-pixel units in the second pixel island are the same, and the colors of the sub-pixel units in the first pixel island and the second pixel island are different; the imaging field of view angle corresponding to the first pixel island is a first field of view angle, and the imaging field of view angle corresponding to the second pixel island is a second field of view angle;
[0037] The step of loading the image data within the corresponding imaging field angle into each pixel island group comprises:
[0038] Applying image data within the first imaging field angle to the first pixel islands in each of the pixel island groups;
[0039] Applying image data within the second field of view angle to the second pixel islands in each of the pixel island groups;
[0040] The second field of view angle is a field of view angle obtained by shifting the first field of view angle by half of the first field of view angle along a set direction; the set direction is an arrangement direction of the first pixel island and the second pixel island. BRIEF DESCRIPTION OF THE DRAWINGS
[0041] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for use in the embodiments of the present disclosure will be briefly introduced below. Obviously, the drawings introduced below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0042] Figure 1 One of the structural schematic diagrams of the near-eye display device provided in the embodiment of the present disclosure;
[0043] Figure 2 One of the schematic diagrams of the field of view stitching principle provided in the embodiment of the present disclosure;
[0044] Figure 3 A second structural schematic diagram of a near-eye display device provided in an embodiment of the present disclosure;
[0045] Figure 4 The second schematic diagram of the field of view stitching principle provided in the embodiment of the present disclosure;
[0046] Figure 5 The third structural schematic diagram of the near-eye display device provided in the embodiment of the present disclosure;
[0047] Figure 6 This is one of the planar structural schematic diagrams of a display screen provided in an embodiment of the present disclosure;
[0048] Figure 7 One of the planar structural schematic diagrams of the pixel island group provided in the embodiment of the present disclosure;
[0049] Figure 8 A schematic diagram of the principle of field of view offset provided in an embodiment of the present disclosure;
[0050] Fig. 9 A schematic diagram of the field of view angle deviation provided for an embodiment of the present disclosure;
[0051] Fig.10a A graph showing the relationship between the viewing angle and brightness in the x-direction provided by an embodiment of the present disclosure;
[0052] Fig.10b A graph showing the relationship between the viewing angle and brightness in the y direction provided by an embodiment of the present disclosure;
[0053] Fig.11a One of the schematic diagrams of the light mixing effect provided in the embodiment of the present disclosure;
[0054] Fig.11b The second schematic diagram of the light mixing effect provided by the embodiment of the present disclosure;
[0055] Fig.11c The third schematic diagram of the light mixing effect provided by the embodiment of the present disclosure;
[0056] Fig.12 The second schematic diagram of the planar structure of the display screen provided in the embodiment of the present disclosure;
[0057] Fig.13 To adopt Fig.12 Schematic diagram of the light mixing effect of the structure shown;
[0058] Fig.14 The second schematic diagram of the planar structure of the pixel island group provided in the embodiment of the present disclosure;
[0059] Fig.15a A fourth schematic diagram of the light mixing effect provided by the embodiment of the present disclosure;
[0060] Fig.15b A fifth schematic diagram of the light mixing effect provided in the embodiment of the present disclosure;
[0061] Fig.16 A flowchart of a display method for a near-eye display device provided in an embodiment of the present disclosure.
[0062] Among them, 100-display screen, 200-microlens array, 300-imaging lens group, 10-pixel island, 20-pixel island, Z-pixel island group, 20r-red pixel island, 20b-blue pixel island, 20g-green pixel island, 20g1-first green pixel island, 20g2-second green pixel island, r-red sub-pixel unit, g-green sub-pixel unit, b-blue sub-pixel unit, w, w1, w2-white dots. DETAILED DESCRIPTION
[0063] In order to make the above-mentioned purposes, features and advantages of the present disclosure more obvious and easy to understand, the present disclosure will be further described below with reference to the accompanying drawings and examples. However, the example embodiments can be implemented in various forms and should not be understood as being limited to the embodiments described herein; on the contrary, these embodiments are provided to make the present disclosure more comprehensive and complete, and to fully convey the concepts of the example embodiments to those skilled in the art. The same figure marks in the figures represent the same or similar structures, and thus their repeated descriptions will be omitted. The words expressing position and direction described in the present disclosure are all explained using the accompanying drawings as examples, but changes can be made as needed, and the changes made are all included in the scope of protection of the present disclosure. The drawings of the present disclosure are only used to illustrate the relative position relationship and do not represent the true proportion.
[0064] Near-eye display usually refers to a head-mounted display, which can generally be designed in the form of a helmet or glasses. Near-eye display technology uses a micro display screen with an optical system to magnify the image and then form an image in the human eye. The near-eye display system consists of two optical paths for the left eye and the right eye. The two optical paths have the same structure. The images viewed by the left eye and the right eye have a certain parallax, which can eventually be fused into a three-dimensional image in the brain. Currently common near-eye display devices are virtual reality and augmented reality.
[0065] Virtual Reality (VR) technology presents a fully enclosed virtual environment, using display modules to create an immersive viewing experience in a three-dimensional environment. The display principle is that the left and right eye screens display the left and right eye images respectively, and the human eye obtains this different information and creates a three-dimensional sense in the mind.
[0066] Augmented Reality (AR) technology is an enhanced projection method that superimposes virtual scenes on the real environment. AR display can integrate the external environment and the virtual world on the basis of VR display, presenting a vivid interactive experience.
[0067] Figure 1 This is one of the structural schematic diagrams of the near-eye display device provided in an embodiment of the present disclosure.
[0068] like Figure 1 As shown, the near-eye display device includes: a display screen 100 and a microlens array 200 .
[0069] The display screen 100 includes a plurality of pixel islands 10. The pixel islands 10 are used to display a partial image, and the images displayed by all the pixel islands 10 constitute a complete image. The pixel islands 10 include at least two sub-pixel units.
[0070] The microlens array 200 is located at the light-emitting side of the display screen 100 and is used to image the image displayed by the display screen 100. The microlens array 200 includes a plurality of microlenses 20, and one microlens 20 corresponds to one pixel island 10.
[0071] According to the imaging optical path of the virtual image, the pixel island 10 is set within one focal length of the corresponding microlens 20. The light emitted by each sub-pixel unit in the pixel island 10 can be approximately regarded as parallel light incident on the human eye after passing through the microlens 20. After being imaged again by the lens in the human eye, it is imaged on the retina, so that the human eye can see the display image of the display screen 100.
[0072] In specific applications, the left eye and the right eye correspond to an optical system consisting of a display screen 100 and a microlens array 200 respectively. Since there is a certain parallax between the displayed images of the left eye and the right eye, a three-dimensional image can be viewed through brain fusion.
[0073] Only when the fields of view of the light emitted from adjacent pixel islands 10 after being imaged by the corresponding microlenses 20 are continuous, can the human eye see a continuous display image. In order to achieve the effect of continuous field of view, it is necessary to design the imaged light of the light emitted from the sub-pixel unit at the edge position of the pixel island 10 after passing through the microlens 20 to be parallel to the imaged light of the light emitted from the edge sub-pixel unit at the adjacent position of the adjacent pixel island 10 after passing through the microlens 20.
[0074] Figure 2 One of the schematic diagrams of the field of view stitching principle provided in the embodiment of the present disclosure, wherein: Figure 2 The dotted line in is the main light ray among the light rays emitted from the pixel island 10 and passing through the center of the corresponding microlens 20 . The main light ray does not change its propagation direction after passing through the center of the microlens 20 .
[0075] like Figure 2 As shown in FIG. 1 , if the imaging field angle of the outgoing light of each pixel island 10 passing through the corresponding microlens 20 is equal, then the imaging field angle corresponding to a pixel island 10 is equal to Figure 2 The angles between two adjacent main rays are equal, both are θ. If the pixel islands 10 are all set to be square, and the size of a pixel island 10 is m×m, and n×n sub-pixel units are set in a pixel island 10, then the angular resolution of the near-eye display device satisfies the following formula:
[0076]
[0077]
[0078] Where l is the distance between the human eye and the microlens array, and h is the distance between the microlens array and the pixel island.
[0079] It can be seen from the above formula that when the distance h between the microlens array and the pixel island increases, the value of the angular resolution θ becomes smaller, indicating that the angular resolution capability of the near-eye display device is stronger. However, in practical applications, the h value represents the placement height of the microlens array. If the placement height is too large, the overall size of the device will be larger and not light enough.
[0080] In addition, if the resolution of the near-eye display device is reflected according to the final imaging field angle of a sub-pixel unit, the angular resolution of the near-eye display device is θ / n. It can be seen from the formula that the more sub-pixel units a pixel island 10 contains, the greater the angular resolution. However, due to the limitations of the display process, the current display can only achieve a resolution of about 500PPI, which cannot meet the usage requirements.
[0081] In view of this, the embodiments of the present disclosure provide a near-eye display device, which can effectively improve its resolution capability. The near-eye display device provided by the embodiments of the present disclosure can be applied to AR or VR display, which is not limited here.
[0082] Figure 3 The second structural schematic diagram of the near-eye display device provided in the embodiment of the present disclosure.
[0083] like Figure 3 As shown, the near-eye display device includes: a display screen 100 , a microlens array 200 and an imaging lens group 300 .
[0084] The display screen 100 is used to display an image. The display screen 100 includes a plurality of pixel island groups Z, each of which includes at least one pixel island 10, and each pixel island 10 includes a plurality of sub-pixel units. The pixel island group Z is used to display a partial image, and the partial images displayed by each pixel island group Z constitute a complete image.
[0085] The microlens array 200 is located at the light-emitting side of the display screen 100 ; the microlens array 200 includes a plurality of microlenses 20 , and one microlens 20 corresponds to one pixel island 10 ; the microlens 20 is used to form an image displayed by the corresponding pixel island 10 .
[0086] The imaging lens group 300 is located on the side of the microlens array 200 away from the display screen 100, and is used to collimate the imaging light of the microlens. In this way, the collimated light can enter the human eye, and the image is formed by the lens of the human eye and then received by the retina. The human eye can view the display screen 100 through the above-mentioned near-eye display device.
[0087] In order to enable the human eye to observe connected display images, the imaging field angles of the outgoing light rays of adjacent pixel island groups Z after passing through the corresponding microlenses 20 and imaging lens group 300 are continuous with each other.
[0088] Figure 4The second schematic diagram of the field of view stitching principle provided in the embodiment of the present disclosure.
[0089] like Figure 4 As shown, by making the distance between the pixel island 10 and the corresponding microlens 20 smaller than one times the focal length of the microlens; and locating the imaging of the corresponding pixel island 10 by the microlens 20 at the focus of the imaging lens group 300, the imaging of the corresponding pixel island 10 by the microlens 20 can be made into an upright, enlarged virtual image, and the virtual image is located at the focus of the imaging lens group 300, so that the light finally emitted by the imaging lens group 300 can be collimated light. Then, after receiving the above-mentioned collimated light, the human eye can generate an imaging point at an infinite position, so that the display image of the display screen 100 can be viewed at a position suitable for the viewing distance of the human eye.
[0090] By adjusting parameters such as the distance between the microlens array 200 and the imaging lens group 300, the distance between the microlens 20 and the pixel island 10, and the focal length of the imaging lens group 300, the collimated light rays emitted from the sub-pixel units at adjacent positions of the adjacent pixel island groups Z are made parallel to each other after passing through the corresponding microlenses 20 and the imaging lens group 300, so that the angles at which the collimated light rays enter the human eye are the same, thereby achieving continuous imaging field of view angles of adjacent pixel island groups.
[0091] By simultaneously arranging a microlens array and an imaging lens group in a near-eye display device, the angular resolution capability can be improved by changing parameters such as the focal length of the imaging lens group, the focal length of the microlens, and the distance between the imaging lens group and the microlens array. It is not necessary to improve the angular resolution capability by increasing the distance between the microlens array and the display screen, so the near-eye display device can be made lightweight at the same time.
[0092] In order to further improve the resolution of the display screen 100, the display screen 100 in the embodiment of the present disclosure can adopt a silicon-based organic light-emitting diode display screen. Since the silicon-based display process can realize the direct production of display devices on the integrated chip, compared with the traditional display process, the display PPI of the display screen can be increased to 2000-3000, and the number of sub-pixel units under the field of view angle corresponding to a single microlens 20 can be increased.
[0093] As a result, both the imaging resolution and the display resolution of the near-eye display device can be greatly improved.
[0094] like Figure 3 As shown, in order to adjust the distance between the microlens array 200 and the display screen 100, a transparent substrate 400 may be disposed between the display screen 100 and the microlens array 200. The microlens array 200 is located on the surface of the transparent substrate 400 that is away from the display screen 100.
[0095] The thickness of the transparent substrate 400 depends on the parameter adjustment between the microlens array 200 and the display screen 100. If the distance between the microlens 20 and the pixel island 10 needs to be increased, the thickness of the transparent substrate 400 needs to be appropriately increased.
[0096] The transparent substrate 400 supports the microlens array 200 and does not deflect light. Therefore, the transparent substrate 400 can be made of a material with a high transmittance, for example, silicon nitride (Si 2+) which is commonly used in glass substrates of display panels. 3 N 4 ) and other materials. In order to reduce weight, transparent materials such as polymethyl methacrylate (PMMA) can also be used for production, which is not limited here.
[0097] Figure 5 This is a third structural schematic diagram of the near-eye display device provided in an embodiment of the present disclosure.
[0098] like Figure 5 As shown, in order to improve the integration of the near-eye display device, a transparent substrate may not be provided, and the microlens array 200 may be directly provided on the surface of the light-emitting side of the display screen 100, thereby reducing the placement height of the microlens, integrating the microlens array with the display screen, and realizing integrated display.
[0099] It should be noted that the microlens 20 is used to image the corresponding pixel island 10, so the object distance of the microlens 20 is the distance between the microlens 20 and the pixel island 10. The pixel island 10 is a sub-pixel set composed of multiple sub-pixel units in the display screen 100. Therefore, even if the microlens array 200 is directly formed on the surface of the display screen 100, a certain distance can still be maintained between the microlens 20 and the pixel island 10.
[0100] In the embodiment of the present disclosure, each microlens 20 in the microlens array 200 may be a geometric lens, a super lens or an optical diffraction lens.
[0101] Geometric lenses follow the principle of light refraction, and the imaging quality can be improved by designing the surface shape of the microlens. The processing difficulty and cost of geometric lenses are relatively low.
[0102] The superlens is composed of a metamaterial surface and usually has a small thickness. Therefore, using a superlens to image the display image of a display screen can further improve the integration between the display screen and the microlens array.
[0103] Optical diffraction lenses usually have a diffraction structure and have excellent performance in compensating imaging quality and eliminating aberrations and chromatic aberrations.
[0104] When performing optical design, any of the above-mentioned forms of microlenses may be selected according to actual needs, and no limitation is made here.
[0105] On the other hand, the imaging lens group 300 includes at least one lens, and the surface shape of the lens in the imaging lens group is one of a spherical surface, an aspherical surface, a free-form surface or a hypersurface.
[0106] The imaging lens group 300 may use one lens to simplify the structure; alternatively, two, three or more lenses may be used to optimize the imaging quality. The embodiment of the present disclosure does not specifically limit the number of lenses in the imaging lens group 300.
[0107] The surface of the lens in the imaging lens group 300 can be spherical, aspherical, free-form or super-surface. Spherical lenses have advantages such as simple design and low assembly precision requirements. Aspherical lenses and free-form lenses are relatively thin, which can optimize image quality. Super lenses made of metamaterials have a smaller thickness and have advantages that geometric lenses cannot achieve. They can be selected according to actual needs during optical design.
[0108] Each lens in the imaging lens group 300 can be made of optical plastic, such as PMMA or other materials, or can be made of optical glass, such as BK7, ZF6 or other materials, which is not limited here.
[0109] For the convenience of design, the pixel islands 10 in the embodiment of the present disclosure have the same shape and size, and the microlenses 20 have the same shape and size.
[0110] To achieve full-color display, the display screen 100 includes at least two sub-pixel units of two colors. In the disclosed embodiment, the sub-pixel units in the same pixel island 10 have the same color, and the sub-pixel units in different pixel islands 10 in the same pixel island group Z have different colors.
[0111] Figure 6 This is one of the planar structural schematic diagrams of a display screen provided in an embodiment of the present disclosure, Figure 7 This is one of the planar structural schematic diagrams of the pixel island group provided in the embodiment of the present disclosure.
[0112] For example, if Figure 6 and Figure 7As shown, the display screen 100 may include a red sub-pixel unit r, a green sub-pixel unit g, and a blue sub-pixel unit b. Then, a pixel island composed of a plurality of red sub-pixel units r is a red pixel island 20r, a pixel island composed of a plurality of green sub-pixel units g is a green pixel island 20g, and a pixel island composed of a plurality of blue sub-pixel units b is a blue pixel island 20b. A pixel island group Z may include a red pixel island 20r, a green pixel island 20g, and a blue pixel island 20b. The arrangement rules of the sub-pixel units included in the red pixel island 20r, the green pixel island 20g, and the blue pixel island 20b are the same, so that the shapes and sizes of the red pixel islands, the green pixel islands, and the blue pixel islands are the same.
[0113] In the embodiment of the present disclosure, the outgoing light rays of each pixel island 10 including the sub-pixel units of the same color pass through the corresponding microlens 20 and the imaging lens group 300, and the imaging field angles are continuous with each other. There is an intersection between the outgoing light rays of adjacent pixel islands 10 in the same pixel island group Z, and the imaging field angles of the corresponding microlens 20 and the imaging lens group 300.
[0114] Specifically, a pixel island group Z is used to display a partial image. In order to achieve full-color display, the red pixel island 20r in a pixel island group Z can display the red component of the above partial image, the green pixel island 20g can display the green component of the above partial image, and the blue pixel island 20b can display the blue component of the above partial image. The images displayed by the red pixel island 20r, the green pixel island 20g and the blue pixel island 20b in a pixel island group Z are imaged at the same position of the human eye, so that the human eye can fuse a color image in the brain. Therefore, it is required that the images displayed by the pixel islands of each color in each pixel island group Z are images with approximately the same field of view, and the imaging field of view corresponding to adjacent pixel island groups are continuous with each other. By adjusting the distance between the microlens array 200 and the imaging lens group 300, the distance between the microlens 20 and the corresponding pixel island 10, that is, the placement height of the microlens, the focal length of the microlens 20 and the imaging lens group 300 and other parameters, the imaging light rays of the sub-pixel units at adjacent positions of adjacent pixel island groups can be made parallel to each other after passing through the corresponding microlens 20 and the imaging lens group 300, thereby realizing the connection of the imaging field of view angle.
[0115] For example, the pixel island group at the center is the 0th pixel island group, and the pixel island groups arranged on both sides with the 0th pixel island group as the center in a certain direction are the 1st pixel island group and the -1th pixel island group. If the imaging field of view of the 0th pixel island group is -2° to 2°, then the imaging field of view of the 1st pixel island group can be 2° to 4°, and the imaging field of view of the -1st pixel island group can be -4° to -2°.
[0116] In principle, it is hoped that the imaging positions of the pixel islands in a pixel island group Z are the same and the imaging field angles are completely equal, so that different color components can be fused at the same position to form an image display at that position. However, due to the setting of the imaging lens group 300, a certain offset will be generated when the light incident on different positions of the imaging lens group 300 is imaged.
[0117] Figure 8 A schematic diagram of the principle of field of view offset provided for an embodiment of the present disclosure.
[0118] If the light emitted by the sub-pixel unit at a certain position in two adjacent pixel islands 10 is parallel to each other after passing through the corresponding microlens 20 and the imaging lens group 300, the sub-pixel unit at this position in the two pixel islands 10 should be located at the same position in the pixel island and display the same display content. If one of the two light rays is the main light ray passing through the corresponding microlens 20, then for the other light ray, it should also be the main light ray passing through the corresponding microlens. However, in actual applications, such as Figure 8 As shown, due to the effect of the imaging lens group 300, the light on the upper side is not the main light of the corresponding microlens when it is tracked, and a certain offset distance is generated between it and the main light: Δh = h × tanθ. If the above offset problem needs to be corrected, the relative position between the pixel island and its corresponding microlens needs to be changed. However, when the above offset distance is greater than the difference between the lens period and the pixel island size, two pixel islands need to be set at the same position, which obviously cannot achieve such a structural setting.
[0119] Therefore, in order to avoid the problem of a certain offset in the imaging field of view angle mentioned above, the embodiment of the present disclosure does not adjust the setting position of the pixel island in the near-eye display device, but adjusts the display content of the pixel island, so that the same image content is displayed at the same imaging position.
[0120] For the convenience of design, the number of pixel islands contained in each pixel island group Z in the embodiment of the present disclosure is the same, and the imaging field angles of the outgoing light of each pixel island group Z through the corresponding microlens 20 and the imaging lens group 300 are equal, and the imaging field angles corresponding to each pixel island in the same pixel island group Z are also equal. Therefore, in the embodiment of the present disclosure, the imaging field angles corresponding to each pixel island are equal. For example, the imaging field angle corresponding to each pixel island can be 4°.
[0121] The display contents of each pixel island 10 in the same pixel island group Z need to be offset in viewing angle. Fig. 9 A schematic diagram of the field of view angle deviation provided for an embodiment of the present disclosure; Fig.10a A graph showing the relationship between the viewing angle and brightness in the x-direction provided by an embodiment of the present disclosure; Fig.10b A curve diagram showing the relationship between the field of view angle and brightness in the y direction provided in an embodiment of the present disclosure.
[0122] When the pixel islands of each color in the pixel island group Z are arranged as follows Figure 6 When arranged in the manner shown, the red pixel island 20r is located on the right side of the blue pixel island 20b along the x direction, and the green pixel island 20g is located on the lower side of the blue pixel island 20b along the y direction. Then according to theoretical analysis, if the imaging field angle corresponding to each pixel island 20 is 1.8°, as shown in FIG. Fig. 9 As shown, the imaging field angle of the red pixel island 20r is offset to the right by 0.9° in the x direction relative to the imaging field angle of the blue pixel island 20b; the imaging field angle of the green pixel island 20g is offset downward by 0.9° in the y direction relative to the imaging field angle of the blue pixel island 20b.
[0123] like Fig.10a and Fig.10b As shown in the figure, r represents the brightness curve corresponding to the red pixel island, g represents the brightness curve corresponding to the green pixel island, b represents the brightness curve corresponding to the blue pixel island, and r+g+b represents the total brightness curve of the pixel islands of the three colors. Fig.10a and Fig.10b As shown in , the total brightness of the three-color pixel islands is the sum of the brightness of the three-color pixel islands. If the imaging field angle corresponding to each pixel island is 1.8°, such as Fig.10a As shown, the imaging field angle between the red pixel island and the blue pixel island in the x direction differs by 0.8° (approximately 0.9°); Fig.10b As shown, the imaging field angle between the green pixel island and the blue pixel island in the y direction differs by 1° (approximately 0.9°).
[0124] It can be seen that according to theoretical analysis and simulation results, it can be determined that the imaging field of view angles of adjacent pixel islands in the same pixel island group Z are not exactly the same, but will produce a certain field of view angle offset, and the field of view angle offset is half of the size of the imaging field of view corresponding to one pixel island. Therefore, there is also an intersection between the imaging field of view angles of adjacent pixel islands, and the intersection is also half of the imaging field of view angle of one pixel island.
[0125] According to the above analysis, if two adjacent pixel islands in the same pixel island group Z are respectively called the first pixel island and the second pixel island, then when the first pixel island displays the first image corresponding to the field of view angle as the first field of view angle, and the second pixel island displays the second image corresponding to the field of view angle as the second field of view angle, the size of the first field of view angle is equal to the size of the second field of view angle, and the second field of view angle is the first field of view angle offset by half of the first field of view angle along a set direction; wherein the set direction is the arrangement direction of the first pixel island and the second pixel island.
[0126] For example, using Figure 6 When the pixel islands are arranged according to the arrangement rule shown, if the imaging field angle corresponding to the blue pixel island 20b in the x direction is -2° to 2°, and the imaging field angle corresponding to the y direction is -2° to 2°, then the imaging field angle corresponding to the red pixel island 20r in the x direction is 0° to 4°, and the imaging field angle corresponding to the green pixel island 20g in the y direction is -4° to 0°. Using the above-mentioned field angles for image display can make Fig. 9 The red pixel island 20r, the green pixel island 20g and the blue pixel island 20b within the effective field of view within the middle dashed box can display the same content without causing image deviation.
[0127] The mixing of colors by the human eye retina can be divided into several types: Fig.11a This is one of the schematic diagrams of the light mixing effect provided in the embodiment of the present disclosure. Fig.11b The second schematic diagram of the light mixing effect provided by the embodiment of the present disclosure is as follows: Fig.11c The third schematic diagram of the light mixing effect provided in the embodiment of the present disclosure.
[0128] like Fig.11a As shown, the red sub-pixel unit r, the green sub-pixel unit g and the blue sub-pixel unit b are superimposed together to form a white point w. Fig.11b As shown, the red sub-pixel unit r, the green sub-pixel unit g and the blue sub-pixel unit b are separated from each other to form a white point w. Fig.11c As shown, two sub-pixel units of the red sub-pixel unit r, the green sub-pixel unit g and the blue sub-pixel unit b are superimposed together, while the sub-pixel unit of the other color is separated to form a white point w.
[0129] However, when using Figure 6 When the pixel islands are arranged regularly, the space in the area of a pixel island group is not fully utilized, so the embodiment of the present disclosure adds another pixel island to the pixel island group.
[0130] Fig.12 The second schematic diagram of the planar structure of the display screen provided in the embodiment of the present disclosure.
[0131] like Fig.12 As shown, the pixel island group Z includes: a blue pixel island 20b, a red pixel island 20r, a first green pixel island 20g1 and a second green pixel island 20g2. Each sub-pixel unit in the blue pixel island 20b is blue, each sub-pixel unit in the red pixel island 20r is red, and each sub-pixel unit in the first green pixel island 20g1 and the second green pixel island 20g2 is green.
[0132] The blue pixel island 20b, the red pixel island 20r, the first green pixel island 20g1 and the second green pixel island 20g2 are arranged in a square array of two rows and two columns; wherein the blue pixel island 20b and the red pixel island 20r are located on one diagonal line of the square array, and the first green pixel island 20g1 and the second green pixel island 20g2 are located on the other diagonal line of the square array.
[0133] Adding a green pixel island to the original pixel island group structure can improve the overall brightness of the display screen. In addition, after adding a green pixel island, the red sub-pixel unit and the blue sub-pixel unit can mix light with the two green sub-pixel units to produce two white dots, thereby improving the display resolution.
[0134] However, when using Fig.11a and Fig.11c In the mixed light form shown, different color sub-pixel units are superimposed to form white dots, which will cause a waste of resolution. Fig.11b The effect of mixing light by the mixing method shown is as follows Fig.13 As shown in FIG. 1 , taking the light mixing of each sub-pixel unit in a single pixel island group as an example, after adding a green pixel island, the light mixing can produce two white points w1 and w2. However, the two white points w1 and w2 cannot be defined by the product of the number of rows and columns in the traditional sense. Fig.13 For example, Fig.13 The pixel islands in the display have a resolution of 4×4×2 and cannot be defined using the conventional resolution of m×n.
[0135] In view of this, the embodiments of the present disclosure rotate each sub-pixel unit in the pixel island by a set angle, and then the above-mentioned problem can be avoided when mixing light.
[0136] Fig.14 The second schematic diagram of the planar structure of the pixel island group provided in the embodiment of the present disclosure.
[0137] like Fig.14 As shown, the sub-pixel units in the pixel island are arranged in an array, each sub-pixel unit is rectangular in shape, and one of the sides of the sub-pixel unit forms a set angle with the arrangement direction of the row where the sub-pixel unit is located. In practical applications, the above angle can be set to 45°.
[0138] Specifically, a pixel island group Z includes a blue pixel island 20b, a red pixel island 20r, a first green pixel island 20g1 and a second green pixel island 20g2. The sub-pixel units in each pixel island are rotated 45°. At this time, if light mixing is performed in an overlapping or staggered manner, the display resolution can be defined in a traditional manner.
[0139] Fig.15aThe fourth schematic diagram of the light mixing effect provided by the embodiment of the present disclosure is as follows: Fig.15b This is the fifth schematic diagram of the light mixing effect provided in the embodiment of the present disclosure.
[0140] like Fig.15a As shown, when sub-pixel units of different colors in a pixel island group are mixed in an overlapping manner, the two white points w1 and w2 generated can be arranged alternately along the rows and columns of the sub-pixel units, respectively, so that the display resolution of a pixel island group is 7×7.
[0141] like Fig.15b As shown, when sub-pixel units of different colors in a pixel island group are mixed in an interlaced manner, the two white points w1 and w2 generated can be alternately arranged along the rows and columns of the sub-pixel units, respectively, so that the display resolution of a pixel island group is 6×8.
[0142] It can be seen that as long as the placement direction of the sub-pixel unit is adjusted and a suitable light mixing method is used, the position of the white point generated after light mixing can be adjusted, thereby defining the display resolution in a traditional way to meet actual usage requirements.
[0143] On the other hand, an embodiment of the present disclosure provides a display method of a near-eye display device, Fig.16 A flowchart of a display method for a near-eye display device provided in an embodiment of the present disclosure.
[0144] like Fig.16 As shown, a display method of a near-eye display device includes:
[0145] S10, determining the imaging field angle corresponding to each pixel island group in the display screen;
[0146] S20, loading image data within the corresponding imaging field of view angle into each pixel island group.
[0147] The display image of the display screen corresponds to a certain field of view angle range. The disclosed embodiment uses pixel islands for image display, and the imaging field of view angles of the pixel island groups are continuous with each other. Each pixel island group is only used to display part of the image within a part of the field of view angle. Then, when driving the image, the imaging field of view angle corresponding to each pixel island group in each display screen can be determined first, and then the image data corresponding to the imaging field of view angle can be loaded into each sub-pixel unit in the corresponding pixel island to realize image display.
[0148] In the specific implementation, for the convenience of design, the imaging field angles corresponding to each pixel island group are equal, and the ranges of the imaging field angles of adjacent pixel island groups are continuous. However, since the imaging lens group is set in the near-eye display device in the embodiment of the disclosure, it will cause the deviation of the field angle. Therefore, the embodiment of the disclosure can directly offset the field angle when loading image data, so that the display image within the effective field of view will not be deviated.
[0149] Specifically, the pixel island group includes at least an adjacent first pixel island and a second pixel island, the colors of the sub-pixel units in the first pixel island are the same, the colors of the sub-pixel units in the second pixel island are the same, and the colors of the sub-pixel units in the first pixel island and the second pixel island are different; the imaging field of view corresponding to the first pixel island is a first field of view, and the imaging field of view corresponding to the second pixel island is a second field of view.
[0150] In order to achieve full-color display, the pixel island group may generally include a red pixel island, a green pixel island and a blue pixel island. The red pixel island includes only red sub-pixel units, the green pixel island includes only green sub-pixel units, and the blue pixel island includes only blue sub-pixel units. In principle, the imaging field angles of each pixel island of different colors in the pixel island group should be equal, so that each pixel island can be imaged at the same position and fused into a color image. It is precisely because an imaging lens group is set in the near-eye display device that the imaging field of view will have a certain offset. When the imaging field angles of each pixel island are equal in size, the imaging field angles of adjacent pixel islands will offset by half the size of the field angle. Therefore, in the above-mentioned step S20, the image data within the corresponding imaging field angle is loaded into each pixel island group, specifically including:
[0151] Applying image data within a first imaging field angle to a first pixel island in each pixel island group;
[0152] Applying image data within a second field of view angle to a second pixel island in each pixel island group;
[0153] The second viewing angle is a viewing angle obtained by shifting the first viewing angle by half of the first viewing angle along a set direction; the set direction is an arrangement direction of the first pixel island and the second pixel island.
[0154] Specifically, when using Figure 6When the pixel islands are arranged according to the arrangement rule shown, the blue pixel island 20b and the red pixel island 20r are adjacent in the x direction, so the blue pixel island 20b and the red pixel island 20r can be regarded as the adjacent first pixel island and the second pixel island mentioned above. According to the principle analysis and simulation results, it can be determined that the field of view offset generated by the adjacent pixel islands is half of the field of view size. Therefore, if the imaging field of view corresponding to the blue pixel island 20b in the x direction is -2° to 2°, then the imaging field of view corresponding to the red pixel island 20r in the x direction is 0° to 4°. Similarly, the blue pixel island 20b and the green pixel island 20g are adjacent in the y direction, so the blue pixel island 20b and the green pixel island 20g can be regarded as the adjacent first pixel island and the second pixel island mentioned above. If the imaging field of view corresponding to the blue pixel island in the y direction is -2° to 2°, then the imaging field of view corresponding to the green pixel island 20g in the y direction is -4° to 0°. When driving an image, the blue pixel island 20b can be loaded with image data corresponding to -2° to 2° in the x and y directions, the red pixel island 20r can be loaded with image data corresponding to 0° to 4° in the x direction, and the green pixel island 20g can be loaded with image data corresponding to -4° to 0° in the y direction, so that Fig. 9 Normal image display is performed in the effective field of view within the dotted frame, and for the area outside the dotted frame, the image data of the sub-pixel unit at the corresponding position can be controlled to be 0, so that the area outside the dotted frame displays a black picture.
[0155] Although the preferred embodiments of the present disclosure have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present disclosure.
[0156] Obviously, those skilled in the art can make various changes and modifications to the embodiments of the present disclosure without departing from the spirit and scope of the embodiments of the present disclosure. Thus, if these modifications and variations of the embodiments of the present disclosure fall within the scope of the claims of the present disclosure and their equivalents, the present disclosure is also intended to include these modifications and variations.
Claims
1. A near-eye display device, comprising: A display screen for displaying an image; the display screen comprises a plurality of pixel island groups, the pixel island group comprises at least one pixel island, the pixel island comprises a plurality of sub-pixel units; the sub-pixel units in the same pixel island have the same color, and the sub-pixel units in different pixel islands in the same pixel island group have different colors; A microlens array is located at the light-emitting side of the display screen; the microlens array includes a plurality of microlenses, one microlens corresponds to one pixel island; the microlens is used to image the image displayed by the corresponding pixel island; and An imaging lens group, located on a side of the microlens array away from the display screen, and used for collimating the imaging light of the microlens; Among them, the pixel island groups are used to display partial images, and the partial images displayed by each pixel island group constitute a complete image; the outgoing light rays of adjacent pixel island groups pass through the corresponding microlenses and the imaging lens group to be continuous with each other in imaging field angles, and the outgoing light rays of each pixel island containing sub-pixel units of the same color pass through the corresponding microlenses and the imaging lens group to be continuous with each other in imaging field angles.
2. The near-eye display device according to claim 1, wherein: The distance between the pixel island and the corresponding microlens is less than one times the focal length of the microlens; The imaging of the corresponding pixel island by the microlens is located at the focus of the imaging lens group.
3. The near-eye display device according to claim 1, wherein: There is an intersection between the imaging field angles of the emergent light rays of adjacent pixel islands in the same pixel island group passing through the corresponding microlenses and the imaging lens group.
4. The near-eye display device according to claim 3, wherein: The number of pixel islands included in each pixel island group is the same; the imaging field angles of the outgoing light rays of each pixel island group passing through the corresponding microlens and the imaging lens group are equal.
5. The near-eye display device according to claim 4, wherein: The intersection of the imaging field angles of adjacent pixel islands in the same pixel island group is half of the imaging field angle of one pixel island.
6. The near-eye display device according to claim 5, wherein: Two adjacent pixel islands in the same pixel island group are respectively a first pixel island and a second pixel island, wherein the first pixel island displays a first image and the second pixel island displays a second image; The field of view angle corresponding to the first image is a first field of view angle, the field of view angle corresponding to the second image is a second field of view angle, the size of the first field of view angle is equal to the size of the second field of view angle, and the second field of view angle is half of the first field of view angle offset along a set direction; wherein the set direction is the arrangement direction of the first pixel island and the second pixel island.
7. The near-eye display device according to any one of claims 1 to 6, wherein: The pixel island group includes: a blue pixel island, a red pixel island, a first green pixel island and a second green pixel island; wherein each sub-pixel unit in the blue pixel island is blue, each sub-pixel unit in the red pixel island is red, and each sub-pixel unit in the first green pixel island and the second green pixel island is green; The blue pixel island, the red pixel island, the first green pixel island and the second green pixel island are arranged in a square array of two rows and two columns; wherein the blue pixel island and the red pixel island are located on one diagonal line of the square array, and the first green pixel island and the second green pixel island are located on another diagonal line of the square array.
8. The near-eye display device according to claim 7, wherein: The sub-pixel units in the pixel island are arranged in an array, each sub-pixel unit is in a rectangular shape, and one side of the sub-pixel unit forms a set angle with the arrangement direction of the row where the sub-pixel unit is located.
9. The near-eye display device according to claim 8, wherein: The set angle is 45°.
10. The near-eye display device according to any one of claims 1 to 6, wherein: The pixel islands have the same shape and size, and the micro lenses have the same shape and size.
11. The near-eye display device according to any one of claims 1 to 6, wherein: The microlens is a geometric lens, a super lens or an optical diffraction lens.
12. The near-eye display device according to any one of claims 1 to 6, wherein: The display screen is a silicon-based organic light-emitting diode display screen.
13. The near-eye display device according to claim 12, wherein: The number of sub-pixel units contained in a unit area of the display screen is 2000-3000.
14. The near-eye display device according to any one of claims 1 to 6, wherein: The imaging lens group includes at least one lens; The surface shape of the lens in the imaging lens group is one of a spherical surface, an aspherical surface, a free-form surface or a hypersurface.
15. The near-eye display device according to any one of claims 1 to 6, further comprising: A transparent substrate, located between the display screen and the microlens array; Wherein, the microlens array is located on the surface of the transparent substrate facing away from the display screen.
16. The near-eye display device according to claim 15, wherein: The material of the transparent substrate is one of silicon nitride and polymethyl methacrylate.
17. The near-eye display device according to any one of claims 1 to 6, wherein: The micro lens array is located on the surface of the light emitting side of the display screen.
18. A display method of a near-eye display device, comprising: Determine the imaging field angle corresponding to each pixel island group in the display screen; Loading image data within a corresponding imaging field angle into each of the pixel island groups; The pixel island group includes at least a first pixel island and a second pixel island that are adjacent to each other, the sub-pixel units in the first pixel island have the same color, the sub-pixel units in the second pixel island have the same color, and the sub-pixel units in the first pixel island and the second pixel island have different colors; the imaging field of view corresponding to the first pixel island is a first field of view, and the imaging field of view corresponding to the second pixel island is a second field of view; The step of loading the image data within the corresponding imaging field angle into each pixel island group comprises: Applying image data within the first field of view angle to the first pixel islands in each of the pixel island groups; Applying image data within the second field of view angle to the second pixel islands in each of the pixel island groups; The second field of view angle is a field of view angle obtained by shifting the first field of view angle by half of the first field of view angle along a set direction; the set direction is an arrangement direction of the first pixel island and the second pixel island.
Citation Information
Patent Citations
Near-to-eye display method and device and wearable equipment
CN111638600A
Display panel, display device and display method
WO2020113428A1