Light beam shifting device, image resolution improving module and near-to-eye display equipment

Abstract

The utility model discloses a light beam offset device, an image resolution improving module and a near-to-eye display device, the light beam offset device comprises a light beam offset element and a driving device, the driving device is used for driving the light beam offset element to deflect N times in each period, and enabling the light beam offset element to sequentially go through an initial state and N-1 deflection states in each period, so that T low-pixel sub-images displayed by the image display device pass through the light beam offset element and the projection lens and then correspondingly output one non-offset sub-image and N-1 offset sub-images to human eyes in sequence, therefore, human eyes can feel a high-pixel image obtained by fusing and superposing one non-shifted sub-image and N-1 shifted sub-images; wherein N and T are integers, N > = 2, and 1 < = T < = N. According to the utility model, small volume can be realized and high-definition pictures can be provided.

Description

Technical Field

[0001] This utility model relates to the field of projection display technology, and in particular to a beam shifting device, an image resolution enhancement module, and a near-eye display device. Background Technology

[0002] Near-eye display devices, as an emerging technology, can project images from a microdisplay screen to the vicinity of a user's eyes, enabling virtual reality or augmented reality experiences, and have thus attracted much attention.

[0003] However, the key to enabling users to wear this near-eye display device comfortably for extended periods lies in reducing its weight and size. However, focusing solely on weight and size reduction will lead to a decrease in the resolution of the image resolution enhancement module within the near-eye display device, failing to provide high-definition visuals. Therefore, there is a need for a near-eye display device that can be compact yet deliver high-definition images. Utility Model Content

[0004] In view of the above problems, the purpose of this utility model is to provide a beam deflection device, an image resolution enhancement module, and a near-eye display device that can achieve small size and provide high-definition images.

[0005] This invention provides a beam shifting device for an image resolution enhancement module. The image resolution enhancement module includes an image display device and a projection lens. The beam shifting device includes a beam shifting element and a driving device. The driving device drives the beam shifting element to deflect N times in each cycle, so that the beam shifting element sequentially experiences an initial state and N-1 deflection states in each cycle. This allows the T low-pixel sub-images displayed by the image display device to be passed through the beam shifting element and the projection lens, and then sequentially output to the human eye one unshifted sub-image and N-1 shifted sub-images. This allows the human eye to perceive a high-pixel image obtained by fusing and superimposing one unshifted sub-image and N-1 shifted sub-images. Here, N and T are integers, and N≥2, 1≤T≤N.

[0006] This invention provides an image resolution enhancement module, comprising an image display device, a projection lens, and the aforementioned beam shifting device. The image display device is equipped with at least one micro-display screen. The image display device is used to receive T low-pixel sub-images obtained by sampling an original high-pixel image from an image processing module, wherein the pixel difference between the original high-pixel image and the low-pixel sub-images is M. In each cycle, the image display device sequentially displays T low-pixel sub-images, which, after passing through the projection lens and the beam shifting device, sequentially output one unshifted sub-image and N-1 shifted sub-images to the human eye, thereby allowing the human eye to perceive a high-pixel image obtained by fusing and superimposing one unshifted sub-image and N-1 shifted sub-images. Herein, N, M, and T are integers, and 2≤N≤M, 1≤T≤N.

[0007] This utility model also provides a near-eye display device, including the above-mentioned image resolution enhancement module and power supply unit, wherein the power supply unit is connected to the image display device and the beam deflection device in the image resolution enhancement module.

[0008] The beam shifting device, image resolution enhancement module, and near-eye display device provided by this invention deflect light N times in each cycle. T low-pixel sub-images displayed by the image display device are then passed through the beam shifting element and projection lens, and sequentially output to the human eye one unshifted sub-image and N-1 shifted sub-images. This projects multiple sub-images with subtle differences in detail generated by the image display device into the human eye from different directions. Utilizing the persistence of vision, the user can perceive a high-pixel image obtained by merging and superimposing the unshifted sub-image and the N-1 shifted sub-images. Therefore, this invention achieves a small size while providing high-definition images. Attached Figure Description

[0009] Figure 1 A cross-sectional schematic diagram of an image resolution enhancement module according to an embodiment of this application is shown.

[0010] Figure 2 A cross-sectional schematic diagram of a beam deflection device according to an embodiment of this application is shown.

[0011] Figure 3 A schematic diagram of the planar structure of a beam deflection device according to an embodiment of this application is shown.

[0012] Figure 4 A schematic diagram of the planar structure of the beam deflection device in another embodiment of this application is shown.

[0013] Figure 5A cross-sectional schematic diagram of the thickness deformation and image height offset generated by the deflection of the tunable lens in one embodiment of this application is shown.

[0014] Figure 6 A cross-sectional schematic diagram of a beam deflection element in another embodiment of this application is shown.

[0015] Figure 7 A cross-sectional schematic diagram of a beam deflection element in another embodiment of this application is shown.

[0016] Figure 8 A schematic diagram of the structure of an image resolution enhancement module in one embodiment of this application is shown.

[0017] Figure 9 A schematic diagram of the structure of an image resolution enhancement module in another embodiment of this application is shown.

[0018] Figure 10 A schematic diagram of the corresponding structure of the tunable lens for pixel unit offset in one embodiment of this application is shown.

[0019] Figure 11 A schematic diagram of the pixel unit offset orientation is shown in one embodiment of this application.

[0020] Figure 12 A schematic diagram of the structure of an tunable lens in eight states according to an embodiment of this application is shown.

[0021] Figure 13 A schematic diagram illustrating the workflow of image fusion using an image resolution enhancement method according to an embodiment of this application is shown.

[0022] Figure 14 A schematic diagram of a frame of original high-resolution image according to an embodiment of this application is shown.

[0023] Figures 15A to 15D A schematic diagram of four low-pixel sub-images sampled in one embodiment of this application is shown.

[0024] Figures 16A to 16D This illustration shows a flowchart of how the human eye fuses and superimposes four low-pixel sub-images to obtain a high-pixel image in one embodiment of this application.

[0025] Figure 17 A schematic diagram of a frame of original high-resolution image is shown in another embodiment of this application.

[0026] Figures 18A to 18D A schematic diagram of four low-pixel sub-images sampled in another embodiment of this application is shown.

[0027] Figures 19A to 19DThis illustration shows a flowchart of how the human eye fuses and superimposes four low-pixel sub-images to obtain a high-pixel image in another embodiment of this application.

[0028] Figure 20 A schematic diagram of a frame of original high-resolution image is shown in another embodiment of this application.

[0029] Figures 21A to 21B A schematic diagram of two low-pixel sub-images sampled in another embodiment of this application is shown.

[0030] Figures 22A to 22B This illustration shows a flowchart of how the human eye fuses and superimposes two low-pixel sub-images to obtain a high-pixel image, according to another embodiment of this application.

[0031] Figure 23 A schematic diagram of a frame of original high-resolution image is shown in another embodiment of this application.

[0032] Figures 24A to 24B A schematic diagram of two low-pixel sub-images sampled in another embodiment of this application is shown.

[0033] Figures 25A to 25B This illustration shows a flowchart of how the human eye fuses and superimposes two low-pixel sub-images to obtain a high-pixel image, according to another embodiment of this application.

[0034] Figure 26 A schematic diagram illustrating the workflow of image fusion using an image resolution enhancement method according to another embodiment of this application is shown.

[0035] Figure 27 A schematic diagram of a frame of original high-resolution image is shown in another embodiment of this application.

[0036] Figure 28 A schematic diagram of a low-pixel sub-image sampled in another embodiment of this application is shown.

[0037] Figures 29A to 29D This illustration shows a flowchart of how the human eye fuses and superimposes a low-pixel sub-image to obtain a high-pixel image, according to another embodiment of this application.

[0038] Figure 30 A simulation diagram showing the effect comparison of the image resolution enhancement module in one embodiment of this application is shown.

[0039] Figure 31 A cross-sectional schematic diagram of the image resolution enhancement module of Embodiment 1 of this application is shown.

[0040] Figure 32 A cross-sectional schematic diagram of the image resolution enhancement module of Embodiment 2 of this application is shown.

[0041] Figure 33 A cross-sectional schematic diagram of the image resolution enhancement module of Embodiment 3 of this application is shown.

[0042] Figure 34 A cross-sectional schematic diagram of the image resolution enhancement module of Embodiment 4 of this application is shown.

[0043] Figure 35 A cross-sectional schematic diagram of the image resolution enhancement module of Embodiment 5 of this application is shown.

[0044] Figure 36 A cross-sectional schematic diagram of the image resolution enhancement module of Embodiment 6 of this application is shown.

[0045] Figure 37 A cross-sectional schematic diagram of the image resolution enhancement module of Embodiment 7 of this application is shown.

[0046] Figure 38 A cross-sectional schematic diagram of the image resolution enhancement module of Embodiment 8 of this application is shown.

[0047] Figure 39 A cross-sectional schematic diagram of the image resolution enhancement module of Embodiment 9 of this application is shown. Detailed Implementation

[0048] The present application will now be described in detail with reference to the accompanying drawings and embodiments. Figure 1 A cross-sectional schematic diagram of an image resolution enhancement module in one embodiment of this application is shown, wherein the image resolution enhancement module includes a beam deflection device 20.

[0049] like Figure 2 As shown, the beam shifting device 20 according to an exemplary embodiment of this application includes a beam shifting element 21 and a driving device 22. The beam shifting element 21 and the driving device 22 are connected. The driving device 22 is used to drive the beam shifting element 21 to deflect N times in each cycle, so that the beam shifting element 21 sequentially experiences an initial state and N-1 deflection states in each cycle. This is so that after the T low-pixel sub-images displayed by the image display device 11 pass through the beam shifting element 21 and the projection lens 12, one unshifted sub-image and N-1 shifted sub-images are sequentially output to the human eye 40, so that the human eye 40 perceives a high-pixel image obtained by fusing and superimposing one unshifted sub-image and N-1 shifted sub-images. Wherein, N and T are integers, and N≥2, 1≤T≤N.

[0050] In the first exemplary embodiment, when the beam deflection element 21 is in a deflection state, the beam deflection element 21 is wedge-shaped as a whole.

[0051] In the first exemplary embodiment, such as Figure 2As shown, the beam deflection element 21 is a tunable lens 21A. The tunable lens 21A includes a first transparent plate 211, a second transparent plate 212, and a compressible medium 213 disposed between the first transparent plate 211 and the second transparent plate 212. The driving device 22 includes at least one control electrode 221 disposed on the first transparent plate 211 and / or the second transparent plate 212. The control electrode 221 is used to drive the first transparent plate 211 and / or the second transparent plate 212 to deflect. Generally, the control electrode 221 is disposed on the outer surface of the first transparent plate 211 away from the second transparent plate 212 and / or on the outer surface of the second transparent plate 212 away from the first transparent plate 211.

[0052] When the tunable lens 21A is in the initial state, the first transparent plate 211 and the second transparent plate 212 are parallel to each other so that the tunable lens 21A is in a plate shape; when the tunable lens 21A is in a deflection state, the first transparent plate 211 and / or the second transparent plate 212 deflect and squeeze the compressible medium 213 so that the tunable lens 21A is in a wedge shape.

[0053] In an exemplary embodiment, the following condition can be satisfied: 1.5 ≤ n1 ≤ 1.9, where the refractive index of the first transparent plate 211 and the second transparent plate 212 is n1. Satisfying 1.5 ≤ n1 ≤ 1.9, and controlling the range of values ​​for the refractive index n1 of the first transparent plate 211 and the second transparent plate 212, facilitates precise control of the light propagation direction, thereby enabling the tunable lens 21A to control the deflection angle of the light. The materials of the first transparent plate 211 and the second transparent plate 212 can be glass, etc.

[0054] In an exemplary embodiment, the following condition can be satisfied: 1.5 ≤ n2 ≤ 1.65, where the refractive index of the compressible medium 213 is n2. Satisfying 1.5 ≤ n2 ≤ 1.65 controls the range of values ​​for the refractive index n2 of the compressible medium 213, which is beneficial for matching the refractive index n2 of the compressible medium 213 with the refractive index n1 of the first transparent plate 211 and the second transparent plate 212. This reduces the reflection and scattering losses of light passing through the interface of media with different refractive indices, and also enables accurate control of the deflection angle of light by the tunable lens 21A.

[0055] In an exemplary embodiment, the following condition can be satisfied: 1 / 20λ≤PV≤1 / 4λ, where the peak-to-valley value of the first transparent plate 211 and the second transparent plate 212 is PV, and λ is 310 nanometers. The PV value (Peak to Valley) of the glass plate represents a key indicator of its surface shape quality, that is, the vertical height difference between the highest and lowest points of the measured glass surface within the measurement area, and is mainly used to evaluate the processing accuracy and optical performance of the glass plate. Satisfying 1 / 20λ≤PV≤1 / 4λ, and controlling the range of PV values ​​for the first transparent plate 211 and the second transparent plate 212, helps to reduce aberrations such as spherical aberration and coma caused by surface unevenness of the first transparent plate 211 and the second transparent plate 212, thereby improving imaging resolution. The tunable lens 21A can then effectively control the propagation path of light, improving the optical performance of the system.

[0056] In an exemplary embodiment, the following conditions can be met: 0°≤θ≤0.3°, 0μm≤d2≤20μm, where the single-sided deflection angle of the tunable lens 21A is θ, and the single-sided edge thickness change is d2. By satisfying 0°≤θ≤0.3° and 0μm≤d2≤20μm, and controlling the range of values ​​for the single-sided deflection angle θ and the single-sided edge thickness change d2 of the tunable lens 21A, it is beneficial to achieve precise control of the light propagation direction, thereby realizing the control of the deflection angle of the light by the tunable lens 21A. If, during the deflection of the beam shifting device 20, only one transparent plate is deflected while the other transparent plate is not deflected, i.e., only one transparent plate experiences a single-sided deflection angle θ and a single-sided edge thickness change d2, then correspondingly, the beam shifting device 20 experiences a deflection angle θ and a thickness deformation Δt=d2.

[0057] In an exemplary embodiment, the first transparent plate 211 and the second transparent plate 212 can be made of transparent glass or transparent plastic.

[0058] In an exemplary embodiment, the material of the compressible medium 213 can be a liquid or an elastically compressible solid. Specifically, the liquid can be liquid crystal, oil, water, or a mixture of the above substances, and the solid can be silicone resin, polymer gel, etc.

[0059] In an exemplary embodiment, the control electrode 221 is disposed on the surface of the first transparent plate 211 away from the second transparent plate 212 and / or on the surface of the second transparent plate 212 away from the first transparent plate 211, and the control electrode 221 is disposed at the edge position of the tunable lens 21A.

[0060] In an exemplary embodiment, the tunable lens 21A has a rectangular structure, and the control electrode 221 is disposed at the apex corner of the tunable lens 21A and / or at the midpoint of the rectangular side.

[0061] In one exemplary implementation, such as Figure 3 As shown, the control electrodes 221 are located at the four apex positions of the tunable lens 21A.

[0062] In another exemplary embodiment, such as Figure 4 As shown, the control electrode 221 is located at the midpoint of the four rectangular sides of the tunable lens 21A.

[0063] In another exemplary embodiment, control electrodes 221 may also be provided at the four apex positions and the midpoint positions of the four rectangular sides of the tunable lens 21A.

[0064] In an exemplary implementation, such as Figure 2 As shown, the driving line 222 is connected to the control electrode 221. The driving line 222 is disposed on the side of the first transparent plate 211 away from the second transparent plate 212 and extends outward from the beam deflection element 21. In other embodiments, the driving line 222 may also extend inward from the beam deflection element 21.

[0065] In an exemplary embodiment, the projection lens 12 is located between the beam shifting device 20 and the image display device 11, satisfying the condition: 1.5 < ΔIH / Δt < 5, where the thickness deformation of the tunable lens 21A is Δt, and its image height shift is ΔIH. By ensuring that the projection lens 12 is located between the beam shifting device 20 and the image display device 11, and that 1.5 < ΔIH / Δt < 5, controlling the ratio of the thickness deformation Δt to the image height shift ΔIH of the tunable lens 21A is advantageous for achieving a larger image height shift effect with a smaller deformation.

[0066] In an exemplary implementation, such as Figure 5 As shown, the beam shifting device 20 is located between the projection lens 12 and the image display device 11, satisfying the condition: 1 < ΔIH / Δt < 3, where the thickness deformation of the tunable lens 21A is Δt, and its image height shift is ΔIH. By satisfying that the beam shifting device 20 is located between the projection lens 12 and the image display device 11, and 1 < ΔIH / Δt < 3, controlling the ratio of the thickness deformation Δt to the image height shift ΔIH of the tunable lens 21A allows for a larger deformation for the same image height shift effect, thus achieving higher control precision.

[0067] Figure 6 A cross-sectional schematic diagram of a beam deflection element is shown in another embodiment of this application. In another exemplary embodiment, such as Figure 6As shown, the beam deflection element 21 is a transparent wedge lens 21B. The transparent wedge lens 21B is wedge-shaped, and its two opposite surfaces are a first plane 214 and an inclined plane 215, respectively. The inclined plane 215 is inclined relative to the first plane 214. The inclination angle of the inclined plane 215 relative to the first plane 214 is greater than 0° and less than 90°, for example, greater than 0° and less than or equal to 60°, or 5° to 60°, or 5° to 30°. In use, it is preferable to place the inclined plane 215 of the transparent wedge lens 21B close to the image display device 11, that is, the inclined plane 215 is located between the first plane 214 and the image display device 11.

[0068] In an exemplary embodiment, the transparent wedge lens 21B can be a single optical element, which is a single piece of transparent wedge-shaped structure, such as a single piece of transparent wedge-shaped glass plate. Alternatively, the transparent wedge lens 21B can be a combination of multiple optical elements, the overall shape of which is a wedge shape, and the relative positions of each optical element are fixed, making the wedge structure fixed and unchangeable. For example, the transparent wedge lens 21B may include two transparent flat plates whose surfaces are not parallel and are relatively fixed. A medium, such as air, glue, or other materials, may be disposed between the two transparent flat plates. In other embodiments, the transparent wedge lens 21B may also include multiple transparent wedge-shaped glass plates, which together form a wedge-shaped beam deflection element 21. Alternatively, the aforementioned medium may be disposed between the multiple transparent wedge-shaped glass plates, with the multiple transparent wedge-shaped glass plates and the medium together forming a wedge-shaped beam deflection element 21.

[0069] Figure 7 A cross-sectional schematic diagram of a beam deflection element is shown in another embodiment of this application. In another exemplary embodiment, such as Figure 7 As shown, the beam deflection element 21 is a transparent flat plate lens 21C. The transparent flat plate lens 21C is flat, and the surfaces on opposite sides of the transparent flat plate lens 21C are a second plane 216 and a third plane 217, respectively. The second plane 216 and the third plane 217 are parallel to each other.

[0070] In an exemplary embodiment, the transparent flat plate lens 21C can be an optical element, which is a single transparent flat plate structure, such as a single piece of transparent glass. The transparent flat plate lens 21C can also be a combination of multiple optical elements, the overall shape of which is a flat plate structure, and the relative positions of each optical element are fixed, making the flat plate structure fixed and unchangeable. For example, the transparent flat plate lens 21C can include multiple stacked transparent plates; or, the transparent flat plate lens 21C can include two transparent plates, the surfaces of which are parallel and relatively fixed, and a medium can be provided in the middle of the two transparent plates, which can be air, glue, or other media.

[0071] When the beam deflection element 21 is a transparent wedge lens 21B or a transparent flat lens 21C, the driving device 22 can be a voice coil motor (VCM). The main principle of a voice coil motor is that within a permanent magnetic field, by changing the magnitude of the DC current in the coil inside the motor, the coil generates different magnitudes of magnetic repulsive force, thereby controlling the stretching position of the spring sheet, which in turn drives the component supported by the spring sheet to move up and down or deflect. Currently, VCMs are widely used in the lens driving of mobile phone cameras. In an exemplary embodiment, the beam deflection element 21 is disposed inside the voice coil motor, and the voice coil motor can drive the beam deflection element 21 to deflect.

[0072] When the beam shifting element 21 is a transparent wedge lens 21B or a transparent flat lens 21C, the driving device 22 can also use shape memory alloys (SMA). Multiple SMA lines can be configured to support the beam shifting element 21. By applying or removing current to the SMA lines, the SMA lines can be controlled to contract or expand, thereby causing the beam shifting element 21 to deflect. Currently, SMA is widely used in optical image stabilization (OIS) of mobile phone lenses.

[0073] In other embodiments, the driving device 22 may also be a piezoelectric motor or other driving motors, which will not be listed here.

[0074] It should be noted that this application is not limited to the beam deflection element 21 being a tunable lens 21A, a transparent wedge lens 21B, or a transparent flat lens 21C. The beam deflection element 21 can also be of other structural shapes, can be deflected multiple times, and can be used to allow light to enter the human eye 40 from different directions, all of which are within the scope of protection of this application.

[0075] In an exemplary embodiment, the following condition can be met: 0.1mm ≤ d1 ≤ 2mm, where the thickness of the beam deflection device 20 is d1. By satisfying 0.1mm ≤ d1 ≤ 2mm and controlling the range of the thickness d1 of the beam deflection device 20, the thickness of the image resolution enhancement module can be controlled, which is beneficial for miniaturizing near-eye display devices.

[0076] In an exemplary embodiment, the driving device 22 drives the beam deflection element 21 to deflect N times in each cycle, where N satisfies: 2 ≤ N ≤ 9. Preferably, N = 2, or N = 4. When the number of deflections of the beam deflection element 21 in each cycle is different, the image resolution ultimately entering the human eye 40 will be improved with different display effects.

[0077] In an exemplary embodiment, the projection lens 12 is located between the beam shifting device 20 and the image display device 11; when the beam shifting element 21 is in a deflection state, the beam shifting element 21 shifts the image height by 0.2p to 0.8p.

[0078] Alternatively, the beam shifting device 20 is located between the projection lens 12 and the image display device 11; when the beam shifting element 21 is in the deflection state, the beam shifting element 21 and the projection lens 12 shift the image height by 0.2p to 0.8p.

[0079] The following describes how the image resolution enhancement module uses a beam offset element 21 to sequentially output one unoffset sub-image and N-1 offset sub-images to the human eye 40, so that the human eye 40 perceives a high-pixel image obtained by fusing and superimposing one unoffset sub-image and N-1 offset sub-images, thus realizing the process of image resolution enhancement.

[0080] The image resolution enhancement module includes an optical engine 10 and a beam shifting device 20. The optical engine 10 includes an image display device 11 and a projection lens 12. The image display device 11 includes at least one microdisplay 111. The image display device 11 is used to receive T low-pixel sub-images obtained by sampling the original high-pixel image by the image processing module 30. The original image is a high-pixel image. Since the resolution of the microdisplay 111 is low, it cannot display the high-pixel image completely. Therefore, it is necessary to first sample the high-pixel image into low-pixel sub-images in a certain form, and then transmit one or more (i.e., T) low-pixel sub-images obtained by sampling to the microdisplay 111 for display. Then, the beam shifting element 21 is used to make the T low-pixel sub-images displayed by the image display device 11 pass through the beam shifting element 21 and the projection lens 12 and output one unshifted sub-image and N-1 shifted sub-images to the human eye 40 in sequence, so that the human eye 40 perceives a high-pixel image obtained by fusing and superimposing one unshifted sub-image and N-1 shifted sub-images.

[0081] It should be noted that this application does not limit the location of the image processing module 30, such as Figure 8 As shown, the image processing module 30 and the image resolution enhancement module can be housed in the same device, for example, both can be housed in a near-eye display device; wherein, the image processing module 30 can be integrated into the image resolution enhancement module, or the image processing module 30 and the image resolution enhancement module can be housed independently in the near-eye display device. Figure 9 As shown, the image processing module 30 and the image resolution enhancement module can also be located in different devices. For example, the image resolution enhancement module can be located in a near-eye display device, but the image processing module 30 can be located independently in another device, such as a mobile phone, computer, or media player. Regardless of the configuration, the image processing module 30 needs to be signal-connected to the image display device 11 in the image resolution enhancement module so that it can transmit image data to the image display device 11. When the image processing module 30 and the image resolution enhancement module are located in the same device, they can be directly electrically connected to transmit image data. When they are located in different devices, they can transmit image data through the wireless communication modules in their respective devices or directly via a wired connection.

[0082] In order to achieve the deflection of light and thus the offset of each pixel unit in the image, the beam deflection element 21 can have multiple states. The following example uses the tunable lens 21A as the beam deflection element 21 for illustration.

[0083] like Figure 10 As shown, the beam deflection element 21 is a tunable lens 21A. The first transparent plate 211 is located on the side of the second transparent plate 212 closer to the human eye 40, and the first transparent plate 211 is deflected while the second transparent plate 212 is not deflected. To better understand the correspondence between the deflection of the tunable lens 21A and the pixel unit offset (i.e., the correspondence between the direction of light deflection and the direction of deflection of the tunable lens 21A), the tunable lens 21A can achieve... Figure 12 Taking the eight deflection states in the image as an example, it should be noted that in practical applications, the tunable lens 21A may only need to possess some of these deflection states, rather than all of them. These eight deflection states enable each pixel unit in the image to achieve the following relative to its initial position: Figure 11 The offset in eight directions. Specifically, to achieve the eight deflection states of the tunable lens 21A, in order to... Figure 3Taking the setup shown as an example, control electrodes 221 are specifically set at the four apex positions of the tunable lens 21A.

[0084] Figure 10 The left side of the tunable lens 21A shows a schematic diagram of the pixel unit offset orientation (this schematic diagram is virtual; it is shown only to better illustrate the correspondence between the deflection direction of the tunable lens 21A and the offset direction of the pixel unit). In the pixel unit offset orientation diagram, G represents a single pixel unit, and the solid square containing G represents the initial position of the single pixel unit before offset. Numbers ① to ⑧ in the diagram represent the eight offset directions of the pixel unit, and the dashed squares containing numbers ① to ⑧ represent the position of the pixel unit after offset.

[0085] like Figure 3 , Figures 10 to 12 As shown, when light passes through the tunable lens 21A, it deflects towards the side where the thickness of the tunable lens 21A increases. When voltage is applied to the two control electrodes 221 at the lower left and lower right corners of the tunable lens 21A, and no voltage is applied to the two control electrodes 221 at the upper left and upper right corners, the lower side of the first transparent plate 211 deflects around the center position O of the tunable lens 21A toward the second transparent plate 212 (i.e., the lower side of the first transparent plate 211 deflects toward the direction closer to the second transparent plate 212). At this time, the lower side of the tunable lens 21A becomes thinner and the upper side becomes thicker (after the lower side of the tunable lens 21A becomes thinner, the compressible medium 213 will be squeezed to the upper side of the tunable lens 21A, thereby making the upper side of the tunable lens 21A thicker). That is, the tunable lens 21A appears... Figure 12 In state 1, the light rays are deflected upwards after passing through the tunable lens 21A, causing the pixel units G of the image to shift in direction ①.

[0086] like Figure 3 , Figures 10 to 12 As shown, when a voltage is applied to the control electrode 221 at the lower right corner of the tunable lens 21A, and no voltage is applied to the three control electrodes 221 at the lower left, upper left, and upper right corners, the lower right corner of the first transparent plate 211 deflects around the center position O of the tunable lens 21A toward the second transparent plate 212. At this time, the lower right corner of the tunable lens 21A becomes thinner and the upper left corner becomes thicker, meaning the tunable lens 21A is in a certain position. Figure 12 In state 2, the light rays are deflected to the upper left after passing through the tunable lens 21A, causing the pixel unit G of the image to shift in direction ②.

[0087] like Figure 3 , Figures 10 to 12As shown, when voltage is applied to the two control electrodes 221 at the upper right and lower right corners of the tunable lens 21A, and no voltage is applied to the two control electrodes 221 at the upper left and lower left corners, the right side of the first transparent plate 211 deflects around the center position O of the tunable lens 21A toward the second transparent plate 212. At this time, the right side of the tunable lens 21A becomes thinner and the left side becomes thicker, that is, the tunable lens 21A is... Figure 12 In state 3, the light rays are deflected to the left after passing through the tunable lens 21A, causing the pixel unit G of the image to shift in direction ③.

[0088] like Figure 3 , Figures 10 to 12 As shown, when a voltage is applied to the control electrode 221 at the upper right corner of the tunable lens 21A, and no voltage is applied to the three control electrodes 221 at the upper left, lower left, and lower right corners, the upper right corner of the first transparent plate 211 deflects around the center position O of the tunable lens 21A toward the second transparent plate 212. At this time, the upper right corner of the tunable lens 21A becomes thinner and the lower left corner becomes thicker, meaning the tunable lens 21A is in a certain position. Figure 12 In state 4, the light rays are deflected to the lower left after passing through the tunable lens 21A, causing the pixel unit G of the image to shift in direction ④.

[0089] like Figure 3 , Figures 10 to 12 As shown, when voltage is applied to the two control electrodes 221 at the upper left and upper right corners of the tunable lens 21A, and no voltage is applied to the two control electrodes 221 at the lower left and lower right corners, the upper side of the first transparent plate 211 deflects around the center position O of the tunable lens 21A toward the second transparent plate 212. At this time, the upper side of the tunable lens 21A becomes thinner and the lower side becomes thicker, that is, the tunable lens 21A is... Figure 12 In state 5, the light rays are deflected downwards after passing through the tunable lens 21A, causing the pixel units G of the image to shift in direction ⑤.

[0090] like Figure 3 , Figures 10 to 12 As shown, when a voltage is applied to the control electrode 221 at the upper left corner of the tunable lens 21A, and no voltage is applied to the three control electrodes 221 at the upper right, lower right, and lower left corners, the upper left corner of the first transparent plate 211 deflects around the center position O of the tunable lens 21A toward the second transparent plate 212. At this time, the upper left corner of the tunable lens 21A becomes thinner and the lower right corner becomes thicker, meaning the tunable lens 21A is in a certain position. Figure 12 In state 6, the light rays are deflected to the lower right after passing through the tunable lens 21A, causing the pixel unit G of the image to shift in direction ⑥.

[0091] like Figure 3 , Figures 10 to 12As shown, when voltage is applied to the two control electrodes 221 at the lower left and upper left corners of the tunable lens 21A, and no voltage is applied to the two control electrodes 221 at the lower right and upper right corners, the left side of the first transparent plate 211 deflects around the center position O of the tunable lens 21A toward the second transparent plate 212. At this time, the left side of the tunable lens 21A becomes thinner and the right side becomes thicker, that is, the tunable lens 21A is... Figure 12 In state 7, the light rays are deflected to the right after passing through the tunable lens 21A, causing the pixel units G of the image to shift in direction ⑦.

[0092] like Figure 3 , Figures 10 to 12 As shown, when a voltage is applied to the control electrode 221 at the lower left corner of the tunable lens 21A, and no voltage is applied to the three control electrodes 221 at the lower right, upper right, and upper left corners, the lower left corner of the first transparent plate 211 deflects around the center position O of the tunable lens 21A toward the second transparent plate 212. At this time, the lower left corner of the tunable lens 21A becomes thinner and the upper right corner becomes thicker, meaning the tunable lens 21A is in a certain position. Figure 12 In state 8, the light rays are deflected to the upper right after passing through the tunable lens 21A, causing the pixel unit G of the image to shift in direction ⑧.

[0093] This embodiment also provides an image resolution enhancement method, which is used in an image resolution enhancement module, and the image resolution enhancement method includes:

[0094] S1, Image Sampling Steps:

[0095] The image processing module 30 divides the original high-pixel image into multiple pixel regions PA, each pixel region PA including M pixel units (specifically, each pixel unit includes at least one sub-pixel); the M pixel units in each pixel region PA are respectively the first pixel unit (shown as G1 in the figure), the second pixel unit (shown as G2 in the figure), ..., the Xth pixel unit, ..., the Mth pixel unit; wherein, the second pixel unit is located in the first direction of the first pixel unit, the third pixel unit is located in the second direction of the first pixel unit, ..., the Xth pixel unit is located in the (X-1)th direction of the first pixel unit, ..., the Mth pixel unit is located in the (M-1)th direction of the first pixel unit;

[0096] The image processing module 30 extracts and merges all first pixel units in each pixel region PA to form a first low-pixel sub-image, extracts and merges all second pixel units in each pixel region PA to form a second low-pixel sub-image, extracts and merges all third pixel units in each pixel region PA to form a third low-pixel sub-image, and so on, extracting and merging all X-th pixel units in each pixel region PA to form an X-th low-pixel sub-image, obtaining T low-pixel sub-images; then the image processing module 30 transmits the T low-pixel sub-images to the image display device 11.

[0097] In other words, in step S1 above, when sampling the original high-pixel image to obtain T low-pixel sub-images, the sampling is performed according to the following pattern: first, all first pixel units are sampled to obtain the first low-pixel sub-image; then, all second pixel units are sampled to obtain the second low-pixel sub-image; then, all third pixel units are sampled to obtain the third low-pixel sub-image; and so on, until finally, all X-th pixel units are sampled to obtain the X-th low-pixel sub-image.

[0098] Here, T represents the number of low-pixel sub-images actually obtained through sampling. In step S1 above, when sampling the original high-pixel image, since sampling continues from the first pixel unit to the Xth pixel unit, T = X. It should be noted that, since it is not necessary to sample all pixel units in each pixel region PA when sampling the original high-pixel image, T ≤ M. In other words, if all pixel units in each pixel region PA are sampled separately, M low-pixel sub-images will be obtained, i.e., T = M; if only some pixel units in each pixel region PA are sampled separately, the number T of low-pixel sub-images obtained will be less than M, i.e., T < M.

[0099] It should be noted that when dividing the original high-pixel image into multiple pixel regions PA, if the original high-pixel image does not meet the division conditions, the number of pixels can be supplemented by stretching algorithms, scaling algorithms, interpolation algorithms, etc. to meet the division conditions.

[0100] S2, Image fusion step, please refer to... Figure 13 :

[0101] S21, the beam deflection element 21 is in the initial state, the image display device 11 displays the first low-pixel sub-image, and the first low-pixel sub-image outputs an un-deflected sub-image to the human eye 40 after passing through the projection lens 12 and the beam deflection device 20.

[0102] S22, the control drive device 22 drives the beam deflection element 21 to deflect in the first deflection direction (i.e., the first deflection of the beam deflection element 21 in each cycle), so that the beam deflection element 21 is in the first deflection state; the image display device 11 displays the second low-pixel sub-image, and the second low-pixel sub-image outputs the first deflected sub-image to the human eye 40 after passing through the projection lens 12 and the beam deflection device 20, wherein the first deflected sub-image is deflected in the first direction compared with the undeflected sub-image; the first deflected sub-image and the undeflected sub-image are fused and superimposed to obtain the first intermediate image;

[0103] S23, the control drive device 22 drives the beam deflection element 21 to deflect in the second deflection direction (i.e., the second deflection of the beam deflection element 21 in each cycle), so that the beam deflection element 21 is in the second deflection state; the image display device 11 displays the third low-pixel sub-image, and after the third low-pixel sub-image passes through the projection lens 12 and the beam deflection device 20, it outputs the second deflected sub-image to the human eye 40, wherein the second deflected sub-image is deflected in the second direction compared to the undeflected sub-image; the second deflected sub-image is fused and superimposed with the first intermediate image to obtain the second intermediate image;

[0104] …

[0105] S24, the control drive device 22 drives the beam deflection element 21 to deflect in the (N-1)th deflection direction (i.e., the (N-1)th deflection of the beam deflection element 21 in each cycle), so that the beam deflection element 21 is in the (N-1)th deflection state; the image display device 11 displays the Xth low-pixel sub-image, and the Xth low-pixel sub-image outputs the (N-1)th shifted sub-image to the human eye 40 after passing through the projection lens 12 and the beam deflection device 20, wherein the (N-1)th shifted sub-image is shifted in the aforementioned (X-1)th direction compared to the unshifted sub-image; the (N-1)th shifted sub-image is fused and superimposed with the (N-2)th intermediate image to obtain a high-pixel image; wherein the first deflection direction, the second deflection direction, ..., the (N-1)th deflection direction are different deflection directions;

[0106] S25, the control drive device 22 drives the beam deflection element 21 to deflect (i.e., the Nth deflection of the beam deflection element 21 in each cycle), so that the beam deflection element 21 returns to the initial state from the N-1th deflection state.

[0107] Where M is the pixel difference between the original high-pixel image and the low-pixel sub-image. The pixel difference specifically refers to the ratio between the total number of pixels in the original high-pixel image and the total number of pixels in the low-pixel sub-image. M, N, X and T are all integers, 2≤N≤M, and T=X=N.

[0108] The control image resolution enhancement module executes the above steps S1 and S2 in each cycle, and performs the above steps S1 and S2 in different cycles, thereby realizing the above image sampling steps and image fusion steps are performed sequentially on the original high-pixel images of different frames, so that the human eye 40 can continuously see high-pixel images that are basically or exactly the same as the original high-pixel images.

[0109] In one exemplary embodiment, the beam deflection element 21 is a tunable lens 21A, which includes a first transparent plate 211, a second transparent plate 212, and a compressible medium 213 disposed between the first transparent plate 211 and the second transparent plate 212; the driving device 22 includes at least one control electrode 221 disposed on the first transparent plate 211 and / or the second transparent plate 212, and the control electrode 221 is used to drive the first transparent plate 211 and / or the second transparent plate 212 to deflect.

[0110] In step S2 above, no voltage is applied to each control electrode 221, and the first transparent plate 211 and the second transparent plate 212 are parallel to each other so that the tunable lens 21A is in a plate shape. At this time, the tunable lens 21A is in its initial state.

[0111] By changing the energizing state of each control electrode 221, the first transparent plate 211 and / or the second transparent plate 212 are deflected, so that the thickness of the side of the tunable lens 21A corresponding to the first direction is increased. At this time, the beam deflection element 21 is in the first deflection state.

[0112] By changing the energizing state of each control electrode 221, the first transparent plate 211 and / or the second transparent plate 212 are deflected, so that the thickness of the side of the tunable lens 21A corresponding to the second direction is increased. At this time, the beam deflection element 21 is in the second deflection state.

[0113] …

[0114] By changing the energizing state of each control electrode 221, the first transparent plate 211 and / or the second transparent plate 212 are deflected, so that the thickness of the side of the tunable lens 21A corresponding to the above-mentioned X-1 direction increases. At this time, the beam deflection element 21 is in the N-1 deflection state.

[0115] Remove the voltage applied to each control electrode 221. At this time, no voltage is applied to each control electrode 221, so that the beam deflection element 21 returns to the initial state from the (N-1)th deflection state.

[0116] In one exemplary embodiment, the beam deflection element 21 is a transparent wedge lens 21B, and the inclined surface 215 of the transparent wedge lens 21B is closer to the image display device 11 than its first plane 214 (i.e., the inclined surface 215 is located between the image display device 11 and the first plane 214). The transparent wedge lens 21B has the following characteristics: when one side of the transparent wedge lens 21B deflects around the center position of the transparent wedge lens 21B toward a direction closer to the image display device 11, the light passing through the transparent wedge lens 21B will be deflected in the same direction as the deflection direction of the transparent wedge lens 21B. For example, when the upper side of the transparent wedge lens 21B deflects around the center position of the transparent wedge lens 21B toward a direction closer to the image display device 11, the light passing through the transparent wedge lens 21B will be deflected upward.

[0117] In step S2 above, when the first plane 214 of the transparent wedge lens 21B is perpendicular to the optical axis of the image display device 11, the transparent wedge lens 21B is in its initial state.

[0118] The control drive device 22 drives the transparent wedge lens 21B to deflect, causing the side of the transparent wedge lens 21B corresponding to the first direction to deflect towards the image display device 11, causing the first plane 214 of the transparent wedge lens 21B to deflect relative to the optical axis of the image display device 11 (i.e., the first plane 214 is not perpendicular to the optical axis of the image display device 11). At this time, the transparent wedge lens 21B is in the first deflection state.

[0119] The control drive device 22 drives the transparent wedge lens 21B to deflect, causing the side of the transparent wedge lens 21B corresponding to the second direction to deflect towards the image display device 11, causing the first plane 214 of the transparent wedge lens 21B to deflect relative to the optical axis of the image display device 11 (i.e., the first plane 214 is not perpendicular to the optical axis of the image display device 11), at which time the transparent wedge lens 21B is in the second deflection state.

[0120] …

[0121] The control drive device 22 drives the transparent wedge lens 21B to deflect, causing the side of the transparent wedge lens 21B corresponding to the above-mentioned X-1 direction to deflect towards the image display device 11, causing the first plane 214 of the transparent wedge lens 21B to deflect relative to the optical axis of the image display device 11 (i.e., the first plane 214 is not perpendicular to the optical axis of the image display device 11). At this time, the transparent wedge lens 21B is in the N-1 deflection state.

[0122] The control drive device 22 drives the transparent wedge lens 21B to deflect, so that the transparent wedge lens 21B returns to the initial state from the (N-1)th deflection state.

[0123] In one exemplary embodiment, the beam deflection element 21 is a transparent flat lens 21C. The transparent flat lens 21C has the following characteristics: when one side of the transparent flat lens 21C is deflected around the center position of the transparent flat lens 21C toward a direction closer to the image display device 11, the light passing through the transparent flat lens 21C will be deflected in the same direction as the deflection direction of the transparent flat lens 21C. For example, when the upper side of the transparent flat lens 21C is deflected around the center position of the transparent flat lens 21C toward a direction closer to the image display device 11, the light passing through the transparent flat lens 21C will be deflected upward.

[0124] In step S2 above, when the second plane 216 and the third plane 217 of the transparent flat lens 21C are perpendicular to the optical axis of the image display device 11, the transparent flat lens 21C is in its initial state.

[0125] The control drive device 22 drives the transparent flat lens 21C to deflect one side corresponding to the first direction toward the image display device 11, so that the second plane 216 and the third plane 217 of the transparent flat lens 21C deflect relative to the optical axis of the image display device 11 (i.e., the second plane 216 and the third plane 217 are not perpendicular to the optical axis of the image display device 11). At this time, the transparent flat lens 21C is in the first deflection state.

[0126] The control drive device 22 drives the transparent flat lens 21C to deflect one side corresponding to the second direction toward the image display device 11, so that the second plane 216 and the third plane 217 of the transparent flat lens 21C deflect relative to the optical axis of the image display device 11 (i.e., the second plane 216 and the third plane 217 are not perpendicular to the optical axis of the image display device 11). At this time, the transparent flat lens 21C is in the second deflection state.

[0127] …

[0128] The control drive device 22 drives the transparent flat lens 21C to deflect one side corresponding to the above-mentioned X-1 direction toward the image display device 11, so that the second plane 216 and the third plane 217 of the transparent flat lens 21C deflect relative to the optical axis of the image display device 11 (that is, the second plane 216 and the third plane 217 are not perpendicular to the optical axis of the image display device 11). At this time, the transparent flat lens 21C is in the N-1 deflection state.

[0129] The control drive device 22 drives the transparent flat lens 21C to deflect, so that the transparent flat lens 21C returns to the initial state from the (N-1)th deflection state.

[0130] The following example illustrates the process of the above image resolution enhancement method:

[0131] Image sampling steps:

[0132] Taking the image processing module 30 as an example, which samples the original high-pixel image to obtain 4 low-pixel sub-images, i.e., T=4.

[0133] An example of the original high-resolution image is as follows: Figure 14 As shown, the image processing module 30 divides the original high-resolution image into multiple pixel regions PA (only four pixel regions PA are shown in the figure). Each pixel region PA includes four pixel units, and each pixel unit includes one sub-pixel. The four pixel units in each pixel region PA are a first pixel unit G1, a second pixel unit G2, a third pixel unit G3, and a fourth pixel unit G4. The first pixel unit G1, the second pixel unit G2, the third pixel unit G3, and the fourth pixel unit G4 are located at the upper left, upper right, lower right, and lower left corners of each pixel region PA, respectively. With the first pixel unit G1 as the reference, the second pixel unit G2 is located to the right of the first pixel unit G1 (i.e., the first direction is to the right), the third pixel unit G3 is located to the lower right of the first pixel unit G1 (i.e., the second direction is to the lower right), and the fourth pixel unit G4 is located below the first pixel unit G1 (i.e., the third direction is below).

[0134] Image processing module 30 extracts and merges all first pixel units G1 in each pixel region PA to form as shown in the image processing module 30. Figure 15A The first low-pixel sub-image shown is formed by extracting and merging all second pixel units G2 in each pixel region PA to form the image shown below. Figure 15B The second low-pixel sub-image shown is formed by extracting and merging all third pixel units G3 in each pixel region PA to form the image shown. Figure 15C The third low-pixel sub-image shown is formed by extracting and merging all fourth pixel units G4 in each pixel region PA to form the image shown. Figure 15D The fourth low-pixel sub-image shown is X=4; then the image processing module 30 transmits the four low-pixel sub-images obtained by the above sampling to the image display device 11; wherein, the pixel difference between the original high-pixel image and the low-pixel sub-image is 4, that is, M=4.

[0135] Image fusion steps:

[0136] Using beam deflection element 21 as an example Figure 3 Take the tunable lens 21A shown as an example. The tunable lens 21A includes a first transparent plate 211, a second transparent plate 212, and a compressible medium 213 disposed between the first transparent plate 211 and the second transparent plate 212. The first transparent plate 211 is located on the side of the second transparent plate 212 closer to the human eye 40. The first transparent plate 211 is provided with a plurality of control electrodes 221, which are used to control the deflection of the first transparent plate 211.

[0137] When the image display device 11 displays as shown Figure 15A When the first low-pixel sub-image is displayed, no voltage is applied to any of the control electrodes 221. The first transparent plate 211 and the second transparent plate 212 are parallel to each other, making the tunable lens 21A flat. At this time, the tunable lens 21A is in its initial state. After the first low-pixel sub-image passes through the projection lens 12 and the tunable lens 21A, an image is output to the human eye 40 as shown. Figure 16A The unoffset sub-image shown.

[0138] When the image display device 11 displays as shown Figure 15B When displaying the second low-pixel sub-image, the energizing state of each control electrode 221 is changed (specifically, voltage is applied to the two control electrodes 221 at the lower left and upper left corners of the first transparent plate 211, while no voltage is applied to the two control electrodes 221 at the lower right and upper right corners), causing the left side of the first transparent plate 211 to deflect around the center position O of the tunable lens 21A toward the second transparent plate 212. At this time, the tunable lens 21A is in the first deflection state, with the left side of the tunable lens 21A becoming thinner and the right side becoming thicker, i.e., the tunable lens 21A appears as... Figure 12 In state 7, the light rays are shifted to the right after passing through the tunable lens 21A; the second low-pixel sub-image, after passing through the projection lens 12 and the tunable lens 21A, outputs the first shifted sub-image to the human eye 40, wherein the first shifted sub-image is shifted to the right compared to the unshifted sub-image; the first shifted sub-image is fused and superimposed with the aforementioned unshifted sub-image to obtain the image shown below. Figure 16B The first intermediate image shown.

[0139] When the image display device 11 displays as shown Figure 15C When displaying the third low-pixel sub-image, the energizing state of each control electrode 221 is changed (specifically, voltage is applied to the control electrode 221 at the upper left corner of the first transparent plate 211, while no voltage is applied to the three control electrodes 221 at the upper right, lower right, and lower left corners), causing the upper left corner of the first transparent plate 211 to deflect around the center position O of the tunable lens 21A toward the second transparent plate 212. At this time, the tunable lens 21A is in a second deflection state, with the upper left corner of the tunable lens 21A becoming thinner and the lower right corner becoming thicker, thus the tunable lens 21A appears as shown in the image. Figure 12 In state 6, the light rays are shifted to the lower right after passing through the tunable lens 21A; the third low-pixel sub-image, after passing through the projection lens 12 and the tunable lens 21A, outputs a second shifted sub-image to the human eye 40, wherein the second shifted sub-image is shifted to the lower right compared to the unshifted sub-image; the second shifted sub-image is fused and superimposed with the aforementioned first intermediate image to obtain... Figure 16C The second intermediate image shown.

[0140] When the image display device 11 displays as shown Figure 15D When displaying the fourth low-pixel sub-image, the energizing state of each control electrode 221 is changed (specifically, voltage is applied to the two control electrodes 221 at the upper left and upper right corners of the first transparent plate 211, while no voltage is applied to the two control electrodes 221 at the lower left and lower right corners), causing the upper side of the first transparent plate 211 to deflect around the center position O of the tunable lens 21A toward the second transparent plate 212. At this time, the tunable lens 21A is in a third deflection state, with the upper side of the tunable lens 21A becoming thinner and the lower side becoming thicker, i.e., the tunable lens 21A appears as... Figure 12 In state 5, the light rays are shifted downwards after passing through the tunable lens 21A; the fourth low-pixel sub-image, after passing through the projection lens 12 and the tunable lens 21A, outputs the third shifted sub-image to the human eye 40, wherein the third shifted sub-image is shifted downwards compared to the unshifted sub-image; the third shifted sub-image is fused and superimposed with the aforementioned second intermediate image to obtain the image shown below. Figure 16D The high-resolution image shown is an example of this. Because this embodiment samples and fuses each pixel unit in the original high-resolution image, the high-resolution image seen by the human eye 40 is essentially or exactly the same as the original high-resolution image.

[0141] Remove the voltage applied to each control electrode 221. At this time, no voltage is applied to each control electrode 221, so that the tunable lens 21A returns to the initial state from the third deflection state, so as to perform the image sampling step and image fusion step of the next cycle.

[0142] The image resolution enhancement module performs the above-mentioned image sampling and image fusion steps in each cycle, and repeats the above-mentioned image sampling and image fusion steps in different cycles.

[0143] It should be noted that when the relative positions of the M pixel units in each pixel region PA change, that is, when the position of the first pixel unit G1, which serves as the reference, changes, the deflection direction of the beam shifting element 21 and the deflection direction of the light after passing through the beam shifting element 21 will also be different during the process of outputting the T low-pixel sub-images obtained by sampling to the human eye 40 through the projection lens 12 and the beam shifting device 20 for image fusion processing. The following is a further example illustrating the process of the above image resolution enhancement method:

[0144] Image sampling steps:

[0145] Taking the image processing module 30 as an example, which samples the original high-pixel image to obtain 4 low-pixel sub-images, i.e., T=4.

[0146] An example of the original high-resolution image is as follows: Figure 17As shown, the image processing module 30 divides the original high-resolution image into multiple pixel regions PA (only four pixel regions PA are shown in the figure). Each pixel region PA includes four pixel units, and each pixel unit includes one sub-pixel. The four pixel units in each pixel region PA are a first pixel unit G1, a second pixel unit G2, a third pixel unit G3, and a fourth pixel unit G4. The first pixel unit G1, the second pixel unit G2, the third pixel unit G3, and the fourth pixel unit G4 are located at the lower left, upper left, upper right, and lower right corners of each pixel region PA, respectively. With the first pixel unit G1 as the reference, the second pixel unit G2 is located above the first pixel unit G1 (i.e., the first direction is above), the third pixel unit G3 is located to the upper right of the first pixel unit G1 (i.e., the second direction is to the upper right), and the fourth pixel unit G4 is located to the right of the first pixel unit G1 (i.e., the third direction is to the right).

[0147] Image processing module 30 extracts and merges all first pixel units G1 in each pixel region PA to form as shown in the image processing module 30. Figure 18A The first low-pixel sub-image shown is formed by extracting and merging all second pixel units G2 in each pixel region PA to form the image shown below. Figure 18B The second low-pixel sub-image shown is formed by extracting and merging all third pixel units G3 in each pixel region PA to form the image shown. Figure 18C The third low-pixel sub-image shown is formed by extracting and merging all fourth pixel units G4 in each pixel region PA to form the image shown. Figure 18D The fourth low-pixel sub-image shown is X=4; then the image processing module 30 transmits the four low-pixel sub-images obtained by the above sampling to the image display device 11; wherein, the pixel difference between the original high-pixel image and the low-pixel sub-image is 4, that is, M=4.

[0148] Image fusion steps:

[0149] Using beam deflection element 21 as an example Figure 3 Take the tunable lens 21A shown as an example. The tunable lens 21A includes a first transparent plate 211, a second transparent plate 212, and a compressible medium 213 disposed between the first transparent plate 211 and the second transparent plate 212. The first transparent plate 211 is located on the side of the second transparent plate 212 closer to the human eye 40. The first transparent plate 211 is provided with a plurality of control electrodes 221, which are used to control the deflection of the first transparent plate 211.

[0150] When the image display device 11 displays as shown Figure 18AWhen the first low-pixel sub-image is displayed, no voltage is applied to any of the control electrodes 221. The first transparent plate 211 and the second transparent plate 212 are parallel to each other, making the tunable lens 21A flat. At this time, the tunable lens 21A is in its initial state. After the first low-pixel sub-image passes through the projection lens 12 and the tunable lens 21A, an image is output to the human eye 40 as shown. Figure 19A The unoffset sub-image shown.

[0151] When the image display device 11 displays as shown Figure 18B When displaying the second low-pixel sub-image, the energizing state of each control electrode 221 is changed (specifically, voltage is applied to the two control electrodes 221 at the lower left and lower right corners of the first transparent plate 211, while no voltage is applied to the two control electrodes 221 at the upper left and upper right corners), causing the lower side of the first transparent plate 211 to deflect around the center position O of the tunable lens 21A toward the second transparent plate 212. At this time, the tunable lens 21A is in the first deflection state, with the lower side of the tunable lens 21A becoming thinner and the upper side becoming thicker, i.e., the tunable lens 21A appears as... Figure 12 In state 1, the light rays are shifted upwards after passing through the tunable lens 21A; the second low-pixel sub-image, after passing through the projection lens 12 and the tunable lens 21A, outputs the first shifted sub-image to the human eye 40, wherein the first shifted sub-image is shifted upwards compared to the unshifted sub-image; the first shifted sub-image is fused and superimposed with the aforementioned unshifted sub-image to obtain... Figure 19B The first intermediate image shown.

[0152] When the image display device 11 displays as shown Figure 18C When displaying the third low-pixel sub-image, the energizing state of each control electrode 221 is changed (specifically, voltage is applied to the control electrode 221 at the lower left corner of the first transparent plate 211, while no voltage is applied to the three control electrodes 221 at the lower right, upper right, and upper left corners), causing the lower left corner of the first transparent plate 211 to deflect around the center position O of the tunable lens 21A toward the second transparent plate 212. At this time, the tunable lens 21A is in a second deflection state, with the lower left corner of the tunable lens 21A becoming thinner and the upper right corner becoming thicker, thus the tunable lens 21A appears as shown in the image. Figure 12 In state 8, the light rays are shifted to the upper right after passing through the tunable lens 21A; the third low-pixel sub-image, after passing through the projection lens 12 and the tunable lens 21A, outputs a second shifted sub-image to the human eye 40, wherein the second shifted sub-image is shifted to the upper right compared to the unshifted sub-image; the second shifted sub-image is fused and superimposed with the aforementioned first intermediate image to obtain... Figure 19C The second intermediate image shown.

[0153] When the image display device 11 displays as shown Figure 18DWhen displaying the fourth low-pixel sub-image, the energizing state of each control electrode 221 is changed (specifically, voltage is applied to the two control electrodes 221 at the lower left and upper left corners of the first transparent plate 211, while no voltage is applied to the two control electrodes 221 at the lower right and upper right corners), causing the left side of the first transparent plate 211 to deflect around the center position O of the tunable lens 21A toward the second transparent plate 212. At this time, the tunable lens 21A is in a third deflection state, with the left side of the tunable lens 21A becoming thinner and the right side becoming thicker, i.e., the tunable lens 21A appears as... Figure 12 In state 7, the light rays are shifted to the right after passing through the tunable lens 21A; the fourth low-pixel sub-image, after passing through the projection lens 12 and the tunable lens 21A, outputs the third shifted sub-image to the human eye 40, wherein the third shifted sub-image is shifted to the right compared to the unshifted sub-image; the third shifted sub-image is fused and superimposed with the aforementioned second intermediate image to obtain the image shown below. Figure 19D The high-resolution image shown is an example of this. Because this embodiment samples and fuses each pixel unit in the original high-resolution image, the high-resolution image seen by the human eye 40 is essentially or exactly the same as the original high-resolution image.

[0154] Remove the voltage applied to each control electrode 221 (at this time, no voltage is applied to each control electrode 221), so that the tunable lens 21A returns to the initial state from the third deflection state, in order to perform the image sampling step and image fusion step of the next cycle.

[0155] The image resolution enhancement module performs the above-mentioned image sampling and image fusion steps in each cycle, and repeats the above-mentioned image sampling and image fusion steps in different cycles.

[0156] It should also be noted that when the image processing module 30 samples the original high-resolution image, it does not limit the sampling of all M pixel units in each pixel region PA. That is, it may sample only a portion of the M pixel units in each pixel region PA. The following example illustrates the process of the above image resolution enhancement method:

[0157] Image sampling steps:

[0158] Taking the image processing module 30 as an example, which samples the original high-pixel image to obtain two low-pixel sub-images, i.e., T=2.

[0159] An example of the original high-resolution image is as follows: Figure 20As shown, the image processing module 30 divides the original high-resolution image into multiple pixel regions PA (only four pixel regions PA are shown in the figure). Each pixel region PA includes four pixel units, and each pixel unit includes one sub-pixel. The four pixel units in each pixel region PA are a first pixel unit G1, a second pixel unit G2, a third pixel unit G3, and a fourth pixel unit G4. The first pixel unit G1, the second pixel unit G2, the third pixel unit G3, and the fourth pixel unit G4 are located at the upper left, upper right, lower right, and lower left corners of each pixel region PA, respectively. With the first pixel unit G1 as the reference, the second pixel unit G2 is located to the right of the first pixel unit G1 (i.e., the first direction is to the right), the third pixel unit G3 is located to the lower right of the first pixel unit G1 (i.e., the second direction is to the lower right), and the fourth pixel unit G4 is located below the first pixel unit G1 (i.e., the third direction is below).

[0160] Image processing module 30 extracts and merges all first pixel units G1 in each pixel region PA to form as shown in the image processing module 30. Figure 21A The first low-pixel sub-image shown is formed by extracting and merging all second pixel units G2 in each pixel region PA to form the image shown below. Figure 21B The second low-pixel sub-image shown is X=2; then the image processing module 30 transmits the two low-pixel sub-images obtained by the above sampling to the image display device 11; wherein, the pixel difference between the original high-pixel image and the low-pixel sub-image is 4, that is, M=4.

[0161] Image fusion steps:

[0162] Using beam deflection element 21 as an example Figure 3 Take the tunable lens 21A shown as an example. The tunable lens 21A includes a first transparent plate 211, a second transparent plate 212, and a compressible medium 213 disposed between the first transparent plate 211 and the second transparent plate 212. The first transparent plate 211 is located on the side of the second transparent plate 212 closer to the human eye 40. The first transparent plate 211 is provided with a plurality of control electrodes 221, which are used to control the deflection of the first transparent plate 211.

[0163] When the image display device 11 displays as shown Figure 21A When the first low-pixel sub-image is displayed, no voltage is applied to any of the control electrodes 221. The first transparent plate 211 and the second transparent plate 212 are parallel to each other, making the tunable lens 21A flat. At this time, the tunable lens 21A is in its initial state. After the first low-pixel sub-image passes through the projection lens 12 and the tunable lens 21A, an image is output to the human eye 40 as shown. Figure 22A The unoffset sub-image shown.

[0164] When the image display device 11 displays as shown Figure 21B When displaying the second low-pixel sub-image, the energizing state of each control electrode 221 is changed (specifically, voltage is applied to the two control electrodes 221 at the lower left and upper left corners of the first transparent plate 211, while no voltage is applied to the two control electrodes 221 at the lower right and upper right corners), causing the left side of the first transparent plate 211 to deflect around the center position O of the tunable lens 21A toward the second transparent plate 212. At this time, the tunable lens 21A is in the first deflection state, with the left side of the tunable lens 21A becoming thinner and the right side becoming thicker, i.e., the tunable lens 21A appears as... Figure 12 In state 7, the light rays are shifted to the right after passing through the tunable lens 21A; the second low-pixel sub-image, after passing through the projection lens 12 and the tunable lens 21A, outputs the first shifted sub-image to the human eye 40, wherein the first shifted sub-image is shifted to the right compared to the unshifted sub-image; the first shifted sub-image is fused and superimposed with the aforementioned unshifted sub-image to obtain the image shown below. Figure 22B The higher-resolution image shown is an example of an image with slightly lower resolution than the original high-resolution image. Because this embodiment samples and fuses some pixel units from the original high-resolution image, the final image quality perceived by the human eye (40) will be slightly lower than that of the original high-resolution image.

[0165] Remove the voltage applied to each control electrode 221. At this time, no voltage is applied to each control electrode 221, so that the tunable lens 21A returns to the initial state from the first deflection state, so as to perform the image sampling step and image fusion step of the next cycle.

[0166] The image resolution enhancement module performs the above-mentioned image sampling and image fusion steps in each cycle, and repeats the above-mentioned image sampling and image fusion steps in different cycles.

[0167] It should be noted that when the relative positions of the M pixel units in each pixel region PA change, that is, when the position of the first pixel unit G1, which serves as the reference, changes, the deflection direction of the beam shifting element 21 and the deflection direction of the light after passing through the beam shifting element 21 will also be different during the process of outputting the T low-pixel sub-images obtained by sampling to the human eye 40 through the projection lens 12 and the beam shifting device 20 for image fusion processing. The following is a further example illustrating the process of the above image resolution enhancement method:

[0168] Image sampling steps:

[0169] Taking the image processing module 30 as an example, which samples the original high-pixel image to obtain two low-pixel sub-images, i.e., T=2.

[0170] An example of the original high-resolution image is as follows: Figure 23As shown, the image processing module 30 divides the original high-resolution image into multiple pixel regions PA (only four pixel regions PA are shown in the figure). Each pixel region PA includes four pixel units, and each pixel unit includes one sub-pixel. The four pixel units in each pixel region PA are a first pixel unit G1, a second pixel unit G2, a third pixel unit G3, and a fourth pixel unit G4. The first pixel unit G1, the second pixel unit G2, the third pixel unit G3, and the fourth pixel unit G4 are located at the lower left, upper right, upper left, and lower right corners of each pixel region PA, respectively. Taking the first pixel unit G1 as a reference, the second pixel unit G2 is located to the upper right of the first pixel unit G1 (i.e., the first direction is the upper right), the third pixel unit G3 is located above the first pixel unit G1 (i.e., the second direction is the upper), and the fourth pixel unit G4 is located to the right of the first pixel unit G1 (i.e., the third direction is the right).

[0171] Image processing module 30 extracts and merges all first pixel units G1 in each pixel region PA to form as shown in the image processing module 30. Figure 24A The first low-pixel sub-image shown is formed by extracting and merging all second pixel units G2 in each pixel region PA to form the image shown below. Figure 24B The second low-pixel sub-image shown is X=2; then the image processing module 30 transmits the two low-pixel sub-images obtained by the above sampling to the image display device 11; wherein, the pixel difference between the original high-pixel image and the low-pixel sub-image is 4, that is, M=4.

[0172] Image fusion steps:

[0173] Using beam deflection element 21 as an example Figure 3 Take the tunable lens 21A shown as an example. The tunable lens 21A includes a first transparent plate 211, a second transparent plate 212, and a compressible medium 213 disposed between the first transparent plate 211 and the second transparent plate 212. The first transparent plate 211 is located on the side of the second transparent plate 212 closer to the human eye 40. The first transparent plate 211 is provided with a plurality of control electrodes 221, which are used to control the deflection of the first transparent plate 211.

[0174] When the image display device 11 displays as shown Figure 24A When the first low-pixel sub-image is displayed, no voltage is applied to any of the control electrodes 221. The first transparent plate 211 and the second transparent plate 212 are parallel to each other, making the tunable lens 21A flat. At this time, the tunable lens 21A is in its initial state. After the first low-pixel sub-image passes through the projection lens 12 and the tunable lens 21A, an image is output to the human eye 40 as shown. Figure 25A The unoffset sub-image shown.

[0175] When the image display device 11 displays as shown Figure 24B When displaying the second low-pixel sub-image, the energizing state of each control electrode 221 is changed. At this time, voltage is applied to the control electrode 221 at the lower left corner of the first transparent plate 211, while no voltage is applied to the three control electrodes 221 at the lower right, upper right, and upper left corners. This causes the lower left corner of the first transparent plate 211 to deflect around the center position O of the tunable lens 21A toward the second transparent plate 212. At this time, the tunable lens 21A is in a first deflection state, with the lower left corner of the tunable lens 21A becoming thinner and the upper right corner becoming thicker, thus the tunable lens 21A appears as... Figure 12 In state 8, the light rays are shifted to the upper right after passing through the tunable lens 21A; the second low-pixel sub-image, after passing through the projection lens 12 and the tunable lens 21A, outputs the first shifted sub-image to the human eye 40, wherein the first shifted sub-image is shifted to the upper right compared to the unshifted sub-image; the first shifted sub-image is fused and superimposed with the aforementioned unshifted sub-image to obtain the image shown below. Figure 25B The higher-resolution image shown is an example of an image with slightly lower resolution than the original high-resolution image. Because this embodiment samples and fuses some pixel units from the original high-resolution image, the final image quality perceived by the human eye (40) will be slightly lower than that of the original high-resolution image.

[0176] Remove the voltage applied to each control electrode 221. At this time, no voltage is applied to each control electrode 221, so that the tunable lens 21A returns to the initial state from the first deflection state, so as to perform the image sampling step and image fusion step of the next cycle.

[0177] The image resolution enhancement module performs the above-mentioned image sampling and image fusion steps in each cycle, and repeats the above-mentioned image sampling and image fusion steps in different cycles.

[0178] In the above embodiment, the original high-pixel image is sampled to obtain two low-pixel sub-images. The image fusion makes the human eye 40 perceive a higher-pixel image obtained by fusing and superimposing an un-offset sub-image and an offset sub-image. In other embodiments, based on the two sampled low-pixel sub-images, a non-offset sub-image and multiple offset sub-images can be fused and superimposed during image fusion to obtain a high-pixel image. Specifically, for example, a first non-offset sub-image is output to the human eye 40 after passing through the projection lens 12 and the beam offset device 20 using the first low-pixel sub-image; then, a first offset sub-image is output to the human eye 40 after passing through the projection lens 12 and the beam offset device 20 using the first low-pixel sub-image, and the first offset sub-image is fused and superimposed with the non-offset sub-image to obtain a first intermediate image; then, a second offset sub-image is output to the human eye 40 after passing through the projection lens 12 and the beam offset device 20 using the second low-pixel sub-image, and the second offset sub-image is fused and superimposed with the first intermediate image to obtain a second intermediate image; finally, a third offset sub-image is output to the human eye 40 after passing through the projection lens 12 and the beam offset device 20 using the second low-pixel sub-image, and the third offset sub-image is fused with the second intermediate image to obtain a high-pixel image.

[0179] This embodiment also provides another image resolution enhancement method, which is used in an image resolution enhancement module and includes:

[0180] S3, Image Sampling Steps:

[0181] The image processing module 30 divides the original high-pixel image into multiple pixel regions PA. Each pixel region PA includes M pixel units (specifically, each pixel unit includes at least one sub-pixel). The M pixel units in each pixel region PA are respectively the first pixel unit (shown as G1 in the figure), the second pixel unit (shown as G2 in the figure), ..., the Xth pixel unit, ..., the Mth pixel unit; wherein, the second pixel unit is located in the first direction of the first pixel unit, the third pixel unit is located in the second direction of the first pixel unit, ..., the Xth pixel unit is located in the (X-1)th direction of the first pixel unit, ..., the Mth pixel unit is located in the (M-1)th direction of the first pixel unit;

[0182] The image processing module 30 extracts and merges all the first pixel units in each pixel region PA to form a low-pixel sub-image, and then the image processing module 30 transmits the low-pixel sub-image to the image display device 11.

[0183] In other words, in step S3 above, when sampling the original high-pixel image, since only the first pixel unit is sampled, T = 1.

[0184] S4, Image fusion step, please refer to... Figure 26 :

[0185] S41, the beam deflection element 21 is in the initial state, the image display device 11 displays the low-pixel sub-image, and the low-pixel sub-image outputs an un-deflected sub-image to the human eye 40 after passing through the projection lens 12 and the beam deflection device 20.

[0186] S42, the control drive device 22 drives the beam deflection element 21 to deflect in the first deflection direction, so that the beam deflection element 21 is in the first deflection state; the image display device 11 displays the low-pixel sub-image, and the low-pixel sub-image outputs the first deflected sub-image to the human eye 40 after passing through the projection lens 12 and the beam deflection device 20, wherein the first deflected sub-image is deflected in the first direction compared with the undeflected sub-image; the first deflected sub-image and the undeflected sub-image are fused and superimposed to obtain the first intermediate image;

[0187] S43, the control drive device 22 drives the beam deflection element 21 to deflect in the second deflection direction, so that the beam deflection element 21 is in the second deflection state; the image display device 11 displays the low-pixel sub-image, and the low-pixel sub-image outputs a second deflected sub-image to the human eye 40 after passing through the projection lens 12 and the beam deflection device 20, wherein the second deflected sub-image is deflected in the second direction compared with the undeflected sub-image; the second deflected sub-image is fused and superimposed with the first intermediate image to obtain a second intermediate image;

[0188] …

[0189] S44, the control drive device 22 drives the beam deflection element 21 to deflect in the (N-1)th deflection direction, so that the beam deflection element 21 is in the (N-1)th deflection state; the image display device 11 displays the low-pixel sub-image, which, after passing through the projection lens 12 and the beam deflection device 20, outputs the (N-1)th deflected sub-image to the human eye 40, wherein the (N-1)th deflected sub-image is deflected in the (X-1)th direction compared to the undeflected sub-image; the (N-1)th deflected sub-image is fused and superimposed with the (N-2)th intermediate image to obtain a higher-pixel image; wherein the first deflection direction, the second deflection direction, ..., the (N-1)th deflection direction are different deflection directions;

[0190] S45, the control drive device 22 drives the beam deflection element 21 to deflect, so that the beam deflection element 21 returns to the initial state from the N-1th deflection state;

[0191] Where M is the pixel ratio between the original high-pixel image and the low-pixel sub-image. Specifically, the pixel ratio refers to the ratio between the total number of pixels in the original high-pixel image and the total number of pixels in the low-pixel sub-image. X, M and N are all integers, 2≤N≤M, and X=N.

[0192] The control image resolution enhancement module executes the above steps S3 and S4 in each cycle, and repeats the above steps S3 and S4 in different cycles.

[0193] In one exemplary embodiment, the beam deflection element 21 is a tunable lens 21A, which includes a first transparent plate 211, a second transparent plate 212, and a compressible medium 213 disposed between the first transparent plate 211 and the second transparent plate 212; the driving device 22 includes at least one control electrode 221 disposed on the first transparent plate 211 and / or the second transparent plate 212, and the control electrode 221 is used to drive the first transparent plate 211 and / or the second transparent plate 212 to deflect.

[0194] In step S4 above, no voltage is applied to each control electrode 221, and the first transparent plate 211 and the second transparent plate 212 are parallel to each other so that the tunable lens 21A is in a plate shape. At this time, the tunable lens 21A is in its initial state.

[0195] By changing the energizing state of each control electrode 221, the first transparent plate 211 and / or the second transparent plate 212 are deflected, so that the thickness of the side of the tunable lens 21A corresponding to the first direction is increased. At this time, the beam deflection element 21 is in the first deflection state.

[0196] By changing the energizing state of each control electrode 221, the first transparent plate 211 and / or the second transparent plate 212 are deflected, so that the thickness of the side of the tunable lens 21A corresponding to the second direction is increased. At this time, the beam deflection element 21 is in the second deflection state.

[0197] …

[0198] By changing the energizing state of each control electrode 221, the first transparent plate 211 and / or the second transparent plate 212 are deflected, so that the thickness of the side of the tunable lens 21A corresponding to the above-mentioned X-1 direction increases. At this time, the beam deflection element 21 is in the N-1 deflection state.

[0199] Remove the voltage applied to each control electrode 221. At this time, no voltage is applied to each control electrode 221, so that the beam deflection element 21 returns to the initial state from the (N-1)th deflection state.

[0200] The following example illustrates the process of the above image resolution enhancement method:

[0201] Image sampling steps:

[0202] Image processing module 30 samples a low-resolution sub-image from the original high-resolution image, i.e., T=1. This sampling process can be performed directly from the original high-resolution image data or from the processed data of the original high-resolution image; no limitation is made here. The following example shows how to obtain a low-resolution sub-image by sampling from the data of the original high-resolution image.

[0203] An example of the original high-resolution image is as follows: Figure 27 As shown, the image processing module 30 divides the original high-resolution image into multiple pixel regions PA (only four pixel regions PA are shown in the figure). Each pixel region PA includes four pixel units, and each pixel unit includes one sub-pixel. The four pixel units in each pixel region PA are the first pixel unit G1, the second pixel unit G2, the third pixel unit G3, and the fourth pixel unit G4, i.e., X=4. The first pixel unit G1, the second pixel unit G2, the third pixel unit G3, and the fourth pixel unit G4 are located at the upper left, upper right, lower right, and lower left corners of each pixel region PA, respectively.

[0204] Image processing module 30 extracts and merges all first pixel units G1 in each pixel region PA to form as shown in the image processing module 30. Figure 28 The image processing module 30 then transmits the low-pixel sub-image obtained by the above sampling to the image display device 11; wherein, the pixel difference between the original high-pixel image and the low-pixel sub-image is 4, that is, M=4.

[0205] Image fusion steps:

[0206] Using beam deflection element 21 as an example Figure 3 Take the tunable lens 21A shown as an example. The tunable lens 21A includes a first transparent plate 211, a second transparent plate 212, and a compressible medium 213 disposed between the first transparent plate 211 and the second transparent plate 212. The first transparent plate 211 is located on the side of the second transparent plate 212 closer to the human eye 40. The first transparent plate 211 is provided with a plurality of control electrodes 221, which are used to control the deflection of the first transparent plate 211.

[0207] No voltage is applied to any of the control electrodes 221. The first transparent plate 211 and the second transparent plate 212 are parallel to each other, making the tunable lens 21A flat. At this time, the tunable lens 21A is in its initial state; the image display device 11 displays as shown. Figure 28 The low-resolution sub-image shown, after passing through the projection lens 12 and the tunable lens 21A, is output to the human eye 40 as an image like... Figure 29AThe unoffset sub-image shown.

[0208] By changing the energizing state of each control electrode 221 (specifically, applying voltage to the two control electrodes 221 at the lower left and upper left corners of the first transparent plate 211, and not applying voltage to the two control electrodes 221 at the lower right and upper right corners), the left side of the first transparent plate 211 is deflected around the center position O of the tunable lens 21A toward the second transparent plate 212. At this time, the tunable lens 21A is in the first deflection state, with the left side of the tunable lens 21A becoming thinner and the right side becoming thicker, i.e., the tunable lens 21A is in the following position: Figure 12 In state 7, the light rays are deflected to the right after passing through the tunable lens 21A; the image display device 11 displays as shown. Figure 28 The low-resolution sub-image shown is output to the human eye 40 as a first offset sub-image after passing through the projection lens 12 and the tunable lens 21A. This first offset sub-image is shifted to the right compared to the unoffset sub-image. The first offset sub-image is then fused and superimposed with the unoffset sub-image to obtain the image shown. Figure 29B The first intermediate image shown.

[0209] By changing the energizing state of each control electrode 221 (specifically, applying voltage to the control electrode 221 at the upper left corner of the first transparent plate 211, while not applying voltage to the three control electrodes 221 at the upper right, lower right, and lower left corners), the upper left corner of the first transparent plate 211 is deflected around the center position O of the tunable lens 21A toward the second transparent plate 212. At this time, the tunable lens 21A is in a second deflection state, with the upper left corner of the tunable lens 21A becoming thinner and the lower right corner becoming thicker, thus the tunable lens 21A appears as... Figure 12 In state 6, the light rays are shifted to the lower right after passing through the tunable lens 21A; the image display device 11 displays as shown. Figure 28 The low-resolution sub-image shown is used to output a second offset sub-image to the human eye 40 after passing through the projection lens 12 and the tunable lens 21A. This second offset sub-image is shifted to the lower right compared to the unoffset sub-image. The second offset sub-image is then fused and superimposed with the aforementioned first intermediate image to obtain the image shown. Figure 29C The second intermediate image shown.

[0210] By changing the energizing state of each control electrode 221 (specifically, applying voltage to the two control electrodes 221 at the upper left and upper right corners of the first transparent plate 211, and not applying voltage to the two control electrodes 221 at the lower left and lower right corners), the upper side of the first transparent plate 211 is deflected around the center position O of the tunable lens 21A toward the second transparent plate 212. At this time, the tunable lens 21A is in a third deflection state, with the upper side of the tunable lens 21A becoming thinner and the lower side becoming thicker, i.e., the tunable lens 21A is in the form of... Figure 12In state 5, the light rays are deflected downwards after passing through the tunable lens 21A; the image display device 11 displays as shown. Figure 28 The low-resolution sub-image shown is used to output a third offset sub-image to the human eye 40 after passing through the projection lens 12 and the tunable lens 21A. This third offset sub-image is shifted downwards compared to the unoffset sub-image. The third offset sub-image is then fused and superimposed with the aforementioned second intermediate image to obtain the image shown. Figure 29D The higher-resolution image shown is an example of an image with lower resolution. Because this embodiment samples and fuses some pixel units in the original high-resolution image, the final image quality of the higher-resolution image seen by the human eye 40 will be lower than that of the original high-resolution image.

[0211] Remove the voltage applied to each control electrode 221. At this time, no voltage is applied to each control electrode 221, so that the tunable lens 21A returns to the initial state from the third deflection state, so as to perform the image sampling step and image fusion step of the next cycle.

[0212] The image resolution enhancement module performs the above-mentioned image sampling and image fusion steps in each cycle, and repeats the above-mentioned image sampling and image fusion steps in different cycles.

[0213] In specific implementations, the values ​​of M, N, X, and T are not limited to the above embodiments, but can also be other ranges. For example, the following table lists some different embodiments with values ​​of M, N, X, and T:

[0214] Serial Number The value of M The value of N The value of X The value of T 1 2 2 2 2 2 2 2 2 1 3 4 4 4 4 4 4 4 2 2 5 4 4 4 1 6 4 2 2 2 7 4 2 2 1 8 6 6 6 6 9 6 4 4 4 10 6 4 4 1 11 8 8 8 8 12 8 4 4 4 13 8 4 4 1 14 9 9 9 9 15 9 4 4 4 16 9 4 4 1 17 9 3 3 1

[0215] Based on the same inventive concept, this application also provides an image resolution enhancement module, which can be referred to. Figure 1 The image resolution enhancement module includes a beam shifting device 20 according to any of the above embodiments. The beam shifting device 20 includes a beam shifting element 21 and a driving device 22. The image resolution enhancement module also includes an optical engine 10, which includes an image display device 11 and a projection lens 12. The image display device 11 is provided with at least one microdisplay screen 111. The projection lens 12 includes multiple lenses. The driving device 22 is used to drive the beam shifting element 21 to deflect N times in each cycle, so that the beam shifting element 21 sequentially experiences an initial state and N-1 deflection states in each cycle. This is so that the T low-pixel sub-images sequentially displayed by the image display device 11 in each cycle are output to the human eye 40 after passing through the projection lens 12 and the beam shifting device 20, correspondingly outputting one unshifted sub-image and N-1 shifted sub-images in sequence. This allows the human eye 40 to perceive a high-pixel image obtained by fusing and superimposing one unshifted sub-image and N-1 shifted sub-images. Here, N and T are integers, and N≥2, 1≤T≤N.

[0216] In an exemplary embodiment, the projection lens 12 is located between the beam deflection device 20 and the image display device 11. The T low-pixel sub-images output by the image display device 11 in each cycle sequentially pass through the projection lens 12 and the beam deflection device 20.

[0217] In another exemplary embodiment, the beam deflection device 20 is located between the projection lens 12 and the image display device 11. The T low-pixel sub-images output by the image display device 11 in each cycle sequentially pass through the beam deflection device 20 and the projection lens 12.

[0218] In an exemplary embodiment, the image display device 11 includes a plurality of monochromatic micro display screens 111 and a light combining prism 112. The plurality of monochromatic micro display screens 111 are used to respectively output monochromatic light such as the three primary colors of red, green, and blue. Different surfaces of the light combining prism 112 are disposed opposite to the plurality of monochromatic micro display screens 111, and are used to combine the plurality of monochromatic lights such as the three primary colors of red, green, and blue to display sub-images.

[0219] In another exemplary embodiment, the image display device 11 includes a single monochromatic micro display screen 111 to output monochromatic sub-images, or a single full-color micro display screen 111 to output full-color sub-images.

[0220] In an exemplary embodiment, the projection lens 12 includes a plurality of lenses. The number N of the plurality of lenses can be greater than 3, and the material can be glass or plastic.

[0221] In an exemplary embodiment, the diagonal length ld of the micro display screen 111 and the focal length EFL of the projection lens 12 may satisfy: 0.25 < ld / EFL < 3.5, where the diagonal length of the micro display screen 111 is ld, and the focal length of the projection lens 12 is EFL. By satisfying 0.25 < ld / EFL < 3.5 and controlling the ratio range of the diagonal length ld of the micro display screen 111 to the focal length EFL of the projection lens 12, it is possible to avoid too small field of view angle caused by too small ratio and too large field of view angle caused by too large ratio, which is beneficial to obtaining better high-resolution display effects.

[0222] In an exemplary embodiment, the entrance pupil diameter EPD of the projection lens 12 and the diagonal length ld of the micro display screen 111 may satisfy: 0.3 < ld / EPD < 1.5, where the entrance pupil diameter of the projection lens 12 is EPD, and the diagonal length of the micro display screen 111 is ld. By satisfying 0.3 < ld / EPD < 1.5 and controlling the ratio of the entrance pupil diameter EPD of the projection lens 12 to the diagonal length ld of the micro display screen 111, the image brightness can be controlled to be of a suitable size, which is beneficial to obtaining better high-resolution display effects.

[0223] In an exemplary embodiment, the PPD of the image resolution enhancement module, that is, the number of pixels that the human eye 40 can see within each 1° range in the viewing angle, can satisfy: 10 < PPD, where the PPD of the image resolution enhancement module = the number of diagonal pixels / FOV', that is, the number of pixels that the human eye 40 can see within each 1° range in the viewing angle. For an image resolution enhancement module without a resolution enhancement device, 5 < PPD can be satisfied. By setting the resolution enhancement device in the present utility model, the total resolution can be increased to 4 times, the number of pixels on the diagonal can be increased to 2 times, that is, the PPD is increased to 2 times, and 10 < PPD is controlled, which is beneficial to increasing the number of pixels on the diagonal and correspondingly improving the image resolution.

[0224] In an exemplary embodiment, the projection lens 12 further includes an aperture STOP. The aperture STOP can be disposed, for example, on the human eye side of the first lens L1 of the projection lens 12. The first lens L1 is the first lens close to the human eye side among the multiple lenses in the projection lens 12. The aperture STOP can also be disposed between other adjacent lenses.

[0225] In an exemplary embodiment, the projection lens 12 may include multiple lenses, such as 4 or 5, etc. However, those skilled in the art should understand that without departing from the technical solutions claimed in the present application, the number of lenses constituting the optical imaging lens can be changed to obtain the various results and advantages described in this specification.

[0226] Figure 30 Fig. shows a simulation diagram of the effect comparison of the image resolution enhancement module in an embodiment of the present application. Figure 30 The simulation diagrams of the effect comparison of not setting the beam offset device and setting the beam offset device are respectively shown. Visibly, setting the beam offset device in the image resolution enhancement module can obtain an image with a relatively higher resolution. Thus, by setting the beam offset device 20, the image resolution enhancement module according to the embodiment of the present application can maintain the original small volume of the image resolution enhancement module while providing a high-definition picture for the image resolution enhancement module.

[0227] Based on the same inventive concept, according to the near-eye display device of the exemplary embodiment of the present application, the near-eye display device includes the above-mentioned image resolution enhancement module and a power supply unit (not shown in the figure). The power supply unit is respectively connected to the image display device 11 and the beam offset device 20 in the image resolution enhancement module. The power supply unit can supply electric energy to the driving device 22 in the image display device 11 and the beam offset device 20.

[0228] In an exemplary embodiment, the near-eye display device further includes a waveguide (not shown) connected to an image resolution enhancement module. The waveguide is used to transmit the image output by the image resolution enhancement module to the human eye 40. Transmitting the light from the sub-image to the human eye 40 using total internal reflection geometric waveguide technology, or using total internal reflection and diffraction waveguide technology, can facilitate structural optimization and lightweight design. For example, the light emitted from the image display device 11 sequentially passes through the beam deflection device 20, the projection lens 12, and the waveguide to the human eye 40.

[0229] The following describes in further detail, with reference to the accompanying drawings, specific embodiments of the image resolution enhancement module applicable to the above-described implementation.

[0230] Example 1

[0231] The following is for reference Figure 31 This application describes an image resolution enhancement module according to Embodiment 1 of this application. Figure 31 A cross-sectional schematic diagram of the image resolution enhancement module of Embodiment 1 of this application is shown.

[0232] The image resolution enhancement module of Embodiment 1 includes an optical engine 10 and a beam shifting device 20. The optical engine 10 includes an image display device 11 and a projection lens 12.

[0233] The projection lens 12 is located between the beam shifting device 20 and the image display device 11. The light emitted from the image display device 11 passes sequentially through the projection lens 12 and the beam shifting device 20. The beam shifting device 20 includes a beam shifting element 21 and a driving device 22.

[0234] The beam deflection element 21 is a tunable lens 21A, which includes a first transparent plate 211, a second transparent plate 212, and a compressible medium 213 disposed between the first transparent plate 211 and the second transparent plate 212. The driving device 22 controls the first transparent plate 211 and / or the second transparent plate 212 to deflect at an angle and squeeze the compressible medium 213 in each cycle, changing the thickness of the tunable lens 21A at different positions. This causes the tunable lens 21A to change from a plate to a wedge shape with different directions in each cycle, thereby deflecting the light in different directions. In the initial state, the first transparent plate 211 and the second transparent plate 212 are parallel to each other, and the tunable lens 21A can be regarded as a plate. In the deflection state, the first transparent plate 211 and the second transparent plate 212 are not parallel, and the tunable lens 21A is formed into a wedge shape.

[0235] The image display device 11 includes multiple monochrome microdisplays 111 and a light combining prism 112. The multiple monochrome microdisplays 111 are used to output monochrome light, such as red, green and blue primary colors, respectively. Different surfaces of the light combining prism 112 are arranged opposite to the multiple monochrome microdisplays 111 to combine the multiple monochrome lights, such as red, green and blue primary colors, to display a sub-image.

[0236] In this embodiment, as Figure 31 As shown, the light emitted from the micro display screen 111 passes sequentially through the light combining prism 112, the projection lens 12, and the tunable lens 21A.

[0237] In one embodiment, when the projection lens 12 is located between the beam shifting device 20 and the image display device 11, the following condition can be met: 1.5 < ΔIH / Δt < 5, where the thickness deformation of the tunable lens 21A is Δt, and its image height shift is ΔIH. By satisfying the condition that the projection lens 12 is located between the beam shifting device 20 and the image display device 11, and 1.5 < ΔIH / Δt < 5, by controlling the ratio of the thickness deformation Δt of the tunable lens 21A to the image height shift ΔIH, the same image height shift effect corresponds to a larger deformation, thus achieving higher control precision.

[0238] In one embodiment, the image resolution enhancement module according to this application satisfies the condition: 0.1mm ≤ d1 ≤ 2mm, where the thickness of the beam shifting device 20 is d1. Satisfying 0.1mm ≤ d1 ≤ 2mm, and controlling the range of the thickness d1 of the beam shifting device 20, allows control over the thickness of the image resolution enhancement module, which is beneficial for miniaturizing near-eye display devices. Specifically, the thickness of the beam shifting device 20 is set to 0.2mm in Table 1. In another embodiment, the thickness d1 of the beam shifting device 20 can be set to be relatively smaller or larger as needed. Specifically, the thickness of the beam shifting device 20 is set to 0.5mm in Table 10, satisfying the condition 0.1mm ≤ d1 ≤ 2mm.

[0239] In one embodiment, such as Figure 31 As shown, the projection lens 12 may include a first lens L1, a second lens L2, a third lens L3, a fourth lens L4, and a fifth lens L5 arranged sequentially from the human eye side to the microdisplay side. The projection lens 12 may be provided with an aperture stop, which may be located on the human eye side of the first lens L1 of the projection lens 12.

[0240] Table 1 shows the basic parameters of the image resolution enhancement module in Example 1, where the units for radius, thickness, and half-diameter are millimeters (mm).

[0241] Table 1:

[0242]

[0243]

[0244] Wherein, S1 represents the human eye side of the beam shifting device 20, S2 represents the micro-display side of the beam shifting device 20, S3 represents the stop, S4 represents the human eye side of the first lens L1, S5 represents the micro-display side of the first lens L1, S6 represents the human eye side of the second lens L2, S7 represents the micro-display side of the second lens L2, S8 represents the human eye side of the third lens L3, S9 represents the micro-display side of the third lens L3, S10 represents the human eye side of the fourth lens L4, S11 represents the micro-display side of the fourth lens L4, S12 represents the human eye side of the fifth lens L5, S13 represents the micro-display side of the fifth lens L5, S14 represents the human eye side of the beam combining prism 112, S15 represents the micro-display side of the beam combining prism 112, and S16 represents the micro-display 111.

[0245] Among them, the object-side surface and image-side surface of any one of the first lens L1 to the fifth lens L5 can both be even-order aspherical surfaces, and the surface shape of each aspherical lens can be defined by, but is not limited to, the following aspherical formula:

[0246] (1)

[0248] Where Z represents the height along the optical axis, c is the reciprocal of the surface radius, k is the conic coefficient, and r is the aperture along the radial direction; α represents the aspherical coefficient, α1 represents the aspherical coefficient A2, α2 represents the aspherical coefficient A4, and so on. Table 2 shows the higher-order coefficients A4, A6, A8, A10, A12, A14, and A16 of the aspherical mirrors that can be used in the projection lens 12 of Embodiment 1 from the second lens L2 to the fifth lens L5.

[0249] Table 2:

[0250]

[0251]

[0252] In Embodiment 1, the diagonal length ld of the micro display screen 111 is 2.6 mm, and the focal length EFL of the projection lens 12 is 5.5 mm. Then ld / EFL = 0.47, which can satisfy: 0.25 < ld / EFL < 3.5. The entrance pupil diameter EPD of the projection lens 12 is 3.06 mm, and the diagonal length ld of the micro display screen 111 is 2.6 mm. Then EPD / ld = 0.85, which can satisfy: 0.3 < ld / EPD < 1.5. The deflection angle set for the beam deflection device 20 is 0.04°, and the thickness deformation amount is 1.17 μm. The first transparent flat plate 311 of the tunable lens 21A can be set to have a single-sided deflection angle θ of 0.04°, and the single-sided edge thickness change amount d2 is 1.17 μm. Then the thickness deformation amount Δt of the tunable lens 21A is 1.17 μm. Table 3 shows the relevant parameter table of the image height change before and after the deflection of the tunable lens 21A in Embodiment 1 at different fields of view.

[0253] Table 3:

[0254]

[0255] Each period of the tunable lens 21A experiences a change from a flat plate to a wedge with a different direction. When deflecting into a wedge with a different direction, it will cause light rays emitted from the same light source position, such as at an image height of 0 μm, to enter the human eye 40 at an angle in different directions, which is equivalent to multiple light sources at another image height, such as 2 μm, in different directions on the micro display screen entering the human eye 40 at 0°. Thus, Table 3 corresponds the angle change generated before and after the wedge deflection of different image heights to the image height change. Among them, OF to 1.0F in the field of view in the first column evenly divides the imaging field of view of the lens into 10 equal parts according to the image height.

[0256] It can be obtained from Table 3 that when the projection lens 12 is located between the beam deflection device 20 and the image display device 11, the relationship between the thickness deformation amount Δt of the tunable lens 21A and the image height offset ΔIH satisfies: 1.5 < ΔIH / Δt < 5, and a larger image height offset effect can be achieved with a smaller deformation amount.

[0257] Example 2

[0258] The following refers to Figure 32 Describe the image resolution improvement module according to Embodiment 2 of the present application. Figure 32A cross-sectional schematic diagram of the image resolution enhancement module of Embodiment 2 of this application is shown. For brevity, descriptions similar to those in Embodiment 1 are omitted in Embodiment 2. The image resolution enhancement module of this embodiment is basically the same as that of Embodiment 1, except that the beam shifting device 20 is located between the projection lens 12 and the image display device 11, and the light emitted from the image display device 11 passes sequentially through the beam shifting device 20 and the projection lens 12. In this embodiment, as... Figure 32 As shown, the light emitted from the micro display screen 111 passes sequentially through the light combining prism 112, the tunable lens 21A, and the projection lens 12.

[0259] In one embodiment, when the beam shifting device 20 is located between the projection lens 12 and the image display device 11, the following condition can be met: 1 < ΔIH / Δt < 3, where the thickness deformation of the tunable lens 21A is Δt, and its image height shift is ΔIH. By satisfying that the beam shifting device 20 is located between the projection lens 12 and the image display device 11, and 1 < ΔIH / Δt < 3, controlling the ratio of the thickness deformation Δt of the tunable lens 21A to the image height shift ΔIH allows for a larger deformation for the same image height shift effect, thus achieving higher control precision.

[0260] Table 4 shows the basic parameters of the image resolution enhancement module in Example 2, where the units for radius, thickness, and half-diameter are millimeters (mm).

[0261] Table 4:

[0262]

[0263]

[0264] Wherein, S1 represents the aperture stop, S2 represents the human eye side of the first lens L1, S3 represents the micro-display side of the first lens L1, S4 represents the human eye side of the second lens L2, S5 represents the micro-display side of the second lens L2, S6 represents the human eye side of the third lens L3, S7 represents the micro-display side of the third lens L3, S8 represents the human eye side of the fourth lens L4, S9 represents the micro-display side of the fourth lens L4, S10 represents the human eye side of the fifth lens L5, S11 represents the micro-display side of the fifth lens L5, S12 represents the human eye side of the beam shifting device 20, S13 represents the micro-display side of the beam shifting device 20, S14 represents the human eye side of the beam combining prism 112, S15 represents the micro-display side of the beam combining prism 112, and S16 represents the micro-display 111.

[0265] Table 5 shows the coefficients A4, A6, A8, A10, A12, A14, and A16 of the high-order terms of the aspherical surfaces of the first lens L1 to the fifth lens L5 that can be used for the projection lens 12 in Example 2.

[0266] Table 5:

[0267] Face number A4 A6 A8 A10 A12 A14 A16 S4 6.00E-02 -1.13E-02 -5.61E-02 1.54E-01 -2.06E-01 1.62E-01 -7.58E-02 S5 1.68E-01 -1.06E-01 -1.61E-02 2.88E-01 -5.55E-01 5.64E-01 -3.31E-01 S6 2.81E-02 -2.24E-01 4.65E-01 -6.29E-01 5.67E-01 -3.25E-01 1.06E-01 S7 -2.13E-01 -1.91E-01 7.43E-01 -1.59E+00 2.19E+00 -2.00E+00 1.13E+00 S8 -1.24E-01 1.17E-01 -1.44E-01 9.30E-01 -2.66E+00 3.84E+00 -3.13E+00 S9 -4.13E-01 1.20E+00 -2.27E+00 3.46E+00 -4.15E+00 3.59E+00 -2.06E+00 S10 -3.23E-01 1.02E+00 -1.85E+00 2.20E+00 -1.85E+00 1.08E+00 -4.27E-01 S11 -6.04E-02 5.44E-02 -1.15E-02 -1.19E-01 2.09E-01 -1.81E-01 8.84E-02

[0268] In Example 2, the diagonal length ld of the micro display screen 111 is 2.6 mm, and the focal length EFL of the projection lens 12 is 5.5 mm. Then ld / EFL = 0.47, which can satisfy: 0.25 < ld / EFL < 3.5. The entrance pupil diameter EPD of the projection lens 12 is 3.06 mm, and the diagonal length ld of the micro display screen 111 is 2.6 mm. Then ld / EPD = 0.85, which can satisfy: 0.3 < ld / EPD < 1.5. The deflection angle set by the beam deflection device 20 is 0.07°, and the thickness deformation amount is 1.72 μm. The first transparent plate 211 of the tunable lens 21A can be set to have a single-sided deflection angle θ of 0.08°, and the single-sided edge thickness change amount d2 is 1.72 μm. Then the thickness deformation amount Δt of the tunable lens 21A is 1.72 μm. Table 6 shows the relevant parameter table of the image height change before and after the deflection of the tunable lens 21A in Example 2 at different fields of view.

[0269] [[ID=1--12]]Table 6:

[0270]

[0271] It can be obtained from Table 6 that when the beam deflection device 20 is located between the projection lens 12 and the image display device 11, the relationship between the thickness deformation amount Δt of the tunable lens 21A and the image height offset ΔIH satisfies: 1 < ΔIH / Δt < 3. For the same image height offset effect, a larger deformation amount can be obtained, and higher control accuracy can be achieved.

[0272] Example 3

[0273] The following refers to Figure 33 Describe the image resolution improvement module according to Embodiment 3 of the present application. Figure 33 Fig. shows a cross-sectional schematic diagram of the image resolution improvement module according to Embodiment 3 of the present application. In Embodiment 3, for the sake of simplicity, some descriptions similar to those in Embodiment 1 will be omitted. The image resolution improvement module of this embodiment is basically the same as the aforementioned Embodiment 1, except that: the image display device 11 includes a monochromatic micro display screen 111 for outputting a monochromatic sub-image, or a full-color micro display screen 111 for outputting a full-color sub-image.

[0274] In this embodiment, as Figure 33As shown, the light emitted from the microdisplay 111 passes sequentially through the projection lens 12 and the tunable lens 21A.

[0275] In one embodiment, such as Figure 33 As shown, the projection lens 12 may include a first lens L1, a second lens L2, a third lens L3, and a fourth lens L4 arranged sequentially from the human eye side to the microdisplay side. In one embodiment, as... Figure 33 As shown, the projection lens 12 may be equipped with a stop, which may be set on the side of the first lens L1 of the projection lens 12 on the side of the human eye.

[0276] Table 7 shows the basic parameters of the image resolution enhancement module in Example 3, where the units for radius, thickness, and half-diameter are millimeters (mm).

[0277] Table 7:

[0278]

[0279] Wherein, S1 represents the human eye side of the beam shifting device 20, S2 represents the micro-display side of the beam shifting device 20, S3 represents the stop, S4 represents the human eye side of the first lens L1, S5 represents the micro-display side of the first lens L1, S6 represents the human eye side of the second lens L2, S7 represents the micro-display side of the second lens L2, S8 represents the human eye side of the third lens L3, S9 represents the micro-display side of the third lens L3, S10 represents the human eye side of the fourth lens L4, S11 represents the micro-display side of the fourth lens L4, and S12 represents the micro-display 111.

[0280] Table 8 gives the higher-order coefficients A4, A6, A8, A10, A12, A14 and A16 of each aspherical mirror surface that can be used in the projection lens 12 of Embodiment 3, from the first lens L1 to the fourth lens L4.

[0281] Table 8:

[0282] Face number A4 A6 A8 A10 A12 A14 A16 S4 -1.89E-03 -1.64E-02 5.69E-04 1.05E-01 -2.30E-01 2.37E-01 -1.33E-01 S5 -9.75E-03 -1.63E-01 1.01E+00 -2.19E+00 2.60E+00 -1.86E+00 7.97E-01 S6 -7.15E-02 -1.74E-01 1.65E+00 -3.95E+00 4.90E+00 -3.57E+00 1.53E+00 S7 -1.34E-01 3.21E-01 4.60E-01 -2.88E+00 5.29E+00 -5.20E+00 2.96E+00 S8 -3.70E-01 2.92E+00 -1.05E+01 2.44E+01 -3.84E+01 4.11E+01 -2.86E+01 S9 -4.92E-01 3.06E+00 -1.22E+01 3.22E+01 -5.82E+01 7.20E+01 -5.81E+01 S10 -8.25E-02 1.83E-01 -3.28E-01 5.37E-01 -8.20E-01 1.21E+00 -1.26E+00 S11 3.28E-02 -3.17E-03 2.40E-01 -1.02E+00 2.38E+00 -3.36E+00 2.93E+00

[0283] In Embodiment 3, the diagonal length ld of the microdisplay 111 is 3.23 mm, and the focal length EFL of the projection lens 12 is 5.7 mm. Then ld / EFL = 0.57, which satisfies 0.25 < ld / EFL < 3.5. The entrance pupil diameter EPD of the projection lens 12 is 2.59 mm, and the diagonal length ld of the microdisplay 111 is 3.23 mm. Then EPD / ld = 1.25, which satisfies 0.3 < ld / EPD < 1.5. The beam deflection device 20 is set to have a deflection angle of 0.02° and a thickness deformation of 0.54 μm. The first transparent plate 211 of the tunable lens 21A can be set to have a single-sided deflection angle θ of 0.02°, and the single-sided edge thickness change d2 is 0.54 μm. Then the thickness deformation Δt of the tunable lens 21A is 0.54 μm. Table 9 shows the relevant parameter table of the image height change before and after the deflection of the tunable lens 21A at different viewing angles in Embodiment 3.

[0284] Table 9:

[0285]

[0286] It can be obtained from Table 9 that when the projection lens 12 is located between the beam deflection device 20 and the image display device 11, the relationship between the thickness deformation Δt of the tunable lens 21A and the image height offset ΔIH satisfies 1.5 < ΔIH / Δt < 5, and a large image height offset effect can be achieved with a small deformation.

[0287] Example 4

[0288] The following refers to Figure 34 Describe the image resolution improvement module according to Embodiment 4 of the present application. Figure 34 Fig. shows a cross-sectional schematic diagram of the image resolution improvement module according to Embodiment 4 of the present application. In Embodiment 4, for the sake of simplicity, some descriptions similar to those in Embodiment 3 will be omitted. The image resolution improvement module of this embodiment is basically the same as the aforementioned Embodiment 3, except that: the beam deflection device 20 is located between the projection lens 12 and the image display device 11, and the light emitted by the image display device 11 passes through the beam deflection device 20 and the projection lens 12 in sequence.

[0289] In this embodiment, as Figure 34 shown, the light emitted by the microdisplay 111 passes through the tunable lens 21A and the projection lens 12 in sequence.

[0290] In one embodiment, when the beam shifting device 20 is located between the projection lens 12 and the image display device 11, it satisfies: 1 < ΔIH / Δt < 3, where the thickness deformation of the tunable lens 21A is Δt, and its image height shift is ΔIH. By satisfying 1 < ΔIH / Δt < 3 and controlling the ratio of the thickness deformation Δt to the image height shift ΔIH of the tunable lens 21A, a larger deformation corresponds to the same image height shift effect, thus achieving higher control precision.

[0291] In one embodiment, such as Figure 34 As shown, the projection lens 12 may include a first lens L1, a second lens L2, a third lens L3, and a fourth lens L4 arranged sequentially from the human eye side to the microdisplay side. In one embodiment, as... Figure 34 As shown, the projection lens 12 may be equipped with a stop, which may be set on the side of the first lens L1 of the projection lens 12 on the side of the human eye.

[0292] Table 10 shows the basic parameters of the image resolution enhancement module in Example 4, where the units for radius, thickness, and half-diameter are millimeters (mm).

[0293] Table 10:

[0294]

[0295] Wherein, S1 represents the aperture stop, S2 represents the human eye side of the first lens L1, S3 represents the micro-display side of the first lens L1, S4 represents the human eye side of the second lens L2, S5 represents the micro-display side of the second lens L2, S6 represents the human eye side of the third lens L3, S7 represents the micro-display side of the third lens L3, S8 represents the human eye side of the fourth lens L4, S9 represents the micro-display side of the fourth lens L4, S10 represents the human eye side of the beam shifting device 20, S11 represents the micro-display side of the beam shifting device 20, and S12 represents the micro-display 111.

[0296] Table 11 gives the higher-order coefficients A4, A6, A8, A10, A12, A14 and A16 of each aspherical mirror surface that can be used in the projection lens 12 of Embodiment 4, from the first lens L1 to the fourth lens L4.

[0297] Table 11:

[0298] Face number A4 A6 A8 A10 A12 A14 A16 S2 -1.89E-03 -1.64E-02 5.69E-04 1.05E-01 -2.30E-01 2.37E-01 -1.33E-01 S3 -9.75E-03 -1.63E-01 1.01E+00 -2.19E+00 2.60E+00 -1.86E+00 7.97E-01 S4 -7.15E-02 -1.74E-01 1.65E+00 -3.95E+00 4.90E+00 -3.57E+00 1.53E+00 S5 -1.34E-01 3.21E-01 4.60E-01 -2.88E+00 5.29E+00 -5.20E+00 2.96E+00 S6 -3.70E-01 2.92E+00 -1.05E+01 2.44E+01 -3.84E+01 4.11E+01 -2.86E+01 S7 -4.92E-01 3.06E+00 -1.22E+01 3.22E+01 -5.82E+01 7.20E+01 -5.81E+01 S8 -8.25E-02 1.83E-01 -3.28E-01 5.37E-01 -8.20E-01 1.21E+00 -1.26E+00 S9 3.28E-02 -3.17E-03 2.40E-01 -1.02E+00 2.38E+00 -3.36E+00 2.93E+00

[0299] In Embodiment 4, the diagonal length ld of the microdisplay 111 is 3.23 mm, and the focal length EFL of the projection lens 12 is 5.7 mm. Then ld / EFL = 0.57, which satisfies 0.25 < ld / EFL < 3.5. The entrance pupil diameter EPD of the projection lens 12 is 2.59 mm, and the diagonal length ld of the microdisplay 111 is 3.23 mm. Then EPD / ld = 1.25, which satisfies 0.3 < ld / EPD < 1.5. The beam deflection device 20 is set to have a deflection angle of 0.05° and a thickness deformation of 0.98 μm. The first transparent plate 211 of the tunable lens 21A can be set to have a single-sided deflection angle θ of 0.05°, and the single-sided edge thickness change d2 is 0.98 μm. Then the thickness deformation Δt of the tunable lens 21A is 0.98 μm. Table 12 shows the relevant parameter table of the image height change before and after the deflection of the tunable lens 21A in Embodiment 4 at different field angles.

[0300] Table 12:

[0301]

[0302] It can be obtained from Table 12 that when the beam deflection device 20 is located between the projection lens 12 and the image display device 11, the thickness deformation Δt of the tunable lens 21A and the image height offset ΔIH satisfy 1 < ΔIH / Δt < 3. For the same image height offset effect, a larger deformation can be obtained, and higher control accuracy can be achieved.

[0303] Example 5

[0304] The following refers to Figure 35 Describe the image resolution improvement module according to Embodiment 5 of the present application. Figure 35 The cross-sectional schematic diagram of the image resolution improvement module according to Embodiment 5 of the present application is shown. In Embodiment 5, for the sake of simplicity, some descriptions similar to those in Embodiment 1 will be omitted. The image resolution improvement module of this embodiment is basically the same as the foregoing Embodiment 1, and the difference lies in that: the beam deflection element (21) is a transparent wedge-shaped lens (21B), the transparent wedge-shaped lens (21B) is wedge-shaped, and the surfaces on the opposite sides of the transparent wedge-shaped lens (21B) are respectively a first plane (the 214) and an inclined surface (the 215), and the inclined surface (the 215) is inclined with respect to the first plane (the 214). During use, it is preferably to make the inclined surface (the 215) of the transparent wedge-shaped lens (21B) close to the image display device 11, that is: the inclined surface (the 215) is located between the first plane (the 214) and the image display device 11.

[0305] In this embodiment, as Figure 35 shown, the light emitted by the microdisplay 111 passes through the light combining prism 112, the projection lens 12, and the transparent wedge-shaped lens 21B in sequence.

[0306] In an exemplary embodiment, the transparent wedge lens 21B can be a single optical element, which is a single piece of transparent wedge-shaped structure, such as a single piece of transparent wedge-shaped glass plate. Alternatively, the transparent wedge lens 21B can be a combination of multiple optical elements, the overall shape of which is a wedge shape, and the relative positions of each optical element are fixed, making the wedge structure fixed and unchangeable. For example, the transparent wedge lens 21B may include two transparent flat plates whose surfaces are not parallel and are relatively fixed. A medium, such as air, glue, or other materials, may be disposed between the two transparent flat plates. In other embodiments, the transparent wedge lens 21B may also include multiple transparent wedge-shaped glass plates, which together form a wedge-shaped beam deflection element 21. Alternatively, the aforementioned medium may be disposed between the multiple transparent wedge-shaped glass plates, with the multiple transparent wedge-shaped glass plates and the medium together forming a wedge-shaped beam deflection element 21.

[0307] Example 6

[0308] The following is for reference Figure 36 This application describes an image resolution enhancement module according to Embodiment 6 of this application. Figure 36 A cross-sectional schematic diagram of the image resolution enhancement module of Embodiment 6 of this application is shown. In Embodiment 6, for the sake of brevity, descriptions similar to those in Embodiment 5 are omitted. The image resolution enhancement module of this embodiment is basically the same as that of Embodiment 5, except that the beam shifting device 20 is located between the projection lens 12 and the image display device 11, and the light emitted from the image display device 11 passes through the beam shifting device 20 and the projection lens 12 in sequence.

[0309] In this embodiment, as Figure 36 As shown, the light emitted from the micro display screen 111 passes sequentially through the light combining prism 112, the transparent wedge lens 21B, and the projection lens 12.

[0310] Example 7

[0311] The following is for reference Figure 37 The image resolution enhancement module according to Embodiment 7 of this application is described. Figure 37 A cross-sectional schematic diagram of the image resolution enhancement module of Embodiment 7 of this application is shown. In Embodiment 7, for the sake of brevity, descriptions similar to those in Embodiment 5 are omitted. The image resolution enhancement module of this embodiment is basically the same as that of Embodiment 5, except that the image display device 11 includes a monochrome microdisplay 111 to output a monochrome sub-image, or a full-color microdisplay 111 to output a full-color sub-image.

[0312] In this embodiment, as Figure 37As shown, the light emitted from the microdisplay 111 passes sequentially through the projection lens 12 and the transparent wedge lens 21B.

[0313] Example 8

[0314] The following is for reference Figure 38 This application describes an image resolution enhancement module according to Embodiment 8 of this application. Figure 38 A cross-sectional schematic diagram of the image resolution enhancement module of Embodiment 8 of this application is shown. In Embodiment 8, for the sake of brevity, descriptions similar to those in Embodiment 7 are omitted. The image resolution enhancement module of this embodiment is basically the same as that of Embodiment 8, except that the beam shifting device 20 is located between the projection lens 12 and the image display device 11, and the light emitted from the image display device 11 passes through the beam shifting device 20 and the projection lens 12 in sequence.

[0315] In this embodiment, as Figure 38 As shown, the light emitted from the microdisplay 111 passes sequentially through the transparent wedge lens 21B and the projection lens 12.

[0316] Example 9

[0317] The following is for reference Figure 39 The image resolution enhancement module according to Embodiment 9 of this application is described. Figure 39 A cross-sectional schematic diagram of the image resolution enhancement module of Embodiment 9 of this application is shown. In Embodiment 9, for the sake of brevity, descriptions similar to those in Embodiments 5, 6, 7, and 8 are omitted. The image resolution enhancement module of this embodiment is basically the same as that of the aforementioned Embodiments 5, 6, 7, and 8, except that: the beam deflection element 21 is a transparent flat plate lens 21C, which is flat in shape, and the surfaces on opposite sides of the transparent flat plate lens 21C are a second plane 216 and a third plane 217, respectively, which are parallel to each other.

[0318] In this embodiment, only the following is illustrated: Figure 39 The image resolution enhancement module, in which light emitted from the microdisplay 111 passes sequentially through a light-combining prism 112, a transparent flat panel lens 21C, and a projection lens 12. Schematic diagrams of other embodiments will not be shown one by one.

[0319] In an exemplary embodiment, the transparent flat plate lens 21C can be an optical element, which is a single transparent flat plate structure, such as a single piece of transparent glass. The transparent flat plate lens 21C can also be a combination of multiple optical elements, the overall shape of which is a flat plate structure, and the relative positions of each optical element are fixed, making the flat plate structure fixed and unchangeable. For example, the transparent flat plate lens 21C can include multiple stacked transparent plates; or, the transparent flat plate lens 21C can include two transparent plates, the surfaces of which are parallel and relatively fixed, and a medium can be provided in the middle of the two transparent plates, which can be air, glue, or other media.

Claims

1. A beam shifting device for an image resolution enhancement module, the image resolution enhancement module comprising an image display device (11) and a projection lens (12), characterized in that, The beam shifting device (20) includes a beam shifting element (21) and a driving device (22). The driving device (22) is used to drive the beam shifting element (21) to deflect N times in each cycle, so that the beam shifting element (21) sequentially experiences an initial state and N-1 deflection states in each cycle, so that the T low-pixel sub-images displayed by the image display device (11) pass through the beam shifting element (21) and the projection lens (12) and output one unshifted sub-image and N-1 shifted sub-images to the human eye (40) in sequence, so that the human eye (40) perceives a high-pixel image obtained by fusing and superimposing one unshifted sub-image and N-1 shifted sub-images; where N and T are integers, and N≥2, 1≤T≤N.

2. The beam deflection device according to claim 1, characterized in that, When the beam deflection element (21) is in a deflection state, the beam deflection element (21) is wedge-shaped as a whole.

3. The beam deflection device according to claim 2, characterized in that, The beam deflection element (21) is a tunable lens (21A), which includes a first transparent plate (211), a second transparent plate (212), and a compressible medium (213) disposed between the first transparent plate (211) and the second transparent plate (212); the driving device (22) includes at least one control electrode (221) disposed on the first transparent plate (211) and / or the second transparent plate (212), which is used to drive the first transparent plate (211) and / or the second transparent plate (212) to deflect; When the tunable lens (21A) is in its initial state, the first transparent plate (211) and the second transparent plate (212) are parallel to each other, so that the tunable lens (21A) is in the shape of a plate; When the tunable lens (21A) is in a deflected state, the first transparent plate (211) and / or the second transparent plate (212) deflect and squeeze the compressible medium (213) to make the tunable lens (21A) wedge-shaped.

4. The beam deflection device according to claim 3, characterized in that, The refractive index n1 of the first transparent plate (211) and the second transparent plate (212) satisfies: 1.5≤n1≤1.9; And / or, the refractive index n2 of the compressible medium (213) satisfies: 1.5≤n2≤1.65; And / or, the PV of the first transparent plate (211) and the second transparent plate (212) satisfies: 1 / 20λ≤PV≤1 / 4λ.

5. The beam deflection device according to claim 3, characterized in that, The single-sided deflection angle θ and the single-sided edge thickness variation d2 of the tunable lens (21A) satisfy: 0°≤θ≤0.3°, 0μm≤d2≤20μm.

6. The beam deflection device according to claim 3, characterized in that, The projection lens (12) is located between the beam shifting device (20) and the image display device (11), and the thickness deformation Δt of the tunable lens (21A) and the image height shift ΔIH satisfy the following condition: 1.5 < ΔIH / Δt < 5; Alternatively, the beam shifting device (20) is located between the projection lens (12) and the image display device (11), and the thickness deformation Δt of the tunable lens (21A) satisfies the following relationship with the image height shift ΔIH: 1 < ΔIH / Δt < 3.

7. The beam deflection device according to claim 3, characterized in that, The control electrode (221) is disposed on the surface of the first transparent plate (211) away from the second transparent plate (212) and / or on the surface of the second transparent plate (212) away from the first transparent plate (211), and the control electrode (221) is disposed at the edge position of the tunable lens (21A).

8. The beam deflection device according to claim 2, characterized in that, The beam deflection element (21) is a transparent wedge lens (21B), which is wedge-shaped.

9. The beam deflection device according to claim 1, characterized in that, The beam deflection element (21) is a transparent flat plate lens (21C), which is flat in shape.

10. The beam deflection device according to claim 1, characterized in that, The thickness d1 of the beam deflection device (20) satisfies: 0.1mm≤d1≤2mm.

11. The beam deflection device according to claim 1, characterized in that, The condition N satisfies: 2≤N≤9.

12. The beam deflection device according to claim 11, characterized in that, N = 2, or N = 4.

13. The beam deflection device according to claim 1, characterized in that, The projection lens (12) is located between the beam shifting device (20) and the image display device (11); when the beam shifting element (21) is in the deflection state, the beam shifting element (21) shifts the image height by 0.2p to 0.8p; Alternatively, the beam shifting device (20) is located between the projection lens (12) and the image display device (11); when the beam shifting element (21) is in a deflection state, the beam shifting element (21) and the projection lens (12) shift the image height by 0.2p to 0.8p.

14. An image resolution enhancement module, characterized in that, The system includes an image display device (11), a projection lens (12), and a beam shifting device (20) as described in any one of claims 1-13; the image display device (11) includes at least one microdisplay (111), and the image display device (11) is used to receive T low-pixel sub-images obtained by sampling an original high-pixel image by an image processing module (30), wherein the pixel difference between the original high-pixel image and the low-pixel sub-image is M; the image display device (11) sequentially displays the T low-pixel sub-images in each cycle, and after passing through the projection lens (12) and the beam shifting device (20), outputs one unshifted sub-image and N-1 shifted sub-images to the human eye (40) in sequence, so that the human eye (40) perceives a high-pixel image obtained by fusing and superimposing one unshifted sub-image and N-1 shifted sub-images; wherein M, N, and T are integers, and 2≤N≤M, 1≤T≤N.

15. The image resolution enhancement module according to claim 14, characterized in that, N = M, T = N.

16. The image resolution enhancement module according to claim 14, characterized in that, The projection lens (12) is located between the beam shifting device (20) and the image display device (11). The T low-pixel sub-images output by the image display device (11) in each cycle pass sequentially through the projection lens (12) and the beam shifting device (20). Alternatively, the beam shifting device (20) is located between the projection lens (12) and the image display device (11), and the T low-pixel sub-images output by the image display device (11) in each cycle pass sequentially through the beam shifting device (20) and the projection lens (12).

17. The image resolution enhancement module according to claim 14, characterized in that, The image display device (11) includes a plurality of monochrome microdisplays (111) and a light-combining prism (112); Alternatively, the image display device (11) may include a monochrome microdisplay (111); Alternatively, the image display device (11) may include a full-color microdisplay (111).

18. The image resolution enhancement module according to claim 14, characterized in that, The diagonal length ld of the microdisplay (111) and the focal length EFL of the projection lens (12) satisfy the following condition: 0.25 <ld / EFL<3.5; And / or, the entrance pupil diameter EPD of the projection lens (12) and the diagonal length ld of the microdisplay (111) satisfy the following relationship: 0.3 <ld / EPD<1.5; And / or, the PPD of the image resolution enhancement module, i.e., the number of pixels that the human eye (40) can see within each 1° range of the field of view, satisfies: 10 <PPD。 19. A near-eye display device, characterized in that, It includes an image resolution enhancement module and a power supply unit as described in any one of claims 14 to 18, wherein the power supply unit is electrically connected to the image display device (11) and the beam shifting device (20) in the image resolution enhancement module, respectively.

Images