Light beam offset device, image resolution improving module, method and equipment
The beam offset device deflects N times in each cycle, and outputs multiple sub-images to realize high-definition picture display, solving the problem of image resolution drop in miniaturized near-eye display devices and providing a high-definition picture experience.
Patent Information
- Application Number
- CN202510600701.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-05-10
- Publication Date
- 2025-07-22
AI Technical Summary
In the process of pursuing miniaturization and lightweighting, existing near-eye display devices often reduce the image resolution and cannot provide high-definition screen display.
The beam offset device is used to deflect N times in each cycle through the beam offset element, so that the image display device outputs an undisplaced sub-image and the N-1 offset sub-image, and fuses into a high-pixel image using the visual residual effect of the human eye.
It realizes the high-definition screen display in small-volume near-eye display devices, which improves image resolution.
Smart Images

Figure CN120353028A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of projection display, and particularly to a beam deflection device, an image resolution improvement module, an image resolution improvement method, and a near-eye display device. Background Art
[0002] As an emerging technology, a near-eye display device can project an image on a micro display screen near the user's eyes to achieve a virtual reality or augmented reality experience, thus attracting much attention.
[0003] However, the key for a user to wear the near-eye display device for a long time and comfortably is to reduce the weight of the device and the volume of the device. However, if only focusing on reducing the weight of the device and the volume of the device, it will lead to a decrease in the resolution of the image resolution improvement module in the near-eye display device and cannot provide a high-definition picture display. Therefore, there is a need to provide a near-eye display device with a small volume and capable of providing a high-definition picture. Summary of the Invention
[0004] In view of the above problems, an object of the present invention is to provide a beam deflection device, an image resolution improvement module, an image resolution improvement method, and a near-eye display device, which can achieve a small volume and provide a high-definition picture.
[0005] The present invention provides a beam deflection device for an image resolution improvement module. The image resolution improvement module includes an image display device and a projection lens. The beam deflection device includes a beam deflection element and a driving device. The driving device is configured to drive the beam deflection element to deflect N times in each period, so that the beam deflection element sequentially experiences an initial state and N - 1 deflection states in each period, so that T sub low-pixel sub-images displayed by the image display device pass through the beam deflection element and the projection lens and sequentially output an unshifted sub-image and N - 1 shifted sub-images to the human eye, so that the human eye can feel a high-pixel image obtained by fusing and superimposing one unshifted sub-image and N - 1 shifted sub-images; where N and T are integers, and N≥2, 1≤T≤N.
[0006] The present invention provides an image resolution enhancement module. The image resolution enhancement module includes an image display device, a projection lens, and the above-mentioned beam offset device. The image display device is provided with at least one micro display screen. The image display device is configured to receive T low-pixel sub-images obtained by sampling an original high-pixel image by an image processing module. Wherein, the pixel multiple difference between the original high-pixel image and the low-pixel sub-image is M. After the T low-pixel sub-images sequentially displayed by the image display device in each cycle pass through the projection lens and the beam offset device, an unshifted sub-image and N - 1 shifted sub-images are sequentially output to the human eye, so that the human eye can perceive a high-pixel image obtained by fusing and superimposing one unshifted sub-image and N - 1 shifted sub-images. Wherein, N, M, and T are integers, and 2 ≤ N ≤ M, 1 ≤ T ≤ N.
[0007] The present invention also provides an image resolution enhancement method for the above-mentioned image resolution enhancement module. The image resolution enhancement method includes:
[0008] The image processing module divides the original high-pixel image into a plurality of pixel regions. Each pixel region includes M pixel units. The M pixel units in each pixel region are respectively a first pixel unit, a second pixel unit,..., an Xth pixel unit,..., an Mth pixel unit. Wherein, the second pixel unit is located in a first direction of the first pixel unit, the third pixel unit is located in a second direction of the first pixel unit,..., the Xth pixel unit is located in an (X - 1)th direction of the first pixel unit,..., and the Mth pixel unit is located in an (M - 1)th direction of the first pixel unit.
[0009] The image processing module extracts and combines all the first pixel units in each pixel region to form a first low-pixel sub-image, extracts and combines all the second pixel units in each pixel region to form a second low-pixel sub-image, extracts and combines all the third pixel units in each pixel region to form a third low-pixel sub-image,..., and so on, extracts and combines all the Xth pixel units in each pixel region to form an Xth low-pixel sub-image. Then the image processing module transmits the T low-pixel sub-images to the image display device.
[0010] The beam offset element is in an initial state. The image display device displays the first low-pixel sub-image. The first low-pixel sub-image outputs an unshifted sub-image to the human eye after passing through the projection lens and the beam offset device.
[0011] Control the driving device to drive the light beam offset element to deflect in the first deflection direction, so that the light beam offset element is in the first deflection state; the image display device displays a second low-pixel sub-image, and the second low-pixel sub-image outputs a first deflected sub-image to the human eye after passing through the projection lens and the light beam offset device, wherein the first deflected sub-image is deflected in the first direction compared with the non-deflected sub-image; the first deflected sub-image and the non-deflected sub-image are fused and superimposed to obtain a first intermediate image;
[0012] Control the driving device to drive the light beam offset element to deflect in the second deflection direction, so that the light beam offset element is in the second deflection state; the image display device displays a third low-pixel sub-image, and the third low-pixel sub-image outputs a second deflected sub-image to the human eye after passing through the projection lens and the light beam offset device, wherein the second deflected sub-image is deflected in the second direction compared with the non-deflected sub-image; the second deflected sub-image and the first intermediate image are fused and superimposed to obtain a second intermediate image;
[0013] …
[0014] Control the driving device to drive the light beam offset element to deflect in the (N - 1)th deflection direction, so that the light beam offset element is in the (N - 1)th deflection state; the image display device displays an Xth low-pixel sub-image, and the Xth low-pixel sub-image outputs an (N - 1)th deflected sub-image to the human eye after passing through the projection lens and the light beam offset device, wherein the (N - 1)th deflected sub-image is deflected in the (X - 1)th direction compared with the non-deflected sub-image; the (N - 1)th deflected sub-image and the (N - 2)th intermediate image are fused and superimposed to obtain a high-pixel image; wherein, the first deflection direction, the second deflection direction,..., the (N - 1)th deflection direction are different deflection directions respectively;
[0015] Control the driving device to drive the light beam offset element to deflect, so that the light beam offset element returns from the (N - 1)th deflection state to the initial state;
[0016] Wherein, M is the pixel multiple difference between the original high-pixel image and the low-pixel sub-image, 2 ≤ N ≤ M, and T = X = N, and X, M, N, and T are all integers.
[0017] The present invention also provides another image resolution improvement method for the above image resolution improvement module, and the image resolution improvement method includes:
[0018] The image processing module divides the original high - pixel image into multiple pixel regions. Each pixel region includes M pixel units, and the M pixel units in each pixel region are the first pixel unit, the second pixel unit, …, the X - th pixel unit, …, the M - th pixel unit respectively. Among them, the second pixel unit is located in the first direction of the first pixel unit, the third pixel unit is located in the second direction of the first pixel unit, …, the X - th pixel unit is located in the (X - 1) - th direction of the first pixel unit, …, the M - th pixel unit is located in the (M - 1) - th direction of the first pixel unit.
[0019] The image processing module extracts and combines all the first pixel units in each pixel region to form a low - pixel sub - image, and then the image processing module transmits the low - pixel sub - image to the image display device.
[0020] The beam deflection element is in an initial state. The image display device displays the low - pixel sub - image, and the low - pixel sub - image outputs an un - deflected sub - image to the human eye after passing through the projection lens and the beam deflection device.
[0021] Control the driving device to drive the beam deflection element to deflect in the first deflection direction, so that the beam deflection element is in a first deflection state. The image display device displays the low - pixel sub - image, and the low - pixel sub - image outputs a first deflected sub - image to the human eye after passing through the projection lens and the beam deflection device. Among them, the first deflected sub - image is deflected in the first direction compared with the un - deflected sub - image. The first deflected sub - image and the un - deflected sub - image are fused and superimposed to obtain a first intermediate image.
[0022] Control the driving device to drive the beam deflection element to deflect in the second deflection direction, so that the beam deflection element is in a second deflection state. The image display device displays the low - pixel sub - image, and the low - pixel sub - image outputs a second deflected sub - image to the human eye after passing through the projection lens and the beam deflection device. Among them, the second deflected sub - image is deflected in the second direction compared with the un - deflected sub - image. The second deflected sub - image and the first intermediate image are fused and superimposed to obtain a second intermediate image.
[0023] …
[0024] Control the driving device to drive the beam deflection element to deflect in the (N - 1)-th deflection direction, so that the beam deflection element is in the (N - 1)-th deflection state; the image display device displays the low-pixel sub-image, and the low-pixel sub-image outputs the (N - 1)-th deflected sub-image to the human eye after passing through the projection lens and the beam deflection device, where the (N - 1)-th deflected sub-image is deflected in the (X - 1)-th direction compared with the non-deflected sub-image; the (N - 1)-th deflected sub-image is fused and superimposed with the (N - 2)-th intermediate image to obtain a high-pixel image; wherein, the first deflection direction, the second deflection direction,..., the (N - 1)-th deflection direction are different deflection directions respectively;
[0025] Control the driving device to drive the beam deflection element to deflect, so that the beam deflection element returns from the (N - 1)-th deflection state to the initial state;
[0026] Wherein, M is the pixel multiple difference between the original high-pixel image and the low-pixel sub-image, 2 ≤ N ≤ M, and X = N, and X, M, and N are all integers.
[0027] The present invention further provides a near-eye display device, including the above-mentioned image resolution enhancement module and a power supply unit, and the power supply unit is respectively connected to the image display device and the beam deflection device in the image resolution enhancement module.
[0028] The beam deflection device, the image resolution enhancement module, the image resolution enhancement method and the near-eye display device provided by the present invention deflect the light N times in each cycle through the beam deflection device. The T low-pixel sub-images displayed by the image display device are output to the human eye corresponding to one non-deflected sub-image and (N - 1) deflected sub-images in sequence after passing through the beam deflection element and the projection lens. Then, multiple sub-images with subtle differences in details generated by the image display device are projected into the human eye in different directions, and by using the visual persistence effect of the human eye, the user can perceive a high-pixel image obtained by fusing and superimposing one non-deflected sub-image and (N - 1) deflected sub-images. Thus, the present invention can achieve a small volume and provide a high-definition picture. Description of the Drawings
[0029] Figure 1 Shows a cross-sectional schematic diagram of an image resolution enhancement module in an embodiment of the present application.
[0030] Figure 2 Shows a cross-sectional schematic diagram of a beam deflection device in an embodiment of the present application.
[0031] Figure 3 Shows a planar structure schematic diagram of a beam deflection device in an embodiment of the present application.
[0032] Figure 4 Shows a schematic plan view of a beam offset device in another embodiment of the present application.
[0033] Figure 5 Shows a schematic cross-sectional view of a tunable lens deflection generating a thickness deformation amount and an image height offset amount in an embodiment of the present application.
[0034] Figure 6 Shows a schematic cross-sectional view of a beam offset element in another embodiment of the present application.
[0035] Figure 7 Shows a schematic cross-sectional view of a beam offset element in another embodiment of the present application.
[0036] Figure 8 Shows a schematic structural view of an image resolution enhancement module in an embodiment of the present application.
[0037] Figure 9 Shows a schematic structural view of an image resolution enhancement module in another embodiment of the present application.
[0038] Figure 10 Shows a corresponding schematic structural view of a tunable lens for pixel unit offset in an embodiment of the present application.
[0039] Figure 11 Shows a schematic diagram of the azimuth of pixel unit offset in an embodiment of the present application.
[0040] Figure 12 Shows a schematic structural view of eight states of a tunable lens in an embodiment of the present application.
[0041] Figure 13 Shows a schematic working flow diagram of image fusion by an image resolution enhancement method in an embodiment of the present application.
[0042] Figure 14 Shows a schematic diagram of a frame of original high-pixel image in an embodiment of the present application.
[0043] Figures 15A to 15D Shows a schematic diagram of four low-pixel sub-images obtained by sampling in an embodiment of the present application.
[0044] Figures 16A to 16D Shows a schematic flow diagram of the human eye fusing and superimposing four low-pixel sub-images to obtain a high-pixel image in an embodiment of the present application.
[0045] Figure 17 Shows a schematic diagram of a frame of original high-pixel image in another embodiment of the present application.
[0046] Figures 18A to 18D Shows a schematic diagram of four low-pixel sub-images obtained by sampling in another embodiment of the present application.
[0047] Figures 19A to 19D Shows a schematic flow chart of the human eye fusing and superimposing four low - pixel sub - images to obtain a high - pixel image in another embodiment of the present application.
[0048] Figure 20 Shows a schematic diagram of a frame of original high - pixel image in another embodiment of the present application.
[0049] Figures 21A to 21B Shows a schematic diagram of two low - pixel sub - images obtained by sampling in another embodiment of the present application.
[0050] Figures 22A to 22B Shows a schematic flow chart of the human eye fusing and superimposing two low - pixel sub - images to obtain a high - pixel image in another embodiment of the present application.
[0051] Figure 23 Shows a schematic diagram of a frame of original high - pixel image in another embodiment of the present application.
[0052] Figures 24A to 24B Shows a schematic diagram of two low - pixel sub - images obtained by sampling in another embodiment of the present application.
[0053] Figures 25A to 25B Shows a schematic flow chart of the human eye fusing and superimposing two low - pixel sub - images to obtain a high - pixel image in another embodiment of the present application.
[0054] Figure 26 Shows a schematic flow chart of the image fusion process using the image resolution improvement method in another embodiment of the present application.
[0055] Figure 27 Shows a schematic diagram of a frame of original high - pixel image in another embodiment of the present application.
[0056] Figure 28 Shows a schematic diagram of a low - pixel sub - image obtained by sampling in another embodiment of the present application.
[0057] Figures 29A to 29D Shows a schematic flow chart of the human eye fusing and superimposing a low - pixel sub - image to obtain a high - pixel image in another embodiment of the present application.
[0058] Figure 30 Shows a comparison simulation diagram of the effects of the image resolution improvement module in an embodiment of the present application.
[0059] Figure 31 Shows a cross - sectional schematic diagram of the image resolution improvement module in Embodiment 1 of the present application.
[0060] Figure 32Shows a cross-sectional schematic diagram of the image resolution improvement module according to Embodiment 2 of the present application.
[0061] Figure 33 Shows a cross-sectional schematic diagram of the image resolution improvement module according to Embodiment 3 of the present application.
[0062] Figure 34 Shows a cross-sectional schematic diagram of the image resolution improvement module according to Embodiment 4 of the present application.
[0063] Figure 35 Shows a cross-sectional schematic diagram of the image resolution improvement module according to Embodiment 5 of the present application.
[0064] Figure 36 Shows a cross-sectional schematic diagram of the image resolution improvement module according to Embodiment 6 of the present application.
[0065] Figure 37 Shows a cross-sectional schematic diagram of the image resolution improvement module according to Embodiment 7 of the present application.
[0066] Figure 38 Shows a cross-sectional schematic diagram of the image resolution improvement module according to Embodiment 8 of the present application.
[0067] Figure 39 Shows a cross-sectional schematic diagram of the image resolution improvement module according to Embodiment 9 of the present application. Detailed implementation manners
[0068] The present application will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments. Figure 1 Shows a cross-sectional schematic diagram of the image resolution improvement module in an embodiment of the present application, wherein the image resolution improvement module includes a beam deflection device 20.
[0069] As Figure 2 shown, according to an exemplary embodiment of the present application, the beam deflection device 20 includes a beam deflection element 21 and a driving device 22. The beam deflection element 21 is connected to the driving device 22. The driving device 22 is configured to drive the beam deflection element 21 to deflect N times within each period, so that the beam deflection element 21 sequentially experiences an initial state and N - 1 deflection states within each period, so that T low-pixel sub-images displayed by the image display device 11 pass through the beam deflection element 21 and the projection lens 12 and are sequentially output to the human eye 40 as an unshifted sub-image and N - 1 shifted sub-images, so that the human eye 40 perceives a high-pixel image obtained by fusing and superimposing an unshifted sub-image and N - 1 shifted sub-images; wherein, N and T are integers, and N ≥ 2, 1 ≤ T ≤ N.
[0070] In the first exemplary embodiment, when the beam deflection element 21 is in a deflected state, the beam deflection element 21 is generally wedge-shaped.
[0071] In the first exemplary embodiment, as Figure 2 shown, the beam offset element 21 is a tunable lens 21A. The tunable lens 21A includes a first transparent flat plate 211, a second transparent flat plate 212, and a compressible medium 213 disposed between the first transparent flat plate 211 and the second transparent flat plate 212. The driving device 22 includes at least one control electrode 221 disposed on the first transparent flat plate 211 and / or the second transparent flat plate 212. The control electrode 221 is used to drive the first transparent flat plate 211 and / or the second transparent flat plate 212 to deflect. Generally, the control electrode 221 is disposed on the outer surface of the first transparent flat plate 211 away from the second transparent flat plate 212 and / or the outer surface of the second transparent flat plate 212 away from the first transparent flat plate 211.
[0072] Wherein, when the tunable lens 21A is in the initial state, the first transparent flat plate 211 and the second transparent flat plate 212 are parallel to each other, so that the tunable lens 21A is in a flat plate shape; when the tunable lens 21A is in the deflected state, the first transparent flat plate 211 and / or the second transparent flat plate 212 deflect and compress the compressible medium 213, so that the tunable lens 21A is in a wedge shape.
[0073] In the exemplary embodiment, it can be satisfied that 1.5 ≤ n1 ≤ 1.9, wherein the refractive indices of the first transparent flat plate 211 and the second transparent flat plate 212 are n1. Satisfying 1.5 ≤ n1 ≤ 1.9 and controlling the value range of the refractive index n1 of the first transparent flat plate 211 and the second transparent flat plate 212 is beneficial to realizing the precise regulation of the light propagation direction, thereby realizing the control of the deflection angle of the light by the tunable lens 21A. The materials of the first transparent flat plate 211 and the second transparent flat plate 212 can be glass or the like.
[0074] In the exemplary embodiment, it can be satisfied that 1.5 ≤ n2 ≤ 1.65, wherein the refractive index of the compressible medium 213 is n2. Satisfying 1.5 ≤ n2 ≤ 1.65 and controlling the value range of the refractive index n2 of the compressible medium 213 is beneficial to the matching of the refractive index n2 of the compressible medium 213 with the refractive indices n1 of the first transparent flat plate 211 and the second transparent flat plate 212, reducing the reflection and scattering losses occurring at the interfaces of different refractive index media, and can also realize the accurate control of the deflection angle of the light by the tunable lens 21A.
[0075] In an exemplary embodiment, it can be satisfied that: 1 / 20λ ≤ PV ≤ 1 / 4λ, where the peak-to-valley value of the first transparent flat plate 211 and the second transparent flat plate 212 is PV, and λ is 310 nanometers. The PV value (Peak to Valley) of the glass plate represents a key index of the surface shape quality of the glass plate, that is, the vertical height difference between the highest point and the lowest point on the measured glass surface within the measurement area, which is mainly used to evaluate the processing accuracy and optical performance of the glass plate. Satisfying 1 / 20λ ≤ PV ≤ 1 / 4λ and controlling the value range of PV of the first transparent flat plate 211 and the second transparent flat plate 212 is beneficial to reducing aberrations such as spherical aberration and coma caused by surface unevenness of the first transparent flat plate 211 and the second transparent flat plate 212, improving the imaging resolution, and then the tunable lens 21A can effectively control the propagation path of light and improve the optical performance of the system.
[0076] In an exemplary embodiment, it can be satisfied that: 0° ≤ θ ≤ 0.3°, 0μm ≤ d2 ≤ 20μm, where the single-sided deflection angle of the tunable lens 21A is θ, and the change amount of the single-sided edge thickness is d2. Satisfying 0° ≤ θ ≤ 0.3°, 0μm ≤ d2 ≤ 20μm, by controlling the value range of the single-sided deflection angle θ and the value range of the change amount of the single-sided edge thickness d2 of the tunable lens 21A, it is beneficial to achieve precise control of the light propagation direction, thereby realizing the control of the deflection angle of the tunable lens 21A for light. When the beam deflection device 20 deflects, if it is controlled that only one transparent plate deflects and the other transparent plate does not deflect, that is, only one transparent plate has a single-sided deflection angle θ and a single-sided edge thickness change amount d2, then correspondingly, the beam deflection device 20 has a deflection angle θ and a thickness deformation amount Δt = d2.
[0077] In an exemplary embodiment, the materials of the first transparent flat plate 211 and the second transparent flat plate 212 can be transparent glass or transparent plastic.
[0078] In an exemplary embodiment, the material of the compressible medium 213 can be a liquid or an elastic compressible solid. Among them, the liquid can specifically be liquid crystal, oil, water, etc. or a mixture of the above substances, and the solid can specifically be silicone resin, polymer gel, etc.
[0079] In an exemplary embodiment, the control electrode 221 is disposed on the surface of the first transparent flat plate 211 away from the second transparent flat plate 212 and / or the surface of the second transparent flat plate 212 away from the first transparent flat plate 211, and the control electrode 221 is disposed at the edge position of the tunable lens 21A.
[0080] In an exemplary embodiment, the tunable lens 21A is a rectangular structure, and the control electrode 221 is disposed at the vertex position and / or the midpoint position of the rectangular side of the tunable lens 21A.
[0081] In an exemplary embodiment, as Figure 3 shown, the control electrodes 221 are disposed at the four vertex positions of the tunable lens 21A.
[0082] In another exemplary embodiment, as Figure 4 shown, the control electrodes 221 are disposed at the midpoint positions of the four rectangular sides of the tunable lens 21A.
[0083] In another exemplary embodiment, the control electrodes 221 may also be disposed at both the four vertex positions and the midpoint positions of the four rectangular sides of the tunable lens 21A.
[0084] In an exemplary embodiment, as Figure 2 shown, the driving lines 222 are connected to the control electrodes 221. The driving lines 222 are disposed on the side of the first transparent plate 211 away from the second transparent plate 212 and extend outwardly from the beam displacement element 21. In other embodiments, the driving lines 222 may also extend inwardly from the beam displacement element 21.
[0085] In an exemplary embodiment, the projection lens 12 is located between the beam displacement device 20 and the image display device 11, and can satisfy: 1.5 < ΔIH / Δt < 5, where the thickness deformation amount of the tunable lens 21A is Δt, and its image height shift is ΔIH. Satisfying that the projection lens 12 is located between the beam displacement device 20 and the image display device 11, and 1.5 < ΔIH / Δt < 5, and controlling the ratio of the thickness deformation amount Δt of the tunable lens 21A to the image height shift ΔIH is beneficial to achieving a large image height shift effect with a small deformation amount.
[0086] In an exemplary embodiment, as Figure 5 shown, the beam displacement device 20 is located between the projection lens 12 and the image display device 11, and can satisfy: 1 < ΔIH / Δt < 3, where the thickness deformation amount of the tunable lens 21A is Δt, and its image height shift is ΔIH. Satisfying that the beam displacement device 20 is located between the projection lens 12 and the image display device 11, and 1 < ΔIH / Δt < 3, and controlling the ratio of the thickness deformation amount Δt of the tunable lens 21A to the image height shift ΔIH, then the same image height shift effect corresponds to a larger deformation amount, and higher control accuracy can be obtained.
[0087] Figure 6 shows a cross-sectional schematic diagram of the beam displacement element in another embodiment of the present application. In another exemplary embodiment, as Figure 6As shown, the light beam offset element 21 is a transparent wedge-shaped lens 21B. The transparent wedge-shaped lens 21B is wedge-shaped. The surfaces on the opposite sides of the transparent wedge-shaped lens 21B are a first plane 214 and an inclined plane 215 respectively. The inclined plane 215 is inclined with respect to the first plane 214. The inclination angle of the inclined plane 215 with respect to the first plane 214 is greater than 0° and less than 90°, for example, greater than 0° and less than or equal to 60°, or 5° to 60°, or 5° to 30°. During use, preferably, the inclined plane 215 of the transparent wedge-shaped lens 21B is close to the image display device 11, that is, the inclined plane 215 is located between the first plane 214 and the image display device 11.
[0088] In an exemplary embodiment, the transparent wedge-shaped lens 21B can be an optical element, which is a monolithic transparent wedge-shaped structure, for example, a monolithic transparent wedge-shaped glass plate; the transparent wedge-shaped lens 21B can also be a combination of multiple optical elements. The shape of the combination of the multiple optical elements is generally a wedge-shaped structure, and the relative positions of the individual optical elements are fixed and unchangeable, so that the wedge-shaped structure is fixed and unchangeable. For example, the transparent wedge-shaped lens 21B can include two transparent flat plates. The plate surfaces of the two transparent flat plates are not parallel and are relatively fixed and unchangeable. A medium can be provided in the middle of the two transparent flat plates. The medium can be air or glue, or others. In other embodiments, the transparent wedge-shaped lens 21B can also include multiple transparent wedge-shaped glass plates. The multiple transparent wedge-shaped glass plates form a beam offset element 21 with an overall wedge shape, or a medium as described above is provided between the multiple transparent wedge-shaped glass plates. The multiple transparent wedge-shaped glass plates and the medium together form a beam offset element 21 with an overall wedge shape.
[0089] Figure 7 The cross-sectional schematic diagram of the light beam offset element in another embodiment of the present application is shown. In another exemplary embodiment, as Figure 7 shown, the light beam offset element 21 is a transparent flat lens 21C. The transparent flat lens 21C is flat. The surfaces on the opposite sides of the transparent flat lens 21C are a second plane 216 and a third plane 217 respectively. The second plane 216 and the third plane 217 are parallel to each other.
[0090] In an exemplary embodiment, the transparent flat lens 21C may be an optical element having an integral transparent flat structure, such as an integral transparent glass plate; the transparent flat lens 21C may also be a combination of multiple optical elements. The overall shape of the combination of the multiple optical elements is a flat structure, and the relative positions of the individual optical elements are fixed and unchangeable, so that the flat structure is fixed and unchangeable. For example, the transparent flat lens 21C may include multiple stacked transparent flats; or, the transparent flat lens 21C may include two transparent flats, the surfaces of the two transparent flats are parallel and relatively fixed, and a medium may be provided in the middle of the two transparent flats. The medium may be air, glue, or others.
[0091] When the beam deflection element 21 is the transparent wedge lens 21B or the transparent flat lens 21C, the driving device 22 may be a voice coil motor (VCM). The main principle of the voice coil motor is that within a permanent magnetic field, by changing the magnitude of the direct current in the coil within the motor, different magnitudes of magnetic repulsive forces are generated in the coil to control the stretching position of the spring piece, thereby driving the component supported by the spring piece to move up and down or deflect. Currently, VCMs have been widely used in the lens driving of mobile phone cameras. In an exemplary embodiment, the beam deflection element 21 is disposed within the voice coil motor, and the beam deflection element 21 can be driven to deflect by the voice coil motor.
[0092] When the beam deflection element 21 is the transparent wedge lens 21B or the transparent flat lens 21C, the driving device 22 can also use shape memory alloys (SMA). Multiple SMA wires can be configured to support the beam deflection element 21. By applying or removing current to the SMA wires, the contraction or expansion of the SMA wires can be controlled, so that the beam deflection element 21 is deflected by the traction of the SMA wires. Currently, SMA has been widely used in optical image stabilization (OIS) of mobile phone lenses.
[0093] In other embodiments, the driving device 22 may also be a piezoelectric motor or other driving motors, which will not be listed one by one here.
[0094] It should be noted that this application is not limited to the beam deflection element 21 being the tunable lens 21A, the transparent wedge lens 21B, or the transparent flat lens 21C. The beam deflection element 21 may also have other structural shapes, be capable of multiple deflections, and be used for light to enter the human eye 40 in different directions, all of which fall within the protection scope of this application.
[0095] In an exemplary embodiment, it can be satisfied that 0.1 mm ≤ d1 ≤ 2 mm, where d1 is the thickness of the beam deflection device 20. By satisfying 0.1 mm ≤ d1 ≤ 2 mm and controlling the value range of the thickness d1 of the beam deflection device 20, the thickness of the image resolution enhancement module can be controlled, which is beneficial to the miniaturization of the near-eye display device.
[0096] In an exemplary embodiment, the driving device 22 drives the beam deflection element 21 to deflect N times in each cycle, and N satisfies: 2 ≤ N ≤ 9. Preferably, N = 2, or N = 4. When the number of deflections of the beam deflection element 21 in each cycle is different, the image resolution of the finally incident light into the human eye 40 will be improved with different display effects.
[0097] In an exemplary embodiment, the projection lens 12 is located between the beam deflection device 20 and the image display device 11; when the beam deflection element 21 is in a deflected state, the beam deflection element 21 offsets the image height of the image by 0.2p to 0.8p;
[0098] Alternatively, the beam deflection device 20 is located between the projection lens 12 and the image display device 11; when the beam deflection element 21 is in a deflected state, the beam deflection element 21 and the projection lens 12 offset the image height of the image by 0.2p to 0.8p.
[0099] The following describes the process of the image resolution enhancement module using the beam deflection element 21 to sequentially output an unshifted sub-image and N - 1 shifted sub-images to the corresponding human eye 40, so that the human eye 40 can perceive a high-pixel image obtained by fusing and superimposing an unshifted sub-image and N - 1 shifted sub-images, thereby achieving image resolution enhancement.
[0100] The image resolution enhancement module includes an optical engine 10 and a beam deflection device 20. The optical engine 10 includes an image display device 11 and a projection lens 12, and the image display device 11 includes at least one micro display screen 111. The image display device 11 is used to receive T low-pixel sub-images obtained by sampling the original high-pixel image by the image processing module 30. The original picture is a high-pixel image. Since the resolution of the micro display screen 111 is relatively low and it cannot completely display the high-pixel image, it is necessary to first sample the high-pixel image into low-pixel sub-images in a certain form, and then transmit one or more (i.e., T) low-pixel sub-images obtained by sampling to the micro display screen 111 for display. Then, by using the beam deflection element 21, the T low-pixel sub-images displayed by the image display device 11 are sequentially output to the corresponding human eye 40 as an unshifted sub-image and N - 1 shifted sub-images after passing through the beam deflection element 21 and the projection lens 12, so that the human eye 40 can perceive a high-pixel image obtained by fusing and superimposing an unshifted sub-image and N - 1 shifted sub-images.
[0101] It should be noted that the present application does not limit the position of the image processing module 30. As Figure 8 shown, the image processing module 30 and the image resolution enhancement module can be arranged in the same device. For example, both are arranged in a near-eye display device. Among them, the image processing module 30 can be integrated into the image resolution enhancement module, or the image processing module 30 and the image resolution enhancement module can be separately and independently arranged in the near-eye display device. As Figure 9 shown, the image processing module 30 and the image resolution enhancement module can also be arranged in different devices. For example, the image resolution enhancement module is arranged in the near-eye display device, but the image processing module 30 is not arranged in the near-eye display device, but is independently arranged in other devices outside the near-eye display device. For example, the image processing module 30 is arranged in terminal devices such as mobile phones, computers, and players. Regardless of which setting form, the image processing module 30 needs to be signal-connected to the image display device 11 in the image resolution enhancement module so that the image processing module 30 can transmit image data to the image display device 11. Among them, when the image processing module 30 and the image resolution enhancement module are arranged in the same device, the image processing module 30 and the image display device 11 can be directly electrically connected for image data transmission. When the image processing module 30 and the image resolution enhancement module are arranged in different devices, the two can transmit image data through the wireless communication module in the corresponding device, or can directly transmit image data through a wired manner.
[0102] Among them, in order to achieve the deflection of light and thus the offset of each pixel unit in the image, there are various states of the beam deflection element 21. Hereinafter, the beam deflection element 21 being a tunable lens 21A will be specifically exemplified.
[0103] As Figure 10 shown, the beam deflection element 21 is a tunable lens 21A. The first transparent plate 211 is located on the side of the second transparent plate 212 close to the human eye 40, and the first transparent plate 211 deflects while the second transparent plate 212 does not deflect. In order to better understand the correspondence between the deflection of the tunable lens 21A and the offset of the pixel unit (that is, the correspondence between the deflection direction of the light and the deflection direction of the tunable lens 21A), taking the tunable lens 21A capable of achieving Figure 12 8 deflection states in Figure 11 as an example. It should be noted that in actual applications, the tunable lens 21A may only need to have some of the deflection states and does not need to have all the deflection states. These 8 deflection states enable each pixel unit in the image to achieve an offset in 8 directions as in Figure 3Taking the setting method shown in [Figure] as an example, specifically, control electrodes 221 are arranged at the four vertex positions of the tunable lens 21A.
[0104] Figure 10 On the left side of the tunable lens 21A in [Figure] is a schematic diagram of the pixel unit offset orientation (this schematic diagram of the pixel unit offset orientation is virtual, and showing this schematic diagram in the figure is only to better illustrate the correspondence between the deflection direction of the tunable lens 21A and the offset direction of the pixel unit). Among them, G in the schematic diagram of the pixel unit offset orientation represents a single pixel unit, the solid grid where G is located represents the initial position of a single pixel unit when no offset occurs, and the numbers ① to ⑧ in the figure are the 8 offset directions of the pixel unit, and the dashed grids where the numbers ① to ⑧ are located represent the positions of the pixel unit after offset.
[0105] As Figure 3 、 Figures 10 to 12 shown, since when light passes through the tunable lens 21A, the light will shift towards the side where the thickness of the tunable lens 21A increases; when voltages are applied to the two control electrodes 221 at the lower left corner and the lower right corner of the tunable lens 21A, and no voltage is applied to the two control electrodes 221 at the upper left corner and the upper right corner, the lower side of the first transparent plate 211 deflects around the central position O of the tunable lens 21A towards the second transparent plate 212 (that is, the lower side of the first transparent plate 211 deflects towards the direction close to the second transparent plate 212), at this time the lower side of the tunable lens 21A becomes thinner and the upper side becomes thicker (after the lower side of the tunable lens 21A becomes thinner, the compressible medium 213 will be squeezed to the upper side of the tunable lens 21A, so that the upper side of the tunable lens 21A becomes thicker), that is, the tunable lens 21A is in the Figure 12 state 1 in [Figure], at this time the light is shifted upward after passing through the tunable lens 21A, causing the pixel unit G of the image to shift in the direction ①.
[0106] As Figure 3 、 Figures 10 to 12 shown, when a voltage is applied to the control electrode 221 at the lower right corner of the tunable lens 21A, and no voltage is applied to the three control electrodes 221 at the lower left corner, the upper left corner and the upper right corner, the lower right corner of the first transparent plate 211 deflects around the central position O of the tunable lens 21A towards the second transparent plate 212, at this time the lower right corner of the tunable lens 21A becomes thinner and the upper left corner becomes thicker, that is, the tunable lens 21A is in the Figure 12 state 2 in [Figure], at this time the light is shifted towards the upper left corner after passing through the tunable lens 21A, causing the pixel unit G of the image to shift in the direction ②.
[0107] As Figure 3 、 Figures 10 to 12As shown, when voltages are applied to the two control electrodes 221 at the upper right corner and the lower right corner of the tunable lens 21A, and no voltage is applied to the two control electrodes 221 at the upper left corner and the lower left corner, the right side of the first transparent plate 211 deflects around the central position O of the tunable lens 21A towards the second transparent plate 212. At this time, the right side of the tunable lens 21A becomes thinner and the left side becomes thicker, that is, the tunable lens 21A assumes the Figure 12 state 3 in, and at this time, the light beam deflects leftward after passing through the tunable lens 21A, causing the pixel unit G of the image to deflect in the direction ③.
[0108] As Figure 3 and Figures 10 to 12 shown, when a voltage is applied to the control electrode 221 at the upper right corner of the tunable lens 21A, and no voltage is applied to the three control electrodes 221 at the upper left corner, the lower left corner, and the lower right corner, the upper right corner of the first transparent plate 211 deflects around the central position O of the tunable lens 21A towards the second transparent plate 212. At this time, the upper right corner of the tunable lens 21A becomes thinner and the lower left corner becomes thicker, that is, the tunable lens 21A assumes the Figure 12 state 4 in, and at this time, the light beam deflects towards the lower left corner after passing through the tunable lens 21A, causing the pixel unit G of the image to deflect in the direction ④.
[0109] As Figure 3 and Figures 10 to 12 shown, when voltages are applied to the two control electrodes 221 at the upper left corner and the upper right corner of the tunable lens 21A, and no voltage is applied to the two control electrodes 221 at the lower left corner and the lower right corner, the upper side of the first transparent plate 211 deflects around the central position O of the tunable lens 21A towards the second transparent plate 212. At this time, the upper side of the tunable lens 21A becomes thinner and the lower side becomes thicker, that is, the tunable lens 21A assumes the Figure 12 state 5 in, and at this time, the light beam deflects downward after passing through the tunable lens 21A, causing the pixel unit G of the image to deflect in the direction ⑤.
[0110] As Figure 3 and Figures 10 to 12 shown, when a voltage is applied to the control electrode 221 at the upper left corner of the tunable lens 21A, and no voltage is applied to the three control electrodes 221 at the upper right corner, the lower right corner, and the lower left corner, the upper left corner of the first transparent plate 211 deflects around the central position O of the tunable lens 21A towards the second transparent plate 212. At this time, the upper left corner of the tunable lens 21A becomes thinner and the lower right corner becomes thicker, that is, the tunable lens 21A assumes the Figure 12 state 6 in, and at this time, the light beam deflects towards the lower right corner after passing through the tunable lens 21A, causing the pixel unit G of the image to deflect in the direction ⑥.
[0111] As Figure 3 and Figures 10 to 12As shown, when voltages are applied to the two control electrodes 221 at the lower left corner and the upper left corner of the tunable lens 21A, and no voltages are applied to the two control electrodes 221 at the lower right corner and the upper right corner, the left side of the first transparent plate 211 deflects around the central position O of the tunable lens 21A towards the second transparent plate 212. At this time, the left side of the tunable lens 21A becomes thinner and the right side becomes thicker, that is, the tunable lens 21A assumes the Figure 12 state 7 in, and at this time, the light rays are deflected to the right after passing through the tunable lens 21A, causing the pixel unit G of the image to deflect in the direction ⑦.
[0112] As Figure 3 , Figures 10 to 12 shown, when a voltage is applied to the control electrode 221 at the lower left corner of the tunable lens 21A, and no voltages are applied to the three control electrodes 221 at the lower right corner, the upper right corner and the upper left corner, the lower left corner of the first transparent plate 211 deflects around the central position O of the tunable lens 21A towards the second transparent plate 212. At this time, the lower left corner of the tunable lens 21A becomes thinner and the upper right corner becomes thicker, that is, the tunable lens 21A assumes the Figure 12 state 8 in, and at this time, the light rays are deflected to the upper right after passing through the tunable lens 21A, causing the pixel unit G of the image to deflect in the direction ⑧.
[0113] This embodiment also provides an image resolution improvement method, which is used for an image resolution improvement module. The image resolution improvement method includes:
[0114] S1, an image sampling step:
[0115] The image processing module 30 divides the original high-pixel image into multiple pixel regions PA. Each pixel region PA includes M pixel units (specifically, each pixel unit includes at least one sub-pixel); the M pixel units in each pixel region PA are respectively the first pixel unit (shown as G1 in the figure), the second pixel unit (shown as G2 in the figure), …, the Xth pixel unit, …, the Mth pixel unit; among them, the second pixel unit is located in the first direction of the first pixel unit, the third pixel unit is located in the second direction of the first pixel unit, …, the Xth pixel unit is located in the (X - 1)th direction of the first pixel unit, …, the Mth pixel unit is located in the (M - 1)th direction of the first pixel unit;
[0116] The image processing module 30 extracts and combines all the first pixel units in each pixel region PA to form a first low-pixel sub-image, extracts and combines all the second pixel units in each pixel region PA to form a second low-pixel sub-image, extracts and combines all the third pixel units in each pixel region PA to form a third low-pixel sub-image, and so on. By analogy, it extracts and combines all the Xth pixel units in each pixel region PA to form an Xth low-pixel sub-image, obtaining T low-pixel sub-images. Then, the image processing module 30 transmits the T low-pixel sub-images to the image display device 11.
[0117] That is to say, in the above step S1, when sampling the original high-pixel image to obtain T low-pixel sub-images, the sampling rule is as follows: first sample all the first pixel units to obtain the first low-pixel sub-image, then sample all the second pixel units to obtain the second low-pixel sub-image, then sample all the third pixel units to obtain the third low-pixel sub-image, and so on. By analogy, finally sample all the Xth pixel units to obtain the Xth low-pixel sub-image.
[0118] Here, T represents the number of actually sampled low-pixel sub-images. And in the above step S1, when sampling the original high-pixel image, since sampling is carried out from the first pixel unit to the Xth pixel unit, so T = X. It should be noted that since when sampling the original high-pixel image, it is not necessary to sample all the pixel units in each pixel region PA separately, so T ≤ M. In other words, during sampling, if all the pixel units in each pixel region PA are sampled separately, then finally M low-pixel sub-images will be obtained, that is, at this time T = M; if only some of the pixel units in each pixel region PA are sampled separately, then the number T of the finally obtained low-pixel sub-images will be less than M, that is, at this time T < M.
[0119] It should be noted that when dividing the original high-pixel image into multiple pixel regions PA, if the original high-pixel image does not meet the division conditions, pixel numbers can be supplemented by means such as stretching algorithms, scaling algorithms, interpolation algorithms, etc. to meet the division conditions.
[0120] S2, the image fusion step. Please refer to Figure 13 :
[0121] S21, the beam deflection element 21 is in the initial state, the image display device 11 displays the first low-pixel sub-image, and the first low-pixel sub-image outputs an undeflected sub-image to the human eye 40 after passing through the projection lens 12 and the beam deflection device 20.
[0122] S22, control the driving device 22 to drive the beam deflection element 21 to deflect in the first deflection direction (i.e., the first deflection of the beam deflection element 21 in each cycle), so that the beam deflection element 21 is in the first deflection state; the image display device 11 displays the second low-pixel sub-image, and the second low-pixel sub-image outputs the first deflected sub-image to the human eye 40 after passing through the projection lens 12 and the beam deflection device 20, where the first deflected sub-image is deflected in the first direction compared with the non-deflected sub-image; the first deflected sub-image and the non-deflected sub-image are fused and superimposed to obtain the first intermediate image;
[0123] S23, control the driving device 22 to drive the beam deflection element 21 to deflect in the second deflection direction (i.e., the second deflection of the beam deflection element 21 in each cycle), so that the beam deflection element 21 is in the second deflection state; the image display device 11 displays the third low-pixel sub-image, and the third low-pixel sub-image outputs the second deflected sub-image to the human eye 40 after passing through the projection lens 12 and the beam deflection device 20, where the second deflected sub-image is deflected in the second direction compared with the non-deflected sub-image; the second deflected sub-image and the first intermediate image are fused and superimposed to obtain the second intermediate image;
[0124] …
[0125] S24, control the driving device 22 to drive the beam deflection element 21 to deflect in the (N - 1)th deflection direction (i.e., the (N - 1)th deflection of the beam deflection element 21 in each cycle), so that the beam deflection element 21 is in the (N - 1)th deflection state; the image display device 11 displays the Xth low-pixel sub-image, and the Xth low-pixel sub-image outputs the (N - 1)th deflected sub-image to the human eye 40 after passing through the projection lens 12 and the beam deflection device 20, where the (N - 1)th deflected sub-image is deflected in the (X - 1)th direction compared with the non-deflected sub-image; the (N - 1)th deflected sub-image and the (N - 2)th intermediate image are fused and superimposed to obtain the high-pixel image; where the first deflection direction, the second deflection direction,..., the (N - 1)th deflection direction are different deflection directions respectively;
[0126] S25, control the driving device 22 to drive the beam deflection element 21 to deflect (i.e., the Nth deflection of the beam deflection element 21 in each cycle), so that the beam deflection element 21 returns from the (N - 1)th deflection state to the initial state;
[0127] Where, M is the pixel multiple difference between the original high-pixel image and the low-pixel sub-image. The pixel multiple difference specifically refers to the ratio of the total number of pixels of the original high-pixel image to the total number of pixels of the low-pixel sub-image. M, N, X, and T are all integers, 2 ≤ N ≤ M, and T = X = N.
[0128] The control image resolution improvement module executes the above-mentioned steps S1 and S2 in each cycle, and performs the loop of the above-mentioned steps S1 and S2 in different cycles, so as to sequentially perform the above-mentioned image sampling step and image fusion step on the original high-pixel images of different frames, enabling the human eye 40 to continuously see high-pixel images that are basically or exactly the same as the original high-pixel images.
[0129] In an exemplary embodiment, the beam offset element 21 is a tunable lens 21A. The tunable lens 21A includes a first transparent plate 211, a second transparent plate 212, and a compressible medium 213 disposed between the first transparent plate 211 and the second transparent plate 212; the driving device 22 includes at least one control electrode 221 disposed on the first transparent plate 211 and / or the second transparent plate 212, and the control electrode 221 is used to drive the first transparent plate 211 and / or the second transparent plate 212 to deflect;
[0130] In the above-mentioned step S2, no voltage is applied to each control electrode 221, and the first transparent plate 211 and the second transparent plate 212 are parallel to each other, so that the tunable lens 21A is in a flat plate shape. At this time, the tunable lens 21A is in an initial state;
[0131] Change the energization state of each control electrode 221 to cause the first transparent plate 211 and / or the second transparent plate 212 to deflect, so that the thickness of the side of the tunable lens 21A corresponding to the above-mentioned first direction increases. At this time, the beam offset element 21 is in a first deflection state;
[0132] Change the energization state of each control electrode 221 to cause the first transparent plate 211 and / or the second transparent plate 212 to deflect, so that the thickness of the side of the tunable lens 21A corresponding to the above-mentioned second direction increases. At this time, the beam offset element 21 is in a second deflection state;
[0133] …
[0134] Change the energization state of each control electrode 221 to cause the first transparent plate 211 and / or the second transparent plate 212 to deflect, so that the thickness of the side of the tunable lens 21A corresponding to the above-mentioned X-1 direction increases. At this time, the beam offset element 21 is in an N-1 deflection state;
[0135] Remove the voltage applied to each control electrode 221. At this time, no voltage is applied to each control electrode 221, and the beam offset element 21 is restored from the N-1 deflection state to the initial state.
[0136] In an exemplary embodiment, the beam offset element 21 is a transparent wedge lens 21B, and the inclined surface 215 of the transparent wedge lens 21B is closer to the image display device 11 than its first plane 214 (i.e., the inclined surface 215 is located between the image display device 11 and the first plane 214). The characteristics of the transparent wedge lens 21B are as follows: when a certain side of the transparent wedge lens 21B deflects around the central position of the transparent wedge lens 21B towards the direction close to the image display device 11, the light passing through the transparent wedge lens 21B will deflect in the same direction as the deflection direction of the transparent wedge lens 21B. For example, when the upper side of the transparent wedge lens 21B deflects around the central position of the transparent wedge lens 21B towards the direction close to the image display device 11, the light passing through the transparent wedge lens 21B will deflect upward;
[0137] In the above step S2, when the first plane 214 of the transparent wedge lens 21B is perpendicular to the optical axis of the image display device 11, the transparent wedge lens 21B is in the initial state at this time;
[0138] Control the driving device 22 to drive the transparent wedge lens 21B to deflect, so that the side of the transparent wedge lens 21B corresponding to the above first direction deflects towards the direction close to the image display device 11, and the first plane 214 of the transparent wedge lens 21B deflects relative to the optical axis of the image display device 11 (i.e., the first plane 214 is not perpendicular to the optical axis of the image display device 11). At this time, the transparent wedge lens 21B is in the first deflection state;
[0139] Control the driving device 22 to drive the transparent wedge lens 21B to deflect, so that the side of the transparent wedge lens 21B corresponding to the above second direction deflects towards the direction close to the image display device 11, and the first plane 214 of the transparent wedge lens 21B deflects relative to the optical axis of the image display device 11 (i.e., the first plane 214 is not perpendicular to the optical axis of the image display device 11). At this time, the transparent wedge lens 21B is in the second deflection state;
[0140] …
[0141] Control the driving device 22 to drive the transparent wedge lens 21B to deflect, so that the side of the transparent wedge lens 21B corresponding to the above X - 1 direction deflects towards the direction close to the image display device 11, and the first plane 214 of the transparent wedge lens 21B deflects relative to the optical axis of the image display device 11 (i.e., the first plane 214 is not perpendicular to the optical axis of the image display device 11). At this time, the transparent wedge lens 21B is in the N - 1 deflection state;
[0142] Control the driving device 22 to drive the transparent wedge lens 21B to deflect, so that the transparent wedge lens 21B returns from the N - 1 deflection state to the initial state.
[0143] In an exemplary embodiment, the beam offset element 21 is a transparent flat lens 21C. The characteristics of the transparent flat lens 21C are as follows: when one side of the transparent flat lens 21C deflects around the central position of the transparent flat lens 21C towards the direction close to the image display device 11, the light passing through the transparent flat lens 21C will deflect in the same direction as the deflection direction of the transparent flat lens 21C. For example, when the upper side of the transparent flat lens 21C deflects around the central position of the transparent flat lens 21C towards the direction close to the image display device 11, the light passing through the transparent flat lens 21C will deflect upwards;
[0144] In the above step S2, when the second plane 216 and the third plane 217 of the transparent flat lens 21C are perpendicular to the optical axis of the image display device 11, the transparent flat lens 21C is in its initial state;
[0145] Control the driving device 22 to drive the side of the transparent flat lens 21C corresponding to the above first direction to deflect towards the direction close to the image display device 11, so that the second plane 216 and the third plane 217 of the transparent flat lens 21C deflect relative to the optical axis of the image display device 11 (that is, the second plane 216 and the third plane 217 are not perpendicular to the optical axis of the image display device 11). At this time, the transparent flat lens 21C is in its first deflection state;
[0146] Control the driving device 22 to drive the side of the transparent flat lens 21C corresponding to the above second direction to deflect towards the direction close to the image display device 11, so that the second plane 216 and the third plane 217 of the transparent flat lens 21C deflect relative to the optical axis of the image display device 11 (that is, the second plane 216 and the third plane 217 are not perpendicular to the optical axis of the image display device 11). At this time, the transparent flat lens 21C is in its second deflection state;
[0147] …
[0148] Control the driving device 22 to drive the side of the transparent flat lens 21C corresponding to the above X - 1 direction to deflect towards the direction close to the image display device 11, so that the second plane 216 and the third plane 217 of the transparent flat lens 21C deflect relative to the optical axis of the image display device 11 (that is, the second plane 216 and the third plane 217 are not perpendicular to the optical axis of the image display device 11). At this time, the transparent flat lens 21C is in its N - 1 deflection state;
[0149] Control the driving device 22 to drive the transparent flat lens 21C to deflect, so that the transparent flat lens 21C returns from the N - 1 deflection state to the initial state.
[0150] The following specifically illustrates the process of the above image resolution improvement method by way of example:
[0151] Image sampling step:
[0152] Taking the example that the image processing module 30 samples the original high - pixel image to obtain 4 low - pixel sub - images, that is, T = 4.
[0153] The example of the original high - pixel image is as Figure 14 shown. The image processing module 30 divides the original high - pixel image into multiple pixel regions PA (only 4 pixel regions PA are schematically shown in the figure). Each pixel region PA includes 4 pixel units, and each pixel unit includes a sub - pixel. The 4 pixel units in each pixel region PA are the first pixel unit G1, the second pixel unit G2, the third pixel unit G3, and the fourth pixel unit G4 respectively. Among them, the first pixel unit G1, the second pixel unit G2, the third pixel unit G3, and the fourth pixel unit G4 are located at the upper - left corner, upper - right corner, lower - right corner, and lower - left corner of each pixel region PA respectively. Among them, taking the first pixel unit G1 as a reference, the second pixel unit G2 is to the right of the first pixel unit G1 (that is, the above - mentioned first direction is to the right), the third pixel unit G3 is to the lower - right of the first pixel unit G1 (that is, the above - mentioned second direction is to the lower - right), and the fourth pixel unit G4 is below the first pixel unit G1 (that is, the above - mentioned third direction is downwards).
[0154] The image processing module 30 extracts and combines all the first pixel units G1 in each pixel region PA to form the first low - pixel sub - image as shown in Figure 15A shown, extracts and combines all the second pixel units G2 in each pixel region PA to form the second low - pixel sub - image as shown in Figure 15B shown, extracts and combines all the third pixel units G3 in each pixel region PA to form the third low - pixel sub - image as shown in Figure 15C shown, extracts and combines all the fourth pixel units G4 in each pixel region PA to form the fourth low - pixel sub - image as shown in Figure 15D shown, that is, X = 4; then the image processing module 30 transmits the 4 low - pixel sub - images obtained by the above sampling to the image display device 11; among them, the pixel multiple difference between the original high - pixel image and the low - pixel sub - image is 4, that is, M = 4.
[0155] Image fusion step:
[0156] Taking the tunable lens 21A of the beam deflection element 21 as shown in Figure 3 shown as an example. The tunable lens 21A includes a first transparent plate 211, a second transparent plate 212, and a compressible medium 213 disposed between the first transparent plate 211 and the second transparent plate 212. The first transparent plate 211 is on the side of the second transparent plate 212 close to the human eye 40. A plurality of control electrodes 221 are provided on the first transparent plate 211, and the plurality of control electrodes 221 are used to control the deflection of the first transparent plate 211.
[0157] When the image display device 11 displays the first low-pixel sub-image as shown Figure 15A below, no voltage is applied to each control electrode 221, and the first transparent plate 211 and the second transparent plate 212 are parallel to each other, making the tunable lens 21A in a flat plate shape. At this time, the tunable lens 21A is in its initial state. After passing through the projection lens 12 and the tunable lens 21A, the first low-pixel sub-image outputs an unshifted sub-image as shown Figure 16A below to the human eye 40.
[0158] When the image display device 11 displays the second low-pixel sub-image as shown Figure 15B below, the energization state of each control electrode 221 is changed (specifically, voltage is applied to the two control electrodes 221 at the lower left and upper left corners of the first transparent plate 211, and no voltage is applied to the two control electrodes 221 at the lower right and upper right corners), causing the left side of the first transparent plate 211 to deflect around the central position O of the tunable lens 21A toward the second transparent plate 212. At this time, the tunable lens 21A is in its first deflection state, with the left side of the tunable lens 21A becoming thinner and the right side becoming thicker, that is, the tunable lens 21A is in the state 7 as shown Figure 12 below. At this time, the light rays are deflected to the right after passing through the tunable lens 21A; after passing through the projection lens 12 and the tunable lens 21A, the second low-pixel sub-image outputs the first shifted sub-image to the human eye 40, where the first shifted sub-image is shifted to the right compared to the unshifted sub-image; the first shifted sub-image and the above unshifted sub-image are fused and superimposed to obtain the first intermediate image as shown Figure 16B below.
[0159] When the image display device 11 displays the third low-pixel sub-image as shown Figure 15C below, the energization state of each control electrode 221 is changed (specifically, voltage is applied to the control electrode 221 at the upper left corner of the first transparent plate 211, and no voltage is applied to the three control electrodes 221 at the upper right, lower right, and lower left corners), causing the upper left corner of the first transparent plate 211 to deflect around the central position O of the tunable lens 21A toward the second transparent plate 212. At this time, the tunable lens 21A is in its second deflection state, with the upper left corner of the tunable lens 21A becoming thinner and the lower right corner becoming thicker, that is, the tunable lens 21A is in the state 6 as shown Figure 12 below. At this time, the light rays are deflected to the lower right after passing through the tunable lens 21A; after passing through the projection lens 12 and the tunable lens 21A, the third low-pixel sub-image outputs the second shifted sub-image to the human eye 40, where the second shifted sub-image is shifted to the lower right compared to the unshifted sub-image; the second shifted sub-image and the above first intermediate image are fused and superimposed to obtain the second intermediate image as shown Figure 16C below.
[0160] When the image display device 11 displays the fourth lowest pixel sub-image as shown Figure 15D below, the energization state of each control electrode 221 is changed (specifically, voltage is applied to the two control electrodes 221 at the upper left and upper right corners of the first transparent plate 211, and no voltage is applied to the two control electrodes 221 at the lower left and lower right corners), so that the upper side of the first transparent plate 211 deflects around the central position O of the tunable lens 21A toward the second transparent plate 212. At this time, the tunable lens 21A is in the third deflection state, the upper side of the tunable lens 21A becomes thinner and the lower side becomes thicker, that is, the tunable lens 21A is in the state 5 as shown Figure 12 below. At this time, the light rays are deflected downward after passing through the tunable lens 21A; the fourth lowest pixel sub-image outputs the third deflected sub-image to the human eye 40 after passing through the projection lens 12 and the tunable lens 21A, where the third deflected sub-image is deflected downward compared with the non-deflected sub-image; the third deflected sub-image is fused and superimposed with the above-mentioned second intermediate image to obtain the high-pixel image as shown Figure 16D below. Since each pixel unit in the original high-pixel image is sampled and fused in this embodiment, the high-pixel image finally seen by the human eye 40 is basically or exactly the same as the original high-pixel image.
[0161] Remove the voltage applied to each control electrode 221. At this time, no voltage is applied to each control electrode 221, so that the tunable lens 21A returns from the third deflection state to the initial state to perform the next cycle of image sampling step and image fusion step.
[0162] Control the image resolution enhancement module to perform the above image sampling step and image fusion step in each cycle, and perform the cycle of the above image sampling step and image fusion step in different cycles.
[0163] It should be noted that when the relative positions of the M pixel units in each pixel region PA change, that is, when the position of the first pixel unit G1 as the reference changes, during the process of outputting the T low-pixel sub-images obtained by sampling to the human eye 40 through the projection lens 12 and the beam deflection device 20 for image fusion processing, the deflection direction of the beam deflection element 21 and the deflection direction of the light rays after passing through the beam deflection element 21 will also be different. The following will specifically illustrate the process of the above image resolution enhancement method with another embodiment:
[0164] Image sampling step:
[0165] Taking the example that the image processing module 30 samples the original high-pixel image to obtain 4 low-pixel sub-images, that is, T = 4.
[0166] The example of the original high-pixel image is as shown Figure 17As shown, the image processing module 30 divides the original high - pixel image into multiple pixel regions PA (only 4 pixel regions PA are schematically shown in the figure). Each pixel region PA includes 4 pixel units, and each pixel unit includes a sub - pixel. The 4 pixel units in each pixel region PA are the first pixel unit G1, the second pixel unit G2, the third pixel unit G3, and the fourth pixel unit G4 respectively. The first pixel unit G1, the second pixel unit G2, the third pixel unit G3, and the fourth pixel unit G4 are located at the lower left corner, upper left corner, upper right corner, and lower right corner of each pixel region PA respectively. Among them, with the first pixel unit G1 as the reference, the second pixel unit G2 is above the first pixel unit G1 (i.e., the above - mentioned first direction is upward), the third pixel unit G3 is at the upper right of the first pixel unit G1 (i.e., the above - mentioned second direction is upper - right), and the fourth pixel unit G4 is to the right of the first pixel unit G1 (i.e., the above - mentioned third direction is right).
[0167] The image processing module 30 extracts and combines all the first pixel units G1 in each pixel region PA to form the first low - pixel sub - image as shown in Figure 18A Extracts and combines all the second pixel units G2 in each pixel region PA to form the second low - pixel sub - image as shown in Figure 18B Extracts and combines all the third pixel units G3 in each pixel region PA to form the third low - pixel sub - image as shown in Figure 18C Extracts and combines all the fourth pixel units G4 in each pixel region PA to form the fourth low - pixel sub - image as shown in Figure 18D That is, X = 4; then the image processing module 30 transmits the 4 low - pixel sub - images obtained by the above sampling to the image display device 11; among them, the pixel multiple difference between the original high - pixel image and the low - pixel sub - image is 4, that is, M = 4.
[0168] Image fusion step:
[0169] Taking the tunable lens 21A shown in Figure 3 as an example of the beam deflection element 21. The tunable lens 21A includes a first transparent plate 211, a second transparent plate 212, and a compressible medium 213 disposed between the first transparent plate 211 and the second transparent plate 212. The first transparent plate 211 is on the side of the second transparent plate 212 closer to the human eye 40. A plurality of control electrodes 221 are provided on the first transparent plate 211, and the plurality of control electrodes 221 are used to control the deflection of the first transparent plate 211.
[0170] When the image display device 11 displays as shown in Figure 18AWhen displaying the first low-pixel sub-image as shown, no voltage is applied to each control electrode 221, and the first transparent plate 211 and the second transparent plate 212 are parallel to each other, making the tunable lens 21A in a flat-plate shape. At this time, the tunable lens 21A is in its initial state. After passing through the projection lens 12 and the tunable lens 21A, the first low-pixel sub-image outputs an unshifted sub-image as shown in Figure 19A to the human eye 40.
[0171] When the image display device 11 displays the second low-pixel sub-image as shown in Figure 18B , the energization state of each control electrode 221 is changed (specifically, voltages are applied to the two control electrodes 221 at the lower left and lower right corners of the first transparent plate 211, and no voltages are applied to the two control electrodes 221 at the upper left and upper right corners), causing the lower side of the first transparent plate 211 to deflect around the central position O of the tunable lens 21A toward the second transparent plate 212. At this time, the tunable lens 21A is in its first deflection state, with the lower side of the tunable lens 21A becoming thinner and the upper side becoming thicker, that is, the tunable lens 21A is in the state 1 as shown in Figure 12 . At this time, the light rays are deflected upward after passing through the tunable lens 21A; after passing through the projection lens 12 and the tunable lens 21A, the second low-pixel sub-image outputs the first shifted sub-image to the human eye 40, where the first shifted sub-image is shifted upward compared to the unshifted sub-image; the first shifted sub-image and the above unshifted sub-image are fused and superimposed to obtain the first intermediate image as shown in Figure 19B .
[0172] When the image display device 11 displays the third low-pixel sub-image as shown in Figure 18C , the energization state of each control electrode 221 is changed (specifically, a voltage is applied to the control electrode 221 at the lower left corner of the first transparent plate 211, and no voltages are applied to the three control electrodes 221 at the lower right, upper right, and upper left corners), causing the lower left corner of the first transparent plate 211 to deflect around the central position O of the tunable lens 21A toward the second transparent plate 212. At this time, the tunable lens 21A is in its second deflection state, with the lower left corner of the tunable lens 21A becoming thinner and the upper right corner becoming thicker, that is, the tunable lens 21A is in the state 8 as shown in Figure 12 . At this time, the light rays are deflected toward the upper right corner after passing through the tunable lens 21A; after passing through the projection lens 12 and the tunable lens 21A, the third low-pixel sub-image outputs the second shifted sub-image to the human eye 40, where the second shifted sub-image is shifted toward the upper right compared to the unshifted sub-image; the second shifted sub-image and the above first intermediate image are fused and superimposed to obtain the second intermediate image as shown in Figure 19C .
[0173] When the image display device 11 displays the image as shown in Figure 18DWhen the fourth lowest pixel sub-image shown is processed, the energization states of the respective control electrodes 221 are changed (specifically, voltages are applied to the two control electrodes 221 at the lower left and upper left corners of the first transparent plate 211, and no voltage is applied to the two control electrodes 221 at the lower right and upper right corners), causing the left side of the first transparent plate 211 to deflect around the central position O of the tunable lens 21A towards the second transparent plate 212. At this time, the tunable lens 21A is in the third deflection state, with the left side of the tunable lens 21A becoming thinner and the right side becoming thicker, that is, the tunable lens 21A is in the state 7 as shown in Figure 12 In this state, the light rays are deflected to the right after passing through the tunable lens 21A; the fourth lowest pixel sub-image is output as the third deflected sub-image towards the human eye 40 after passing through the projection lens 12 and the tunable lens 21A. Among them, the third deflected sub-image is deflected to the right compared to the non-deflected sub-image; the third deflected sub-image is fused and superimposed with the above-mentioned second intermediate image to obtain a high-pixel image as shown in Figure 19D . Since each pixel unit in the original high-pixel image is sampled and fused in this embodiment, the high-pixel image finally seen by the human eye 40 is basically or completely the same as the original high-pixel image.
[0174] The voltages applied to the respective control electrodes 221 are removed (at this time, no voltage is applied to each control electrode 221), causing the tunable lens 21A to return from the third deflection state to the initial state to perform the next cycle of image sampling step and image fusion step.
[0175] The image resolution improvement module is controlled to perform the above-mentioned image sampling step and image fusion step in each cycle, and perform the cycle of the above-mentioned image sampling step and image fusion step in different cycles.
[0176] It should also be noted that when the image processing module 30 samples the original high-pixel image, it is not limited to sampling all M pixel units in each pixel region PA. That is to say, only some of the M pixel units in each pixel region PA can be sampled. The following takes another embodiment as an example to specifically illustrate the process of the above-mentioned image resolution improvement method:
[0177] Image sampling step:
[0178] Taking the example that the image processing module 30 samples the original high-pixel image to obtain 2 low-pixel sub-images, that is, T = 2.
[0179] An example of the original high-pixel image is as shown in Figure 20As shown, the image processing module 30 divides the original high - pixel image into multiple pixel regions PA (only 4 pixel regions PA are schematically shown in the figure). Each pixel region PA includes 4 pixel units, and each pixel unit includes a sub - pixel. The 4 pixel units in each pixel region PA are respectively the first pixel unit G1, the second pixel unit G2, the third pixel unit G3, and the fourth pixel unit G4. Among them, the first pixel unit G1, the second pixel unit G2, the third pixel unit G3, and the fourth pixel unit G4 are respectively located at the upper - left corner, upper - right corner, lower - right corner, and lower - left corner of each pixel region PA. Among them, taking the first pixel unit G1 as a reference, the second pixel unit G2 is to the right of the first pixel unit G1 (i.e., the above - mentioned first direction is to the right), the third pixel unit G3 is to the lower - right of the first pixel unit G1 (i.e., the above - mentioned second direction is to the lower - right), and the fourth pixel unit G4 is below the first pixel unit G1 (i.e., the above - mentioned third direction is below).
[0180] The image processing module 30 extracts and combines all the first pixel units G1 in each pixel region PA to form a first low - pixel sub - image as shown in Figure 21A and extracts and combines all the second pixel units G2 in each pixel region PA to form a second low - pixel sub - image as shown in Figure 21B , that is, X = 2. Then the image processing module 30 transmits the 2 low - pixel sub - images obtained by the above sampling to the image display device 11. Among them, the pixel multiple difference between the original high - pixel image and the low - pixel sub - image is 4, that is, M = 4.
[0181] Image fusion step:
[0182] Taking the tunable lens 21A shown in Figure 3 as an example of the beam - offset element 21. The tunable lens 21A includes a first transparent plate 211, a second transparent plate 212, and a compressible medium 213 disposed between the first transparent plate 211 and the second transparent plate 212. The first transparent plate 211 is on the side of the second transparent plate 212 close to the human eye 40. A plurality of control electrodes 221 are provided on the first transparent plate 211, and the plurality of control electrodes 221 are used to control the deflection of the first transparent plate 211.
[0183] When the image display device 11 displays the first low - pixel sub - image shown in Figure 21A , no voltage is applied to each control electrode 221. The first transparent plate 211 and the second transparent plate 212 are parallel to each other, so that the tunable lens 21A is in a flat - plate shape. At this time, the tunable lens 21A is in an initial state, and the first low - pixel sub - image outputs an un - offset sub - image as shown in Figure 22A to the human eye 40 after passing through the projection lens 12 and the tunable lens 21A.
[0184] When the image display device 11 displays the second lowest pixel sub-image as shown in Figure 21B , the energization state of each control electrode 221 is changed (specifically, voltage is applied to the two control electrodes 221 at the lower left and upper left corners of the first transparent plate 211, and no voltage is applied to the two control electrodes 221 at the lower right and upper right corners), so that the left side of the first transparent plate 211 deflects around the central position O of the tunable lens 21A towards the second transparent plate 212. At this time, the tunable lens 21A is in the first deflection state, the left side of the tunable lens 21A becomes thinner and the right side becomes thicker, that is, the tunable lens 21A is in the state 7 as shown in Figure 12 . At this time, the light ray is deflected to the right after passing through the tunable lens 21A; the second lowest pixel sub-image outputs the first deflected sub-image to the human eye 40 after passing through the projection lens 12 and the tunable lens 21A, where the first deflected sub-image is deflected to the right compared with the non-deflected sub-image; the first deflected sub-image is fused and superimposed with the above non-deflected sub-image to obtain a higher pixel image as shown in Figure 22B . Since this embodiment samples and fuses some pixel units in the original high pixel image, the image quality of the higher pixel image finally seen by the human eye 40 will be slightly lower than that of the original high pixel image.
[0185] Remove the voltage applied to each control electrode 221. At this time, no voltage is applied to each control electrode 221, so that the tunable lens 21A returns from the first deflection state to the initial state to perform the next cycle of image sampling step and image fusion step.
[0186] Control the image resolution improvement module to perform the above image sampling step and image fusion step in each cycle, and perform the cycle of the above image sampling step and image fusion step in different cycles.
[0187] It should be noted that when the relative positions of the M pixel units in each pixel region PA change, that is, when the position of the first pixel unit G1 as the reference changes, during the process of outputting the T low pixel sub-images obtained by sampling to the human eye 40 through the projection lens 12 and the beam deflection device 20 for image fusion processing, the deflection direction of the beam deflection element 21 and the deflection direction of the light ray after passing through the beam deflection element 21 will also be different. The following takes another embodiment as an example to specifically illustrate the process of the above image resolution improvement method:
[0188] Image sampling step:
[0189] Taking the example that the image processing module 30 samples the original high pixel image to obtain 2 low pixel sub-images, that is, T = 2.
[0190] The example of the original high pixel image is as shown in Figure 23As shown, the image processing module 30 divides the original high - pixel image into multiple pixel regions PA (only 4 pixel regions PA are schematically shown in the figure). Each pixel region PA includes 4 pixel units, and each pixel unit includes a sub - pixel. The 4 pixel units in each pixel region PA are the first pixel unit G1, the second pixel unit G2, the third pixel unit G3, and the fourth pixel unit G4 respectively. Among them, the first pixel unit G1, the second pixel unit G2, the third pixel unit G3, and the fourth pixel unit G4 are located at the lower left corner, upper right corner, upper left corner, and lower right corner of each pixel region PA respectively. Among them, taking the first pixel unit G1 as a reference, the second pixel unit G2 is located at the upper right of the first pixel unit G1 (that is, the above - mentioned first direction is the upper right), the third pixel unit G3 is located above the first pixel unit G1 (that is, the above - mentioned second direction is the upper), and the fourth pixel unit G4 is located to the right of the first pixel unit G1 (that is, the above - mentioned third direction is the right).
[0191] The image processing module 30 extracts and combines all the first pixel units G1 in each pixel region PA to form a first low - pixel sub - image as shown in Figure 24A shown, extracts and combines all the second pixel units G2 in each pixel region PA to form a second low - pixel sub - image as shown in Figure 24B shown, that is, X = 2; then the image processing module 30 transmits the 2 low - pixel sub - images obtained by the above sampling to the image display device 11. Among them, the pixel multiple difference between the original high - pixel image and the low - pixel sub - image is 4, that is, M = 4.
[0192] Image fusion step:
[0193] Taking the tunable lens 21A shown in Figure 3 as an example of the beam - offset element 21. The tunable lens 21A includes a first transparent plate 211, a second transparent plate 212, and a compressible medium 213 disposed between the first transparent plate 211 and the second transparent plate 212. The first transparent plate 211 is located on the side of the second transparent plate 212 closer to the human eye 40. A plurality of control electrodes 221 are provided on the first transparent plate 211, and the plurality of control electrodes 221 are used to control the deflection of the first transparent plate 211.
[0194] When the image display device 11 displays the first low - pixel sub - image shown in Figure 24A shown, no voltage is applied to each control electrode 221. The first transparent plate 211 and the second transparent plate 212 are parallel to each other, so that the tunable lens 21A is in a flat - plate shape. At this time, the tunable lens 21A is in an initial state, and the first low - pixel sub - image outputs an un - offset sub - image as shown in Figure 25A shown after passing through the projection lens 12 and the tunable lens 21A to the human eye 40.
[0195] When the image display device 11 displays the second lowest pixel sub-image as shown in Figure 24B , the energization state of each control electrode 221 is changed. At this time, a voltage is applied to the control electrode 221 at the lower left corner of the first transparent plate 211, and no voltage is applied to the three control electrodes 221 at the lower right corner, upper right corner, and upper left corner, so that the lower left corner of the first transparent plate 211 deflects around the central position O of the tunable lens 21A toward the second transparent plate 212. At this time, the tunable lens 21A is in the first deflection state, the lower left corner of the tunable lens 21A becomes thinner, and the upper right corner becomes thicker, that is, the tunable lens 21A is in the state 8 as shown in Figure 12 . At this time, the light ray shifts to the upper right corner after passing through the tunable lens 21A; the second lowest pixel sub-image outputs the first shifted sub-image to the human eye 40 after passing through the projection lens 12 and the tunable lens 21A. The first shifted sub-image is shifted upward and to the right compared with the unshifted sub-image; the first shifted sub-image and the above unshifted sub-image are fused and superimposed to obtain a higher pixel image as shown in Figure 25B . Since this embodiment samples and fuses some pixel units in the original high pixel image, the image quality of the higher pixel image finally seen by the human eye 40 is slightly lower than that of the original high pixel image.
[0196] Remove the voltage applied to each control electrode 221. At this time, no voltage is applied to each control electrode 221, so that the tunable lens 21A returns from the first deflection state to the initial state to perform the next cycle of image sampling step and image fusion step.
[0197] Control the image resolution improvement module to perform the above image sampling step and image fusion step in each cycle, and perform the cycle of the above image sampling step and image fusion step in different cycles.
[0198] In the above embodiments, two low-pixel sub-images are obtained by sampling the original high-pixel image. Image fusion enables the human eye 40 to perceive a higher-pixel image obtained by fusing and superimposing an unshifted sub-image and a shifted sub-image. In other embodiments, according to the two low-pixel sub-images obtained by sampling, when performing image fusion, an unshifted sub-image and multiple shifted sub-images can be fused and superimposed to obtain a high-pixel image. Specifically, for example, first, the first low-pixel sub-image passes through the projection lens 12 and the light beam shifting device 20 and then outputs an unshifted sub-image to the human eye 40. Then, the first low-pixel sub-image passes through the projection lens 12 and the light beam shifting device 20 and then outputs the first shifted sub-image to the human eye 40, and the first shifted sub-image is fused and superimposed with the above unshifted sub-image to obtain the first intermediate image. Then, the second low-pixel sub-image passes through the projection lens 12 and the light beam shifting device 20 and then outputs the second shifted sub-image to the human eye 40, and the second shifted sub-image is fused and superimposed with the above first intermediate image to obtain the second intermediate image. Then, the second low-pixel sub-image passes through the projection lens 12 and the light beam shifting device 20 and then outputs the third shifted sub-image to the human eye 40, and the third shifted sub-image is fused with the above second intermediate image to obtain a high-pixel image.
[0199] This embodiment also provides another method for improving image resolution. This method for improving image resolution is used for an image resolution improvement module, and this method for improving image resolution includes:
[0200] S3. Image sampling step:
[0201] The image processing module 30 divides the original high-pixel image into multiple pixel regions PA. Each pixel region PA includes M pixel units (specifically, each pixel unit includes at least one sub-pixel). The M pixel units in each pixel region PA are respectively the first pixel unit (denoted as G1 in the figure), the second pixel unit (denoted as G2 in the figure), …, the Xth pixel unit, …, the Mth pixel unit. Among them, the second pixel unit is located in the first direction of the first pixel unit, the third pixel unit is located in the second direction of the first pixel unit, …, the Xth pixel unit is located in the (X - 1)th direction of the first pixel unit, …, the Mth pixel unit is located in the (M - 1)th direction of the first pixel unit.
[0202] The image processing module 30 extracts and combines all the first pixel units in each pixel region PA to form a low-pixel sub-image, and then the image processing module 30 transmits this low-pixel sub-image to the image display device 11.
[0203] That is to say, in the above S3 step, when sampling the original high-pixel image, since only the first pixel unit is sampled, so T = 1.
[0204] S4, Image fusion step, please refer to Figure 26 :
[0205] S41, The beam deflection element 21 is in the initial state, and the image display device 11 displays the low-pixel sub-image. After passing through the projection lens 12 and the beam deflection device 20, the low-pixel sub-image outputs an undeflected sub-image to the human eye 40;
[0206] S42, Control the driving device 22 to drive the beam deflection element 21 to deflect in the first deflection direction, so that the beam deflection element 21 is in the first deflection state; the image display device 11 displays the low-pixel sub-image. After passing through the projection lens 12 and the beam deflection device 20, the low-pixel sub-image outputs the first deflected sub-image to the human eye 40, where the first deflected sub-image deflects in the above first direction compared with the undeflected sub-image; the first deflected sub-image and the undeflected sub-image are fused and superimposed to obtain the first intermediate image;
[0207] S43, Control the driving device 22 to drive the beam deflection element 21 to deflect in the second deflection direction, so that the beam deflection element 21 is in the second deflection state; the image display device 11 displays the low-pixel sub-image. After passing through the projection lens 12 and the beam deflection device 20, the low-pixel sub-image outputs the second deflected sub-image to the human eye 40, where the second deflected sub-image deflects in the above second direction compared with the undeflected sub-image; the second deflected sub-image and the first intermediate image are fused and superimposed to obtain the second intermediate image;
[0208] …
[0209] S44, Control the driving device 22 to drive the beam deflection element 21 to deflect in the (N - 1)th deflection direction, so that the beam deflection element 21 is in the (N - 1)th deflection state; the image display device 11 displays the low-pixel sub-image. After passing through the projection lens 12 and the beam deflection device 20, the low-pixel sub-image outputs the (N - 1)th deflected sub-image to the human eye 40, where the (N - 1)th deflected sub-image deflects in the above (X - 1)th direction compared with the undeflected sub-image; the (N - 1)th deflected sub-image and the (N - 2)th intermediate image are fused and superimposed to obtain a higher-pixel image; where the first deflection direction, the second deflection direction,..., the (N - 1)th deflection direction are different deflection directions respectively;
[0210] S45, Control the driving device 22 to drive the beam deflection element 21 to deflect, so that the beam deflection element 21 returns from the (N - 1)th deflection state to the initial state;
[0211] Among them, M is the pixel multiple difference between the original high - pixel image and the low - pixel sub - image. The pixel multiple difference specifically refers to the ratio of the total number of pixels in the original high - pixel image to the total number of pixels in the low - pixel sub - image. X, M, and N are all integers, 2 ≤ N ≤ M, and X = N.
[0212] Control the image resolution improvement module to execute the above - mentioned steps S3 and S4 in each cycle, and perform the loop of the above - mentioned steps S3 and S4 in different cycles.
[0213] In an exemplary embodiment, the beam deflection element 21 is a tunable lens 21A. The tunable lens 21A includes a first transparent plate 211, a second transparent plate 212, and a compressible medium 213 disposed between the first transparent plate 211 and the second transparent plate 212; the driving device 22 includes at least one control electrode 221 disposed on the first transparent plate 211 and / or the second transparent plate 212, and the control electrode 221 is used to drive the first transparent plate 211 and / or the second transparent plate 212 to deflect;
[0214] In the above - mentioned step S4, no voltage is applied to each control electrode 221, and the first transparent plate 211 and the second transparent plate 212 are parallel to each other, so that the tunable lens 21A is in a flat - plate shape. At this time, the tunable lens 21A is in an initial state;
[0215] Change the energization state of each control electrode 221 to make the first transparent plate 211 and / or the second transparent plate 212 deflect, so that the thickness of the side of the tunable lens 21A corresponding to the above - mentioned first direction increases. At this time, the beam deflection element 21 is in a first deflection state;
[0216] Change the energization state of each control electrode 221 to make the first transparent plate 211 and / or the second transparent plate 212 deflect, so that the thickness of the side of the tunable lens 21A corresponding to the above - mentioned second direction increases. At this time, the beam deflection element 21 is in a second deflection state;
[0217] …
[0218] Change the energization state of each control electrode 221 to make the first transparent plate 211 and / or the second transparent plate 212 deflect, so that the thickness of the side of the tunable lens 21A corresponding to the above - mentioned (X - 1) - th direction increases. At this time, the beam deflection element 21 is in the (N - 1) - th deflection state;
[0219] Remove the voltage applied to each control electrode 221. At this time, no voltage is applied to each control electrode 221, and the beam deflection element 21 is restored from the (N - 1) - th deflection state to the initial state.
[0220] The following specifically illustrates the process of the above - mentioned image resolution improvement method by examples:
[0221] Image sampling step:
[0222] The image processing module 30 samples the original high - pixel image to obtain a low - pixel sub - image, i.e., T = 1. This sampling process can be directly performed from the original high - pixel image data or from the data after processing the original high - pixel image, and there is no limitation here. The following example is to sample a low - pixel sub - image from the data of the original high - pixel image.
[0223] The example of the original high - pixel image is as Figure 27 shown. The image processing module 30 divides the original high - pixel image into multiple pixel regions PA (only 4 pixel regions PA are schematically shown in the figure). Each pixel region PA includes 4 pixel units, and each pixel unit includes a sub - pixel. The 4 pixel units in each pixel region PA are the first pixel unit G1, the second pixel unit G2, the third pixel unit G3, and the fourth pixel unit G4 respectively, i.e., X = 4, where the first pixel unit G1, the second pixel unit G2, the third pixel unit G3, and the fourth pixel unit G4 are located at the upper - left corner, upper - right corner, lower - right corner, and lower - left corner of each pixel region PA respectively.
[0224] The image processing module 30 extracts and combines all the first pixel units G1 in each pixel region PA to form a low - pixel sub - image as Figure 28 shown; then the image processing module 30 transmits the low - pixel sub - image obtained by the above sampling to the image display device 11; among them, the pixel multiple difference between the original high - pixel image and the low - pixel sub - image is 4, i.e., M = 4.
[0225] Image fusion step:
[0226] Taking the beam - deflecting element 21 as the tunable lens 21A as Figure 3 shown as an example. The tunable lens 21A includes a first transparent plate 211, a second transparent plate 212, and a compressible medium 213 disposed between the first transparent plate 211 and the second transparent plate 212. The first transparent plate 211 is located on the side of the second transparent plate 212 close to the human eye 40, and a plurality of control electrodes 221 are provided on the first transparent plate 211, and the plurality of control electrodes 221 are used to control the deflection of the first transparent plate 211.
[0227] When no voltage is applied to each control electrode 221, the first transparent plate 211 and the second transparent plate 212 are parallel to each other, making the tunable lens 21A in a flat - plate shape. At this time, the tunable lens 21A is in an initial state; the image display device 11 displays the low - pixel sub - image as Figure 28 shown, and this low - pixel sub - image outputs an image as Figure 29AThe unshifted sub-image shown.
[0228] Change the energization state of each control electrode 221 (specifically, apply voltage to the two control electrodes 221 at the lower left and upper left corners of the first transparent plate 211, and do not apply voltage to the two control electrodes 221 at the lower right and upper right corners), so that the left side of the first transparent plate 211 deflects toward the second transparent plate 212 around the central position O of the tunable lens 21A. At this time, the tunable lens 21A is in the first deflection state, the left side of the tunable lens 21A becomes thinner and the right side becomes thicker, that is, the tunable lens 21A is in the state 7 as shown in Figure 12 . At this time, the light is shifted to the right after passing through the tunable lens 21A; the image display device 11 displays the low-pixel sub-image as shown in Figure 28 . The low-pixel sub-image outputs the first shifted sub-image to the human eye 40 after passing through the projection lens 12 and the tunable lens 21A. Among them, the first shifted sub-image is shifted to the right compared with the unshifted sub-image; the first shifted sub-image and the above unshifted sub-image are fused and superimposed to obtain the first intermediate image as shown in Figure 29B .
[0229] Change the energization state of each control electrode 221 (specifically, apply voltage to the control electrode 221 at the upper left corner of the first transparent plate 211, and do not apply voltage to the three control electrodes 221 at the upper right, lower right and lower left corners), so that the upper left corner of the first transparent plate 211 deflects toward the second transparent plate 212 around the central position O of the tunable lens 21A. At this time, the tunable lens 21A is in the second deflection state, the upper left corner of the tunable lens 21A becomes thinner and the lower right corner becomes thicker, that is, the tunable lens 21A is in the state 6 as shown in Figure 12 . At this time, the light is shifted to the lower right after passing through the tunable lens 21A; the image display device 11 displays the low-pixel sub-image as shown in Figure 28 . The low-pixel sub-image outputs the second shifted sub-image to the human eye 40 after passing through the projection lens 12 and the tunable lens 21A. Among them, the second shifted sub-image is shifted to the lower right compared with the unshifted sub-image; the second shifted sub-image and the above first intermediate image are fused and superimposed to obtain the second intermediate image as shown in Figure 29C .
[0230] Change the energization state of each control electrode 221 (specifically, apply voltage to the two control electrodes 221 at the upper left and upper right corners of the first transparent plate 211, and do not apply voltage to the two control electrodes 221 at the lower left and lower right corners), so that the upper side of the first transparent plate 211 deflects toward the second transparent plate 212 around the central position O of the tunable lens 21A. At this time, the tunable lens 21A is in the third deflection state, the upper side of the tunable lens 21A becomes thinner and the lower side becomes thicker, that is, the tunable lens 21A is in the state as shown in Figure 12In state 5, at this time, the light beam is deflected downward after passing through the tunable lens 21A; the image display device 11 displays the low-pixel sub-image as shown in Figure 28 This low-pixel sub-image, after passing through the projection lens 12 and the tunable lens 21A, outputs a third deflected sub-image to the human eye 40. Among them, the third deflected sub-image is deflected downward compared to the non-deflected sub-image; the third deflected sub-image is fused and superimposed with the above-mentioned second intermediate image to obtain a higher-pixel image as shown in Figure 29D Since this embodiment samples and fuses some pixel units in the original high-pixel image, the image quality of the higher-pixel image finally seen by the human eye 40 is lower than that of the original high-pixel image.
[0231] Remove the voltage applied to each control electrode 221. At this time, no voltage is applied to each control electrode 221, so that the tunable lens 21A returns from the third deflection state to the initial state to perform the image sampling step and the image fusion step in the next cycle.
[0232] Control the image resolution enhancement module to perform the above-mentioned image sampling step and image fusion step in each cycle, and perform the cycle of the above-mentioned image sampling step and image fusion step in different cycles.
[0233] In specific implementation, the values of M, N, X, and T are not limited to the above embodiments, and other value ranges are also possible. For example, the following table lists the values of M, N, X, and T in some different embodiments:
[0234] Serial number Value range of M Value range of N Value range of X Value range of T 1 2 2 2 2 2 2 2 2 1 3 4 4 4 4 4 4 4 2 2 5 4 4 4 1 6 4 2 2 2 7 4 2 2 1 8 6 6 6 6 9 6 4 4 4 10 6 4 4 1 11 8 8 8 8 12 8 4 4 4 13 8 4 4 1 14 9 9 9 9 15 9 4 4 4 16 9 4 4 1 17 9 3 3 1
[0235] Based on the same inventive concept, the present application also provides an image resolution enhancement module, which can be referred to Figure 1 The image resolution enhancement module includes the beam deflection device 20 in any of the above embodiments. The beam deflection device 20 includes a beam deflection element 21 and a driving device 22. The image resolution enhancement module further includes an optical engine 10. The optical engine 10 includes an image display device 11 and a projection lens 12. The image display device 11 is provided with at least one micro display screen 111. The projection lens 12 includes a plurality of lenses. The driving device 22 is used to drive the beam deflection element 21 to deflect N times in each cycle, so that the beam deflection element 21 sequentially experiences the initial state and N-1 deflection states in each cycle, so that the T low-pixel sub-images sequentially displayed by the image display device 11 in each cycle, after passing through the projection lens 12 and the beam deflection device 20, correspondingly output an undeflected sub-image and N-1 deflected sub-images to the human eye 40 in sequence, so that the human eye 40 can feel a high-pixel image obtained by fusing and superimposing an undeflected sub-image and N-1 deflected sub-images; where N and T are integers, and N≥2, 1≤T≤N.
[0236] In an exemplary embodiment, the projection lens 12 is located between the beam deflection device 20 and the image display device 11. The T low-pixel sub-images output by the image display device 11 in each cycle sequentially pass through the projection lens 12 and the beam deflection device 20.
[0237] In another exemplary embodiment, the beam deflection device 20 is located between the projection lens 12 and the image display device 11. The T low-pixel sub-images output by the image display device 11 in each cycle sequentially pass through the beam deflection device 20 and the projection lens 12.
[0238] In an exemplary embodiment, the image display device 11 includes a plurality of monochromatic micro display screens 111 and a light combining prism 112. The plurality of monochromatic micro display screens 111 are used to respectively output monochromatic light such as the three primary colors of red, green, and blue. Different surfaces of the light combining prism 112 are disposed opposite to the plurality of monochromatic micro display screens 111, and are used to combine the plurality of monochromatic lights such as the three primary colors of red, green, and blue to display sub-images.
[0239] In another exemplary embodiment, the image display device 11 includes a single monochromatic micro display screen 111 to output monochromatic sub-images, or a single full-color micro display screen 111 to output full-color sub-images.
[0240] In an exemplary embodiment, the projection lens 12 includes a plurality of lenses. The number N of the plurality of lenses can be greater than 3, and the material can be glass or plastic.
[0241] In an exemplary embodiment, the diagonal length ld of the micro display screen 111 and the lens focal length EFL of the projection lens 12 may satisfy: 0.25 < ld / EFL < 3.5, where the diagonal length of the micro display screen 111 is ld, and the lens focal length of the projection lens 12 is EFL. By satisfying 0.25 < ld / EFL < 3.5 and controlling the ratio range of the diagonal length ld of the micro display screen 111 to the lens focal length EFL of the projection lens 12, it is possible to avoid too small a field of view angle caused by too small a ratio and too large a field of view angle caused by too large a ratio, which is beneficial to obtaining a better high-resolution display effect.
[0242] In an exemplary embodiment, the entrance pupil diameter EPD of the projection lens 12 and the diagonal length ld of the micro display screen 111 may satisfy: 0.3 < ld / EPD < 1.5, where the entrance pupil diameter of the projection lens 12 is EPD, and the diagonal length of the micro display screen 111 is ld. By satisfying 0.3 < ld / EPD < 1.5 and controlling the ratio of the entrance pupil diameter EPD of the projection lens 12 to the diagonal length ld of the micro display screen 111, the image brightness can be controlled to be of a suitable size, which is beneficial to obtaining a better high-resolution display effect.
[0243] In an exemplary embodiment, the PPD of the image resolution enhancement module, that is, the number of pixels that the human eye 40 can see within every 1° range in the field of view angle, can satisfy: 10 < PPD, where the PPD of the image resolution enhancement module = the number of diagonal pixels / FOV’, that is, the number of pixels that the human eye 40 can see within every 1° range in the field of view angle. For an image resolution enhancement module without a resolution enhancement device, 5 < PPD can be satisfied. By setting a resolution enhancement device in the present invention, the total resolution can be increased to 4 times, the number of pixels on the diagonal can be increased to 2 times, that is, the PPD is increased to 2 times, and 10 < PPD is controlled, which is beneficial to increasing the number of pixels on the diagonal and correspondingly improving the image resolution.
[0244] In an exemplary embodiment, the projection lens 12 further includes a diaphragm STOP. The diaphragm STOP can be disposed, for example, on the human eye side of the first lens L1 of the projection lens 12. The first lens L1 is the first lens close to the human eye side among the multiple lenses in the projection lens 12. The diaphragm STOP can also be disposed between other adjacent lenses.
[0245] In an exemplary embodiment, the projection lens 12 may include multiple lenses, such as 4 or 5, etc. However, those skilled in the art should understand that without departing from the technical solution claimed in the present application, the number of lenses constituting the optical imaging lens can be changed to obtain the various results and advantages described in this specification.
[0246] Figure 30 The effect comparison simulation diagram of the image resolution enhancement module in an embodiment of the present application is shown. Figure 30 The effect comparison simulation diagrams of not setting a beam offset device and setting a beam offset device are respectively shown. Visibly, setting a beam offset device in the image resolution enhancement module can obtain a relatively higher resolution image. Thus, by setting the beam offset device 20, the image resolution enhancement module according to the embodiment of the present application can maintain the original small volume of the image resolution enhancement module and provide a high-definition picture for the image resolution enhancement module.
[0247] Based on the same inventive concept, a near-eye display device according to an exemplary embodiment of the present application includes the above-mentioned image resolution enhancement module and a power supply unit (not shown in the figure). The power supply unit is respectively connected to the image display device 11 and the beam offset device 20 in the image resolution enhancement module. The power supply unit can supply electric energy to the driving device 22 in the image display device 11 and the beam offset device 20.
[0248] In an exemplary embodiment, the near-eye display device further includes a waveguide (not shown in the figure), which is connected to the image resolution enhancement module. The waveguide is configured to conduct the image output by the image resolution enhancement module to the human eye 40. By using the geometric optical waveguide technology of total reflection or the diffractive optical waveguide technology of total reflection and diffraction to transmit the light rays of the sub-images to the human eye 40, it is beneficial to optimize the structure and lightweight design. For example, the light emitted by the image display device 11 sequentially passes through the beam deflection device 20, the projection lens 12, and the waveguide to the human eye 40.
[0249] The following further describes specific embodiments of the image resolution enhancement module applicable to the above embodiments with reference to the accompanying drawings.
[0250] Example 1
[0251] The following refers to Figure 31 Describe the image resolution enhancement module according to Embodiment 1 of the present application. Figure 31 A cross-sectional schematic diagram of the image resolution enhancement module according to Embodiment 1 of the present application is shown.
[0252] The image resolution enhancement module of Embodiment 1 includes an optical engine 10 and a beam deflection device 20. The optical engine 10 includes an image display device 11 and a projection lens 12.
[0253] Among them, the projection lens 12 is located between the beam deflection device 20 and the image display device 11, and the light emitted by the image display device 11 sequentially passes through the projection lens 12 and the beam deflection device 20. The beam deflection device 20 includes a beam deflection element 21 and a driving device 22.
[0254] Among them, the beam deflection element 21 is a tunable lens 21A. The tunable lens 21A includes a first transparent plate 211, a second transparent plate 212, and a compressible medium 213 disposed between the first transparent plate 211 and the second transparent plate 212. The driving device 22 is configured to control the angular deflection of the first transparent plate 211 and / or the second transparent plate 212 and squeeze the compressible medium 213 within each period, changing the thickness of different positions of the tunable lens 21A, so that the tunable lens 21A experiences a change from a flat plate to a wedge with a different direction within each period to deflect the light in different directions. Among them, in the initial state, the first transparent plate 211 and the second transparent plate 212 are parallel to each other, and the tunable lens 21A can be regarded as a flat plate; in the deflected state, the first transparent plate 211 and the second transparent plate 212 are not parallel, and the tunable lens 21A is formed into a wedge shape.
[0255] Among them, the image display device 11 includes a plurality of monochromatic micro display screens 111 and a light combining prism 112. The plurality of monochromatic micro display screens 111 are used to respectively output monochromatic light such as the three primary colors of red, green, and blue. Different surfaces of the light combining prism 112 are disposed opposite to the plurality of monochromatic micro display screens 111, and are used to combine the plurality of monochromatic lights such as the three primary colors of red, green, and blue to display a sub-image.
[0256] In this embodiment, as Figure 31 shown, the light emitted by the micro display screen 111 sequentially passes through the light combining prism 112, the projection lens 12, and the tunable lens 21A.
[0257] In one embodiment, when the projection lens 12 is located between the beam offset device 20 and the image display device 11, it can satisfy: 1.5 < ΔIH / Δt < 5, where the thickness deformation amount of the tunable lens 21A is Δt, and its image height offset is ΔIH. When the projection lens 12 is located between the beam offset device 20 and the image display device 11, and 1.5 < ΔIH / Δt < 5, by controlling the ratio of the thickness deformation amount Δt of the tunable lens 21A to the image height offset ΔIH, for the same image height offset effect, a larger deformation amount can be obtained, and higher control accuracy can be achieved.
[0258] In one embodiment, the image resolution enhancement module according to the present application can satisfy: 0.1 mm ≤ d1 ≤ 2 mm, where d1 is the thickness of the beam offset device 20. By satisfying 0.1 mm ≤ d1 ≤ 2 mm and controlling the value range of the thickness d1 of the beam offset device 20, the thickness of the image resolution enhancement module can be controlled, which is beneficial to the miniaturization of the near-eye display device. Specifically, the thickness of the beam offset device 20 set in Table 1 can be referred to as 0.2 mm. In another embodiment, the thickness d1 of the beam offset device 20 can be set relatively smaller or larger according to requirements. Specifically, the thickness of the beam offset device 20 set in Table 10 can be referred to as 0.5 mm, as long as 0.1 mm ≤ d1 ≤ 2 mm is satisfied.
[0259] In one embodiment, as Figure 31 shown, the projection lens 12 may include a first lens L1, a second lens L2, a third lens L3, a fourth lens L4, and a fifth lens L5 sequentially arranged from the human eye side to the micro display screen side. The projection lens 12 may be provided with a diaphragm STOP, and the diaphragm STOP may be provided on the human eye side surface of the first lens L1 of the projection lens 12.
[0260] Table 1 shows the basic parameter table of the image resolution enhancement module of Embodiment 1, where the units of radius, thickness, and semi-aperture are all millimeters (mm).
[0261] Table 1:
[0262]
[0263] Among them, S1 represents the human eye side of the light beam deflection device 20, S2 represents the micro display screen side of the light beam deflection device 20, S3 represents the aperture STOP, S4 represents the human eye side of the first lens L1, S5 represents the micro display screen side of the first lens L1, S6 represents the human eye side of the second lens L2, S7 represents the micro display screen side of the second lens L2, S8 represents the human eye side of the third lens L3, S9 represents the micro display screen side of the third lens L3, S10 represents the human eye side of the fourth lens L4, S11 represents the micro display screen side of the fourth lens L4, S12 represents the human eye side of the fifth lens L5, S13 represents the micro display screen side of the fifth lens L5, S14 represents the human eye side of the light combining prism 112, S15 represents the micro display screen side of the light combining prism 112, and S16 represents the micro display screen 111.
[0264] Among them, the object side and the image side of any one of the first lens L1 to the fifth lens L5 can both be even aspherical surfaces, and the surface shapes of the aspherical lenses can be defined by, but not limited to, the following aspherical formula:
[0265]
[0266] Among them, Z represents the height in the optical axis direction, c is the reciprocal of the surface radius, k is the conic coefficient, r is the aperture in the radial direction; α represents the aspherical coefficient, α1 represents the aspherical coefficient A2, α2 represents the aspherical coefficient A4... Table 2 gives the high-order term coefficients A4, A6, A8, A10, A12, A14, and A16 of the aspherical mirror surfaces of the second lens L2 to the fifth lens L5 that can be used in the projection lens 12 in Embodiment 1.
[0267] Table 2:
[0268]
[0269]
[0270] In Embodiment 1, the diagonal length ld of the micro display screen 111 is 2.6 mm, and the focal length EFL of the projection lens 12 is 5.5 mm. Then ld / EFL = 0.47, which can satisfy 0.25 < ld / EFL < 3.5. The entrance pupil diameter EPD of the projection lens 12 is 3.06 mm, and the diagonal length ld of the micro display screen 111 is 2.6 mm. Then EPD / ld = 0.85, which can satisfy 0.3 < ld / EPD < 1.5. The deflection angle set for the beam deflection device 20 is 0.04°, and the thickness deformation amount is 1.17 μm. The first transparent plate 311 of the tunable lens 21A can be set to have a single-sided deflection angle θ of 0.04°, and the single-sided edge thickness change amount d2 is 1.17 μm. Then the thickness deformation amount Δt of the tunable lens 21A is 1.17 μm. Table 3 shows the relevant parameter table of the image height change before and after the deflection of the tunable lens 21A in Embodiment 1 at different fields of view.
[0271] Table 3:
[0272]
[0273] Each period of the tunable lens 21A experiences a change from a flat plate to a wedge with a different direction. When deflecting into a wedge with a different direction, it will cause light rays emitted from the same light source position, such as 0 um in image height, to enter the human eye 40 at an angle in different directions, which is equivalent to multiple light sources with different image heights, such as 2 um in different directions on the micro display screen, entering the human eye 40 at 0°. Therefore, in Table 3, the angle changes generated before and after the wedge deflection of different image heights are corresponding to the image height changes. The 0F to 1.0F in the field of view in the first column equally divides the imaging field of view of the lens into 10 equal parts according to the image height.
[0274] It can be obtained from Table 3 that when the projection lens 12 is located between the beam deflection device 20 and the image display device 11, the relationship between the thickness deformation amount Δt of the tunable lens 21A and the image height offset ΔIH satisfies 1.5 < ΔIH / Δt < 5, and a relatively large image height offset effect can be achieved with a relatively small deformation amount.
[0275] Example 2
[0276] The following refers to Figure 32 Describe the image resolution improvement module according to Embodiment 2 of the present application. Figure 32The cross-sectional schematic diagram of the image resolution enhancement module according to Embodiment 2 of the present application is shown. In Embodiment 2, for the sake of simplicity, some descriptions similar to those in Embodiment 1 will be omitted. The image resolution enhancement module of this embodiment is basically the same as the aforementioned Embodiment 1, except that: the beam offset device 20 is located between the projection lens 12 and the image display device 11, and the light emitted by the image display device 11 passes through the beam offset device 20 and the projection lens 12 in sequence. In this embodiment, as Figure 32 shown, the light emitted by the microdisplay 111 passes through the light combining prism 112, the tunable lens 21A, and the projection lens 12 in sequence.
[0277] In one embodiment, when the beam offset device 20 is located between the projection lens 12 and the image display device 11, it can satisfy: 1 < ΔIH / Δt < 3, where the thickness deformation amount of the tunable lens 21A is Δt, and its image height offset is ΔIH. Satisfying that the beam offset device 20 is located between the projection lens 12 and the image display device 11, and 1 < ΔIH / Δt < 3, and controlling the ratio of the thickness deformation amount Δt of the tunable lens 21A to the image height offset ΔIH, for the same image height offset effect, a larger deformation amount can be obtained, and higher control accuracy can be achieved.
[0278] Table 4 shows the basic parameter table of the image resolution enhancement module of Embodiment 2, where the units of radius, thickness, and semi-aperture are all millimeters (mm).
[0279] Table 4:
[0280]
[0281]
[0282] Among them, S1 represents the aperture STOP, S2 represents the human eye side of the first lens L1, S3 represents the microdisplay side of the first lens L1, S4 represents the human eye side of the second lens L2, S5 represents the microdisplay side of the second lens L2, S6 represents the human eye side of the third lens L3, S7 represents the microdisplay side of the third lens L3, S8 represents the human eye side of the fourth lens L4, S9 represents the microdisplay side of the fourth lens L4, S10 represents the human eye side of the fifth lens L5, S11 represents the microdisplay side of the fifth lens L5, S12 represents the human eye side of the beam offset device 20, S13 represents the microdisplay side of the beam offset device 20, S14 represents the human eye side of the light combining prism 112, S15 represents the microdisplay side of the light combining prism 112, and S16 represents the microdisplay 111.
[0283] Table 5 shows the coefficients A4, A6, A8, A10, A12, A14, and A16 of the high-order terms of the aspherical mirror surfaces of the first lens L1 to the fifth lens L5 that can be used for the projection lens 12 in Example 2.
[0284] Table 5:
[0285]
[0286] In Example 2, the diagonal length ld of the micro display screen 111 is 2.6 mm, and the focal length EFL of the projection lens 12 is 5.5 mm. Then ld / EFL = 0.47, which can satisfy: 0.25 < ld / EFL < 3.5. The entrance pupil diameter EPD of the projection lens 12 is 3.06 mm, and the diagonal length ld of the micro display screen 111 is 2.6 mm. Then ld / EPD = 0.85, which can satisfy: 0.3 < ld / EPD < 1.5. The deflection angle set by the beam deflection device 20 is 0.07°, and the thickness deformation amount is 1.72 μm. The first transparent plate 211 of the tunable lens 21A can be set to have a single-sided deflection angle θ of 0.08°, and the single-sided edge thickness change amount d2 is 1.72 μm. Then the thickness deformation amount Δt of the tunable lens 21A is 1.72 μm. Table 6 shows the relevant parameter table of the image height change before and after the deflection of the tunable lens 21A in Example 2 at different fields of view.
[0287] Table 6:
[0288]
[0289] It can be obtained from Table 6 that when the beam deflection device 20 is located between the projection lens 12 and the image display device 11, the relationship between the thickness deformation amount Δt of the tunable lens 21A and the image height offset ΔIH satisfies: 1 < ΔIH / Δt < 3. For the same image height offset effect, a larger deformation amount can be obtained, and higher control accuracy can be achieved.
[0290] Example 3
[0291] The following refers to Figure 33 Describe the image resolution improvement module according to Embodiment 3 of the present application. Figure 33 Fig. shows a cross-sectional schematic diagram of the image resolution improvement module according to Embodiment 3 of the present application. In Embodiment 3, for the sake of simplicity, some descriptions similar to those in Embodiment 1 will be omitted. The image resolution improvement module of this embodiment is basically the same as the aforementioned Embodiment 1, except that: the image display device 11 includes a monochromatic micro display screen 111 for outputting a monochromatic sub-image, or a full-color micro display screen 111 for outputting a full-color sub-image.
[0292] In this embodiment, as Figure 33As shown, the light emitted by the microdisplay 111 sequentially passes through the projection lens 12 and the tunable lens 21A.
[0293] In one embodiment, as Figure 33 shown, the projection lens 12 may include a first lens L1, a second lens L2, a third lens L3, and a fourth lens L4 sequentially arranged from the human eye side to the microdisplay side. And in one embodiment, as Figure 33 shown, the projection lens 12 may be provided with a diaphragm STOP, and the diaphragm STOP may be arranged on the human eye side surface of the first lens L1 of the projection lens 12.
[0294] Table 7 shows the basic parameter table of the image resolution improvement module of Embodiment 3, where the units of radius, thickness, and semi-aperture are all millimeters (mm).
[0295] Table 7:
[0296]
[0297] Among them, S1 represents the human eye side surface of the beam deflection device 20, S2 represents the microdisplay side surface of the beam deflection device 20, S3 represents the diaphragm STOP, S4 represents the human eye side surface of the first lens L1, S5 represents the microdisplay side surface of the first lens L1, S6 represents the human eye side surface of the second lens L2, S7 represents the microdisplay side surface of the second lens L2, S8 represents the human eye side surface of the third lens L3, S9 represents the microdisplay side surface of the third lens L3, S10 represents the human eye side surface of the fourth lens L4, S11 represents the microdisplay side surface of the fourth lens L4, and S12 represents the microdisplay 111.
[0298] Table 8 gives the higher-order term coefficients A4, A6, A8, A10, A12, A14, and A16 of the aspherical mirror surfaces of the first lens L1 to the fourth lens L4 that can be used for the projection lens 12 in Embodiment 3.
[0299] Table 8:
[0300]
[0301]
[0302] In Embodiment 3, the diagonal length ld of the microdisplay 111 is 3.23 mm, and the focal length EFL of the projection lens 12 is 5.7 mm. Then ld / EFL = 0.57, which satisfies 0.25 < ld / EFL < 3.5. The entrance pupil diameter EPD of the projection lens 12 is 2.59 mm, and the diagonal length ld of the microdisplay 111 is 3.23 mm. Then EPD / ld = 1.25, which satisfies 0.3 < ld / EPD < 1.5. The beam deflection device 20 is set to have a deflection angle of 0.02° and a thickness deformation of 0.54 μm. The first transparent plate 211 of the tunable lens 21A can be set to have a single-sided deflection angle θ of 0.02°, and the single-sided edge thickness change d2 is 0.54 μm. Then the thickness deformation Δt of the tunable lens 21A is 0.54 μm. Table 9 shows the relevant parameter table of the image height change before and after the deflection of the tunable lens 21A at different field angles in Embodiment 3.
[0303] Table 9:
[0304]
[0305] It can be obtained from Table 9 that when the projection lens 12 is located between the beam deflection device 20 and the image display device 11, the relationship between the thickness deformation Δt of the tunable lens 21A and the image height offset ΔIH satisfies 1.5 < ΔIH / Δt < 5, and a large image height offset effect can be achieved with a small deformation.
[0306] Example 4
[0307] The following refers to Figure 34 Describe the image resolution enhancement module according to Embodiment 4 of the present application. Figure 34 Fig. shows a cross-sectional schematic diagram of the image resolution enhancement module according to Embodiment 4 of the present application. In Embodiment 4, for simplicity, some descriptions similar to those in Embodiment 3 will be omitted. The image resolution enhancement module of this embodiment is basically the same as the aforementioned Embodiment 3, except that: the beam deflection device 20 is located between the projection lens 12 and the image display device 11, and the light emitted by the image display device 11 passes through the beam deflection device 20 and the projection lens 12 in sequence.
[0308] In this embodiment, as Figure 34 shown, the light emitted by the microdisplay 111 passes through the tunable lens 21A and the projection lens 12 in sequence.
[0309] In one embodiment, when the beam offset device 20 is located between the projection lens 12 and the image display device 11, the following condition can be satisfied: 1 < ΔIH / Δt < 3, where Δt is the thickness deformation amount of the tunable lens 21A, and ΔIH is the image height offset. By satisfying 1 < ΔIH / Δt < 3 and controlling the ratio of the thickness deformation amount Δt of the tunable lens 21A to the image height offset ΔIH, a larger deformation amount corresponds to the same image height offset effect, and higher control accuracy can be obtained.
[0310] In one embodiment, as Figure 34 shown, the projection lens 12 may include a first lens L1, a second lens L2, a third lens L3, and a fourth lens L4 sequentially arranged from the human eye side to the micro display screen side. And in one embodiment, as Figure 34 shown, the projection lens 12 may be provided with a diaphragm STOP, and the diaphragm STOP may be disposed on the human eye side surface of the first lens L1 of the projection lens 12.
[0311] Table 10 shows the basic parameter table of the image resolution improvement module in Embodiment 4, where the units of radius, thickness, and semi-aperture are all millimeters (mm).
[0312] Table 10:
[0313]
[0314]
[0315] Among them, S1 represents the diaphragm STOP, S2 represents the human eye side surface of the first lens L1, S3 represents the micro display screen side surface of the first lens L1, S4 represents the human eye side surface of the second lens L2, S5 represents the micro display screen side surface of the second lens L2, S6 represents the human eye side surface of the third lens L3, S7 represents the micro display screen side surface of the third lens L3, S8 represents the human eye side surface of the fourth lens L4, S9 represents the micro display screen side surface of the fourth lens L4, S10 represents the human eye side surface of the beam offset device 20, S11 represents the micro display screen side surface of the beam offset device 20, and S12 represents the micro display screen 111.
[0316] Table 11 gives the high-order term coefficients A4, A6, A8, A10, A12, A14, and A16 of the aspherical mirror surfaces of the first lens L1 to the fourth lens L4 that can be used in the projection lens 12 in Embodiment 4.
[0317] Table 11:
[0318]
[0319] In Embodiment 4, the diagonal length ld of the microdisplay 111 is 3.23 mm, and the focal length EFL of the projection lens 12 is 5.7 mm. Then ld / EFL = 0.57, which can satisfy: 0.25 < ld / EFL < 3.5. The entrance pupil diameter EPD of the projection lens 12 is 2.59 mm, and the diagonal length ld of the microdisplay 111 is 3.23 mm. Then EPD / ld = 1.25, which can satisfy: 0.3 < ld / EPD < 1.5. The beam deflection device 20 is set to have a deflection angle of 0.05° and a thickness deformation of 0.98 μm. The first transparent plate 211 of the tunable lens 21A can be set to have a single-sided deflection angle θ of 0.05° and a single-sided edge thickness change d2 of 0.98 μm. Then the thickness deformation Δt of the tunable lens 21A is 0.98 μm. Table 12 shows the relevant parameter table of the image height change before and after the deflection of the tunable lens 21A at different field angles in Embodiment 4.
[0320] Table 12:
[0321]
[0322] It can be obtained from Table 12 that when the beam deflection device 20 is located between the projection lens 12 and the image display device 11, the following relationship is satisfied between the thickness deformation Δt of the tunable lens 21A and the image height offset ΔIH: 1 < ΔIH / Δt < 3. For the same image height offset effect, a larger deformation can be obtained, and higher control accuracy can be achieved.
[0323] Example 5
[0324] The following refers to Figure 35 Describe an image resolution improvement module according to Embodiment 5 of the present application. Figure 35 Fig. shows a cross-sectional schematic diagram of the image resolution improvement module according to Embodiment 5 of the present application. In Embodiment 5, for the sake of simplicity, some descriptions similar to those in Embodiment 1 will be omitted. The image resolution improvement module of this embodiment is basically the same as the foregoing Embodiment 1, except that: the beam deflection element 21 is a transparent wedge-shaped lens 21B. The transparent wedge-shaped lens 21B is wedge-shaped. The surfaces on the opposite sides of the transparent wedge-shaped lens 21B are a first plane 214 and an inclined plane 215 respectively. The inclined plane 215 is inclined with respect to the first plane 214. During use, preferably, the inclined plane 215 of the transparent wedge-shaped lens 21B is close to the image display device 11, that is: the inclined plane 215 is located between the first plane 214 and the image display device 11.
[0325] In this embodiment, as Figure 35 shown, the light emitted by the microdisplay 111 passes through the light combining prism 112, the projection lens 12, and the transparent wedge-shaped lens 21B in sequence.
[0326] In an exemplary embodiment, the transparent wedge-shaped lens 21B may be an optical element with an integral transparent wedge-shaped structure, such as an integral transparent wedge-shaped glass plate; the transparent wedge-shaped lens 21B may also be a combination of multiple optical elements. The overall shape of the combination of these multiple optical elements is a wedge-shaped structure, and the relative positions of the individual optical elements are fixed and unchangeable, making the wedge-shaped structure fixed and unchangeable. For example, the transparent wedge-shaped lens 21B may include two transparent flat plates with non-parallel and relatively fixed surfaces. A medium may be provided in the middle of the two transparent flat plates, and the medium may be air, glue, or others. In other embodiments, the transparent wedge-shaped lens 21B may also include multiple transparent wedge-shaped glass plates. The multiple transparent wedge-shaped glass plates form a beam displacement element 21 with an overall wedge shape, or a medium as described above is also provided between the multiple transparent wedge-shaped glass plates. The multiple transparent wedge-shaped glass plates and the medium together form a beam displacement element 21 with an overall wedge shape.
[0327] Example 6
[0328] The following refers to Figure 36 Describe the image resolution enhancement module according to Embodiment 6 of the present application. Figure 36 Fig. shows a cross-sectional schematic diagram of the image resolution enhancement module according to Embodiment 6 of the present application. In Embodiment 6, for the sake of simplicity, some descriptions similar to those in Embodiment 5 will be omitted. The image resolution enhancement module of this embodiment is basically the same as the aforementioned Embodiment 5, except that: the beam displacement device 20 is located between the projection lens 12 and the image display device 11, and the light emitted by the image display device 11 passes through the beam displacement device 20 and the projection lens 12 in sequence.
[0329] In this embodiment, as Figure 36 shown, the light emitted by the micro display screen 111 passes through the light combining prism 112, the transparent wedge-shaped lens 21B, and the projection lens 12 in sequence.
[0330] Example 7
[0331] The following refers to Figure 37 Describe the image resolution enhancement module according to Embodiment 7 of the present application. Figure 37 Fig. shows a cross-sectional schematic diagram of the image resolution enhancement module according to Embodiment 7 of the present application. In Embodiment 7, for the sake of simplicity, some descriptions similar to those in Embodiment 5 will be omitted. The image resolution enhancement module of this embodiment is basically the same as the aforementioned Embodiment 5, except that: the image display device 11 includes a monochromatic micro display screen 111 to output a monochromatic sub-image, or a full-color micro display screen 111 to output a full-color sub-image.
[0332] In this embodiment, as Figure 37As shown, the light emitted by the micro display screen 111 sequentially passes through the projection lens 12 and the transparent wedge lens 21B.
[0333] Example 8
[0334] The following refers to Figure 38 Describe the image resolution improvement module according to Embodiment 8 of the present application. Figure 38 The cross-sectional schematic diagram of the image resolution improvement module according to Embodiment 8 of the present application is shown. In Embodiment 8, for the sake of simplicity, some descriptions similar to those in Embodiment 7 will be omitted. The image resolution improvement module of this embodiment is basically the same as the aforementioned Embodiment 8, and the difference lies in that: the beam offset device 20 is located between the projection lens 12 and the image display device 11, and the light emitted by the image display device 11 sequentially passes through the beam offset device 20 and the projection lens 12.
[0335] In this embodiment, as Figure 38 shown, the light emitted by the micro display screen 111 sequentially passes through the transparent wedge lens 21B and the projection lens 12.
[0336] Example 9
[0337] The following refers to Figure 39 Describe the image resolution improvement module according to Embodiment 9 of the present application. Figure 39 The cross-sectional schematic diagram of the image resolution improvement module according to Embodiment 9 of the present application is shown. In Embodiment 9, for the sake of simplicity, some descriptions similar to those in Embodiments 5, 6, 7, and 8 will be omitted. The image resolution improvement module of this embodiment is basically the same as the aforementioned Embodiments 5, 6, 7, and 8, and the difference lies in that: the beam offset element 21 is a transparent flat lens 21C, the transparent flat lens 21C is in a flat shape, and the surfaces on the opposite sides of the transparent flat lens 21C are the second plane 216 and the third plane 217 respectively, and the second plane 216 and the third plane 217 are parallel to each other.
[0338] In this embodiment, only the image resolution improvement module as Figure 39 is schematically shown, and the light emitted by the micro display screen 111 sequentially passes through the light combining prism 112, the transparent flat lens 21C, and the projection lens 12. The schematic diagrams of other embodiments will not be shown one by one.
[0339] In an exemplary embodiment, the transparent flat lens 21C may be an optical element having an integral transparent flat structure, such as an integral transparent glass plate; the transparent flat lens 21C may also be a combination of multiple optical elements. The shape of the combination of the multiple optical elements is generally a flat structure, and the relative positions of the individual optical elements are fixed and unchangeable, so that the flat structure is fixed and unchangeable. For example, the transparent flat lens 21C may include multiple stacked transparent flats; alternatively, the transparent flat lens 21C may include two transparent flats, the plate surfaces of the two transparent flats are parallel and relatively fixed, and a medium may be provided in the middle of the two transparent flats. The medium may be air, glue, or others.
Claims
1. A beam offset device for an image resolution enhancement module, the image resolution enhancement module comprising an image display device (11) and a projection lens (12), characterized in that, The beam deflection device (20) includes a beam deflection element (21) and a driving device (22). The driving device (22) is configured to drive the beam deflection element (21) to deflect N times within each cycle, so that the beam deflection element (21) sequentially experiences an initial state and N - 1 deflection states within each cycle, such that T low - pixel sub - images displayed by the image display device (11) pass through the beam deflection element (21) and the projection lens (12) and then sequentially output an un - deflected sub - image and N - 1 deflected sub - images to the human eye (40), thereby enabling the human eye (40) to perceive a high - pixel image obtained by fusing and superimposing one un - deflected sub - image and N - 1 deflected sub - images; where N and T are integers, and N≥2, 1≤T≤N.
2. The beam offset device according to claim 1, characterized in that, When the beam deflection element (21) is in a deflected state, the beam deflection element (21) is generally wedge - shaped as a whole.
3. The beam offset device according to claim 2, wherein The beam deflection element (21) is a tunable lens (21A). The tunable lens (21A) includes a first transparent plate (211), a second transparent plate (212), and a compressible medium (213) disposed between the first transparent plate (211) and the second transparent plate (212); the driving device (22) includes at least one control electrode (221) disposed on the first transparent plate (211) and / or the second transparent plate (212), and the control electrode (221) is configured to drive the first transparent plate (211) and / or the second transparent plate (212) to deflect. When the tunable lens (21A) is in an initial state, the first transparent plate (211) and the second transparent plate (212) are parallel to each other, so that the tunable lens (21A) is in a flat - plate shape. When the tunable lens (21A) is in a deflected state, the first transparent plate (211) and / or the second transparent plate (212) deflect and squeeze the compressible medium (213), so that the tunable lens (21A) is in a wedge - shaped.
4. The beam offset device according to claim 3, characterized in that, The refractive index n1 of the first transparent plate (211) and the second transparent plate (212) satisfies: 1.5≤n1≤1.
9. And / or, the refractive index n2 of the compressible medium (213) satisfies: 1.5≤n2≤1.
65. And / or, the PV of the first transparent plate (211) and the second transparent plate (212) satisfies: 1 / 20λ≤PV≤1 / 4λ.
5. The beam offset device according to claim 3, characterized in that, The single - side deflection angle θ of the tunable lens (21A) and the single - side edge thickness change amount d2 satisfy: 0°≤θ≤0.3°, 0μm≤d2≤20μm.
6. The beam offset device according to claim 3, characterized in that, The projection lens (12) is located between the beam deflection device (20) and the image display device (11). The relationship between the thickness deformation amount Δt of the tunable lens (21A) and the image height offset ΔIH satisfies: 1.5 < ΔIH / Δt < 5. Alternatively, the beam offset device (20) is located between the projection lens (12) and the image display device (11), and the relationship between the thickness deformation amount Δt of the tunable lens (21A) and the image height offset ΔIH satisfies: 1 < ΔIH / Δt < 3.
7. The beam offset device according to claim 3, characterized in that, The control electrode (221) is disposed on the surface of the first transparent plate (211) away from the second transparent plate (212) and / or the surface of the second transparent plate (212) away from the first transparent plate (211), and the control electrode (221) is disposed at the edge position of the tunable lens (21A).
8. The beam offset device according to claim 3, characterized in that, The materials of the first transparent plate (211) and the second transparent plate (212) are transparent glass or transparent plastic.
9. The beam offset device according to claim 2, wherein, The beam offset element (21) is a transparent wedge-shaped lens (21B), and the transparent wedge-shaped lens (21B) is wedge-shaped.
10. The beam offset device according to claim 1, characterized in that, The beam offset element (21) is a transparent flat lens (21C), and the transparent flat lens (21C) is flat.
11. The beam offset device according to claim 1, wherein, The thickness d1 of the beam offset device (20) satisfies: 0.1 mm ≤ d1 ≤ 2 mm.
12. The beam offset device according to claim 1, characterized in that, The N satisfies: 2 ≤ N ≤ 9.
13. The beam offset device according to claim 12, characterized in that, N = 2, or N = 4.
14. The beam deflection device according to claim 1, characterized in that, The projection lens (12) is located between the beam offset device (20) and the image display device (11); when the beam offset element (21) is in a deflected state, the beam offset element (21) offsets the image height of the image by 0.2p to 0.8p. Alternatively, the beam offset device (20) is located between the projection lens (12) and the image display device (11); when the beam offset element (21) is in a deflected state, the beam offset element (21) and the projection lens (12) offset the image height of the image by 0.2p to 0.8p.
15. An image resolution enhancement module, characterized in that, It includes an image display device (11), a projection lens (12), and a beam offset device (20) according to any one of claims 1-14; the image display device (11) includes at least one micro display screen (111), and the image display device (11) is configured to receive T low-pixel sub-images obtained by sampling an original high-pixel image by an image processing module (30), where the pixel multiple difference between the original high-pixel image and the low-pixel sub-image is M; the T low-pixel sub-images sequentially displayed by the image display device (11) in each cycle, after passing through the projection lens (12) and the beam offset device (20), sequentially output one non-offset sub-image and N - 1 offset sub-images to the human eye (40), so that the human eye (40) can perceive a high-pixel image obtained by fusing and superimposing one non-offset sub-image and N - 1 offset sub-images; where M, N, and T are integers, and 2 ≤ N ≤ M, 1 ≤ T ≤ N.
16. The image resolution enhancement module according to claim 15, wherein N = M, T = N.
17. The image resolution enhancement module according to claim 15, wherein The projection lens (12) is located between the beam deflection device (20) and the image display device (11), and T low-pixel sub-images output by the image display device (11) in each cycle sequentially pass through the projection lens (12) and the beam deflection device (20); Alternatively, the beam deflection device (20) is located between the projection lens (12) and the image display device (11), and T low-pixel sub-images output by the image display device (11) in each cycle sequentially pass through the beam deflection device (20) and the projection lens (12).
18. The image resolution enhancement module according to claim 15, wherein, The image display device (11) includes a plurality of monochromatic micro display screens (111) and a light-combining prism (112); Alternatively, the image display device (11) includes a single monochromatic micro display screen (111); Alternatively, the image display device (11) includes a single full-color micro display screen (111).
19. The image resolution enhancement module according to claim 15, wherein The diagonal length ld of the micro display screen (111) and the focal length EFL of the projection lens (12) satisfy: 0.25 < ld / EFL < 3.5; And / or, the entrance pupil diameter EPD of the projection lens (12) and the diagonal length ld of the micro display screen (111) satisfy: 0.3 < ld / EPD < 1.5; And / or, the PPD of the image resolution enhancement module, that is, the number of pixels that the human eye (40) can see within every 1° in the field of view angle, satisfies: 10 < PPD.
20. An image resolution improvement method, applied to the image resolution improvement module according to any one of claims 15 to 19, characterized in that, The image resolution enhancement method includes: The image processing module (30) divides the original high-pixel image into a plurality of pixel regions (PA), each pixel region (PA) includes M pixel units, and the M pixel units in each pixel region (PA) are respectively the first pixel unit, the second pixel unit,..., the Xth pixel unit,..., the Mth pixel unit; wherein, the second pixel unit is located in the first direction of the first pixel unit, the third pixel unit is located in the second direction of the first pixel unit,..., the Xth pixel unit is located in the (X - 1)th direction of the first pixel unit,..., the Mth pixel unit is located in the (M - 1)th direction of the first pixel unit; The image processing module (30) extracts and combines all the first pixel units in each pixel region (PA) to form a first low-pixel sub-image, extracts and combines all the second pixel units in each pixel region (PA) to form a second low-pixel sub-image, extracts and combines all the third pixel units in each pixel region (PA) to form a third low-pixel sub-image,..., and so on, extracts and combines all the Xth pixel units in each pixel region (PA) to form an Xth low-pixel sub-image, obtaining T low-pixel sub-images; then the image processing module (30) transmits the T low-pixel sub-images to the image display device (11); The beam deflection element (21) is in an initial state, and the image display device (11) displays a first low-pixel sub-image. After passing through the projection lens (12) and the beam deflection device (20), the first low-pixel sub-image outputs an unshifted sub-image to the human eye (40). Control the driving device (22) to drive the beam deflection element (21) to deflect in the first deflection direction, so that the beam deflection element (21) is in a first deflection state; the image display device (11) displays a second low-pixel sub-image. After passing through the projection lens (12) and the beam deflection device (20), the second low-pixel sub-image outputs a first shifted sub-image to the human eye (40), where the first shifted sub-image is shifted in the first direction compared to the unshifted sub-image; the first shifted sub-image and the unshifted sub-image are fused and superimposed to obtain a first intermediate image. Control the driving device (22) to drive the beam deflection element (21) to deflect in the second deflection direction, so that the beam deflection element (21) is in a second deflection state; the image display device (11) displays a third low-pixel sub-image. After passing through the projection lens (12) and the beam deflection device (20), the third low-pixel sub-image outputs a second shifted sub-image to the human eye (40), where the second shifted sub-image is shifted in the second direction compared to the unshifted sub-image; the second shifted sub-image and the first intermediate image are fused and superimposed to obtain a second intermediate image. … Control the driving device (22) to drive the beam deflection element (21) to deflect in the (N - 1)-th deflection direction, so that the beam deflection element (21) is in the (N - 1)-th deflection state; the image display device (11) displays an X-th low-pixel sub-image. After passing through the projection lens (12) and the beam deflection device (20), the X-th low-pixel sub-image outputs an (N - 1)-th shifted sub-image to the human eye (40), where the (N - 1)-th shifted sub-image is shifted in the (X - 1)-th direction compared to the unshifted sub-image; the (N - 1)-th shifted sub-image and the (N - 2)-th intermediate image are fused and superimposed to obtain a high-pixel image; where the first deflection direction, the second deflection direction,..., the (N - 1)-th deflection direction are different deflection directions respectively. Control the driving device (22) to drive the beam deflection element (21) to deflect, so that the beam deflection element (21) returns from the (N - 1)-th deflection state to the initial state. Where M is the pixel multiple difference between the original high-pixel image and the low-pixel sub-image, 2 ≤ N ≤ M, and T = X = N, and X, M, N, and T are all integers.
21. The image resolution improvement method according to claim 20, wherein, The beam deflection element (21) is a tunable lens (21A), and the tunable lens (21A) includes a first transparent plate (211), a second transparent plate (212), and a compressible medium (213) disposed between the first transparent plate (211) and the second transparent plate (212); the driving device (22) includes at least one control electrode (221) disposed on the first transparent plate (211) and / or the second transparent plate (212), and the control electrode (221) is used to drive the first transparent plate (211) and / or the second transparent plate (212) to deflect; No voltage is applied to each of the control electrodes (221), and the first transparent plate (211) and the second transparent plate (212) are parallel to each other, so that the tunable lens (21A) is in a flat plate shape, and at this time the tunable lens (21A) is in an initial state; The energization state of each of the control electrodes (221) is changed to cause the first transparent plate (211) and / or the second transparent plate (212) to deflect, so that the thickness of one side of the tunable lens (21A) corresponding to the first direction increases, and at this time the beam deflection element (21) is in a first deflection state; The energization state of each of the control electrodes (221) is changed to cause the first transparent plate (211) and / or the second transparent plate (212) to deflect, so that the thickness of one side of the tunable lens (21A) corresponding to the second direction increases, and at this time the beam deflection element (21) is in a second deflection state; … The energization state of each of the control electrodes (221) is changed to cause the first transparent plate (211) and / or the second transparent plate (212) to deflect, so that the thickness of one side of the tunable lens (21A) corresponding to the X-1 direction increases, and at this time the beam deflection element (21) is in an N-1 deflection state; The voltage applied to the control electrode (221) is removed, so that the beam deflection element (21) returns from the N-1 deflection state to the initial state.
22. An image resolution improvement method, applied to the image resolution improvement module according to any one of claims 15 to 19, characterized in that, The image resolution improvement method includes: The image processing module (30) divides the original high-pixel image into a plurality of pixel regions (PA), each pixel region (PA) includes M pixel units, and the M pixel units in each pixel region (PA) are respectively a first pixel unit, a second pixel unit,..., an Xth pixel unit,..., an Mth pixel unit; wherein, the second pixel unit is located in the first direction of the first pixel unit, the third pixel unit is located in the second direction of the first pixel unit,..., the Xth pixel unit is located in the X-1 direction of the first pixel unit,..., and the Mth pixel unit is located in the M-1 direction of the first pixel unit; The image processing module (30) extracts and combines all the first pixel units in each of the pixel regions (PA) to form a low-pixel sub-image, and then the image processing module (30) transmits the low-pixel sub-image to the image display device (11); The beam deflection element (21) is in an initial state, the image display device (11) displays the low-pixel sub-image, and the low-pixel sub-image outputs an unshifted sub-image to the human eye (40) after passing through the projection lens (12) and the beam deflection device (20); Control the driving device (22) to drive the beam deflection element (21) to deflect in the first deflection direction, so that the beam deflection element (21) is in the first deflection state; the image display device (11) displays the low-pixel sub-image, and the low-pixel sub-image outputs the first shifted sub-image to the human eye (40) after passing through the projection lens (12) and the beam deflection device (20), wherein the first shifted sub-image is shifted in the first direction compared with the unshifted sub-image; the first shifted sub-image and the unshifted sub-image are fused and superimposed to obtain a first intermediate image; Control the driving device (22) to drive the beam deflection element (21) to deflect in the second deflection direction, so that the beam deflection element (21) is in the second deflection state; the image display device (11) displays the low-pixel sub-image, and the low-pixel sub-image outputs the second shifted sub-image to the human eye (40) after passing through the projection lens (12) and the beam deflection device (20), wherein the second shifted sub-image is shifted in the second direction compared with the unshifted sub-image; the second shifted sub-image and the first intermediate image are fused and superimposed to obtain a second intermediate image; … Control the driving device (22) to drive the beam deflection element (21) to deflect in the (N - 1)th deflection direction, so that the beam deflection element (21) is in the (N - 1)th deflection state; the image display device (11) displays the low-pixel sub-image, and the low-pixel sub-image outputs the (N - 1)th shifted sub-image to the human eye (40) after passing through the projection lens (12) and the beam deflection device (20), wherein the (N - 1)th shifted sub-image is shifted in the (X - 1)th direction compared with the unshifted sub-image; the (N - 1)th shifted sub-image and the (N - 2)th intermediate image are fused and superimposed to obtain a high-pixel image; wherein, the first deflection direction, the second deflection direction,..., the (N - 1)th deflection direction are different deflection directions respectively; Control the driving device (22) to drive the beam deflection element (21) to deflect, so that the beam deflection element (21) returns from the (N - 1)th deflection state to the initial state; Wherein, M is the pixel multiple difference between the original high-pixel image and the low-pixel sub-image, 2 ≤ N ≤ M, and X = N, and X, M, and N are all integers.
23. A near-eye display device, characterized in that, Comprising an image resolution enhancement module and a power supply unit as described in any one of claims 15 to 19, the power supply unit being electrically connected to the image display device (11) and the light beam deflection device (20) in the image resolution enhancement module respectively.