Image correction method and display module

Abstract

An image correction method includes providing a left eye image and a right eye image; providing a left eye gazing position and a right eye gazing position; eliminating the distorted left-eye image according to the left-eye gazing position and eliminating the distorted right-eye image according to the right-eye gazing position to obtain a distortionless left-eye image and a distortionless right-eye image; performing brightness correction on the distortionless left eye image according to the left eye gazing position and performing brightness correction on the distortionless right eye image according to the right eye gazing position; and performing three-dimensional rendering on the distortionless left-eye image and the distortionless right-eye image to obtain a three-dimensional left-eye image and a three-dimensional right-eye image.

Description

Technical Field

[0001] The present disclosure relates to an image correction method and a display module. Background Art

[0002] In the field of automotive displays, head-up display (HUD) plays an important role. Due to the large viewing angle and magnification of general augmented reality head-up display, it is easy to have problems such as the inability to merge the influence of both eyes, the easy penetration of sunlight, and the overall size being too large.

[0003] The general solution to this problem is to use a 3D head-up display (3D HUD) to adjust the distance of the 3D image to achieve the magnification scaling, so the overall projection lens base volume can be reduced. However, the 3D head-up display image will be distorted (warping), and because the cylindrical lens array of the 3D head-up display may not be designed together with the projection lens group, the brightness felt by the left and right eyes may be different, causing dizziness. Summary of the invention

[0004] A technical aspect of the present disclosure is an image correction method.

[0005] According to one embodiment of the present disclosure, an image correction method includes providing a left eye image and a right eye image; providing a left eye gaze position and a right eye gaze position; eliminating the distorted left eye image according to the left eye gaze position and eliminating the distorted right eye image according to the right eye gaze position to obtain a non-distorted left eye image and a non-distorted right eye image; performing brightness correction on the non-distorted left eye image according to the left eye gaze position and performing brightness correction on the non-distorted right eye image according to the right eye gaze position; and performing stereoscopic rendering on the non-distorted left eye image and the non-distorted right eye image to obtain a stereoscopic left eye image and a stereoscopic right eye image.

[0006] In one embodiment of the present disclosure, the distortion of the left eye image is eliminated according to the left eye gaze position to meet

[0007] u′(u,v,x,y)=p u00 +p u10 u+p u01 v+p u20 u 2 +p v11 uv+p u02 v 2

[0008] v′(u,v,x,y)=p v00 +p v10 u+p v01 v+p v20 u 2 +pv11 uv+p v02 v 2

[0009]

[0010] Where (u, v) is the coordinate of the left eye image, (u', v') is the coordinate of the undistorted left eye image, (x, y) is the coordinate of the left eye gaze position, and po(no) is the polynomial coefficient.

[0011] In one embodiment of the present disclosure, the image correction method further includes providing an image; and dividing the image into a left-eye image and a right-eye image.

[0012] In one embodiment of the present disclosure, providing the left eye gaze position and the right eye gaze position is performed using an eye tracking camera.

[0013] In one embodiment of the present disclosure, the image correction method further includes displaying the stereo left-eye image and the stereo right-eye image from a display module.

[0014] In one embodiment of the present disclosure, the display module has a lenticular lens array, and the lenticular lens array is configured to separate a 3D left-eye image and a 3D right-eye image.

[0015] Another technical aspect of the present disclosure is a display module.

[0016] According to one embodiment of the present disclosure, a display module includes an image generation unit, a reflection unit, and an eye tracking camera. The image generation unit includes a display, a cylindrical lens array, and a computing unit. The cylindrical lens array is located on the display. The computing unit is electrically connected to the display. The reflection unit is located on the image generation unit. The eye tracking camera is located between the image generation unit and the reflection unit, electrically connected to the computing unit, and configured to provide a left eye gaze position and a right eye gaze position, wherein the computing unit is configured to eliminate a distorted left eye image according to the left eye gaze position and eliminate a distorted right eye image according to the right eye gaze position, so as to obtain a non-distorted left eye image and a non-distorted right eye image.

[0017] In one embodiment of the present disclosure, the distortion of the left eye image is eliminated according to the left eye gaze position to meet

[0018] u′(u,v,x,y)=p u00 +p u10 u+p u01 v+p u20 u 2 +p v11 uv+p u02 v 2

[0019] v′(u,v,x,y)=pv00 +p v10 u+p v01 v+p v20 u 2 +p v11 uv+p v02 v 2

[0020]

[0021] Where (u, v) is the coordinate of the left eye image, (u', v') is the coordinate of the undistorted left eye image, (x, y) is the coordinate of the left eye gaze position, and po(no) is the polynomial coefficient.

[0022] In one embodiment of the present disclosure, the display module further comprises a projection lens set. The projection lens set is located above the display.

[0023] In one embodiment of the present disclosure, the display module further includes a lighting module. The lighting module is located below the display.

[0024] In the above-mentioned embodiment of the present disclosure, since the distorted left eye image is eliminated according to the left eye gaze position and the distorted right eye image is eliminated according to the right eye gaze position, and brightness correction is performed according to the left eye gaze position and the right eye gaze position, the brightness imbalance caused by the different gaze positions of the left and right eyes can be corrected, and the distortion elimination parameters can also be corrected in real time according to the current gaze positions of the left and right eyes, so that the display module can achieve a better display effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] When read together with the accompanying drawings, the aspects of the present disclosure can be best understood from the following embodiments. Note that according to standard practice in this industry, various features are not drawn to scale. In fact, the size of various features may be arbitrarily increased or reduced for clarity of discussion.

[0026] Figure 1 A schematic diagram of a display module according to an embodiment of the present disclosure is shown.

[0027] Figure 2 Draw Figure 1 A partial enlarged view of the display and the cylindrical lens array.

[0028] Figure 3 A flow chart of an image correction method according to an embodiment of the present disclosure is shown.

[0029] Figure 4 and Figure 5 Draw Figure 3 Schematic diagram of the image correction method in the intermediate process.

[0030] Figure 6A schematic diagram is shown of a method for eliminating distortion.

[0031] Figure 7 and Figure 8 Draw Figure 3 Schematic diagram of the image correction method in the intermediate process.

[0032] Wherein, the reference numerals are:

[0033] 100: Display module

[0034] 110: Image generation unit

[0035] 112: Display

[0036] 113: cylindrical lens array

[0037] 114: Computing Unit

[0038] 116: Projection lens set

[0039] 118: Lighting module

[0040] 120: Reflection unit

[0041] 130:Eye tracking camera

[0042] 200: Image

[0043] 210: Left eye image

[0044] 220: Right eye image

[0045] 230: No distortion left eye image

[0046] 240: No distortion right eye image

[0047] 250: Stereoscopic Image

[0048] 260: Depth Image

[0049] I: Image

[0050] O: Observer

[0051] S1, S2, S3, S4, S5: Steps

[0052] Page 4 of 4 (Invention Description) DETAILED DESCRIPTION

[0053] The following disclosed embodiments provide many different embodiments, or examples, for implementing the different features of the provided objectives. Specific examples of components and arrangements are described below to simplify the present invention. Of course, these examples are only examples and are not intended to be limiting. In addition, the present invention may repeat component symbols and / or letters in each example. This repetition is for the purpose of simplicity and clarity, and does not itself specify the relationship between the various embodiments and / or configurations discussed.

[0054] Spatially relative terms such as "below," "beneath," "lower," "above," "upper," and the like may be used herein for descriptive purposes to describe the relationship of one component or feature to another component or feature as illustrated in the accompanying drawings. The spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation illustrated in the accompanying drawings. The device may be otherwise oriented (rotated 90 degrees or at other orientations) and the spatially relative descriptors used herein should be interpreted accordingly.

[0055] Figure 1 A schematic diagram of a display module 100 according to an embodiment of the present disclosure is shown. Figure 2 Draw Figure 1 A partial enlarged view of the display 112 and the cylindrical lens array 113. Figure 1 and Figure 2 A display module 100 includes an image generating unit 110, a reflecting unit 120, and an eye tracking camera 130. The image generating unit 110 includes a display 112, a cylindrical lens array 113, and a computing unit 114. The cylindrical lens array 113 is located on the display 112. The computing unit 114 is electrically connected to the display. The reflecting unit 120 is located on the image generating unit 110. The eye tracking camera 130 is located between the image generating unit 110 and the reflecting unit 120, electrically connected to the computing unit 114, and configured to provide a left eye gaze position and a right eye gaze position. In this embodiment, the display module 100 further includes a projection lens group 116 and an illumination module 118. The projection lens group 116 is located above the display 112. The illumination module 118 is located below the display 112. In some embodiments, the display module 100 can be a vehicle-mounted head-up display, a stereoscopic display, etc., but the present disclosure is not limited thereto.

[0056] Specifically, the eye tracking camera 130 is configured to provide the left eye gaze position and the right eye gaze position for the calculation unit 114 to calculate and process the image. In some embodiments, the above-mentioned image processing includes eliminating distortion, stereo rendering, brightness correction, etc., but the present disclosure is not limited to this. The processed image is then projected to the observer O through the display 112, so that the observer can see the image I with different depths in front of the reflective unit. Figure 1In the figure, only three images I with different depths are shown, but more or fewer images I can be formed in actual application.

[0057] Figure 3 A flow chart of an image correction method according to an embodiment of the present disclosure is shown. Figure 3 , an image correction method comprises the following steps: first, in step S1, a left eye image and a right eye image are provided. Then, in step S2, a left eye gaze position and a right eye gaze position are provided. Then, in step S3, the distorted left eye image is eliminated according to the left eye gaze position and the distorted right eye image is eliminated according to the right eye gaze position to obtain a non-distorted left eye image and a non-distorted right eye image, then, in step S4, brightness correction is performed on the non-distorted left eye image according to the left eye gaze position and brightness correction is performed on the non-distorted right eye image according to the right eye gaze position. And finally, in step S5, stereo rendering is performed on the non-distorted left eye image and the non-distorted right eye image to obtain a stereo left eye image and a stereo right eye image.

[0058] In some embodiments, the image correction method is not limited to the above steps S1 to S5. For example, in some embodiments, other steps may be further included between two steps, or other steps may be further included before step S1, and other steps may be further included after step S5. In the following description, at least the above steps will be described.

[0059] Figure 4 and Figure 5 Draw Figure 3 Schematic diagram of the image correction method in the middle process. Figure 4 First, the calculation unit 114 (refer to Figure 1 ) will provide a complete image 200, the left and right sides of this image will have the same information, so it will be cut once to become a left eye image 210 and a right eye image 220. At this time, all objects on the left eye image 210 and the right eye image 220 are at the same depth, that is, they are still flat images without depth difference.

[0060] Figure 6 A schematic diagram showing a method for eliminating distortion is shown. Figure 5 and Figure 6 Then, the left eye image 210 and the right eye image 220 are subjected to a de-distortion algorithm. This step includes using the eye tracking camera 130 (refer to Figure 1 ) provides the left eye gaze position and the right eye gaze position. The eye tracking camera 130 finds the gaze coordinates of the left eye and the right eye in the entire eye box (the gaze coordinates of the left eye are expressed as (x, y)) and feeds them back to the calculation unit 114. The distortion-free left eye image 210 satisfies the following formula 1 according to the left eye gaze position (x, y):

[0061] u′(u,v,x,y)=p u00 +p u10 u+p u01 v+p u20 u 2 +p v11 uv+p u02 v 2

[0062] v′(u,v,x,y)=p v00 +p v10 u+p v01 v+p v20 u 2 +p v11 uv+p v02 v 2

[0063]

[0064] Where (u,v) is the coordinate of the left eye image, (u',v') is the coordinate of the undistorted left eye image, (x,y) is the coordinate of the left eye gaze position, and po(no) is the polynomial coefficient. In formula 1, m, n, and o are natural numbers. For example, when m is equal to 4, one of the coefficients pv00 in formula 1 can be expressed as formula 2:

[0065] p v00 =p 00 +p 10 x+p 01 y+p 20 x 2 +p 11 xy+p 02 y 2 +p 30 x 3 +p 21 x 2 y+p 12 xy 2 +p 03 y 3 +p 40 x 4 +p 31 x 3 y+p 22 x 2 y 2 +p 13 xy 3 +p 04 y 4 ...Formula 2

[0066] That is, in some embodiments, the coordinates of the undistorted left eye image are related to the fourth power of the coordinates of the left eye gaze position, but the present disclosure is not limited thereto. In some embodiments, instead of using a polynomial algorithm, multiple sets of look-up tables (LUTs) are established in the eye box, and interpolation is used to find the distortion-eliminating data of the required gaze point.

[0067] Reference Figure 5 Then, the brightness of the distortion-free left eye image is corrected according to the left eye gaze position, and the brightness of the distortion-free right eye image is corrected according to the right eye gaze position. This step will first record the individual brightness of the left and right eye gaze positions, and then perform brightness correction on the distortion-free left eye image and the distortion-free right eye image respectively, so that the final output image can have the same brightness and will not cause dizziness.

[0068] Figure 7 and Figure 8 Draw Figure 3 Schematic diagram of the image correction method in the middle process. Figure 7 Then, the distortion-free left-eye image 230 and the distortion-free right-eye image 240 are subjected to stereoscopic rendering to obtain a stereoscopic left-eye image and a stereoscopic right-eye image. Figure 7 In FIG. 2 , the stereoscopic left-eye image and the stereoscopic right-eye image are shown as a superimposed stereoscopic image 250 .

[0069] Reference Figure 8 Then, the stereo left eye image and the stereo right eye image are displayed from the display module 100 (refer to Figure 1 ) display. The display module 100 has a cylindrical lens array 113, and the cylindrical lens array 113 is configured to separate the stereo left eye image and the stereo right eye image. After the stereo left eye image and the stereo right eye image are separated, what the observer O sees is a depth image 260 in which each object has a different depth.

[0070] The foregoing summarizes the features of several embodiments so that those skilled in the art can better understand the aspects of the present disclosure. Those skilled in the art will appreciate that they can easily use the present disclosure as a basis for designing or modifying other processes and structures to achieve the same purposes and / or achieve the same advantages as the embodiments described herein. Those skilled in the art will also appreciate that such equivalent constructions do not depart from the spirit and scope of the present disclosure, and that they may make various changes, substitutions, and modifications herein without departing from the spirit and scope of the present disclosure.

Claims

1. An image correction method, characterized in that: Include: Providing a left-eye image and a right-eye image; Providing a left eye gaze position and a right eye gaze position; De-distorting the left eye image according to the left eye gaze position and de-distorting the right eye image according to the right eye gaze position to obtain a distortion-free left eye image and a distortion-free right eye image; Performing brightness correction on the undistorted left-eye image according to the left-eye gaze position and performing brightness correction on the undistorted right-eye image according to the right-eye gaze position; and The distortion-free left-eye image and the distortion-free right-eye image are subjected to stereoscopic rendering to obtain a stereoscopic left-eye image and a stereoscopic right-eye image.

2. The image correction method according to claim 1, wherein: According to the left eye gaze position, the distortion of the left eye image is eliminated and the left eye image satisfies u′(u,v,x,y)=p u00 +p u10 u+p u01 v+p u20 u 2 +p v11 uv+p u02 v 2 v′(u,v,x,y)=p v00 +p v10 u+p v01 v+p v20 u 2 +p v11 uv+p v02 v 2 Wherein (u, v) is the coordinate of the left eye image, (u', v') is the coordinate of the undistorted left eye image, (x, y) is the coordinate of the left eye gaze position, and po(no) is the polynomial coefficient.

3. The image correction method according to claim 1, wherein: Also includes: providing an image; and The image is divided into the left-eye image and the right-eye image.

4. The image correction method according to claim 1, wherein: Providing the left eye gaze position and the right eye gaze position is performed using an eye tracking camera.

5. The image correction method according to claim 1, wherein: Also includes: The 3D left-eye image and the 3D right-eye image are displayed from a display module.

6. The image correction method according to claim 5, characterized in that: The display module has a cylindrical lens array, and the cylindrical lens array is configured to separate the stereo left-eye image and the stereo right-eye image.

7. A display module, characterized in that: Include: An image generation unit, comprising: a display; a lenticular lens array located on the display; and a computing unit electrically connected to the display; a reflection unit, located on the image generating unit; as well as An eye tracking camera is located between the image generating unit and the reflecting unit, electrically connected to the computing unit, and configured to provide a left eye gaze position and a right eye gaze position, wherein the computing unit is configured to eliminate the distortion of a left eye image according to the left eye gaze position and eliminate the distortion of a right eye image according to the right eye gaze position to obtain a distortion-free left eye image and a distortion-free right eye image.

8. The display module according to claim 7, wherein: According to the left eye gaze position, the distortion of the left eye image is eliminated and the left eye image satisfies u′(u,v,x,y)=p u00 +p u10 u+p u01 v+p u20 u 2 +p v11 uv+p u02 v 2 v′(u,v,x,y)=p v00 +p v10 u+p v01 v+p v20 u 2 +p v11 uv+p v02 v 2 Wherein (u, v) is the coordinate of the left eye image, (u', v') is the coordinate of the undistorted left eye image, (x, y) is the coordinate of the left eye gaze position, and po(no) is the polynomial coefficient.

9. The display module according to claim 7, wherein: Also includes: A projection lens assembly is located above the display.

10. The display module according to claim 7, wherein: Also includes: A lighting module is located below the display.

Images