Stereoscopic display device and display method thereof

Abstract

The present invention provides a stereoscopic display device and a display method thereof. The stereoscopic display device includes a display panel, a lens array, an image sensor, and a processing circuit. The display panel displays a three-dimensional image. The lens array is configured on a transmission path of the three-dimensional image. The image sensor acquires a sensed image of a viewing field of the display panel. The processing circuit is coupled to the lens array and the image sensor. The processing circuit calculates the actual position of a user's human eye in the viewing field based on the reference coordinates of the reference position in the sensed image and the coordinates of the user's human eye in the sensed image. The processing circuit adjusts the liquid crystal rotation angle of the lens array based on the actual position of the human eye, so that the viewing position of the three-dimensional image matches the actual position of the human eye.

Description

Technical Field

[0001] The present invention relates to a stereoscopic display device, and in particular to a stereoscopic display device capable of adjusting the rotation angle of a lens and a display method thereof. Background Art

[0002] Today's 3D display technology can be divided into glasses-type 3D display technology, in which the observer needs to wear specially designed glasses, and naked-eye 3D display technology, which can be viewed directly with the naked eye. In naked-eye 3D display technology, it can be divided into parallax barriers, lenticular lenses, and directional backlight. Among them, the lenticular lens 3D imaging method is to set a series of straight cylindrical convex lens films in front of the display screen. The light can change its direction when passing through the lenticular lens. The left eye image and the right eye image are arranged in a vertical manner in accordance with the position of the lenticular lens. Through lens refraction, the user's left and right eyes see the corresponding left eye image and right eye image to produce parallax, thereby presenting a 3D effect.

[0003] However, generally, cylindrical lenses are arranged in a single direction and fixedly attached to the surface of the display screen, or liquid crystal is injected into the cylindrical lenses to control the refraction angle of the lens. However, at most, the refraction can only be adjusted in the horizontal direction according to the horizontal position of the user. Therefore, when the display screen has too large an inclination angle for the user, or the vertical viewing angle of the user viewing the display screen is too large due to the user's height, sitting posture or other factors, the three-dimensional presentation effect of the displayed image may be greatly reduced, and there may even be a visual deviation of the three-dimensional image or the three-dimensional sense cannot be formed, thereby affecting the user experience. Summary of the invention

[0004] In view of this, the present invention provides a stereoscopic display device and a display method thereof, which can dynamically adjust the liquid crystal rotation angle of the lens array according to the actual position of the human eye to maintain the presentation effect of the stereoscopic image.

[0005] In one embodiment of the present invention, the stereoscopic display device includes a display panel, a lens array, an image sensor, and a processing circuit. The display panel is used to display a three-dimensional image. The lens array is configured on the transmission path of the three-dimensional image. The image sensor is used to obtain a sensed image for the viewing field of the display panel. The processing circuit is coupled to the lens array and the image sensor. The processing circuit calculates the actual position of the user's human eye in the viewing field based on the reference coordinates of the reference position in the sensed image and the coordinates of the user's human eye in the sensed image. The processing circuit adjusts the liquid crystal rotation angle of the lens array based on the actual position of the human eye so that the viewing position of the three-dimensional image matches the actual position of the human eye.

[0006] In one embodiment according to the present invention, the display method of the stereoscopic display device includes: displaying a three-dimensional image through a display panel of the stereoscopic display device; configuring a lens array of the stereoscopic display device on a transmission path of the three-dimensional image; acquiring a sensed image of a viewing field of the display panel through an image sensor of the stereoscopic display device; calculating the actual position of a user's eyes in the viewing field based on reference coordinates of a reference position in the sensed image and the coordinates of the user's eyes in the sensed image through a processing circuit of the stereoscopic display device; and adjusting the liquid crystal rotation angle of the lens array based on the actual position of the human eye through the processing circuit, so that the viewing position of the three-dimensional image matches the actual position of the human eye.

[0007] Based on the above, the stereoscopic display device and display method described in the embodiments of the present invention can obtain a sensed image of the viewing field of the display panel through an image sensor, and calculate the actual position of the user's human eye in the viewing field according to the reference coordinates and the human eye coordinates in the sensed image through a processing circuit, so as to adjust the liquid crystal rotation angle of the lens array according to the actual position of the human eye. In this way, the viewing position of the three-dimensional image displayed by the display panel can be made to match the actual position of the human eye, so as to maintain the presentation effect of the stereoscopic image, thereby optimizing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The accompanying drawings are included to provide a further understanding of the present invention and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the present invention and together with the description serve to explain the principles of the present invention.

[0009] Figure 1 is a schematic diagram of a usage scenario of a stereoscopic display device according to an embodiment of the present invention;

[0010] Figure 2 is a schematic diagram of a circuit block of a stereoscopic display device according to an embodiment of the present invention;

[0011] Figure 3 is a flow chart of a display method of a stereoscopic display device according to an embodiment of the present invention;

[0012] Figure 4 is a schematic diagram of a sensing scenario of a stereoscopic display device according to an embodiment of the present invention;

[0013] Figure 5 According to an embodiment of the present invention, Figure 4 yz plane schematic diagram of the sensing situation shown;

[0014] Figure 6 According to an embodiment of the present invention, Figure 1 and Figure 2A schematic diagram of a local optical path of the stereoscopic display device shown;

[0015] Figure 7 is a schematic diagram of the hardware architecture of a stereoscopic display device according to another embodiment of the present invention;

[0016] Figure 8 It is a partial structural schematic diagram of a stereoscopic display device according to an embodiment of the present invention.

[0017] Description of Reference Numerals

[0018] 100, 200: Stereoscopic display equipment

[0019] 110: Display panel

[0020] 120, 121, 122: Lens array

[0021] 130: Image sensor

[0022] 140: Processing circuit

[0023] 141: Memory

[0024] 142: Processor

[0025] 143: Analog-to-digital conversion circuit

[0026] 144: Timing controller

[0027] 145: Scaling Circuit

[0028] 150: Backlight module

[0029] C 0 : Origin coordinates

[0030] C G :Human eye position

[0031] C S : Reference position

[0032] d: distance

[0033] DP: Display Pixels

[0034] Eye L : Left eye coordinates

[0035] Eye R : Right eye coordinates

[0036] FD: Watching Field

[0037] fv: imaging distance

[0038] GS1, GS2: Glass substrate

[0039] I1: 3D images

[0040] I2: Sensing images

[0041] IM1: Left disparity image

[0042] IM2: Right disparity image

[0043] LC: Liquid Crystal Layer

[0044] PC: Polarized coating

[0045] S210~S250: Steps

[0046] SLC: Switching Liquid Crystal Layer

[0047] t: compensation vector

[0048] u, v, x, y, z: coordinate axes

[0049] u G 、v G 、u S 、v S 、x E ,y E 、z E 、x F ,y F 、z F :coordinate

[0050] VC: Voltage

[0051] VP: Imaging Plane

[0052] X E : Actual position of human eyes

[0053] X EyeL : Left eye

[0054] X EyeR : Right eye

[0055] X F : Default viewing position DETAILED DESCRIPTION

[0056] Reference will now be made in detail to exemplary embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Whenever possible, the same reference numerals are used in the drawings and the description to refer to the same or like parts.

[0057] The term "coupled (or connected)" used in the entire specification of this case (including the claims) may refer to any direct or indirect means of connection. For example, if the text describes a first device coupled (or connected) to a second device, it should be interpreted that the first device can be directly connected to the second device, or the first device can be indirectly connected to the second device through other devices or some connection means. The terms "first", "second", etc. mentioned in the entire specification of this case (including the claims) are used to name the components, or to distinguish different embodiments or scopes, and are not used to limit the upper or lower limits of the number of components, nor to limit the order of components. In addition, wherever possible, components / components / steps with the same number in the drawings and embodiments represent the same or similar parts. Components / components / steps using the same number or the same terminology in different embodiments can refer to the relevant descriptions of each other.

[0058] Figure 1 is a schematic diagram of a usage scenario of a stereoscopic display device 100 according to an embodiment of the present invention. Figure 2 FIG. 1 is a schematic diagram of a circuit block of a stereoscopic display device 100 according to an embodiment of the present invention. Figure 1 and Figure 2 .At Figure 1 and Figure 2 In the illustrated embodiment, the stereoscopic display device 100 includes a display panel 110, a lens array 120, an image sensor 130, and a processing circuit 140. The processing circuit 140 is coupled to the lens array 120 and the image sensor 130. According to actual applications, the type of the display panel 110 can be a liquid crystal display (LCD), a light emitting diode (LED) display, a field emission display (FED), an organic light emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) display, a flexible display (FlexibleDisplay), a transparent light emitting diode display (Transparent Light Emitted Diode Display), or other display units that provide display functions.

[0059] The display panel 110 can display a three-dimensional image I1 to the viewing field FD. The lens array 120 is disposed on the transmission path of the three-dimensional image I1. In some embodiments, the lens array 120 can directly contact or be attached to the display panel 110 to simplify the process or optimize the optical effect, which is not limited in this embodiment.

[0060] According to the design requirements, the related functions of the processing circuit 140 can be implemented as hardware using hardware description languages ​​(such as Verilog HDL or VHDL) or other suitable programming languages. For example, the related functions of the processing circuit 140 can be implemented in various logic blocks, modules and circuits in one or more microcontrollers, microprocessors, application-specific integrated circuits (ASICs), digital signal processors (DSPs), field programmable gate arrays (FPGAs) and / or other processing units. In terms of software and / or firmware, the related functions of the processing circuit 140 can be implemented as programming codes. For example, it can be implemented using general programming languages ​​(such as C, C++ or assembly language) or other suitable programming languages. The programming code may be recorded / stored in a "non-transitory computer readable medium", such as a read-only memory (ROM), a tape, a disk, a card, a semiconductor memory, a programmable logic circuit and / or a storage device. A central processing unit (CPU), a microcontroller or a microprocessor may read and execute the programming code from the non-transitory computer readable medium to achieve related functions.

[0061] Figure 3 It is a flowchart of a display method of a stereoscopic display device according to an embodiment of the present invention. Figure 1 and Figure 2 The stereoscopic display device 100 shown can refer to Figure 3 Please also refer to Figure 1 , Figure 2 and Figure 3In step S210, the display panel 110 may display the three-dimensional image I1 to project the three-dimensional image I1 to the viewing field FD. In step S220, the lens array 120 of the stereoscopic display device 100 may be arranged on the transmission path of the three-dimensional image I1.

[0062] In detail, Figure 1 The viewing field FD shown includes the default viewing position X F And the actual position of the user's eyes X E , the actual position of the human eye X E May be the same or different from the default viewing position X F It is worth mentioning that, in this embodiment, each lens in the lens array 120 is injected with liquid crystal, wherein the rotation angle of the liquid crystal can be controlled to change the focusing characteristics of the lens, thereby changing the refraction angle of the light passing through the lens. In this embodiment, assuming that the rotation angle of the liquid crystal of the lens array 120 is a preset initial angle, the viewing position (ideal position) of the three-dimensional image I1 displayed by the display panel 110 is the default viewing position X in the viewing field FD. F According to the actual design, in some embodiments, the default viewing position X F It may be located on the normal vector at the center of the display panel 110 , but is not limited thereto in other embodiments.

[0063] In step S230, the image sensor 130 may acquire a sensed image I2 for the viewing field FD of the display panel 110, and transmit the sensed image I2 to the processing circuit 140. In step S240, the processing circuit 140 may identify the sensed image I2 to obtain the eye coordinates of the user in the sensed image I2. F Corresponding to the reference position in the sensed image I2. In this embodiment, it is assumed that the reference position in the sensed image I2 includes the central position of the sensed image I2. However, in other embodiments, the reference position may be other positions in the sensed image I2. Based on the reference coordinates of the reference position in the sensed image I2 and the eye coordinates of the user in the sensed image I2, the processing circuit 140 may calculate the actual eye position X of the user in the viewing field FD. E (Step S240).

[0064] For example, Figure 4 FIG. 1 is a schematic diagram of a sensing scenario of a stereoscopic display device 100 according to an embodiment of the present invention. Figure 4 In the illustrated embodiment, it is assumed that in the xyz three-dimensional space of the viewing field FD, the image sensor 130 is used as a reference, the sensing direction of the image sensor 130 toward the user is defined as the z-axis, and the x-axis, y-axis and z-axis are perpendicular to each other.F The xyz three-dimensional coordinates can be expressed as (x F ,y F ,z F ), the actual eye position X of the user in the viewing field FD E The xyz three-dimensional coordinates can be expressed as (x E ,y E ,z E ).

[0065] In this embodiment, the sensing image I2 acquired by the image sensor 130 for the viewing field FD may correspond to the virtual imaging plane VP where the focal length of the image sensor 130 is located. The image sensor 130 senses the actual position X of the human eye in the viewing field FD. E The image plane VP (the image plane I2) is a 2D plane uv formed by the u axis and the v axis. The eye position C in the image plane VP (the image plane I2) is G Corresponding to the actual position X of the human eye in the viewing field FD E , and the reference position C in the imaging plane VP (sensing image I2) S Corresponding to the default viewing position X in the viewing field FD F On the imaging plane VP, with the origin coordinate C 0 (0,0) is the reference position C S The coordinates of the reference coordinates (u S ,v S ), and the eye position C G The coordinates of are the eye coordinates (u G ,v G ).exist Figure 4 In the illustrated embodiment, the x-axis of the viewing field FD is parallel to the u-axis of the imaging plane VP, and the y-axis of the viewing field FD is parallel to the v-axis of the imaging plane VP. F When the default viewing position or the known position is set in advance, the processing circuit 140 may sense the reference position C in the image I2. S The reference coordinates (u S ,v S ) and the eye position C G The eye coordinates (u G ,v G ) to calculate the actual eye position X of the user in the viewing field FD E .

[0066] For example, Figure 5 According to an embodiment of the present invention, Figure 4 Schematic diagram of the yz plane of the sensing situation shown. Please also refer to Figure 4 and Figure 5 .At Figure 5 In the embodiment shown, it is assumed that the user in the viewing field FD (ie, the actual position of the human eye X E ) (depth information from the display panel 110 to the human eye) E Equal to the default viewing position X F The z-axis coordinate (display panel 110 to the default viewing position X F Depth information)z F .exist Figure 5 In the embodiment shown, the image sensor 130 is used as a reference, and the default viewing position X F The yz two-dimensional coordinates can be expressed as (y F ,z F ), the actual position of the human eye X E The yz two-dimensional coordinates can be expressed as (0, z F ), and the default viewing position X F The actual position of the human eye X E The relative distance on the y-axis is y F Thus, in this embodiment, the reference position C in the imaging plane VP S The reference coordinates (u S ,v S ) and human eye position C G The eye coordinates (u G ,v G ) can be expressed as follows:

[0067]

[0068]

[0069]

[0070] Where, d represents the reference position C in the imaging plane VP S With human eye position C G The relative distance on the v axis (y axis variable). fv ​​represents the imaging distance between the display panel 110 (image sensor 130) and the imaging plane VP corresponding to the sensed image I2, that is, the distance between the image sensor 130 and the human eye position C G The relative distance on the z-axis (z-axis variable). Δx represents the actual position of the human eye X E With default viewing position X F The relative distance on the x-axis (x-axis variable), and ΔEyeball represents the actual position of the human eye X E With default viewing position X FIn some embodiments, the processing circuit 140 can sense the reference position C in the image I2 by S The reference coordinates (u S ,v S ) and the eye position C G The eye coordinates (u G ,v G ) calculates the distance d. In some embodiments, the processing circuit 140 can calculate the imaging distance fv by the focal length of the image sensor 130. According to actual applications, in some embodiments, the stereoscopic display device 100 can selectively include a depth sensor (not shown), which can sense the distance from the display panel 110 to the user (actual position of the human eye X) in the viewing field FD. E )’s depth information z F Thus, in some embodiments, the processing circuit 140 can use the above-mentioned equations (1) to (3) to use the depth information z F With reference position C S The reference coordinates (u S , v S ) to calculate the reference position C in the viewing field FD S The corresponding default viewing position X F .

[0071] exist Figure 3 In step S250, the processing circuit 140 may process the image according to the actual position X of the human eye. E Adjust the rotation angle of the liquid crystal of the lens array 120 so that the viewing position (ideal position) of the three-dimensional image I1 matches the actual position X of the human eye. E It is worth mentioning that in Figure 1 and Figure 2 In the illustrated embodiment, the processing circuit 140 can change the refraction direction of the light by adjusting the rotation angle of the liquid crystal of the lens array 120, so that the viewing position of the three-dimensional image I1 can be changed from the default viewing position X F Move to the actual eye position X E (Or, as close as possible to the actual position of the human eye X E ).by Figure 4 Taking the scenario shown in FIG. 1 as an example, the movement of the light (image) is only the movement of the three-dimensional image 11 on the uv (or xy) two-dimensional plane for the user's eyes, but it is a stereo conversion in the xyz three-dimensional space for the lens array 120 and the image sensor 130. Therefore, in some embodiments, the processing circuit 140 can pre-set or calculate the space conversion matrix that converts the uv two-dimensional coordinates into the xyz three-dimensional coordinates. The processing circuit 140 can use the space conversion matrix to convert the human eye position C in the sensed image I2 GThe eye coordinates (u G , v G ) is converted to the actual eye position X E The coordinates (x E ,y E , z E ), and then according to the actual position of the human eye X E The coordinates (x E ,y E , z E ) adjusts the liquid crystal rotation angle of the lens array 120.

[0072] For example, in some embodiments, the space conversion matrix may be one or more fixed matrices pre-set before the stereoscopic display device 100 leaves the factory. Alternatively, in some embodiments, the processing circuit 140 may also be based on the reference position C in the sensed image I2. S The reference coordinates (u S , v S ) and the reference position C in the viewing field FD S The corresponding default viewing position X F The coordinates (x F ,y F , z F ) to dynamically calculate the spatial transformation matrix. For example, in some embodiments, the reference position C S With default viewing position X F The relationship can be expressed as follows:

[0073] C s =K F X F -(4)

[0074] K F (X F t ·X F )=X F t ·C s ·X F -1 -(5)

[0075] K F (X F t ·X F ) -1 ·(X F t ·X F )=(X F t ·X F ) -1 ·C s -(6)

[0076] K F =(X F t ·X F ) -1 ·C s -(7)

[0077] Among them, K F Represents the reference position C on the two-dimensional plane S With the default viewing position X in 3D space F In some embodiments, the reference position C S Can be a 2x1 matrix, the spatial transformation matrix K F Can be a 2x3 matrix, default viewing position X F It can be a 3x1 matrix. In some embodiments, the default viewing position X F is an irreversible non-square matrix, so the processing circuit 140 can solve the spatial transformation matrix K by the least square method of the above equations (5)-(7): F Similarly, in some embodiments, the eye position C G The actual position of the human eye X E The relationship can also be expressed as follows:

[0078] C G =K E X E -(8)

[0079] Among them, K E Represents the eye position C on a two-dimensional plane G The actual position of the human eye in three-dimensional space is X E In some embodiments, the eye position C G Can be a 2x1 matrix, the spatial transformation matrix K E It can be a 2x3 matrix, the actual coordinate of the human eye is X E It can be a 3x1 matrix. In some embodiments, the spatial transformation matrix K E Can be equal to the space transformation matrix K F , thus, the processing circuit 140 can use the spatial transformation matrix K calculated by the above formula (7) F , and then use formula (8) to calculate the eye position C G The eye coordinates (u G , v G ) is converted to the actual eye position X E The coordinates (x E ,y E , z E ).

[0080] Furthermore, for the lens array 120 and the image sensor 130, the movement of the viewing position of the three-dimensional image 11 can be regarded as the default viewing position X. F Coordinate transformation in three-dimensional space. Therefore, in some embodiments, the default viewing position X F The actual position of the human eye X E The relationship can be expressed as follows:

[0081] X E =R F X F +t -(9)

[0082] Where t represents the compensation vector between the multiple lenses in the lens array 120. F Indicates the default viewing position X F The rotation matrix when performing coordinate transformation in three-dimensional space. In some embodiments, the actual position of the human eye X E Can be a 3x1 matrix, rotation matrix R F Can be a 3x3 matrix, default viewing position X F The compensation vector t may be a 3x1 matrix. Thus, when the compensation vector t approaches 0, the processing circuit 140 may convert the default viewing position X in the viewing field FD into F And the actual eye position X calculated by the above formula (8) E Substitute into the above formula (9) to calculate the rotation matrix R F Then, the processing circuit 140 can calculate the rotation matrix R according to F The liquid crystal rotation angle of the lens array 120 is calculated.

[0083] In some other embodiments, the above formula (8) and formula (9) can also be combined into the following relationship:

[0084] C G =K E (R F X F +t) -(10)

[0085] R F =K E -1 ·X F t ·(X F t X F ) -1 ·C G -(11)

[0086] In some embodiments, it is assumed that the compensation vector t approaches 0 and the spatial transformation matrix K EEqual to the space transformation matrix K F When the above formula (10) can be expressed as C G =K F (R F X F In other words, the processing circuit 140 may also be configured to process the image I2 based on the eye position C of the human eye in the sensed image I2 sensed by the image sensor 130. G , the default viewing position X pre-set or calculated by the above formula (1) F , and the spatial transformation matrix K calculated by the above formula (7) F , to calculate the rotation matrix R F In this way, as long as the image sensor 130 captures the eye position C G , the processing circuit 140 can directly calculate the rotation matrix R through the above equations (10) and (11): F , and according to the rotation matrix R F The liquid crystal rotation angle required for the lens array 120 to rotate is obtained.

[0087] Specifically, the three-dimensional coordinate point (for example, the default viewing position X F ) The coordinate transformation in the xyz three-dimensional space can be decomposed into the rotation of the three-dimensional coordinate point about the x-axis, y-axis and z-axis respectively, and its rotation matrix R F It can be expressed as follows:

[0088] R F =R y (θ y )R x (θ x )R z (θ z ) -(12)

[0089]

[0090]

[0091]

[0092] Among them, R x , R y and R z They represent the rotation matrices when the three-dimensional coordinate point rotates about the x-axis, y-axis, and z-axis separately, and their rotation angles are θ respectively. x ,θ y and θ z. In other words, when the three-dimensional coordinate point rotates about the x-axis alone, its coordinate transformation only affects the yz two-dimensional plane, that is, it can be regarded as the yz two-dimensional plane where the three-dimensional coordinate point is located rotates about the x-axis. When the three-dimensional coordinate point rotates about the y-axis alone, its coordinate transformation only affects the xz two-dimensional plane, that is, it can be regarded as the xz two-dimensional plane where the three-dimensional coordinate point is located rotates about the y-axis. When the three-dimensional coordinate point rotates about the z-axis alone, its coordinate transformation only affects the xy two-dimensional plane, that is, it can be regarded as the xy two-dimensional plane where the three-dimensional coordinate point is located rotates about the z-axis.

[0093] Therefore, Figure 4 For example, in the xyz three-dimensional space, for the lens array 120 (or the image sensor 130), the viewing position of the three-dimensional image I1 is changed from the default viewing position X F Transfer to the actual position of the human eye X E The movement can be seen as the default viewing position X F The xy two-dimensional plane where the z-axis is located is rotated. Then the rotation matrix R in the above equations (9) to (11) is F The rotation matrix R in the above equation (15) can be used Z (θ z ) is used to represent the rotation matrix. In this way, the processing circuit 140 calculates the rotation matrix R F After that, we can use the rotation matrix R Z (θ z ) Calculate the default viewing position X F The rotation angle θ when rotating about the z-axis z Then, the processing circuit 140 adjusts the rotation angle of the liquid crystal in the lens array 120 to change the refraction direction of the light, so that the viewing position of the three-dimensional image I1 matches the actual position X of the human eye. E , in order to maintain the presentation effect of stereoscopic images.

[0094] Figure 6 According to an embodiment of the present invention, Figure 1 and Figure 2 FIG. 1 is a schematic diagram of a partial optical path of the stereoscopic display device 100. Figure 6In the illustrated embodiment, the display panel 110 can simultaneously present at least two sub-images for forming a three-dimensional image, and the lens array 120 can include a plurality of lenses arranged in sequence to correspond to the plurality of sub-images respectively, so as to project the plurality of sub-images to the user's eyes respectively. The number, shape, and arrangement of the lenses in the lens array 120 can be adjusted according to actual needs, and this embodiment is not limited thereto. For example, in this embodiment, the three-dimensional image displayed by the display panel 110 can include a left parallax image IM1 and a right parallax image IM2, and the lens array 120 can include a plurality of lenses corresponding to the user's left eye X and a plurality of lenses corresponding to the user's right eye X. EyeL With right eye X EyeR The lens array 122 and the lens array 121 are used to transmit the left parallax image IM1 and the right parallax image IM2 to the user's left eye X respectively. EyeL With right eye X EyeR , and then present a three-dimensional effect through parallax. Corresponding to the actual position of the user's eyes X E (Left Eye X EyeL With right eye X EyeR ), the liquid crystal rotation angles of the lens arrays 121 and 122 must be calculated separately.

[0095] Specifically, in this embodiment, the image sensor 130 can sense the user's left eye X EyeL and / or right eye X EyeR To generate a sensed image, the imaging plane VP corresponding to the sensed image may include the left eye X corresponding to the user. EyeL and / or right eye X EyeR The left eye coordinates of Eye L and (or) the right eye coordinates Eye R In some embodiments, assuming that the right eye X EyeR Taking the actual position as the reference, the above formula (9) can be rewritten as follows:

[0096] Eye R =K E (R EL X EyeL ) -(16)

[0097] Eye L =K E (R ER X EyeR +t) -(17)

[0098] In this embodiment, the compensation vector t may be related to the horizontal resolution of the display panel 110. For example, taking the display panel 110 with a resolution of 1920*1080 pixels as an example, the compensation vector t may be the spacing between horizontal pixels of 0.17925 millimeters (mm). Then, in the xyz three-dimensional space, the compensation vector t may be represented as a 3x1 matrix: R EL and R ER denote the rotation matrices of the lens arrays 121 and 122, respectively. In this embodiment, it is assumed that the lens arrays 121 and 122 are arranged in sequence along the horizontal direction of the x-axis, and the direction in which the display panel 110 displays an image through the lens array 120 is the z-axis. The processing circuit 140 can use the above equations (16) and (17) to calculate the rotation matrix of the lens arrays 121 and 122 according to the actual position of the human eye X. E (Left Eye X EyeL or right eye X EyeR ) and the compensation vector t to calculate the rotation matrix R corresponding to the lens arrays 121 and 122 EL With R ER The processing circuit 140 can further use the rotation matrix R in the above formula (15) to rotate the z-axis alone. Z (θ z ) to calculate the rotation matrix R EL With R ER The rotation angle θ z , and then the liquid crystal rotation angle of the lens array 121 and the liquid crystal rotation angle of the lens array 122 can be adjusted respectively.

[0099] Figure 7 FIG. 2 is a schematic diagram of the hardware architecture of a stereoscopic display device 200 according to another embodiment of the present invention. Figure 7 In the illustrated embodiment, the stereoscopic display device 200 includes a display panel 110, a lens array 120, an image sensor 130, and a processing circuit 140. The embodiments of the display panel 110, the lens array 120, and the image sensor 130 may refer to Figure 1 and Figure 2 The related descriptions of the display panel 110, the lens array 120 and the image sensor 130 are analogous, so they are not repeated here. In some embodiments, the processing circuit 140 may include a memory 141, a processor 142, an analog-to-digital conversion circuit 143, a timing controller 144 and (or) a scaling circuit 145. The implementation of the processor 142 may refer to Figure 1 and Figure 2In some embodiments, the stereoscopic display device 100 may further include a backlight module 150. The implementation of the memory 141, the analog-to-digital conversion circuit 143, the timing controller 144, the scaling circuit 145, and the backlight module 150 may be implemented by an image display device well known to those skilled in the art, and this embodiment is not limited thereto.

[0100] Figure 8 It is a partial structural schematic diagram of a stereoscopic display device according to an embodiment of the present invention. Figure 8 The display panel 110 and / or the lens array 120 may be used as Figure 1 and Figure 2 The display panel 110 and / or the lens array 120 in the stereoscopic display device 100 are implemented as examples, or as Figure 7 The display panel 110 and / or the lens array 120 in the stereoscopic display device 200 are implemented as examples. Figure 8 In the illustrated embodiment, the display panel 110 may include a switching liquid crystal layer SLC, a polarized coating PC, and a plurality of display pixels DP that are sequentially overlapped. The lens array 120 may include a glass substrate GS1, a liquid crystal layer LC, and a glass substrate GS2 that are sequentially overlapped. The liquid crystal rotation angle of the liquid crystal layer LC in the lens array 120 may be adjusted to change the light transmission direction of the image displayed by the display pixel DP. The implementation of each component may be constructed by a stereoscopic display device known to those skilled in the art, and this embodiment is not limited thereto.

[0101] In summary, the stereoscopic display devices 100 and 200 described in the embodiments of the present invention can obtain the sensing image I2 of the viewing field FD of the display panel 110 through the image sensor 130, and the processing circuit 140 can obtain the sensing image I2 according to the reference position C in the sensing image I2. S With human eye position C G Calculate the actual eye position X of the user in the viewing field FD E , based on the actual position of the human eye X E Adjust the rotation angle of the liquid crystal of the lens array 120. In this way, the viewing position of the three-dimensional image I1 displayed by the display panel 110 can be made to match the actual position X of the human eye. E , thereby optimizing the user experience.

[0102] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A stereoscopic display device, characterized in that: The stereoscopic display device comprises: A display panel for displaying a three-dimensional image; A lens array, arranged on a transmission path of the three-dimensional image; An image sensor, used to acquire a sensed image of a viewing field of the display panel; and A processing circuit is coupled to the lens array and the image sensor, wherein the processing circuit calculates the actual position of the user's eyes in the viewing field according to the reference coordinates of the reference position in the sensed image and the coordinates of the user's eyes in the sensed image, so as to adjust the liquid crystal rotation angle of the lens array according to the actual position of the eyes, so that the viewing position of the three-dimensional image coincides with the actual position of the eyes. The lens array includes a first lens array and a second lens array corresponding to the left eye and the right eye of the user respectively, and the processing circuit adjusts the liquid crystal rotation angle of the first lens array and the liquid crystal rotation angle of the second lens array according to the actual position of the human eye and the compensation vector, wherein the compensation vector is related to the horizontal resolution of the display panel.

2. The stereoscopic display device according to claim 1, characterized in that: The processing circuit calculates a spatial transformation matrix according to the reference coordinates and a default viewing position corresponding to the reference coordinates in the viewing field.

3. The stereoscopic display device according to claim 1, characterized in that: The processing circuit uses a space transformation matrix to transform the human eye coordinates into the actual position of the human eye.

4. The stereoscopic display device according to claim 1, characterized in that: The processing circuit calculates a rotation matrix according to a default viewing position corresponding to the reference coordinates in the viewing field and an actual position of the human eye, and calculates a liquid crystal rotation angle according to the rotation matrix.

5. The stereoscopic display device according to claim 1, characterized in that: The stereoscopic display device further comprises: A depth sensor is used to sense depth information from the display panel to the user in the viewing field, wherein the processing circuit uses the depth information and the reference coordinates to calculate a default viewing position corresponding to the reference coordinates in the viewing field.

6. A display method of a stereoscopic display device, characterized in that: The display method comprises: Displaying a three-dimensional image through a display panel of the stereoscopic display device; Arrange the lens array of the stereoscopic display device on the transmission path of the three-dimensional image; Acquiring a sensed image from a viewing field of the display panel through an image sensor of the stereoscopic display device; Calculating, by the processing circuit of the stereoscopic display device, the actual position of the user's eyes in the viewing field according to the reference coordinates of the reference position in the sensing image and the coordinates of the user's eyes in the sensing image; and The processing circuit adjusts the liquid crystal rotation angle of the lens array according to the actual position of the human eye, so that the viewing position of the three-dimensional image matches the actual position of the human eye. The lens array includes a first lens array and a second lens array corresponding to the left eye and the right eye of the user respectively, and the display method further includes: The liquid crystal rotation angle of the first lens array and the liquid crystal rotation angle of the second lens array are adjusted by the processing circuit according to the actual position of the human eye and a compensation vector, wherein the compensation vector is related to the horizontal resolution of the display panel.

7. The display method according to claim 6, characterized in that: The display method further includes: The processing circuit calculates a spatial transformation matrix according to the reference coordinates and a default viewing position corresponding to the reference coordinates in the viewing field.

8. The display method according to claim 6, characterized in that: The display method further includes: The processing circuit uses a space transformation matrix to transform the eye coordinates into the actual eye position.

9. The display method according to claim 6, characterized in that: The display method further includes: Calculating a rotation matrix by the processing circuit according to a default viewing position corresponding to the reference coordinates in the viewing field and the actual position of the human eye; and The processing circuit calculates the liquid crystal rotation angle according to the rotation matrix.

10. The display method according to claim 6, characterized in that: The display method further includes: sensing depth information from the display panel to the user in the viewing field by a depth sensor of the stereoscopic display device; and The processing circuit uses the depth information and the reference coordinates to calculate a default viewing position corresponding to the reference coordinates in the viewing field.

Images