Multi-view autostereoscopic 3D display screen, multi-view autostereoscopic 3D display device

Abstract

The present application relates to the field of naked-eye 3D display technology, and discloses a multi-viewpoint naked-eye 3D display screen, including: a display panel having a plurality of composite pixels, each of the plurality of composite pixels including a plurality of composite sub-pixels, and each of the plurality of composite sub-pixels including a plurality of sub-pixels arranged in an array; and a plurality of spherical gratings covering the plurality of composite sub-pixels. The multi-viewpoint naked-eye 3D display screen can play 3D effects for users at front and rear positions and reduce the amount of transmission and rendering calculations. The present application also discloses a multi-viewpoint naked-eye 3D display device.

Description

Technical Field

[0001] This application relates to the field of 3D display technologies, for example, to multi-view autostereoscopic 3D display screens and multi-view autostereoscopic 3D display devices. Background Art

[0002] Currently, autostereoscopic 3D display devices achieve 3D display effects by refracting pixels through lenticular gratings.

[0003] In the process of implementing the embodiments of the present disclosure, it is found that there are at least the following problems in the related technologies: The lenticular gratings with fixed optical properties can form multiple viewpoints arranged horizontally along the display device in cooperation with pixels. For multiple users at different distances from the display device, some users may have poor 3D effects or cannot see 3D effects. Summary of the Invention

[0004] To provide a basic understanding of some aspects of the disclosed embodiments, a simple summary is given below. This summary is not a comprehensive review, nor is it intended to identify key / important elements or delineate the scope of protection of these embodiments. Instead, it serves as a preamble to the subsequent detailed description.

[0005] Embodiments of the present disclosure provide a multi-view autostereoscopic 3D display screen and a multi-view autostereoscopic 3D display device to solve the problems that users in the front and back positions cannot simultaneously view 3D effects and the large amount of transmission and rendering calculations.

[0006] In some embodiments of the present disclosure, a multi-view autostereoscopic 3D display screen is provided, including: a display panel having a plurality of composite pixels, each composite pixel of the plurality of composite pixels including a plurality of composite sub-pixels, and each composite sub-pixel of the plurality of composite sub-pixels including a plurality of sub-pixels in an array; and a plurality of spherical gratings covering the plurality of composite sub-pixels.

[0007] In some embodiments, each composite sub-pixel is square.

[0008] In some embodiments, each sub-pixel of the plurality of sub-pixels is square.

[0009] In some embodiments, the plurality of sub-pixels are in an i×j array, where j≥2 and i≥2.

[0010] In some embodiments, the aspect ratio of each sub-pixel of the plurality of sub-pixels is i / j.

[0011] In some embodiments, i≥3 and j≥3.

[0012] In some embodiments, the plurality of composite sub-pixels have different colors, and the plurality of composite sub-pixels with different colors are arranged alternately.

[0013] In some embodiments, multiple composite sub-pixels with different colors are arranged in a triangular pattern.

[0014] In some embodiments, at least one of the multiple spherical gratings is a spherical grating or an elliptical spherical grating.

[0015] In some embodiments, at least one of the multiple spherical gratings further includes at least one side surface.

[0016] In some embodiments of the present disclosure, a multi-view autostereoscopic 3D display device is provided, including: the multi-view autostereoscopic 3D display screen as described above; and a 3D processing device configured to render sub-pixels in multiple composite sub-pixels in the multi-view autostereoscopic 3D display screen.

[0017] In some embodiments, each composite sub-pixel includes multiple sub-pixels arranged in an i×j array; wherein, the multiple sub-pixels in the i×j array correspond to i first-direction viewpoints and j second-direction viewpoints of the multi-view autostereoscopic 3D display device.

[0018] In some embodiments, the multi-view autostereoscopic 3D display device further includes: an eye tracking data acquisition device configured to acquire eye tracking data.

[0019] In some embodiments, the eye tracking data acquisition device is configured to acquire the horizontal position of the user's eyes to determine the first-direction viewpoint where the user's eyes are located.

[0020] In some embodiments, the 3D processing device is configured to render sub-pixels corresponding to the first-direction viewpoint in the multiple sub-pixels arranged in an array based on the first-direction viewpoint where the user's eyes are located.

[0021] In some embodiments, the eye tracking data acquisition device is configured to acquire at least one of the depth position and height position of the user's eyes to determine the second-direction viewpoint where the user's eyes are located.

[0022] In some embodiments, the 3D processing device is configured to render sub-pixels corresponding to the second-direction viewpoint in the multiple sub-pixels arranged in an array based on the second-direction viewpoint where the user's eyes are located.

[0023] The multi-view autostereoscopic 3D display screen and the multi-view autostereoscopic 3D display device provided by the embodiments of the present disclosure can achieve the following technical effects:

[0024] The i×j array of same-color sub-pixels covered by the spherical grating plays 3D images to the spatial positions corresponding to multiple viewpoints at different distances from the multi-view autostereoscopic 3D display screen, meeting the 3D viewing requirements of users at different positions. In addition, the display resolution of the multi-view autostereoscopic 3D display screen is defined in the form of composite pixels, and both the transmission and display take the display resolution defined by the composite pixels into consideration, reducing the computational amount of transmission and rendering while ensuring high-definition display effects, and achieving high-quality autostereoscopic 3D display.

[0025] The above general description and the following description are only exemplary and explanatory, and are not used to limit the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] One or more embodiments are exemplarily illustrated by corresponding drawings. These exemplary illustrations and the drawings do not constitute limitations on the embodiments. Elements with the same reference numerals in the drawings are shown as similar elements. The drawings do not constitute a proportional limitation, and:

[0027] Figure 1 is a schematic diagram of a multi-view autostereoscopic 3D display screen according to an embodiment of the present disclosure;

[0028] Figure 2 is a schematic diagram of the arrangement of composite pixels according to an embodiment of the present disclosure;

[0029] Figure 3 is a spherical grating and corresponding composite sub-pixels according to an embodiment of the present disclosure;

[0030] Figure 4 is a spherical grating and corresponding composite sub-pixels according to another embodiment of the present disclosure;

[0031] Figures 5A to 5C is a schematic diagram of the structure of a multi-view autostereoscopic 3D display device according to an embodiment of the present disclosure;

[0032] Figure 6 is a schematic diagram of dynamic rendering according to an embodiment of the present disclosure;

[0033] Figures 7A to 7E is the format of the image included in the video frame of the 3D video signal according to an embodiment of the present disclosure.

[0034] REFERENCE SIGNS:

[0035] 100: Multi-view autostereoscopic 3D display device; 110: Multi-view autostereoscopic 3D display screen; 111: Display panel; 120: Processor; 121: Register; 130: 3D processing device; 131: Buffer; 140: Video signal interface; 150: Eye tracking device; 160: Eye tracking data interface; 190: Spherical grating; 191: Side cross-section; 192: Spherical surface; 193: Bottom plane; 400: Composite pixel; 410: Red composite sub-pixel; 420: Green composite sub-pixel; 430: Blue composite sub-pixel; 601: One of the two images included in the video frame of the 3D video signal; 602: One of the two images included in the video frame of the 3D video signal; 603: Composite image. Detailed implementation

[0036] In order to understand the features and technical content of the embodiments of the present disclosure in more detail, the implementation of the embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. The accompanying drawings are for reference and illustration only and are not intended to limit the embodiments of the present disclosure.

[0037] In this document, "autostereoscopic three-dimensional (3D) display" refers to a technology in which a user can observe a 3D display image on a flat panel display without wearing glasses for 3D display.

[0038] In this document, "multi-view" has its conventional meaning in the art, meaning that different images displayed by different pixels or sub-pixels of a display screen can be viewed at different positions (viewpoints) in space. In this document, multi-view will mean at least 3 viewpoints.

[0039] In this document, a conventional "pixel" means the smallest display unit in terms of its resolution for a 2D display or when a display is used as a 2D display.

[0040] However, in some embodiments of this document, the "composite pixel" referred to when applying multi-view technology to the field of autostereoscopic 3D display refers to the smallest display unit when an autostereoscopic 3D display provides multi-view display, but it does not exclude that a single composite pixel for multi-view technology may include or be presented as multiple pixels of a 2D display. In this document, unless specifically stated as a composite pixel or 3D pixel for "3D display" or "multi-view" applications, a pixel will refer to the smallest display unit for 2D display. Similarly, when describing the "composite sub-pixel" of an autostereoscopic 3D display with multi-view, it will refer to the composite sub-pixel of a single color presented in the composite pixel when an autostereoscopic 3D display provides multi-view display. In this document, the sub-pixel in "composite sub-pixel" will refer to the smallest display unit of a single color, which is often corresponding to a viewpoint.

[0041] Embodiments according to the present disclosure provide a multi-view autostereoscopic 3D display screen, which can be applied to a multi-view autostereoscopic 3D display device. The multi-view autostereoscopic 3D display screen includes a display panel and a plurality of spherical gratings. The display panel has a plurality of composite pixels, each composite pixel includes a plurality of composite sub-pixels, and each composite sub-pixel is composed of an i×j array of sub-pixels, where i≥2 and j≥2. The plurality of spherical gratings cover the plurality of composite sub-pixels. Among the i×j array of sub-pixels, i corresponds to the first-direction viewpoints (such as row viewpoints, also known as horizontal viewpoints) of the multi-view autostereoscopic 3D display device, and j corresponds to the second-direction viewpoints (such as column viewpoints, also known as height or depth viewpoints) of the multi-view autostereoscopic 3D display device. In some embodiments, the i×j array of sub-pixels of each composite sub-pixel is an i×j array of same-color sub-pixels.

[0042] In some embodiments, there is a one-to-one correspondence between the spherical gratings and the composite sub-pixels in the multi-view autostereoscopic 3D display screen.

[0043] In some embodiments, i≥3 and j≥3.

[0044] Figures 1 to 3 FIG. shows a multi-view autostereoscopic 3D display screen 110 according to an embodiment of the present disclosure. The multi-view autostereoscopic 3D display screen 110 includes a display panel 111 and a plurality of spherical gratings 190 covering the display panel 111. The display panel 111 has a plurality of composite pixels 400, and each composite pixel 400 includes a plurality of composite sub-pixels. In the illustrated embodiment, each composite pixel 400 includes three composite sub-pixels of different colors, namely a red composite sub-pixel 410, a green composite sub-pixel 420, and a blue composite sub-pixel 430. The red composite sub-pixel 410 is composed of i columns and j rows (i×j array) of red sub-pixels R, the green composite sub-pixel 420 is composed of i columns and j rows (i×j array) of green sub-pixels G, and the blue composite sub-pixel 430 is composed of i columns and j rows (i×j array) of blue sub-pixels B. Figure 1 FIG. shows the red composite sub-pixel 410 composed of the i×j array of red sub-pixels R as an example.

[0045] In some embodiments, each composite sub-pixel is square. In the i×j array of same-color sub-pixels of each composite sub-pixel, the aspect ratio of each sub-pixel is equal to i / j. In some embodiments, each sub-pixel in each composite sub-pixel is square.

[0046] As Figure 1 and Figure 2As shown, in the i×j array of red sub-pixels R of the red composite sub-pixel 410, i = 6 and j = 3. In the i×j array of green sub-pixels G of the green composite sub-pixel 420, i = 6 and j = 3. In the i×j array of green sub-pixels G of the blue composite sub-pixel 420, i = 6 and j = 3. The 6×3 array of same-color sub-pixels in each color's composite sub-pixel corresponds to 6 row viewpoints and 3 column viewpoints of the multi-view autostereoscopic 3D display device.

[0047] It can be envisioned that in other embodiments, the composite sub-pixels and sub-pixels may have other configurations. For example, each sub-pixel in the i×j array of same-color sub-pixels is square, and the aspect ratio i / j of each sub-pixel is 1.

[0048] In some embodiments, the composite sub-pixels of different colors are alternately arranged in the display panel, and the multiple composite sub-pixels of each composite pixel are arranged in a triangular pattern.

[0049] As Figure 2 As shown, the red composite sub-pixel 410, green composite sub-pixel 420, and blue composite sub-pixel 430 in the composite sub-pixel 400 are arranged in a triangular pattern. Horizontally in the display panel 111, the red composite sub-pixel 410, green composite sub-pixel 420, and blue composite sub-pixel 430 are alternately arranged. The composite pixels 400 are arranged in a staggered manner.

[0050] In some embodiments, the display panel 111 of the multi-view autostereoscopic 3D display screen 110 may include m columns and n rows (i.e., an m×n array) of composite pixels and thus define an m×n display resolution. In some embodiments, the m×n display resolution can be a resolution above full high definition (FHD), including but not limited to: 1920×1080, 1920×1200, 2048×1280, 2560×1440, 3840×2160, etc.

[0051] In the embodiments of the present disclosure, each composite sub-pixel has corresponding sub-pixels corresponding to the viewpoints. The multiple sub-pixels of each composite sub-pixel are arranged in an array on the multi-view autostereoscopic 3D display screen, and the colors of the multiple sub-pixels in the array form are the same. Since the multiple viewpoints of the 3D display device are arranged approximately horizontally and vertically on the multi-view autostereoscopic 3D display screen, in this way, when the user moves back and forth and left and right, causing the human eye to be at different azimuth viewpoints, it is necessary to dynamically render the different sub-pixels corresponding to the corresponding viewpoints in each composite sub-pixel accordingly. Since the same-color sub-pixels in each composite sub-pixel are arranged in an array, it is possible to avoid the color bleeding problem caused by persistence of vision. In addition, due to the refraction of the grating, it is possible to see a part of the currently displayed sub-pixel at adjacent viewpoint positions, and through the same-color and same-row arrangement, even if a part of the currently displayed sub-pixel is seen, there will be no color mixing problem.

[0052] In some embodiments, multiple spherical gratings are arranged on the surface of the display panel and each covers a composite sub-pixel. Each of the multiple spherical gratings may include, for example, a spherical surface to form a spherical grating. In some other embodiments, each of the multiple spherical gratings includes an ellipsoidal surface to form an ellipsoidal grating. In some other embodiments, the spherical grating includes a spherical surface and a side cross-section. In some other embodiments, the spherical grating includes an ellipsoidal surface and a side cross-section.

[0053] Figure 3 An example of the spherical grating is shown. As shown, a spherical grating 190 corresponds to a composite sub-pixel, such as the red composite sub-pixel 410. The spherical grating 190 includes, for example, a bottom plane 193 in the shape of a square, a spherical surface 192 opposed to the bottom plane 193, and a side cross-section 191 connecting the spherical surface 192 and the bottom plane 193.

[0054] Figure 4 Another example of the spherical grating is shown. As shown, a spherical grating 190 corresponds to a composite sub-pixel, such as the green composite sub-pixel 420. The spherical grating 190 includes, for example, a bottom plane 193 in the shape of a circle and a spherical surface 192 connecting the bottom plane 193.

[0055] In other embodiments, the bottom plane of the spherical grating may have other shapes, such as a hexagon, a triangle, etc.

[0056] In some embodiments, another refractive layer with a refractive index different from that of the spherical grating is provided on the spherical side of the spherical grating. The surface of this another refractive layer facing the spherical grating is concave and fits with the spherical surface of the spherical grating in a concave-convex mating manner, and the surface facing away from the spherical grating is a plane, for example, a plane parallel to the bottom plane of the spherical grating.

[0057] The multi-view autostereoscopic 3D display screen 110 according to an embodiment of the present disclosure can be applied in a multi-view autostereoscopic 3D display device. According to an embodiment of the present disclosure, the multi-view autostereoscopic 3D display device includes a multi-view autostereoscopic 3D display screen, a video signal interface, and a 3D processing device. The video signal interface is configured to receive video frames of 3D video signals. The 3D processing device is configured to render relevant sub-pixels in each composite sub-pixel based on the received video frames of the 3D video signals.

[0058] Figure 5A An example of the multi-view autostereoscopic 3D display device 100 according to an embodiment of the present disclosure is shown. As Figure 5A shown, the multi-view autostereoscopic 3D display device 100 includes a multi-view autostereoscopic 3D display screen 110, a 3D processing device 130, and a 3D signal interface (such as the video signal interface 140) configured to receive 3D content such as 3D video signals.

[0059] In some embodiments, the 3D video signal includes video frames.

[0060] In some embodiments, the 3D processing device is an FPGA or ASIC chip or an FPGA or ASIC chipset. In some embodiments, the multi-view autostereoscopic 3D display device 100 may also be provided with more than one 3D processing device 130, which process the rendering of the sub-pixels of each composite sub-pixel of each composite pixel of the multi-view autostereoscopic 3D display screen 110 in parallel, serially, or in a combination of serial and parallel. Those skilled in the art will understand that more than one 3D processing device can be distributed and process the multi-row and multi-column composite pixels or composite sub-pixels of the multi-view autostereoscopic 3D display screen 110 in other ways, which fall within the scope of the embodiments of the present disclosure. In some embodiments, the 3D processing device 130 may also selectively include a buffer 131 for buffering the received video frames.

[0061] In some embodiments, the 3D processing device is communicatively connected to the multi-view autostereoscopic 3D display screen. In some embodiments, the 3D processing device is communicatively connected to the driving device of the multi-view autostereoscopic 3D display screen.

[0062] See Figure 5A , the multi-view autostereoscopic 3D display device 100 may further include a processor 120 communicatively connected to the 3D processing device 130 through a video signal interface 140. In some embodiments, the processor is included in a computer or a smart terminal, and such a smart terminal is, for example, a mobile terminal. Alternatively, the processor may be a processor unit of a computer or a smart terminal. However, it can be envisioned that in some embodiments, the processor 120 may be provided outside the multi-view autostereoscopic 3D display device 100. For example, the multi-view autostereoscopic 3D display device 100 may be a multi-view autostereoscopic 3D display with a 3D processing device, such as a non-smart autostereoscopic 3D TV.

[0063] In some embodiments, a processor is included inside the multi-view autostereoscopic 3D display device. Based on this, the 3D signal interface 140 is an internal interface connecting the processor 120 and the 3D processing device 130. Such a 3D display device 100 may be, for example, a mobile terminal, and the 3D signal interface 140 may be an MIPI, mini-MIPI interface, LVDS interface, min-LVDS interface, or DisplayPort interface.

[0064] In some embodiments, as Figure 5AAs shown, the processor 120 of the multi-view autostereoscopic 3D display device 100 may further include a register 121. The register 121 may be configured to temporarily store instructions, data, and addresses. In some embodiments, the register 121 may be configured to receive information regarding the display requirements of the multi-view autostereoscopic 3D display screen 110. In some embodiments, the multi-view autostereoscopic 3D display device 100 may further include a codec configured to decompress, encode, and decode a compressed 3D video signal and send the decompressed 3D video signal to the 3D processing device 130 via the 3D signal interface 140.

[0065] In some embodiments, the i×j array of same-color sub-pixels of each composite sub-pixel of the multi-view autostereoscopic 3D display screen 110 corresponds to i first-direction viewpoints and j second-direction viewpoints of the multi-view autostereoscopic 3D display device. The first-direction viewpoints may be row viewpoints, or lateral viewpoints, corresponding to the viewpoint positions of the user in the lateral (X-axis direction) of the multi-view autostereoscopic 3D display screen. The second-direction viewpoints may be column viewpoints, or depth or height viewpoints, corresponding to the viewpoint positions of the user in the vertical (Y-axis direction) and / or depth direction (Z-axis direction) of the multi-view autostereoscopic 3D display screen. In the embodiments of the present disclosure, the depth is defined by the distance of the user relative to the multi-view autostereoscopic 3D display screen.

[0066] As Figure 6 shown, the correspondence between the red composite sub-pixel 410 composed of the i×j array of red sub-pixels R and the i first-direction viewpoints and j second-direction viewpoints of the multi-view autostereoscopic 3D display device is shown. For clarity, each viewpoint is identified by the coordinates of the sub-pixels corresponding to each viewpoint. The coordinates of each red sub-pixel R are identified based on its position Ri i j j in the i×j red sub-pixel array of the red composite sub-pixel. As shown in the figure, in the i×j red sub-pixel array, the coordinates of the first red sub-pixel R from the left in the first row are Ri 1 j 1 , the coordinates of the second red sub-pixel from the left in the first row are Ri 2 j 1 , and so on. The coordinates of the sixth red sub-pixel R from the left in the third row are Ri 6 j 3 . Correspondingly, the viewpoint corresponding to the first red sub-pixel Ri 1 j 1 from the left in the first row of the i×j red sub-pixel array is Vi 1 j 1 , and the viewpoint corresponding to the second red sub-pixel Ri 2 j 1 from the left in the first row is Vi 2 j 1, and so on, corresponding to the sixth red sub-pixel Ri from the left in the third row 6 j 3 The corresponding viewing point is Vi 6 j 3 . The corresponding relationship between other color composite sub-pixels and viewing points can be analogized with reference to the corresponding relationship between the above-mentioned red composite sub-pixels and viewing points.

[0067] Next, refer to Figures 7A to 7E to describe the transmission and display of 3D video signals in a multi-viewpoint autostereoscopic 3D display device according to an embodiment of the present disclosure. In the illustrated embodiment, the multi-viewpoint autostereoscopic 3D display device can define multiple viewing points, such as i first-direction viewing points and j second-direction viewing points. The user's eyes can see the display of the corresponding sub-pixels in the composite sub-pixels of each composite pixel in the display panel at each viewing point (spatial position). The two different images seen by the user's two eyes at different viewing points form a parallax, and a 3D image is synthesized in the brain.

[0068] In some embodiments of the present disclosure, the 3D processing device 130 receives video frames, such as decompressed 3D video signals, from the processor 120 through, for example, a video signal interface 140 as an internal interface. Each video frame may include two images or a composite image, or be composed of them.

[0069] In some embodiments, the two images or the composite image may include different types of images and may be arranged in various forms.

[0070] In Figure 7A the illustrated embodiment, the video frame of the 3D video signal includes two images 601, 602 in a side-by-side format or is composed of them. In some embodiments, the two images may be a left-eye parallax image and a right-eye parallax image respectively. In some embodiments, the two images may be a rendered color image and a depth-of-field image respectively.

[0071] In Figure 7B the illustrated embodiment, the video frame of the 3D video signal includes two images 601, 602 in an up-and-down format or is composed of them. In some embodiments, the two images may be a left-eye parallax image and a right-eye parallax image respectively. In some embodiments, the two images may be a rendered color image and a depth-of-field image respectively.

[0072] In Figure 7C the illustrated embodiment, the video frame of the 3D video signal includes a composite image 603 in a left-right interlaced format. In some embodiments, the composite image may be a left-right interlaced left-eye and right-eye parallax composite image. In some embodiments, the composite image may be a left-right interlaced rendered color image and a depth-of-field image.

[0073] In Figure 7DIn the illustrated embodiments, the video frames of the 3D video signal include a composite image 603 in an up-and-down interleaved format. In some embodiments, the composite image may be an up-and-down interleaved left-eye and right-eye disparity composite image. In some embodiments, the composite image may be an up-and-down interleaved rendered color image and depth-of-field image.

[0074] In Figure 7E In the illustrated embodiments, the video frames of the 3D video signal include a composite image 603 interleaved in a checkerboard pattern. In some embodiments, the composite image may be a left-eye and right-eye disparity composite image interleaved in a checkerboard pattern. In some embodiments, the composite image may be a rendered color image and depth-of-field image interleaved in a checkerboard pattern.

[0075] Those skilled in the art will understand that the embodiments shown in the drawings are merely illustrative, and the two images or composite images included in the video frames of the 3D video signal may include other types of images and may be arranged in other forms, which fall within the scope of the embodiments of the present disclosure.

[0076] In some embodiments, after receiving a video frame including two images 601 and 602, at least one 3D processing device 130 renders at least one sub-pixel in each composite sub-pixel based on one of the two images and renders at least another sub-pixel in each composite sub-pixel based on the other of the two images.

[0077] In some embodiments, after receiving a video frame including a composite image, at least one 3D processing device 130 renders at least two sub-pixels in each composite sub-pixel based on the composite image. For example, at least one sub-pixel is rendered according to the first image (portion) in the composite image, and at least another sub-pixel is rendered according to the second image (portion).

[0078] In some embodiments, this is, for example, dynamic rendering based on real-time eye tracking data.

[0079] In some embodiments, the multi-view autostereoscopic 3D display device further includes an eye tracking data acquisition device configured to acquire eye tracking data, such as an eye tracking device or an eye tracking data interface. In some embodiments, the eye tracking data includes spatial position information of the user's eyes, such as the distance between the user's eyes or face and the multi-view autostereoscopic 3D display screen or the eye tracking device (i.e., the depth of the user's eyes / face), the position of the user's eyes or face in the vertical direction of the multi-view autostereoscopic 3D display screen, the position of the user's eyes or face in the horizontal direction of the multi-view autostereoscopic 3D display screen, the viewpoint position where the user's two eyes are located, the user's viewing angle, etc.

[0080] In Figure 5BIn the illustrated embodiment, the multi-view autostereoscopic 3D display device 100 includes an eye tracking device 150 communicatively connected to a 3D processing device 130, whereby the 3D processing device 130 can directly receive eye tracking data.

[0081] In some embodiments, the eye tracking device includes an eye tracking unit configured to capture an image of a user (e.g., an image of the user's face), an eye tracking image signal processor configured to determine the spatial position of the eyes based on the captured user image, and an eye tracking data interface configured to transmit the eye spatial position information of the eye spatial position.

[0082] In some embodiments, the eye tracking unit includes a first camera configured to capture a first image and a second camera configured to capture a second image, and the eye tracking image signal processor is configured to identify the presence of eyes based on at least one of the first image and the second image and determine the eye viewing point position based on the spatial position of the eyes present in the first image and the second image.

[0083] In some embodiments, the eye tracking unit includes at least one camera configured to capture at least one image and at least one depth acquisition device configured to acquire at least the depth information of the user's binocular eyes, and the eye tracking image signal processor is configured to identify the presence of eyes based on the at least one captured image and determine the viewing point position of the eyes based on the position of the eyes present in the at least one image and the depth information of the user's binocular eyes.

[0084] In Figure 5C In the illustrated embodiment, the eye tracking device (not shown) can be directly connected to the processor 120, for example, and the 3D processing device 130 obtains the eye tracking data from the processor 120 via the eye tracking data interface 160. In some other embodiments, the eye tracking device can be connected to both the processor and the 3D processing device simultaneously, such that on the one hand, the 3D processing device 130 can directly obtain the eye tracking data from the eye tracking device, and on the other hand, other information obtained by the eye tracking device can be processed by the processor.

[0085] In some embodiments, the eye tracking device obtains the horizontal position of the user's eyes in real time to determine the first direction viewing point where the user's eyes are located. The 3D processing device renders the sub-pixels corresponding to the first direction viewing point in the i×j array of same-color sub-pixels of each composite sub-pixel based on the first direction viewing point where the user's eyes are located.

[0086] In some embodiments, the eye tracking device acquires the depth position of the user's eyes in real time to determine the second-direction viewing point where the user's eyes are located. Alternatively, the eye tracking device acquires the height position of the user's eyes in real time to determine the second-direction viewing point where the user's eyes are located. Alternatively, the eye tracking device acquires the height position and the depth position of the user's eyes in real time to determine the second-direction viewing point where the user's eyes are located. The 3D processing device renders the sub-pixels corresponding to the second-direction viewing point in the i×j array of same-color sub-pixels of each composite sub-pixel based on the second-direction viewing point where the user's eyes are located.

[0087] See Figure 6 , which shows an example of dynamically rendering corresponding sub-pixels in composite sub-pixels based on real-time eye tracking data in a multi-view autostereoscopic 3D display device. The figure shows a red composite sub-pixel 410 composed of an i×j array of red sub-pixels R, where i = 6, corresponding to 6 row-direction viewing points of the multi-view autostereoscopic 3D display device, and j = 3, corresponding to 3 column-direction viewing points of the multi-view autostereoscopic 3D display device. The real-time eye tracking data can be acquired by the eye tracking device in real time, for example. When the eye tracking device acquires that a user's both eyes are at the viewing point Vi 1 j 1 、Vi 2 j 1 , an image of the viewing point where the user's both eyes are located is generated based on the video frame of the 3D video signal, and two red sub-pixels Ri 1 j 1 、Vi 2 j 1 corresponding to the viewing point Vi 1 j 1 、Ri 2 j 1 in the i×j array of red sub-pixels R of the red composite sub-pixel 410 are rendered. When the eye tracking device acquires that another user's both eyes are at the viewing point Vi 3 j 2 、Vi 4 j 2 , an image of the viewing point where the user's both eyes are located is generated based on the video frame of the 3D video signal, and two red sub-pixels corresponding to the viewing point Vi 3 j 2 、Vi 4 j 2 in the i×j array of red sub-pixels R of the red composite sub-pixel 410 are rendered as R i 3 j 2 、Ri 4 j 2 . When the eye tracking device acquires that yet another user's both eyes are at the viewing point Vi 5 j 3 、Vi 6 j 3When generating an image of the viewpoints where the user's both eyes are located based on the 3D video signal and rendering the i×j array of red sub-pixels R of the red composite sub-pixel 410 corresponding to the viewpoint Vi 5 j 3 、Vi 6 j 3 of the two red sub-pixels R i 5 j 3 、Ri 6 j 3 。Thus, users at different row positions (horizontal positions) and column positions (including depth positions and height positions) in front of the display panel can see appropriate 3D images.

[0088] The multi-viewpoint autostereoscopic 3D display device according to an embodiment of the present disclosure can be applied to a video playback device, for example, it can be presented as a mobile terminal (such as a mobile phone or a tablet computer), a television, a mobile television, a computer, a cinema viewing system or a home viewing system.

[0089] The above description and the accompanying drawings fully illustrate the embodiments of the present disclosure, enabling those skilled in the art to practice them. Other embodiments may include structural, logical, electrical, process, and other changes. Unless explicitly required, the individual components and functions are optional, and the order of operations may vary. Some parts and features of some embodiments may be included in or replace parts and features of other embodiments. The scope of the embodiments of the present disclosure includes the entire scope of the claims and all available equivalents of the claims. The terms used in this application are only used to describe the embodiments and do not limit the claims. When used in this application, the term "including" and the like mean the presence of at least one of the stated features, but do not exclude the presence of other features.

[0090] Those skilled in the art can realize that each example unit and algorithm step described in combination with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Those skilled in the art can use different methods for each specific application to achieve the described functions, but such implementation should not be considered to exceed the scope of the embodiments of the present disclosure.

[0091] In the embodiments disclosed herein, the disclosed methods, products (including but not limited to devices, equipment, etc.) can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of units can be merely a logical function division. In actual implementation, there can be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Additionally, the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces. The indirect couplings or communication connections of devices or units can be in electrical, mechanical, or other forms. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units. Some or all of the units can be selected according to actual needs to implement this embodiment. Additionally, each functional unit in the embodiments of the present disclosure can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit.

[0092] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram can represent a module, a program segment, or a part of code, and the above-mentioned module, program segment, or part of code contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the blocks can also occur in a different order than marked in the accompanying drawings. For example, two consecutive blocks can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, which can depend on the functions involved. In the descriptions corresponding to the flowcharts and block diagrams in the accompanying drawings, the operations or steps corresponding to different blocks can also occur in a different order than disclosed in the description. Sometimes, there is no specific order between different operations or steps. For example, two consecutive operations or steps can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, which can depend on the functions involved. Each block in the block diagram and / or flowchart, and the combination of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system for performing the specified functions or actions, or can be implemented by a combination of dedicated hardware and computer instructions.

Claims

1. A multi-view autostereoscopic 3D display screen, characterized in that, it includes: a display panel having a plurality of composite pixels, each of the plurality of composite pixels including a plurality of composite sub-pixels, each of the plurality of composite sub-pixels including a plurality of same-color sub-pixels arranged in an i×j array, where j≥2 and i≥2; and a plurality of spherical gratings covering the plurality of composite sub-pixels, wherein the plurality of spherical gratings are arranged on the surface of the display panel and each covers one composite sub-pixel; wherein the plurality of same-color sub-pixels arranged in an i×j array correspond to i first-direction viewpoints and j second-direction viewpoints of the multi-view autostereoscopic 3D display screen.

2. The multi-view autostereoscopic 3D display screen according to claim 1, characterized in that, each of the composite sub-pixels is square.

3. The multi-view autostereoscopic 3D display screen according to claim 2, characterized in that, each of the plurality of sub-pixels is square.

4. The multi-view autostereoscopic 3D display screen according to claim 1, characterized in that, the aspect ratio of each of the plurality of sub-pixels is i / j.

5. The multi-view autostereoscopic 3D display screen according to claim 1, characterized in that, i≥3 and j≥3.

6. The multi-view autostereoscopic 3D display screen according to claim 1, characterized in that, the plurality of composite sub-pixels have different colors, and the plurality of composite sub-pixels having different colors are arranged alternately.

7. The multi-view autostereoscopic 3D display screen according to claim 6, characterized in that, the plurality of composite sub-pixels having different colors are arranged in a triangular pattern.

8. The multi-view autostereoscopic 3D display screen according to any one of claims 1 to 7, characterized in that, at least one of the plurality of spherical gratings is a spherical grating or an elliptical spherical grating.

9. The multi-view autostereoscopic 3D display screen according to claim 8, characterized in that, at least one of the plurality of spherical gratings further includes at least one side surface.

10. A multi-view autostereoscopic 3D display device, characterized in that, it includes: a multi-view autostereoscopic 3D display screen according to any one of claims 1 to 9; and a 3D processing device configured to render the sub-pixels in the plurality of composite sub-pixels in the multi-view autostereoscopic 3D display screen.

11. The multi-view autostereoscopic 3D display device according to claim 10, characterized in that, it further includes: an eye tracking data acquisition device configured to acquire eye tracking data.

12. The multi-view autostereoscopic 3D display device according to claim 11, characterized in that: the eye tracking data acquisition device is configured to acquire the horizontal position of the user's eyes to determine the first-direction viewpoint where the user's eyes are located.

13. The multi-view autostereoscopic 3D display device according to claim 12, characterized in that, the 3D processing device is configured to render the sub-pixels corresponding to the first-direction viewpoint in the plurality of sub-pixels arranged in an array based on the first-direction viewpoint where the user's eyes are located.

14. The multi-view autostereoscopic 3D display device according to claim 12 or 13, characterized in that, The human eye tracking data acquisition device is configured to acquire at least one of the depth position and the height position of the user's eyes to determine the second direction viewing point where the user's eyes are located.

15. The multi-viewpoint autostereoscopic 3D display device according to claim 14, wherein, the 3D processing device is configured to render the sub-pixels corresponding to the second direction viewing point among the plurality of sub-pixels presented in an array based on the second direction viewing point where the user's eyes are located.

Images