A resolution-lossless naked-eye stereoscopic display system

Abstract

The present invention relates to a multi-viewpoint naked-eye stereoscopic display, comprising a display screen having a display panel and a grating, a video signal interface for receiving a 3D video signal, and one or more 3D video processing units, wherein the display panel comprises multiple rows and columns of pixels and defines multiple pixel groups, each pixel group being composed of at least 3 pixels and corresponding to a multi-viewpoint setting, wherein the one or more 3D video processing units are configured to generate multiple images corresponding to all viewpoints or predetermined viewpoints based on the image of the 3D video signal and render the corresponding pixels in each pixel group based on the generated multiple images. In some embodiments, the mutual arrangement positions of the multiple pixel groups are adjusted or determined based on optical relationship data between the pixels and the grating and / or corresponding relationship data between the pixels of the display panel and the viewpoints. The present invention also provides a naked-eye stereoscopic display system, a display method of a naked-eye stereoscopic display, and a pixel group arrangement method of a naked-eye stereoscopic display.

Description

Technical Field

[0001] The present invention relates to the field of stereoscopic images, and in particular to naked-eye stereoscopic display technology. Specifically, the present invention relates to a naked-eye stereoscopic (3D) display system. Background Art

[0002] Stereoscopic imaging is one of the hottest technologies in the video industry, driving the technological shift from flat-screen displays to stereoscopic displays. Stereoscopic display technology, a key component of the 3D imaging industry, is primarily categorized into two types: eye-guided stereo and naked-eye stereo. Naked-eye stereo technology allows viewers to directly view 3D images without wearing glasses. Compared to eye-guided stereo, naked-eye stereo is a self-contained stereo technology, placing fewer constraints on the viewer.

[0003] Typically, naked-eye stereoscopic displays are viewpoint-based, forming a sequence of parallax images (frames) at different positions in space, so that a pair of stereoscopic images with a parallax relationship can enter the left and right eyes of a person, respectively, thereby giving the viewer a sense of stereo. For a traditional multi-viewpoint naked-eye stereoscopic (3D) display with, for example, N viewpoints, multiple independent pixels on the display panel are required to project multiple viewpoints in space. Since the total resolution of the display panel is a fixed value, the resolution will drop sharply, for example, the column resolution will drop to 1 / N of the original resolution. Due to the pixel arrangement of the multi-viewpoint display, this will also result in different reductions in horizontal and vertical resolution.

[0004] To maintain high-definition display, for example, when providing a 3D display with N viewpoints, which is N times higher than a 2D display, the required transmission bandwidth from the terminal to the display also increases by N times, resulting in excessive signal transmission. Furthermore, pixel-by-pixel rendering of such N-fold higher-resolution images significantly consumes computing resources on the terminal or display itself, resulting in a significant performance degradation.

[0005] This background technology is only for the purpose of facilitating understanding of the relevant technology in this field and is not to be regarded as an admission of the prior art. Summary of the Invention

[0006] The embodiments of the present invention intend to provide a multi-viewpoint naked-eye stereoscopic display and a display method thereof, which intend to overcome or alleviate the problem of resolution degradation of naked-eye stereoscopic display without occupying excessive transmission bandwidth or rendering computing resources.

[0007] Furthermore, the inventors have recognized that, due to factors such as the installation, material, or alignment of the grating, the pixels of the display screen viewed from a spatial viewpoint may not correspond to the "ideal" pixels (or vice versa). Some embodiments of the present invention provide novel technical solutions to this problem.

[0008] In one technical solution, a multi-viewpoint naked-eye stereoscopic display is provided, characterized in that it includes a display screen having a display panel and a grating, a video signal interface for receiving a 3D video signal, and one or more 3D video processing units, wherein the display panel includes multiple rows and columns of pixels and defines multiple pixel groups, each pixel group is composed of at least 3 pixels and corresponds to a multi-viewpoint setting, wherein the one or more 3D video processing units are configured to generate multiple images corresponding to all viewpoints or predetermined viewpoints based on the image of the 3D video signal and render the corresponding pixels in each pixel group according to the generated multiple images.

[0009] In the technical solution of the embodiment of the present invention, the generated image is generated from the image of the received 3D video signal corresponding to all viewpoints or predetermined viewpoints in a "resolution lossless" manner, that is, the image is generated and the pixels are rendered "point-to-point" from the image of the original 3D video signal according to the required (all or predetermined) viewpoints. This advantageously overcomes the problem of resolution degradation existing in the prior art. In the embodiment of the present invention, the "resolution lossless" or "point-to-point" rendering explicitly includes that the image corresponding to a single viewpoint has the same resolution as the image (frame) of the received 3D video signal and the pixels corresponding to each viewpoint in each pixel group (or the pixels determined according to the pixel-viewpoint correspondence relationship) correspond substantially point-by-point to the generated image (and thus the received image). The "resolution lossless" or "point-to-point" rendering may also include the following embodiments, namely, interpolating the received 3D video signal or increasing the resolution in other ways, and then generating an image for each viewpoint corresponding to the interpolated or resolution-increased image in a "resolution lossless" manner and correspondingly rendering the pixels corresponding to each viewpoint in each pixel group (or the pixels determined according to the pixel-viewpoint correspondence relationship).

[0010] In one embodiment, the mutual arrangement positions of the plurality of pixel groups are adjusted or determined based on optical relationship data between pixels and gratings and / or corresponding relationship data between pixels of the display panel and viewpoints.

[0011] In one embodiment, the grating comprises a cylindrical prism grating, and the optical relationship between the pixel and the grating comprises an alignment relationship between the pixel and the cylindrical prism grating and / or a refractive state of the cylindrical prism grating relative to the corresponding pixel.

[0012] In one embodiment, the grating includes a front and / or rear parallax barrier grating, the parallax barrier grating includes a light-shielding portion and a light-transmitting portion, and the optical relationship between the pixel and the grating includes an alignment relationship between the pixel and the corresponding light-transmitting portion of the parallax barrier grating.

[0013] In one embodiment, the correspondence between pixels and viewpoints is calculated or determined based on an optical relationship between the pixels and the grating.

[0014] In one embodiment, the correspondence between pixels and viewpoints is determined by measuring at each viewpoint position.

[0015] In one embodiment, the multi-viewpoint naked-eye stereoscopic display further comprises a memory storing the optical relationship data and / or pixel-viewpoint correspondence relationship data, and the one or more 3D video processing units are configured to read the data in the memory.

[0016] In one embodiment, the received 3D video signal includes a received depth image and a rendered color image, and the generated image includes a generated depth image and a rendered color image.

[0017] In one embodiment, the received 3D video signal includes a received depth image and a rendered color image, and the generated image includes a generated first parallax image and a second parallax image.

[0018] In one embodiment, the received 3D video signal includes a received first parallax image and a received second parallax image, and the generated image includes a generated first parallax image and a generated second parallax image.

[0019] In one embodiment, the received 3D video signal includes a received first parallax image and a received second parallax image, and the generated image includes a generated depth image and a rendered color image.

[0020] In one embodiment, a plurality of 3D video processing units are provided in the multi-viewpoint naked-eye stereoscopic display, and each 3D video processing unit is configured to be allocated multiple rows or columns of pixels and render its own multiple rows or columns of pixels. In one embodiment, the multiple 3D video processing units can sequentially allocate and render their respective multiple rows or columns of pixels. For example, assuming that four 3D video processing units are provided and the display panel is provided with a total of M columns of pixels, each 3D video processing unit is sequentially allocated M / 4 columns of pixels, for example, from left to right or from right to left.

[0021] In some embodiments of the present invention, pixel driving and rendering of the display panel are performed in a row-by-row scanning manner.

[0022] In some preferred embodiments of the present invention, the 3D video processing units each allocating multiple columns of pixels are combined with the progressive scanning, which has an outstanding effect and effectively reduces the computing bandwidth.

[0023] In one embodiment, the one or more 3D video processing units are FPGA or ASIC chips or chipsets.

[0024] In one embodiment, the 3D video signal is a single-channel signal, and the one or more 3D video processing units are configured to generate multiple images corresponding to all viewpoints based on the single-channel 3D video signal and render all pixels in each pixel group.

[0025] In one embodiment, the 3D video signal is a multi-channel signal, wherein the number of multiple viewpoints is N, the number of multi-channel signals is M, and N≥M. The one or more 3D video processing units are configured to generate N images corresponding to all viewpoints and render all pixels in each pixel group, and each generated image is generated based on one of the M signals.

[0026] In one embodiment, the multi-viewpoint naked-eye stereoscopic display further includes an eye tracking device or an eye tracking data interface for acquiring eye tracking data.

[0027] In one embodiment, the one or more 3D video processing units are configured to generate multiple images corresponding to predetermined viewpoints based on the images of the 3D video signal and render corresponding pixels in each pixel group according to the generated multiple images, wherein the predetermined viewpoint is determined by real-time eye tracking data of the viewer.

[0028] In one embodiment, the one or more 3D video processing units are configured to, when each eyeball of the viewer is located at a single viewpoint, generate an image corresponding to the single viewpoint based on the image of the 3D video signal and render the pixels corresponding to the single viewpoint in each pixel group.

[0029] In one embodiment, the one or more 3D video processing units are configured to further generate images corresponding to viewpoints adjacent to the single viewpoint and further render pixels corresponding to the adjacent viewpoints in each pixel group.

[0030] In one embodiment, the one or more 3D video processing units are configured to, when each eyeball of the viewer is located between two viewpoints, generate images corresponding to the two viewpoints based on the image of the 3D video signal and render pixels corresponding to the two viewpoints in each pixel group.

[0031] In one embodiment, the 3D video signal is a single-channel signal, and the one or more 3D video processing units are configured to, when there are multiple viewers, generate the multiple images and render corresponding pixels in each pixel group for the viewpoint corresponding to the eyeball of each viewer based on the single-channel signal.

[0032] In one embodiment, the 3D video signal is a multi-channel signal, and the one or more 3D video processing units are configured to, when there are multiple viewers, generate the multiple images based on different 3D video signals and render corresponding pixels in each pixel group for viewpoints corresponding to respective eyeballs of at least some of the viewers.

[0033] In one embodiment, the display panel is a self-luminous display panel, and the self-luminous display panel is configured so that unrendered pixels do not emit light. Preferably, the display panel is a MICRO-LED display panel.

[0034] In another technical solution, a multi-viewpoint naked-eye stereoscopic display is provided, comprising a display screen having a display panel and a grating, a video signal interface, and one or more 3D video processing units, wherein the display panel comprises multiple rows and columns of pixels and defines multiple pixel groups, each pixel group being composed of at least 3 pixels and corresponding to a multi-viewpoint setting, wherein the multiple pixel groups have irregular relative arrangement positions and are adjusted or determined based on optical relationship data between pixels and the grating and / or correspondence data between pixels of the display panel and viewpoints, wherein the one or more 3D video processing units are configured to render corresponding pixels in each pixel group.

[0035] Compared with the conventional method of improving accuracy to overcome alignment errors, installation errors, and material errors, the embodiments of the present invention provide a simple, highly reliable, high-definition, and resolution-lossless naked-eye stereoscopic display by simply adjusting the arrangement of pixel groups.

[0036] In one embodiment, the grating comprises a cylindrical prism grating, and the optical relationship between the pixel and the grating comprises an alignment relationship between the pixel and the cylindrical prism grating and / or a refractive state of the cylindrical prism grating relative to the corresponding pixel.

[0037] In one embodiment, the grating includes a front and / or rear parallax barrier grating, the parallax barrier grating includes a light-shielding portion and a light-transmitting portion, and the optical relationship between the pixel and the grating includes an alignment relationship between the pixel and the corresponding light-transmitting portion of the parallax barrier grating.

[0038] In one embodiment, the correspondence between pixels and viewpoints is calculated or determined based on an optical relationship between the pixels and the grating.

[0039] In one embodiment, the correspondence between pixels and viewpoints is determined by measuring at each viewpoint position.

[0040] In one embodiment, the multi-viewpoint naked-eye stereoscopic display further includes a memory storing the optical relationship data and / or pixel-viewpoint correspondence relationship data, and the one or more 3D video processing units are configured to read the data in the memory.

[0041] In another technical solution, a multi-viewpoint autostereoscopic display is provided, comprising a display screen having a display panel and a grating, and a memory. The display panel comprises multiple rows and columns of pixels, and the memory stores optical relationship data between each pixel of the display panel and the grating, and / or corresponding relationship data between each pixel of the display panel and viewpoints. The stored data can be used for autostereoscopic display according to the present invention, particularly "resolution-lossless" autostereoscopic display.

[0042] Compared with conventional methods of improving accuracy to overcome alignment errors, installation errors, and material errors, the embodiments of the present invention provide a simple, highly reliable, high-definition, and resolution-lossless naked-eye stereoscopic display.

[0043] In one embodiment, the grating comprises a cylindrical prism grating, and the optical relationship between the pixel and the grating comprises an alignment relationship between the pixel and the cylindrical prism grating and / or a refractive state of the cylindrical prism grating relative to the corresponding pixel.

[0044] In one embodiment, the grating includes a front and / or rear parallax barrier grating, the parallax barrier grating includes a light-shielding portion and a light-transmitting portion, and the optical relationship between the pixel and the grating includes an alignment relationship between the pixel and the corresponding light-transmitting portion of the parallax barrier grating.

[0045] In one embodiment, the correspondence between pixels and viewpoints is calculated or determined based on an optical relationship between the pixels and the grating.

[0046] In one embodiment, the correspondence between pixels and viewpoints is determined by measuring at each viewpoint position.

[0047] In one embodiment, the multi-viewpoint naked-eye stereoscopic display further includes a video signal interface for receiving a 3D video signal and one or more 3D video processing units, wherein the one or more 3D video processing units are configured to generate multiple 3D video images corresponding to some or all viewpoints based on the received video signal, and the one or more 3D video processing units are further configured to read the alignment relationship data between each pixel of the display panel and the grating and / or the correspondence relationship data between each pixel of the display panel and the viewpoint and render the pixels corresponding to some or all viewpoints based on the data.

[0048] In another technical solution, a naked-eye stereoscopic display system is provided, including a processor unit and the multi-viewpoint naked-eye stereoscopic display according to an embodiment of the present invention, wherein the processor unit is communicatively connected to the multi-viewpoint naked-eye stereoscopic display.

[0049] In one embodiment, the naked-eye stereoscopic display system is configured as a smart TV having the processor unit.

[0050] In one embodiment, the naked-eye stereoscopic display system is a smart cellular phone, a tablet computer, a personal computer, or a wearable device.

[0051] In one embodiment, the naked-eye stereoscopic display system includes a set-top box or a cellular phone or tablet computer with screen projection as the processor unit and a digital TV connected to the set-top box, cellular phone or tablet computer by wire or wirelessly as a multi-viewpoint naked-eye stereoscopic display.

[0052] In one embodiment, the naked-eye stereoscopic display system is constructed as a smart home system or a part thereof, wherein the processor unit includes a smart gateway or central controller of the smart home system, and the smart home system also includes an eye tracking device for obtaining eye tracking data.

[0053] In one embodiment, the autostereoscopic display system is configured as an entertainment interactive system or a part thereof. Preferably, the entertainment interactive system is configured to be suitable for use by multiple people and to generate multiple 3D video signals based on multiple users for transmission to the autostereoscopic display system.

[0054] In another technical solution, a method for displaying a multi-viewpoint autostereoscopic display is provided. The display includes a display screen having a display panel and a grating, wherein the display panel includes multiple rows and columns of pixels. The method includes the following steps: defining multiple pixel groups, each pixel group consisting of at least three pixels and corresponding to a multi-viewpoint configuration; receiving a 3D video signal; generating multiple images corresponding to all viewpoints or predetermined viewpoints based on an image in the received 3D video signal; and rendering corresponding pixels in each pixel group based on the generated multiple images.

[0055] In one embodiment, the step of defining the plurality of pixel groups includes adjusting or determining the relative arrangement positions of the plurality of pixel groups based on optical relationship data between pixels and gratings and / or corresponding relationship data between pixels of the display panel and viewpoints.

[0056] In one embodiment, the display method further comprises the steps of: receiving or reading real-time eye tracking data from a viewer; the generating step comprises determining the predetermined viewpoint based on the real-time eye tracking data from the viewer; and the rendering step comprises rendering the pixels in each pixel group corresponding to the predetermined viewpoint.

[0057] In another technical solution, a method for displaying a multi-viewpoint autostereoscopic display is provided. The display includes a display screen having a display panel and a grating, wherein the display panel includes multiple rows and columns of pixels. The method includes the following steps: obtaining optical relationship data between each pixel of the display panel and the grating and / or corresponding relationship data between each pixel of the display panel and a viewpoint; receiving a 3D video signal; generating multiple images corresponding to all viewpoints or predetermined viewpoints based on an image of the received 3D video signal; and rendering corresponding pixels based on the generated multiple images. The corresponding pixels to be rendered are determined based on the obtained optical relationship data and / or the corresponding relationship data between each pixel and a viewpoint.

[0058] In one embodiment, the step of acquiring data includes measuring alignment data between each pixel and the grating and / or a refraction state of the cylindrical prism grating relative to each pixel as the optical relationship data.

[0059] In one embodiment, the step of acquiring data includes calculating or determining a correspondence between pixels and viewpoints based on an optical relationship between the pixels and the grating, or determining the correspondence between pixels and viewpoints by measuring at each viewpoint position.

[0060] In another technical solution, a method for arranging pixel groups for a multi-viewpoint autostereoscopic display is provided, comprising the following steps: providing a display screen having a display panel and a grating, wherein the display panel includes multiple rows and columns of pixels; obtaining optical relationship data between each pixel of the display panel and the grating and / or corresponding relationship data between each pixel of the display panel and a viewpoint; and defining multiple pixel groups based on the obtained optical relationship data and / or corresponding relationship data between each pixel and the viewpoint, each pixel group consisting of at least three pixels and corresponding to a multi-viewpoint setting. The defined multiple pixel groups are used for multi-viewpoint autostereoscopic display of the display.

[0061] Preferred features of the invention are described in part below and in part will be apparent from reading the text. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings, wherein:

[0063] Figure 1A A schematic structural diagram of a multi-viewpoint naked-eye stereoscopic display according to an embodiment of the present invention is shown.

[0064] Figure 1B A schematic structural diagram of a multi-viewpoint naked-eye stereoscopic display according to an embodiment of the present invention is shown.

[0065] Figure 1C A schematic structural diagram of a multi-viewpoint naked-eye stereoscopic display according to an embodiment of the present invention is shown.

[0066] Figure 2 Shown Figure 1A-1C A schematic structural diagram of pixels in a display panel corresponding to viewpoints in the illustrated embodiment.

[0067] Figure 3 Schematically shows Figure 1A-1C The embodiment shown is a schematic diagram of generating images corresponding to various viewpoints from images (frames) of a received 3D video signal.

[0068] Figure 4 A schematic structural diagram of a single 3D video processing unit of a multi-viewpoint naked-eye stereoscopic display according to an embodiment of the present invention is shown.

[0069] Figure 5 A schematic structural diagram of multiple 3D video processing units of a multi-viewpoint naked-eye stereoscopic display according to an embodiment of the present invention is shown.

[0070] Figure 6 Schematically shows Figure 1A-1C The embodiment shown is a schematic diagram of generating images corresponding to various viewpoints from images (frames) of a received 3D video signal.

[0071] Figure 7A A schematic structural diagram of a multi-viewpoint naked-eye stereoscopic display according to an embodiment of the present invention is shown, and schematically illustrates the deviation in the correspondence between pixels in certain pixel groups and viewpoints.

[0072] Figure 7B Shown Figure 7A A structural diagram of a multi-viewpoint naked-eye stereoscopic display of an embodiment of the present invention is provided, and the correspondence between the adjusted pixels and the viewpoints is schematically presented.

[0073] Figure 8 A schematic structural diagram of a multi-viewpoint naked-eye stereoscopic display according to an embodiment of the present invention is shown, and the correspondence between each pixel of the display panel and the viewpoint is schematically presented.

[0074] Figure 9 A partial structural schematic diagram of a multi-viewpoint naked-eye stereoscopic display according to an embodiment of the present invention is shown, which adopts a cylindrical prism grating.

[0075] Figure 10 A partial structural schematic diagram of a multi-viewpoint naked-eye stereoscopic display according to an embodiment of the present invention is shown, which adopts a cylindrical prism grating.

[0076] Figure 11 A partial structural schematic diagram of a multi-viewpoint naked-eye stereoscopic display according to an embodiment of the present invention is shown, which adopts a parallax barrier grating.

[0077] Figure 12A schematic structural diagram of a multi-viewpoint naked-eye stereoscopic display using real-time eye tracking data according to an embodiment of the present invention is shown, wherein each eye corresponds to a viewpoint.

[0078] Figure 13 A schematic structural diagram of a multi-viewpoint naked-eye stereoscopic display using real-time eye tracking data according to an embodiment of the present invention is shown, wherein each eye corresponds to a viewpoint.

[0079] Figure 14 A schematic structural diagram of a multi-viewpoint naked-eye stereoscopic display using real-time eye tracking data according to an embodiment of the present invention is shown, wherein each eye is located between two viewpoints.

[0080] Figure 15 A schematic structural diagram of a multi-viewpoint naked-eye stereoscopic display using real-time eye tracking data according to an embodiment of the present invention is shown, wherein eyeballs move.

[0081] Figure 16 A schematic structural diagram of a multi-viewpoint auto-stereoscopic display using real-time eye tracking data according to an embodiment of the present invention is shown, wherein there are multiple viewers.

[0082] Figure 17 Schematically shows Figure 16 The embodiment shown is a schematic diagram of generating an image corresponding to a predetermined viewpoint from images (frames) of two received 3D video signals.

[0083] Figure 18 The multi-viewpoint autostereoscopic display system according to an embodiment of the present invention is schematically shown as being constructed into a cellular phone or a part thereof.

[0084] Figure 19 The multi-viewpoint naked-eye stereoscopic display system according to an embodiment of the present invention is schematically shown as a digital television connected to a set-top box.

[0085] Figure 20 The multi-viewpoint naked-eye stereoscopic display system according to an embodiment of the present invention is schematically shown as being configured as a smart home system or a part thereof.

[0086] Figure 21 The multi-viewpoint naked-eye stereoscopic display system according to an embodiment of the present invention is schematically shown as an entertainment interactive system or a part thereof. DETAILED DESCRIPTION

[0087] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention will be further described in detail below in conjunction with specific embodiments and accompanying drawings. Here, the exemplary embodiments of the present invention and their descriptions are used to explain the present invention, but are not intended to limit the present invention.

[0088] definition

[0089] In this article, "naked eye stereoscopic (3D) display" refers to technologies that enable viewers to observe three-dimensional display images on a flat display without wearing stereoscopic display glasses, including but not limited to "parallax barrier", "cylindrical lens" and "directional backlight" technologies.

[0090] In this document, "grating" has the broadest interpretation in the art, including but not limited to "parallax barrier" grating and "lenticular lens" grating.

[0091] In this article, "multi-viewpoint" has the conventional meaning in the art, meaning a sequence (frame) of parallax images formed at different positions (viewpoints) in space. In this article, multi-viewpoint will mean at least 3 viewpoints.

[0092] refer to Figure 1A In one embodiment of the present invention, a naked-eye stereoscopic display system is provided, which may include a processor unit and a multi-viewpoint naked-eye stereoscopic display, wherein the processor unit is communicatively connected to the multi-viewpoint naked-eye stereoscopic display. In some embodiments herein, the processor unit includes a processing / transmission / forwarding / control device for sending a 3D video signal to the naked-eye stereoscopic display, which may be a device having the functions of both generating and transmitting a 3D video signal, or a device that processes or does not process a received 3D video signal and forwards it to a display. In some embodiments, the processor unit may be included in or referred to as a processing terminal or terminal.

[0093] The multi-viewpoint naked-eye stereoscopic display may include a display screen having a display panel and a grating (not shown), a video signal interface for receiving a 3D video signal, and a 3D video processing unit. Figure 2 In the embodiment shown, the display may have 12 viewpoints (V1-V12), but it is contemplated that it may have more or fewer viewpoints.

[0094] In an embodiment of the present invention, the display may further selectively include a timing controller and / or a display driver chip, which may be integrated with the 3D video processing unit or independently provided.

[0095] In some embodiments of the present invention, the display may further include a memory to store required data. Some embodiments of the display incorporating a memory will be further described below.

[0096] Continue to refer Figure 1A The display panel may include multiple rows and columns of pixels and define multiple pixel groups. In the embodiment shown, for illustrative purposes, only two exemplary pixel groups PG are shown. 1,1 and PG x,y, each pixel group corresponds to a multi-viewpoint setting, and each has 12 pixels (P1-P12). As an illustrative embodiment, the pixels in the pixel group are arranged in a single row and multiple columns, but other arrangements are conceivable, such as a single column with multiple rows or multiple rows and multiple columns. For illustrative purposes only, the aforementioned PG x,y The pixel group at the Xth row and the Yth column can be schematically represented.

[0097] Combined with reference Figure 1A and Figure 2 , describing the display of this embodiment. As previously described, the display can have 12 viewpoints V1-V12. At each viewpoint (spatial location), the viewer's eyes can see the display of corresponding pixels in each pixel group in the display panel, and thus see different rendered images. The two different images seen by the viewer's two eyes at different viewpoints form parallax, which is synthesized into a three-dimensional image in the brain.

[0098] In an embodiment of the present invention, one or more 3D video processing units are configured to generate images for display and render pixels in such a manner that multiple images corresponding to all viewpoints are generated based on the image of the 3D video signal and corresponding pixels in each pixel group are rendered according to the generated multiple images.

[0099] Accordingly, embodiments of the present invention may also provide a method for displaying a multi-viewpoint autostereoscopic display, the method comprising the following steps: defining a plurality of pixel groups, each pixel group consisting of at least three pixels and corresponding to a multi-viewpoint setting; receiving a 3D video signal; generating a plurality of images corresponding to all or predetermined viewpoints based on an image of the received 3D video signal; and rendering corresponding pixels in each pixel group based on the generated plurality of images. In the illustrated embodiment, image generation and pixel rendering are performed for all (12) viewpoints.

[0100] Combined with reference Figure 1A 、 Figure 2 and Figure 3 , describing the processing of the 3D video processing unit in the illustrated embodiment. The 3D video signal S1 received by the video signal interface is an image frame containing both a color image and depth of field content. Therefore, the 3D video processing unit uses the image information and depth of field information of the received 3D video signal S1 as input and renders 12 images corresponding to viewing angles from viewpoints V1-V12. The content of each generated image is then written to the pixels corresponding to each viewpoint.

[0101] Therefore, when the viewer's eyes watch at different viewpoints V1-V12, they can see the rendered images at different angles, generating parallax to form a stereoscopic effect of 3D display.

[0102] In some embodiments, the 12 frames generated above are generated with "lossless resolution" and, in particular, with the same resolution as the corresponding image frames of the received 3D video signal. Moreover, in these embodiments, the corresponding written pixels also basically correspond point by point to the resolution of the generated image (and thus the resolution of the image of the received 3D video signal).

[0103] In some embodiments, the received 3D video signal may also be subjected to a resolution increase (multiplication) process, such as an interpolation process, or referred to as pre-processing. As an illustrative example, for example, both the color image and the depth of field image may be interpolated with a 2-fold line resolution. This may then be combined with the "resolution lossless" and / or "point-to-point rendering" processes described in the embodiments of the present invention to obtain new embodiments. It will be understood that the "resolution lossless" and / or "point-to-point rendering" processes combined with interpolation or other resolution increase processes, or themselves, fall within the scope of the "resolution lossless" and / or "point-to-point rendering" processes described in the present invention. In this document, the generation of images of corresponding viewpoints combined with resolution increase may sometimes also be referred to as resolution increase (multiplication) generation.

[0104] In some embodiments of the present invention, an additional (pre)processor may be provided to perform the resolution increase (multiplication) or interpolation, or the resolution increase (multiplication) or interpolation may be performed by the one or more 3D video processing units, which falls within the scope of the invention.

[0105] In some embodiments of the present invention, a display system or display may include an eye tracking device or may be capable of reading eye tracking data.

[0106] refer to Figure 1BIn one embodiment of the present invention, a naked-eye stereoscopic display system is provided, which may include a processor unit and a multi-viewpoint naked-eye stereoscopic display, wherein the processor unit is communicatively connected to the multi-viewpoint naked-eye stereoscopic display. In the illustrated embodiment, the display may be integrated with an eye-tracking device, which may be directly communicatively connected to the 3D video processing unit. In some embodiments not shown, the display may be provided with a memory to store eye-tracking data, and the 3D video processing unit is connected to the memory and reads the eye-tracking data. Preferably, the eye-tracking data is real-time data. In the illustrated embodiment, the eye-tracking device may, for example, be in the form of a dual camera. In other embodiments of the present invention, other forms of eye-tracking devices may be used, such as a single camera, a combination of an eye-tracking camera and a depth-of-field camera, or other sensing devices or combinations thereof that can be used to determine the viewer's eye position. In some embodiments of the present invention, the eye-tracking device may have other functions or be shared with other functions or components. For example, in one embodiment, a display system configured as a cellular phone may use the cellular phone's built-in front-facing camera as an eye-tracking device.

[0107] Alternatively, the display may further include an eye tracking data transmission interface, and the 3D processing unit may read real-time eye tracking data via the eye tracking data transmission interface.

[0108] refer to Figure 1C In one embodiment, a naked-eye stereoscopic display system is provided, which may include a processor unit and a multi-viewpoint naked-eye stereoscopic display, wherein the processor unit is communicatively connected to the multi-viewpoint naked-eye stereoscopic display. In the illustrated embodiment, the naked-eye stereoscopic display system may further include an eye tracking device, for example in the form of a dual camera, which is communicatively connected to the processor unit. Furthermore, the display may include an eye tracking data interface, and the 3D processing unit may be communicatively connected to the processor unit via the eye tracking data transmission interface to read real-time eye tracking data.

[0109] In some embodiments not shown, the processor unit may not be equipped with or connected to an eye-tracking device, but may instead read real-time eye-tracking data on its own. Alternatively, the 3D processing unit may obtain real-time eye-tracking data from other sources via an eye-tracking data interface. All of these fall within the scope of the present invention.

[0110] The embodiments of the present invention that utilize an eye-tracking device can be combined with the above-described embodiments to yield further embodiments. For example, the "resolution-lossless" embodiments of the present invention can be combined with conventional use of an eye-tracking device or data to yield new embodiments. Alternatively, further improvements can be made using the eye-tracking device or data to yield preferred embodiments, as further described below.

[0111] In one embodiment, the generated image content is written (rendered) to the pixels of the display panel by writing (rendering) row by row, which greatly reduces the pressure of rendering calculation.

[0112] In one embodiment of the present invention, the row-by-row writing (rendering) process is performed in the following manner: information of corresponding points in each generated image is read respectively and written into pixels of the display panel row by row.

[0113] In another embodiment of the present invention, the method further includes synthesizing the multiple generated images into a composite image, reading information of corresponding points in the composite image, and writing the information into pixels of the display panel row by row.

[0114] Continue to refer Figure 4 , shows another embodiment of a display according to the present invention. In the embodiment shown, only a single 3D video processing unit is provided, which simultaneously processes image generation corresponding to multiple viewpoints and rendering of corresponding multiple pixels in a pixel group.

[0115] In some embodiments of the present invention, multiple 3D video processing units may be provided, which process image generation and pixel rendering in parallel, serially, or in combination of serial and parallel.

[0116] refer to Figure 5 , shows a preferred embodiment of a display including multiple 3D video processing units according to the present invention. In this embodiment, multiple 3D video processing units, i.e., a 3D video processing unit group, are provided. More preferably, the multiple parallel 3D video processing units are sequentially arranged in parallel corresponding to their respective multiple columns of pixels. Thus, each 3D video processing unit can particularly process pixel rendering in parallel. That is, each 3D video processing unit can correspondingly process the rendering of its own pixels (columns). Figure 5 As shown by way of example, when the display panel has a total of M columns of pixels, if four parallel 3D video processing units (groups) are provided, the first 3D video processing unit processes the first M / 4 columns of pixels, the second 3D video processing unit processes the second M / 4 columns of pixels, the third 3D video processing unit processes the third M / 4 columns of pixels, and the fourth 3D video processing unit processes the fourth M / 4 columns of pixels.

[0117] The arrangement of such a 3D video processing unit (group) simplifies the structure and greatly speeds up the processing process. In particular, this embodiment is suitable for combining with the aforementioned embodiment of reading each generated image separately to write (render) the processing line by line to obtain a further preferred embodiment. For example, Figure 5Taking the illustrated embodiment as an example, when scanning row by row, the first through fourth columns can sequentially process and render each M / 4 column of pixels in the first row. For example, after the first 3D video processing unit completes processing, while other video processing units sequentially proceed, the first 3D video processing unit has ample time to prepare for processing the corresponding M / 4 columns of pixels in the next row (e.g., the second row), such as the first M / 4 columns of pixels in the second row. This significantly overcomes the problem of severely insufficient rendering computing power that may arise in conventional architectures.

[0118] Those skilled in the art will understand that the embodiments shown in the drawings are merely exemplary, and that there may be more or fewer 3D video processing units, or that the 3D video processing units (groups) may be allocated in other ways and process the multiple rows and columns of pixels in parallel, all of which fall within the scope of the present invention.

[0119] refer to Figure 1A-1C 、 Figure 2 and Figure 6 , shows a naked-eye stereoscopic display system according to another embodiment of the present invention, which may include a processor unit and a multi-viewpoint naked-eye stereoscopic display, wherein the processor unit is communicatively connected to the multi-viewpoint naked-eye stereoscopic display. In the illustrated embodiment, the naked-eye stereoscopic display system may also include an eye tracking device, for example in the form of dual cameras, which is communicatively connected to the processor unit.

[0120] The multi-viewpoint naked-eye stereoscopic display may include a display screen having a display panel and a grating (not shown), a video signal interface for receiving a 3D video signal, and a 3D video processing unit. Figure 2 In the embodiment shown, the display may have 12 viewpoints (V1-V12), but it is conceivable that it may have more or fewer viewpoints. In the embodiment shown, the display may also include an eye tracking data interface. The 3D processing unit may be communicatively connected to the processor unit via the eye tracking data transmission interface to read real-time eye tracking data. In an embodiment of the present invention, the display may further optionally include a timing controller and / or a display driver chip, which may be integrated with the 3D video processing unit or independently provided. In some embodiments of the present invention, the display may be integrated with an eye final device, which may be directly communicatively connected to the 3D video processing unit.

[0121] The display panel may include multiple rows and columns of pixels and define multiple pixel groups. In the embodiment shown, for illustrative purposes, only two illustrative pixel groups PG are shown. 1,1 and PG x,y , each pixel group corresponds to a multi-view setting and has its own 12 pixels (P1-P12).

[0122] Combined with reference Figure 1A-1C and Figure 2, describing the display of the display of this embodiment. As mentioned above, the display can have 12 viewpoints V1-V12. The viewer's eyes can see the display of the corresponding pixel points in each pixel group in the display panel at each viewpoint (spatial position), and then see different rendered images. The two different images seen by the viewer's two eyes at different viewpoints form parallax, and a three-dimensional image is synthesized in the brain.

[0123] Combined with reference Figure 1A-1C 、 Figure 2 and Figure 6 , describing the processing of the 3D video processing unit in the specific embodiment shown. The 3D video signal S1 received by the video signal interface is an image frame containing two contents of left and right parallax color images. Therefore, the 3D video processing unit takes the left and right parallax color images of the received 3D video signal S1 as input and generates intermediate image information I1 therefrom. In a specific embodiment, on the one hand, the left and right parallax color images are used to synthesize a depth image. On the other hand, a color image of the center point is generated with the help of one or both of the left and right parallax color images. Then, the intermediate image information I1, i.e., the depth image information and the color image information of the center point, is used as input to render 12 pictures according to the viewing angles corresponding to the viewpoints V1-V12. Then, the content of each generated image is written into the corresponding pixel in each pixel group corresponding to each viewpoint.

[0124] Therefore, when the viewer's eyes watch at different viewpoints V1-V12, they can see the rendered images at different angles, generating parallax to form a stereoscopic effect of 3D display.

[0125] In some embodiments, the 12 frames generated above are generated with "lossless resolution" and, in particular, with the same resolution as the corresponding image frames of the received 3D video signal. Moreover, in these embodiments, the corresponding written pixels also basically correspond point by point to the resolution of the generated image (and thus the resolution of the image of the received 3D video signal).

[0126] In some embodiments, the received 3D video signal may also be processed to increase (multiply) the resolution, such as interpolation, or pre-processing. As an illustrative example, for example, the left-eye and right-eye parallax images may both be interpolated with 2 times the line resolution. The "resolution lossless" and / or "point-to-point rendering" processing described in the embodiments of the present invention may then be combined to obtain a new embodiment, and the image conversion processing may be performed as described above before processing, all of which fall within the scope of the invention. It will be understood that the "resolution lossless" and / or "point-to-point rendering" processing combined with interpolation or other resolution increase processing, or itself, falls within the scope of the "resolution lossless" and / or "point-to-point rendering" processing described in the present invention. In this article, the generation of images of corresponding viewpoints combined with resolution increase may sometimes also be referred to as resolution increase (multiplication) generation.

[0127] In some embodiments of the present invention, an additional (pre)processor may be provided to perform the resolution increase (multiplication) or interpolation, or the resolution increase (multiplication) or interpolation may be performed by the one or more 3D video processing units, which falls within the scope of the invention.

[0128] refer to Figure 7A and Figure 7B , showing a naked-eye stereoscopic display system and a display thereof according to another embodiment of the present invention.

[0129] Although not shown, the display panel of the naked-eye stereoscopic display according to an embodiment of the present invention has multiple rows and columns of pixels. For "multi-viewpoint" display, the multiple rows and columns of pixels are divided into multiple groups in a manner corresponding to multiple viewpoints. For example, in the embodiment shown, each pixel group includes a row of 12 pixels corresponding to 12 viewpoints. In a conventional configuration, the pixel groups are arranged in a regular manner. For example, in a pixel group consisting of a single row and multiple columns of pixels, the pixel groups are arranged in sequence in the same row, for example, the pixel groups PG in the same row 1，i (i≥1) are arranged end to end; pixel groups are aligned in the same column, for example, pixel groups PG in the same column j,1 (j≥1) are arranged vertically aligned. As an illustrative embodiment, the pixels in the pixel group are arranged in a single row and multiple columns, but other arrangements are conceivable, such as a single column with multiple rows or multiple rows with multiple columns. In conventional configurations, other pixel groups PG are still regularly arranged relative to each other.

[0130] Ideally, the corresponding pixels in the regularly arranged pixel groups are correctly displayed at the corresponding viewpoints. However, the inventors have recognized that due to factors such as the installation, material, or alignment of the grating, the pixels of the display screen viewed from a viewpoint in space may not correspond to the "ideal" pixels (or vice versa).

[0131] For example Figure 7A As shown by way of example, the display panel shown has a plurality of pixel groups PG distributed regularly, including PG 1,1 and PG x,y In the embodiment shown, the pixel group PG 1,1 The corresponding pixels in PG are correctly displayed in the corresponding viewpoints V1-V12. However, the pixel group PG that should be displayed in the corresponding viewpoints V1-V12 "theoretically" x,y The pixels of are actually displayed in viewpoints V1'-V12', respectively. (In the embodiment shown, V1' corresponds to V3).

[0132] refer to Figure 7B As shown, in the exemplary embodiment shown, the multi-viewpoint autostereoscopic display is configured to have pixel groups with irregular relative positions, that is, the pixel groups are adjusted relative to the "regular" arrangement. Such adjustment is adjusted or determined based on the correspondence between the pixels of the display panel and the viewpoints. In the specific embodiment shown, based on the correspondence between the pixels and the viewpoints, the pixel group PG' x,y This adjustment or determination is made, that is, compared to the "regular" arrangement of pixel groups PG x,y Shift two pixels to the left of the image. Thus, the adjusted "irregular" arrangement of pixel group PG' x,y The pixels in are correctly displayed at the corresponding viewpoints V1-V12.

[0133] Although the illustrated embodiment provides horizontal (row) adjustment of a pixel group consisting of a single row and multiple columns of pixels, adjustment in other directions is contemplated, such as vertical (column) adjustment or a combination of horizontal and vertical adjustment. Furthermore, horizontal, vertical, and / or combined adjustment of pixel groups consisting of other pixel arrangements is also contemplated.

[0134] In the illustrated embodiment, the adjustment of the aforementioned "irregular" pixel group is directly adjusted based on the correspondence between the pixels and the viewpoints. In certain embodiments, the "irregular" correspondence between the pixels and the viewpoints is determined based on an optical relationship, such as an alignment relationship or a refraction relationship, between the pixels and the grating. Therefore, in some embodiments, the "irregular" pixel group can be adjusted or determined based on the optical relationship between the pixels and the grating. In other embodiments, the "irregular" or actual alignment relationship between the pixels and the viewpoints can be determined through direct measurement.

[0135] In some embodiments, the optical data and / or alignment relationship data can be stored in a memory so that the 3D video processing unit can read the data during processing. In an alternative embodiment, a data interface that communicates with the 3D video processing unit can be provided so that the 3D video processing unit can read the optical data and / or alignment relationship data via the data interface. In an alternative embodiment, the optical data and / or alignment relationship data can be directly written into the 3D video processing unit or as part of its algorithm. This all falls within the scope of the present invention.

[0136] Combined with reference Figure 1A-1C 、 Figure 3 、 Figure 6 as well as Figures 7A-7B , describes the processing of the 3D video processing unit of the embodiment shown, and then the display of the display. The 3D video signal S1 received by the video signal interface is an image frame containing two contents of left and right parallax color images. Therefore, the 3D video processing unit takes the left and right parallax color images of the received 3D video signal S1 as input, and generates intermediate image information I1 therefrom. In a specific embodiment, on the one hand, the left and right parallax color images are used to synthesize a depth image. On the other hand, a color image of the center point is generated with the help of one or both of the left and right parallax color images. Then, the intermediate image information I1, that is, the depth image information and the color image information of the center point are used as input, and 12 pictures are rendered according to the viewing angles corresponding to the viewpoints V1-V12. Then, the content of each generated image is written to the corresponding pixels in each pixel group seen by each viewpoint, wherein each pixel group is a pixel group adjusted or determined based on optical data or pixel-viewpoint alignment relationship, preferably an irregularly arranged pixel group. For example, in the embodiment shown, the pixel group includes "regularly" arranged PG 1,1 and adjusted PG' x,y .

[0137] Therefore, when the viewer's eyes watch at different viewpoints V1...V12, they can see the rendered images at different angles, generating parallax to form a stereoscopic effect of 3D display.

[0138] exist Figures 7A-7B The illustrated embodiment describes adjusting pixel groups based on optical data and / or pixel-viewpoint alignment relationships, enabling a 3D video processing unit to correctly render corresponding pixels in the pixel groups. However, it is contemplated that methods that directly or indirectly utilize optical data and / or pixel-viewpoint alignment relationships to determine pixels correctly displayed at corresponding viewpoints, and methods for rendering such pixels, regardless of whether pixel groups and their adjustment are intentionally defined, fall within the scope of the present invention or are equivalent to the present invention.

[0139] refer to Figure 8, shows a naked-eye stereoscopic display system and a display thereof according to another embodiment of the present invention. In the embodiment shown, the display panel of the naked-eye stereoscopic display of the embodiment has multiple rows and columns of pixels. Figure 8 In the embodiment shown, the display stores or can read the data of the viewpoint corresponding to each pixel of the display panel. Figure 8 As shown by way of example, the pixel P 1,b1 Corresponding to viewpoint V8, pixel P am,bn Corresponding to viewpoint V6, pixel P az,bz Corresponding to viewpoint V12.

[0140] exist Figure 8 In the illustrated embodiment, direct correspondence data between each pixel and the viewpoint is shown. However, it is conceivable that in some embodiments, optical data that can be used to determine the correspondence between pixels and viewpoints, such as grating and pixel alignment data and / or grating refraction data, or other indirect data, can be used. In some embodiments, the above-mentioned optical data and / or alignment relationship data can be stored in a memory so that the 3D video processing unit can read it during processing. In an alternative embodiment, a data interface that communicates with the 3D video processing unit can be provided so that the 3D video processing unit can read the optical data and / or alignment relationship data with the help of the data interface. In an alternative embodiment, the optical data and / or alignment relationship data can be directly written into the 3D video processing unit or as part of its algorithm. In a preferred embodiment, the pixel-viewpoint correspondence data can be in the form of a lookup table. This all falls within the scope of the present invention.

[0141] Combined with reference Figure 1A-1C 、 Figure 3 、 Figure 6 as well as Figure 8 , describing the processing of the 3D video processing unit of the illustrated embodiment, and then the display of the display. The 3D video signal S1 received by the video signal interface is an image frame containing two contents, left and right parallax color images. Therefore, the 3D video processing unit takes the left and right parallax color images of the received 3D video signal S1 as input and generates intermediate image information I1 therefrom. In a specific embodiment, on the one hand, the left and right parallax color images are used to synthesize a depth image. On the other hand, a color image of the center point is generated with the help of one or both of the left and right parallax color images. Then, using the intermediate image information I1, that is, the depth image information and the color image information of the center point, as input, 12 pictures are rendered according to the viewing angles corresponding to the viewpoints V1-V12. Then, the content of each generated image is written to each pixel seen corresponding to each viewpoint according to the pixel-viewpoint correspondence relationship.

[0142] Therefore, when the viewer's eyes watch at different viewpoints V1-V12, they can see the rendered images at different angles, generating parallax to form a stereoscopic effect of 3D display.

[0143] In some embodiments, the grating of the display is a cylindrical prism grating. Figure 9 One embodiment of a cylindrical prism grating is shown.

[0144] exist Figure 9 In the embodiment of the cylindrical prism grating shown in FIG. , the following can be used accordingly: Figures 7A-7B The pixel group shown is adjusted or Figure 8 Features such as the pixel-viewpoint alignment relationship shown.

[0145] Specific reference Figure 9 In the embodiment shown, each row of the tilted cylindrical prisms generally covers 12 pixels. As an example, the display of this embodiment also has 12 viewpoints, and the pixel group of the display panel has a single row and multiple columns of pixels corresponding to the 12 viewpoints. Figure 9 and Figures 7A-7B , in the display of the cylindrical prism grating of the embodiment shown, the pixel P in the "regular" arrangement of the pixel group located on top of the cylindrical prism shown in the figure is a1,b1 -P a1,b4 The four pixels in the "regular" pixel group at the bottom of the cylindrical prism are not aligned with the correct viewpoints V1-V4, but with the corresponding viewpoints V1'-V4'. To this end, the pixel group can be adjusted to shift one pixel to the left in the diagram so that it is displayed at the correct viewpoints V1-V4. The remaining viewpoints in the pixel group can also be shifted one pixel to the left, for example Figure 9 The pixel shown in 'theoretically' corresponding to viewpoint V4' corresponds to viewpoint V5.

[0146] Combined with reference Figure 9 and Figure 8 , Figure 9 The illustrated embodiment can also be applied to directly utilizing optical (deviation) data and / or "irregular" pixel-viewpoint alignment relationships for each pixel of a display panel. For example, the following pixel-viewpoint correspondence data can be stored, recorded, or read: the four pixels at the bottom of a cylindrical prism correspond to viewpoints V2, V3, V4, and V5, respectively.

[0147] While not wishing to be bound by theory, the "misalignment" of the pixel groups or pixels may be caused by misalignment between the lenticular prisms and the pixels and / or the refractive state of the lenticular prisms. Figure 9 The dotted line and the solid line exemplarily show the theoretical alignment position and the actual alignment deviation on the left side of the prism.

[0148] Combined with reference Figure 9 and Figure 10 In the embodiment shown, the cylindrical prisms are, for example, arranged tilted relative to the pixels, for example, to eliminate moiré patterns. Therefore, there are "shared" pixels between the cylindrical prism boundaries (e.g., the pixels corresponding to the viewpoint V1 described above). In some configurations, corresponding viewpoints are specified for each of these "shared" pixels. However, in some preferred embodiments of the present invention, pixel group fine-tuning based on these "shared" pixels or a "dynamic" correspondence between pixels and viewpoints, or pixels referred to as viewpoint sharing, can be provided.

[0149] refer to Figure 10 , for pixel row P am,bn -P am,bn+i (i≥1), for example, conventionally corresponds to the “shared” pixels of viewpoint V12, which can be rendered according to the image of viewpoint V1 when viewpoint V12 is not rendered.

[0150] Those skilled in the art will understand that Figure 10 The fine-tuning or "dynamic" relationship of the illustrated embodiment can be applied to other types of gratings and can be combined with embodiments for acquiring real-time eye tracking data to obtain further advantageous embodiments.

[0151] refer to Figure 11 , shows a partial structural diagram of a parallax barrier display. The parallax barrier grating 100 includes a light shielding portion 102 and a light transmitting portion 104. Figure 11 In the embodiment of the parallax barrier grating shown in FIG. 1 , the following can be used accordingly: Figures 7A-7B The pixel group shown is adjusted or Figure 8 Features such as the pixel-viewpoint alignment relationship shown.

[0152] Although not wishing to be bound by theory, the “misalignment” of the pixel groups or pixels may be caused by misalignment between the transparent portion 104 of the parallax barrier and the pixels.

[0153] In the embodiment shown, the parallax barrier grating 100 is a front grating, but it is conceivable to provide a rear grating or to provide both a front grating and a rear grating.

[0154] Combined with reference Figures 1B-1C and Figure 12In one embodiment of the present invention, a naked-eye stereoscopic display system is provided, which may include a processor unit and a multi-viewpoint naked-eye stereoscopic display, wherein the processor unit is communicatively connected to the multi-viewpoint naked-eye stereoscopic display. In the illustrated embodiment, the naked-eye stereoscopic display system may further include an eye tracking device, for example in the form of a dual camera, which is communicatively connected to the processor unit. As an alternative embodiment, the eye tracking device may be provided in the display, or the system or the display may only have a transmission interface for receiving real-time eye tracking data.

[0155] Continue to refer Figures 1B-1C The multi-viewpoint naked-eye stereoscopic display may include a display screen having a display panel and a grating (not shown), a video signal interface for receiving a 3D video signal, and a 3D video processing unit. Figure 2 In the embodiment shown, the display may have 12 viewpoints (V1-V12), but it is contemplated that it may have more or fewer viewpoints. In embodiments of the present invention, the display may optionally include a timing controller and / or a display driver chip, which may be integrated with the 3D video processing unit or independently provided. In some embodiments of the present invention, the display may integrate an eyeball final device, which may be directly communicatively connected to the 3D video processing unit.

[0156] Continue to refer Figures 1B-1C The display panel may include multiple rows and columns of pixels and define multiple pixel groups. In the embodiment shown, for illustrative purposes, only two exemplary pixel groups PG are shown. 1,1 and PG x,y , each pixel group corresponds to a multi-viewpoint setting, and each has 12 pixels (P1-P12). As an illustrative embodiment, the pixels in the pixel group are arranged in a single row and multiple columns, but other arrangements are conceivable, such as a single column with multiple rows or multiple rows and multiple columns. For illustrative purposes only, the aforementioned PG x,y The pixel group at the Xth row and the Yth column can be schematically represented.

[0157] Combined with reference Figures 1B-1C and Figure 12 , describing the display of the display of this embodiment. As mentioned above, the display can have 12 viewpoints V1-V12. The viewer's eyes can see the display of the corresponding pixel points in each pixel group in the display panel at each viewpoint (spatial position), and then see different rendered images. The two different images seen by the viewer's two eyes at different viewpoints form parallax, and a three-dimensional image is synthesized in the brain.

[0158] exist Figure 12In the illustrated embodiment, one or more 3D video processing units are configured to generate images and render pixels for display in such a manner that a plurality of images corresponding to predetermined viewpoints are generated based on the image of the 3D video signal and pixels corresponding to the predetermined viewpoints in each pixel group are rendered based on the generated plurality of images. In the illustrated embodiment, the predetermined viewpoint is determined based on real-time eye tracking data. More specifically, when it is detected that the viewer's eyes (left eye and right eye) are at a predetermined viewpoint (spatial position), an image for the corresponding viewpoint is generated and pixels in the pixel group corresponding to the corresponding viewpoint are rendered. Specifically, in Figure 12 In the illustrated embodiment, it is detected that the first eye (eg, the right eye) is located at viewpoint V4, and the second eye (eg, the left eye) is located at viewpoint V8.

[0159] Accordingly, an embodiment of the present invention may also provide a method for displaying a multi-viewpoint autostereoscopic display, the method comprising the following steps: defining a plurality of pixel groups, each pixel group consisting of at least three pixels and corresponding to a multi-viewpoint setting; receiving a 3D video signal; generating a plurality of images corresponding to predetermined viewpoints (e.g., viewpoints V4 and V8) based on images of the received 3D video signal; and rendering corresponding pixels in each pixel group based on the generated plurality of images. In the illustrated embodiment, image generation and pixel rendering are performed corresponding to the predetermined viewpoints (V4 and V8).

[0160] Combined with reference Figures 1B-1C and Figure 12 , describes the processing of the 3D video processing unit in the specific embodiment shown. The 3D video signal S1 received by the video signal interface is an image frame containing two contents: a color image and a depth of field. Therefore, the 3D video processing unit takes the image information and depth of field information of the received 3D video signal S1 as input, and based on the real-time eyeball data, renders two pictures at the viewpoints V4 and V8 where the eyeballs are located according to the corresponding viewing angles. Then, the content of the corresponding generated image is written to each pixel group (such as PG 1,1 and PG x,y ) corresponds to the pixels seen by the corresponding viewpoints (such as the 4th and 8th pixels).

[0161] Thus, the eyes of viewers at viewpoints V4 and V8 can see the rendered images at different angles, generating parallax to form a stereoscopic effect of 3D display.

[0162] In some embodiments of the present invention, the aforementioned "resolution lossless" embodiment can be combined with eye tracking to obtain new embodiments. Figures 1B-1C and Figure 12As described above, the images corresponding to viewpoints V4 and V8 generated above are generated with "lossless resolution" and especially with the same resolution as the corresponding image frames of the received 3D video signal. Moreover, in these embodiments, the corresponding written pixels also basically correspond point by point to the resolution of the generated image (and thus the resolution of the image of the received 3D video signal).

[0163] In some embodiments, the received 3D video signal may also be subjected to a resolution increase (multiplication) process, such as an interpolation process, or referred to as pre-processing. As an illustrative example, for example, both the color image and the depth of field image may be interpolated at 2 times the line resolution. Then, the "resolution lossless" and / or "point-to-point rendering" processes described in the embodiments of the present invention may be combined to obtain a new embodiment, such as obtaining a generated picture of the corresponding viewpoints V4 and V8 having a resolution corresponding to the 2-fold interpolated image. It will be understood that the "resolution lossless" and / or "point-to-point rendering" processes combined with interpolation or other resolution increase processes or themselves fall within the scope of the "resolution lossless" and / or "point-to-point rendering" processes described in the present invention. In this document, the generation of pictures of corresponding viewpoints combined with resolution increase may sometimes also be referred to as resolution increase (multiplication) generation.

[0164] In some embodiments of the present invention, an additional (pre)processor may be provided to perform the resolution increase (multiplication) or interpolation, or the resolution increase (multiplication) or interpolation may be performed by the one or more 3D video processing units, which falls within the scope of the invention.

[0165] Furthermore, it will be appreciated that the embodiment of using real-time eye tracking data to render predetermined viewpoints (rather than all viewpoints) can be combined with many of the aforementioned embodiments, or features can be substituted to create new embodiments. In particular, this embodiment can be combined with features related to optical data / pixel-viewpoint alignment data to create new embodiments. Furthermore, this embodiment can be modified without explicitly grouping pixels to create new embodiments.

[0166] Continue to refer Figure 13 The embodiment shown is generally similar to Figure 12 The difference is that the predetermined viewpoints also include viewpoints adjacent to the viewpoint where the eyeball is located. For example, Figure 13 In the embodiment shown, the predetermined viewpoints for generating an image may further include viewpoints V3 and V5, as well as viewpoints V7 and V9, and the pixels corresponding to these viewpoints in the pixel group are rendered. In some embodiments, only the adjacent viewpoints on one side may be used as predetermined viewpoints.

[0167] In some embodiments, for example, only the Figure 12or the pixels described in 13, and the remaining pixels are not rendered. Preferably, for liquid crystal displays, the pixels that are not rendered can be left white or retain the color of the previous image frame. This can thereby minimize the computational load.

[0168] refer to Figure 12 、 Figure 13 According to a preferred embodiment of the present invention, the display comprises a self-luminous display panel, preferably a micro-LED display panel. In some embodiments of the present invention, the self-luminous display panel, such as a micro-LED display panel, is configured so that unrendered pixels do not emit light. This can significantly reduce the power consumed by the display, especially for multi-viewpoint ultra-high-definition displays.

[0169] Combined with reference Figures 1B-1C and Figure 14 In one embodiment of the present invention, a naked-eye stereoscopic display system is provided, which may include a processor unit and a multi-viewpoint naked-eye stereoscopic display, wherein the processor unit is communicatively connected to the multi-viewpoint naked-eye stereoscopic display. In the illustrated embodiment, the naked-eye stereoscopic display system may further include an eye tracking device, for example in the form of a dual camera, which is communicatively connected to the processor unit. As an alternative embodiment, the eye tracking device may be provided in the display, or the system or the display may only have a transmission interface for receiving real-time eye tracking data.

[0170] Continue to refer Figure 1A-1C The multi-viewpoint naked-eye stereoscopic display may include a display screen having a display panel and a grating (not shown), a video signal interface for receiving a 3D video signal, and a 3D video processing unit. Figure 2 In the embodiment shown, the display may have 12 viewpoints (V1-V12), but it is contemplated that it may have more or fewer viewpoints. In embodiments of the present invention, the display may optionally include a timing controller and / or a display driver chip, which may be integrated with the 3D video processing unit or independently provided. In some embodiments of the present invention, the display may integrate an eyeball final device, which may be directly communicatively connected to the 3D video processing unit.

[0171] Continue to refer Figure 1A-1C The display panel may include multiple rows and columns of pixels and define multiple pixel groups. In the embodiment shown, for illustrative purposes, only two exemplary pixel groups PG are shown. 1,1 and PG x,y , each pixel group corresponds to a multi-viewpoint setting, and each has 12 pixels (P1-P12). As an illustrative embodiment, the pixels in the pixel group are arranged in a single row and multiple columns, but other arrangements are conceivable, such as a single column with multiple rows or multiple rows and multiple columns. For illustrative purposes only, the aforementioned PGx,y The pixel group at the Xth row and the Yth column can be schematically represented.

[0172] Combined with reference Figure 1A -C and Figure 14 , describing the display of the display of this embodiment. As mentioned above, the display can have 12 viewpoints V1-V12. The viewer's eyes can see the display of the corresponding pixel points in each pixel group in the display panel at each viewpoint (spatial position), and then see different rendered images. The two different images seen by the viewer's two eyes at different viewpoints form parallax, and a three-dimensional image is synthesized in the brain.

[0173] exist Figure 14 In the illustrated embodiment, one or more 3D video processing units are configured to generate images and render pixels for display in such a manner that a plurality of images corresponding to predetermined viewpoints are generated based on the image of the 3D video signal and pixels corresponding to the predetermined viewpoints in each pixel group are rendered based on the generated plurality of images. In the illustrated embodiment, the predetermined viewpoint is determined based on real-time eye tracking data. More specifically, when it is detected that the viewer's eyes (left eye and right eye) are at adjacent viewpoints, images for the adjacent viewpoints are generated and pixels in the pixel groups corresponding to the corresponding viewpoints are rendered. Specifically, in Figure 12 In the illustrated embodiment, it is detected that the first eye (e.g., the right eye) is located between viewpoints V4 and V5, while the second eye (e.g., the left eye) is located between viewpoints V8 and V9. Accordingly, four images corresponding to viewpoints V4, V5, V8, and V9 are generated, and the pixels corresponding to these four viewpoints in the pixel group are rendered.

[0174] Accordingly, an embodiment of the present invention can also provide a display method for a multi-viewpoint naked-eye stereoscopic display, the method comprising the following steps: defining multiple pixel groups, each pixel group consisting of at least 3 pixels and corresponding to a multi-viewpoint setting; receiving a 3D video signal; generating multiple images corresponding to predetermined viewpoints (such as viewpoints V4, V5 and V8, V9) based on the image of the received 3D video signal; and rendering corresponding pixels in each pixel group based on the generated multiple images.

[0175] Combined with reference Figure 1A-1C and Figure 14 , describes the processing of the 3D video processing unit in the specific embodiment shown. The 3D video signal S1 received by the video signal interface is an image frame containing two contents: a color image and a depth of field. Therefore, the 3D video processing unit takes the image information and depth of field information of the received 3D video signal S1 as input, and based on the real-time eyeball data, renders four pictures at the viewpoints V4, V5, V8 and V9 where the eyeballs are located according to the corresponding viewing angles. Then, the content of the corresponding generated image is written to each pixel group (such as PG1,1 and PG x,y ) corresponds to the pixels seen by the corresponding viewpoint (such as the 4th, 5th and 8th, 9th pixels).

[0176] Therefore, the eyes of viewers located between viewpoints V4 and V5 and between viewpoints V8 and V9 can see the rendered images at different angles, generating parallax to form a stereoscopic effect of 3D display.

[0177] It will be appreciated that the embodiment of using real-time eye tracking data to render predetermined viewpoints (but not all viewpoints) can be combined with many of the aforementioned embodiments, or features can be substituted to create new embodiments. In particular, this embodiment can be combined with features related to optical data / pixel-viewpoint alignment data to create new embodiments. Furthermore, this embodiment can be modified without explicitly grouping pixels to create new embodiments.

[0178] Combined with reference Figure 1B -C and Figure 14 In another embodiment of the present invention, a naked-eye stereoscopic display system is provided, which may include a processor unit and a multi-viewpoint naked-eye stereoscopic display. The difference in this embodiment is that the 3D video signal S1 received by the video signal interface is an image frame containing left and right parallax color image content. Thus, the 3D video processing unit takes the image frame containing left and right parallax color image content of the received 3D video signal S1 as input. Based on real-time eyeball data, according to the eyeballs detected by real-time eyeball tracking data, a left-eye or right-eye parallax color image is generated accordingly. For example, for viewpoints V4 and V5 where the right eye is located, two pictures are rendered based on the right parallax color image content of the 3D video signal S1. For viewpoints V8 and V9 where the left eye is located, two pictures are rendered based on the left parallax color image content of the 3D video signal S1. Then, the content of the corresponding generated image is written to each pixel group (such as PG 1,1 and PG x,y ) corresponds to the pixels seen by the corresponding viewpoint (such as the 4th, 5th and 8th, 9th pixels).

[0179] Therefore, the eyes of viewers located between viewpoints V4 and V5 and between viewpoints V8 and V9 can see the rendered images at different angles, generating parallax to form a stereoscopic effect of 3D display.

[0180] Combined with reference Figure 1A-1C and Figure 15In one embodiment of the present invention, a naked-eye stereoscopic display system is provided, which may include a processor unit and a multi-viewpoint naked-eye stereoscopic display, wherein the processor unit is communicatively connected to the multi-viewpoint naked-eye stereoscopic display. In the illustrated embodiment, the naked-eye stereoscopic display system may further include an eye tracking device, for example in the form of a dual camera, which is communicatively connected to the processor unit. As an alternative embodiment, the eye tracking device may be provided in the display, or the system or the display may only have a transmission interface for receiving real-time eye tracking data.

[0181] Continue to refer Figure 1A-1C The multi-viewpoint naked-eye stereoscopic display may include a display screen having a display panel and a grating (not shown), a video signal interface for receiving a 3D video signal, and a 3D video processing unit. Figure 2 In the embodiment shown, the display may have 12 viewpoints (V1-V12), but it is contemplated that it may have more or fewer viewpoints. In embodiments of the present invention, the display may optionally include a timing controller and / or a display driver chip, which may be integrated with the 3D video processing unit or independently provided. In some embodiments of the present invention, the display may integrate an eyeball final device, which may be directly communicatively connected to the 3D video processing unit.

[0182] Continue to refer Figure 1A-1C The display panel may include multiple rows and columns of pixels and define multiple pixel groups. In the embodiment shown, for illustrative purposes, only two exemplary pixel groups PG are shown. 1,1 and PG x,y , each pixel group corresponds to a multi-viewpoint setting, and each has 12 pixels (P1-P12). As an illustrative embodiment, the pixels in the pixel group are arranged in a single row and multiple columns, but other arrangements are conceivable, such as a single column with multiple rows or multiple rows and multiple columns. For illustrative purposes only, the aforementioned PG x,y The pixel group at the Xth row and the Yth column can be schematically represented.

[0183] Combined with reference Figure 1A-1C and Figure 15 , describing the display of the display of this embodiment. As mentioned above, the display can have 12 viewpoints V1-V12. The viewer's eyes can see the display of the corresponding pixel points in each pixel group in the display panel at each viewpoint (spatial position), and then see different rendered images. The two different images seen by the viewer's two eyes at different viewpoints form parallax, and a three-dimensional image is synthesized in the brain.

[0184] exist Figure 15In the illustrated embodiment, one or more 3D video processing units are configured to generate images and render pixels for display in such a manner that a plurality of images corresponding to predetermined viewpoints are generated based on the image of the 3D video signal and pixels corresponding to the predetermined viewpoints in each pixel group are rendered based on the generated plurality of images. In the illustrated embodiment, the predetermined viewpoint is determined based on real-time eye tracking data. More specifically, when it is detected that the viewer's eyes (left eye and right eye) are at a predetermined viewpoint (spatial position), an image for the corresponding viewpoint is generated and pixels in the pixel group corresponding to the corresponding viewpoint are rendered. Specifically, in Figure 15 In the illustrated embodiment, it is detected that the first eye (eg, right eye Er) is located at viewpoint V4, and the second eye (eg, left eye E1) is located at viewpoint V8.

[0185] Continue to refer Figure 15 When the real-time eye tracking data indicates that the viewer's eyes move, multiple images corresponding to new predetermined viewpoints can be generated based on the next image (frame) of the 3D video signal, and the pixels corresponding to the predetermined viewpoints in each pixel group can be rendered based on the generated multiple images. Specifically, Figure 15 In the embodiment shown, it is currently detected that the first eye (e.g., right eye Er) has moved to viewpoint V6, while the second eye (e.g., left eye El) is located at viewpoint V10. In the embodiment shown, the predetermined viewpoints can also be changed based on real-time eye tracking data using a timing controller provided by the display.

[0186] Accordingly, an embodiment of the present invention can also provide a display method for a multi-viewpoint naked-eye stereoscopic display, the method comprising the following steps: defining a plurality of pixel groups, each pixel group consisting of at least 3 pixels and corresponding to a multi-viewpoint setting; receiving a 3D video signal; generating a plurality of images corresponding to predetermined viewpoints based on the image of the received 3D video signal; and rendering the corresponding pixels in each pixel group according to the generated plurality of images. The method further comprises the steps of adjusting the predetermined viewpoint based on real-time eye tracking data, and generating an image and rendering pixels based on the new predetermined viewpoint. In the illustrated embodiment, image generation and pixel rendering are performed corresponding to the current predetermined viewpoint V4, V8 or V6, V10 based on real-time eye tracking data.

[0187] Combined with reference Figure 1A-1C and Figure 15 , describing the processing of the 3D video processing unit in the illustrated embodiment. The 3D video signal S1 received by the video signal interface is an image frame containing left and right parallax color images. Based on real-time eye data and the eyes detected by the real-time eye tracking data, a left-eye or right-eye parallax color image is generated accordingly.

[0188] For example, at the first time, for the viewpoint V4 where the right eye is located, a picture is rendered based on the right parallax color image content of the 3D video signal S1. For the viewpoint V8 where the left eye is located, a picture is rendered based on the left parallax color image content of the 3D video signal S1. Then, the content of the generated corresponding image is written to each pixel group (such as PG 1,1 and PG x,y ) corresponds to the pixels seen by the corresponding viewpoints (such as the 4th and 8th pixels).

[0189] At the second time, for the viewpoint V6 where the right eye is located, a picture is rendered based on the right parallax color image content of the 3D video signal S1. For the viewpoint V10 where the left eye is located, a picture is rendered based on the left parallax color image content of the 3D video signal S1. Then, the content of the generated corresponding image is written to each pixel group (such as PG 1,1 and PG x,y ) corresponds to the pixels seen by the corresponding viewpoints (such as the 6th and 10th pixels).

[0190] Therefore, the eyes of viewers in motion can still see the rendered images from different angles in real time, generating parallax to form a three-dimensional effect of 3D display.

[0191] Combined with reference Figure 1A-1C and Figure 16 In one embodiment of the present invention, a naked-eye stereoscopic display system is provided, which may include a processor unit and a multi-viewpoint naked-eye stereoscopic display, wherein the processor unit is communicatively connected to the multi-viewpoint naked-eye stereoscopic display. In the illustrated embodiment, the naked-eye stereoscopic display system may further include an eye tracking device, for example in the form of a dual camera, which is communicatively connected to the processor unit. As an alternative embodiment, the eye tracking device may be provided in the display, or the system or the display may only have a transmission interface for receiving real-time eye tracking data.

[0192] Continue to refer Figure 1A-1C The multi-viewpoint naked-eye stereoscopic display may include a display screen having a display panel and a grating (not shown), a video signal interface for receiving a 3D video signal, and a 3D video processing unit. Figure 2 In the embodiment shown, the display may have 12 viewpoints (V1-V12), but it is contemplated that it may have more or fewer viewpoints. In embodiments of the present invention, the display may optionally include a timing controller and / or a display driver chip, which may be integrated with the 3D video processing unit or independently provided. In some embodiments of the present invention, the display may integrate an eyeball final device, which may be directly communicatively connected to the 3D video processing unit.

[0193] Continue to refer Figure 1A-1CThe display panel may include multiple rows and columns of pixels and define multiple pixel groups. In the embodiment shown, for illustrative purposes, only two exemplary pixel groups PG are shown. 1,1 and PG x,y , each pixel group corresponds to a multi-viewpoint setting, and each has 12 pixels (P1-P12). As an illustrative embodiment, the pixels in the pixel group are arranged in a single row and multiple columns, but other arrangements are conceivable, such as a single column with multiple rows or multiple rows and multiple columns. For illustrative purposes only, the aforementioned PG x,y The pixel group at the Xth row and the Yth column can be schematically represented.

[0194] Combined with reference Figure 1A-1C and Figure 16 , describing the display of the display of this embodiment. As mentioned above, the display can have 12 viewpoints V1-V12. The viewer's eyes can see the display of the corresponding pixel points in each pixel group in the display panel at each viewpoint (spatial position), and then see different rendered images. The two different images seen by the viewer's two eyes at different viewpoints form parallax, and a three-dimensional image is synthesized in the brain.

[0195] exist Figure 16 In the illustrated embodiment, one or more 3D video processing units are configured to generate images for display and render pixels by generating multiple images corresponding to predetermined viewpoints based on the image of the 3D video signal and rendering the pixels corresponding to the predetermined viewpoints in each pixel group based on the generated multiple images. In the illustrated embodiment, there are multiple viewers, such as two. Based on the eye positions of different viewers, images are rendered for corresponding viewpoints and written to the corresponding pixels in the pixel groups.

[0196] Accordingly, an embodiment of the present invention can also provide a display method for a multi-viewpoint naked-eye stereoscopic display, the method comprising the following steps: defining multiple pixel groups, each pixel group consisting of at least 3 pixels and corresponding to a multi-viewpoint setting; receiving a 3D video signal; generating multiple images corresponding to predetermined viewpoints (such as viewpoints V4 and V6 corresponding to the left and right eyes of the first user and viewpoints V8 and V10 corresponding to the left and right eyes of the second user) based on the image of the received 3D video signal; and rendering the corresponding pixels in each pixel group based on the generated multiple images.

[0197] Combined with reference Figure 1A-1C and Figure 16, describing the processing of the 3D video processing unit in the specific embodiment shown. The 3D video signal S1 received by the video signal interface is an image frame containing two contents: a color image and a depth of field image. Therefore, the 3D video processing unit takes the image information and depth of field information of the received 3D video signal S1 as input, and based on the real-time eyeball data, renders four pictures according to the corresponding viewing angles of the viewpoints V4 and V6 corresponding to the left and right eyes of the first user and the viewpoints V8 and V10 corresponding to the left and right eyes of the second user. Then, the content of the corresponding generated image is written to each pixel group (such as PG 1,1 and PG x,y ) corresponds to the pixels seen by the corresponding viewpoints (such as the 4th, 6th and 8th, 10th pixels).

[0198] Therefore, each person can view the rendered image corresponding to his or her own viewing angle, generating parallax to form a stereoscopic effect of 3D display.

[0199] Combined with reference Figure 1A-1C and Figure 16 In another embodiment of the present invention, a naked-eye stereoscopic display system is provided, which may include a processor unit and a multi-viewpoint naked-eye stereoscopic display. The difference in this embodiment is that the 3D video signal S1 received by the video signal interface is an image frame containing left and right parallax color image content. Thus, the 3D video processing unit takes the image frame containing left and right parallax color image content of the received 3D video signal S1 as input. Based on real-time eyeball data, according to the eyeballs detected by real-time eyeball tracking data, a left-eye or right-eye parallax color image is generated accordingly. For example, for the viewpoint V4 where the right eye of the first user is located and the viewpoint V8 where the right eye of the first user is located, two pictures are rendered based on the right parallax color image content of the 3D video signal S1. For the viewpoint V6 where the left eye of the first user is located and the viewpoint V10 where the left eye of the first user is located, two pictures are rendered based on the left parallax color image content of the 3D video signal S1. Then, the content of the corresponding generated image is written into each pixel group (such as PG 1,1 and PG x,y ) corresponds to the pixels seen by the corresponding viewpoints (such as the 4th, 6th and 8th, 10th pixels).

[0200] Therefore, each person can view the rendered image corresponding to his or her own viewing angle, generating parallax to form a stereoscopic effect of 3D display.

[0201] Combined with reference Figure 16 and Figure 17 In another embodiment of the present invention, a naked eye stereoscopic display system is provided, which may include a processor unit and a multi-viewpoint naked eye stereoscopic display. The display is configured to receive multiple signal inputs. Figure 17In the embodiment shown, there are two paths, S1 (left and right parallax images) and S2 (color image and depth image).

[0202] Continue to refer Figure 16 For example, the first user (User2) wants to see the left and right parallax signals S1, while the second user (User3) wants to see the color and depth signals. Therefore, the 3D video processing unit generates rendering images corresponding to the viewpoints according to the positions of the left and right eyeballs (Er and El) of the first user (viewpoints V4 and V6) and the positions of the left and right eyeballs (Er and El) of the second user (viewpoints V8 and V10), and writes the contents of the generated corresponding images to each pixel group (such as PG 1,1 and PG x,y ) corresponds to the pixels seen by the corresponding viewpoints (such as the 4th, 6th and 8th, 10th pixels).

[0203] Therefore, each person can view the rendered image corresponding to his or her own viewing angle, generating parallax to form a stereoscopic effect of 3D display, and different users can view different video content.

[0204] In some embodiments of the present invention, the above embodiments may have specific implementation schemes. For example, for a naked-eye 3D display with 12 viewpoints, the video signal interface receives a MiPi signal with a resolution of 1920x1200, and the signal is converted into a mini-LVDS signal after entering the timing controller. The traditional processing method is to give the signal output to multiple display driver chips for the screen respectively. In this regard, in one embodiment of the present invention, a 3D video processing unit (or unit group) in the form of FPGA or ASIC is provided before the display driver chip.

[0205] The display has a resolution of 1920x12x 1200, and the signal received by the interface is processed to complete lossless expansion of the resolution for each viewpoint, that is, expansion of the resolution to 12 times the received video.

[0206] In some embodiments of the present invention, the video signal interface can have multiple implementation forms, including but not limited to, a high-definition digital display interface (Display Port, DP1.2) with version 1.2, a high-definition multimedia interface (High Definition Multimedia Interface, HDMI 2.0) with version 2.0, a high-definition digital display interface (V-by-One), etc., or a wireless interface, such as WiFi, Bluetooth, cellular network, etc.

[0207] In some embodiments of the present invention, the display or display system and display method may be combined with other image processing technologies: such as color adjustment of the video signal, including color space rotation (Color Tint) adjustment and color gain (Color Gain) adjustment; brightness adjustment, including contrast (Contrast) adjustment, drive gain (Drive Gain) adjustment, and gamma curve adjustment.

[0208] In some embodiments of the present invention, implementations of a display system according to the present invention are described. In one embodiment, Figure 18 As shown, the display system 1800 is a cellular phone or is configured as part of a cellular phone. In some embodiments, the processing unit of the display system can be provided by or integrated into a processor of the cellular phone, such as an application processor (AP). In some embodiments, the eye tracking device can include or be configured as a camera of the cellular phone, particularly a front-facing camera. In some preferred embodiments, the eye tracking device according to the present invention can include or be configured as a front-facing camera combined with a structured light camera.

[0209] In some embodiments, the display system may be configured as a tablet computer, a personal computer, or a wearable device having a processor unit.

[0210] In one embodiment of the present invention, the naked eye stereoscopic display may be a digital television (intelligent or non-intelligent). Figure 19 As shown, the display system 1900 can be constructed as the naked-eye stereoscopic display 1904 connected to a set-top box 1902 or a projection cell phone or tablet computer, and the processor unit is included in the set-top box or the projection cell phone or tablet computer.

[0211] In an alternative embodiment, the naked-eye stereoscopic display is a smart TV and is integrated with the processor unit.

[0212] In some embodiments of the present invention, the naked eye stereoscopic display system is constructed as a smart home system or a part thereof. Figure 20 In the illustrated embodiment, a smart home system 2000 (or a naked-eye stereoscopic display system) may include a smart gateway 2002 or a central controller that includes or integrates a processor unit, a naked-eye stereoscopic display 2004, and an eye-tracking device, such as dual cameras 2006, for acquiring eye-tracking data. By way of example, the eye-tracking device may take other forms, such as a single camera, a combination of a camera and a depth-of-field camera, etc. In the illustrated embodiment, both the display and the eye-tracking device are wirelessly connected to the smart gateway or central controller, such as via WiFi. However, other connection forms are contemplated.

[0213] In some embodiments of the present invention, the naked-eye stereoscopic display system is constructed as an entertainment interactive system or a part thereof.

[0214] like Figure 21 A naked-eye stereoscopic display system according to a preferred embodiment of the present invention is shown, which is configured as an entertainment interactive system 2100 or a portion thereof. The entertainment interactive system 2100 includes a naked-eye stereoscopic display 2104 and an eye-tracking device, such as dual cameras 2106, that obtains eye-tracking data. A processor unit is not shown. The entertainment interactive system 2100 is configured to be suitable for use by multiple users, and in the illustrated embodiment, is suitable for use by two users. In the illustrated embodiment, the naked-eye stereoscopic display 2104 of the entertainment interactive system 2100 generates an image based on the eye-tracking data from the eye-tracking device, such as dual cameras 2106, and writes the image into pixels corresponding to the viewpoint.

[0215] In a more preferred embodiment, the entertainment interactive system 2100 can also be combined with embodiments for multiple signal inputs to obtain new embodiments. For example, in one specific embodiment, based on user interaction (e.g., based on data detected by an eye tracking device or other sensor), the processing unit generates multiple, such as two, personalized video signals, which can be displayed using the display and display method described in the embodiments of the present invention.

[0216] The entertainment interactive system according to the embodiment of the present invention can provide users with a high degree of freedom and interaction.

[0217] The systems, devices, modules or units described in the above embodiments can be implemented by various possible entities. A typical implementation entity is a computer or its processor or other component. Specifically, the computer can be, for example, a personal computer, a laptop computer, a vehicle-mounted human-computer interaction device, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, a smart TV, an Internet of Things system, a smart home, an industrial computer, a single-chip computer system or a combination of these devices. In a typical configuration, the computer may include one or more processors (CPU), an input / output interface, a network interface and a memory. The memory may include non-permanent memory in a computer-readable medium, a random access memory (RAM) and / or a non-volatile memory in the form of a read-only memory (ROM) or a flash memory (flash RAM).

[0218] The methods, programs, systems, and apparatuses of the embodiments of the present invention may be executed or implemented in a single or multiple networked computers, or may be practiced in a distributed computing environment. In the embodiments of this specification, tasks are performed by remote processing devices connected via a communication network in these distributed computing environments.

[0219] Those skilled in the art will appreciate that the embodiments of this specification may be provided as methods, systems, or computer program products. Therefore, the embodiments of this specification may take the form of entirely hardware embodiments, entirely software embodiments, or embodiments combining software and hardware.

[0220] Those skilled in the art will appreciate that the functional modules / units or controllers and the related method steps described in the above embodiments can be implemented in software, hardware, or a combination of software / hardware. For example, they can be implemented in pure computer-readable program code, or part or all of the method steps can be logically programmed to enable the controller to implement the same functions in hardware, including but not limited to logic gates, switches, application-specific integrated circuits, programmable logic controllers (such as FPGAs), and embedded microcontrollers.

[0221] In some embodiments of the present invention, the components of the device are described in the form of functional modules / units. It is conceivable that multiple functional modules / units are implemented in one or more "combined" functional modules / units and / or one or more software and / or hardware. It is also conceivable that a single functional module / unit is implemented by a combination of multiple sub-functional modules or sub-units and / or multiple software and / or hardware. The division of functional modules / units can be only a logical functional division. In a specific implementation, multiple modules / units can be combined or integrated into another system. In addition, the connections of the modules, units, devices, systems and components thereof described herein include direct or indirect connections, covering feasible electrical, mechanical, and communication connections, and especially including wired or wireless connections between various interfaces, including but not limited to HDMI, Thunderbolt, USB, WiFi, and cellular networks.

[0222] In the embodiments of the present invention, the technical features, flow charts, and / or block diagrams of the methods and programs can be applied to the corresponding devices, equipment, systems, and their modules, units, and components. Conversely, the various embodiments and features of the devices, equipment, systems, and their modules, units, and components can be applied to the methods and programs according to the embodiments of the present invention. For example, computer program instructions can be loaded into a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine that has the functions or features corresponding to one or more flow charts and / or one or more blocks in a block diagram.

[0223] The methods and programs according to embodiments of the present invention may be stored in the form of computer program instructions or programs in a computer-readable memory or medium capable of directing a computer or other programmable data processing device to operate in a specific manner. Embodiments of the present invention also relate to computer-readable memory or media storing the methods, programs, and instructions that can implement embodiments of the present invention.

[0224] Storage media include permanent and non-permanent, removable and non-removable items that can be used to store information using any method or technology. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device.

[0225] Unless explicitly stated, the actions or steps of the methods, procedures, and methods described in accordance with the embodiments of the present invention do not have to be performed in a specific order and can still achieve the desired results. In some implementations, multitasking and parallel processing are also possible or may be advantageous.

[0226] In this document, multiple embodiments of the present invention are described, but for the sake of brevity, the description of each embodiment is not exhaustive, and the same or similar features or parts between the embodiments may be omitted. In this document, "one embodiment", "some embodiments", "example", "specific example", or "some examples" are intended to apply to at least one embodiment or example of the present invention, not all embodiments. And the above terms do not necessarily mean to refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics of each embodiment can be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of different embodiments or examples, unless they are contradictory.

[0227] As used herein, the terms "comprise," "include," or variations thereof are intended to be inclusive, not exhaustive, such that a process, method, product, or apparatus comprising a list of elements may include those elements without excluding the possibility of including other elements not expressly listed. For purposes of disclosure and unless otherwise specified, "a" or "an" means "one or more." To the extent that the terms "comprise" or "comprising" are used in this specification and claims, they will be non-exhaustive, somewhat similar to "comprising" in that those terms are interpretative when used as transitional conjunctions. Additionally, to the extent that the term "or" is used (e.g., A or B), it will mean "A or B or both." When the applicant intends to indicate "only A or B but not both," "only A or B but not both" will be used. Thus, the use of the term "or" is inclusive, not exclusive. See Bryan.A.Garner, Modern Legal Dictionary, p. 624 (2d.Ed.1995).

[0228] The exemplary systems and methods of the present invention have been specifically shown and described with reference to the above-described embodiments, which are merely examples of the best modes for implementing the present systems and methods. It will be understood by those skilled in the art that various changes may be made to the embodiments of the systems and methods described herein when implementing the present systems and / or methods without departing from the spirit and scope of the present invention as defined in the appended claims. The appended claims are intended to define the scope of the present systems and methods, and systems and methods falling within these claims and their equivalents are intended to be covered. The above description of the present systems and methods should be understood to include all new and non-obvious combinations of elements described herein, and claims may be present in this or subsequent applications relating to any new and non-obvious combination of elements. In addition, the above-described embodiments are exemplary, and no single feature or element is essential to all possible combinations that may be claimed in this or subsequent applications.

Claims

1. A multi-viewpoint naked-eye stereoscopic display, characterized in that: The invention comprises a display screen having a display panel and a grating, a video signal interface for receiving a 3D video signal, and one or more 3D video processing units, wherein the display panel comprises a plurality of rows and columns of pixels and defines a plurality of pixel groups, each pixel group being composed of at least three pixels and corresponding to a multi-viewpoint setting, wherein the plurality of pixel groups are pixel groups having irregular relative positions, and the irregular relative positions of the plurality of pixel groups are determined based on optical relationship data between the pixels and the grating and / or a correspondence between the pixels of the display panel and the viewpoints, wherein the one or more 3D video processing units are configured to generate a plurality of images corresponding to all viewpoints or predetermined viewpoints based on an image of the 3D video signal and render corresponding pixels in each pixel group according to the generated plurality of images.

2. The multi-viewpoint naked-eye stereoscopic display according to claim 1, wherein: The grating includes a cylindrical prism grating, and the optical relationship between the pixel and the grating includes an alignment relationship between the pixel and the cylindrical prism grating and / or a refraction state of the cylindrical prism grating relative to the corresponding pixel.

3. The multi-viewpoint naked-eye stereoscopic display according to claim 1, wherein: The grating includes a front and / or rear parallax barrier grating, the parallax barrier grating includes a light-shielding portion and a light-transmitting portion, and the optical relationship between the pixel and the grating includes an alignment relationship between the pixel and the corresponding light-transmitting portion of the parallax barrier grating.

4. The multi-viewpoint naked-eye stereoscopic display according to claim 1, wherein: The correspondence between pixels and viewpoints is calculated or determined based on the optical relationship between pixels and the grating.

5. The multi-viewpoint naked-eye stereoscopic display according to claim 1, wherein: The correspondence between pixels and viewpoints is determined by measuring at each viewpoint position.

6. The multi-viewpoint naked-eye stereoscopic display according to claim 1, wherein: It also includes a memory storing the optical relationship data and / or pixel-viewpoint correspondence relationship data, and the one or more 3D video processing units are configured to read the data in the memory.

7. The multi-viewpoint naked-eye stereoscopic display according to claim 1, wherein: The received 3D video signal includes a received depth image and a rendered color image, and the generated image includes a generated depth image and a rendered color image.

8. The multi-viewpoint naked-eye stereoscopic display according to claim 1, wherein: The received 3D video signal includes a received depth image and a rendered color image, and the generated image includes a generated first parallax image and a second parallax image.

9. The multi-viewpoint naked-eye stereoscopic display according to claim 1, wherein: The received 3D video signal includes the received first parallax image and the received second parallax image, and the generated image includes the generated first parallax image and the generated second parallax image.

10. The multi-viewpoint naked-eye stereoscopic display according to claim 1, wherein: The received 3D video signal includes a received first parallax image and a received second parallax image, and the generated image includes a generated depth image and a rendered color image.

11. The multi-viewpoint naked-eye stereoscopic display according to claim 1, wherein: A plurality of 3D video processing units are provided, and each 3D video processing unit is configured to be allocated with a plurality of rows or columns of pixels and render the plurality of rows or columns of pixels.

12. The multi-viewpoint naked-eye stereoscopic display according to claim 1, wherein: The one or more 3D video processing units are FPGA or ASIC chips or chipsets.

13. The multi-viewpoint naked-eye stereoscopic display according to any one of claims 1 to 12, characterized in that: The 3D video signal is a single-channel signal, and the one or more 3D video processing units are configured to generate multiple images corresponding to all viewpoints based on the single-channel 3D video signal and render all pixels in each pixel group.

14. The multi-viewpoint naked-eye stereoscopic display according to any one of claims 1 to 12, characterized in that: The 3D video signal is a multi-channel signal, wherein the number of multiple viewpoints is N, the number of multi-channel signals is M, and N≥M. The one or more 3D video processing units are configured to generate N images corresponding to all viewpoints and render all pixels in each pixel group, and each generated image is generated based on one of the M signals.

15. The multi-viewpoint naked-eye stereoscopic display according to any one of claims 1 to 12, characterized in that: Also included is an eye tracking device or an eye tracking data interface for acquiring eye tracking data.

16. The multi-viewpoint naked-eye stereoscopic display according to claim 15, wherein: The one or more 3D video processing units are configured to generate a plurality of images corresponding to predetermined viewpoints based on the images of the 3D video signal and render corresponding pixels in each pixel group according to the generated plurality of images, wherein the predetermined viewpoints are determined by real-time eye tracking data of a viewer.

17. The multi-viewpoint naked-eye stereoscopic display according to claim 16, wherein: The one or more 3D video processing units are configured to, when each eyeball of the viewer is located at a single viewpoint, generate an image corresponding to the single viewpoint based on the image of the 3D video signal and render pixels corresponding to the single viewpoint in each pixel group.

18. The multi-viewpoint naked-eye stereoscopic display according to claim 17, wherein: The one or more 3D video processing units are configured to further generate images corresponding to viewpoints adjacent to the single viewpoint and further render pixels corresponding to the adjacent viewpoints in each pixel group.

19. The multi-viewpoint naked-eye stereoscopic display according to claim 16, wherein: The one or more 3D video processing units are configured to, when each eyeball of the viewer is located between two viewpoints, generate images corresponding to the two viewpoints based on the image of the 3D video signal and render pixels corresponding to the two viewpoints in each pixel group.

20. The multi-viewpoint naked-eye stereoscopic display according to claim 16, wherein: The 3D video signal is a single-channel signal, and the one or more 3D video processing units are configured to, when there are multiple viewers, generate the multiple images and render the corresponding pixels in each pixel group for the viewpoint corresponding to the eye position of each viewer based on the single-channel signal.

21. The multi-viewpoint naked-eye stereoscopic display according to claim 17, wherein: The 3D video signal is a multi-channel signal, and the one or more 3D video processing units are configured to, when there are multiple viewers, generate the multiple images based on different 3D video signals and render corresponding pixels in each pixel group for viewpoints corresponding to the respective eyeballs of at least some of the viewers.

22. The multi-viewpoint naked-eye stereoscopic display according to any one of claims 16 to 21, characterized in that: The display panel is a self-luminous display panel, and the self-luminous display panel is configured so that unrendered pixels do not emit light.

23. The multi-viewpoint naked-eye stereoscopic display according to claim 22, wherein: The display panel is a Micro-LED display panel.

24. A multi-viewpoint naked-eye stereoscopic display, characterized in that: The invention comprises a display screen having a display panel and a grating, a video signal interface for receiving a 3D video signal, and one or more 3D video processing units, wherein the display panel comprises a plurality of rows and columns of pixels and defines a plurality of pixel groups, each pixel group being composed of at least 3 pixels and corresponding to a multi-viewpoint setting, wherein the irregular relative arrangement positions of the plurality of pixel groups are adjusted or determined based on an optical relationship between the pixels and the grating and / or a correspondence relationship data between the pixels of the display panel and the viewpoints, wherein the one or more 3D video processing units are configured to render corresponding pixels in each pixel group.

25. The multi-viewpoint naked-eye stereoscopic display according to claim 24, wherein: The grating includes a cylindrical prism grating, and the optical relationship between the pixel and the grating includes an alignment relationship between the pixel and the cylindrical prism grating and / or a refraction state of the cylindrical prism grating relative to the corresponding pixel.

26. The multi-viewpoint naked-eye stereoscopic display according to claim 24, wherein: The grating includes a front and / or rear parallax barrier grating, the parallax barrier grating includes a light-shielding portion and a light-transmitting portion, and the optical relationship between the pixel and the grating includes an alignment relationship between the pixel and the corresponding light-transmitting portion of the parallax barrier grating.

27. The multi-viewpoint naked-eye stereoscopic display according to claim 24, wherein: The correspondence between pixels and viewpoints is calculated or determined based on the optical relationship between pixels and the grating.

28. The multi-viewpoint naked-eye stereoscopic display according to claim 24, wherein: The correspondence between pixels and viewpoints is determined by measuring at each viewpoint position.

29. The multi-viewpoint naked-eye stereoscopic display according to any one of claims 24 to 28, characterized in that: It also includes a memory storing the optical relationship data and / or pixel-viewpoint correspondence relationship data, and the one or more 3D video processing units are configured to read the data in the memory.

30. A multi-viewpoint naked-eye stereoscopic display, characterized in that: The present invention comprises a display screen and a memory, wherein the display screen has a display panel and a grating, wherein the display panel includes multiple rows and columns of pixels and defines multiple pixel groups, each pixel group is composed of at least 3 pixels and corresponds to a multi-viewpoint setting, wherein the memory stores optical relationship data between each pixel of the display panel and the grating and / or corresponding relationship data between each pixel of the display panel and the viewpoint, wherein the multiple pixel groups are pixel groups with irregular mutual arrangement positions, and the irregular mutual arrangement positions of the multiple pixel groups are determined based on the optical relationship data between the pixels and the grating and / or the corresponding relationship between the pixels of the display panel and the viewpoint.

31. The multi-viewpoint naked-eye stereoscopic display according to claim 30, wherein: The grating includes a cylindrical prism grating, and the optical relationship between the pixel and the grating includes an alignment relationship between the pixel and the cylindrical prism grating and / or a refraction state of the cylindrical prism grating relative to the corresponding pixel.

32. The multi-viewpoint naked-eye stereoscopic display according to claim 30, wherein: The grating includes a front and / or rear parallax barrier grating, the parallax barrier grating includes a light-shielding portion and a light-transmitting portion, and the optical relationship between the pixel and the grating includes an alignment relationship between the pixel and the corresponding light-transmitting portion of the parallax barrier grating.

33. The multi-viewpoint naked-eye stereoscopic display according to claim 30, wherein: The correspondence between pixels and viewpoints is calculated or determined based on the optical relationship between pixels and the grating.

34. The multi-viewpoint naked-eye stereoscopic display according to claim 30, wherein: The correspondence between pixels and viewpoints is determined by measuring at each viewpoint position.

35. The multi-viewpoint naked-eye stereoscopic display according to any one of claims 30 to 34, characterized in that: It also includes a video signal interface for receiving a 3D video signal and one or more 3D video processing units, wherein the one or more 3D video processing units are configured to generate multiple 3D video images corresponding to part or all of the viewpoints based on the received video signal, and the one or more 3D video processing units are further configured to read the alignment relationship data between each pixel of the display panel and the grating and / or the correspondence relationship data between each pixel of the display panel and the viewpoint and render the pixels corresponding to the part or all of the viewpoints based on the alignment relationship data between each pixel of the display panel and the grating and / or the correspondence relationship data between each pixel of the display panel and the viewpoint.

36. A naked eye stereoscopic display system, characterized in that: The device comprises a processor unit and a multi-viewpoint naked-eye stereoscopic display according to any one of claims 1 to 35, wherein the processor unit is communicatively connected to the multi-viewpoint naked-eye stereoscopic display.

37. The naked eye stereoscopic display system according to claim 36, characterized in that: The naked-eye stereoscopic display system is constructed as a smart TV having the processor unit; or, the naked-eye stereoscopic display system is a smart cellular phone, tablet computer, personal computer or wearable device; or, the naked-eye stereoscopic display system includes a set-top box or a cellular phone or tablet computer with screen projection as the processor unit and a digital TV as a multi-viewpoint naked-eye stereoscopic display connected to the set-top box, cellular phone or tablet computer by wire or wireless; or, the naked-eye stereoscopic display system is constructed as a smart home system or a part thereof, wherein the processor unit includes a smart gateway or central controller of the smart home system, and the smart home system also includes an eye tracking device for obtaining eye tracking data; or, the naked-eye stereoscopic display system is constructed as an entertainment interactive system or a part thereof.

38. The naked eye stereoscopic display system according to claim 37, characterized in that: The entertainment interactive system is configured to be suitable for use by multiple people and generates multiple 3D video signals based on multiple users so as to be transmitted to a naked-eye stereoscopic display.

39. A display method for a multi-viewpoint naked-eye stereoscopic display, characterized in that: The display comprises a display screen having a display panel and a grating, wherein the display panel comprises a plurality of rows and columns of pixels, and the method comprises the following steps: defining a plurality of pixel groups, each pixel group consisting of at least three pixels and corresponding to a multi-viewpoint setting, wherein the plurality of pixel groups are pixel groups having irregular relative positions, and the irregular relative positions of the plurality of pixel groups are determined based on optical relationship data between pixels and a grating and / or a correspondence between pixels of a display panel and viewpoints; receiving a 3D video signal; generating a plurality of images corresponding to all viewpoints or predetermined viewpoints based on an image of a received 3D video signal; Rendering corresponding pixels in each pixel group according to the generated multiple images.

40. The display method according to claim 39, wherein: The method further includes the steps of: receiving or reading eye tracking data of a viewer; wherein the generating step includes determining the predetermined viewpoint based on the real-time eye tracking data of the viewer; and the rendering step includes rendering pixels in each pixel group corresponding to the predetermined viewpoint.

41. A display method for a multi-viewpoint naked-eye stereoscopic display, characterized in that: The display comprises a display screen having a display panel and a grating, wherein the display panel comprises a plurality of rows and columns of pixels and defines a plurality of pixel groups, each pixel group consisting of at least three pixels and corresponding to a multi-viewpoint setting, and the method comprises the following steps: Acquiring optical relationship data between each pixel of the display panel and the grating and / or corresponding relationship data between each pixel of the display panel and a viewpoint, wherein the optical relationship data and / or the corresponding relationship data determine the irregular mutual arrangement positions of the plurality of pixel groups; receiving a 3D video signal; generating a plurality of images corresponding to all viewpoints or predetermined viewpoints based on an image of a received 3D video signal; Render the corresponding pixels based on the generated multiple images, The corresponding pixels to be rendered are determined based on the acquired optical relationship data and / or the corresponding relationship data between each pixel and the viewpoint.

42. The display method according to claim 41, characterized in that: The step of obtaining optical relationship data between each pixel of the display panel and the grating and / or corresponding relationship data between each pixel of the display panel and the viewpoint includes measuring the alignment data of each pixel and the grating and / or the refraction state of the cylindrical prism grating relative to each pixel as the optical relationship data.

43. The display method according to claim 41, characterized in that: The step of obtaining the optical relationship data between each pixel of the display panel and the grating and / or the correspondence data between each pixel of the display panel and the viewpoint includes calculating or determining the correspondence between the pixel and the viewpoint based on the optical relationship between the pixel and the grating, or determining the correspondence between the pixel and the viewpoint by measuring at each viewpoint position.

44. A pixel group arrangement method for a multi-viewpoint naked-eye stereoscopic display, characterized in that: The steps include: Providing a display screen having a display panel and a grating, wherein the display panel includes a plurality of rows and columns of pixels and defines a plurality of pixel groups, each pixel group consisting of at least three pixels and corresponding to a multi-viewpoint setting; Acquiring optical relationship data between each pixel of the display panel and the grating and / or corresponding relationship data between each pixel of the display panel and a viewpoint, wherein the optical relationship data and / or the corresponding relationship data determine the irregular mutual arrangement positions of the plurality of pixel groups; defining a plurality of pixel groups based on the acquired optical relationship data and / or the correspondence relationship data between each pixel and the viewpoint, each pixel group consisting of at least three pixels and corresponding to a multi-viewpoint setting; The multiple pixel groups defined therein are used for multi-viewpoint naked-eye stereoscopic display of the display.

Images