Naked eye 3D LED display device and naked eye 3D display method

Abstract

The invention belongs to the technical field of naked-eye 3D, and particularly relates to naked-eye 3D LED display equipment and a naked-eye 3D display method. The naked-eye 3D LED display equipment comprises a 2D LED display, a dynamic adjustable slit grating and a control device, the control device is electrically connected with the 2D LED display and the dynamic adjustable slit grating, the control device is used for decomposing a 3D image to be displayed into a plurality of parallax images and decomposing each parallax image into low-resolution sub-parallax images, and the sub-parallax images are used for displaying the 3D image to be displayed. The control device is also used for controlling the 2D LED display to sequentially display the sub parallax images of each parallax image in a time-sharing manner and controlling the position of the light-transmitting slit of the dynamic adjustable slit grating to correspondingly change along with the display of each sub parallax image, and the time interval between the sub parallax images displayed for two adjacent times is smaller than or equal to the preset time. According to the invention, the resolution of naked eye 3D image display can be improved.

Description

Technical Field

[0001] The present invention belongs to the field of naked-eye 3D technology, and in particular relates to a naked-eye 3D LED display device and a naked-eye 3D display method. Background Art

[0002] As an emerging display technology, naked-eye 3D display technology has attracted widespread attention because it can provide a stereoscopic visual experience without the need for auxiliary equipment. Among the many naked-eye 3D display technologies, grating-based technology has been widely used in many fields due to its advantages such as simple preparation, good stereoscopic effect and high image quality, and has achieved a certain degree of industrialization. Grating 3D display technology separates the two-dimensional display image through a slit grating or a cylindrical lens grating to achieve the separation of visual information for the left and right eyes. This technology uses the binocular stereoscopic vision fusion of the human eye to form a three-dimensional visual perception. Various two-dimensional display screens, including LCD, OLED, LED, etc., can achieve naked-eye 3D effects through grating 3D technology. Among them, LED display screens have the advantages of high brightness and high refresh rate compared to LCD and OLED screens, and show great potential in the field of naked-eye 3D display. However, since the 3D resolution of the grating 3D display screen is lower than the 2D resolution of the 2D display, especially when the number of viewpoints is large, its 3D resolution is very low; since the 2D resolution of the LED screen is relatively low, it limits the realization of high-resolution naked-eye 3D LED display, so the situation where the 3D resolution is seriously reduced due to multiple viewpoints is particularly obvious on the LED display screen. Although the resolution of 3D images can be provided by increasing the pixels of the two-dimensional display, the LED pixel array is composed of multiple small light-emitting diodes, which are arranged in a matrix to form an image. As the resolution increases, the number of light-emitting diodes required increases, resulting in increased process complexity and cost. Summary of the invention

[0003] In view of this, the present invention provides a naked-eye 3D LED display device and a naked-eye 3D display method to solve the technical problem in the prior art that the LED display displays naked-eye 3D images resulting in reduced image resolution.

[0004] The technical solution adopted by the present invention is:

[0005] In a first aspect, the present invention provides a naked-eye 3D LED display device, comprising a 2D LED display, a dynamically adjustable slit grating and a control device, wherein the control device is electrically connected to the 2D LED display and the dynamically adjustable slit grating, respectively, and the control device is used to decompose a 3D image to be displayed into a plurality of parallax images, and decompose each parallax image into a low-resolution sub-parallax image, and the control device is also used to control the 2D LED display to display the sub-parallax images of each parallax image in time-sharing order, and control the position of the light-transmitting slit of the dynamically adjustable slit grating to change accordingly with the display of each sub-parallax image, wherein the time interval between two adjacent sub-parallax images displayed is less than or equal to a preset time.

[0006] Preferably, the control device includes an LED display controller, a grating controller and a synchronization controller, the LED display controller is electrically connected to the 2D LED display, the grating controller is electrically connected to the dynamically adjustable slit grating, and the synchronization controller is electrically connected to the 2D LED display, the dynamically adjustable slit grating, the LED display controller and the grating controller respectively, the LED display controller is used to control the 2D LED display to display an image, the grating controller is used to control the dynamically adjustable slit grating to display a grating pattern with light-transmitting slits, and the synchronization controller is used to control the grating pattern of the dynamically adjustable slit grating to be displayed synchronously with the image of the 2D LED display.

[0007] Preferably, the dynamically adjustable slit grating is a modulatable dynamic liquid crystal grating, which includes a first polarizer, a strip electrode, a liquid crystal layer, a common electrode and a second polarizer stacked in sequence, and the grating controller is electrically connected to the common electrode and the strip electrode, respectively.

[0008] Preferably, the dynamically adjustable slit grating is a liquid crystal display.

[0009] Preferably, the refresh rates of the 2D LED display and the dynamically adjustable slit grating are both greater than or equal to 120 Hz.

[0010] In a second aspect, the present invention provides a naked-eye 3D display method, which uses the naked-eye 3D LED display device described in the first aspect to display a naked-eye 3D image, and the display method comprises:

[0011] Acquiring a stereoscopic image to be displayed;

[0012] Get the number of viewpoints n;

[0013] Acquire n disparity images corresponding to the viewpoints one by one according to the stereoscopic image to be displayed and the number n of viewpoints;

[0014] Decomposing the disparity image into m low-resolution sub-disparity images;

[0015] Controlling the display to sequentially display the sub-parallax images of each parallax image in a time-sharing manner, and controlling the position of the light-transmitting slit of the dynamically adjustable slit grating to change accordingly with the display of each sub-parallax image, wherein the time interval between two adjacent sub-parallax images displayed is less than or equal to a preset time;

[0016] Wherein, m and n are positive integers greater than or equal to 2, and m is less than or equal to n.

[0017] Preferably, the acquiring n disparity images corresponding to the viewpoints one by one according to the stereoscopic image to be displayed and the number of viewpoints n comprises:

[0018] Acquire first depth information of an image to be displayed;

[0019] Determining the positions and spacings of the viewpoints based on the number of viewpoints n and the expected viewing area of ​​the display;

[0020] Determine the viewpoint coordinates corresponding to each viewpoint according to the position and interval of the viewpoints;

[0021] Projecting pixels of the image to be displayed onto image plane coordinates corresponding to each viewpoint according to the first depth information and the coordinates of each viewpoint to obtain an initial disparity image;

[0022] Identify occluded holes in the initial disparity image;

[0023] The occluded holes are interpolated to obtain a disparity image.

[0024] Preferably, decomposing the disparity image into m low-resolution sub-disparity images further comprises:

[0025] analyzing second depth information of the parallax image according to the first depth information, wherein the second depth information includes local depth distribution and depth variation;

[0026] dividing the disparity image into a plurality of depth regions with different depths according to the second depth information;

[0027] Determine the priority level of each depth area according to the depth information of each depth area;

[0028] Determining the number and resolution of the sub-parallax images for each depth region according to the priority level of each depth region;

[0029] The display time intervals of the sub-parallax images corresponding to the depth regions are adjusted according to the priority levels of the depth regions.

[0030] Preferably, the control display sequentially displays the sub-parallax images of each parallax image in a time-sharing manner, and controls the position of the light-transmitting slit of the dynamically adjustable slit grating to change accordingly with the display of each sub-parallax image, wherein the time interval between two adjacent sub-parallax images displayed is less than or equal to a preset time, including:

[0031] Acquire a pre-divided viewpoint quantity value range, wherein the value range includes a first value range, a second value range, and a third value range in which the viewpoint quantity increases in sequence;

[0032] Determine the value range of the current number of viewpoints;

[0033] If the current number of viewpoints is within the first value range, the sub-parallax images are displayed in sequence at the same time interval;

[0034] If the current number of viewpoints is within the second value range, the priority level of each depth region is obtained:

[0035] Determining, according to the priority level of each depth region, a display time proportion of the sub-parallax image corresponding to each depth region;

[0036] If the current number of viewpoints is within the third value range, obtaining pixel gradients in the disparity image;

[0037] Determine the comprehensive priority level of each region according to the depth and pixel gradient of each depth region and the weight of the depth and the weight of the pixel gradient;

[0038] The resolution and display time interval of each sub-parallax image are adjusted according to the comprehensive priority level.

[0039] Preferably, the grating pattern of the dynamically adjustable slit grating is a grating pattern in which light-transmitting areas and light-impermeable areas are arranged alternately, and the grating pattern displayed one after another is a pattern in which the grating pattern displayed one time before is translated along a preset direction.

[0040] Beneficial effects: The naked-eye 3D LED display device and the naked-eye 3D display method of the present invention decompose the 3D image to be displayed into a plurality of parallax images, and decompose each parallax image into low-resolution sub-parallax images, and then control the 2D LED display to display these sub-parallax images in time-sharing order through a control device, and use the control device to control the position of the light-transmitting slit of the dynamically adjustable slit grating to change in real time with the display of each sub-parallax image. Since the time interval between two adjacent sub-parallax images displayed is less than or equal to the visual persistence time, these rapidly changing low-resolution sub-parallax images will visually synthesize a high-resolution 3D image, thereby realizing a lower-resolution 2D LED display to display a high-resolution 3D image. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the technical solution of the embodiment of the present invention, the drawings required for use in the embodiment of the present invention will be briefly introduced below. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work, and these are all within the protection scope of the present invention.

[0042] Figure 1 The nine-viewpoint grating 3D display pixel distribution diagram of the present invention;

[0043] Figure 2 It is a structural block diagram of the naked-eye 3D LED display device of the present invention;

[0044] Figure 3 A pixel arrangement diagram of a 2D LED display in the present invention;

[0045] Figure 4 A schematic diagram of a modulatable dynamic liquid crystal grating structure in the present invention;

[0046] Figure 5 is a schematic diagram of the process of the naked-eye 3D display method of the present invention;

[0047] Figure 6 It is a schematic flow chart of a method for controlling a display to display a sub-parallax image and controlling a dynamically adjustable grating to display a grating pattern in the present invention;

[0048] Figure 7 A schematic flow chart of a method for determining sub-parallax images corresponding to each display moment according to the present invention;

[0049] Figure 8 A schematic diagram of a flow chart of a method for decomposing a parallax image into sub-parallax images according to the present invention;

[0050] Fig. 9 A schematic diagram of the principle of realizing high-resolution two-viewpoint 3D display through a modulated dynamic grating in the present invention;

[0051] Fig.10 A schematic diagram of a multi-view 3D display system for realizing high resolution through a liquid crystal display screen dynamic grating according to the present invention;

[0052] Fig.11 Schematic diagram of grating patterns displayed by a dynamically modulated grating at two moments;

[0053] Fig.12 Schematic diagram of the arrangement of sub-pixels for nine-viewpoint 3D display at a first time T1 and a second time T2;

[0054] Fig.13 Schematic diagram of pixel distribution of the first viewpoint observed by the human eye through the visual persistence effect. DETAILED DESCRIPTION

[0055] In order to make the purpose, technical solution and advantages of the embodiment of the present invention clearer, the technical solution in the embodiment of the present invention will be clearly and completely described in combination with the embodiment of the present invention. It should be noted that, in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. In the description of the present invention, it should be understood that the orientation or position relationship indicated by the terms "center", "upper", "lower", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc. is based on the orientation or position relationship shown in the drawings, which is only for the convenience of describing the present application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present invention. Moreover, the term "include", "comprise" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such a process, method, article or device. In the absence of further restrictions, the elements defined by the phrase "comprising..." do not exclude the existence of other identical elements in the process, method, article or device comprising the elements. If there is no conflict, the embodiments of the present invention and the various features in the embodiments can be combined with each other, all within the protection scope of the present invention.

[0056] Example 1

[0057] In naked-eye 3D display technology, spatial resolution decreases as the number of viewpoints increases, because the original 2D display image is divided into two or more viewpoint images with parallax. Figure 1 The pixel distribution diagram of nine-viewpoint naked-eye 3D display using tilted gratings is shown in . In this example, nine images with different parallaxes are displayed simultaneously on a 2D display, and the horizontal and vertical resolutions of the display are reduced to 1 / 3 of the original resolutions, respectively. Accordingly, the spatial resolution of the naked-eye 3D display becomes 1 / 9 of the original 2D display resolution.

[0058] In this regard Figure 2As shown, the present embodiment provides a naked-eye 3D LED display device, which includes a 2D LED display, a dynamically adjustable slit grating and a control device, wherein the control device is electrically connected to the 2D LED display and the dynamically adjustable slit grating respectively, and the control device is used to decompose the 3D image to be displayed into a plurality of parallax images, and decompose each parallax image into a low-resolution sub-parallax image, and the control device is also used to control the 2D LED display to display the sub-parallax images of each parallax image in time-sharing order, and control the position of the light-transmitting slit of the dynamically adjustable slit grating to change accordingly with the display of each sub-parallax image, wherein the time interval between two adjacent sub-parallax images displayed is less than or equal to a preset time.

[0059] Displaying the sub-parallax images of each parallax image in sequence in time-sharing means displaying the sub-parallax images of the same parallax image in different display time periods, and having one sub-parallax image displayed for each parallax image in the same display time period, that is, each parallax image adopts a time-division multiplexing display method, different sub-parallax images of the same parallax image are displayed in time-sharing, and each parallax image is displayed simultaneously, so that the corresponding parallax image can be viewed from each viewpoint in the same display time period, thereby forming a naked-eye 3D image.

[0060] The aforementioned preset time refers to the effective time of the visual persistence effect of the human eye, and generally 0.1 second can be selected as the preset time. Although the sub-parallax images in this embodiment are displayed in time-sharing at different times, as long as the time interval between these sub-parallax images is short enough, with the help of the visual persistence effect of the human eye, these rapidly changing low-resolution sub-images will visually synthesize a high-resolution 3D image, thereby achieving a naked-eye 3D effect and enhancing the user's visual experience.

[0061] The dynamically adjustable slit grating is an optical device that can adjust the position of the light-transmitting slit in the grating in real time as needed. The light-transmitting slit in the dynamically adjustable slit grating is a light-transmitting area in the shape of a slit, through which part of the light from the display can reach the eyes of the observer. The remaining area is a non-light-transmitting area that does not allow light to pass through. By setting the position of the light-transmitting slit, the light emitted by the corresponding parallax image can only pass through the slit to reach the viewpoint position, while other positions cannot view the corresponding parallax image due to the occlusion of the non-light-transmitting area in the grating. By setting the position of the light-transmitting slit, each viewpoint position can only view the corresponding parallax image, and cannot view other non-corresponding parallax images.

[0062] For example, the light-transmitting area allows light to pass through by displaying white pixels, while the non-light-transmitting area displays black pixels to block light, thereby forming the required grating structure. This method not only achieves dynamic modulation, but also has high resolution and flexibility, which can adapt to the needs of different application scenarios.

[0063] The naked-eye 3D LED display device of this embodiment decomposes a high-resolution multi-viewpoint 3D image into N multi-viewpoint low-resolution sub-images, and displays these sub-images one after another on a 2D display screen quickly through time-division multiplexing technology. With the help of the visual persistence effect of the human eye, these rapidly changing low-resolution sub-images will visually synthesize a high-resolution 3D image.

[0064] In this embodiment, the control device includes an LED display controller, a grating controller and a synchronization controller. The LED display controller is electrically connected to the 2D LED display, the grating controller is electrically connected to the dynamically adjustable slit grating, and the synchronization controller is electrically connected to the 2D LED display, the dynamically adjustable slit grating, the LED display controller and the grating controller respectively. The LED display controller is used to control the 2D LED display to display an image, the grating controller is used to control the dynamically adjustable slit grating to display a grating pattern with a light-transmitting slit, and the synchronization controller is used to control the grating pattern of the dynamically adjustable slit grating to be displayed synchronously with the image displayed by the two-dimensional LED.

[0065] like Figure 3 As shown, the 2D LED display includes a plurality of pixels 3 arranged in an array. Figure 3 A pixel arrangement of a 2D LED display is shown. In the display, pixels 3 are arranged at a uniform pitch to ensure that the dot spacing between each pixel in the horizontal direction is equal. Each pixel is composed of three sub-pixels 31 of red (R), green (G), and blue (B), which are arranged in the horizontal direction, so that the display can achieve rich color expression and high-quality image display.

[0066] In addition to the pixel arrangement described above, this embodiment may also adopt other forms of pixel arrangement according to application requirements to meet the needs of different scenarios. Therefore, there is no limitation on the pixel arrangement of the 2D LED display.

[0067] The LED display controller is used to control the 2D LED display to display the parallax image, and the grating controller is used to control the dynamically adjustable slit grating to display a grating pattern with light-transmitting slits at preset positions. The synchronization controller is used to control the LED display to display the parallax image and the grating pattern displayed by the dynamically adjustable slit grating synchronously.

[0068] like Figure 4As shown, as one example, the dynamically adjustable slit grating is a modulatable dynamic liquid crystal grating, and the modulatable dynamic liquid crystal grating includes a first polarizer, a strip electrode, a liquid crystal layer, a common electrode and a second polarizer stacked in sequence, and the grating controller is electrically connected to the common electrode and the strip electrode, respectively.

[0069] The modulatable dynamic liquid crystal grating in this embodiment can realize light modulation by electric control. The modulator includes a first polarizer and a second polarizer, between which a plurality of strip electrodes are arranged, close to one side of the first polarizer, and a common electrode is close to the position of the second polarizer. The liquid crystal layer is placed between the plurality of electrodes and the common electrode. The liquid crystal grating also includes a grating controller, which is responsible for adjusting the voltage signal applied to the plurality of electrodes and the common electrode. By accurately controlling the voltage signal, the liquid crystal molecules in the liquid crystal layer can be deflected, thereby forming a plurality of light-transmitting areas and non-light-transmitting areas arranged alternately with each other. The light-transmitting area is the aforementioned light-transmitting slit.

[0070] In this embodiment, the dynamically adjustable slit grating can also be realized by using a fast-response liquid crystal display. Through the characteristics of the liquid crystal display, we can accurately control the light-transmitting area and the non-light-transmitting area of ​​the grating. For example, the light-transmitting area allows light to pass through by displaying white pixels, while the non-light-transmitting area displays black pixels to block light, thereby forming the desired grating structure. This method not only realizes dynamic modulation, but also has high resolution and flexibility, and can adapt to the needs of different application scenarios.

[0071] In this embodiment, the refresh rates of the 2D LED display and the dynamically adjustable slit grating are both greater than or equal to 120 Hz. The above refresh rate allows the two decomposed sub-parallax images to be displayed sequentially within the effective visual persistence time, thereby having a better 3D display effect. In specific implementation, a higher refresh rate can also be used as needed to further improve the resolution of the 3D image display.

[0072] Example 2

[0073] This embodiment also provides a naked-eye 3D display method, which uses the naked-eye 3D LED display device described in Embodiment 1 to display naked-eye 3D images. Figure 5 As shown, the display method includes:

[0074] S1: Acquire a stereoscopic image to be displayed;

[0075] S2: Get the number of viewpoints n;

[0076] Since the naked-eye 3D image display is obtained by fusing multiple two-dimensional images with parallax, the parallax image viewed at each viewpoint is different. Therefore, this step first obtains the number of viewpoints n, and then determines the number of parallax images according to the number of viewpoints.

[0077] S3: acquiring n disparity images corresponding to the viewpoints one by one according to the stereoscopic image to be displayed and the number n of viewpoints;

[0078] In this step, the 3D stereo image is decomposed into a plurality of disparity images having the same number as the viewpoint images, wherein each viewpoint corresponds to a disparity image.

[0079] S4: decomposing the disparity image into m low-resolution sub-disparity images;

[0080] Since the 2D LED display has to display images with different parallaxes at the same time during naked-eye 3D display, the displayed parallax images cannot repeatedly occupy the same pixels at the same time. To solve this problem, the resolution of the parallax images can be reduced so that the 2D LED display can display the parallax images with different pixels at the same time. These parallax images with reduced resolution are the aforementioned sub-parallax images, which are obtained by decomposing the original parallax images.

[0081] S5: controlling the display to sequentially display the sub-parallax images of each parallax image in a time-sharing manner, and controlling the position of the light-transmitting slit of the dynamically adjustable slit grating to change accordingly with the display of each sub-parallax image, wherein the time interval between two adjacent sub-parallax images displayed is less than or equal to a preset time;

[0082] Wherein, m and n are positive integers greater than or equal to 2, and m is less than or equal to n.

[0083] Displaying the sub-parallax images of each parallax image in sequence in time-sharing means displaying the sub-parallax images of the same parallax image in different display time periods, and having one sub-parallax image displayed for each parallax image in the same display time period, that is, each parallax image adopts a time-division multiplexing display method, different sub-images of the same parallax image are displayed in time-sharing, and each parallax image is displayed simultaneously, so that the corresponding parallax image can be viewed from each viewpoint in the same display time period, thereby forming a naked-eye 3D image.

[0084] The naked-eye 3D LED display method of this embodiment decomposes a high-resolution multi-viewpoint 3D image into N multi-viewpoint low-resolution sub-images, and quickly displays these sub-images in sequence on a 2D display screen through time division multiplexing technology. With the help of the visual persistence effect of the human eye, these rapidly changing low-resolution sub-images will visually synthesize a high-resolution 3D image.

[0085] The step S3: acquiring n disparity images corresponding to the viewpoints one by one according to the stereoscopic image to be displayed and the number of viewpoints n comprises:

[0086] S31: Acquire first depth information of an image to be displayed;

[0087] This step can utilize existing stereo image data and extract the depth information of each pixel, namely the aforementioned first depth information, through a stereo matching algorithm or other depth estimation technology.

[0088] S32: Obtain the number of viewpoints n and the expected viewing area of ​​the display to determine the positions and intervals of the viewpoints;

[0089] S33: determining the viewpoint coordinates corresponding to each viewpoint in the space according to the position and interval of the viewpoints;

[0090] The viewpoint position can be the position of the virtual camera or the observation point. For example, the viewpoint position can be distributed with equal spacing or with dense distribution in the middle and sparse distribution on both sides.

[0091] S34: projecting pixels of the image to be displayed onto image plane coordinates corresponding to each viewpoint according to the first depth information and the coordinates of each viewpoint to obtain an initial parallax image;

[0092] For each viewpoint, the first depth information is used to project the pixels of the source image to the image plane coordinates under the new viewpoint according to the depth and coordinate relationship to generate an initial disparity image; wherein projecting the depth information to obtain the initial disparity image includes: first mapping the depth information to a disparity value; for example, the disparity value formula in the classic binocular stereo geometry can be used to calculate the disparity value: (z×b) / f, where z is the depth value, f is the focal length, and b is the baseline. Then, the original image is remapped according to the disparity value, and the blank area generated during the mapping process is repaired using the pixel filling technology.

[0093] S35: Identify occlusion holes in the initial disparity image; when the scene undergoes occlusion changes, for example, the background that is not visible from the source viewpoint may be exposed at the target viewpoint, resulting in holes in the target image.

[0094] S36: performing interpolation processing on the occluded hole to obtain a disparity image.

[0095] This step uses interpolation to fill the holes, thereby obtaining a visually complete parallax image.

[0096] like Figure 6 As shown, in this embodiment, the S5: controlling the display to sequentially display the sub-parallax images of each parallax image in a time-sharing manner, and controlling the position of the light-transmitting slit of the dynamically adjustable slit grating to change accordingly with the display of each sub-parallax image, wherein the time interval between two adjacent sub-parallax images displayed is less than or equal to the preset time also includes:

[0097] S51: determining m display time periods for sequentially displaying the sub-parallax images according to the number m of the sub-parallax images, so that the length of each display time period is less than or equal to the preset time;

[0098] The number m of sub-parallax images refers to the number of sub-parallax images obtained after decomposing the same parallax image. In each time period, one sub-parallax image of the same parallax image is displayed, and each parallax image has a sub-parallax image displayed in the time period, so as to form a 3D image using different low-resolution parallax images at the same time. The preset time is the maximum time allowed by the visual persistence effect.

[0099] S52: Obtain pixel distribution of each sub-parallax image;

[0100] The pixel distribution of the sub-parallax image refers to the position distribution of pixels used to display the sub-parallax image.

[0101] S53: determining a sub-parallax image of each parallax image displayed in each display time period according to m different display time periods and pixel distribution of each sub-parallax image, wherein each parallax image has one and only one sub-parallax image displayed in the same display time period, and each sub-parallax image in the same display time period occupies different sub-pixels;

[0102] In this step, the decomposed sub-parallax images are allocated to each time period, so that each sub-parallax image of the same parallax image is displayed in different display time periods, and a low-resolution image, i.e., a sub-parallax image, of each parallax image is displayed in the same time period, so that the same pixel of the two-dimensional LED is reused in different time periods.

[0103] S54: determining the position of the light-transmitting slit corresponding to each display time period according to the pixel distribution of the sub-parallax image displayed in each time period;

[0104] S55: Control the display to sequentially display the sub-parallax images corresponding to each display time period, and control the light-transmitting slits of the dynamically adjustable slit grating to sequentially appear at positions corresponding to each display time period.

[0105] The sub-parallax image in each display period and the grating pattern formed by the light-transmitting slits are displayed simultaneously, so that the sub-parallax image displayed in this period can just reach the corresponding viewpoint through the light-transmitting slits.

[0106] like Figure 7As shown, in this embodiment, the S53: determining the sub-parallax image of each parallax image displayed in each display time period according to m different display time periods and the pixel distribution of each sub-parallax image, wherein each parallax image in the same display time period has one and only one sub-parallax image displayed, and each sub-parallax image in the same display time period occupies different sub-pixels, further includes:

[0107] S531: selecting a display time period of a sub-parallax image that has not yet been determined to be displayed from the display time periods as a target display time period;

[0108] S532: selecting a sub-parallax image from each parallax image as the sub-parallax image corresponding to the target display time period;

[0109] S533: Determine whether each sub-parallax image corresponding to the target display time period occupies the same sub-pixel;

[0110] S534: if yes, replace the sub-parallax image occupying the same sub-pixel with other sub-parallax images in the same parallax image;

[0111] S535: If not, the above steps are repeated until all sub-parallax images displayed in all display time periods are determined.

[0112] like Figure 8 As shown, in this embodiment, the step S4: decomposing the parallax image into m low-resolution sub-parallax images further includes:

[0113] S41: Obtaining a reference refresh frequency f1;

[0114] The reference refresh frequency f1 can be set to 60 Hz.

[0115] S42: Acquire the refresh frequency of the display and the refresh frequency of the dynamically adjustable slit grating;

[0116] S43: comparing the refresh frequency of the display and the refresh frequency of the dynamically adjustable slit grating, and taking the lowest refresh frequency of the two as the reference refresh frequency f2;

[0117] S44: determining the number m of sub-parallax images obtained by decomposing a parallax image according to the ratio of the reference refresh frequency f2 to the base refresh frequency;

[0118] The aforementioned implementation can make full use of the refresh rates of the display and the dynamically adjustable slit grating, and decompose the parallax image according to the refresh rates of the two, so that the resolution of the naked-eye 3D image formed in the user's brain through the persistence of vision effect can be maximized under the condition that the device refresh rate allows.

[0119] When the above solution is implemented, the ratio k=f2 / f1 of the reference refresh frequency f2 and the base refresh frequency f1 can be calculated first, and then the integer part of k is taken as the number m of sub-parallax images.

[0120] In this embodiment, the step S4: decomposing the parallax image into m low-resolution sub-parallax images further includes:

[0121] S401: Calculating second depth information of the disparity image according to the first depth information, where the second depth information includes local depth distribution and depth change;

[0122] In this step, after obtaining the depth information of each pixel, the depth distribution and depth change of each local area of ​​the image are analyzed.

[0123] S402: Dividing the disparity image into a plurality of depth regions with different depths according to the depth information;

[0124] In the naked eye 3D display image, different areas in the image often have different scene depths. For example, the image generally includes a foreground area, a middle area and a background area. The scene area has a shallower depth, the middle area has a deeper depth than the foreground area, and the background area has the deepest depth. In this step, multiple different depth ranges can be set first, and areas belonging to the same depth range are divided into the same depth area.

[0125] S403: Determine the priority level of each depth area according to the depth information of each depth area;

[0126] For example, a region with a shallower depth has a higher priority, or a region with a greater depth has a higher priority.

[0127] S404: Determine the number and resolution of sub-disparity images for each depth region according to the priority level of each depth region;

[0128] In this step, a region with a higher priority has more sub-parallax images divided therein, and its corresponding resolution is also higher.

[0129] S405: adjusting the display time intervals of the sub-parallax images corresponding to the depth regions according to the priority levels of the depth regions.

[0130] This step adjusts the time interval for displaying the sub-parallax images of the depth area according to the priority. The higher the priority, the shorter the time interval for displaying the sub-parallax images, so that the image update speed of the area with a relatively large depth change is faster, and the smoothness of the naked-eye 3D image display can be provided under the condition of limited display resources. In combination with the sub-parallax images and resolutions allocated according to the depth priority level, the naked-eye 3D image can make full use of the display resources of the display, so that the details of the image can be better displayed.

[0131] In this embodiment, the step S5: controlling the display to sequentially display the sub-parallax images of each parallax image in a time-sharing manner, and controlling the position of the light-transmitting slit of the dynamically adjustable slit grating to change accordingly with the display of each sub-parallax image, wherein the time interval between two adjacent sub-parallax images displayed is less than or equal to a preset time includes:

[0132] S501: Acquire a pre-divided viewpoint quantity value range, wherein the value range includes a first value range, a second value range, and a third value range in which the viewpoint quantity increases in sequence;

[0133] The first value range is [2,4], the second value range is [5,9], and the third value range is [10,20]

[0134] S502: Determine the value range of the current number of viewpoints;

[0135] S503: if the current number of viewpoints is within the first value range, the sub-parallax images are displayed in sequence at the same time interval;

[0136] The first value range is suitable for naked-eye 3D display with a small viewing angle, has low computational complexity, and has low refresh rate pressure. The sub-parallax images corresponding to each viewpoint are displayed in sequence in a time-sharing manner with a uniform time interval.

[0137] S504: If the current number of viewpoints is within the second value range, obtaining the priority level of each depth region:

[0138] S505: determining the display time proportion of the sub-parallax image corresponding to each depth region according to the priority level of each depth region;

[0139] The second range is suitable for medium-angle naked-eye 3D display (such as large displays or exhibition equipment). It is necessary to balance the relationship between refresh rate and resolution. Sub-parallax images are displayed in sequence, but dynamic priority allocation is added: for example, foreground area: a higher time proportion is allocated. Background area: a lower time proportion is allocated. The time proportion is dynamically adjusted according to the priority weight. Dynamic modulation focuses on key depth areas to enhance visual impact

[0140] S506: If the current number of viewpoints is within the third value range, obtaining pixel gradients in the disparity image;

[0141] S507: determining a comprehensive priority level of each region according to the depth and pixel gradient of each depth region and the weight of the depth and the weight of the pixel gradient;

[0142] S508: Adjust the resolution and display time interval of each sub-parallax image according to the comprehensive priority level.

[0143] The third value selection method is suitable for wide-viewing angle naked-eye 3D displays (such as holographic walls and large cinema screens). For such scenes, weights can be assigned to depth and pixels respectively, and the comprehensive priority of each area can be calculated. For high-priority areas: more sub-parallax images m are allocated, resolution and refresh rate are improved, and the time interval between sub-parallax images is reduced. For low-priority areas, resource consumption is reduced by reducing sub-parallax images m.

[0144] In this embodiment, the grating pattern of the dynamically adjustable slit grating is a grating pattern in which light-transmitting areas and opaque areas are arranged alternately, and the grating pattern displayed one after another is a pattern in which the grating pattern displayed one time is translated along a preset direction. In addition to the aforementioned manner, this embodiment may also adopt other grating pattern changing manners according to the pixel distribution of the sub-parallax images displayed one after another, which is not specifically limited here.

[0145] The following is an example of the display of a two-view naked-eye 3D image. In this example, a high-resolution two-view 3D display system is realized by a modulated dynamic grating. The naked-eye 3D display device is composed of an LED display with a refresh rate greater than or equal to 120Hz, and a liquid crystal dynamic grating is configured in front of the display, and its refresh rate is also matched, which also needs to be greater than or equal to 120Hz. The grating is designed to be partially transparent and partially opaque.

[0146] like Fig. 9As shown, at time T1, the liquid crystal grating is in the first state, and through the grating, the right eye receives the right parallax image composed of even-numbered columns of pixels, while the left eye sees the left parallax image composed of odd-numbered columns of pixels. Subsequently, at time T2, the liquid crystal grating switches to the second state, at which time the odd-numbered columns of pixels on the display screen present the right parallax image, while the even-numbered columns of pixels show the left parallax image. Although the resolution of the parallax image seen by the viewer's left and right eyes is only half of the resolution of the display screen at these two different moments, since the switching frequency of the liquid crystal slit grating is higher than 120Hz, the audience will not notice the alternation of the two states, because of the existence of the visual persistence effect. Therefore, the parallax image received by each eye of the viewer is actually the superposition of the parallax images at two moments, thereby achieving a stereoscopic image resolution equal to that of a 2D display screen. Similarly, with the further improvement of the response speed of the liquid crystal slit grating and the 2D display screen, high-resolution 3D display with multiple viewpoints can also be achieved.

[0147] The following is an example of displaying a naked-eye 3D image with nine viewpoints. Fig.10 As shown, this example realizes a high-resolution multi-view 3D display system through a dynamic grating of a liquid crystal display. The system includes an LED display with a refresh rate greater than or equal to 120Hz and a controller thereof, a liquid crystal display with a refresh rate greater than or equal to 120Hz and a controller thereof, and a synchronization controller. First, the system sets a specific pattern for the first time grating and determines the sub-pixel distribution of the multi-view 3D image accordingly. Next, the system sets a pattern for the second time grating and its corresponding sub-pixel distribution of the multi-view 3D image in sequence. By decomposing a high-resolution multi-view 3D image into two low-resolution multi-view sub-images, the system can quickly display these sub-images in sequence on a 2D LED display and synchronously display the corresponding grating pattern on the liquid crystal screen. The refresh rate of the two sub-images is greater than or equal to 60Hz. With the help of the visual persistence effect of the human eye, these two rapidly changing low-resolution sub-images will visually synthesize a high-resolution 3D image.

[0148] in Fig.11 It is a specific grating pattern displayed on the liquid crystal display screen at the first time T1 and the second time T2. The grating pattern displayed at the second time is a horizontal translation pattern of the grating displayed at the first time, and the interval between the light-transmitting area and the opaque area remains unchanged. Fig.12 What is displayed is the 9-viewpoint 3D display sub-pixel arrangement corresponding to the first time grating pattern and the second time grating pattern on the LED display screen. The refresh rate of the two sub-images is greater than or equal to 60Hz. With the help of the visual persistence effect of the human eye, these two fast-changing low-resolution sub-images will visually synthesize a 3D image with 2 times the resolution, such as Fig.13 shown.

[0149] The above is a detailed introduction to the naked-eye 3D LED display device and the naked-eye 3D display method provided by the embodiments of the present invention.

[0150] It should be clear that the present invention is not limited to the specific configuration and processing described above and shown in the figure. For the sake of simplicity, a detailed description of the known method is omitted here. In the above embodiment, several specific steps are described and shown as examples. However, the method process of the present invention is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order between the steps after understanding the spirit of the present invention. The functional blocks shown in the structural block diagram described above can be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application-specific integrated circuit (ASIC), appropriate firmware, plug-in, function card, etc. When implemented in software, the elements of the present invention are programs or code segments used to perform the required tasks. The program or code segment can be stored in a machine-readable medium, or transmitted on a transmission medium or communication link via a data signal carried in a carrier. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROMs, flash memories, erasable ROMs (EROMs), floppy disks, CD-ROMs, optical disks, hard disks, optical fiber media, radio frequency (RF) links, and the like. The code segments can be downloaded via a computer network such as the Internet, an intranet, etc. It should also be noted that the exemplary embodiments mentioned in the present invention describe some methods or systems based on a series of steps or devices. However, the present invention is not limited to the order of the above steps, that is, the steps can be performed in the order mentioned in the embodiment, or in a different order from the embodiment, or several steps can be performed simultaneously.

[0151] The above is only a specific implementation of the present invention. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process of the system, module and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here. It should be understood that the protection scope of the present invention is not limited to this. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed by the present invention, and these modifications or replacements should be covered within the protection scope of the present invention.

Claims

1. A naked-eye 3D LED display device, characterized in that: The invention comprises a 2D LED display, a dynamically adjustable slit grating and a control device, wherein the control device is electrically connected to the 2D LED display and the dynamically adjustable slit grating respectively, and is used to decompose a 3D image to be displayed into a plurality of parallax images, and decompose each parallax image into a low-resolution sub-parallax image. The control device is also used to control the 2D LED display to sequentially display the sub-parallax images of each parallax image in a time-sharing manner, and to control the position of the light-transmitting slit of the dynamically adjustable slit grating to change accordingly with the display of each sub-parallax image, wherein the time interval between two adjacent sub-parallax images displayed is less than or equal to a preset time.

2. The naked eye 3D LED display device according to claim 1, characterized in that: The control device includes an LED display controller, a grating controller and a synchronization controller. The LED display controller is electrically connected to the 2D LED display, the grating controller is electrically connected to the dynamically adjustable slit grating, and the synchronization controller is electrically connected to the 2D LED display, the dynamically adjustable slit grating, the LED display controller and the grating controller respectively. The LED display controller is used to control the 2D LED display to display an image, the grating controller is used to control the dynamically adjustable slit grating to display a grating pattern with light-transmitting slits, and the synchronization controller is used to control the grating pattern of the dynamically adjustable slit grating to be displayed synchronously with the image of the 2D LED display.

3. The naked eye 3D LED display device according to claim 2, characterized in that: The dynamically adjustable slit grating is a modulatable dynamic liquid crystal grating, which includes a first polarizer, a strip electrode, a liquid crystal layer, a common electrode and a second polarizer stacked in sequence, and the grating controller is electrically connected to the common electrode and the strip electrode respectively.

4. The naked eye 3D LED display device according to claim 2, characterized in that: The dynamically adjustable slit grating is a liquid crystal display.

5. The naked-eye 3D LED display device according to any one of claims 1 to 4, characterized in that: The refresh rates of the 2D LED display and the dynamically adjustable slit grating are both greater than or equal to 120 Hz.

6. A naked eye 3D display method, characterized in that: The naked-eye 3D LED display device according to any one of claims 1 to 5 is used to display naked-eye 3D images, and the display method comprises: Acquire a stereoscopic image to be displayed; Get the number of viewpoints n; Acquire n disparity images corresponding to the viewpoints one by one according to the stereoscopic image to be displayed and the number n of viewpoints; Decomposing the disparity image into m low-resolution sub-disparity images; Controlling the display to sequentially display the sub-parallax images of each parallax image in a time-sharing manner, and controlling the position of the light-transmitting slit of the dynamically adjustable slit grating to change accordingly with the display of each sub-parallax image, wherein the time interval between two adjacent sub-parallax images displayed is less than or equal to a preset time; Wherein, m and n are positive integers greater than or equal to 2, and m is less than or equal to n.

7. The naked eye 3D display method according to claim 6, characterized in that: The acquiring n disparity images corresponding to the viewpoints one by one according to the stereoscopic image to be displayed and the number of viewpoints n comprises: Acquire first depth information of an image to be displayed; Determining the positions and spacings of the viewpoints based on the number of viewpoints n and the expected viewing area of ​​the display; Determine the viewpoint coordinates corresponding to each viewpoint according to the position and interval of the viewpoints; Projecting pixels of the image to be displayed onto image plane coordinates corresponding to each viewpoint according to the first depth information and the coordinates of each viewpoint to obtain an initial disparity image; Identify occluded holes in the initial disparity image; The occluded hole is interpolated to obtain a disparity image.

8. The naked eye 3D display method according to claim 7, characterized in that: The step of decomposing the disparity image into m low-resolution sub-disparity images further comprises: analyzing second depth information of the parallax image according to the first depth information, wherein the second depth information includes local depth distribution and depth variation; dividing the disparity image into a plurality of depth regions with different depths according to the second depth information; Determine the priority level of each depth area according to the depth information of each depth area; Determining the number and resolution of the sub-parallax images for each depth region according to the priority level of each depth region; The display time intervals of the sub-parallax images corresponding to the depth regions are adjusted according to the priority levels of the depth regions.

9. The naked eye 3D display method according to claim 7, characterized in that: The control display sequentially displays the sub-parallax images of each parallax image in a time-sharing manner, and controls the position of the light-transmitting slit of the dynamically adjustable slit grating to change accordingly with the display of each sub-parallax image, wherein the time interval between two adjacent sub-parallax images displayed is less than or equal to a preset time, including: Acquire a pre-divided viewpoint quantity value range, wherein the value range includes a first value range, a second value range, and a third value range in which the viewpoint quantity increases in sequence; Determine the value range of the current number of viewpoints; If the current number of viewpoints is within the first value range, the sub-parallax images are displayed in sequence at the same time interval; If the current number of viewpoints is within the second value range, the priority level of each depth region is obtained: Determining, according to the priority level of each depth region, a display time proportion of the sub-parallax image corresponding to each depth region; If the current number of viewpoints is within the third value range, obtaining pixel gradients in the disparity image; Determine the comprehensive priority level of each region according to the depth and pixel gradient of each depth region and the weight of the depth and the weight of the pixel gradient; The resolution and display time interval of each sub-parallax image are adjusted according to the comprehensive priority level.

10. The naked eye 3D display method according to any one of claim 7, characterized in that: The grating pattern of the dynamically adjustable slit grating is a grating pattern in which light-transmitting areas and light-impermeable areas are arranged alternately, and the grating pattern displayed one after another is a pattern in which the grating pattern displayed one time before is translated along a preset direction.

Images