Naked eye 3D display device and display method thereof

Abstract

The present invention provides a naked-eye 3D display device and a display method thereof, belonging to the field of display technology. The naked-eye 3D display method comprises: controlling a display panel to display M test images in sequence, taking pictures of the M test images displayed by the display panel at preset viewpoints among N viewpoints, respectively, to obtain M first images; processing the M first images respectively, to obtain M second images, the second images being images of the display area of ​​the display panel; dividing each of the M second images into L sub-image areas, generating a numbering matrix according to the numbering of the second image corresponding to the sub-image area with the maximum brightness; calculating the offset value of each sub-image area according to the numbering matrix; correcting the position of the pixel group in the sub-image area according to the offset value, and displaying the arrangement of the image using the position of the corrected pixel group. The present invention can solve the problems of local ghosting and local distortion of 3D images, and improve the user viewing experience.

Description

Technical Field

[0001] The present invention relates to the field of display technology, and in particular to a naked-eye 3D display device and a display method thereof. Background Art

[0002] Naked-eye 3D display technology can achieve stereoscopic visual effects without the help of external tools such as polarized glasses. Currently, the representatives of naked-eye 3D display technology mainly include light barrier technology, cylindrical lens technology and distributed optical matrix technology. Among them, cylindrical lens technology has no effect on the brightness of the display screen and has better stereoscopic imaging. It is currently the most widely used naked-eye 3D display technology.

[0003] In the process of manufacturing a 3D display with a cylindrical prism, the cylindrical prism may not be properly bonded to the liquid crystal display, resulting in a certain difference between the theoretical arrangement and the actual display effect (image ghosting, distortion, etc.), which has a great impact on the user's viewing experience. Summary of the invention

[0004] The technical problem to be solved by the present invention is to provide a naked-eye 3D display device and a display method thereof, which can solve the problems of local ghosting and local distortion of 3D images and improve the user viewing experience.

[0005] To solve the above technical problems, the embodiments of the present invention provide the following technical solutions:

[0006] On the one hand, a naked-eye 3D display method is provided, which is applied to a naked-eye 3D display device, wherein the naked-eye 3D display device comprises: a display panel and a light splitting component arranged on a light-emitting side of the display panel, wherein the display panel comprises: a plurality of pixel groups, each pixel group comprises N pixels; the light splitting component comprises: a plurality of light splitting structures, which are configured to form N viewpoints, where N is a positive integer greater than or equal to 2; the display method comprises:

[0007] Step 1, controlling the display panel to display M test images in sequence, taking photos of the M test images displayed by the display panel at preset viewpoints among the N viewpoints, respectively, to obtain M first images, wherein in the M first images, a display area of ​​the display panel in the Kth first image is completely white, where M is a positive integer greater than or equal to 2, and K is a positive integer greater than or equal to 1 and less than or equal to M;

[0008] Step 2: Process the M first images respectively to obtain M second images, where the second images are images of the display area of ​​the display panel;

[0009] Step 3: Divide each of the M second images into L sub-image areas, and generate a number matrix according to the numbers of the second images corresponding to the sub-image areas with maximum brightness, wherein the number matrix includes L elements, each element corresponds to the sub-image area one by one, and the sub-image area corresponds to at least one pixel group of the display panel;

[0010] Step 4, calculating the offset value of each sub-image area according to the numbering matrix;

[0011] Step 5: Correct the position of the pixel group corresponding to the sub-image area according to the offset value, and use the corrected position of the pixel group to display the image.

[0012] In some embodiments, step 3 specifically includes:

[0013] Acquire L sub-image area groups according to the M second images, each of the sub-image area groups includes M sub-image areas, and the M sub-image areas are located in different second images and correspond to the same area of ​​the display panel;

[0014] The brightest sub-image area in each of the sub-image area groups is determined, and the number of the second image corresponding to the brightest sub-image area is used as the number of the sub-image area group to obtain L numbers corresponding to the L sub-image area groups, and the L numbers constitute the number matrix.

[0015] In some embodiments, step 4 specifically includes:

[0016] Determine the number that appears most times in the number matrix, recorded as A;

[0017] The offset value of each sub-image area is calculated by the difference between the number corresponding to each sub-image area in the number matrix and A, the value of M, and the pixel width covered by each of the light-splitting structures.

[0018] In some embodiments, steps 1-5 are repeated multiple times.

[0019] In some embodiments, steps 1-5 are repeated four times.

[0020] In some embodiments, K is (M+1) / 2 or M / 2 or M / 2+1.

[0021] In some embodiments, the sub-image areas correspond one-to-one to pixel groups of the display panel.

[0022] In some embodiments, determining the brightest sub-image region in each of the sub-image region groups comprises:

[0023] The second image is converted from the RGB color domain to the YUV color domain, the brightness component of each pixel is extracted, and the arithmetic mean of the brightness components of multiple pixels in each sub-image area is used as the brightness of the sub-image area.

[0024] An embodiment of the present invention further provides a naked-eye 3D display device, the naked-eye 3D display device comprising: a display panel and a light splitting component arranged on a light-emitting side of the display panel, the display panel comprising: a plurality of pixel groups, each pixel group comprising N pixels; the light splitting component comprising: a plurality of light splitting structures, configured to form N viewpoints, N being a positive integer greater than or equal to 2; the display device further comprising:

[0025] an image acquisition module, used to control the display panel to display M test images in sequence, and to take pictures of the M test images displayed by the display panel at preset viewpoints among the N viewpoints, respectively, to obtain M first images, wherein among the M first images, a display area of ​​the display panel in the Kth first image is completely white, where M is a positive integer greater than or equal to 2, and K is a positive integer greater than or equal to 1 and less than or equal to M;

[0026] an image processing module, used to process the M first images respectively to obtain M second images, where the second images are images of the display area of ​​the display panel;

[0027] a numbering matrix generating module, configured to divide each of the M second images into L sub-image areas, and generate a numbering matrix according to the numbers of the second images corresponding to the sub-image areas with maximum brightness, wherein the numbering matrix includes L elements, each element corresponds to the sub-image area one-to-one, and the sub-image area corresponds to at least one pixel group of the display panel;

[0028] A calculation module, used for calculating the offset value of each sub-image area according to the number matrix;

[0029] A correction module is used to correct the position of the pixel group corresponding to the sub-image area according to the offset value, and use the corrected position of the pixel group to display the image.

[0030] In some embodiments, the numbering matrix generating module is specifically used to obtain L sub-image area groups based on the M second images, each of the sub-image area groups includes M sub-image areas, and the M sub-image areas are located in different second images and correspond to the same area of ​​the display panel; determine the brightest sub-image area in each of the sub-image area groups, and use the number of the second image corresponding to the brightest sub-image area as the number of the sub-image area group, to obtain L numbers corresponding to the L sub-image area groups, and the L numbers constitute the numbering matrix.

[0031] In some embodiments, the calculation module is specifically used to determine the number that appears most times in the numbering matrix, denoted as A; the offset value of each sub-image area is calculated based on the difference between the number corresponding to each sub-image area in the numbering matrix and A, the value of M, and the pixel width covered by each spectroscopic structure.

[0032] In some embodiments, the numbering matrix generation module is specifically used to convert the second image from the RGB color domain to the YUV color domain, extract the brightness component of each pixel, and take the arithmetic mean of the brightness components of multiple pixels in each sub-image area as the brightness of the sub-image area.

[0033] An embodiment of the present invention further provides a computer-readable storage medium, comprising a stored program, which controls a device where the storage medium is located to execute the steps of the above-mentioned method when the program is executed.

[0034] An embodiment of the present invention also provides an electronic device, including a naked-eye 3D display device, wherein the naked-eye 3D display device includes: a display panel and a spectroscopic component arranged on the light-emitting side of the display panel, wherein the display panel includes: a plurality of pixel groups, each pixel group includes N pixels; the spectroscopic component includes: a plurality of spectroscopic structures, configured to form N viewpoints, where N is a positive integer greater than or equal to 2; and further includes: a processor and a memory storing a computer program that can be run on the processor, wherein the processor implements the steps of the method described above when executing the program.

[0035] The embodiments of the present invention have the following beneficial effects:

[0036] In the above scheme, the display panel is controlled to display M single-viewpoint test images in sequence, and the M test images displayed on the display panel are photographed respectively at preset viewpoints among the N viewpoints to obtain M first images, and a numbering matrix is ​​obtained according to the M first images. The difference between the image number corresponding to the maximum brightness of the same sub-image area and the actual view number can be obtained through the numbering matrix, so as to obtain the offset value corresponding to the sub-image area, and the position of the pixel group in the sub-image area is corrected according to the offset value, and the position of the corrected pixel group is used to display the image. In this way, the situation that the splitting component may not be properly fitted during the process of fitting the display panel can be compensated, the problem of local ghosting and local distortion of 3D images can be solved, and the user viewing experience can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 Schematic diagram of the process of the naked eye 3D display method according to an embodiment of the present invention;

[0038] Figure 2 A schematic diagram of obtaining 25 first images according to a specific embodiment of the present invention;

[0039] Figure 3 It is a partial schematic diagram of a number matrix of a specific embodiment of the present invention;

[0040] Figure 4 A structural block diagram of a naked-eye 3D display device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0041] In order to make the technical problems, technical solutions and advantages to be solved by the embodiments of the present invention more clear, a detailed description will be given below with reference to the accompanying drawings and specific embodiments.

[0042] The technical solution of the present invention is applied to a naked-eye 3D display device, which may include: a display panel and a spectroscopic component arranged on the light-emitting side of the display panel. The spectroscopic component is configured to perform spectroscopic processing on the light emitted by the pixels in the display panel to form N viewpoints in space. The display panel may include: a plurality of pixels arranged along a row direction (i.e., a first direction X) and a column direction (i.e., a second direction Y), and the plurality of pixels arranged along the row direction and the column direction may be divided into a plurality of pixel groups, each pixel group may include: N pixels corresponding to the N viewpoints provided by the spectroscopic component. N is a positive integer greater than or equal to 2, and the first direction X intersects with the second direction Y.

[0043] In an exemplary embodiment, each pixel in the display panel may be a pixel unit including a red sub-pixel (R sub-pixel), a green sub-pixel (G sub-pixel) and a blue sub-pixel (B sub-pixel). In practical applications, the above-mentioned light splitting component may have a variety of structural forms. For example, the light splitting component may be implemented by a cylindrical prism or by a parallax barrier. Of course, it may also be implemented by other structures, and the embodiments of the present disclosure are not limited to this.

[0044] In an exemplary embodiment, taking the light splitting component as a cylindrical prism as an example, the naked eye 3D display device may include: a display panel, a spacer dielectric layer arranged on the light emitting side of the display panel, and a cylindrical prism arranged on the side of the spacer dielectric layer away from the display panel. Among them, the display panel is configured to display a three-dimensional image with N viewpoints; the cylindrical prism is configured to provide N viewpoints and project the light emitted by the pixels corresponding to different viewpoints to different areas in space to achieve three-dimensional display (i.e., multi-viewpoint display); the spacer dielectric layer has a certain thickness T and is configured to ensure that the display panel is on the focal plane of the cylindrical prism to obtain the best collimation effect.

[0045] In an exemplary embodiment, a spacer dielectric layer is attached between the display panel and the cylindrical prism, and the material of the spacer dielectric layer can be a transparent material such as glass, PET (polyethylene terephthalate), etc.

[0046] In an exemplary embodiment, the light-splitting component may include a plurality of light-splitting structures. For example, taking the light-splitting component implemented by a cylindrical prism as an example, the light-splitting component may include a plurality of cylindrical prisms (i.e., each light-splitting structure is a cylindrical prism), and the plurality of cylindrical prisms may be arranged parallel to each other and arranged in sequence along the first direction X. For another example, taking the light-splitting component implemented by a parallax barrier as an example, the light-splitting component may include a plurality of shading strips and a plurality of light-transmitting strips arranged alternately in sequence along the first direction X (i.e., each light-splitting structure includes a plurality of shading strips and a portion of a plurality of light-transmitting strips located between the center lines of two adjacent shading strips, that is, including a light-transmitting strip and half of the shading strips located on both sides of the light-transmitting strip). The light-transmitting strip may be arranged as a slit.

[0047] In an exemplary embodiment, taking the light splitting component as a cylindrical prism as an example, a plurality of cylindrical prisms can be arranged in parallel with each other and arranged in sequence along the first direction X. Among them, all pixels of the display panel covered by at least one cylindrical prism can be divided into at least one pixel group, and the at least one pixel group can be arranged in sequence along the extension direction Z of the at least one cylindrical prism. Among them, the pixels covered by at least one cylindrical prism refer to the pixels that are split by the at least one cylindrical prism.

[0048] There is an angle between the cylindrical prism and the display panel (for example, there is a certain angle θ between the extension direction Z of the cylindrical prism and the second direction Y of the display panel), and N viewpoints are provided by obliquely arranging the cylindrical prisms. When the cylindrical prism and the display panel present a certain angle, the relative position of the pixel in the display panel and the cylindrical prism can be changed periodically through the pattern arrangement design (here, the pixel can refer to only one sub-pixel among the three sub-pixels of R, G, and B). Here, the distances from the sub-pixels corresponding to different viewpoints to the axis of the cylindrical prism are different. Therefore, the light rays emitted by the sub-pixels corresponding to different viewpoint numbers in all pixel groups have different angles after passing through their respective cylindrical prisms. As a result, the light rays emitted by the sub-pixels corresponding to different viewpoint numbers in all pixel groups are separated in space from different viewpoints (that is, the light rays emitted by the sub-pixels corresponding to the same viewpoint number in all pixel groups form one viewpoint after passing through their respective cylindrical prisms), so as to spatially separate or isolate the left-eye image portion and the right-eye image portion displayed on the display panel in the directions of the user's left eye and right eye, respectively. In this way, 3D display can be achieved.

[0049] The naked-eye 3D display device with multiple viewpoints has very high requirements on the alignment accuracy of the cylindrical prism. Only when the sub-pixels corresponding to the same viewpoint (i.e., the sub-pixels corresponding to the same viewpoint number in all pixel groups) are equidistant from the axis of the cylindrical prism to which they correspond, can the light emitted by the sub-pixels corresponding to the same viewpoint in the display panel reach the same area in space after passing through the cylindrical prism. However, at present, when the cylindrical prism and the display panel are aligned and bonded, deviations are often prone to occur. When the alignment of the cylindrical prism and the display panel deviates, if the two-dimensional images corresponding to different viewpoints (also called single-viewpoint images, plane images) are arranged according to the original arrangement method to obtain a three-dimensional image (also called a multi-viewpoint image, stereoscopic image), and then the display panel is driven for three-dimensional display, crosstalk will occur, and the display effect will be very poor, which will seriously affect the viewing experience, and may even make it impossible to watch normally.

[0050] To solve the above technical problems, the embodiments of the present invention provide the following technical solutions:

[0051] A naked-eye 3D display method is applied to a naked-eye 3D display device, wherein the naked-eye 3D display device comprises: a display panel and a light splitting component arranged on a light-emitting side of the display panel, wherein the display panel comprises: a plurality of pixel groups, each pixel group comprises N pixels; the light splitting component comprises: a plurality of light splitting structures, configured to form N viewpoints, where N is a positive integer greater than or equal to 2; Figure 1 As shown, the display method includes:

[0052] Step 1, controlling the display panel to display M test images in sequence, taking photos of the M test images displayed by the display panel at preset viewpoints among the N viewpoints, respectively, to obtain M first images, wherein in the M first images, a display area of ​​the display panel in the Kth first image is completely white, where M is a positive integer greater than or equal to 2, and K is a positive integer greater than or equal to 1 and less than or equal to M;

[0053] In this embodiment, the naked-eye 3D display device includes N viewpoints; the M test images are all-white images from a single viewpoint, that is, the display panel displays the M test images in sequence, and when the display panel is viewed from one of the N viewpoints, one of the M test images can be seen as an all-white image, and the other M-1 test images are not all-white images. The value of M may be greater than or equal to N. In a specific example, the naked-eye 3D display device includes 24 viewpoints (i.e., N=24), and 25 test images (i.e., M=25) may be generated by an image arrangement algorithm. Figure 2The diagram shown is a schematic diagram of a display panel sequentially displaying 25 test images, and photographing the display panel at a preset viewpoint among N viewpoints, including: when the display panel displays the first test image, photographing the display panel to obtain the first first image; when the display panel displays the second test image, photographing the display panel to obtain the second first image; when the display panel displays the third test image, photographing the display panel to obtain the third first image, ..., and so on, to obtain M first images.

[0054] Among the M first images, there will be a first image in which the display area of ​​the display panel is completely white, that is, the display area of ​​the display panel in the Kth first image among the M first images is completely white. The value of K may be any value from 1 to M. In some embodiments, K may be (M+1) / 2 or M / 2 or M / 2+1, that is, the Kth first image is the middle image among the M first images, which can better cover the left and right offset of pixels.

[0055] For example, when M is 25, K is selected as 13, then a suitable viewpoint is selected, and the display panel is photographed at the viewpoint. When the display panel displays the first test image, the display panel is photographed to obtain the first first image; when the display panel displays the second test image, the display panel is photographed to obtain the second first image; when the display panel displays the third test image, the display panel is photographed to obtain the third first image, ..., when the display panel displays the 25th test image, the display panel is photographed to obtain the 25th first image. Among them, the display area of ​​the display panel in the obtained 1st to 12th and 14th to 25th first images is not completely white, and the display area of ​​the display panel in the obtained 13th first image is completely white.

[0056] Step 2: Process the M first images respectively to obtain M second images, where the second images are images of the display area of ​​the display panel;

[0057] Since the first image obtained by taking a photo includes not only the display area of ​​the display panel but also other background images, the first image needs to be processed. Specifically, the first image can be cropped and transformed by using color recognition and perspective transformation in image processing to obtain a second image. The second image only includes the image of the display area of ​​the display panel. This can remove redundant areas in the first image and reduce the computational complexity of subsequent image processing.

[0058] Step 3: Divide each of the M second images into L sub-image areas, and generate a number matrix according to the numbers of the second images corresponding to the sub-image areas with maximum brightness, wherein the number matrix includes L elements, each element corresponds to the sub-image area one by one, and the sub-image area corresponds to at least one pixel group of the display panel;

[0059] When there is a deviation in the alignment between the cylindrical prism and the display panel, different areas of the display panel will have different deviations. Therefore, it is necessary to divide each of the second images into L sub-image areas, calculate the offset value of each sub-image area respectively, and compensate the position of the pixel group according to the offset value of each sub-image area.

[0060] Specifically, the display panel is divided into a plurality of sub-areas arranged in rows and columns, and the sub-image areas of the second image correspond to the sub-areas of the display panel one by one; each sub-area may include at least one pixel group. In order to improve the calculation accuracy of the offset value, each sub-area may include only one pixel group, that is, the sub-image area corresponds to the pixel group of the display panel one by one. In some embodiments, the display panel includes 270*480 pixel groups, and each second image may be divided into 270 rows and 480 columns, totaling 129,600 sub-image areas.

[0061] For each second image, the second image is divided into L sub-image areas arranged in rows and columns, the second image is converted from the RGB color domain to the YUV color domain, the brightness component of each pixel is extracted, and the arithmetic average of the brightness components of multiple pixels in each sub-image area is used as the brightness of the sub-image area. For example, the average of the brightness components of multiple pixels in the sub-image area can be used as the brightness of the sub-image area; or different weights can be assigned to multiple pixels in the sub-image area, and the weighted average of the brightness components of multiple pixels in the sub-image area is used as the brightness of the sub-image area.

[0062] L sub-image area groups are obtained according to the M second images, each of the sub-image area groups includes M sub-image areas, and the M sub-image areas are located in different second images and correspond to the same area of ​​the display panel; for example, each second image is divided into a first sub-image area, a second sub-image area, ..., an Lth sub-image area, then according to the M second images, M first sub-image areas, M second sub-image areas, ..., M Lth sub-image areas can be obtained, the M first sub-image areas are divided into a first sub-image area group, the M second sub-image areas are divided into a second sub-image area group, ..., the M Lth sub-image areas are divided into an Lth sub-image area group.

[0063] For each sub-image area group, the brightest sub-image area is determined, and the number of the second image corresponding to the brightest sub-image area is used as the number of the sub-image area group, so that L numbers corresponding to L sub-image area groups can be obtained, and the L numbers constitute the number matrix.

[0064] Specifically, the value of the element in the i-th row and j-th column of the numbering matrix NV ij ∈[1,M], where Y ij 1 is the brightness of the sub-image area in the i-th row and j-th column in the first second image, Y ij 2 is the brightness of the sub-image area in the i-th row and j-th column in the second second image, ..., Y ij M NV is the brightness of the sub-image area in the i-th row and j-th column in the M-th second image. ij That is, among all the M second images, the number of the second image corresponding to the sub-image area in the i-th row and the j-th column with the largest brightness.

[0065] For example, for the first sub-image area group, the brightest sub-image area corresponds to the first second image, and the value of the first row and first column element in the numbering matrix is ​​1; for the Lth sub-image area group, the brightest sub-image area corresponds to the 25th second image, and the value of the last row and last column element in the numbering matrix is ​​25; for the 24th sub-image area group, the brightest sub-image area corresponds to the 23rd second image, and the value of the first row and 24th column element in the numbering matrix is ​​23. Figure 3 It is a partial schematic diagram of a numbering matrix in a specific example of the present invention.

[0066] Step 4, calculating the offset value of each sub-image area according to the numbering matrix;

[0067] First, determine the number that appears most times in the number matrix, denoted as A, such as Figure 3 As shown, the number that appears most times in the number matrix is ​​25, then A=25; then the offset value of each sub-image area is calculated according to the difference between the number corresponding to each sub-image area in the number matrix and A, the value of M, and the pixel width covered by each of the spectroscopic structures. It can be seen that the offset value can reflect the difference between the image number corresponding to the maximum brightness of the same sub-image area and the actual view number.

[0068] In a specific example, the offset value offset can be calculated according to the following formula:

[0069]

[0070] Wherein, ΔX is the pixel width covered by a single light splitting structure such as a cylindrical prism.

[0071] In some embodiments, the viewpoint number difference (NV ij -A), stored as comma-separated values ​​(CSV) or text files (TXT), and then read by software such as Unity or embedded devices such as field programmable gate array (FPGA), and use the read content for subsequent image arrangement correction.

[0072] Among them, Y ij The M values ​​of should satisfy that there is only one maximum value. If not, NV ij Set to A.

[0073] Step 5: Correct the position of the pixel group corresponding to the sub-image area according to the offset value, and use the corrected position of the pixel group to display the image.

[0074] In this embodiment, the offset value of each sub-pixel area is used to correct the position of the pixel group of the sub-area corresponding to the display panel. For example, if each sub-pixel area corresponds to a pixel group of the display panel, the offset value of the sub-pixel area is used to correct the position of the pixel group corresponding to the sub-pixel area; if each sub-pixel area corresponds to multiple pixel groups of the display panel, the offset value of the sub-pixel area is used to correct the positions of the multiple pixel groups corresponding to the sub-pixel area.

[0075] When display arrangement is performed, the display arrangement is performed according to the pixel structure of the display panel, including the display arrangement according to the position of each pixel group. This embodiment corrects the position of the pixel group before performing display arrangement, which can compensate for the possible misalignment of the light splitting component during the process of bonding the display panel, solve the problems of local ghosting and local distortion of the 3D picture, and enhance the user viewing experience.

[0076] In some embodiments, using the offset value for one correction cannot completely solve the problem of local ghosting and local distortion of the 3D image. This is because the base value of the offset value It cannot be small enough to ensure the accuracy of the offset value. If M is large enough, the light of the display panel is very weak and the viewing effect of the human eye is very poor. Therefore, it is not feasible to improve the correction effect by directly increasing M. In order to improve the correction effect, iterative correction can be performed, that is, repeating steps 1-5 multiple times. The more times steps 1-5 are repeated, the better the correction effect, but at the same time the amount of calculation will increase. In some embodiments, steps 1-5 can be repeated four times, which can ensure a better correction effect without causing too much increase in the amount of calculation.

[0077] Each execution of steps 1-5 above can be called a correction. In iterative correction, each correction is based on the previous correction, so that the offset value is further offset. Distance, for the nth correction, since the previous offset value has been corrected, the baseline value for this correction is In this way, after n corrections, the offset value of a sub-image area can be expressed as ΔN1 is the first correction (NV ij -A), ΔN2 is the second correction (NV ij -A), ΔN n is the nth correction (NV ij -A).

[0078] The offset value of the entire second image can be expressed as Among them A n Represents the nth correction (NV ij -A) values. This embodiment can further optimize the accuracy of the offset value through an iterative correction method, making the image transition smoother.

[0079] In this embodiment, the display panel is controlled to display M single-viewpoint test images in sequence, and the M test images displayed on the display panel are photographed respectively at preset viewpoints among the N viewpoints to obtain M first images, and a numbering matrix is ​​obtained according to the M first images. The difference between the image number corresponding to the maximum brightness of the same sub-image area and the actual view number can be obtained through the numbering matrix, so as to obtain the offset value corresponding to the sub-image area, and the position of the pixel group in the sub-image area is corrected according to the offset value, and the display arrangement is performed using the position of the corrected pixel group, so as to compensate for the possible inadequate fitting of the light splitting component during the process of fitting the display panel, solve the problems of local ghosting and local distortion of the 3D picture, and enhance the user viewing experience.

[0080] An embodiment of the present invention further provides a naked-eye 3D display device, the naked-eye 3D display device comprising: a display panel and a light splitting component arranged on a light-emitting side of the display panel, the display panel comprising: a plurality of pixel groups, each pixel group comprising N pixels; the light splitting component comprising: a plurality of light splitting structures, configured to form N viewpoints, N being a positive integer greater than or equal to 2; Figure 4 As shown, the display device also includes:

[0081] The image acquisition module 21 is used to control the display panel to display M test images in sequence, and take pictures of the M test images displayed by the display panel at preset viewpoints among the N viewpoints to obtain M first images, wherein the display area of ​​the display panel in the Kth first image among the M first images is completely white, where M is a positive integer greater than or equal to 2, and K is a positive integer greater than or equal to 1 and less than or equal to M;

[0082] In this embodiment, the naked-eye 3D display device includes N viewpoints; the M test images are all-white images from a single viewpoint, that is, the display panel displays the M test images in sequence, and when the display panel is viewed from one of the N viewpoints, one of the M test images can be seen as an all-white image, and the other M-1 test images are not all-white images. The value of M may be greater than or equal to N. In a specific example, the naked-eye 3D display device includes 24 viewpoints (i.e., N=24), and 25 test images (i.e., M=25) may be generated by an image arrangement algorithm. Figure 2 The diagram shown is a schematic diagram of a display panel sequentially displaying 25 test images, and photographing the display panel at a preset viewpoint among N viewpoints, including: when the display panel displays the first test image, photographing the display panel to obtain the first first image; when the display panel displays the second test image, photographing the display panel to obtain the second first image; when the display panel displays the third test image, photographing the display panel to obtain the third first image, ..., and so on, to obtain M first images.

[0083] Among the M first images, there will be a first image in which the display area of ​​the display panel is completely white, that is, the display area of ​​the display panel in the Kth first image among the M first images is completely white. The value of K may be any value from 1 to M. In some embodiments, K may be (M+1) / 2 or M / 2 or M / 2+1, that is, the Kth first image is the middle image among the M first images, which can better cover the left and right offset of pixels.

[0084] For example, when M is 25, K is selected as 13, then a suitable viewpoint is selected, and the display panel is photographed at the viewpoint. When the display panel displays the first test image, the display panel is photographed to obtain the first first image; when the display panel displays the second test image, the display panel is photographed to obtain the second first image; when the display panel displays the third test image, the display panel is photographed to obtain the third first image, ..., when the display panel displays the 25th test image, the display panel is photographed to obtain the 25th first image. Among them, the display area of ​​the display panel in the obtained 1st to 12th and 14th to 25th first images is not completely white, and the display area of ​​the display panel in the obtained 13th first image is completely white.

[0085] An image processing module 22, configured to process the M first images respectively to obtain M second images, where the second images are images of a display area of ​​the display panel;

[0086] Since the first image obtained by taking a photo includes not only the display area of ​​the display panel but also other background images, the first image needs to be processed. Specifically, the first image can be cropped and transformed by using color recognition and perspective transformation in image processing to obtain a second image. The second image only includes the image of the display area of ​​the display panel. This can remove redundant areas in the first image and reduce the computational complexity of subsequent image processing.

[0087] a numbering matrix generating module 23, configured to divide each of the M second images into L sub-image regions, and generate a numbering matrix according to the numbers of the second images corresponding to the sub-image regions with maximum brightness, wherein the numbering matrix includes L elements, each element corresponds to the sub-image region one by one, and the sub-image region corresponds to at least one pixel group of the display panel;

[0088] When there is a deviation in the alignment between the cylindrical prism and the display panel, different areas of the display panel will have different deviations. Therefore, it is necessary to divide each of the second images into L sub-image areas, calculate the offset value of each sub-image area respectively, and compensate the position of the pixel group according to the offset value of each sub-image area.

[0089] Specifically, the display panel is divided into a plurality of sub-areas arranged in rows and columns, and the sub-image areas of the second image correspond to the sub-areas of the display panel one by one; each sub-area may include at least one pixel group. In order to improve the calculation accuracy of the offset value, each sub-area may include only one pixel group, that is, the sub-image area corresponds to the pixel group of the display panel one by one. In some embodiments, the display panel includes 270*480 pixel groups, and each second image may be divided into 270 rows and 480 columns, totaling 129,600 sub-image areas.

[0090] For each second image, the second image is divided into L sub-image areas arranged in rows and columns, the second image is converted from the RGB color domain to the YUV color domain, the brightness component of each pixel is extracted, and the arithmetic average of the brightness components of multiple pixels in each sub-image area is used as the brightness of the sub-image area. For example, the average of the brightness components of multiple pixels in the sub-image area can be used as the brightness of the sub-image area; or different weights can be assigned to multiple pixels in the sub-image area, and the weighted average of the brightness components of multiple pixels in the sub-image area is used as the brightness of the sub-image area.

[0091] L sub-image area groups are obtained according to the M second images, each of the sub-image area groups includes M sub-image areas, and the M sub-image areas are located in different second images and correspond to the same area of ​​the display panel; for example, each second image is divided into a first sub-image area, a second sub-image area, ..., an Lth sub-image area, then according to the M second images, M first sub-image areas, M second sub-image areas, ..., M Lth sub-image areas can be obtained, the M first sub-image areas are divided into a first sub-image area group, the M second sub-image areas are divided into a second sub-image area group, ..., the M Lth sub-image areas are divided into an Lth sub-image area group.

[0092] For each sub-image area group, the brightest sub-image area is determined, and the number of the second image corresponding to the brightest sub-image area is used as the number of the sub-image area group, so that L numbers corresponding to L sub-image area groups can be obtained, and the L numbers constitute the number matrix.

[0093] Specifically, the value of the element in the i-th row and j-th column of the numbering matrix NV ij ∈[1,M], where Y ij 1 is the brightness of the sub-image area in the i-th row and j-th column in the first second image, Y ij 2 is the brightness of the sub-image area in the i-th row and j-th column in the second second image, ..., Y ij M NV is the brightness of the sub-image area in the i-th row and j-th column in the M-th second image. ij That is, among all the M second images, the number of the second image corresponding to the sub-image area in the i-th row and the j-th column with the largest brightness.

[0094] For example, for the first sub-image area group, the brightest sub-image area corresponds to the first second image, and the value of the first row and first column element in the numbering matrix is ​​1; for the Lth sub-image area group, the brightest sub-image area corresponds to the 25th second image, and the value of the last row and last column element in the numbering matrix is ​​25; for the 24th sub-image area group, the brightest sub-image area corresponds to the 23rd second image, and the value of the first row and 24th column element in the numbering matrix is ​​23. Figure 3 It is a partial schematic diagram of a numbering matrix in a specific example of the present invention.

[0095] A calculation module 24, configured to calculate an offset value of each sub-image region according to the number matrix;

[0096] First, determine the number that appears most times in the number matrix, denoted as A, such as Figure 3 As shown, the number that appears most times in the number matrix is ​​25, then A=25; then the offset value of each sub-image area is calculated according to the difference between the number corresponding to each sub-image area in the number matrix and A, the value of M, and the pixel width covered by each of the spectroscopic structures. It can be seen that the offset value can reflect the difference between the image number corresponding to the maximum brightness of the same sub-image area and the actual view number.

[0097] In a specific example, the offset value offset can be calculated according to the following formula:

[0098]

[0099] Wherein, ΔX is the pixel width covered by a single light splitting structure such as a cylindrical prism.

[0100] In some embodiments, the viewpoint number difference (NV ij -A), stored as comma-separated values ​​(CSV) or text files (TXT), and then read by software such as Unity or embedded devices such as field programmable gate array (FPGA), and use the read content for subsequent image arrangement correction.

[0101] The correction module 25 is used to correct the position of the pixel group corresponding to the sub-image area according to the offset value, and use the corrected position of the pixel group to display the image.

[0102] In this embodiment, the offset value of each sub-pixel area is used to correct the position of the pixel group of the sub-area corresponding to the display panel. For example, if each sub-pixel area corresponds to a pixel group of the display panel, the offset value of the sub-pixel area is used to correct the position of the pixel group corresponding to the sub-pixel area; if each sub-pixel area corresponds to multiple pixel groups of the display panel, the offset value of the sub-pixel area is used to correct the positions of the multiple pixel groups corresponding to the sub-pixel area.

[0103] When display arrangement is performed, the display arrangement is performed according to the pixel structure of the display panel, including the display arrangement according to the position of each pixel group. This embodiment corrects the position of the pixel group before performing display arrangement, which can compensate for the possible misalignment of the light splitting component during the process of bonding the display panel, solve the problems of local ghosting and local distortion of the 3D picture, and enhance the user viewing experience.

[0104] In some embodiments, using the offset value for one correction cannot completely solve the problem of local ghosting and local distortion of the 3D image. This is because the base value of the offset value It cannot be small enough to ensure the accuracy of the offset value. If M is large enough, the light of the display panel is very weak and the viewing effect of the human eye is very poor. Therefore, it is not feasible to improve the correction effect by directly increasing M. In order to improve the correction effect, iterative correction can be performed, that is, repeating steps 1-5 multiple times. The more times steps 1-5 are repeated, the better the correction effect, but at the same time the amount of calculation will increase. In some embodiments, steps 1-5 can be repeated four times, which can ensure a better correction effect without causing too much increase in the amount of calculation.

[0105] In this embodiment, the display panel is controlled to display M single-viewpoint test images in sequence, and the M test images displayed on the display panel are photographed respectively at preset viewpoints among the N viewpoints to obtain M first images, and a numbering matrix is ​​obtained according to the M first images. The difference between the image number corresponding to the maximum brightness of the same sub-image area and the actual view number can be obtained through the numbering matrix, so as to obtain the offset value corresponding to the sub-image area, and the position of the pixel group in the sub-image area is corrected according to the offset value, and the display arrangement is performed using the position of the corrected pixel group, so as to compensate for the possible inadequate fitting of the light splitting component during the process of fitting the display panel, solve the problems of local ghosting and local distortion of the 3D picture, and enhance the user viewing experience.

[0106] The naked eye 3D display device includes but is not limited to: a radio frequency unit, a network module, an audio output unit, an input unit, a sensor, a display unit, a user input unit, an interface unit, a memory, a processor, and a power supply. Those skilled in the art will understand that the structure of the above-mentioned display device does not constitute a limitation on the display device, and the display device may include more or less of the above-mentioned components, or combine certain components, or arrange the components differently. In an embodiment of the present invention, the display device includes but is not limited to a display, a mobile phone, a tablet computer, a television, a wearable electronic device, a navigation display device, etc.

[0107] The naked-eye 3D display device may be any product or component with a display function, such as a television, a monitor, a digital photo frame, a mobile phone, a tablet computer, etc., wherein the display device further includes a flexible circuit board, a printed circuit board and a backplane.

[0108] In some embodiments, the numbering matrix generating module 23 is specifically used to obtain L sub-image area groups based on the M second images, each of the sub-image area groups includes M sub-image areas, and the M sub-image areas are located in different second images and correspond to the same area of ​​the display panel; determine the brightest sub-image area in each of the sub-image area groups, and use the number of the second image corresponding to the brightest sub-image area as the number of the sub-image area group, to obtain L numbers corresponding to the L sub-image area groups, and the L numbers constitute the numbering matrix.

[0109] In some embodiments, the calculation module 24 is specifically used to determine the number that appears most times in the numbering matrix, denoted as A; the offset value of each sub-image area is calculated based on the difference between the number corresponding to each sub-image area in the numbering matrix and A, the value of M, and the pixel width covered by each of the spectroscopic structures.

[0110] In some embodiments, the numbering matrix generation module 23 is specifically used to convert the second image from the RGB color domain to the YUV color domain, extract the brightness component of each pixel, and take the arithmetic mean of the brightness components of multiple pixels in each sub-image area as the brightness of the sub-image area.

[0111] An embodiment of the present invention further provides a computer-readable storage medium, comprising a stored program, which controls a device where the storage medium is located to execute the steps of the above-mentioned method when the program is executed.

[0112] An embodiment of the present invention also provides an electronic device, including a naked-eye 3D display device, wherein the naked-eye 3D display device includes: a display panel and a spectroscopic component arranged on the light-emitting side of the display panel, wherein the display panel includes: a plurality of pixel groups, each pixel group includes N pixels; the spectroscopic component includes: a plurality of spectroscopic structures, configured to form N viewpoints, where N is a positive integer greater than or equal to 2; and further includes: a processor and a memory storing a computer program that can be run on the processor, wherein the processor implements the steps of the method described above when executing the program.

[0113] In the various method embodiments of the present invention, the serial numbers of the steps cannot be used to limit the sequence of the steps. For ordinary technicians in this field, without paying creative work, changes to the sequence of the steps are also within the protection scope of the present invention.

[0114] It should be noted that each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the embodiments, since they are basically similar to the product embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the product embodiments.

[0115] Unless otherwise defined, the technical terms or scientific terms used in the present disclosure should be understood by people with ordinary skills in the field to which the present disclosure belongs. The "first", "second" and similar words used in the present disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. "Include" or "comprise" and similar words mean that the elements or objects appearing before the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0116] It will be understood that when an element such as a layer, film, region, or substrate is referred to as being “on” or “under” another element, it can be “directly on” or “under” the other element or intervening elements may be present.

[0117] In the description of the above embodiments, specific features, structures, materials or characteristics may be combined in a suitable manner in any one or more embodiments or examples.

[0118] The above is only a specific embodiment of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any person skilled in the art who is familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present disclosure, which should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.

Claims

1. A naked eye 3D display method, characterized in that: The invention is applied to a naked-eye 3D display device, the naked-eye 3D display device comprising: a display panel and a light splitting component arranged on a light-emitting side of the display panel, the display panel comprising: a plurality of pixel groups, each pixel group comprising N pixels; the light splitting component comprising: a plurality of light splitting structures, configured to form N viewpoints, where N is a positive integer greater than or equal to 2; the display method comprising: Step 1, controlling the display panel to display M test images in sequence, taking photos of the M test images displayed by the display panel at preset viewpoints among the N viewpoints, respectively, to obtain M first images, wherein in the M first images, a display area of ​​the display panel in the Kth first image is completely white, where M is a positive integer greater than or equal to 2, and K is a positive integer greater than or equal to 1 and less than or equal to M; Step 2: Process the M first images respectively to obtain M second images, where the second images are images of the display area of ​​the display panel; Step 3: Divide each of the M second images into L sub-image areas, and generate a number matrix according to the numbers of the second images corresponding to the sub-image areas with maximum brightness, wherein the number matrix includes L elements, each element corresponds to the sub-image area one by one, and the sub-image area corresponds to at least one pixel group of the display panel; Step 4, calculating the offset value of each sub-image area according to the numbering matrix; Step 5: Correct the position of the pixel group corresponding to the sub-image area according to the offset value, and use the corrected position of the pixel group to display the image.

2. The naked eye 3D display method according to claim 1, characterized in that: The step 3 specifically includes: Acquire L sub-image area groups according to the M second images, each of the sub-image area groups includes M sub-image areas, and the M sub-image areas are located in different second images and correspond to the same area of ​​the display panel; The brightest sub-image area in each of the sub-image area groups is determined, and the number of the second image corresponding to the brightest sub-image area is used as the number of the sub-image area group to obtain L numbers corresponding to the L sub-image area groups, and the L numbers constitute the number matrix.

3. The naked eye 3D display method according to claim 2, characterized in that: The step 4 specifically includes: Determine the number that appears most times in the number matrix, recorded as A; The offset value of each sub-image area is calculated by the difference between the number corresponding to each sub-image area in the number matrix and A, the value of M, and the pixel width covered by each of the light-splitting structures.

4. The naked eye 3D display method according to claim 1, characterized in that: Repeat steps 1-5 multiple times.

5. The naked eye 3D display method according to claim 4, characterized in that: Repeat steps 1-5 four times.

6. The naked eye 3D display method according to claim 4, characterized in that: K is (M+1) / 2 or M / 2 or M / 2+1.

7. The naked eye 3D display method according to claim 1, characterized in that: The sub-image areas correspond one-to-one to the pixel groups of the display panel.

8. The naked eye 3D display method according to claim 2, characterized in that: Determining the brightest sub-image area in each of the sub-image area groups comprises: The second image is converted from the RGB color domain to the YUV color domain, the brightness component of each pixel is extracted, and the arithmetic mean of the brightness components of multiple pixels in each sub-image area is used as the brightness of the sub-image area.

9. A naked-eye 3D display device, characterized in that: The naked-eye 3D display device comprises: a display panel and a light splitting component arranged on the light-emitting side of the display panel, wherein the display panel comprises: a plurality of pixel groups, each pixel group comprises N pixels; the light splitting component comprises: a plurality of light splitting structures, configured to form N viewpoints, where N is a positive integer greater than or equal to 2; the display device further comprises: an image acquisition module, used to control the display panel to display M test images in sequence, and to take pictures of the M test images displayed by the display panel at preset viewpoints among the N viewpoints, respectively, to obtain M first images, wherein among the M first images, a display area of ​​the display panel in the Kth first image is completely white, where M is a positive integer greater than or equal to 2, and K is a positive integer greater than or equal to 1 and less than or equal to M; an image processing module, used to process the M first images respectively to obtain M second images, where the second images are images of the display area of ​​the display panel; a numbering matrix generating module, configured to divide each of the M second images into L sub-image areas, and generate a numbering matrix according to the numbers of the second images corresponding to the sub-image areas with maximum brightness, wherein the numbering matrix includes L elements, each element corresponds to the sub-image area one-to-one, and the sub-image area corresponds to at least one pixel group of the display panel; A calculation module, used for calculating the offset value of each sub-image area according to the number matrix; A correction module is used to correct the position of the pixel group corresponding to the sub-image area according to the offset value, and use the corrected position of the pixel group to display the image.

10. The naked eye 3D display device according to claim 9, characterized in that: The numbering matrix generation module is specifically used to obtain L sub-image area groups according to the M second images, each of the sub-image area groups includes M sub-image areas, and the M sub-image areas are located in different second images and correspond to the same area of ​​the display panel; The brightest sub-image area in each of the sub-image area groups is determined, and the number of the second image corresponding to the brightest sub-image area is used as the number of the sub-image area group to obtain L numbers corresponding to the L sub-image area groups, and the L numbers constitute the number matrix.

11. The naked eye 3D display device according to claim 10, characterized in that: The calculation module is specifically used to determine the number that appears most times in the number matrix, denoted as A; the offset value of each sub-image area is calculated based on the difference between the number corresponding to each sub-image area in the number matrix and A, the value of M, and the pixel width covered by each spectroscopic structure.

12. The naked eye 3D display device according to claim 9, characterized in that: The numbering matrix generation module is specifically used to convert the second image from the RGB color domain to the YUV color domain, extract the brightness component of each pixel, and use the arithmetic mean of the brightness components of multiple pixels in each sub-image area as the brightness of the sub-image area.

13. A computer-readable storage medium, comprising a stored program, characterized in that: When the program is running, the device where the storage medium is located is controlled to execute the steps of the method according to any one of claims 1 to 8.

14. An electronic device, characterized in that: A naked-eye 3D display device is provided, wherein the naked-eye 3D display device comprises: a display panel and a light splitting component arranged on a light-emitting side of the display panel, wherein the display panel comprises: a plurality of pixel groups, each pixel group comprises N pixels; the light splitting component comprises: a plurality of light splitting structures, configured to form N viewpoints, where N is a positive integer greater than or equal to 2; and further comprises: A processor and a memory storing a computer program executable on the processor, wherein the processor implements the steps of the method according to any one of claims 1 to 8 when executing the program.

Images