Display device and method, computer readable storage medium and computer device

Abstract

The application discloses a display device and method, a computer readable storage medium and a computer device, wherein the display device of an embodiment comprises: an image collector, which outputs a user position to a control unit according to a real-time collected user image; a variable-focus lens array, which is arranged on the light-emitting side of a second display panel and is away from the user relative to a first display panel, and the focal length of each lens is variable; and the control unit is configured to obtain display parameters according to the user position, wherein the display parameters comprise: a focal length parameter output to the variable-focus lens array to control the focal length of each lens, and an image parameter output to an image rendering unit, which is used to make the first display panel display a first display image and make the second display panel display a second display image, so that the display device presents a three-dimensional image. The display device provided by the embodiment of the application increases the depth of field range and the viewing angle of the three-dimensional image display by arranging the first display panel, the variable-focus lens array and the second display panel.

Description

Technical Field

[0001] This invention relates to the field of display technology, and in particular to a display device and method, a computer-readable storage medium, and a computer device. Background Technology

[0002] Deeply integrated 3D display is achieved by layering two or more display elements, such as... Figure 1 As shown, the first and second display images are displayed on the first and second display elements respectively. The first and second display images are foreground and background images displayed with different brightness. The depth effect is presented due to the difference in the depth of the objects. The human eye performs depth fusion on the display images on the two display elements to form a depth-fused display image.

[0003] Because deep fusion doesn't create a sense of depth by simulating binocular parallax, but rather by truly differentiating the foreground and background, it allows the viewer's eyes to naturally focus on the image and perceive depth, thus reducing eye strain. However, due to the limitation that the angular shift when foreground and background overlap cannot be too large, the suitable viewing angle for deep fusion 3D displays is limited. Figure 1 Observer 1 can observe the correct depth-blended display image, but observer 2, who is at a certain distance from observer 1, cannot observe the correct depth-blended display image simultaneously. Furthermore, the depth-blended display image formed by the depth-blended 3D display is located between the first and second display elements, and its depth range is determined by the distance between the first and second display elements; therefore, the depth range of the depth-blended 3D display is limited. Summary of the Invention

[0004] To address at least one of the aforementioned problems, a first embodiment of the present invention provides a display device, comprising an image acquisition unit, a control unit, an image rendering unit, and a first display panel, a variable focus lens array, and a second display panel stacked together, wherein:

[0005] The image acquisition unit is used to acquire user images of the user viewing the display device in real time and output the user's position to the control unit based on the user images;

[0006] A variable focus lens array is disposed on the light-emitting side of the second display panel, which is farther away from the user relative to the first display panel. The variable focus lens array includes multiple lenses, each of which has a variable focal length.

[0007] The control unit is configured to acquire display parameters based on the user's location. These display parameters include:

[0008] The focal length parameters are output to the variable focal length lens array to control the focal length of each lens.

[0009] The image parameters output to the image rendering unit are used to control the image rendering unit to output first display parameters to the first display panel to display the first display image and to output second display parameters to the second display panel to display the second display image, so that the display device presents a three-dimensional image.

[0010] In some optional embodiments, the focal length of each lens in the variable focal length lens array satisfies:

[0011]

[0012] Where θ is the angle between the line connecting the center of the human eye and the center of the first display panel and the line connecting the center of the human eye and the image center of the second display panel, L is the distance of the human eye from the first display panel, g is the distance from the variable focus lens array to the second display panel, f is the focal length of each lens in the variable focus lens array, d1 is the distance between the first display panel and the second display panel, and e is the interpupillary distance.

[0013] The first displayed image is the foreground image of the three-dimensional image;

[0014] The second displayed image is the background image of the three-dimensional image.

[0015] In some optional embodiments, the variable focus lens array is:

[0016] A variable focal length cylindrical lens array, where each lens is a variable focal length cylindrical lens;

[0017] or

[0018] A variable-focus microlens array, where each lens is a variable-focus microlens.

[0019] In some optional embodiments, the display parameters also include the display range obtained by the control unit based on the distance between the variable focus lens array and the second display panel.

[0020] The control unit is configured to determine whether the user's position is within the display range, and if so, to control:

[0021] The focal length of each lens in the variable focal length lens array is the distance between the variable focal length lens array and the second display panel;

[0022] The first displayed image is a transparent image;

[0023] The second displayed image is a two-dimensional image that is a three-dimensional image.

[0024] In some optional embodiments, the display range must meet the following requirements:

[0025] f = g

[0026]

[0027]

[0028]

[0029]

[0030]

[0031]

[0032] And, a y ≤e,(M-1)b y ≥e,c y ≤e

[0033] Where f is the focal length of each lens in the variable focal length lens array, g is the distance from the variable focal length lens to the second display panel, Lb is the distance from the optimal viewing position to the display device, e is the interpupillary distance, and t is the focal length of the human eye. y M is the length of the subpixels of the second display panel along the horizontal direction, M is the number of subpixels covered by each lens, and a y Lb is the width of the viewing area at the optimal viewing distance, L1 is the distance between the nearest viewing position and the optimal viewing position, L2 is the distance between the farthest viewing position and the optimal viewing position, and w y It is the length of the second display panel in the horizontal direction, b y c is the distance between two adjacent viewpoints of the nearest viewing position. y This represents the distance between two adjacent viewpoints at the furthest viewing distance.

[0034] In some alternative embodiments, the variable focal length lens array is a variable focal length column lens array, where each lens is a variable focal length column lens.

[0035] In some alternative embodiments, the second display panel includes an array of pixels, each pixel including a plurality of subpixels;

[0036] Each lens in the variable focal length lens array covers at least two sub-pixels of the second display panel.

[0037] A second aspect of the present invention provides a display method using the display device described above, comprising:

[0038] The control unit controls the image acquisition device to acquire user images of the user viewing the display device in real time and outputs the user's position to the control unit based on the user images;

[0039] The control unit obtains display parameters based on the user's location. These display parameters include focal length parameters and image parameters.

[0040] The control unit controls the focal length of each lens in the variable focal length lens array based on the focal length parameters;

[0041] The control unit controls the image rendering unit to output first display parameters to the first display panel to display the first display image and to output second display parameters to the second display panel to display the second display image, so that the display device presents a three-dimensional image.

[0042] In some alternative embodiments,

[0043] The control unit controls the focal length of each lens in the variable focal length lens array based on the focal length parameters, further including:

[0044] The focal length of each lens in the variable focal length lens array satisfies:

[0045]

[0046] Where θ is the angle between the line connecting the human eye and the center of the first display panel and the line connecting the human eye and the image center of the second display panel, L is the distance from the human eye to the first display panel, g is the distance from the variable focus lens array to the second display panel, f is the focal length of each lens in the variable focus lens array, d1 is the distance between the first display panel and the second display panel, and e is the interpupillary distance.

[0047] The control unit controls the image rendering unit to output first display parameters to the first display panel to display the first display image and to output second display parameters to the second display panel to display the second display image, so that the display device presents a three-dimensional image. This further includes controlling the first display image to be the foreground image of the three-dimensional image and controlling the second display image to be the background image of the three-dimensional image.

[0048] In some optional embodiments, the display parameters further include the display range obtained by the control unit based on the distance between the variable focus lens array and the second display panel, and the display method further includes: the control unit determining whether the user's position is within the display range; if so, then:

[0049] The control unit controls the focal length of each lens in the zoom lens array according to the focal length parameter, which further includes controlling the focal length of each lens in the zoom lens array to be the distance between the zoom lens array and the second display panel.

[0050] The control unit controls the image rendering unit to output first display parameters to the first display panel to display the first display image and to output second display parameters to the second display panel to display the second display image, so that the display device presents a three-dimensional image. This further includes controlling the first display image to be a transparent image and controlling the second display image to be a two-dimensional image of the three-dimensional image.

[0051] A third aspect of the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method described above.

[0052] A fourth aspect of the present invention provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the method described above.

[0053] The beneficial effects of this invention are as follows:

[0054] This invention addresses existing problems by providing a display device and method, a computer-readable storage medium, and a computer equipment. It utilizes a first display panel, a variable-focus lens array, and a second display panel stacked together. The focal length of each lens in the variable-focus lens array is controlled according to the user's position. By displaying images on both the first and second display panels, the display device presents a three-dimensional image, achieving a depth-fusion 3D display with variable depth of field, effectively increasing the depth range. Furthermore, the variable-focus lens array can form viewpoints in multiple directions, thereby expanding the viewing angle. This provides the advantages of deep fusion, reducing visual fatigue, while also offering a wide viewing angle and a large depth of field, making it suitable for a wide range of applications. Attached Figure Description

[0055] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0056] Figure 1 This diagram illustrates the imaging principle of deep fusion 3D display based on existing technology.

[0057] Figure 2 A schematic diagram of the structure of a display device according to an embodiment of the present invention is shown.

[0058] Figure 3 A schematic diagram illustrating the conditions required for 3D display of a display device according to an embodiment of the present invention.

[0059] Figure 4 A schematic diagram illustrating the display mode of a display device according to another embodiment of the present invention is shown.

[0060] Figure 5 Show Figure 4 The illustrated embodiment shows a schematic diagram of the view area of ​​the display device in multi-view 3D display mode.

[0061] Figure 6A schematic flowchart illustrating a display method of a display device according to an embodiment of the present invention is shown.

[0062] Figure 7 A schematic diagram of the structure of a computer device according to another embodiment of the present invention is shown. Detailed Implementation

[0063] To more clearly illustrate the present invention, the following description, in conjunction with preferred embodiments and accompanying drawings, further explains the invention. Similar components in the drawings are indicated by the same reference numerals. Those skilled in the art should understand that the specific description below is illustrative rather than restrictive and should not be construed as limiting the scope of protection of the present invention.

[0064] It should be noted that in the description of this application, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes the element.

[0065] To address at least one of the above problems, one embodiment of the present invention provides a display device, including an image acquisition unit, a control unit, an image rendering unit, and a first display panel, a variable focus lens array, and a second display panel stacked together, wherein:

[0066] The image acquisition unit is used to acquire user images of the user viewing the display device in real time and output the user's position to the control unit based on the user images;

[0067] A variable focus lens array is disposed on the light-emitting side of the second display panel, which is farther away from the user relative to the first display panel. The variable focus lens array includes multiple lenses, each of which has a variable focal length.

[0068] The control unit is configured to acquire display parameters based on the user's location. These display parameters include:

[0069] The focal length parameters are output to the variable focal length lens array to control the focal length of each lens.

[0070] The image parameters output to the image rendering unit are used to control the image rendering unit to output first display parameters to the first display panel to display the first display image and to output second display parameters to the second display panel to display the second display image, so that the display device presents a three-dimensional image.

[0071] In this embodiment, by stacking a first display panel, a variable focal length lens array, and a second display panel, and controlling the focal length of each lens in the variable focal length lens array according to the user's position, and displaying images on the first and second display panels respectively, the display device presents a three-dimensional image, thereby realizing a depth-fusion 3D display with variable depth of field, effectively increasing the depth range; and by forming viewpoints in multiple directions through the variable focal length lens array, the viewing angle can be expanded, thus combining the advantages of deep fusion that does not easily cause visual fatigue with the advantages of a wide viewing angle and a large depth of field, and has broad application prospects.

[0072] In a specific example, such as Figure 2 As shown, the display device includes an image acquisition unit 101, a control unit 103, an image rendering unit 105, and a first display panel 107-1, a variable focus lens array 109, and a second display panel 107-2 stacked together.

[0073] A variable-focus lens array 109 is disposed between a first display device 107-1 and a second display device 107-2. The variable-focus lens array 109 is located on the light-emitting side of the second display panel 107-2. The first display panel 107-1 is closer to the user viewing the display device relative to the variable-focus lens array 109, and correspondingly, the second display panel 107-2 is farther away from the user viewing the display device relative to the variable-focus lens array 109. In other words, the variable-focus lens array 109 is farther away from the user relative to the first display panel 107-1. In an embodiment of the present invention, the variable-focus lens array 109 includes a plurality of lenses, each with a variable focal length.

[0074] Image acquisition device 101 may be a depth camera and may be located at the first display panel 107-1. Image acquisition device 101 is used to acquire user images of the user viewing the display device in real time and output the user position to the control unit 103 based on the user images. The user position may include, for example, the distance of the user from the first display panel 107-1 of the display device.

[0075] The control unit 103 is configured to acquire display parameters based on the user position received from the image acquisition unit 101. The display parameters include: focal length parameters output to the variable focal length lens array 109 to control the focal length of each lens, and image parameters output to the image rendering unit 105.

[0076] The focal length parameter can be the focal length of each lens that corresponds to the specific value of the user's position and is stored in the display device in advance, or it can be the focal length of each lens that corresponds to the distance range of the user's position and is stored in the display device in advance. The distance range can be reasonably selected during the design based on the actual allowable error. The focal length parameter and the corresponding user position can be stored in the storage of the display device in the form of a search table.

[0077] The image parameters output to the image rendering unit 105 are used to control the image rendering unit 105 to output first display parameters to the first display panel 107-1 to display the first display image, and to output second display parameters to the second display panel 107-2 to display the second display image, so that the display device presents a three-dimensional image.

[0078] With the above setup, by incorporating two display elements for image display—a first display panel and a second display panel—and placing a variable-focus lens array between them, and using an image acquisition unit to obtain the user's position while viewing the display, the control unit obtains the corresponding focal length parameters of the variable-focus lens array based on the user's position and outputs them to the image rendering unit to control the display parameters of the display elements. This allows the focal length of each lens to be controlled according to the user's position. By utilizing the cooperation between the variable-focus lens array and the second display panel, the image on the second display panel is not limited to the second display panel itself, enabling adjustment of the depth of field in 3D depth-of-field fusion and increasing the depth-of-field range. Furthermore, the variable-focus lens array can be used to achieve a multi-viewpoint display effect, increasing the viewing angle.

[0079] The following section, with reference to the accompanying diagram, details the implementation principles of the increased depth of field and viewing angle described above.

[0080] On the one hand, for the function of increasing the depth of field range, we will continue to refer to... Figure 2 As shown, in the display device of this embodiment, the specific position of the image A formed by the second display panel 107-2 is related not only to the distance between the variable focus lens array 109 and the second display panel 107-2, but also to the focal length of each lens in the variable focus lens array 109. Therefore, in this embodiment, the image distance of the second display panel 107-2 is the distance d from the variable focus lens array 109 to the image A formed by the second display panel 107-2, and satisfies:

[0081]

[0082] Where g is the distance from the variable focus lens array 109 to the second display panel 107-2, and f is the focal length of each lens in the variable focus lens array. It should be noted that, in this embodiment, the distance between the variable focus lens array 109 and the image A or the second display panel 107-2 is the distance between the optical center of the lens in the array and the image A or the second display panel 107-2.

[0083] In this embodiment of the invention, when the first display panel 107-1 displays the foreground image of a 3D image and the second display panel 107-2 displays the foreground image of a 3D image, that is, when both the first display panel 107-1 and the second display panel 107-2 display normal two-dimensional images, depth fusion 3D display is performed using the first display panel 107-1, the second display panel 107-2, and the variable focus lens array 109, and its depth range d2 satisfies:

[0084] d2=d-g+d1 (2)

[0085] As can be seen from expression (2), because of the introduction of the variable focus lens array 109, compared with the case of only two display elements, since dg is greater than or equal to 0, the depth range d2 will necessarily be increased, and the depth range d2 can increase the image distance d of the second display panel 107-2 by a maximum.

[0086] Reference Figure 3 As shown, in order to achieve deep fusion 3D display, enabling the human eye to correctly fuse the images displayed on the first display panel 107-1 and the second display panel 107-2 to produce a fused 3D image between the image on the first display panel 107-1 (i.e., the image formed on the first display panel 107-1) and the image A displayed on the second display panel 107-2, the angle θ between the line connecting the human eye and the center of the first display panel 107-1 and the line connecting the human eye and the center of image A on the second display panel 107-2 needs to be less than or equal to 2 arcminutes, where 1 arcminute is 1 / 60 degrees. The resolution of the human eye's retina is less than or equal to 2 arcminutes, and the angle θ satisfies:

[0087]

[0088] Where L is the distance between the human eye and the first display panel 107-1, and e is the interpupillary distance.

[0089] Substituting expressions (1) and (2) into expression (3), we obtain the following: To achieve deep fusion 3D display, the focal length f of the variable focal length lens array 109 must satisfy:

[0090]

[0091] As can be seen from the above analysis, in the embodiments of the present invention, since the depth of field range d2 is limited by the focal length f of each lens of the variable focal length lens array 109, the depth of field range d2 can be adjusted simply by adjusting the value of the focal length f.

[0092] Specifically, a lookup table for achieving deep fusion 3D display can be pre-stored in the display device according to expression (4). The lookup table includes the corresponding relationships of the included angle θ less than or equal to 2 arcminutes, the focal length f of each lens of the variable focal length lens array 109, and the distance L between the human eye and the first display panel 107-1.

[0093] In this embodiment, different included angles θ correspond to a set of distances L and focal lengths f. According to this lookup table, at least one included angle θ and its corresponding focal length f can be obtained based on the distance L between the human eye and the first display panel 107-1. In this embodiment, considering that a larger included angle θ can achieve a larger depth of field range, the focal length f corresponding to the largest included angle θ is selected.

[0094] It is worth noting that this application does not specifically limit how to select the included angle θ and the corresponding focal length f. Those skilled in the art should understand that, under the condition that the included angle θ is less than or equal to 2 arcminutes, the focal length f can be obtained by using the above lookup table and determining the distance L between the human eye and the first display panel 107-1, thereby realizing deep fusion 3D display.

[0095] Correspondingly, the control unit 103 outputs image parameters corresponding to the deep fusion 3D display to the image rendering unit 105, so that the image rendering unit 105 outputs the first image parameters to the first display panel 107-1 to display the first image and outputs the second image parameters to the second display panel 107-2 to display the second image. The first display image is the foreground image of the three-dimensional image presented during deep fusion 3D display, and the second display image is the background image of the three-dimensional image.

[0096] Those skilled in the art should understand that the type of variable focal length lens array is not limited here. The variable focal length lens array can be a variable focal length microlens array, in which each lens is a variable focal length microlens, or it can be a variable focal length cylindrical lens array, in which each lens in the array is a variable focal length cylindrical lens.

[0097] Specifically, the lenses in the variable focus lens array can be one of the following: liquid crystal lens, birefringent lens, PB lens, and metasurface lens.

[0098] Liquid crystal lenses are a novel type of microlens that utilizes the electro-optic effect to alter the spatial distribution of the lens's refractive index and is fabricated using microelectronic technology. By changing the spatial distribution of the lens's refractive index, its focal length can be altered. Birefringent microlenses can be composite lenses formed by stacking multiple birefringent lenses. By changing the polarization state of the incident light, the focal length of the composite lens can be changed by utilizing the change in the equivalent refractive index of the material. PB lenses change their focal length by altering the applied voltage or by changing the polarization state of the incident light. In practical applications, multiple PB lenses are stacked to form a PB composite lens. Each PB lens forms a different focal length based on the applied voltage or the polarization state of the incident light. The multiple PB lenses are adjusted collaboratively to achieve a variable focal length for the composite PB lens. Metasurface lenses change their focal length by altering the polarization state of the incident light. In practical applications, multiple metasurface lenses are stacked to form a composite metasurface lens. Each metasurface lens forms a different focal length based on the polarization state of the incident light. The multiple metasurface lenses are adjusted collaboratively to achieve a variable focal length for the composite metasurface lens.

[0099] Specifically, a variable-focus microlens can be a two-dimensional arrangement of lenses. The lens units of a variable-focus microlens are arranged in a two-dimensional manner, providing parallax in both the horizontal and vertical directions. However, this arrangement can easily lead to a decrease in 3D resolution. A variable-focus cylindrical lens, on the other hand, is a one-dimensional lens. The lenses of a variable-focus cylindrical lens are arranged in a one-dimensional direction, providing parallax only in the horizontal direction, which can meet the requirements of 3D displays. Therefore, a cylindrical lens array can be selected.

[0100] Since 3D displays can be formed using one-dimensional parallax, cylindrical lens arrays are preferred.

[0101] On the other hand, regarding the feature of increased viewing angle, we will continue to refer to... Figure 2 As shown, because a variable focus lens array is introduced into the deep fusion 3D display, multiple viewing zones are included under the dimming effect of the lenses. Each lens corresponds to multiple sub-pixels of the second display panel, forming multiple viewing zones through the lenses. As shown in the figure, each lens corresponds to 4 sub-pixels of the second display panel, forming 4 viewing zones through the lenses. Therefore, deep fusion 3D display can be realized within the multiple viewing zones formed by the first display panel 107-1, the second display panel 107-2, and the variable focus lens array. This allows users viewing the display device to observe the deep fusion 3D display effect from multiple directions, thereby improving the narrow viewing angle of traditional deep fusion 3D displays.

[0102] In some alternative embodiments, in order to improve the viewing angle characteristics of the deep fusion 3D display, the second display panel includes an array of pixels, each pixel including multiple sub-pixels, and each lens of the variable focus lens array covers at least two sub-pixels of the second display panel.

[0103] In this embodiment, at least two viewpoints are formed by each lens covering at least two sub-pixels of the second display panel, thereby improving the viewing angle characteristics of the deep fusion display. In other words, multiple viewpoints can effectively improve the viewing angle characteristics of the deep fusion display.

[0104] In some optional embodiments, the display parameters acquired by the control unit 105 also include the display range obtained by the control unit 105 based on the distance between the variable focal length lens array 109 and the second display panel. In embodiments of the present invention, this display range is the visible range that enables multi-viewpoint 3D display. Figure 4 In the text, the label W1 represents the display range.

[0105] In this embodiment, the control unit 103 is configured to determine whether the user's position is within the display range W1. If so, it controls: the focal length f of each lens of the variable focal lens array 109 is the distance between the variable focal lens array and the second display panel 107-2, that is, the second display panel 107-2 is located on the focal plane of the variable focal lens array 109; the first display image is a transparent image; and the second display image is a two-dimensional image of a three-dimensional image.

[0106] It should be noted that in this embodiment, by controlling the first image displayed on the first display panel to be a transparent image, the purpose is to make the first display panel transparent, so that the first display panel does not participate in the display. For example, when the first display panel is a liquid crystal display panel, by adjusting the voltage applied to the liquid crystal display panel, the liquid crystal does not refract or reflect light, thus presenting a transparent state. Of course, this application is not intended to be limited to this, and other methods to make the first display panel transparent are also possible.

[0107] Among them, the variable focus lens array 109 is a variable focus cylindrical lens array, that is, each lens is a variable focus cylindrical lens. By placing the second display panel 107-2 on the focal plane of the variable focus lens array 109, the light emitted from the second display panel is converted into collimated light after passing through each lens. Combined with the transparent first display panel, the two-dimensional image displayed on the second display panel is presented as a three-dimensional image through the microlens array, thereby providing users of the display device with a multi-viewpoint 3D display mode with better display effect within the display range W1.

[0108] Specifically, refer to Figure 5 As shown, in the multi-view 3D display mode, because the first display panel 107-1 displays a transparent image, the first display panel 107-1 has no effect on the multi-view 3D display. Figure 5 Not shown in the figure. The display range W1 includes the optimal viewing position D1, the first viewing position D2, and the second viewing position D3, where the diamond-shaped areas surrounded by thick black lines in the figure are the respective viewing zones 1-7.

[0109] When the left and right eyes are in different visual zones, the left and right eyes observe images with different parallaxes due to the different parallaxes in the images in different visual zones, thus forming three-dimensional vision. In the diagram, Lb is the optimal viewing distance when at the best viewing position D1, L1 is the distance from the nearest viewing position D2 to the optimal viewing position D1, L2 is the distance from the farthest viewing position D3 to the optimal viewing position D1, and w... y The length of the second display panel 107-2 in the horizontal direction is the display size of the second display panel in the horizontal direction. In the multi-viewpoint 3D display mode, the second display panel is set on the focal plane of each cylindrical lens in the zoom lens array. That is, the focal length of each cylindrical lens in the zoom lens array is the distance between the second display panel and the zoom lens array, i.e., f = g.

[0110] Within the display area W1, Figure 5 The maximum spacing a between two adjacent view areas y Must meet: Where t y The size of the subpixel along the horizontal direction.

[0111] The optimal viewing distance Lb satisfies:

[0112]

[0113] Where e is the interpupillary distance and M is the number of subpixels covered by each lens.

[0114] L1 and L2 must satisfy:

[0115]

[0116]

[0117] In actual design, once the positions of the variable focus lens array 109 and the second display panel 107-2 are determined, Lb, L1 and L2 are also determined.

[0118] Optionally, the control unit 103 determines the user's position based on the user's location. If the distance between the user and the second display panel 107-2 is greater than or equal to Lb-L1 and less than or equal to Lb+L2, the control unit 103 determines that the user's position is within the display range W1. That is, the user's position represents the sum of the distance L between the user and the first display panel 107-1 and the distance d1 between the first display panel 107-1 and the second display panel 107-2. If L+d1 is greater than or equal to Lb-L1 and less than or equal to Lb+L2, then the user's position is within the display range W1. The control unit 103 outputs the focal length parameters of the variable focus lens array 109 to the image rendering unit 105 to set the focal length of each lens to the distance g between the variable focus lens array 109 and the second display panel 107-2, and controls the image parameters output to the image rendering unit 105. These image parameters are used to control the image rendering unit 105 to output first display parameters to the first display panel 107-1 to display a transparent image and to output second display parameters to the second display panel 107-2 to display a two-dimensional image.

[0119] More specifically, the display range W1 should also satisfy:

[0120]

[0121]

[0122] And, a y ≤e,(M-1)b y ≥e,c y ≤e

[0123] Where M is the number of sub-pixels covered by each lens, and in order to form a parallax image to meet 3D display requirements, M should be greater than or equal to 2. y c is the distance between two adjacent viewpoints of the nearest viewing position. y This is the distance between two adjacent viewing zones at the furthest viewing position. Under the above conditions, it can be ensured that the user's two eyes are in different viewing zones within the display range W1, thereby achieving multi-viewpoint 3D display on the display device.

[0124] Additionally, it can be understood that in this embodiment, if the control unit 103 determines that the distance between the user and the second display panel 107-2 is less than Lb-L1 or greater than Lb+L2, then the user's position is determined to be in another display range W2. That is, the sum of the distance L between the user and the first display panel 107-1 (represented by the user's position) and the distance d1 between the first display panel 107-1 and the second display panel 107-2, if L+d1 is less than Lb-L1 or greater than Lb+L2, then the user's position is in another display range W2. The control unit 103 presents a three-dimensional image in the depth fusion 3D display mode described in the above embodiment by controlling the displayed images of the first display panel 107-1 and the second display panel 107-2, as well as the focal length of each variable focal length lens of the variable focal length lens array 109.

[0125] The above settings, through the control method of the configuration control unit 103, enable the display device to automatically switch the 3D display mode according to the position of the user viewing the display device, thereby providing a composite 3D display device that can have two display modes.

[0126] Corresponding to display devices, such as Figure 6 As shown, embodiments of the present invention also provide a display method using the display device described in the above embodiments, comprising:

[0127] S1. The control unit controls the image acquisition device to acquire user images of the user viewing the display device in real time and outputs the user's position to the control unit based on the user images.

[0128] S2. The control unit obtains display parameters based on the user's location. The display parameters include focal length parameters and image parameters.

[0129] S3. The control unit controls the focal length of each lens in the variable focal length lens array according to the focal length parameter.

[0130] S4. The control unit controls the image rendering unit to output the first display parameters to the first display panel to display the first display image and to output the second display parameters to the second display panel to display the second display image, so that the display device presents a three-dimensional image.

[0131] This embodiment uses a first display panel, a variable focal length lens array, and a second display panel stacked together. The focal length of each lens in the variable focal length lens array is controlled according to the user's position. By displaying images on the first display panel and the second display panel respectively, the display device presents a three-dimensional image, thereby realizing a depth-fusion 3D display with variable depth of field, effectively increasing the depth range. Furthermore, the variable focal length lens array can form viewpoints in multiple directions, thereby expanding the viewing angle. This allows for the advantages of not easily causing visual fatigue in local depth fusion, while also possessing the advantages of a wide viewing angle and deep depth of field, and has broad application prospects.

[0132] Optionally, the control unit controlling the focal length of each lens in the variable focal length lens array according to the focal length parameter further includes:

[0133] The focal length of each lens in the variable focal length lens array satisfies:

[0134]

[0135] Where θ is the angle between the line connecting the human eye and the center of the first display panel and the line connecting the human eye and the image center of the second display panel, L is the distance from the human eye to the first display panel, g is the distance from the variable focus lens to the second display panel, f is the focal length of each lens in the variable focus lens array, d1 is the distance between the first display panel and the second display panel, and e is the interpupillary distance.

[0136] The control unit controls the image rendering unit to output first display parameters to the first display panel to display a first display image and to output second display parameters to the second display panel to display a second display image, so that the display device presents a three-dimensional image, which further includes: controlling the first display image to be the foreground image of the three-dimensional image and controlling the second display image to be the background image of the three-dimensional image.

[0137] In this embodiment, based on the user's position, the displayed images on the first and second display panels are controlled, as well as the focal length of each variable focal length lens in the variable focal length lens array, to achieve deep fusion 3D display. Since the display method provided in this embodiment corresponds to the display devices provided in the aforementioned embodiments, the previous implementation methods are also applicable to the display method using the display device provided in this embodiment, and will not be described in detail here.

[0138] Optionally, the display parameters also include the display range obtained by the control unit based on the distance between the variable focus lens array and the second display panel, and the display method further includes: the control unit determining whether the user's position is within the display range; if so, then:

[0139] The control unit controls the focal length of each lens in the zoom lens array according to the focal length parameter, which further includes controlling the focal length of each lens in the zoom lens array to be the distance between the zoom lens array and the second display panel.

[0140] The control unit controls the image rendering unit to output first display parameters to the first display panel to display the first display image and to output second display parameters to the second display panel to display the second display image, so that the display device presents a three-dimensional image. This further includes controlling the first display image to be a transparent image and controlling the second display image to be a two-dimensional image of the three-dimensional image.

[0141] It should also be noted here that, in this embodiment, by controlling the first image displayed on the first display panel to be a transparent image, the purpose is to make the first display panel transparent, so that the first display panel does not participate in the display. For example, when the first display panel is a liquid crystal display panel, the voltage applied to the liquid crystal display panel can be adjusted so that the liquid crystal does not refract or reflect light, thus presenting a transparent state. Of course, this application is not intended to be limited to this, and other methods to make the first display panel transparent are also possible.

[0142] In this embodiment, when the user's position is within the display range, multi-viewpoint 3D display is achieved by controlling the displayed images on the first and second display panels, and controlling the focal length of each variable focal length lens in the variable focal length lens array. Since the display method provided in this application corresponds to the display devices provided in the aforementioned embodiments, the previous implementation methods are also applicable to the display method using the display device provided in this embodiment, and will not be described in detail here.

[0143] Another embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, which is implemented when executed by a processor:

[0144] The control unit controls the image acquisition device to acquire user images of the user viewing the display device in real time and outputs the user's position to the control unit based on the user images;

[0145] The control unit obtains display parameters based on the user's location. These display parameters include focal length parameters and image parameters.

[0146] The control unit controls the focal length of each lens in the variable focal length lens array based on the focal length parameters;

[0147] The control unit controls the image rendering unit to output first display parameters to the first display panel to display the first display image and to output second display parameters to the second display panel to display the second display image, so that the display device presents a three-dimensional image.

[0148] In practical applications, the computer-readable storage medium can be any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. For example, a computer-readable storage medium can be, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this embodiment, the computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0149] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, capable of sending, propagating, or transmitting programs for use by or in connection with an instruction execution system, apparatus, or device.

[0150] Program code contained on a computer-readable medium may be transmitted using any suitable medium, including but not limited to wireless, wire, optical fiber, RF, etc., or any suitable combination thereof.

[0151] Computer program code for performing the operations of this invention can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as "C" or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0152] like Figure 7As shown, another embodiment of the present invention provides a structural schematic diagram of a computer device. Figure 7 The computer device 12 shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of the present invention.

[0153] like Figure 7 As shown, the computer device 12 is represented in the form of a general-purpose computing device. The components of the computer device 12 may include, but are not limited to: one or more processors or processing units 16, system memory 28, and a bus 18 connecting different system components (including system memory 28 and processing unit 16).

[0154] Bus 18 represents one or more of several bus architectures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of the various bus architectures. For example, these architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnect (PCI) bus.

[0155] Computer device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by computer device 12, including volatile and non-volatile media, removable and non-removable media.

[0156] System memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. Computer device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 34 may be used to read and write non-removable, non-volatile magnetic media (…). Figure 7 Not shown; usually referred to as a "hard drive"). Although Figure 7 Not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk") and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 via one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the embodiments of the present invention.

[0157] A program / utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28. Such program modules 42 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. Program modules 42 typically perform the functions and / or methods described in the embodiments of the present invention.

[0158] Computer device 12 can also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), and with one or more devices that enable a user to interact with the computer device 12, and / or with any device that enables the computer device 12 to communicate with one or more other computing devices (e.g., network card, modem, etc.). This communication can be performed through input / output (I / O) interface 22. Furthermore, computer device 12 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) through network adapter 20. Figure 7 As shown, network adapter 20 communicates with other modules of computer device 12 via bus 18. It should be understood that, although... Figure 7 As not shown, it can be used in conjunction with computer device 12 with other hardware and / or software modules, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0159] The processor unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, such as implementing a display method using a display device provided in an embodiment of the present invention.

[0160] This invention addresses existing problems by providing a display device and method, a computer-readable storage medium, and a computer equipment. It utilizes a first display panel, a variable-focus lens array, and a second display panel stacked together. The focal length of each lens in the variable-focus lens array is controlled according to the user's position. By displaying images on both the first and second display panels, the display device presents a three-dimensional image, achieving a depth-fusion 3D display with variable depth of field, effectively increasing the depth range. Furthermore, the variable-focus lens array can form viewpoints in multiple directions, thereby expanding the viewing angle. This provides the advantages of deep fusion, reducing visual fatigue, while also offering a wide viewing angle and a large depth of field, making it suitable for a wide range of applications.

[0161] Obviously, the above embodiments of the present invention are merely examples for clearly illustrating the present invention, and are not intended to limit the implementation of the present invention. For those skilled in the art, other variations or modifications can be made based on the above description. It is impossible to exhaustively list all the implementation methods here. All obvious variations or modifications derived from the technical solutions of the present invention are still within the protection scope of the present invention.

Claims

1. A display device, characterized in that, It includes an image acquisition unit, a control unit, an image rendering unit, and a first display panel, a variable focus lens array, and a second display panel stacked together, wherein: The image acquisition device is used to acquire user images of users viewing the display device in real time and output the user's position to the control unit based on the user images; The variable focus lens array is disposed between the first display panel and the second display panel, and is disposed on the light-emitting side of the second display panel, away from the user relative to the first display panel. The variable focus lens array includes multiple lenses, each of which has a variable focal length. The control unit is configured to obtain display parameters based on the user's location, the display parameters including: The focal length parameters are output to the variable focal length lens array to control the focal length of each lens. The image parameters output to the image rendering unit are used to control the image rendering unit to output first display parameters to the first display panel to display a first display image, and to output second display parameters to the second display panel to display a second display image, so that the display device presents a three-dimensional image. The second display panel includes pixels arranged in an array, and each pixel includes multiple sub-pixels; Each lens of the variable focal length lens array covers at least two sub-pixels of the second display panel.

2. The display device according to claim 1, characterized in that, The focal length of each lens in the variable focal length lens array satisfies: θ≤2 arcminutes Where θ is the angle between the line connecting the center of the human eye and the center of the first display panel and the line connecting the center of the human eye and the image center of the second display panel, L is the distance of the human eye from the first display panel, g is the distance from the variable focus lens array to the second display panel, f is the focal length of each lens in the variable focus lens array, d1 is the distance between the first display panel and the second display panel, and e is the interpupillary distance. The first displayed image is the foreground image of the three-dimensional image; The second displayed image is the background image of the three-dimensional image.

3. The display device according to claim 2, characterized in that, The variable focal length lens array is: A variable focal length cylindrical lens array, where each lens is a variable focal length cylindrical lens; or A variable-focus microlens array, where each lens is a variable-focus microlens.

4. The display device according to claim 1, characterized in that, The display parameters also include the display range obtained by the control unit based on the distance between the variable focus lens array and the second display panel. The control unit is configured to determine whether the user's location is within the display range, and if so, control: The focal length of each lens in the variable focal length lens array is the distance between the variable focal length lens array and the second display panel; The first displayed image is a transparent image; The second displayed image is a two-dimensional image of the three-dimensional image.

5. The display device according to claim 4, characterized in that, The display range must meet the following requirements: f = g And, a y ≤e,(M-1)b y ≥e,c y ≤e Where f is the focal length of each lens in the variable focal length lens array, g is the distance from the variable focal length lens to the second display panel, Lb is the distance from the optimal viewing position to the display device, e is the interpupillary distance, and t is the focal length of the human eye. y M is the length of the subpixels of the second display panel along the horizontal direction, M is the number of subpixels covered by each lens, and a y Lb is the width of the viewing area at the optimal viewing distance, L1 is the distance between the nearest viewing position and the optimal viewing position, L2 is the distance between the farthest viewing position and the optimal viewing position, and w y It is the length of the second display panel in the horizontal direction, b y c is the distance between two adjacent viewpoints of the nearest viewing position. y This represents the distance between two adjacent viewpoints at the furthest viewing position.

6. The display device according to claim 5, characterized in that, The variable focal length lens array is a variable focal length cylindrical lens array, and each lens is a variable focal length cylindrical lens.

7. A display method using the display device as described in any one of claims 1-6, characterized in that, include: The control unit controls the image acquisition device to acquire user images of users viewing the display device in real time and outputs the user's position to the control unit based on the user images. The control unit obtains display parameters based on the user's location, and the display parameters include focal length parameters and image parameters; The control unit controls the focal length of each lens in the variable focal length lens array according to the focal length parameter; The control unit controls the image rendering unit to output first display parameters to the first display panel to display a first display image and to output second display parameters to the second display panel to display a second display image, so that the display device presents a three-dimensional image.

8. The display method according to claim 7, characterized in that, The control unit controls the focal length of each lens in the variable focal length lens array according to the focal length parameter, which further includes: The focal length of each lens in the variable focal length lens array satisfies: θ≤2 arcminutes Where θ is the angle between the line connecting the human eye and the center of the first display panel and the line connecting the human eye and the image center of the second display panel, L is the distance from the human eye to the first display panel, g is the distance from the variable focus lens to the second display panel, f is the focal length of each lens in the variable focus lens array, d1 is the distance between the first display panel and the second display panel, and e is the interpupillary distance. The control unit controls the image rendering unit to output first display parameters to the first display panel to display a first display image and to output second display parameters to the second display panel to display a second display image, so that the display device presents a three-dimensional image, which further includes: controlling the first display image to be the foreground image of the three-dimensional image and controlling the second display image to be the background image of the three-dimensional image.

9. The display method according to claim 7, characterized in that, The display parameters also include the display range obtained by the control unit based on the distance between the variable focus lens array and the second display panel, and the display method further includes: the control unit determining whether the user's position is within the display range; if so: The control unit controls the focal length of each lens in the variable focal length lens array according to the focal length parameter, which further includes controlling the focal length of each lens in the variable focal length lens array to be the distance between the variable focal length lens array and the second display panel. The control unit controls the image rendering unit to output first display parameters to the first display panel to display a first display image and to output second display parameters to the second display panel to display a second display image, so that the display device presents a three-dimensional image, which further includes: controlling the first display image to be a transparent image and controlling the second display image to be a two-dimensional image of the three-dimensional image.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the method as described in any one of claims 7-9.

11. A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the method as described in any one of claims 7-9.

Images