Display method of naked-eye three-dimensional display, naked-eye three-dimensional display, and electronic device

Abstract

The application discloses a display method of a naked-eye three-dimensional display, the naked-eye three-dimensional display and electronic equipment, and relates to the technical field of display. A processing unit determines display pictures of different depths of field according to human eye position information and image data streams; the pictures of different depths of field are respectively transmitted to light emitting diodes and liquid crystal layers, and the pictures of different depths of field are projected to human eyes through corresponding light filtering layers of the light emitting diodes and the liquid crystal layers. The method does not provide a 3D effect by making left and right eyes see different pixels, but adopts multi-layer space modulation, the displayed pictures themselves have depth of field effects, the pixels output by the display can be all received by the human eyes, the resolution observed by the human eyes is consistent with the resolution of the display, the picture definition is ensured, and the user observation experience is improved. In addition, the processing unit is directly integrated in the display, the human eye position is recognized, and the data displayed by the multi-layer display panel is determined, so that the dependence on a host computer is reduced, the delay is reduced, and the display efficiency is improved.

Description

Technical Field

[0001] This invention relates to the field of display technology, and in particular to a display method for a naked-eye 3D display, a naked-eye 3D display, and an electronic device. Background Technology

[0002] Traditional 3D display technology typically requires users to wear special glasses, which is inconvenient, causes eye strain, and limits the viewing experience. To enable users to see 3D videos without glasses, related technologies utilize liquid crystal display (LCD) panels. A lens is added to the display surface, and two cameras located above the display detect the user's eye position, causing the content seen by each eye to differ, thus achieving a 3D effect. Figure 1 As shown, Figure 1 This is a schematic diagram of a traditional display, including a backlight layer 1, a liquid crystal layer 2, a light filter 3, a lens 4, and a camera 5. Because the lens on the display surface projects misaligned pixels onto different spatial angles based on the principle of light refraction, the pixels seen by two different eyes are different. Even though the display has a 4K resolution, the human eye actually receives a resolution of 1080P, resulting in decreased image clarity and a blurry overall viewing experience. Furthermore, converting 2D video to 3D video and constantly tracking the viewer's eye position requires a graphics processing unit (GPU) located in the host computer, which only supports a specific architecture type, thus relying on host resources and experiencing high latency in image display.

[0003] Therefore, ensuring image clarity, providing users with a good viewing experience, reducing reliance on host resources, and lowering display latency are technical problems that urgently need to be solved by those in this field. Summary of the Invention

[0004] The purpose of this invention is to provide a display method, a naked-eye 3D display, and an electronic device for a naked-eye 3D display, in order to solve the technical problems of low image clarity, which affects the user's visual experience, and the reliance on host resources and display delay in traditional displays.

[0005] To address the aforementioned technical problems, this invention provides a display method for a naked-eye 3D display, applied to a processing unit within the naked-eye 3D display. The naked-eye 3D display further includes a camera, a light-emitting diode (LED), and a filter layer, multiple alternating liquid crystal layers, and the filter layer sequentially arranged along the transmission direction of the light beam emitted from the LED. The input terminal of the processing unit is connected to the output terminal of the camera, and the output terminal of the processing unit is connected to the input terminal of the LED and the input terminal of each liquid crystal layer, respectively. The method includes:

[0006] Acquire human eye images captured by a camera, and determine the human eye position information based on the human eye images;

[0007] Acquire image data stream, and determine display images with different depths of field based on the human eye position information and the image data stream;

[0008] Images of different depths of field are transmitted to light-emitting diodes (LEDs) and liquid crystal layers respectively, so that the images of different depths of field are projected to the human eye through the filter layers corresponding to the LEDs and the liquid crystal layers.

[0009] On one hand, the processing unit is connected to the host computer; the step of acquiring the image data stream and determining the display screen for different depths of field based on the human eye position information and the image data stream includes:

[0010] Acquire the two-dimensional image data stream sent by the host;

[0011] Convert the two-dimensional image data stream into a three-dimensional image data stream;

[0012] The display images with different depths of field are determined based on the human eye position information and the three-dimensional image data stream.

[0013] On the other hand, determining the display images with different depths of field based on the human eye position information and the three-dimensional image data stream includes:

[0014] The target observation angle of the human eye is determined based on the aforementioned human eye position information;

[0015] The three-dimensional image data stream is parsed to extract depth information in order to obtain image data at different depths of field;

[0016] Based on the target observation angle, viewpoint transformation processing is performed on image data of different depths in the three-dimensional image data stream to determine the display screen of different depths.

[0017] On the other hand, converting the two-dimensional image data stream into a three-dimensional image data stream includes:

[0018] The features of the image content corresponding to the two-dimensional image data stream are obtained; wherein, the features of the image content include at least texture differences, edge gradients, and brightness distribution;

[0019] Based on the characteristics of the image content corresponding to the two-dimensional image data stream, the two-dimensional image data stream is divided into multiple mutually independent semantic regions;

[0020] A depth weight is assigned to each semantic region; wherein the depth weight is determined by features of the image content of the semantic region.

[0021] The depth weights are mapped to spatial depth values ​​to construct a depth data layer corresponding to each pixel of the two-dimensional image data stream.

[0022] The two-dimensional image data stream is fused with the generated depth data layer to obtain the three-dimensional image data stream containing two-dimensional image information and spatial depth information.

[0023] On the other hand, after acquiring the image data stream and before determining the display screen for different depths of field based on the human eye position information and the image data stream, the process also includes:

[0024] Obtain the optical characteristic parameters of each liquid crystal layer; wherein, the optical characteristic parameters include at least transmittance, scattering coefficient and phase shift parameter;

[0025] The modulation relationship of each optical characteristic parameter on beam propagation is obtained, and the beam modulation relationships corresponding to multiple sets of optical characteristic parameters are coupled to construct a model of the influence of the liquid crystal layer on beam transmission.

[0026] Obtain the original image data stream corresponding to the target depth image to be displayed; wherein, the target depth image is any depth image among all depth images except the depth image closest to the human eye;

[0027] The beam propagation path corresponding to the target depth image is determined based on the optical path setting of the multilayer liquid crystal display structure;

[0028] The target liquid crystal layer that the light beam corresponding to the target depth image needs to pass through is determined based on the light beam propagation path.

[0029] The beam change parameters after the beam passes through the target liquid crystal layer are determined based on the target liquid crystal layer, the order in which the beam passes through each target liquid crystal layer, and the beam transmission influence model.

[0030] The original image data stream is compensated according to the beam change parameters to obtain the compensated image data stream;

[0031] Determining the display images with different depths of field based on the human eye position information and the image data stream includes:

[0032] The display images with different depths of field are determined based on the human eye position information and the compensated image data stream.

[0033] On the other hand, after acquiring the human eye image captured by the camera, and before determining the human eye position information based on the human eye image, the process also includes:

[0034] The system captures eye images of the current scene using a camera, and detects and counts the number of eyes appearing in the images.

[0035] If more than two eyes are detected, extract the feature information of each eye.

[0036] The feature information of each eye is input into the self-learning model that is used to represent the eyes of the target user.

[0037] A self-learning model is used to compare each eye feature with the pre-stored eye features of the target user in order to identify the target eye that matches the eye features of the target user from multiple eye features.

[0038] The process of determining the human eye position information based on the human eye image includes:

[0039] The location information of the target eye is determined based on the human eye image.

[0040] On the other hand, in the direction facing the human eye, the area of ​​the light-emitting diode, the area of ​​each liquid crystal layer, and the area of ​​each filter layer are all equal and all greater than the preset area.

[0041] To address the aforementioned technical problems, the present invention also provides a naked-eye 3D display, comprising a processing unit, a camera, a light-emitting diode (LED), and a filter layer, multiple sets of alternately arranged liquid crystal layers and filter layers sequentially disposed along the transmission direction of the light beam emitted by the LED; the input end of the processing unit is connected to the output end of the camera, and the output end of the processing unit is connected to the input end of the LED and the input end of each liquid crystal layer, respectively.

[0042] The processing unit is used to acquire human eye images captured by the camera and determine human eye position information based on the human eye images; acquire image data streams and determine display images of different depths of field according to the human eye position information and the image data streams; and transmit the images of different depths of field to the light-emitting diodes and each liquid crystal layer respectively.

[0043] The filter layers corresponding to the light-emitting diodes and the liquid crystal layers are used to project images of different depths of field onto the human eye.

[0044] To address the aforementioned technical problems, the present invention also provides an electronic device, comprising:

[0045] Memory, used to store computer programs;

[0046] A processor is used to execute the computer program to implement the steps of the above-described display method for a naked-eye 3D display.

[0047] To address the aforementioned technical problems, the present invention also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps of the above-described display method for a naked-eye 3D display.

[0048] The beneficial effect of this invention is that the display method of the naked-eye 3D display is applied to naked-eye 3D displays. The naked-eye 3D display includes a camera, a processing unit, a light-emitting diode (LED), and a filter layer, multiple sets of alternately arranged liquid crystal layers, and a filter layer sequentially arranged along the transmission direction of the light beam emitted by the LED. The input end of the processing unit is connected to the output end of the camera, and the output end of the processing unit is connected to the input end of the LED and the input end of each liquid crystal layer. The processing unit in the naked-eye 3D display first acquires an image of the human eye captured by the camera and determines the human eye position information based on the image. Then, it acquires an image data stream and determines display images of different depths of field based on the human eye position information and the image data stream. Finally, the images of different depths of field are transmitted to the LED and each liquid crystal layer respectively, and after passing through the filter layer corresponding to the LED and the filter layer corresponding to the liquid crystal layer, the images of different depths of field are projected onto the human eye. The display images of different depths of field are thus 3D images. As can be seen, the display method provided by this invention does not provide a 3D effect by having the left and right eyes see different pixels. Instead, it employs multi-layer spatial modulation, so the image displayed on the monitor itself has a depth effect. All pixels output by the monitor can be received by the human eye, ensuring that the resolution seen by the human eye matches the resolution of the monitor, thereby guaranteeing image clarity and improving the user's viewing experience. Furthermore, the processing unit is directly integrated into the monitor to identify the position of the human eye and determine the data displayed on the multi-layer display panel (LED layer, each liquid crystal layer), reducing dependence on the host computer, lowering display latency, and improving image display efficiency. In addition, LEDs are used, which are self-emissive, with each pixel independently controlled, resulting in high contrast, pure colors, and fast response, further improving the display quality of the image.

[0049] In addition, the processing unit receives the two-dimensional image data stream sent by the host and converts it into a three-dimensional image data stream. Compared with the method of relying on the host for image conversion, this reduces the naked-eye 3D display's dependence on host resources.

[0050] By combining the human eye position to determine the target observation angle, analyzing the 3D image data stream to extract depth information and dividing the image data according to different depths of field, and then performing perspective transformation processing on the image data of each depth of field according to the observation angle, it can accurately match the actual observation angle of the human eye with the 3D display screen, realize independent perspective adaptation of different depth of field content, improve the stereoscopic sense, realism and observation comfort of 3D display, and at the same time ensure that the images at different depth levels are clear and conform to the visual habits of the human eye.

[0051] By extracting texture differences, edge gradients, and brightness distribution features from two-dimensional image data streams to divide them into independent semantic regions, and then assigning depth weights based on the features of each semantic region and mapping them to spatial depth values, a depth data layer corresponding to each pixel is constructed. Finally, it is fused with two-dimensional image data to generate a three-dimensional image data stream. It can automatically and accurately distinguish the spatial layers of different semantic regions based on the content features of two-dimensional images, achieve efficient and adaptive conversion from two-dimensional to three-dimensional, and improve the accuracy and scene adaptability of three-dimensional data generation.

[0052] By acquiring the optical characteristic parameters of the multilayer liquid crystal layer and constructing a beam transmission influence model, and combining the beam propagation path of the target depth image to determine the corresponding target liquid crystal layer and beam change parameters, the original image data stream can be pre-compensated. This effectively eliminates the optical attenuation, scattering, and phase shift interference caused by the multilayer liquid crystal structure to beam propagation, improves the display accuracy and optical consistency of images at different depths, and makes the final displayed image more in line with the actual observation effect of the human eye, thereby enhancing the realism and stability of 3D display.

[0053] By using a self-learning model in the processing unit, the system can recognize the eyes of a specific user. When determining the display screen with different depths of field based on the position of the user's eyes, the system ensures that the user can see the 3D image clearly, while other users cannot see or cannot see the 3D image. This guarantees the security of the screen display and ensures that the user can see the 3D image clearly.

[0054] In the direction facing the human eye, the area of ​​the light-emitting diode, the area of ​​each liquid crystal layer, and the area of ​​each filter layer are all equal and larger than the preset area, ensuring complete imaging, no blind spots, uniform light, and when the area is larger than the preset area, it can be used as a three-dimensional naked-eye television.

[0055] Furthermore, the naked-eye 3D display, electronic device, and computer-readable storage medium provided by this invention have the same or corresponding technical features as the display method of the naked-eye 3D display mentioned above, and have the same effect. Attached Figure Description

[0056] To more clearly illustrate the embodiments of the present invention, the accompanying drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0057] Figure 1 This is a schematic diagram of a traditional monitor.

[0058] Figure 2 A schematic diagram of the panel structure of a naked-eye 3D display provided in an embodiment of the present invention;

[0059] Figure 3 This is a schematic diagram of the structure of a naked-eye 3D display provided in an embodiment of the present invention;

[0060] Figure 4 A flowchart illustrating a display method for a naked-eye 3D display provided in an embodiment of the present invention;

[0061] Figure 5 This is a structural diagram of an electronic device provided in an embodiment of the present invention. Detailed Implementation

[0062] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the protection scope of the present invention.

[0063] The core of this invention is to provide a display method, a naked-eye 3D display, and an electronic device for a naked-eye 3D display, in order to solve the technical problems of low image clarity, which affects the user's visual experience, and the reliance on host resources, which results in image display delay, in traditional displays.

[0064] To enable those skilled in the art to better understand the present invention, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. Figure 2 This is a schematic diagram of the panel structure of a naked-eye 3D display according to an embodiment of the present invention. The panel structure of this naked-eye 3D display includes a light-emitting diode (LED), and a filter layer, multiple sets of alternately arranged liquid crystal layers and filter layers sequentially disposed along the transmission direction of the light beam emitted by the LED. It is worth noting that the multiple sets of alternately arranged liquid crystal layers and filter layers refer to a sequence of liquid crystal layer, filter layer, liquid crystal layer, filter layer, ..., liquid crystal layer, filter layer. The number of sets of alternately arranged liquid crystal layers and filter layers is not limited; the number depends on the level of detail of the image to be displayed. Figure 2 In this structure, the alternating liquid crystal layer and filter layer are arranged in two groups. Figure 2 The entire panel structure consists of six layers. From left to right, the first layer is a light-emitting diode layer (6), the second layer is a first light filter layer (7), the third layer is a first liquid crystal layer (8), the fourth layer is a second light filter layer (9), the fifth layer is a second liquid crystal layer (10), and the sixth layer is a third light filter layer (11).

[0065] The first layer is a light-emitting diode (LED) 6, which can be controlled to emit light sources of different intensities. Specifically, an organic light-emitting diode (OLED) can be used. Compared to LCD displays, OLEDs can control the light emission of individual pixels, allowing the display to show perfect blacks by controlling the LEDs of individual pixels. After passing through the first filter layer 7, the first layer image is displayed as the background. The light beam passes through the first liquid crystal layer 8, and the intensity of the light beam is adjusted by the first liquid crystal layer 8 before reaching the second filter layer 9, where the second layer image is displayed as the mid-ground. Similarly, when the light beam passes through the second liquid crystal layer 10 and the third filter layer 11, the third layer image is displayed as the foreground. These six panels together constitute the panel structure of the display. This panel uses three-layer spatial modulation, allowing the display itself to show three different images—foreground, mid-ground, and background—giving the human eye a three-dimensional (3D) effect.

[0066] Figure 2 The panel structure shown depicts three layers of spatial modulation; in practice, the panel can be increased to five layers. From left to right, the panel structure consists of ten layers: light-emitting diodes (LEDs), a light filter layer, a liquid crystal layer, another light filter layer, another liquid crystal layer, another light filter layer, another liquid crystal layer, another light filter layer, another liquid crystal layer, and another light filter layer. The display shows the foreground, middle foreground, middle ground, middle background, and background, resulting in a more detailed image.

[0067] The size of each layer is not limited. In some embodiments, the areas of the light-emitting diodes, the liquid crystal layers, and the filter layers are all equal and larger than a preset area in the direction facing the human eye. This ensures complete imaging, no blind spots, uniform light, and, when the area is larger than the preset area, it can be used as a 3D glasses-free television.

[0068] Based on the panel structure described above, Figure 3 This is a schematic diagram of the structure of a naked-eye 3D display provided in an embodiment of the present invention, as shown below. Figure 3 As shown, it includes a processing unit 12, a camera 5, a light-emitting diode 6, and a filter layer, multiple sets of alternating liquid crystal layers and filter layers arranged sequentially along the transmission direction of the light beam emitted by the light-emitting diode 6; the input end of the processing unit 12 is connected to the output end of the camera 5, and the output end of the processing unit 12 is connected to the input end of the light-emitting diode 6 and the input end of each liquid crystal layer. Figure 3 The alternating arrangement of liquid crystal layers and filter layers is shown in two groups. Specifically, the output terminal of the processing unit 12 is connected to the input terminal of the light-emitting diode 6, the input terminal of the first liquid crystal layer 8, and the input terminal of the second liquid crystal layer 10, respectively. The processing unit 12 can be an application-specific integrated circuit (ASIC) or a GPU, etc., to provide computing power support.

[0069] Based on the naked-eye 3D display provided above, this embodiment of the invention provides a display method for a naked-eye 3D display, applied to a processing unit in a naked-eye 3D display. Figure 4 A flowchart illustrating a display method for a naked-eye 3D display provided in an embodiment of the present invention is shown below. Figure 4 As shown, the method includes:

[0070] S10: Acquire the human eye image captured by the camera, and determine the human eye position information based on the human eye image;

[0071] S11: Acquire image data stream and determine the display screen for different depths of field based on human eye position information and image data stream;

[0072] S12: Transmit images of different depths of field to the light-emitting diodes and each liquid crystal layer respectively, so that the images of different depths of field are projected to the human eye through the filter layers corresponding to the light-emitting diodes and the filter layers corresponding to the liquid crystal layers.

[0073] Two cameras are fixed to the display, and the processing unit acquires images captured by the cameras. Determining the human eye position information based on the images captured by the cameras includes:

[0074] Two cameras are symmetrically mounted on the edge of the monitor with a fixed spacing and fixed posture. A unified spatial coordinate system with the monitor as the reference is established. The internal and external parameters and relative positional relationship of the two cameras are pre-calibrated to obtain the dual-camera calibration parameters.

[0075] Control two cameras to simultaneously capture facial images of people in front of the display at the same time, and preprocess the two captured images. The preprocessing includes at least denoising, enhancement, and distortion correction.

[0076] Face and eye region detection is performed on the two preprocessed images to locate key human eye feature points such as the left and right eye contours and pupil center, and the corresponding human eye feature pixel coordinates under the two cameras are obtained respectively;

[0077] Based on the dual-camera imaging model and calibration parameters, the pixel coordinates of the same human eye feature points in the two images are matched to establish the correspondence of feature points and calculate the phase difference and disparity information of feature points between the two imaging paths.

[0078] Based on the principle of binocular vision triangulation, and combined with the fixed distance and focal length of the two cameras, as well as the calculated parallax and phase difference, the three-dimensional spatial coordinates of human eye feature points in the display spatial coordinate system are calculated.

[0079] This method employs dual cameras fixed to the display and obtains the human eye position based on phase difference or parallax. The hardware structure is simple and the arrangement is stable and reliable. Through phase difference calculation, it can achieve rapid, stable and relatively accurate detection of the human eye's spatial position without relying on complex equipment. This provides a real-time and accurate human eye observation benchmark for subsequent 3D display perspective changes and image compensation, which is conducive to improving the realism and visual comfort of 3D display.

[0080] In practice, computers and other electronic devices correspond to a single user. However, cameras may capture images of more than one eye. In such cases, to ensure that the single user can see the image, some embodiments include, after acquiring the eye image captured by the camera and before determining the eye position information based on the eye image, the following steps are also taken:

[0081] The system captures eye images of the current scene using a camera, and detects and counts the number of eyes appearing in the images.

[0082] If more than two eyes are detected, extract the feature information of each eye.

[0083] The feature information of each eye is input into the self-learning model that is used to represent the eyes of the target user.

[0084] A self-learning model is used to compare each eye feature with the pre-stored eye features of the target user in order to identify the target eye that matches the eye features of the target user from multiple eye features.

[0085] Determining human eye location information based on human eye images includes:

[0086] Determine the location information of the target eye based on human eye images.

[0087] In this embodiment, the self-learning model in the processing unit is used to recognize the eyes of a specific user. When determining the display screen with different depths of field to be displayed based on the position of the specific user's eyes, the specific user can see the three-dimensional image clearly, while other users cannot see the three-dimensional image clearly, so as to ensure the security of the screen display and ensure that the specific user can see the three-dimensional image clearly.

[0088] The processing unit acquires an image data stream, which can be a two-dimensional image or a three-dimensional image. The image data stream acquired by the processing unit can be a pre-stored image data stream or an image data stream acquired from a host. In some embodiments, the processing unit is connected to a host; acquiring the image data stream and determining display screens with different depths of field based on human eye position information and the image data stream includes:

[0089] Acquire the two-dimensional image data stream sent by the host;

[0090] Convert a two-dimensional image data stream into a three-dimensional image data stream;

[0091] The display image at different depths is determined based on the human eye position information and the 3D image data stream.

[0092] In this embodiment, a two-dimensional image data stream is obtained from the host, and then the processing unit converts the two-dimensional image data stream into a three-dimensional image data stream itself. Compared with methods that rely on the host for image conversion, this reduces the dependence on host resources.

[0093] In order to convert a two-dimensional image data stream into a three-dimensional image data stream, in some embodiments, the conversion of a two-dimensional image data stream into a three-dimensional image data stream includes:

[0094] Obtain the features of the image content corresponding to the two-dimensional image data stream; wherein, the features of the image content include at least texture differences, edge gradients and brightness distribution;

[0095] Based on the characteristics of the image content corresponding to the two-dimensional image data stream, the two-dimensional image data stream is divided into multiple independent semantic regions;

[0096] A depth weight is assigned to each semantic region; where the depth weight is determined by the features of the image content of the semantic region.

[0097] Depth weights are mapped to spatial depth values ​​to construct a depth data layer that corresponds to each pixel of the two-dimensional image data stream.

[0098] The two-dimensional image data stream is fused with the generated depth data layer to obtain a three-dimensional image data stream containing two-dimensional image information and spatial depth information.

[0099] The method provided in this embodiment extracts the texture differences, edge gradients and brightness distribution features of two-dimensional images to divide semantic regions, and then allocates depth weights according to the region features and constructs a depth data layer corresponding to each pixel. This enables adaptive and high-precision conversion from two-dimensional images to three-dimensional images, improving the stereoscopic and realistic feel of subsequent three-dimensional displays.

[0100] In the above embodiments, human eye position information and three-dimensional image data stream are determined. In some embodiments, determining the display screen with different depths of field based on the human eye position information and the three-dimensional image data stream includes:

[0101] Determine the target observation angle of the human eye based on the human eye's position information;

[0102] The 3D image data stream is parsed to extract depth information in order to obtain image data at different depths of field;

[0103] Based on the target observation angle, viewpoint transformation processing is performed on image data of different depths in the 3D image data stream to determine the display screen of different depths.

[0104] Specifically, after obtaining the human eye position information, the target observation angle of the human eye relative to the display screen is calculated and determined based on the relative spatial relationship between the human eye position information and the display screen. At the same time, the input three-dimensional image data stream is parsed frame by frame to extract the corresponding depth information and obtain image data of different depths according to the depth level. Then, based on the determined target observation angle, independent perspective transformation processing is performed on the image data of different depths in the three-dimensional image data stream so that the image data of each depth level is adapted to the current human eye observation perspective, and finally, a display screen with different depths that matches the target observation angle and has distinct layers is generated.

[0105] In this embodiment, by determining the target observation angle based on the human eye position information, parsing the three-dimensional image data stream and extracting image data of different depths, and then performing perspective transformation processing on each depth image data, the display screen of different depths can be accurately matched with the actual observation angle of the human eye, significantly improving the stereoscopic sense, realism and visual consistency of the three-dimensional display.

[0106] The background image projected to the viewer's eye needs to pass through the preceding liquid crystal layer and filter layer; the mid-ground image projected to the viewer's eye also needs to pass through the preceding liquid crystal layer and filter layer. The preceding liquid crystal layer and filter layer affect the background and mid-ground images. To ensure the realism of the 3D image display, in some embodiments, after acquiring the image data stream and before determining the display screen for different depths of field based on the viewer's eye position information and the image data stream, the following steps are also included:

[0107] Obtain the optical characteristic parameters of each liquid crystal layer; wherein, the optical characteristic parameters include at least transmittance, scattering coefficient and phase shift parameter;

[0108] The modulation relationship of each optical characteristic parameter on beam propagation is obtained, and the beam modulation relationship corresponding to multiple sets of optical characteristic parameters is coupled to construct a model of the influence of the liquid crystal layer on beam transmission.

[0109] Obtain the original image data stream corresponding to the target depth image to be displayed; wherein, the target depth image is any depth image among all depth images except the depth image closest to the human eye;

[0110] The beam propagation path corresponding to the target depth image is determined based on the optical path setting of the multilayer liquid crystal display structure.

[0111] Determine the target liquid crystal layer that the beam needs to pass through to correspond to the target depth image based on the beam propagation path;

[0112] The beam change parameters after the beam passes through the target liquid crystal layer are determined based on the target liquid crystal layer, the order in which the beam passes through each target liquid crystal layer, and the influence model of beam transmission.

[0113] The original image data stream is compensated based on the beam change parameters to obtain the compensated image data stream;

[0114] Determining different depths of field based on human eye position information and image data stream includes:

[0115] The display image at different depths is determined based on the human eye position information and the compensated image data stream.

[0116] In this embodiment, by acquiring optical characteristic parameters such as transmittance, scattering coefficient, and phase shift of the multilayer liquid crystal layer and constructing a beam transmission influence model, and combining the beam propagation path corresponding to the depth image with the order of passing through the liquid crystal layer to determine the beam change parameters, the original image data stream is pre-compensated. This can effectively offset the attenuation, scattering, and phase shift caused by the multilayer liquid crystal structure to beam propagation, improve the display accuracy and optical fidelity of non-near-eye depth images, make the display images of different depths clearer and more accurate in terms of layering, and enhance the overall visual effect of three-dimensional display.

[0117] The following is based on Figure 3 Taking the aforementioned naked-eye 3D display method as an example, we will explain its display method. An ASIC or GPU serves as the processing unit, providing computational support. A camera captures the position of the viewer's eyes in front of the display panel, while the processing unit simultaneously receives image data streams from the host computer. The specific process is as follows: The processing unit runs an eye recognition mode, calculates the position of the viewer's eyes in real time, and calculates the foreground, middle ground, and background images to be displayed based on the received image data stream. The image is displayed by controlling the light-emitting diodes in the backlight layer and the third and fifth liquid crystal layers, sending the corresponding image to the viewer's eyes. Figure 3 The panel employs three-layer spatial modulation to create a 3D spatial effect. Inside the display, an ASIC / GPU receives information from the camera and the host computer in real time. Using a human eye recognition model, it accurately identifies the user's eye position, calculates the data displayed on the three layers of the display panel, and delivers the 3D image to the user's eyes. Simultaneously, the first luminescent panel uses OLED to improve image quality. The display integrates a processing unit, enhancing adaptability and reducing reliance on the host computer.

[0118] The naked-eye 3D display method provided in this invention uses an OLED as the light source. Compared to LCD displays, OLEDs can control the light emission of individual pixels, allowing the display to show perfect blacks by controlling the light-emitting diodes of individual pixels. Therefore, the display of this invention has higher contrast and faster response speed. Furthermore, because it employs multi-layer (e.g., three or more layers) spatial modulation, the displayed image itself has a depth-of-field effect, making it more comfortable for the human eye, reducing dizziness, and providing a better viewing angle. Compared to drawing computing power from a PC's specific graphics card architecture to convert 2D images to 3D images, where the graphics card utilization reaches 80% and the human eye only sees 1080P at 4K resolution, the processing unit of this invention is directly embedded in the display, eliminating the reliance on a host with a specific graphics card architecture. Meanwhile, the display method provided by this invention does not provide a 3D effect by having the left and right eyes see different pixels. Instead, it uses multi-layer spatial modulation, so that the image displayed by the display itself has a depth effect. All the pixels output by the display can be received by the human eye, so that the resolution seen by the human eye is consistent with the resolution of the display. That is, the resolution received by the human eye is the resolution of the screen, and there is no situation where the resolution is halved, thereby ensuring the clarity of the image and improving the user's viewing experience.

[0119] The above describes a display method for a naked-eye 3D display. This embodiment also provides a naked-eye 3D display, including a processing unit, a camera, a light-emitting diode, and a filter layer, multiple sets of alternately arranged liquid crystal layers and filter layers arranged sequentially along the transmission direction of the light beam emitted by the light-emitting diode; the input end of the processing unit is connected to the output end of the camera, and the output end of the processing unit is connected to the input end of the light-emitting diode and the input end of each liquid crystal layer respectively.

[0120] The processing unit is used to acquire human eye images captured by the camera and determine human eye position information based on the human eye images; acquire image data streams and determine display images of different depths of field based on human eye position information and image data streams; and transmit images of different depths of field to light-emitting diodes and liquid crystal layers respectively.

[0121] The filter layers corresponding to the light-emitting diodes and the liquid crystal layers are used to project images of different depths of field onto the human eye.

[0122] In the above embodiments, the display method of the naked-eye 3D display has been described in detail. The present invention also provides embodiments corresponding to electronic devices. These embodiments are described from a hardware perspective.

[0123] Figure 5 This is a structural diagram of an electronic device provided in an embodiment of the present invention. This embodiment is based on a hardware perspective, such as... Figure 5 As shown, the electronic device includes:

[0124] Memory 20 is used to store computer programs;

[0125] The processor 21 is used to execute a computer program to implement the steps of a display method for a naked-eye 3D display as described in the above embodiments.

[0126] The processor 21 may include one or more processing cores, such as a quad-core processor or an octa-core processor. The processor 21 may be implemented using at least one of the following hardware forms: Digital Signal Processor (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array. The processor 21 may also include a main processor and a coprocessor. The main processor, also known as the Central Processing Unit (CPU), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, the processor 21 may integrate a GPU, which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, the processor 21 may also include an Artificial Intelligence (AI) processor, which handles computational operations related to machine learning.

[0127] The memory 20 may include one or more computer-readable storage media, which may be non-transitory. The memory 20 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In this embodiment, the memory 20 is used to store at least the following computer program 201, which, after being loaded and executed by the processor 21, is capable of implementing the relevant steps of the display method of the naked-eye 3D display disclosed in any of the foregoing embodiments. In addition, the resources stored in the memory 20 may also include an operating system 202 and data 203, etc., and the storage method may be temporary storage or permanent storage. The operating system 202 may include Windows, Unix, Linux, etc. The data 203 may include, but is not limited to, the data involved in the aforementioned display method of the naked-eye 3D display.

[0128] In some embodiments, the electronic device may further include a display screen 22, an input / output interface 23, a communication interface 24, a power supply 25, and a communication bus 26.

[0129] Those skilled in the art will understand that Figure 5The structures shown do not constitute a limitation on electronic devices and may include more or fewer components than those shown.

[0130] The electronic device provided in this embodiment of the invention includes a memory and a processor. When the processor executes the program stored in the memory, it can implement the following method: a display method for a naked-eye 3D display, with the same effect as above.

[0131] This invention also provides a computer program product, including a computer program / instruction, which, when executed by a processor, implements the steps of the above-described display method for a naked-eye 3D display.

[0132] Finally, the present invention also provides an embodiment corresponding to a computer-readable storage medium. The computer-readable storage medium stores a computer program, which, when executed by a processor, performs the steps described in the above method embodiments.

[0133] It is understood that if the methods in the above embodiments are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and executes all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0134] The computer-readable storage medium provided by this invention includes the display method of the aforementioned naked-eye 3D display, with the same effect.

[0135] The display method, the naked-eye 3D display, and the electronic device provided by this invention have been described in detail above. The various embodiments in the specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since it corresponds to the method disclosed in the embodiments, the description is relatively simple, and relevant parts can be referred to in the method section. It should be noted that those skilled in the art can make several improvements and modifications to this invention without departing from the principles of this invention, and these improvements and modifications also fall within the protection scope of this invention.

[0136] It should also be noted that, in this specification, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

Claims

1. A display method for a naked-eye 3D display, characterized in that, A processing unit for use in a glasses-free 3D display, the glasses-free 3D display further comprising a camera, a light-emitting diode (LED), and a filter layer, multiple sets of alternately arranged liquid crystal layers and filter layers sequentially arranged along the transmission direction of the light beam emitted by the LED; the input terminal of the processing unit is connected to the output terminal of the camera, and the output terminal of the processing unit is connected to the input terminal of the LED and the input terminal of each liquid crystal layer respectively; the method includes: Acquire human eye images captured by a camera, and determine the human eye position information based on the human eye images; Acquire image data stream, and determine display images with different depths of field based on the human eye position information and the image data stream; Images of different depths of field are transmitted to light-emitting diodes (LEDs) and liquid crystal layers respectively, so that the images of different depths of field are projected to the human eye through the filter layers corresponding to the LEDs and the liquid crystal layers.

2. The display method of the naked-eye 3D display according to claim 1, characterized in that, The processing unit is connected to the host computer; the step of acquiring the image data stream and determining the display screen for different depths of field based on the human eye position information and the image data stream includes: Acquire the two-dimensional image data stream sent by the host; Convert the two-dimensional image data stream into a three-dimensional image data stream; The display images with different depths of field are determined based on the human eye position information and the three-dimensional image data stream.

3. The display method of the naked-eye 3D display according to claim 2, characterized in that, The step of determining the display images with different depths of field based on the human eye position information and the three-dimensional image data stream includes: The target observation angle of the human eye is determined based on the aforementioned human eye position information; The three-dimensional image data stream is parsed to extract depth information in order to obtain image data at different depths of field; Based on the target observation angle, viewpoint transformation processing is performed on image data of different depths in the three-dimensional image data stream to determine the display screen of different depths.

4. The display method of the naked-eye 3D display according to claim 2, characterized in that, The step of converting the two-dimensional image data stream into a three-dimensional image data stream includes: The features of the image content corresponding to the two-dimensional image data stream are obtained; wherein, the features of the image content include at least texture differences, edge gradients, and brightness distribution; Based on the characteristics of the image content corresponding to the two-dimensional image data stream, the two-dimensional image data stream is divided into multiple mutually independent semantic regions; A depth weight is assigned to each semantic region; wherein the depth weight is determined by features of the image content of the semantic region. The depth weights are mapped to spatial depth values ​​to construct a depth data layer corresponding to each pixel of the two-dimensional image data stream. The two-dimensional image data stream is fused with the generated depth data layer to obtain the three-dimensional image data stream containing two-dimensional image information and spatial depth information.

5. The display method of the naked-eye 3D display according to any one of claims 1 to 4, characterized in that, After acquiring the image data stream, and before determining the display screen for different depths of field based on the human eye position information and the image data stream, the process further includes: Obtain the optical characteristic parameters of each liquid crystal layer; wherein, the optical characteristic parameters include at least transmittance, scattering coefficient and phase shift parameter; The modulation relationship of each optical characteristic parameter on beam propagation is obtained, and the beam modulation relationships corresponding to multiple sets of optical characteristic parameters are coupled to construct a model of the influence of the liquid crystal layer on beam transmission. Obtain the original image data stream corresponding to the target depth image to be displayed; wherein, the target depth image is any depth image among all depth images except the depth image closest to the human eye; The beam propagation path corresponding to the target depth image is determined based on the optical path setting of the multilayer liquid crystal display structure; The target liquid crystal layer that the light beam corresponding to the target depth image needs to pass through is determined based on the light beam propagation path. The beam change parameters after the beam passes through the target liquid crystal layer are determined based on the target liquid crystal layer, the order in which the beam passes through each target liquid crystal layer, and the influence model of beam transmission. The original image data stream is compensated according to the beam change parameters to obtain the compensated image data stream; Determining the display images with different depths of field based on the human eye position information and the image data stream includes: The display images with different depths of field are determined based on the human eye position information and the compensated image data stream.

6. The display method of the naked-eye 3D display according to any one of claims 1 to 4, characterized in that, After acquiring the human eye image captured by the camera, and before determining the human eye position information based on the human eye image, the process also includes: The system captures eye images of the current scene using a camera, and detects and counts the number of eyes appearing in the images. If more than two eyes are detected, extract the feature information of each eye. The feature information of each eye is input into the self-learning model that is used to represent the eyes of the target user. A self-learning model is used to compare each eye feature with the pre-stored eye features of the target user in order to identify the target eye that matches the eye features of the target user from multiple eye features. The process of determining the human eye position information based on the human eye image includes: The location information of the target eye is determined based on the human eye image.

7. The display method of the naked-eye 3D display according to any one of claims 1 to 4, characterized in that, In the direction facing the human eye, the area of ​​the light-emitting diode, the area of ​​each liquid crystal layer, and the area of ​​each filter layer are all equal and all greater than the preset area.

8. A glasses-free 3D display, characterized in that, It includes a processing unit, a camera, a light-emitting diode (LED), and a filter layer, multiple sets of alternating liquid crystal layers and filter layers arranged sequentially along the transmission direction of the light beam emitted by the LED; the input end of the processing unit is connected to the output end of the camera, and the output end of the processing unit is connected to the input end of the LED and the input end of each liquid crystal layer respectively. The processing unit is used to acquire human eye images captured by the camera and determine human eye position information based on the human eye images; Acquire image data stream, and determine display images with different depths of field based on the human eye position information and the image data stream; Images with different depths of field are transmitted separately to the light-emitting diodes and each liquid crystal layer; The filter layer corresponding to the light-emitting diode and the filter layer corresponding to the liquid crystal layer are used to project images of different depths of field onto the human eye.

9. An electronic device, characterized in that, include: Memory, used to store computer programs; A processor, configured to execute the computer program to implement the steps of the display method of the naked-eye 3D display as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of the display method of the naked-eye 3D display as described in any one of claims 1 to 7.

Images