A three-dimensional light field display system with adjustable angular resolution

Abstract

The present invention discloses a three-dimensional light field display system with adjustable angular resolution, which relates to the field of three-dimensional display. Through the collaborative optimization of hardware and software, a high-fidelity and high-smoothness three-dimensional stereoscopic display effect is achieved. The hardware part includes a micro-pitch LED, a diaphragm liquid crystal screen, and a high-resolution LCD liquid crystal screen. The software part includes a depth detection algorithm, a light control coding algorithm, a diaphragm coding algorithm, and a parallax map synthesis algorithm. By combining hardware and software, this system can accurately control the number of light rays emitted by different volume pixels in different directions according to different display information, significantly enhancing the three-dimensional visual experience of users.

Description

Technical Field

[0001] This application relates to the field of three-dimensional display, and particularly to a three-dimensional light field display system with adjustable angular resolution. Background Art

[0002] With the rapid development of virtual reality, augmented reality, medical imaging, and scientific visualization technologies, people's demand for high-precision and high-smoothness three-dimensional display systems is increasing day by day. Traditional three-dimensional display technologies, such as stereoscopic display and multi-viewpoint display, although meeting these needs to a certain extent, still have significant limitations in issues such as single angular resolution, uneven brightness, and insufficient stereoscopic effect. For example, in the prior art, it is often difficult to dynamically adjust the size of the angular resolution according to different display contents, resulting in various problems in the trade-off between display depth and resolution.

[0003] Some solutions in the current market attempt to improve the three-dimensional display effect by using binocular parallax display technology combined with technologies such as optical waveguides. However, these solutions still have technical bottlenecks in terms of light control accuracy and dynamic range. Inaccurate light control will lead to parallax errors and crosstalk to a certain extent, thereby affecting the stereoscopic effect; while insufficient dynamic range limits the realism and detail performance of three-dimensional display. In addition, how to achieve smooth viewpoint switching and depth adjustment when displaying different depth information is also an issue that has not been fully solved by current technologies.

[0004] Although some technologies based on light field photography and rendering have made significant progress in simulating three-dimensional scenes, they still face major challenges in real-time display and user experience. Real-time depth detection and accurate light control coding require the cooperation of complex algorithms and high-performance hardware. Summary of the Invention

[0005] In view of the above deficiencies in the prior art, the present invention provides a three-dimensional light field display system with adjustable angular resolution, which solves the problem of the single number of light rays diverging from voxels in different directions.

[0006] To achieve the above object of the invention, the technical solution adopted by the present invention is: a three-dimensional light field display system with adjustable angular resolution, including: a hardware part and a software part;

[0007] The hardware part includes a micro-pitch LED, a diaphragm liquid crystal screen, and an LCD liquid crystal screen arranged in sequence from the inside out;

[0008] The micro-pitch LED is used to load a light control effect diagram, and precisely control the light output angle through the light modulation of the diaphragm liquid crystal screen, project the pixel information of different parallax images on the LCD liquid crystal screen to the corresponding positions in space, and form voxels;

[0009] The diaphragm LCD screen is used to load the light flux regulation image and limit the light flux and emission angle of the micro-pitch LED;

[0010] The LCD screen is used to load the interleaved image;

[0011] The software part includes the depth detection algorithm, the light control coding algorithm, the diaphragm coding algorithm, and the parallax map synthesis algorithm;

[0012] Depth detection algorithm: By capturing and processing multi-angle image data, it is used to obtain the depth information of different positions of the image to be displayed;

[0013] Light control coding algorithm: It is used to calculate and generate the corresponding light control effect diagram according to the depth information, and load the light control effect diagram onto the micro-pitch LED;

[0014] Diaphragm coding algorithm: It is used to generate the corresponding light flux regulation image according to the light control effect diagram, and load the light flux regulation image onto the diaphragm LCD screen;

[0015] Parallax map synthesis algorithm: It is used to synthesize a group of parallax images containing different angle information into an interleaved image, and load the interleaved image onto the LCD screen.

[0016] Furthermore: The micro-pitch LED is of the Micro-LED type, and the diaphragm LCD screen is a liquid crystal screen without a color filter.

[0017] Furthermore: The installation distance between the micro-pitch LED and the LCD screen d Follows:

[0018]

[0019] Among them, L c is the width of a single sub-pixel on the LCD screen, Le is the intercept of the lit area on a column of light control units on the backlight of the micro-pitch LED, D is the distance of the viewer from the center of the screen.

[0020] Furthermore: The depth detection algorithm includes the process of three-dimensional reconstruction of the object to be displayed through image processing technology, specifically including:

[0021] Using a high-definition camera device or 3D creation software to obtain multi-angle image data of the object to be displayed;

[0022] Through image segmentation technology, extract the contour features of the object from the multi-angle image data;

[0023] Through the depth estimation algorithm, perform three-dimensional reconstruction on the extracted contour features to obtain the depth information of each position of the object;

[0024] Convert the depth information of each position of the object into digital signals that can be processed by the light control encoding algorithm.

[0025] Furthermore: The light control effect diagram generated by the light control encoding algorithm consists of vertically black and white stripes with different spacings at different depths. The area where the micro-spacing LEDs load the white stripes is the light-emitting area, and the diodes are in the lit state; the area where the micro-spacing LEDs load the black stripes is the non-light-emitting area, and the diodes are in the off state.

[0026] The light control encoding algorithm sets a column of light-emitting area and its adjacent column of non-light-emitting area as a group of light control units. The light control encoding algorithm is used to regulate the lighting and extinguishing of the diodes in each group of light control units, control the widths of the light-emitting area and the non-light-emitting area, and adjust the number of light rays emitted in different directions by different volume pixels.

[0027] Furthermore: The number of viewpoints formed by loading the light control effect diagram in the viewing area Q The expression is:

[0028]

[0029] Where k b is the width of the non-light-emitting area, k s is the width of the light-emitting area, k p is the size of the sub-pixel.

[0030] Furthermore: When the distance from the sub-pixel on the LCD screen to the edge of its corresponding light control unit satisfies , assign the sub-pixel at the corresponding position in the x th picture;

[0031] Where X e is the width of the area of the LCD screen sub-pixels covered by each group of light control units in the horizontal direction, n is the number of viewpoints, is the interval width corresponding to a single sub-pixel, and the distance from each sub-pixel to the edge of its corresponding light control unit is within the interval [0, X e ).

[0032] Furthermore: The light flux regulation image generated by the aperture encoding algorithm consists of light-transmitting apertures with different radii at different depths. The light flux regulation image is loaded onto the aperture LCD screen to limit the light flux and the emission angle of the micro-spacing LEDs.

[0033] Furthermore: After the three-dimensional light field display system generates a three-dimensional image, light and dark brightness adjustment is also required. The specific method is:

[0034] An industrial camera is used to photograph the generated three-dimensional image, and the brightness difference information of each area of the photographed image is obtained;

[0035] The brightness difference information of each area is subjected to brightness recognition, and the areas with brightness lower than the threshold are subjected to targeted area brightening operations through an LCD display screen.

[0036] The beneficial effects of the present invention are as follows:

[0037] Through the collaborative optimization of hardware and software, the light output direction can be controlled and the density of viewpoints can be precisely regulated, realizing a high-smooth three-dimensional light field display system with adjustable angular resolution and uniform brightness, significantly enhancing the user's three-dimensional visual experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 It is a schematic diagram of the formation principle of parallax of a three-dimensional light field display system with adjustable angular resolution.

[0039] Figure 2 It is a single-viewpoint image to be processed.

[0040] Figure 3 It is a depth information map displayed by a depth detection algorithm.

[0041] Figure 4 It is a schematic diagram of the light flux regulation of the aperture encoding algorithm.

[0042] Figure 5 It is a schematic diagram of the principle of calculating the aperture diameter of the light-transmitting aperture by the aperture encoding algorithm.

[0043] Figure 6 It is a comparison diagram of the effects of different angular resolutions. DETAILED DESCRIPTION OF THE INVENTION

[0044] The following describes the specific embodiments of the present invention to facilitate those skilled in the art of the present technology to understand the present invention. However, it should be clear that the present invention is not limited to the scope of the specific embodiments. For those of ordinary skill in the art of the present technology, as long as various changes are within the spirit and scope of the present invention defined and determined by the appended claims, these changes are obvious, and all inventions created using the concept of the present invention are within the scope of protection.

[0045] In an embodiment of the present invention, a three-dimensional light field display system with adjustable angular resolution is provided, including: a hardware part and a software part;

[0046] As Figure 1 shown, the hardware part includes a micro-pitch LED, a diaphragm liquid crystal screen, and an LCD liquid crystal screen arranged in sequence from the inside out;

[0047] The micro-pitch LEDs are used to load the light control effect diagram, and precisely control the light output angle of the light through the dimming of the aperture liquid crystal screen, project the pixel information of different parallax images on the LCD liquid crystal screen to the corresponding positions in space, and form volumetric pixels;

[0048] The aperture liquid crystal screen is used to load the light flux regulation image and limit the light transmission amount and emission angle of the micro-pitch LEDs;

[0049] The LCD liquid crystal screen is used to load the interleaved image;

[0050] The software part includes a depth detection algorithm, a light control coding algorithm, an aperture coding algorithm, and a parallax map synthesis algorithm;

[0051] Depth detection algorithm: By capturing and processing multi-angle image data, it is used to obtain the depth information of different positions of the image to be displayed;

[0052] Light control coding algorithm: It is used to calculate and generate the corresponding light control effect diagram according to the depth information, and load the light control effect diagram onto the micro-pitch LEDs;

[0053] Aperture coding algorithm: It is used to generate the corresponding light flux regulation image according to the light control effect diagram, and load the light flux regulation image onto the aperture liquid crystal screen;

[0054] Parallax map synthesis algorithm: It is used to synthesize a group of parallax images containing different angle information into an interleaved image, and load the interleaved image onto the LCD liquid crystal screen.

[0055] Specifically, the micro-pitch LEDs are of the Micro-LED type. The tiny and dense pixel structure and high brightness characteristics provide a solid foundation for precise light control. The aperture liquid crystal screen selects a liquid crystal screen without a color filter to regulate the light path of the LED behind it. The LCD liquid crystal screen selects a model with high resolution, wide color gamut, and high refresh rate to ensure the clarity and color richness of the image display.

[0056] In the installation design, the system pays special attention to the distance optimization between the micro-pitch LED display and the LCD liquid crystal screen. The installation distance between the micro-pitch LEDs and the LCD liquid crystal screen d follows:

[0057]

[0058] where L c is the width of a single sub-pixel on the LCD liquid crystal screen, Le is the intercept of the lit area on a column of light control units on the micro-pitch LED backlight, Dis the distance of the viewer from the center of the screen, which is precisely calculated to achieve the best optical transmission effect and minimize the light crosstalk error. It focuses on solving the problem of fixed angular resolution in traditional 3D display technologies. It can flexibly adjust the number of light rays diverging from different voxels in different directions according to the different objects to be displayed, which will significantly enhance the user's viewing experience.

[0059] The depth detection algorithm is used to convert the original image to be 3D reconstructed, as shown in Figure 2 into a depth information map of the depth information of the display object at different positions, as shown in Figure 3 including the process of image processing technology and 3D reconstruction of the object to be displayed, specifically including:

[0060] Use a high-definition camera device or 3D creation software to obtain multi-angle image data of the object to be displayed;

[0061] Extract the contour features of the object from the multi-angle image data through image segmentation technology;

[0062] Through a depth estimation algorithm, perform 3D reconstruction on the extracted contour features to obtain the depth information of each position of the object;

[0063] Convert the depth information of each position of the object into a digital signal that can be processed by the light control coding algorithm.

[0064] The light control coding algorithm generates a corresponding light control effect diagram loaded on the micro-pitch LED display according to the depth information of the display object at different positions obtained by the depth detection algorithm. The effect diagram is vertical black and white stripes with different spacings at different depths. The area where the micro-pitch LED loads the white stripes is the light-emitting area, and the diode is in the lit state; the area where the micro-pitch LED loads the black stripes is the non-light-emitting area, and the diode is in the off state;

[0065] The light control coding algorithm sets a column of light-emitting areas and its adjacent column of non-light-emitting areas as a group of light control units. The light control coding algorithm is used to precisely regulate the lighting and extinguishing of the diodes in each group of light control units, that is, control the widths of the light-emitting area and the non-light-emitting area. Increase the width of the non-light-emitting area at greater depths to form more viewpoints and increase the angular resolution. Through precise dimming of the micro-pitch LED, adjust the number of light rays diverging from different voxels in different directions, so as to achieve the effect of optimizing 3D display.

[0066] The number of viewpoints formed by the light control effect diagram in the viewing area Q The expression is:

[0067]

[0068] Where kb is the width of the non - light - emitting area, k s is the width of the light - emitting area, k p is the size of the sub - pixel. The number of viewpoints within the unit area is the viewpoint density. The greater the viewpoint density, the higher the corresponding angular resolution.

[0069] The aperture encoding algorithm generates a corresponding light - flux regulation image according to the light - control effect diagram generated by the light - control encoding algorithm. The light - flux image is a light - transmitting aperture with different radii at different depths. Loading the light - flux regulation image onto the aperture liquid - crystal screen is used to limit the light - passing amount and the light - emitting angle of the micro - pitch LEDs;

[0070] The light - transmitting apertures correspond one - to - one with the micro - pitch LEDs lit below. The aperture radius is smaller in places with smaller depths and larger in places with larger depths. The effect is as Figure 4 shown.

[0071] Loading the light - flux image onto the aperture liquid - crystal screen to control the light - flux and angle of the micro - pitch LEDs, ensuring that the viewing angles of the entire encoded image are consistent. By having consistent viewing angles, the distance between the virtual light - emitting point and the LCD liquid - crystal screen can be calculated d , and the distance between the viewing position of the human eye and the LCD liquid - crystal screen D is known. From this, the size of the aperture light - passing hole can be deduced t , as Figure 5 shown.

[0072] When the distance from the sub - pixel on the LCD liquid - crystal screen to the edge of its corresponding light - control unit satisfies , assign the sub - pixel at the corresponding position in the x th image;

[0073] Among them, X e is the width of the sub - pixel area on the LCD liquid - crystal screen covered by each group of light - control units in the horizontal direction, n is the number of viewpoints, is the interval width corresponding to a single sub - pixel. The distance from each sub - pixel to the edge of its corresponding light - control unit is within the interval [0, X e )).

[0074] Create different angular resolutions at different display depths, so that the number of light - emitting rays of different volume pixels is different, thereby optimizing the final visual smoothness and enhancing the immersion of 3D display. As Figure 6 shown, it shows the comparative effect diagram of forming different angular resolutions.

[0075] Specifically, the intercepts of the light control units generated in different depth regions are different, and the corresponding encoded images should be synthesized according to their corresponding parameters and loaded onto the LCD screen.

[0076] Since the lighting of the backlight micro-pitch LEDs is not uniform in different regions, after the three-dimensional light field display system generates a three-dimensional image, light and dark brightness adjustment is still required. The specific method is as follows:

[0077] Use an industrial camera to take pictures of the generated three-dimensional image and obtain the brightness difference information of each region of the captured image;

[0078] Perform brightness recognition on the brightness difference information of each region, and perform targeted area brightening operations on the regions with brightness lower than the threshold through the LCD display screen;

[0079] The targeted area brightening operations include, but are not limited to, increasing the backlight intensity of local areas, adjusting color balance, or applying techniques such as dynamic light compensation. Finally, a high-smooth three-dimensional stereoscopic display image with balanced brightness, smooth color, and uneven angular resolution is achieved.

[0080] Through the collaborative optimization of hardware and software, the present invention realizes a high-smooth three-dimensional light field display system with adjustable angular resolution and uniform brightness. The system significantly improves the realism and smoothness of the three-dimensional image through the precise layout of the micro-pitch LED display, the aperture LCD screen, and the high-resolution LCD screen, as well as the collaborative work of the depth detection algorithm, the light control encoding algorithm, the aperture encoding algorithm, and the disparity map synthesis algorithm, providing users with an immersive three-dimensional visual experience. The present invention has broad application prospects in the fields of virtual reality, augmented reality, and medical imaging.

[0081] The above embodiments are only used to illustrate the technical solutions of the present application, and are not intended to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements on some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A three-dimensional light field display system with adjustable angular resolution, characterized in that: include: Hardware part and software part; The hardware part includes micro-pitch LED, aperture LCD screen and LCD screen arranged from the inside to the outside; The micro-pitch LED is used to load the light control effect map, and the light output angle is precisely controlled through the dimming of the aperture LCD screen, and the pixel information from different parallax images on the LCD screen is projected to the corresponding position in the space to form a volume pixel; The aperture LCD screen is used to load the light flux control image and limit the light flux and luminous angle of the micro-pitch LED; The LCD screen is used to load interlaced images; The software part includes depth detection algorithm, light control coding algorithm, aperture coding algorithm and disparity map synthesis algorithm; Depth detection algorithm: It is used to obtain the depth information of different positions of the image to be displayed by capturing and processing multi-angle image data; Light control coding algorithm: used to calculate and generate the corresponding light control effect map according to the depth information, and load the light control effect map onto the micro-pitch LED; The light control effect diagram generated by the light control coding algorithm is vertical black and white stripes with different spacings at different depths. The area where the micro-pitch LED is loaded with white stripes is the light-emitting area, and the diode is in the lit state; the area where the micro-pitch LED is loaded with black stripes is the non-light-emitting area, and the diode is in the off state. The light control coding algorithm sets a column of luminous areas and an adjacent column of non-luminous areas as a group of light control units. The light control coding algorithm is used to control the on and off of the diodes of each group of light control units, control the width of the luminous area and the non-luminous area, and adjust the number of light rays emitted by different pixels in different directions. Aperture coding algorithm: used to generate the corresponding light flux control image according to the light control effect diagram, and load the light flux control image onto the aperture LCD screen; Disparity map synthesis algorithm: used to synthesize a group of disparity images containing information of different angles into an interlaced image, and load the interlaced image onto the LCD screen.

2. The three-dimensional light field display system with adjustable angular resolution according to claim 1, characterized in that: The micro-pitch LED uses the Micro-LED type, and the aperture LCD screen uses an LCD screen without a color filter.

3. The three-dimensional light field display system with adjustable angular resolution according to claim 1, characterized in that: Installation distance between micro-pitch LED and LCD screen d follow: in, L c It is the width of a single sub-pixel on the LCD screen. Le It is the intercept of the lit area on a row of light control units on the micro-pitch LED backlight source. D is the distance from the viewer to the center of the screen.

4. The three-dimensional light field display system with adjustable angular resolution according to claim 1, characterized in that: The depth detection algorithm includes the process of three-dimensional reconstruction of the object to be displayed through image processing technology, including: Use high-definition camera equipment or 3D creation software to obtain multi-angle image data of the object to be displayed; Through image segmentation technology, the contour features of objects are extracted from multi-angle image data; Through the depth estimation algorithm, the extracted contour features are reconstructed in three dimensions to obtain the depth information of each position of the object; The depth information of each position of the object is converted into a digital signal that can be used for light control coding algorithm processing.

5. The three-dimensional light field display system with adjustable angular resolution according to claim 1, characterized in that: The number of viewpoints formed by loading the light control effect map in the viewing area Q The expression is: in, k b is the width of the non-luminous area, k s is the width of the luminous area, k p is the sub-pixel size.

6. The three-dimensional light field display system with adjustable angular resolution according to claim 5, characterized in that: When the distance from the sub-pixel on the LCD screen to the edge of the corresponding light control unit meets When x The sub-pixel at the corresponding position of the image; in, X e is the width of the LCD sub-pixel area covered by each group of light control units in the horizontal direction, n is the number of viewpoints, is the interval width corresponding to a single sub-pixel, and the distance between each sub-pixel and the edge of the corresponding light control unit is between [0, X e ) interval.

7. The three-dimensional light field display system with adjustable angular resolution according to claim 1, characterized in that: The light flux control image generated by the aperture coding algorithm is a transparent aperture of different radii at different depths. The light flux control image is loaded onto the aperture LCD screen to limit the light flux and luminous angle of the micro-pitch LED.

8. The three-dimensional light field display system with adjustable angular resolution according to any one of claims 1 to 7, characterized in that: After the three-dimensional light field display system generates a three-dimensional image, it is also necessary to adjust the light and dark brightness. The specific method is as follows: The generated three-dimensional image is photographed by an industrial camera, and brightness difference information of each area of ​​the photographed image is obtained; The brightness difference information of each area is used to identify the brightness, and the areas with brightness below the threshold are brightened in a targeted manner through the LCD display.

Images