Three-dimensional light field display system with adjustable angular resolution

Abstract

The invention discloses a three-dimensional light field display system with an adjustable angular resolution, which relates to the field of three-dimensional display, and realizes a high-fidelity and high-smoothness three-dimensional display effect through collaborative optimization of hardware and software, the hardware part comprises a micro-pitch LED, a diaphragm liquid crystal screen and a high-resolution LCD liquid crystal screen, and the micro-pitch LED, the diaphragm liquid crystal screen and the high-resolution LCD liquid crystal screen are arranged in the micro-pitch LED, the diaphragm liquid crystal screen and the high-resolution LCD liquid crystal screen respectively. The software part comprises a depth detection algorithm, a light control coding algorithm, a diaphragm coding algorithm and a disparity map synthesis algorithm, and through combination of hardware and software, the system can accurately regulate and control the number of light rays diverging to different directions by different body pixels according to different display information, so that the three-dimensional visual experience of a user is remarkably improved.

Description

Technical Field

[0001] The present application relates to the field of three-dimensional display, and in particular to a three-dimensional light field display system with adjustable angular resolution. Background Art

[0002] With the rapid development of virtual reality, augmented reality, medical imaging and scientific visualization technology, people's demand for high-precision and high-smoothness three-dimensional display systems is growing. Although traditional three-dimensional display technologies, such as stereoscopic display and multi-viewpoint display, have met these needs to a certain extent, they still have significant limitations in terms of single angular resolution, uneven brightness, and insufficient stereoscopic effect. For example, in the prior art, the size of the angular resolution is often difficult to dynamically adjust according to different display contents, resulting in various problems in the trade-off between display depth and resolution.

[0003] Some solutions in the current market attempt to improve the 3D display effect by using binocular parallax display technology combined with technologies such as optical waveguides. However, these solutions still have technical bottlenecks in terms of light control accuracy and dynamic range. Inaccurate light control will lead to parallax errors and, to a certain extent, crosstalk, which will affect the stereoscopic effect; while insufficient dynamic range limits the realism and detail of the 3D display. In addition, how to achieve smooth viewpoint switching and depth adjustment when displaying different depth information is also a problem that has not been fully solved by current technology.

[0004] Although some technologies based on light field photography and rendering have made significant progress in simulating 3D scenes, they still face major challenges in real-time display and user experience. Real-time depth detection and accurate light control coding require the synergy of complex algorithms and high-performance hardware. Summary of the invention

[0005] In view of the above-mentioned deficiencies in the prior art, the present invention provides a three-dimensional light field display system with adjustable angular resolution, which solves the problem that a single number of light rays is emitted by a body pixel in different directions.

[0006] In order to achieve the above-mentioned invention object, the technical solution adopted by the present invention is: a three-dimensional light field display system with adjustable angular resolution, including: a hardware part and a software part; The hardware part includes micro-pitch LED, aperture LCD screen and LCD screen arranged from the inside to the outside; The micro-pitch LED is used to load the light control effect map, and the light output angle is precisely controlled through the dimming of the aperture LCD screen, and the pixel information from different parallax images on the LCD screen is projected to the corresponding position in the space to form a volume pixel; The aperture LCD screen is used to load the light flux control image and limit the light flux and luminous angle of the micro-pitch LED; The LCD screen is used to load interlaced images; The software part includes depth detection algorithm, light control coding algorithm, aperture coding algorithm and disparity map synthesis algorithm; Depth detection algorithm: It is used to obtain the depth information of different positions of the image to be displayed by capturing and processing multi-angle image data; Light control coding algorithm: used to calculate and generate the corresponding light control effect map according to the depth information, and load the light control effect map onto the micro-pitch LED; Aperture coding algorithm: used to generate the corresponding light flux control image according to the light control effect diagram, and load the light flux control image onto the aperture LCD screen; Disparity map synthesis algorithm: used to synthesize a group of disparity images containing information of different angles into an interlaced image, and load the interlaced image onto the LCD screen.

[0007] Furthermore: the micro-pitch LED adopts the Micro-LED type, and the aperture LCD screen adopts an LCD screen without a color filter.

[0008] Further: The installation distance between the micro-pitch LED and the LCD screen d follow:

[0009] in, L c It is the width of a single sub-pixel on the LCD screen. Le It is the intercept of the lit area on a row of light control units on the micro-pitch LED backlight source. D is the distance from the viewer to the center of the screen.

[0010] Further: the depth detection algorithm includes the process of three-dimensional reconstruction of the object to be displayed through image processing technology, specifically including: Use high-definition camera equipment or 3D creation software to obtain multi-angle image data of the object to be displayed; Through image segmentation technology, the contour features of objects are extracted from multi-angle image data; Through the depth estimation algorithm, the extracted contour features are reconstructed in three dimensions to obtain the depth information of each position of the object; The depth information of each position of the object is converted into a digital signal that can be used for light control coding algorithm processing.

[0011] Further: the light control effect diagram generated by the light control coding algorithm is vertical black and white stripes with different spacings at different depths, the area where the micro-pitch LED is loaded with white stripes is the light-emitting area, and the diode is in a lit state; the area where the micro-pitch LED is loaded with black stripes is the non-light-emitting area, and the diode is in an off state; The light control coding algorithm sets a column of luminous areas and an adjacent column of non-luminous areas as a group of light control units. The light control coding algorithm is used to control the brightness of each group of light control unit diodes, control the width of the luminous area and the non-luminous area, and adjust the number of light rays emitted by different pixels in different directions.

[0012] Further: Load the number of viewpoints formed by the light control effect map in the viewing area Q The expression is:

[0013] in, k b is the width of the non-luminous area, k s is the width of the luminous area, k p is the sub-pixel size.

[0014] Further: when the distance between the sub-pixel on the LCD screen and the edge of the corresponding light control unit meets When x The sub-pixel at the corresponding position of the image; in, X e is the width of the LCD sub-pixel area covered by each group of light control units in the horizontal direction, n is the number of viewpoints, is the interval width corresponding to a single sub-pixel, and the distance between each sub-pixel and the edge of the corresponding light control unit is between [0, X e ) interval.

[0015] Furthermore: the light flux control image generated by the aperture coding algorithm is a light-transmitting aperture of different radii at different depths, and the light flux control image is loaded onto the aperture LCD screen to limit the light flux and light-emitting angle of the micro-pitch LED.

[0016] Furthermore, after the three-dimensional light field display system generates a three-dimensional image, it is also necessary to adjust the light and dark brightness, and the specific method is as follows: The generated three-dimensional image is photographed by an industrial camera, and the brightness difference information of each area of ​​the photographed image is obtained; The brightness difference information of each area is used to identify the brightness, and the areas with brightness below the threshold are brightened in a targeted manner through the LCD display.

[0017] The beneficial effects of the present invention are: Through the coordinated optimization of hardware and software, it is possible to control the light output direction and accurately adjust the density of viewpoints, realizing a highly smooth three-dimensional light field display system with adjustable angular resolution and uniform brightness, significantly improving the user's three-dimensional visual experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 Schematic diagram of parallax formation in a three-dimensional light field display system with adjustable angular resolution.

[0019] Figure 2 is the single viewpoint image to be processed.

[0020] Figure 3 A graph of depth information displayed for a depth detection algorithm.

[0021] Figure 4 Schematic diagram of light flux control using the aperture coding algorithm.

[0022] Figure 5 Schematic diagram of the aperture calculation for the aperture coding algorithm.

[0023] Figure 6 This is a comparison chart of the effects of different angular resolutions. DETAILED DESCRIPTION

[0024] The specific implementation modes of the present invention are described below so that those skilled in the art can understand the present invention. However, it should be clear that the present invention is not limited to the scope of the specific implementation modes. For those of ordinary skill in the art, as long as various changes are within the spirit and scope of the present invention as defined and determined by the attached claims, these changes are obvious, and all inventions and creations utilizing the concept of the present invention are protected.

[0025] In one embodiment of the present invention, a three-dimensional light field display system with adjustable angular resolution is provided, comprising: a hardware part and a software part; like Figure 1 As shown, the hardware part includes micro-pitch LED, aperture LCD screen and LCD screen arranged from inside to outside; The micro-pitch LED is used to load the light control effect map, and the light output angle is precisely controlled through the dimming of the aperture LCD screen, and the pixel information from different parallax images on the LCD screen is projected to the corresponding position in the space to form a volume pixel; The aperture LCD screen is used to load the light flux control image and limit the light flux and luminous angle of the micro-pitch LED; The LCD screen is used to load interlaced images; The software part includes depth detection algorithm, light control coding algorithm, aperture coding algorithm and disparity map synthesis algorithm; Depth detection algorithm: It is used to obtain the depth information of different positions of the image to be displayed by capturing and processing multi-angle image data; Light control coding algorithm: used to calculate and generate the corresponding light control effect map according to the depth information, and load the light control effect map onto the micro-pitch LED; Aperture coding algorithm: used to generate the corresponding light flux control image according to the light control effect diagram, and load the light flux control image onto the aperture LCD screen; Disparity map synthesis algorithm: used to synthesize a group of disparity images containing information of different angles into an interlaced image, and load the interlaced image onto the LCD screen.

[0026] Specifically, the micro-pitch LED uses the Micro-LED type. The tiny and dense pixel structure and high brightness characteristics provide a solid foundation for precise light control. The aperture LCD screen uses an LCD screen without color filters to regulate the light path of the LED behind it. The LCD screen uses a high-resolution, wide color gamut and high refresh rate model to ensure the clarity and color richness of the image.

[0027] In terms of installation design, the system pays special attention to the distance optimization between the micro-pitch LED display and the LCD screen. d follow:

[0028] in, L c It is the width of a single sub-pixel on the LCD screen. Le It is the intercept of the lit area on a row of light control units on the micro-pitch LED backlight source. D It is the distance between the viewer and the center of the screen. This distance is precisely calculated to achieve the best optical transmission effect and the smallest light crosstalk error. It focuses on solving the problem of fixed angular resolution in traditional 3D display technology. It can flexibly adjust the number of light rays emitted by different pixels in different directions according to the different objects to be displayed, which will significantly improve the user's viewing experience.

[0029] The depth detection algorithm is used to convert Figure 2 The original image to be 3D reconstructed is converted into Figure 3 The depth information map showing the depth information of the object at different positions shown includes a process of three-dimensionally reconstructing the object to be displayed through image processing technology, specifically including: Use high-definition camera equipment or 3D creation software to obtain multi-angle image data of the object to be displayed; Through image segmentation technology, the contour features of objects are extracted from multi-angle image data; Through the depth estimation algorithm, the extracted contour features are reconstructed in three dimensions to obtain the depth information of each position of the object; The depth information of each position of the object is converted into a digital signal that can be used for light control coding algorithm processing.

[0030] The light control coding algorithm generates the corresponding light control effect diagram loaded on the micro-pitch LED display according to the depth information of the display object at different positions obtained by the depth detection algorithm. The effect diagram is vertical black and white stripes with different spacings at different depths. The area where the micro-pitch LED is loaded with white stripes is the light-emitting area, and the diode is in the lit state; the area where the micro-pitch LED is loaded with black stripes is the non-light-emitting area, and the diode is in the off state. The light control coding algorithm sets a column of luminous areas and an adjacent column of non-luminous areas as a group of light control units. The light control coding algorithm is used to accurately control the brightness of each group of light control unit diodes, that is, to control the width of the luminous area and the non-luminous area, and to increase the width of the non-luminous area at a greater depth, thereby forming more viewpoints and increasing the angular resolution. Through the precise dimming of the micro-pitch LEDs, the number of light rays emitted in different directions by different body pixels is adjusted, thereby achieving the effect of optimizing the three-dimensional display.

[0031] The number of viewpoints formed by the light control effect diagram in the viewing area Q The expression is:

[0032] in, k b is the width of the non-luminous area, k s is the width of the luminous area, k p is the size of the sub-pixel, and the number of viewpoints in a unit area is the viewpoint density. The larger the viewpoint density, the higher the corresponding angular resolution.

[0033] The aperture coding algorithm generates a corresponding light flux control image based on the light control effect diagram generated by the light control coding algorithm. The light flux image is a light-transmitting aperture of different radii at different depths. The light flux control image is loaded onto the aperture LCD screen to limit the light flux and luminous angle of the micro-pitch LED. The light-transmitting aperture corresponds to the micro-pitch LEDs lit below. The aperture radius is smaller where the depth is smaller, and the aperture radius is larger where the depth is greater. The effect is as follows: Figure 4 shown.

[0034] The luminous flux image is loaded onto the aperture LCD screen to control the luminous flux and angle of the micro-pitch LED to ensure the consistent viewing angle of the entire coded image. The distance between the virtual light point and the LCD screen can be calculated through the consistent viewing angle. d, the distance between the human eye's viewing position and the LCD screen D It is known that the size of the aperture can be calculated from this t ,like Figure 5 shown.

[0035] When the distance from the sub-pixel on the LCD screen to the edge of the corresponding light control unit meets When x The sub-pixel at the corresponding position of the image; in, X e is the width of the LCD sub-pixel area covered by each group of light control units in the horizontal direction, n is the number of viewpoints, is the interval width corresponding to a single sub-pixel, and the distance from each sub-pixel to the edge of its corresponding light control unit is between [0, X e ) interval.

[0036] Different angular resolutions are created at different display depths, so that different pixels emit different numbers of divergent light, thereby optimizing the final visual smoothness and enhancing the immersiveness of the 3D display. Figure 6 As shown, a comparison diagram of the effects of forming different angular resolutions is shown.

[0037] In particular, the intercepts of the light control units generated in different depth regions are different, and their corresponding coded images should be synthesized according to their corresponding parameters and loaded onto the LCD screen.

[0038] Since the backlight micro-pitch LEDs are not evenly lit in different areas, the 3D light field display system needs to adjust the brightness after generating the 3D image. The specific method is as follows: The generated three-dimensional image is photographed by an industrial camera, and the brightness difference information of each area of ​​the photographed image is obtained; The brightness difference information of each area is identified, and the area with brightness below the threshold is brightened through the LCD display; Targeted area brightening operations include, but are not limited to, increasing the backlight intensity of a local area, adjusting color balance, or applying dynamic lighting compensation techniques, ultimately achieving a highly smooth three-dimensional display image with balanced brightness, smooth colors, and uneven angular resolution.

[0039] The present invention realizes a highly smooth three-dimensional light field display system with adjustable angular resolution and uniform brightness through the coordinated optimization of hardware and software. The system significantly improves the realism and smoothness of three-dimensional images through the precise layout of micro-pitch LED displays, aperture liquid crystal screens and high-resolution LCD screens, as well as the coordinated work of depth detection algorithms, light control coding algorithms, aperture coding algorithms and parallax map synthesis algorithms, providing users with an immersive three-dimensional visual experience. The present invention has broad application prospects in the fields of virtual reality, augmented reality and medical imaging.

[0040] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A three-dimensional light field display system with adjustable angular resolution, characterized in that: include: Hardware part and software part; The hardware part includes micro-pitch LED, aperture LCD screen and LCD screen arranged from the inside to the outside; The micro-pitch LED is used to load the light control effect map, and the light output angle is precisely controlled through the dimming of the aperture LCD screen, and the pixel information from different parallax images on the LCD screen is projected to the corresponding position in the space to form a volume pixel; The aperture LCD screen is used to load the light flux control image and limit the light flux and luminous angle of the micro-pitch LED; The LCD screen is used to load interlaced images; The software part includes depth detection algorithm, light control coding algorithm, aperture coding algorithm and disparity map synthesis algorithm; Depth detection algorithm: It is used to obtain the depth information of different positions of the image to be displayed by capturing and processing multi-angle image data; Light control coding algorithm: used to calculate and generate the corresponding light control effect map according to the depth information, and load the light control effect map onto the micro-pitch LED; Aperture coding algorithm: used to generate the corresponding light flux control image according to the light control effect diagram, and load the light flux control image onto the aperture LCD screen; Disparity map synthesis algorithm: used to synthesize a group of disparity images containing information of different angles into an interlaced image, and load the interlaced image onto the LCD screen.

2. The three-dimensional light field display system with adjustable angular resolution according to claim 1, characterized in that: The micro-pitch LED uses the Micro-LED type, and the aperture LCD screen uses an LCD screen without a color filter.

3. The three-dimensional light field display system with adjustable angular resolution according to claim 1, characterized in that: Installation distance between micro-pitch LED and LCD screen d follow: in, L c It is the width of a single sub-pixel on the LCD screen. Le It is the intercept of the lit area on a row of light control units on the micro-pitch LED backlight source. D is the distance from the viewer to the center of the screen.

4. The three-dimensional light field display system with adjustable angular resolution according to claim 1, characterized in that: The depth detection algorithm includes the process of three-dimensional reconstruction of the object to be displayed through image processing technology, including: Use high-definition camera equipment or 3D creation software to obtain multi-angle image data of the object to be displayed; Through image segmentation technology, the contour features of objects are extracted from multi-angle image data; Through the depth estimation algorithm, the extracted contour features are reconstructed in three dimensions to obtain the depth information of each position of the object; The depth information of each position of the object is converted into a digital signal that can be used for light control coding algorithm processing.

5. The three-dimensional light field display system with adjustable angular resolution according to claim 1, characterized in that: The light control effect diagram generated by the light control coding algorithm is vertical black and white stripes with different spacings at different depths. The area where the micro-pitch LED is loaded with white stripes is the light-emitting area, and the diode is in the lit state; the area where the micro-pitch LED is loaded with black stripes is the non-light-emitting area, and the diode is in the off state. The light control coding algorithm sets a column of luminous areas and an adjacent column of non-luminous areas as a group of light control units. The light control coding algorithm is used to control the brightness of each group of light control unit diodes, control the width of the luminous area and the non-luminous area, and adjust the number of light rays emitted by different pixels in different directions.

6. The three-dimensional light field display system with adjustable angular resolution according to claim 5, characterized in that: The number of viewpoints formed by loading the light control effect map in the viewing area Q The expression is: in, k b is the width of the non-luminous area, k s is the width of the luminous area, k p is the sub-pixel size.

7. The three-dimensional light field display system with adjustable angular resolution according to claim 6, characterized in that: When the distance from the sub-pixel on the LCD screen to the edge of the corresponding light control unit meets When x The sub-pixel at the corresponding position of the image; in, X e is the width of the LCD sub-pixel area covered by each group of light control units in the horizontal direction, n is the number of viewpoints, is the interval width corresponding to a single sub-pixel, and the distance between each sub-pixel and the edge of the corresponding light control unit is between [0, X e ) interval.

8. The three-dimensional light field display system with adjustable angular resolution according to claim 1, characterized in that: The light flux control image generated by the aperture coding algorithm is a transparent aperture of different radii at different depths. The light flux control image is loaded onto the aperture LCD screen to limit the light flux and luminous angle of the micro-pitch LED.

9. The three-dimensional light field display system with adjustable angular resolution according to any one of claims 1 to 8, characterized in that: After the three-dimensional light field display system generates a three-dimensional image, it is also necessary to adjust the light and dark brightness. The specific method is as follows: The generated three-dimensional image is photographed by an industrial camera, and brightness difference information of each area of ​​the photographed image is obtained; The brightness difference information of each area is used to identify the brightness, and the areas with brightness below the threshold are brightened in a targeted manner through the LCD display.

Images