A light field display method and system based on staggered lighting of LEDs

Abstract

The present invention discloses a light field display method and system based on staggered lighting of LEDs, belonging to the technical field of light field display. The method includes the following steps: S1, dividing 3D display content into multi-view image frames; S2, setting a staggered lighting mode of an LED array module according to the multi-view image frames; S3, using a light field encoding method according to the staggered lighting mode, and mapping encoded image data to pixels of an LCD display module through a control circuit module to complete the display of a composite image. The present invention can achieve continuous, low-crosstalk, and large-depth light field display within a large viewing angle range of more than 150°.

Description

Technical Field

[0001] The present invention belongs to the technical field of light field display, and particularly relates to a light field display method and system based on staggered lighting of LEDs. Background Art

[0002] In the technical field of light field display, with the increasing demand for high-quality visual experience, how to achieve light field display with a large viewing angle, low crosstalk, and large depth has become a research hotspot. Traditional light field display technologies have certain limitations in terms of viewing angle range, display depth, and crosstalk control. Traditional structures use lenticular gratings or lens arrays to achieve three-dimensional light field display. A single-layer lenticular grating has significant distortion at the edge of its field of view. To ensure the viewing effect, the viewing angle of a light field display using a single-layer grating is usually less than or equal to 55°, and there is a jump phenomenon between adjacent viewing areas. Using a composite grating can reduce distortion to a certain extent, but its light efficiency is low. The viewing angle of a three-dimensional light field display using a composite grating is usually less than or equal to 110°, and there is also a jump phenomenon between adjacent viewing areas. The existence of multiple viewing areas results in incorrect geometric relationships for viewers located in non-central viewing areas. For applications such as medicine and military that require accurate reproduction of three-dimensional scenes, this defect is unacceptable.

[0003] LEDs have the advantages of self-luminescence, high brightness, high contrast, etc. However, in the application of light field display, how to cooperate with other components to achieve an ideal display effect still needs further exploration. Therefore, it is of great significance to develop a new light field display device and method. Summary of the Invention

[0004] Aiming at the above deficiencies in the prior art, the light field display method and system based on staggered lighting of LEDs provided by the present invention solve the problem of limited viewing angle of traditional display technologies, and successfully increase the viewing angle of the light field display system to more than 150°. The appearance of the jump phenomenon is avoided, and the problem of incorrect geometric relationships for viewers in non-central viewing areas is solved.

[0005] To achieve the above invention purpose, the technical solution adopted by the present invention is: A light field display method based on staggered lighting of LEDs, comprising the following steps:

[0006] S1. Divide the 3D display content into multi-view image frames;

[0007] S2. Set the staggered lighting mode of the LED array module according to the multi-view image frames;

[0008] S3. Use the light field encoding method according to the staggered lighting mode, and map the encoded image data to the pixels of the LCD display module through the control circuit module to complete the display of the synthesized image.

[0009] Further: in S2, based on multi-view image frames, the viewing angle is adjusted by adjusting the number of intervals of the lit LED units through an interleaved lighting pattern, where the viewing angle is specifically expressed as:

[0010]

[0011] In the formula, p is the size of the LED unit, d is the pitch of the LED units, l is the distance between the LED unit and the filter in the LCD display module, n is the number of spaced LED units.

[0012] Further: in S3, the expression of the light field encoding method is specifically:

[0013] Determine the number of viewpoints of the light field display based on LED interleaved lighting After that, divide the interval into sub-intervals, and the width of the sub-interval is . The parallax map information to be filled by the sub-pixels is determined according to the distance D p from the sub-pixel to the left side of the illuminated area of the leftmost LED unit and the distance A p from the sub-pixel to the left side of the illuminated area of the corresponding LED unit below it. Its expression is specifically:

[0014]

[0015]

[0016]

[0017]

[0018]

[0019] In the formula, N is the number of viewpoints, is the i th j column pixel in the k th row, P h is the number of horizontal lines, P v is the number of vertical lines, D p is the distance from a certain sub-pixel to the left side of the illuminated area of the leftmost LED unit, A pis the distance from the sub-pixel to the left side of the illuminated area of the corresponding LED unit below it, d is the sub-interval width, is rounding down, n is the view point number without offset, is the view point number after adding offset according to the LED lighting condition, and % is the remainder calculation.

[0020] A light field display system based on LED interleaved lighting includes:

[0021] The LED array module serves as the backlight source for light field display;

[0022] The LCD display module is used to display the synthesized image after encoding processing;

[0023] The control circuit module is provided with a brightness sensor and has a programmable control function, and is used to control the lighting mode of the LED array module, the brightness of the LED array, and the display content of the LCD display module;

[0024] The light field encoding algorithm module is used to calculate the view point matrix, fill the sub-pixels at the same position of the corresponding disparity images into the synthesized image, and complete the light field encoding.

[0025] Further: The size of the LED unit of the LED array module is less than 0.8 mm, and the unit pitch is less than 0.8 mm.

[0026] Further: The LCD display module is installed in front of the LED array module, the distance between the LCD display module and the LED array module is less than 2 mm, the size of the LCD liquid crystal layer is not less than 24 inches, and the resolution is not less than 2560*1440.

[0027] Further: A microlens array is provided between the LED array module and the LCD display module.

[0028] The beneficial effects of the present invention are: The present invention provides a light field display method and system based on LED interleaved lighting, which has the following advantages compared with the prior art:

[0029] (1) The large viewing angle light field display effect is improved

[0030] Through the interleaved lighting method of the LED array, the emission direction and range of light are precisely controlled. The light field encoding algorithm accurately maps multi-view image data to the LCD pixels according to the lighting pattern of the LED array, achieving continuous, low-crosstalk, and large-depth light field display within a large viewing angle range of 150°+. This combination effectively solves the problem of limited viewing angles in traditional display technologies, avoids the occurrence of jumping phenomena, and solves the problem of incorrect geometric relationships viewed by viewers in non-central viewing areas, greatly enhancing the visual experience of users when viewing at large viewing angles, especially suitable for scenarios where multiple people watch simultaneously, such as medical consultations, large-scale exhibitions, and multi-person shared home theaters.

[0031] (2)Device design and manufacturing cost optimization

[0032] The flexible requirements of the LED array module for unit size and spacing, as well as the optional range of the distance, its own size, and resolution between the LCD display module and the LED array module, give more room for device design and manufacturing. Manufacturers do not have to be limited to specific high-precision and high-cost components and can be flexibly matched according to actual application requirements and cost budgets. For example, in some scenarios where the display effect requirements are not extremely high but cost is sensitive, relatively low-parameter components can be selected, reducing material costs and manufacturing difficulties, improving production efficiency, making this light field display device more competitive in the market, and contributing to its large-scale popularization and application.

[0033] (3)Ambient light adaptive display optimization

[0034] The programmable control function of the control circuit module is the key to realizing ambient light adaptive display. When the lighting conditions change, this module can quickly obtain ambient light information and adjust the brightness and lighting pattern of the LED array according to the preset program. This real-time adjustment ensures that the display content can be presented to users with the best brightness and contrast in different lighting environments, improving the practicality and user-friendliness of the display device, and can be widely applied to various indoor and outdoor places with different lighting environments.

[0035] In summary, the present invention provides a light field display method and system based on LED interleaved lighting, realizing continuous, low-crosstalk, and large-depth light field display within a large viewing angle range of more than 150°. Brief description of the drawings

[0036] Figure 1 It is a flowchart of a light field display method based on LED interleaved lighting of the present invention.

[0037] Figure 2 It is a schematic diagram of the viewpoint numbers and the viewpoint number matrix of the present invention.

[0038] Figure 3Schematic diagram of a light field display system based on staggered lighting of LEDs according to the present invention.

[0039] Figure 4 Schematic diagram of the staggered lighting of LEDs according to the present invention. Detailed implementation manners

[0040] The following describes the detailed implementation manners of the present invention to facilitate those skilled in the art of the present technology to understand the present invention. However, it should be clear that the present invention is not limited to the scope of the detailed implementation manners. For those of ordinary skill in the art of the present technology, as long as various changes are within the spirit and scope of the present invention defined and determined by the appended claims, these changes are obvious, and all inventions and creations using the concept of the present invention are within the scope of protection.

[0041] As Figure 1 shown, in an embodiment of the present invention, a light field display method based on staggered lighting of LEDs includes the following steps:

[0042] S1. Divide the 3D display content into multi-view image frames;

[0043] S2. Set the staggered lighting mode of the LED array module according to the multi-view image frames;

[0044] S3. According to the staggered lighting mode, use the light field encoding method to map the encoded image data to the pixels of the LCD display module through the control circuit module to complete the display of the synthesized image.

[0045] In this embodiment, through the synthesized image displayed by the staggered lighting of the LED array and the LCD display module, a light field display with continuous, low crosstalk, and large depth is provided within a large viewing angle range of 150°+.

[0046] In step S2, based on the multi-view image frames, the viewing angle is adjusted by adjusting the number of intervals of the lit LED units in the staggered lighting mode. Among them, the viewing angle has the following specific expression:

[0047]

[0048] In the formula, p is the size of the LED unit, d is the pitch of the LED units, l is the distance between the LED unit and the filter in the LCD display module, n is the number of spaced LED units.

[0049] In step S3, the specific expression of the light field encoding method is:

[0050] Determine the number of viewpoints of the light field display based on the staggered lighting of LEDs After that, will The interval is evenly divided into sub - intervals, and the width of the sub - interval is . The disparity map information to be filled in the sub - pixels is determined according to the distance from the sub - pixel to the left side of the illuminated area of the left - most LED unit D p and the distance from the sub - pixel to the left side of the illuminated area of the corresponding LED unit below it A p . Its specific expression is:

[0051]

[0052]

[0053]

[0054]

[0055]

[0056] In the formula, N is the number of viewpoints, is the i th row and j th column pixel, and k th sub - pixel among them, P h is the number of horizontal lines, P v is the number of vertical lines, D p is the distance from a certain sub - pixel to the left side of the illuminated area of the left - most LED unit, A p is the distance from the sub - pixel to the left side of the illuminated area of the corresponding LED unit below it, d is the width of the sub - interval, is rounding down, n is the view - point number without offset, is the view - point number with an offset added according to the LED lighting situation, and % is the remainder calculation.

[0057] The mapping relationship between the sub - pixels in the composite image and the sub - pixels in the disparity map is determined by the above formula, and then the view - point matrix is determined. For example, Figure 2As shown, the numbers on the sub-pixels in the LCD display module represent the information of which disparity map should be filled in each sub-pixel; the right side is the view point matrix. The view point matrix records the situation of which disparity map should be loaded for each sub-pixel in the LCD display module, and is essentially a data structure. After calculating the disparity map information that each sub-pixel needs to fill, that is, obtaining the view point number, the complete view point matrix can be obtained. According to this view point matrix, filling the disparity map information into the corresponding sub-pixels completes the light field encoding.

[0058] In this embodiment, the LED array module adopts a Micro-LED array or a Mini-LED array.

[0059] As Figure 3 shown, in this embodiment, a light field display system based on staggered lighting of LEDs includes:

[0060] An LED array module, serving as the backlight source for light field display;

[0061] An LCD display module, used to display the synthesized image after encoding processing;

[0062] A control circuit module, equipped with a brightness sensor, having a programmable control function, used to control the lighting mode of the LED array module, the brightness of the LED array, and the display content of the LCD display module;

[0063] A light field encoding algorithm module, used to calculate the view point matrix, fill the sub-pixels at the same position of the corresponding disparity images into the synthesized image, and complete the light field encoding.

[0064] The LED unit size of the LED array module is less than 0.8 mm, and the unit pitch is less than 0.8 mm.

[0065] As Figure 4 shown, in this embodiment, the LED array module serves as the backlight source for light field display and adopts a staggered lighting method. For example, the lighting rule of staggered lighting method one is: starting from the upper left corner, the first LED unit of the odd rows is lit first, and then the second LED unit is lit every 3 LED units, and so on; the first LED unit of the even rows is lit first, and then the second LED unit is lit every 3 LED units. For example, the lighting rule of staggered lighting method two is: taking the first three rows as an example, the first two LED units of each row are taken. The two LED units of the first row are marked as A and B; the two LED units of the second row are marked as C and D; the LED units of the third row are marked as E and F. C is located on the perpendicular bisector of the line AB, C and D are located on the perpendicular bisector of the line AE, and B and F are located on the perpendicular bisector of the line CD. The lighting methods that satisfy the above geometric relationships are all regarded as the staggered lighting mentioned in the present invention.

[0066] The LCD display module is installed in front of the LED array module. The distance between the LCD display module and the LED array module is less than 2 mm. The size of the LCD liquid crystal layer is not less than 24 inches, and the resolution is not less than 2560*1440.

[0067] A microlens array is arranged between the LED array module and the LCD display module, which is used to further optimize the directivity of light, so as to further enhance the display depth and reduce crosstalk between viewpoints.

[0068] The beneficial effects of the present invention are as follows: The present invention provides a light field display method and system based on staggered lighting of LEDs. Compared with the prior art, it has the following advantages:

[0069] (1) Improvement of large-view-angle light field display effect

[0070] Through the staggered lighting method of the LED array, the emission direction and range of light are precisely controlled. The light field encoding algorithm accurately maps multi-view image data to the LCD pixels according to the lighting pattern of the LED array, realizing continuous, low-crosstalk, and large-depth light field display within a large view angle range of 150°+. This combination effectively solves the problem of limited viewing angles in traditional display technologies, avoids the occurrence of jumping phenomena, and solves the problem of incorrect geometric relationships viewed by viewers in non-central viewing areas, greatly improving the visual experience of users when viewing at large view angles, especially suitable for scenarios where multiple people watch simultaneously, such as medical consultations, large-scale exhibitions, and multi-person shared home theaters.

[0071] (2) Optimization of device design and manufacturing costs

[0072] The flexible requirements of the LED array module for the unit size and spacing, as well as the optional range of the distance between the LCD display module and the LED array module, its own size and resolution, give more choices for device design and manufacturing. Manufacturers do not have to be limited to specific high-precision and high-cost components, and can be flexibly matched according to actual application requirements and cost budgets. For example, in some scenarios where the display effect requirements are not extremely high but cost is sensitive, relatively low-parameter components can be selected, reducing material costs and manufacturing difficulties, improving production efficiency, making the light field display device more competitive in the market, and contributing to its large-scale popularization and application.

[0073] (3) Optimization of ambient light adaptive display

[0074] The programmable control function of the control circuit module is the key to achieving ambient light adaptive display. When the lighting conditions change, it can quickly obtain ambient light information and adjust the brightness of the LED array according to the preset program. This real-time adjustment ensures that the display content can be presented to the user with the best brightness and contrast in different lighting environments, improving the practicality and user-friendliness of the display device, and can be widely applied to various indoor and outdoor places with different lighting environments.

[0075] In summary, the present invention provides a light field display method and system based on staggered lighting of LEDs, which realizes continuous, low crosstalk, and large-depth light field display within a large viewing angle range of more than 150°.

[0076] In the description of the present invention, it should be understood that the orientation or positional relationship indicated by the terms "center", "thickness", "upper", "lower", "horizontal", "top", "bottom", "inner", "outer", "radial", etc. is based on the orientation or positional relationship shown in the drawings, and is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present invention. In addition, the terms "first", "second", and "third" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly specifying the number of technical features. Therefore, the features defined by "first", "second", and "third" may explicitly or implicitly include one or more of such features.

Claims

1. A light field display method based on staggered lighting of LEDs, characterized in that: The following steps are involved: S1, dividing the 3D display content into multi-view image frames; S2, setting a staggered lighting mode of the LED array module according to the multi-view image frame; S3, using a light field coding method according to the staggered lighting mode, mapping the coded image data to pixels of the LCD display module through the control circuit module, and completing the display of the synthesized image; In S3, the expression of the light field encoding method is specifically: Determining the number of viewpoints for a light field display based on staggered LED lighting After that, The interval is divided into subintervals, the width of the subinterval is The disparity map information that the sub-pixel needs to fill is based on the distance from the sub-pixel to the left side of the area illuminated by the leftmost LED unit. D p The distance from the sub-pixel to the left side of the illuminated area of ​​the corresponding LED unit below it A p The specific expression is: In the formula, N is the number of viewpoints, For the i Line j Pixel in column k sub-pixels, P h is the number of horizontal lines, P v is the number of vertical lines, D p is the distance from a sub-pixel to the left side of the illuminated area of ​​the leftmost LED unit. A p The left side distance from the sub-pixel to the illuminated area of ​​the corresponding LED unit below it. d is the subinterval width, To round down, n is the viewpoint number without offset, It is the viewpoint number after adding the offset according to the LED lighting situation, and % is the remainder calculation.

2. The light field display method based on staggered lighting of LEDs according to claim 1, characterized in that: In S2, based on the multi-view image frame, the viewing angle is adjusted by adjusting the number of intervals of the lit LED units in a staggered lighting mode, wherein the viewing angle The specific expression is: In the formula, p is the LED unit size, is the LED unit spacing, l is the distance between the LED unit and the filter in the LCD display module, is the number of interval LED units.

3. A light field display system based on staggered lighting of LEDs, applied to the light field display method based on staggered lighting of LEDs as claimed in any one of claims 1 to 2, characterized in that: The system includes: LED array module, serving as the backlight source for light field display; An LCD display module, used for displaying the encoded composite image; The control circuit module is provided with a brightness sensor and has a programmable control function, and is used to control the lighting mode of the LED array module, the brightness of the LED array, and the display content of the LCD display module; The light field coding algorithm module is used to calculate the viewpoint matrix and fill the sub-pixels at the same position of the corresponding parallax image into the synthetic image to complete the light field coding.

4. The light field display system based on staggered lighting of LEDs according to claim 3, characterized in that: The LED unit size of the LED array module is less than 0.8 mm, and the unit spacing is less than 0.8 mm.

5. The light field display system based on staggered lighting of LEDs according to claim 3, characterized in that: The LCD display module is installed in front of the LED array module. The distance between the LCD display module and the LED array module is less than 2 mm. The size of the LCD liquid crystal layer is not less than 24 inches, and the resolution is not less than 2560*1440.

6. The light field display system based on staggered lighting of LEDs according to claim 3, characterized in that: A microlens array is arranged between the LED array module and the LCD display module.

Images