Method and apparatus for displaying image, display device, storage medium

Abstract

The application aims to provide a method and device for displaying an image, a display device and a storage medium, and relates to the technical field of display. The method for displaying an image comprises the following steps: acquiring an image to be displayed; dividing the image to be displayed into a plurality of first partitions according to a first preset mode and dividing the image to be displayed into a plurality of second partitions according to a second preset mode; the number of the second partitions is greater than or equal to the number of the first partitions; determining an expected backlight brightness of the image to be displayed according to a first backlight value of each first partition and a target light diffusion coefficient of each second partition; one target light diffusion coefficient represents the influence degree of the brightness of each first partition located within a first preset range of one second partition on the second partition; performing pixel compensation on the pixels of the image to be displayed according to the expected backlight brightness, and displaying the image to be displayed after the pixel compensation. In the above manner, the display effect of the image can be improved.

Description

Methods and apparatus for displaying images, display devices, and storage media Technical Field

[0001] This application relates to the field of display technology, and more specifically, to a method and apparatus for displaying images, a display device, and a storage medium. Background Technology

[0002] With the continuous development of science and technology, users have higher expectations for the display effects of display devices. Related technologies typically divide the image to be displayed into zones, convolving the backlight values ​​of different zones with the same set light diffusion function to obtain a backlight image; then, a deep learning model is used to enlarge the backlight image to a set image resolution, and pixel compensation is performed using the enlarged backlight image. However, the above pixel compensation stage does not perform different pixel compensation for dark and bright areas, resulting in poor display effects.

[0003] It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of this application, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0004] In view of this, the present application aims to provide a method and apparatus for displaying images, a display device, and a storage medium to improve the image display effect.

[0005] In a first aspect, embodiments of this application provide a method for displaying an image, comprising: acquiring an image to be displayed; dividing the image to be displayed into multiple first partitions according to a first preset method, and dividing the image to be displayed into multiple second partitions according to a second preset method; the number of second partitions being greater than or equal to the number of first partitions; determining an expected backlight brightness of the image to be displayed based on a first backlight value of each first partition and a target light diffusion coefficient of each second partition; a target light diffusion coefficient representing the degree of influence of the brightness of each first partition within a first preset range of a second partition on that second partition; performing pixel compensation on the pixels of the image to be displayed based on the expected backlight brightness, and displaying the pixel-compensated image to be displayed.

[0006] The expected backlight brightness of the image to be displayed is determined by considering the influence of the brightness of each first zone within a first preset range of the second zone on the second zone. This takes into account the mutual influence of brightness between different first zones, simulating the light diffusion characteristics of a real backlight module. This makes the obtained expected backlight brightness closer to the actual backlight brightness during display, allowing for more accurate pixel compensation when using the expected backlight brightness, resulting in a better display effect for the pixel-compensated image. Furthermore, by simulating the light diffusion characteristics of a real backlight module, the expected backlight brightness may differ between different zones, enabling different pixel compensation for dark and bright areas, further enhancing the display effect of the pixel-compensated image.

[0007] In one embodiment, the target light diffusion coefficient is obtained by performing a lookup operation on the second partition in a preset first storage space to obtain the target light diffusion coefficient corresponding to each second partition; the first storage space stores the correspondence between each second partition and the target light diffusion coefficient.

[0008] By pre-calculating the target light diffusion coefficient for each second partition and storing it in the first storage space, it is not necessary to calculate the target light diffusion coefficient for each second partition for every image to be displayed. This reduces the computational load and the processor's workload, allowing the use of lower-performance processors and saving display device costs. Furthermore, since only one target light diffusion coefficient is determined for each second partition, and the number of stored target light diffusion coefficients is related to the number of second partitions, the number of target light diffusion coefficients that need to be stored can be reduced by adjusting the number of second partitions, thereby saving hardware storage space.

[0009] In one embodiment, the target light diffusion coefficient is determined as follows: For each second partition: a second backlight value of the second partition and a sub-light pattern of a first candidate partition corresponding to the second partition are obtained; the first candidate partition is the first partition located within a second preset range of the second partition; a normalization factor of the first candidate partition is determined based on the sub-light pattern of the first candidate partition and the first backlight value of the second candidate partition corresponding to the first candidate partition; the second candidate partition is the first partition located within a third preset range of the first candidate partition; a sub-light diffusion coefficient corresponding to each normalization factor is obtained by calculating with the second backlight value of the second partition using a preset algorithm; the target light diffusion coefficient of the second partition is the set of the sub-light diffusion coefficients of the second partition.

[0010] This embodiment of the application takes into account that the brightness of the first zone located within the second preset range of the second partition will affect the second partition. The sub-light pattern diagram of the first partition can reflect which other first zones located within the third preset range of the first partition will affect the second partition. By combining the first backlight values ​​of each first zone that will affect the second partition, the target light diffusion coefficient of the second partition can be calculated. This allows the target light diffusion coefficient to more accurately reflect the brightness impact on the second partition, thus making the simulated expected backlight brightness based on the target light diffusion coefficient more closely match the actual displayed backlight brightness.

[0011] In one embodiment, determining the normalization factor of the first candidate partition based on the sub-light pattern of the first candidate partition and the first backlight value of the second candidate partition corresponding to the first candidate partition includes: for each first candidate partition: adjusting the first backlight value of each second candidate partition corresponding to the first candidate partition based on the sub-light pattern of the first candidate partition; and determining the sum of the adjusted first backlight values ​​of each second candidate partition as the normalization factor of the first candidate partition.

[0012] This embodiment of the application takes into account that the brightness illumination range of LED beads varies depending on their location. For example, the brightness illumination of an LED bead located on the left edge of the display screen is mainly on the right side of the LED bead. The sub-light pattern diagram of the first candidate zone can accurately reflect which second candidate zones can affect the second zone. By adjusting the first backlight value of each corresponding second candidate zone through the sub-light pattern diagram, second candidate zones with little or no impact on the second zone can be ignored during the calculation process. This allows the final sub-light diffusion coefficient to more accurately reflect the brightness impact on the second zone, and thus the expected backlight brightness simulated based on the target light diffusion coefficient more closely matches the actual displayed backlight brightness.

[0013] In one embodiment, adjusting the first backlight value of each of the second candidate partitions corresponding to the first candidate partition based on the sub-light pattern of the first candidate partition includes: performing a lookup operation on the sub-light pattern in a preset second storage space to obtain the position of the partition to be modified corresponding to the sub-light pattern; storing the correspondence between the sub-light pattern and the position of the partition to be modified in the second storage space; and finding and modifying the value of the first backlight value of the second candidate partition corresponding to the position of the partition to be modified to a set backlight value.

[0014] By pre-storing the correspondence between the sub-light pattern diagram and the location of the partition to be modified in the second storage space, and modifying the value of the second candidate partition by searching during use, the efficiency of determining the second candidate partition that has little or no impact on the second partition can be improved.

[0015] In one embodiment, the first backlight value of each first partition is obtained by the following method: for each first partition: obtain the brightness value corresponding to each pixel in the first partition; determine the candidate backlight value of the first partition according to each brightness value; correct each candidate backlight value to obtain the first backlight value of each first partition.

[0016] This application takes into account that the brightness value of each pixel in the actual displayed image deviates to a certain extent from the brightness value perceived by the human eye. By correcting the alternative backlight values, the brightness of the image presented by the display device can be made more consistent with the brightness changes perceived by the human eye, thereby improving viewing comfort.

[0017] In one embodiment, correcting the candidate backlight value includes: obtaining an average brightness value and a maximum brightness value; the average brightness value is the average of all brightness values; the maximum brightness value is the maximum of all brightness values; determining a correction value based on the average brightness value and the maximum brightness value; and correcting the candidate backlight value using the correction value.

[0018] The candidate backlight value is corrected by using the correction value determined by the average brightness and the maximum brightness. The backlight value can be adjusted according to the image content of the image to be displayed so that it is neither too bright nor too dark.

[0019] In one embodiment, correcting the candidate backlight value includes: spatially filtering the candidate backlight value.

[0020] By spatially filtering the candidate backlight values, the brightness abrupt changes between adjacent backlight zones can be smoothed, making the image backlight uniform.

[0021] In one embodiment, correcting the candidate backlight value includes: obtaining a first pixel statistical histogram of the previous frame of the image to be displayed and a second pixel statistical histogram of the image to be displayed; determining whether the scene has changed based on the first pixel statistical histogram and the second pixel statistical histogram; and performing time filtering on the candidate backlight value if the scene has not changed.

[0022] This application takes into account that, since the human eye is sensitive to flicker, changes in backlight between multiple frames during video streaming are easily noticeable to the user. Therefore, this application uses temporal filtering to smooth out backlight flicker that may occur between multiple frames of the video stream. Simultaneously, this application does not perform temporal filtering when the scene changes, thus reducing erroneous frames caused by temporal filtering.

[0023] In one embodiment, a target light diffusion coefficient includes multiple sub-light diffusion coefficients; determining the expected backlight brightness of the image to be displayed based on the first backlight value of each first partition and the target light diffusion coefficient of each second partition includes: for each second partition: using each sub-light diffusion coefficient corresponding to the second partition as a convolution coefficient; convolving the convolution coefficient with the first backlight value of the first partition in which the second partition is located to obtain the simulated backlight brightness of the second partition; enlarging the backlight image to a preset resolution to obtain an expected backlight distribution image; the backlight image is an image displaying the simulated backlight brightness of all second partitions; the preset resolution is the resolution of the image to be displayed; the brightness of each pixel in the expected backlight distribution image is the expected backlight brightness of the image to be displayed.

[0024] By magnifying the backlight image to the resolution of the image to be displayed, each backlight point in the magnified backlight image can correspond one-to-one with a pixel in the image to be displayed, making it easy to obtain the expected backlight brightness corresponding to each pixel.

[0025] In one embodiment, pixel compensation of the pixels of the image to be displayed based on the expected backlight brightness includes: for each pixel of the image to be displayed: in a preset third storage space, performing a lookup operation on the maximum value of the RGB channel of the pixel and the expected backlight brightness corresponding to the pixel to obtain a compensation value for the pixel; the third storage space stores the correspondence between the maximum value of the RGB channel, the expected backlight brightness corresponding to a single pixel, and the compensation value; and using the compensation value to compensate the pixel.

[0026] By pre-storing the correspondence between the maximum values ​​of the RGB channels, the expected backlight brightness for a single pixel, and the compensation value in a third storage space, the compensation process for each pixel only requires looking up the corresponding pixel's compensation value, eliminating the need to calculate the compensation value for each pixel sequentially. This omits the calculation steps and reduces the processor's workload. Furthermore, by incorporating the expected backlight brightness into the compensation for each pixel, the image to be displayed can remain consistent with the original image even when the backlight is reduced, thus enhancing the dynamic contrast of the display device.

[0027] In one embodiment, pixel compensation of the pixels of the image to be displayed based on the expected backlight brightness includes: for each pixel of the image to be displayed: calculating the expected backlight brightness corresponding to the pixel divided by a set display brightness to obtain a candidate compensation value; if the candidate compensation value is less than or equal to the set compensation value, compensating the pixel using the candidate compensation value; if the candidate compensation value is greater than the set compensation value, compensating the pixel using the set compensation value.

[0028] Thus, errors can occur in calculating the backlight value, spatial filtering the backlight value, temporal filtering the backlight value, and calculating the simulated backlight brightness using convolution coefficients. These errors can lead to inaccurate final expected backlight brightness, resulting in a very large calculated alternative compensation value. This causes the compensated pixels to exceed the maximum bit width and be clipped, meaning that highlights in the displayed image may exhibit color distortion or loss of detail. By pre-setting a compensation value to limit the alternative compensation value from exceeding this value, the loss of highlight detail in the displayed image can be prevented.

[0029] In one embodiment, the method for displaying an image further includes: performing backlight control according to each of the first backlight values.

[0030] Considering that the first backlight value is involved in the pixel compensation of the image to be displayed, backlight control is performed according to each first backlight value. The backlight effect after backlight control can complement the pixel-compensated image to be displayed, resulting in a better overall image display effect.

[0031] Secondly, embodiments of this application provide an image display apparatus, comprising: an acquisition module for acquiring an image to be displayed; a partitioning module for dividing the image to be displayed into multiple first partitions according to a first preset method, and dividing the image to be displayed into multiple second partitions according to a second preset method; wherein the number of second partitions is greater than or equal to the number of first partitions; a determination module for determining an expected backlight brightness of the image to be displayed based on a first backlight value of each first partition and a target light diffusion coefficient of each second partition; wherein a target light diffusion coefficient characterizes the degree of influence of the brightness of each first partition within a first preset range of a second partition on that second partition; and a display module for performing pixel compensation on the pixels of the image to be displayed based on the expected backlight brightness, and displaying the pixel-compensated image to be displayed.

[0032] Thirdly, embodiments of this application provide a display device, including a processor and a memory, wherein the memory stores computer-executable instructions that can be executed by the processor, and the processor executes the computer-executable instructions to implement the above-described method for displaying images.

[0033] Fourthly, embodiments of this application provide a storage medium storing computer-executable instructions. When the computer-executable instructions are invoked and executed by a processor, the computer-executable instructions cause the processor to implement the above-described method for displaying images. Attached Figure Description

[0034] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments of this application will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0035] Figure 1 is a schematic diagram of a method for displaying an image provided in an embodiment of this application;

[0036] Figure 2 is a schematic diagram of the mapping function curve for calculating the correction value provided in the embodiment of this application;

[0037] Figure 3 is a schematic diagram of an image undergoing time filtering when the scene changes according to an embodiment of this application;

[0038] Figure 4 is a schematic diagram of an image without time filtering when the scene changes according to an embodiment of this application;

[0039] Figure 5 is a schematic diagram of a backlight control method provided in an embodiment of this application;

[0040] Figure 6 is a schematic diagram of a light pattern brightness distribution provided in an embodiment of this application;

[0041] Figure 7 is a schematic diagram of a backlight simulation comparison diagram provided in an embodiment of this application;

[0042] Figure 8 is a schematic diagram of a backlight simulation method provided in an embodiment of this application;

[0043] Figure 9 is a schematic diagram of a pixel compensation comparison diagram provided in an embodiment of this application;

[0044] Figure 10 is a schematic diagram of a 2D LUT provided in an embodiment of this application;

[0045] Figure 11 is a schematic diagram of another 2D LUT provided in an embodiment of this application;

[0046] Figure 12 is a schematic diagram of another backlight simulation method provided in an embodiment of this application;

[0047] Figure 13 is a schematic diagram of an image display device provided in an embodiment of this application;

[0048] Figure 14 is a schematic diagram of the application of a display device provided in an embodiment of this application.

[0049] Icons: Get module 1; Partition module 2; Confirm module 3; Display module 4; Error frame 5. Detailed Implementation

[0050] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to limit this application.

[0051] The following explanations are provided for some of the technical terms appearing in this application:

[0052] LCD: Liquid Crystal Display.

[0053] LED: light-emitting diode, a component of the backlight of a liquid crystal display.

[0054] LUT: look-up table, is a data mapping method commonly used in hardware. It typically stores the output of complex calculations as LUTs in hardware, which can simplify hardware implementation and enable fast computation.

[0055] IIR: Infinite Impulse Response.

[0056] RGB: A color mode that represents the colors of the three channels: red, green, and blue.

[0057] Example 1

[0058] Please refer to Figure 1, which is a flowchart of a method for displaying an image provided in an embodiment of this application, including:

[0059] S101, Obtain the image to be displayed.

[0060] In some embodiments, the image to be displayed can be an image passed to the display device awaiting display. For example, the image can be sent to the display device by another electronic device, or it can be uploaded to the display device by a user.

[0061] Display devices are electronic devices with screens, such as computers, smartphones, and televisions.

[0062] The video includes multiple frames of images, and the video to be played can also be transmitted to a display device, where each frame of the video is used as an image to be displayed.

[0063] S102, the image to be displayed is divided into multiple first partitions according to the first preset method, and the image to be displayed is divided into multiple second partitions according to the second preset method.

[0064] The number of second partitions is greater than or equal to the number of first partitions.

[0065] The preset method refers to the way and number of partitions into which the image to be displayed is divided. For example, it can be divided into a set number of partitions evenly, or into a set number of partitions according to a set shape. The shape can be set, for example, a square or a rectangle.

[0066] For example, the image to be displayed is divided into M×N first partitions according to a first preset method, and into H×V second partitions according to a second preset method. Here, M represents the number of columns in the first partition of the image to be displayed, N represents the number of rows in the first partition of the image to be displayed, H represents the number of columns in the second partition of the image to be displayed, and V represents the number of rows in the second partition of the image to be displayed. The first and second preset methods can be the same, and the number of first and second partitions can also be the same, i.e., M×N = H×V.

[0067] Optionally, when the first preset method and the second preset method are the same, and the number of rows in the first partition and the number of rows in the second partition are the same, and the number of columns in the first partition and the number of columns in the second partition are the same, only one partitioning operation needs to be performed. That is, when the first preset method and the second preset method are the same, and the value of M equals the value of H, and the value of N equals the value of V, only one partitioning operation needs to be performed.

[0068] S103, determine the expected backlight brightness of the image to be displayed based on the first backlight value of each first zone and the target light diffusion coefficient of each second zone.

[0069] Each first zone corresponds to a first backlight value. Each second zone corresponds to a target light diffusion coefficient. A target light diffusion coefficient represents the degree to which the brightness of each first zone within a first preset range affects the second zone.

[0070] For example, the first preset range can be the range in which the brightness of a first zone can affect other first zones. The first preset range, for example, is an 8×8 first zone centered on the first zone where the second zone is located.

[0071] In some embodiments, the first backlight value of each first partition is obtained as follows: For each first partition: obtain the brightness value corresponding to each pixel in the first partition; determine the candidate backlight value of the first partition based on each brightness value; correct each candidate backlight value to obtain the first backlight value of each first partition.

[0072] The brightness value corresponding to a pixel can be the maximum value of the pixel's RGB channels.

[0073] In one optional embodiment of the above, determining the candidate backlight value of the first zone based on each brightness value can be done by calculating the average value of each brightness value as the candidate backlight value.

[0074] In another alternative embodiment described above, determining the candidate backlight value for the first zone based on each brightness value can be done by using the median of each brightness value as the candidate backlight value.

[0075] In one optional embodiment described above, correcting the candidate backlight value may involve: obtaining an average brightness value and a maximum brightness value; determining a correction value based on the average brightness value and the maximum brightness value; and correcting the candidate backlight value using the correction value. The average brightness value is the average of all brightness values; the maximum brightness value is the maximum of all brightness values.

[0076] In the above optional methods, determining the correction value based on the average and maximum brightness can be achieved by searching for the average and maximum brightness values ​​in a preset fourth storage space to obtain the correction value that corresponds to both the average and maximum brightness values. The fourth storage space stores the correspondence between the average brightness value, the maximum brightness value, and the correction value. In this way, by pre-determining the correction value based on the average and maximum brightness values ​​and storing the relationship between them in the fourth storage space, the correction value can be directly obtained by searching when correcting alternative backlight values ​​later, without needing to recalculate the correction value for each first partition, thus simplifying hardware design.

[0077] For example, it can be calculated The correction value is obtained, and the correspondence between the average brightness, the maximum brightness, and the correction value is stored in the fourth storage space. Here, `correction` is the correction value, and `Diff` is the difference between the average brightness and the maximum brightness. `n` represents n gray levels. Referring to Figure 2, which is a schematic diagram of the mapping function curve for calculating the correction value, the horizontal axis `Input` represents the input, i.e., `Diff`, and the vertical axis `Onput` represents the output, i.e., `correction`.

[0078] In the above optional methods, the correction value can be used to correct the candidate backlight value by calculating the sum of the candidate backlight value and the correction value.

[0079] For example, BL can be calculated as Ave + correction to obtain the first backlight value of the first zone. Here, BL is the first backlight value, and Ave is the average brightness value.

[0080] In another optional embodiment described above, the modification of the candidate backlight value can be achieved by spatial filtering the candidate backlight value.

[0081] For example, a 3×3 spatial filter can be applied to the candidate backlight values. The filtering mode can be Gaussian filtering or maximum value filtering. Specifically, when using Gaussian filtering, the normalized Gaussian function value of the 3x3 partition is used as the corrected backlight value. When using maximum value filtering, the maximum candidate backlight value within the 3x3 partition is subtracted from a threshold to obtain the corrected backlight value. In this way, spatial filtering can smooth out abrupt brightness changes between adjacent partitions, resulting in uniform backlighting in the image to be displayed. Furthermore, the 3×3 spatial filtering can mitigate potential blockiness at the edges of each partition in the image to be displayed. Additionally, when using maximum value filtering, it can reduce the possibility of the filtered backlight value being too small, causing the image to be too dark.

[0082] In another optional embodiment described above, the modification of the candidate backlight value may be achieved by: obtaining the first pixel statistical histogram of the previous frame of the image to be displayed and the second pixel statistical histogram of the image to be displayed; determining whether the scene has changed based on the first pixel statistical histogram and the second pixel statistical histogram; and performing time filtering on the candidate backlight value if the scene has not changed.

[0083] For example, during the processing of the previous frame image, the first pixel statistical histogram of the previous frame image can be obtained and stored. Then, during the processing of the image to be displayed, the stored first pixel statistical histogram can be directly called, and the second pixel statistical histogram of the image to be displayed can be obtained and stored for use in the next frame image.

[0084] Referring to Figures 3 and 4, the figures show three images: the previous frame, the current frame, and the next frame. As can be seen, when the scene in the previous frame is darker than the scene in the current frame, temporal filtering may result in error frame 5. However, when the scene changes, not performing temporal filtering eliminates the error frame. Therefore, this application, by accurately determining whether the scene has changed and thus deciding whether to perform temporal filtering, reduces the probability of error frames and improves the image display effect.

[0085] For example, for the previous frame image and the image to be displayed, a pixel statistical histogram can be obtained using H(i) = H(i) + 1 | max(r,g,b) ∈ [i,i+1). Here, H(i) is the histogram, i is divided into 64 bins (intervals), and max(r,g,b) is the maximum value of the RGB channels of the pixel.

[0086] In the above optional methods, determining whether the scene has changed based on the first pixel statistical histogram and the second pixel statistical histogram can be achieved by calculating the similarity between the first pixel statistical histogram and the second pixel statistical histogram. If the similarity is greater than or equal to a preset similarity, it is confirmed that the scene has not changed. If the similarity is less than the preset similarity, it is confirmed that the scene has changed. Related technologies typically determine whether the scene of two images has changed based on the average brightness of the two images. However, since a night scene image with alternating light and dark areas may have the same average backlight brightness as a daytime scene with moderate brightness, the accuracy of methods for determining scene changes in related technologies is low. This application uses pixel statistical histograms to reflect the distribution probability of image grayscale values, which can alleviate misjudgments caused by the similarity of average backlight brightness in the two images.

[0087] For example, this can be achieved by d(H1,H2)=∑ I The function `min(H1(i),H2(i))` calculates the similarity between two pixel histograms. Here, `d(H1,H2)` represents the similarity between the two pixel histograms, where `H1` is the first pixel histogram of the previous frame, and `H2` is the second pixel histogram of the image to be displayed.

[0088] In the above optional methods, time filtering of the candidate backlight value can be performed by: obtaining the historical backlight value corresponding to the candidate backlight value; calculating BL = R * BL. n +(1-R)*BL n-1 Where R is the preset weight, BL n As an alternative backlight value, BL n-1 The * represents the historical backlight value corresponding to the candidate backlight value, and * indicates multiplication. Since the human eye is sensitive to flicker, backlight changes between multiple frames during video playback are easily noticeable to the user. By using IIR (Internal Reflection) to perform time filtering on the candidate backlight value, backlight flicker that may occur between multiple frames of the video stream can be smoothed out.

[0089] Considering that the images displayed on the same display device have the same resolution, the previous frame image is also divided into multiple first partitions according to a first preset method. The positions of the first partitions in the previous frame image correspond one-to-one with the positions of the first partitions in the image to be displayed. The first partition in the previous frame image that is in the same position as the candidate backlight value is found, and the first backlight value of the first partition with the same position is used as the historical backlight value corresponding to the candidate backlight value.

[0090] The preset weights can be fixed weights. Alternatively, the preset weights can be calculated by R = min(1, T + |P|). n -P n-1 |) to obtain. Where T is the preset filtering coefficient, P nP is the normalized value of the average backlight value of the image to be displayed. n-1 This is a normalized value of the average backlight value from the previous frame. By setting a fixed weight, the display device doesn't need to update the weight for each frame based on changes between two frames, reducing processor computation and hardware costs. Updating the weight using the average backlight value of the image to be displayed and the average backlight value of the previous frame allows for a comprehensive analysis of brightness changes between the two frames, mitigating frame errors caused by scene changes to some extent.

[0091] For example, for each first partition, a candidate backlight value can be calculated, the candidate backlight values ​​of each first partition are normalized to between 0 and 1, and the average value of the normalized candidate backlight values ​​is calculated as the normalized value of the average backlight value.

[0092] Optionally, the three correction methods described above can be used in combination, provided there are no conflicts. For example: First, calculate the candidate backlight values ​​for each first zone. Then, obtain the average and maximum brightness values ​​of the first zone corresponding to each candidate backlight value, and determine the correction value corresponding to each candidate backlight value based on the average and maximum brightness values. Calculate the sum of each candidate backlight value and its corresponding correction value to obtain each backlight value to be calculated. Perform spatial filtering on each backlight value to obtain a spatially filtered backlight value. Perform temporal filtering on each spatially filtered backlight value to obtain the first backlight value for each first zone.

[0093] In some embodiments, the method of displaying an image further includes: backlight control according to each first backlight value.

[0094] For example, each first backlight value is sent to the LED controller of the display device, triggering the LED controller to control the LED beads according to each first backlight value.

[0095] For example, referring to Figure 5, which is a flowchart of a backlight control method provided in an embodiment of this application, including:

[0096] S201, Obtain the image to be displayed, and then execute step S202.

[0097] S202, the image to be displayed is divided into multiple first partitions according to the first preset method, and then step S203 is executed.

[0098] S203, for each first partition: obtain the average brightness and maximum brightness of the first partition; search for the average brightness and maximum brightness in the preset fourth storage space to obtain the correction value corresponding to the average brightness and maximum brightness; calculate the sum of the correction value and the average brightness of the first partition to obtain the backlight value to be calculated, and then execute step S204.

[0099] S204, Spatial filtering is performed on each backlight value to be calculated to obtain the spatially filtered backlight value, and then step S205 is executed.

[0100] S205, determine whether the scene of the previous frame image and the image to be displayed has changed; if the scene has not changed, proceed to step S206; if the scene has changed, proceed to step S207.

[0101] S206, perform time filtering on each spatial filter backlight value to obtain the first backlight value of each first partition, and then execute step S208.

[0102] S207, use the spatial filter backlight value as the first backlight value of each first partition, and then execute step S208.

[0103] S208, send the first backlight value of each first zone to the LED controller, triggering the LED controller to light up the LED beads according to each first backlight value.

[0104] In this way, the correction value is determined by the difference between the average brightness and the maximum brightness. This correction value is then used to perform the first correction on the backlight value, reducing the brightness differences between backlight values ​​after the initial correction. Spatial filtering of the corrected backlight value smooths out abrupt brightness changes between adjacent zones, resulting in uniform image backlighting. Temporal filtering of the spatially filtered backlight value smooths out backlight flickering that may occur between multiple frames of the video stream. Finally, using the backlight values ​​corrected using these three methods for backlight control improves the image display effect.

[0105] In some embodiments, the target light diffusion coefficient of each second partition is determined as follows: For each second partition: a second backlight value of the second partition and a sub-light pattern of the corresponding first candidate partition are obtained; a normalization factor of the first candidate partition is determined based on the sub-light pattern of the first candidate partition and the first backlight value of the corresponding second candidate partition; a sub-light diffusion coefficient corresponding to each normalization factor is obtained by calculating with the second backlight value of the second partition using a preset algorithm; the target light diffusion coefficient of the second partition is the set of sub-light diffusion coefficients of the second partition. Wherein, the first candidate partition is a first partition located within a second preset range of the second partition. The second candidate partition is a first partition located within a third preset range of the first candidate partition.

[0106] Referring to Figure 6, for each backlight module, four light pattern brightness distribution maps can be captured using a professional industrial array camera. These are the upper left partition light pattern, the left center partition light pattern, the upper center partition light pattern, and the center partition light pattern. The brightness distribution map is referred to as the light pattern map. The light pattern map of the first candidate partition is used as the sub-light pattern map of that first candidate partition. As can be seen from the light pattern maps, the range affected by brightness differs in different light pattern maps. Adjusting the first backlight value of the second candidate partition using the light pattern map allows the final determined normalization factor to better match the actual display situation. Furthermore, the method for obtaining the second backlight value of the second partition is similar to that of the first partition, and will not be repeated here.

[0107] In one optional embodiment of the above, determining the normalization factor of the first candidate partition based on the sub-light pattern of the first candidate partition and the first backlight value of the second candidate partition corresponding to the first candidate partition may be as follows: for each first candidate partition: adjust the first backlight value of each second candidate partition corresponding to the first candidate partition according to the sub-light pattern of the first candidate partition; and determine the sum of the adjusted first backlight values ​​of each second candidate partition as the normalization factor of the first candidate partition.

[0108] In the above optional method, adjusting the first backlight value of each second candidate partition corresponding to the first candidate partition based on the sub-light pattern diagram of the first candidate partition can be achieved by: performing a lookup operation on the sub-light pattern diagram in a preset second storage space to obtain the location of the partition to be modified corresponding to the sub-light pattern diagram; and finding and modifying the value of the first backlight value of the second candidate partition corresponding to the location of the partition to be modified to a set backlight value. The second storage space stores the correspondence between the sub-light pattern diagram and the location of the partition to be modified.

[0109] The backlight value can be set, for example, to 0. By setting the backlight value to 0, it can be shown that the second candidate zone does not produce backlight brightness. Therefore, the second candidate zone, which does not actually affect the brightness of the first candidate zone, is excluded from the normalization factor calculation.

[0110] The location of the partition to be modified can be directional, such as the three second alternative partitions to the left of the first alternative partition, or the three second alternative partitions above the first alternative partition. If the location of the partition to be modified is the three second alternative partitions to the right of the first alternative partition, then the three consecutive second alternative partitions that are in the same row as the first alternative partition, adjacent to the first alternative partition, and located to the right of the first alternative partition correspond to the location of the partition to be modified.

[0111] In the above optional method, adjusting the first backlight value of each second alternative partition corresponding to the first alternative partition according to the sub-light pattern of the first alternative partition can be: inputting the sub-light pattern of the first alternative partition, the position of each second alternative partition corresponding to the first alternative partition, and the first backlight value of each second alternative partition corresponding to the first alternative partition into a preset backlight value adjustment model to obtain the adjusted first backlight value of each second alternative partition corresponding to the first alternative partition.

[0112] This can be achieved by acquiring multiple sets of first training data, inputting them into a preset first neural network model for training, and obtaining a backlight value adjustment model. Each set of first training data includes: a sub-light pattern map of the first candidate partition of the sample, the position of the second candidate partition of the first candidate partition of the sample, the sample backlight value of the second candidate partition of the first partition of the sample, and the adjusted sample backlight value label of each second candidate partition.

[0113] In the above optional method, the sub-light diffusion coefficient corresponding to each normalization factor is obtained by calculating the second backlight value of the second partition according to the preset algorithm using each normalization factor. This can be done by: for each normalization factor, calculating the second backlight value of the second partition divided by the normalization factor to obtain the sub-light diffusion coefficient corresponding to the normalization factor.

[0114] In another optional embodiment described above, determining the normalization factor of the first candidate partition based on the sub-light pattern of the first candidate partition and the first backlight value of the second candidate partition corresponding to the first candidate partition can be achieved by inputting the sub-light pattern of the first candidate partition, the position of each second candidate partition corresponding to the first candidate partition, and the first backlight value of each second candidate partition corresponding to the first candidate partition into a preset normalization factor determination model to obtain the normalization factor corresponding to the first candidate partition.

[0115] This can be achieved by acquiring multiple sets of second training data, inputting them into a pre-defined second neural network model for training, and obtaining a normalization factor determination model. Each set of second training data includes: a sub-light pattern map of the first candidate partition of the sample, the location of the second candidate partition of the first candidate partition of the sample, the sample backlight value of the second candidate partition of the first partition of the sample, and the normalization factor label of the first candidate partition of the sample.

[0116] In other embodiments, the target light diffusion coefficient of each second partition is obtained by performing a table lookup operation on the second partition in a preset first storage space to obtain the target light diffusion coefficient corresponding to each second partition. The first storage space stores the correspondence between each second partition and the target light diffusion coefficient.

[0117] In the above embodiments, the target light diffusion coefficient can be stored in the following way: displaying a sample image; dividing the image to be displayed into multiple third partitions according to a second preset method. The number of third partitions is the same as the number of second partitions. For each third partition: obtaining the third backlight value of the third partition and the sub-light pattern diagram of the corresponding third candidate partition; the third candidate partition is a first partition located within a second preset range of the third partition; determining the normalization factor of the third candidate partition based on the sub-light pattern diagram of the third candidate partition and the first backlight value of the corresponding fourth candidate partition; the fourth candidate partition is a first partition located within a third preset range of the third candidate partition; calculating the sub-light diffusion coefficient corresponding to each normalization factor using a preset algorithm with the third backlight value of the third partition; the target light diffusion coefficient of the third partition is the set of all sub-light diffusion coefficients of the third partition. The position of the third partition and the target light diffusion coefficient of the third partition are stored in a first storage space.

[0118] The sample image can be an image received before the image to be displayed. For example, an image displayed during the debugging of a display device. Another example is a light pattern image.

[0119] Since the third partition is divided in the same way and in the same number as the second partition, there is essentially a one-to-one correspondence between the third and second partitions. The target light diffusion coefficient of the third partition, which is located in the same position as the second partition, can be used as the target light diffusion coefficient of the second partition. Thus, by pre-setting sample images to calculate the target light diffusion coefficient of each third partition, the corresponding target light diffusion coefficient of the second partition can be directly looked up when processing the image to be displayed. This eliminates the need for calculation during the image processing, reducing the processor's computational load and accelerating the processing speed of the image to be displayed.

[0120] For example, an image to be displayed is acquired, and the image is divided into M×N first partitions, and the first backlight value of each first partition is acquired. Then, the image to be displayed is divided into H×V second partitions. For each second partition: based on the coordinates of the second partition, 8×8 first partitions surrounding the second partition are selected as first candidate partitions, and the normalization factor of each first candidate partition for the second partition is calculated; the second backlight value of the second partition is divided by the normalization factor to obtain the sub-light diffusion coefficient corresponding to the normalization factor. Specifically, for the 8×8 first candidate partitions: the sub-light pattern of the first candidate partition is acquired, and based on the coordinates of the first candidate partition, 8×8 first partitions surrounding the first candidate partition are selected as second candidate partitions; the first backlight values ​​of the 8×8 second candidate partitions surrounding the first candidate partition are adjusted according to the sub-light pattern of the first candidate partition; the sum of the adjusted first backlight values ​​of each second candidate partition is determined as the normalization factor of the first candidate partition. Thus, by repeating the calculation for all second partitions, the target light diffusion coefficients corresponding to each of the second partitions can be obtained. Referring to Figure 7, backlight simulation using the sub-light diffusion coefficients obtained by the method of this application produces a smoother backlight compared to simulations directly using a Gaussian function.

[0121] In some embodiments, assuming there are multiple first partitions within the second preset range of the second partition, each second partition corresponds to multiple first candidate partitions, and thus each second partition corresponds to multiple normalization factors, enabling the calculation of multiple sub-light diffusion coefficients. In this case, a target light diffusion coefficient includes multiple sub-light diffusion coefficients. Step S103 may include: for each second partition: using the sub-light diffusion coefficients corresponding to the second partition as convolution coefficients; convolving the convolution coefficients with the first backlight value of the first partition where the second partition is located to obtain the simulated backlight brightness of the second partition; enlarging the backlight image to a preset resolution to obtain a desired backlight distribution image; the backlight image is an image displaying the simulated backlight brightness of all second partitions; the preset resolution is the resolution of the image to be displayed; the brightness of each pixel in the desired backlight distribution image is the desired backlight brightness of the image to be displayed. Thus, by convolving the sub-light diffusion coefficients of the second partition with the first backlight value of the first partition where the second partition is located, an H×V backlight image can be obtained. Enlarging the H×V backlight image to the resolution of the image to be displayed allows the pixels of the expected backlight distribution image to correspond one-to-one with the pixels of the image to be displayed, facilitating pixel compensation of the image to be displayed.

[0122] In other embodiments, assuming that there is only one first partition within the second preset range of the second partition, each second partition corresponds to a first candidate partition, and thus each second partition corresponds to a normalization factor, which can be used to calculate a sub-light diffusion coefficient. In this case, a target light diffusion coefficient includes a sub-light diffusion coefficient. Step S103 may include: for each second partition: using the sub-light diffusion coefficient corresponding to the second partition as a convolution coefficient; convolving the convolution coefficient with the first backlight value of the first partition in which the second partition is located to obtain the simulated backlight brightness of the second partition; enlarging the backlight image to a preset resolution to obtain a expected backlight distribution image; the backlight image is an image displaying the simulated backlight brightness of all second partitions; the preset resolution is the resolution of the image to be displayed; the brightness of each pixel in the expected backlight distribution image is the expected backlight brightness of the image to be displayed.

[0123] For example, the backlight image can be magnified to the resolution of the image to be displayed using bilinear interpolation. Thus, since deep learning models are computationally complex, the method of magnifying the backlight image to the resolution of the image to be displayed using this application is computationally simpler than the method of magnifying the backlight image to a set image resolution using a deep learning model, and can reduce hardware configuration requirements.

[0124] For example, referring to Figure 8, which is a flowchart of a backlight simulation method provided in an embodiment of this application, including:

[0125] S301, Obtain the image to be displayed.

[0126] S302, the image to be displayed is divided into multiple second partitions according to the second preset method.

[0127] S303, in the preset first storage space, perform a table lookup operation on the second partition to obtain the target light diffusion coefficient corresponding to each second partition; a target light diffusion coefficient includes multiple sub-light diffusion coefficients.

[0128] S304, for each second partition: use the sub-light diffusion coefficients corresponding to the second partition as convolution coefficients; use the convolution coefficients to convolve with the first backlight value of the first partition in which the second partition is located to obtain the simulated backlight brightness of the second partition.

[0129] S305, magnify the backlight image to a preset resolution to obtain the expected backlight distribution image; the brightness of each pixel in the expected backlight distribution image is the expected backlight brightness of the image to be displayed.

[0130] It's understandable that, assuming each first partition can influence 8×8 surrounding first partitions, each pixel would be affected by these surrounding 8×8 first partitions. Therefore, to accurately determine the impact on a pixel, it's necessary to calculate the sub-light diffusion coefficients generated by these surrounding 8×8 first partitions. However, storing a set of 8×8 coefficients for each pixel would require a large storage space for the display device's hardware storage unit, placing high demands on its configuration. Therefore, this application divides the image to be displayed into H×V second partitions, assuming that pixels within the same second partition are affected equally. Thus, only one set of 8×8 coefficients needs to be stored for each second partition. That is, the total number of sub-light diffusion coefficients that need to be stored is H×V×8×8. By adjusting the value of H×V, the final number of sub-light diffusion coefficients that need to be stored can be adjusted to meet the storage requirements of the display device. The smaller the second partition, the closer its expected backlight brightness is to the actual backlight brightness during display. For example, if H is 4 and V is 4, then the total number of sub-light diffusion coefficients that need to be stored is 4×4×8×8. Compared to storing a set of 8×8 coefficients for each pixel, this can reduce the hardware area.

[0131] S104, perform pixel compensation on the pixels of the image to be displayed according to the expected backlight brightness, and display the image according to the pixel-compensated image.

[0132] In some embodiments, S104 may be for each pixel of the image to be displayed: calculating the expected backlight brightness corresponding to the pixel divided by a set display brightness to obtain a candidate compensation value; if the candidate compensation value is less than or equal to the set compensation value, the pixel is compensated using the candidate compensation value; if the candidate compensation value is greater than the set compensation value, the pixel is compensated using the set compensation value. Thus, in related technologies, compensation data for each pixel is typically calculated based on the pixel's backlight data and the original image data. However, since the backlight is weakened, the compensation data for each pixel is obtained by dividing the original backlight by the weakened backlight, so that the final displayed pixel brightness equals the original pixel brightness. Because errors may exist in calculating the backlight value, spatially filtering the backlight value, temporally filtering the backlight value, and calculating the simulated backlight brightness using convolution coefficients, the backlight brightness of each pixel cannot be accurately calculated. Therefore, the gain calculated by dividing the original backlight by the weakened backlight may be large, causing the final pixel calculated by this method to exceed the maximum limit and ultimately be cropped to the maximum value, resulting in color distortion or loss of detail in bright areas when displaying the image to be displayed. As shown in Figure 9, using existing pixel compensation methods results in discoloration or loss of detail in the highlighted areas of the image to be displayed. However, by obtaining the pixel compensation value using the method described in this application and applying that value for pixel compensation, no discoloration or loss of detail occurs in the highlighted areas of the image to be displayed.

[0133] For example, calculation Obtain alternative compensation values ​​and set gain <= (2^bw–1) / max(r,g,b). Here, gain is the alternative compensation value, bw is the pixel bit depth, BLsim is the expected backlight brightness, and BLori is the original backlight value without local dimming, i.e., the backlight brightness set on the display device. Set the compensation value equal to the maximum compensation value, which is equal to (2^bw–1) / max(r,g,b).

[0134] In other embodiments, S104 may be for each pixel of the image to be displayed: in a preset third storage space, a lookup operation is performed on the maximum value of the RGB channels of the pixel and the expected backlight brightness corresponding to the pixel to obtain the compensation value of the pixel; the compensation value is then used to compensate the pixel. The third storage space stores the correspondence between the maximum value of the RGB channels, the expected backlight brightness corresponding to a single pixel, and the compensation value.

[0135] In the above embodiments, the expected backlight brightness can be pre-calculated for the sample image. For each pixel of the sample image: the expected backlight brightness corresponding to that pixel is calculated and divided by a set display brightness to obtain a compensation value to be stored. If the compensation value to be stored is less than or equal to the set compensation value, the relationship between the expected backlight brightness, the maximum value of the RGB channels of that pixel, and the compensation value to be stored is stored in a third storage space. If the compensation value to be stored is greater than the set compensation value, the relationship between the expected backlight brightness, the maximum value of the RGB channels of that pixel, and the set compensation value is stored in the third storage space. The compensation value to be stored and the set compensation value stored in the third storage space serve as the compensation value for the pixel.

[0136] For example, referring to Figures 10 and 11, the compensation value is set to the maximum compensation value. A 2D LUT (two-dimensional lookup table) for pixel compensation can be constructed for the sample image based on the relationship between the expected backlight brightness, the maximum value of the pixel's RGB channels, and the set compensation value, and configured in the hardware register. Specifically, each 2DLUT includes 65 1DLUTs (one-dimensional lookup tables). The X-axis of each 1D LUT represents the expected backlight brightness of the pixel, and the Y-axis represents the pixel's compensation value. It is foreseeable that the pixel's compensation value (gain') is large in low-backlight areas and small in high-backlight areas, with a minimum value of 1. Each horizontal axis of the 2DLUT is a 1DLUT, and each vertical axis represents the maximum value of the pixel's RGB channels. The maximum compensation value for each 1DLUT can be calculated using (2^bw–1) / max(r,g,b). Here, the value at x1 is set to the maximum compensation value, the value at x0 is set to 1, and the values ​​after x1 are set to pixel bit depth / x. Taking a 14-bit grayscale pixel as an example, if the compensation gain for each pixel is to be calculated precisely, the gain from the low backlight area to the high backlight area is 16383-1. Even if the pixel grayscale is very large, the brightness of the low backlight area is still dark. In order to reduce hardware overhead, the maximum value of the compensation gain at x1 is limited to 64. This can accurately compensate for pixels with grayscale values ​​above 256, that is, it can accurately compensate for 98.4% of grayscale pixels. Since grayscale pixels below 256 are inherently dark scenes, limiting their compensation gain value can make them even darker and increase the display contrast.

[0137] In some embodiments, the compensation value of 2DLUT can be manually modified according to the display effect of the image to be displayed in order to optimize the effect of local dimming.

[0138] In some embodiments, the method for displaying an image further includes: performing pixel compensation on the pixels of the image to be displayed according to the expected backlight brightness, and then using dither (dithering algorithm) to dither the compensated pixel values ​​to prevent color banding in the image.

[0139] For example, referring to Figure 12, which is a flowchart of another backlight simulation method provided in an embodiment of this application, including:

[0140] S401, Obtain the image to be displayed.

[0141] S402, for each pixel of the image to be displayed: in the preset third storage space, perform a lookup operation on the maximum value of the RGB channel of the pixel and the expected backlight brightness corresponding to the pixel to obtain the compensation value of the pixel; use the compensation value to compensate the pixel.

[0142] In this way, by pre-calculating the compensation values ​​for pixels under different conditions, the compensation values ​​can be obtained directly by lookup when performing pixel compensation on the image to be displayed, which can reduce the computational burden on the processor.

[0143] Example 2

[0144] Please refer to Figure 13, which illustrates an image display apparatus according to an embodiment of this application. The apparatus includes: an acquisition module 1, a partitioning module 2, a determination module 3, and a display module 4. The acquisition module 1 is used to acquire an image to be displayed. The partitioning module 2 is used to divide the image to be displayed into multiple first partitions according to a first preset method, and into multiple second partitions according to a second preset method; the number of second partitions is greater than or equal to the number of first partitions. The determination module 3 is used to determine the expected backlight brightness of the image to be displayed based on a first backlight value of each first partition and a target light diffusion coefficient of each second partition; a target light diffusion coefficient characterizes the degree of influence of the brightness of each first partition within a first preset range on that second partition. The display module 4 is used to perform pixel compensation on the pixels of the image to be displayed according to the expected backlight brightness, and display the pixel-compensated image.

[0145] In some embodiments, the determining module 3 is used to obtain the target light diffusion coefficient by performing a lookup operation on the second partition in a preset first storage space to obtain the target light diffusion coefficient corresponding to each second partition; the first storage space stores the correspondence between each second partition and the target light diffusion coefficient.

[0146] In some embodiments, the determining module 3 is used to determine the target light diffusion coefficient in the following manner: for each second partition: obtaining the second backlight value of the second partition and the sub-light pattern of the first candidate partition corresponding to the second partition; the first candidate partition is a first partition located within a second preset range of the second partition; determining the normalization factor of the first candidate partition based on the sub-light pattern of the first candidate partition and the first backlight value of the second candidate partition corresponding to the first candidate partition; the second candidate partition is a first partition located within a third preset range of the first candidate partition; calculating the sub-light diffusion coefficient corresponding to each normalization factor by using each normalization factor and the second backlight value of the second partition respectively according to a preset algorithm; the target light diffusion coefficient of the second partition is the set of each sub-light diffusion coefficient of the second partition.

[0147] In some embodiments, the determining module 3 is configured to determine the normalization factor of the first candidate partition based on the sub-light pattern of the first candidate partition and the first backlight value of the second candidate partition corresponding to the first candidate partition in the following manner: for each first candidate partition: adjust the first backlight value of each second candidate partition corresponding to the first candidate partition according to the sub-light pattern of the first candidate partition; and determine the sum of the adjusted first backlight values ​​of each second candidate partition as the normalization factor of the first candidate partition.

[0148] In some embodiments, the determining module 3 is used to adjust the first backlight value of each second candidate partition corresponding to the first candidate partition according to the sub-light pattern of the first candidate partition in the following manner: in a preset second storage space, a lookup operation is performed on the sub-light pattern to obtain the position of the partition to be modified corresponding to the sub-light pattern; the second storage space stores the correspondence between the sub-light pattern and the position of the partition to be modified; the value of the first backlight value of the second candidate partition corresponding to the position of the partition to be modified is found and modified to the set backlight value.

[0149] In some embodiments, the acquisition module 1 is used to acquire the first backlight value of each first partition in the following manner: for each first partition: acquire the brightness value corresponding to each pixel in the first partition; determine the candidate backlight value of the first partition based on each brightness value; correct each candidate backlight value to obtain the first backlight value of each first partition.

[0150] In some embodiments, the acquisition module 1 is used to correct the candidate backlight value by: acquiring an average brightness value and a maximum brightness value; the average brightness value is the average of all brightness values; the maximum brightness value is the maximum of all brightness values; determining a correction value based on the average brightness value and the maximum brightness value; and correcting the candidate backlight value using the correction value.

[0151] In some embodiments, the acquisition module 1 is used to correct the candidate backlight value by performing spatial filtering on the candidate backlight value.

[0152] In some embodiments, the acquisition module 1 is used to correct the candidate backlight value by: acquiring the first pixel statistical histogram of the previous frame image of the image to be displayed and the second pixel statistical histogram of the image to be displayed; determining whether the scene has changed based on the first pixel statistical histogram and the second pixel statistical histogram; and performing time filtering on the candidate backlight value if the scene has not changed.

[0153] In some embodiments, the determining module 3 is configured to determine the expected backlight brightness of the image to be displayed based on the first backlight value of each first partition and the target light diffusion coefficient of each second partition in the following manner: For each second partition: the sub-light diffusion coefficients corresponding to the second partition are used as convolution coefficients; the convolution coefficients are used to convolve with the first backlight value of the first partition in which the second partition is located to obtain the simulated backlight brightness of the second partition; the backlight image is magnified to a preset resolution to obtain an expected backlight distribution image; the backlight image is an image showing the simulated backlight brightness of all second partitions; the preset resolution is the resolution of the image to be displayed; the brightness of each pixel in the expected backlight distribution image is the expected backlight brightness of the image to be displayed.

[0154] In some embodiments, the display module 4 is used to perform pixel compensation on the pixels of the image to be displayed according to the expected backlight brightness: for each pixel of the image to be displayed: in a preset third storage space, a lookup operation is performed on the maximum value of the RGB channel of the pixel and the expected backlight brightness corresponding to the pixel to obtain the compensation value of the pixel; the third storage space stores the correspondence between the maximum value of the RGB channel, the expected backlight brightness corresponding to a single pixel and the compensation value; the compensation value is used to compensate the pixel.

[0155] In some embodiments, the display module 4 is used to perform pixel compensation on the pixels of the image to be displayed according to the expected backlight brightness: for each pixel of the image to be displayed: calculate the expected backlight brightness corresponding to the pixel divided by the set display brightness to obtain a candidate compensation value; if the candidate compensation value is less than or equal to the set compensation value, compensate the pixel using the candidate compensation value; if the candidate compensation value is greater than the set compensation value, compensate the pixel using the set compensation value.

[0156] In some embodiments, the display module 4 is further configured to perform backlight control according to each first backlight value.

[0157] It is understood that the embodiments described in Embodiment 1 are also applicable in Embodiment 2 without conflict. For the sake of brevity, they will not be repeated here.

[0158] Example 3

[0159] This application provides a display device. The display device is configured with a processor, an LCD screen, and a backlight module. The display device also includes registers. The LCD screen is used to display images. The backlight module includes an LED controller and multiple LED beads, with the LED controller controlling the LED beads to illuminate to generate backlight. The processor calculates the backlight parameters required for the image and adjusts the image pixels, sending the backlight parameters to the LED controller to control the LED beads to illuminate, and sending the pixel-adjusted image to the LCD screen for display. The registers can serve as storage space to store data.

[0160] The processor can be a CPU processor or an FPGA (Field Programmable Gate Array) processor.

[0161] In some embodiments, as shown in FIG14, the image display method is applied to a display device. The FPGA processor of the display device receives the input image to be displayed. The FPGA processor partitions the image to be displayed into multiple first partitions according to a first preset method and multiple second partitions according to a second preset method. The backlight value to be calculated for each partition is then calculated, and spatial filtering is applied to each backlight value to obtain a spatially filtered backlight value. Temporal filtering is then applied to each spatially filtered backlight value to obtain a first backlight value for each first partition. Finally, the first backlight value is sent to the LED controller for backlight control. Simultaneously, the FPGA processor finds the target light diffusion coefficient corresponding to each second partition, and performs backlight convolution with the first backlight value of the first partition in which the second partition is located to obtain simulated backlight brightness. The backlight image composed of each simulated backlight brightness is magnified using bilinear interpolation. The magnified backlight image and pixels are then used to find compensation values, and pixel compensation is performed using these compensation values. The pixel-compensated image to be displayed is sent to an LCD screen for display. In other words, processing the image to be displayed in the FPGA processor requires sequential steps of image partitioning, spatial filtering, temporal filtering, sending backlight values, backlight convolution, bilinear interpolation amplification, pixel compensation, and sending the pixel-compensated image to be displayed.

[0162] The specific implementation method of each step is described in Example 1 and will not be repeated here. The data to be obtained through lookup during the implementation of each step can be pre-stored in a register. Examples of data to be obtained through lookup include: historical backlight values ​​corresponding to candidate backlight values, i.e., the backlight values ​​corresponding to candidate backlight values ​​in the previous frame. Another example is a two-dimensional lookup table.

[0163] The display device and image display method of this application embodiment take into account the mutual influence of brightness between different first zones, and can simulate the light diffusion characteristics of a real backlight module. This makes the obtained expected backlight brightness closer to the actual backlight brightness during display, and thus allows for more accurate pixel compensation when using the expected backlight brightness for pixel compensation. The image to be displayed after pixel compensation is sent to the LCD screen for display, and the first backlight value of the first zone is sent to the LED controller for backlight control, resulting in a better image effect seen by the user on the LCD screen.

[0164] This application provides a storage medium storing computer-executable instructions configured to execute the method for displaying the image described above.

[0165] The technical solutions of this application embodiment can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes one or more instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in this application embodiment. The aforementioned storage medium can be a non-transitory storage medium, including various media capable of storing program code such as USB flash drives, portable hard drives, read-only memory, random access memory, magnetic disks, or optical disks, or it can be a transient storage medium.

[0166] In the embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. The apparatus embodiments described above are merely illustrative. For example, the division of units is only a logical functional division, and there may be other division methods in actual implementation. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed.

[0167] The above descriptions are merely embodiments of this application and are not intended to limit the scope of protection of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of protection of this application. Furthermore, the above embodiments can be combined with each other to form new embodiments without conflict.

Claims

1. A method for displaying an image, characterized in that, include: Get the image to be displayed; The image to be displayed is divided into multiple first partitions according to a first preset method, and into multiple second partitions according to a second preset method; the number of second partitions is greater than or equal to the number of first partitions. The expected backlight brightness of the image to be displayed is determined based on the first backlight value of each of the first partitions and the target light diffusion coefficient of each of the second partitions. A target light diffusion coefficient characterizes the degree to which the brightness of each of the first partitions within a first preset range of a second partition affects the second partition; Pixel compensation is performed on the pixels of the image to be displayed according to the expected backlight brightness, and the image to be displayed is then displayed according to the pixel-compensated image.

2. The method according to claim 1, characterized in that, The target light diffusion coefficient is obtained in the following way: In the preset first storage space, a table lookup operation is performed on the second partition to obtain the target light diffusion coefficient corresponding to each second partition; the first storage space stores the correspondence between each second partition and the target light diffusion coefficient.

3. The method according to claim 1, characterized in that, The target light diffusion coefficient is determined in the following way: For each of the second partitions: Obtain the second backlight value of the second partition and the sub-light pattern of the first candidate partition corresponding to the second partition; the first candidate partition is the first partition located within the second preset range of the second partition; The normalization factor of the first candidate partition is determined based on the sub-light pattern diagram of the first candidate partition and the first backlight value of the second candidate partition corresponding to the first candidate partition. The second candidate partition is the first partition located within a third preset range of the first candidate partition; According to the preset algorithm, the normalization factor is calculated with the second backlight value of the second partition to obtain the sub-light diffusion coefficient corresponding to each normalization factor; the target light diffusion coefficient of the second partition is the set of the sub-light diffusion coefficients of the second partition.

4. The method according to claim 3, characterized in that, The normalization factor of the first candidate partition is determined based on the sub-light pattern diagram of the first candidate partition and the first backlight value of the second candidate partition corresponding to the first candidate partition, including: For each of the first candidate partitions: Adjust the first backlight value of each of the second candidate zones corresponding to the first candidate zone according to the sub-light pattern diagram of the first candidate zone; The sum of the adjusted first backlight values ​​of each of the second candidate zones is determined as the normalization factor of the first candidate zone.

5. The method according to claim 4, characterized in that, Adjusting the first backlight value of each of the second candidate zones corresponding to the first candidate zone according to the sub-light pattern diagram of the first candidate zone includes: In the preset second storage space, a table lookup operation is performed on the sub-light pattern diagram to obtain the partition position to be modified corresponding to the sub-light pattern diagram; the second storage space stores the correspondence between the sub-light pattern diagram and the partition position to be modified; Find and modify the value of the first backlight value of the second candidate partition corresponding to the location of the partition to be modified to the set backlight value.

6. The method according to claim 1, characterized in that, The first backlight value of each of the first partitions is obtained in the following way: For each of the first partitions: obtain the brightness value corresponding to each pixel in the first partition; determine the candidate backlight value for the first partition based on the brightness value; The candidate backlight values ​​are corrected to obtain the first backlight value for each of the first zones.

7. The method according to claim 6, characterized in that, The modification of the candidate backlight values ​​includes: Obtain the average brightness and the maximum brightness; the average brightness is the average of all brightness values; the maximum brightness is the maximum of all brightness values. The correction value is determined based on the average brightness value and the maximum brightness value; The alternative backlight values ​​are corrected using the correction value.

8. The method according to claim 6, characterized in that, The correction of the candidate backlight values ​​includes: Spatial filtering is performed on the candidate backlight values.

9. The method according to claim 6, characterized in that, The correction of the candidate backlight values ​​includes: Obtain the first pixel statistical histogram of the previous frame of the image to be displayed and the second pixel statistical histogram of the image to be displayed; Determine whether the scene has changed based on the first pixel statistical histogram and the second pixel statistical histogram; If the scene remains unchanged, the candidate backlight values ​​are subjected to time filtering.

10. The method according to claim 1, characterized in that, A target light diffusion coefficient includes multiple sub-light diffusion coefficients; determining the expected backlight brightness of the image to be displayed based on the first backlight value of each first partition and the target light diffusion coefficient of each second partition includes: For each second partition: use the sub-light diffusion coefficients corresponding to the second partition as convolution coefficients; use the convolution coefficients to convolve with the first backlight value of the first partition where the second partition is located to obtain the simulated backlight brightness of the second partition; The backlight image is magnified to a preset resolution to obtain a desired backlight distribution image; the backlight image is an image displaying the simulated backlight brightness of all the second partitions; the preset resolution is the resolution of the image to be displayed; the brightness of each pixel in the desired backlight distribution image is the desired backlight brightness of the image to be displayed.

11. The method according to any one of claims 1 to 10, characterized in that, Pixel compensation is performed on the pixels of the image to be displayed based on the expected backlight brightness, including: For each pixel of the image to be displayed: In the preset third storage space, a lookup operation is performed on the maximum value of the RGB channel of the pixel and the expected backlight brightness corresponding to the pixel to obtain the compensation value of the pixel; the third storage space stores the correspondence between the maximum value of the RGB channel, the expected backlight brightness corresponding to a single pixel and the compensation value; The pixel is compensated using this compensation value.

12. The method according to any one of claims 1 to 10, characterized in that, Pixel compensation is performed on the pixels of the image to be displayed based on the expected backlight brightness, including: For each pixel of the image to be displayed: Calculate the expected backlight brightness corresponding to the pixel and divide it by the set display brightness to obtain the alternative compensation value; If the alternative compensation value is less than or equal to the set compensation value, the pixel is compensated using the alternative compensation value; If the alternative compensation value is greater than the set compensation value, the set compensation value is used to compensate the pixel.

13. The method according to any one of claims 1 to 10, characterized in that, The method also includes: Backlight control is performed according to each of the first backlight values.

14. An apparatus for displaying images, characterized in that, include: The acquisition module is used to acquire the image to be displayed. A partitioning module is used to divide the image to be displayed into multiple first partitions according to a first preset method, and to divide the image to be displayed into multiple second partitions according to a second preset method; the number of second partitions is greater than or equal to the number of first partitions; The determining module is used to determine the expected backlight brightness of the image to be displayed based on the first backlight value of each of the first partitions and the target light diffusion coefficient of each of the second partitions; A target light diffusion coefficient characterizes the degree to which the brightness of each of the first partitions within a first preset range of a second partition affects the second partition; The display module is used to perform pixel compensation on the pixels of the image to be displayed according to the expected backlight brightness, and display the image to be displayed according to the pixel-compensated image.

15. A display device, characterized in that, The device includes a processor and a memory, the memory storing computer-executable instructions that can be executed by the processor, the processor executing the computer-executable instructions to implement the method for displaying an image as described in any one of claims 1 to 13.

16. A storage medium, characterized in that, The storage medium stores computer-executable instructions, which, when invoked and executed by a processor, cause the processor to implement the method for displaying an image as described in any one of claims 1 to 13.

Images