Display control method and apparatus, display device, electronic device, and storage medium

Abstract

The present disclosure provides a display control method, device, display equipment, electronic equipment and storage medium, and belongs to the technical field of display, wherein the display control method comprises: determining first backlight characteristic values of each backlight partition of a backlight module according to first pixel data of each pixel point in a to-be-displayed image; determining backlight driving values of light sources in each backlight partition according to the first backlight characteristic values of each backlight partition; determining second backlight characteristic values of each backlight partition according to a pre-set backlight diffusion factor group and the first backlight characteristic values of each backlight partition; the backlight diffusion factor group comprises N*N backlight diffusion factors, and N is a positive integer; and compensating the first pixel data of each pixel point in the to-be-displayed image according to the second backlight characteristic values of each backlight partition to obtain second pixel data after compensation for display.

Description

Technical Field

[0001] This disclosure belongs to the field of display technology, specifically relating to a display control method, apparatus, display device, electronic device, and storage medium. Background Technology

[0002] With the rapid development of sub-millimeter light-emitting diode (mini LED) display technology, mini LED display products have begun to be applied in the field of ultra-large high-definition displays, such as automotive displays, monitoring and command centers, high-definition broadcasting, high-end cinemas, medical diagnostics, advertising displays, conference and exhibition displays, office displays, and virtual reality, achieving relatively good display effects. Summary of the Invention

[0003] This disclosure aims to at least solve one of the technical problems existing in the prior art, and to provide a display control method, apparatus, display device, electronic device and storage medium.

[0004] Firstly, the technical solution adopted to solve the technical problem of this disclosure is a display control method, including:

[0005] Based on the first pixel data of each pixel in the image to be displayed, determine the first backlight feature value of each backlight zone of the backlight module;

[0006] Based on the first backlight characteristic value of each backlight zone, determine the backlight driving value of the light source in each backlight zone;

[0007] The second backlight characteristic value of each backlight partition is determined based on the pre-set backlight diffusion factor group and the first backlight characteristic value of each backlight partition; the backlight diffusion factor group includes N×N backlight diffusion factors, where N is a positive integer;

[0008] Based on the second backlight feature value of each backlight zone, the first pixel data of each pixel in the image to be displayed is compensated to obtain the compensated second pixel data for display.

[0009] In some embodiments, determining the first backlight feature value of each backlight zone of the backlight module based on the first pixel data of each pixel in the image to be displayed includes:

[0010] Based on the first pixel data of each pixel in the image to be displayed, grayscale features are extracted from each pixel to obtain the first grayscale value of each pixel.

[0011] For any of the backlight partitions, based on the first grayscale values ​​of each pixel corresponding to the backlight partition, the maximum value among the first grayscale values ​​is determined as the second grayscale value of the backlight partition, and the average value of the first grayscale values ​​of each pixel corresponding to the backlight partition is determined as the third grayscale value of the backlight partition.

[0012] The first backlight feature value of the backlight zone is determined based on the second gray value, the third gray value, and the preset weighting coefficient; the preset weighting coefficient ranges from 0 to 1.

[0013] In some embodiments, the weighting coefficients range from 0.5 to 0.9.

[0014] In some embodiments, determining the backlight drive value of the light source in each of the backlight zones based on the first backlight characteristic value of each backlight zone includes:

[0015] Based on a preset mapping method, the first backlight feature value of each backlight zone is mapped to the corresponding backlight drive value before adjustment.

[0016] For any backlight zone, if the backlight drive value before adjustment is less than a first preset threshold, a non-linear mapping algorithm with display module parameter gamma < 1 is used to determine the backlight drive value after adjustment of the light source in the backlight zone; if the backlight drive value before adjustment is greater than or equal to the first preset threshold, a non-linear mapping algorithm with display module parameter gamma > 1 is used to determine the backlight drive value after adjustment of the light source in the backlight zone.

[0017] In some embodiments, determining the second backlight characteristic value of each backlight zone based on a pre-set backlight diffusion factor group and a first backlight characteristic value of each backlight zone includes:

[0018] For any of the backlight zones, the first backlight feature value of the backlight zone and the first backlight feature value of the first neighboring zones of the backlight zone are weighted using N×N backlight diffusion factors in the backlight diffusion factor group to determine the second backlight feature value of each of the backlight zones; wherein, the first neighboring zones include backlight zones whose zone distance from the backlight zone is less than or equal to a first preset distance threshold.

[0019] In some embodiments, the first neighboring partition further includes a first mirror partition whose partition distance from the backlight partition is less than or equal to a first preset distance threshold;

[0020] Before determining the second backlight characteristic value of each backlight zone by weighting the first backlight characteristic value of the first backlight zone and the first backlight characteristic value of the first neighboring zone of the backlight zone using N×N backlight diffusion factors in the backlight diffusion factor group, the method further includes:

[0021] Based on the size information of N×N backlight diffusion factors and the size information of multiple backlight partitions divided by the backlight module, a preset mirroring algorithm is used to determine multiple first virtual mirror regions of the backlight module; each first virtual mirror region includes at least N rows and N columns of first mirror partitions;

[0022] The first backlight feature value of the first mirror partition is determined based on the first backlight feature value of the backlight partition corresponding to the first mirror partition.

[0023] In some embodiments, determining the first backlight feature value of the first mirrored partition based on the first backlight feature value of the backlight partition corresponding to the first mirrored partition includes:

[0024] Configure a call address for at least a portion of the first mirror partition, and use the configured call address of the first mirror partition to read the first backlight feature value of the first mirror partition.

[0025] In some embodiments, the step of compensating the first pixel data of each pixel in the image to be displayed based on the second backlight feature value of each of the backlight zones to obtain the compensated second pixel data includes:

[0026] Based on the second backlight feature value of each backlight zone, the third backlight feature value of each pixel in the image to be displayed is determined using a preset linear interpolation algorithm.

[0027] Based on the third backlight feature value of each pixel in the image to be displayed, the first pixel data of each pixel in the image to be displayed is compensated to obtain the compensated second pixel data.

[0028] In some embodiments, the step of compensating the first pixel data of each pixel in the image to be displayed based on the second backlight feature value of each of the backlight zones to obtain the compensated second pixel data includes:

[0029] The second backlight feature value of each backlight zone is filtered to obtain the fourth backlight feature value of each backlight zone;

[0030] Based on the fourth backlight feature value of each backlight zone, the third backlight feature value of each pixel in the image to be displayed is determined using a preset linear interpolation algorithm.

[0031] Based on the third backlight feature value of each pixel in the image to be displayed, the first pixel data of each pixel in the image to be displayed is compensated to obtain the compensated second pixel data.

[0032] In some embodiments, filtering the second backlight feature values ​​of each of the backlight zones to obtain the fourth backlight feature values ​​of each of the backlight zones includes:

[0033] For each of the backlight zones, a predetermined set of filtering coefficients is used to filter the second backlight feature value of the backlight zone and the second backlight feature value of the second neighboring zones of the backlight zone to determine the fourth backlight feature value of the backlight zone; wherein, the second neighboring zones include backlight zones whose zone distance from the backlight zone is less than or equal to a second preset distance threshold.

[0034] In some embodiments, the second neighboring partition further includes a second mirror partition whose partition distance from the backlight partition is less than or equal to a second preset distance threshold; the filter coefficient group includes n×n filter coefficients, where n is a positive integer.

[0035] Before determining the fourth backlight feature value of the backlight partition by filtering the second backlight feature value of the backlight partition and the second backlight feature value of the second neighboring partition of the backlight partition using a predetermined set of filtering coefficients, the method further includes:

[0036] Based on the size information of n×n filter coefficients and the multiple backlight partitions divided by the backlight module, a multiple second virtual mirror region of the backlight module is determined using a preset mirroring algorithm;

[0037] The second backlight feature value of the second mirror partition is determined based on the second backlight feature value of the backlight partition corresponding to the mirror of the second mirror partition.

[0038] In some embodiments, determining the second backlight feature value of the second mirrored partition based on the second backlight feature value of the backlight partition corresponding to the second mirrored partition includes:

[0039] Configure a call address for at least a portion of the second mirror partition, and use the configured call address of the second mirror partition to read the second backlight feature value of the second mirror partition.

[0040] In some embodiments, determining the third backlight feature value of each pixel in the image to be displayed using a preset linear interpolation algorithm based on the fourth backlight feature value of each of the backlight zones includes:

[0041] The multiple backlight zones are divided into multiple backlight zone groups, and each backlight zone group includes 2×2 backlight zones;

[0042] For each of the backlight partition groups, the central region of the backlight partition group is determined according to the center position of each of the backlight partitions in the backlight partition group; the number of pixels in the central region is equal to the number of pixels in the backlight partition.

[0043] Based on the size information of the central region, determine the quantization data for linear interpolation of each pixel;

[0044] For any of the backlight partition groups, the third backlight feature value of each pixel in the central region is determined by using a preset linear interpolation algorithm based on the fourth backlight feature value of each backlight partition in the backlight partition group and the quantized data of the pixel in the central region; the central region of each backlight partition group constitutes multiple backlight partitions of the backlight module.

[0045] In some embodiments, the step of compensating the first pixel data of each pixel in the image to be displayed based on the third backlight feature value of each pixel in the image to be displayed to obtain the compensated second pixel data includes:

[0046] For any pixel in the image to be displayed, a first compensation factor for the pixel is determined based on the third backlight feature value of the pixel.

[0047] The second compensation factor of the pixel is determined based on the first compensation factor and the first gray value of the pixel.

[0048] The second compensation factor is used to compensate the first pixel data of the pixel to obtain the second pixel data of the pixel.

[0049] Secondly, this disclosure also provides a display control device, including a first processing module, a second processing module, a third processing module, and a fourth processing module;

[0050] The first processing module is configured to determine the first backlight feature value of each backlight partition of the backlight module based on the first pixel data of each pixel in the image to be displayed.

[0051] The second processing module is configured to determine the backlight driving value of the light source in each of the backlight zones based on the first backlight feature value of each of the backlight zones.

[0052] The third processing module is configured to determine the second backlight characteristic value of each backlight partition based on a pre-set backlight diffusion factor group and the first backlight characteristic value of each backlight partition; the backlight diffusion factor group includes N×N backlight diffusion factors, where N is a positive integer;

[0053] The fourth processing module is configured to compensate the first pixel data of each pixel in the image to be displayed based on the second backlight feature value of each backlight partition, so as to obtain the compensated second pixel data for display.

[0054] Thirdly, embodiments of this disclosure also provide a display device, comprising: a backlight module, a display module, and a display control device, wherein the display control device is connected to the backlight module and the display module respectively, and the display control device adopts the display control device described in the second aspect;

[0055] The backlight module includes a driving component and multiple backlight zones. The driving component is used to drive the multiple backlight zones to emit backlight according to the backlight driving values ​​of the multiple backlight zones.

[0056] The display module is used to display data based on the input second pixel data.

[0057] In some embodiments, the display module includes a 14.96-inch display screen.

[0058] Fourthly, embodiments of this disclosure also provide an electronic device, comprising:

[0059] One or more processors;

[0060] Memory, used to store one or more programs;

[0061] When the one or more programs are executed by the one or more processors, the one or more processors implement the display control method as described in any of the first aspects.

[0062] In some embodiments, the processor includes a field-programmable gate array (FPGA).

[0063] Fifthly, embodiments of this disclosure also provide a computer non-transient readable storage medium storing a computer program that, when executed by a processor, performs the steps of the display control method as described in any one of the first aspects. Attached Figure Description

[0064] Figure 1 A flowchart of a display control method provided in an embodiment of this disclosure;

[0065] Figure 2 A schematic diagram of the convolutional diffusion model provided in the embodiments of this disclosure;

[0066] Figure 3 A schematic flowchart illustrating the process of determining a first backlight feature value for a backlight zone, as provided in an embodiment of this disclosure;

[0067] Figure 4 This is a schematic flowchart illustrating the process of determining the backlight drive value after light source adjustment in a backlight zone, as provided in an embodiment of the present disclosure.

[0068] Figure 5 This is a schematic diagram of an image to be displayed according to an embodiment of the present disclosure;

[0069] Figure 6 A schematic diagram of a gamma curve provided in an embodiment of this disclosure;

[0070] Figure 7 A schematic diagram of a backlight zone and its first adjacent zone provided for an embodiment of this disclosure;

[0071] Figure 8 A schematic flowchart illustrating the process of determining a second backlight feature value for a backlight zone, as provided in an embodiment of this disclosure;

[0072] Figure 9 A schematic diagram of the first virtual mirror region provided in an embodiment of this disclosure;

[0073] Figure 10 A schematic diagram of a pixel compensation process provided in an embodiment of this disclosure;

[0074] Figure 11a A schematic diagram of a backlight zone and its second adjacent zone provided for an embodiment of this disclosure;

[0075] Figure 11b A schematic diagram of a filter coefficient group provided in an embodiment of this disclosure;

[0076] Figure 12 A schematic flowchart illustrating a method for determining a fourth backlight feature value for a backlight zone, provided in an embodiment of this disclosure;

[0077] Figure 13 This is a schematic flowchart illustrating the process of determining the third backlight feature value of each pixel in an embodiment of the present disclosure.

[0078] Figure 14a A schematic diagram of bilinear interpolation provided in an embodiment of this disclosure;

[0079] Figure 14b for Figure 14a A schematic diagram of the corresponding interpolation model;

[0080] Figure 15 This is a schematic diagram of a process for compensating the first pixel data of each pixel in an image to be displayed to obtain the compensated second pixel data, as provided in an embodiment of the present disclosure.

[0081] Figure 16A schematic diagram illustrating another pixel compensation process provided in this embodiment of the disclosure;

[0082] Figure 17 This is a schematic flowchart illustrating the display control method provided in an embodiment of the present disclosure.

[0083] Figure 18 A schematic diagram of a display control device provided in an embodiment of this disclosure;

[0084] Figure 19 A schematic diagram of a display device provided in an embodiment of this disclosure;

[0085] Figure 20 A schematic diagram of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0086] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. The components of the embodiments of this disclosure described and shown in the accompanying drawings can generally be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of this disclosure provided in the accompanying drawings is not intended to limit the scope of the claimed disclosure, but merely represents selected embodiments of this disclosure. All other embodiments obtained by those skilled in the art based on the embodiments of this disclosure without inventive effort are within the scope of protection of this disclosure.

[0087] Unless otherwise defined, the technical or scientific terms used in this disclosure shall have the ordinary meaning understood by one of ordinary skill in the art to which this disclosure pertains. The terms “first,” “second,” and similar terms used in this disclosure do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Similarly, the terms “an,” “a,” or “the,” and similar terms do not indicate a quantity limitation, but rather indicate the presence of at least one. The terms “including,” “comprising,” or “containing,” and similar terms mean that the element or object preceding the word encompasses the elements or objects listed following the word and their equivalents, without excluding other elements or objects. The terms “connected,” “linked,” or similar terms are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. The terms “upper,” “lower,” “left,” and “right,” etc., are used only to indicate relative positional relationships, and these relative positional relationships may change accordingly when the absolute position of the described objects changes.

[0088] In this disclosure, "multiple or several" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.

[0089] In recent years, with the rapid rise of new energy vehicles, the trends of "electrification," "intelligentization," and "larger display screens" have become increasingly apparent, and in-vehicle displays have become an important factor in evaluating the user experience. Adopting mini LED display technology for in-vehicle displays can achieve better display effects and enhance the user experience.

[0090] In related technologies, for traditional image displays, the input image information is used to extract brightness features to determine the backlight drive value to drive the backlight panel. The input image information is also used to simulate pixel compensation, thereby improving the display effect. However, the aforementioned traditional display algorithms have certain drawbacks. On the one hand, the algorithm implementation requires a large amount of storage resources, making it unsuitable for deployment on low-end chips, thus resulting in high hardware costs for supporting traditional algorithms. On the other hand, the backlight module is divided into multiple backlight zones, and the zoned control of the light source causes the backlight brightness to become inconsistent. Significant differences remain in the backlight drive values ​​between adjacent backlight zones, leading to poor smooth transitions in pixel compensation between adjacent zones, and consequently, failing to eliminate image blockiness.

[0091] It should be noted that the backlight drive values ​​in this disclosure are drive data used by the LED driver module to drive the backlight module.

[0092] To overcome the shortcomings of related technologies, a regional dynamic backlight control method can be adopted to dynamically adjust the backlight brightness of the LED display system. This regional dynamic backlight control is based on the pixel display principle of liquid crystal displays (LCDs). LCDs display pixels by using the electro-optic effect of liquid crystals to control the aperture of liquid crystal molecules, thereby changing the luminous flux output by each pixel. When displaying the same image using backlights of different intensities, theoretically, as long as the output luminous flux of each pixel remains constant, the displayed image can be guaranteed to remain unchanged. This principle can be summarized by the following formula:

[0093]

[0094] In formula (1), BL is the backlight brightness value of the pixel before dimming, and g is the pixel grayscale value of the pixel before dimming (i.e., the maximum value among the R, G, and B sub-pixels contained in the pixel). This represents the backlight brightness value of that pixel after dimming. Let γ be the pixel grayscale value after dimming, and γ be a constant power exponent determined by the display device itself. As can be seen from formula (1), if the backlight brightness value BL decreases, the final brightness of the displayed image (i.e., the output luminous flux) will also change. In order to reduce the backlight while ensuring that the emitted light brightness remains unchanged, the γ should be appropriately increased. The value is used to increase the transmittance of the emitted light.

[0095] In a first aspect, embodiments of this disclosure provide a display control method. Figure 1 This is a flowchart illustrating a display control method provided in an embodiment of the present disclosure. This display control method can be applied to a display control device, which can be implemented using software and / or hardware. Generally, the software can be integrated into the electronic device, and the hardware can be deployed in the display device. Figure 1 As shown, steps S11 to S14 are included, wherein:

[0096] S11. Determine the first backlight feature value of each backlight zone of the backlight module based on the first pixel data of each pixel in the image to be displayed.

[0097] The image to be displayed is obtained from the image acquisition device or by calling image resources in the memory. The first pixel data is, for example, the sub-pixel values ​​(R, G, and B) of each sub-pixel contained in the pixel.

[0098] The backlight module is pre-divided into multiple backlight zones, each corresponding to at least one light source. Each backlight zone corresponds to multiple pixels.

[0099] For example, this disclosure is applied to a 14.96-inch automotive display screen with a resolution of 2000×1200. The backlight module is pre-divided into 48×24 backlight zones, and each backlight zone includes 50×50 pixels.

[0100] S12. Determine the backlight driving value of the light source in each backlight zone based on the first backlight characteristic value of each backlight zone.

[0101] The backlight drive value of the light source in each backlight zone is used to drive the light source in each backlight zone to emit backlight corresponding to the image to be displayed.

[0102] For example, the backlight driving value of the light source in each backlight zone can be smoothed by combining the first backlight feature value of each backlight zone corresponding to the image to be displayed with the screen characteristics of the display module, thereby reducing the backlight difference between adjacent backlight zones.

[0103] S13. Determine the second backlight characteristic value of each backlight zone based on the pre-set backlight diffusion factor group and the first backlight characteristic value of each backlight zone.

[0104] The backlight diffusion factor group includes N×N backlight diffusion factors, where N is a positive integer.

[0105] It should be noted that because the first backlight characteristic values ​​of different backlight zones vary, the determined backlight drive values ​​for these zones often also differ. This causes the backlight light emitted from adjacent backlight zones to interfere with each other during the projection and diffusion process onto the panel within the backlight cavity. The actual backlight distribution of each backlight zone is not equal to its corresponding backlight drive value. If the effect of light diffusion is ignored and pixel compensation is directly performed based on the determined first backlight characteristic value, not only will the image information not be accurately reproduced, but significant blockiness will also occur. Furthermore, light diffusion can cause crosstalk, resulting in decreased brightness in bright areas and increased brightness in dark areas, thus affecting the display effect.

[0106] The backlight diffusion factor set can be a pre-established diffusion model that simulates the projection and diffusion process of backlight light within the backlight cavity. For example, a 9×9 convolutional diffusion model can be established by actually testing the projection and diffusion of backlight light within the backlight cavity. This model can accurately simulate the backlight diffusion phenomenon. The 9×9 convolutional diffusion model includes 81 backlight diffusion factors. Figure 2 A schematic diagram of the convolutional diffusion model provided in the embodiments of this disclosure, as shown below. Figure 2 As shown, the second backlight characteristic value of a backlight zone is obtained by multiplying the first backlight characteristic value of each of the 81 backlight zones by the sum of the backlight diffusion factors of that zone. Here, the backlight diffusion factor group can eliminate the influence of light diffusion in the backlight zones, thereby improving the display effect.

[0107] For example, the display control method described above can be deployed on a low-end chip, such as a Field Programmable Gate Array (FPGA). The 81 backlight diffusion factors are actual measured values ​​and can be pre-stored in the read-only memory (ROM) inside the FPGA.

[0108] The backlight characteristic values ​​(including the first backlight characteristic value and the second backlight characteristic value) in this disclosure can also be understood as the brightness values ​​of the backlight.

[0109] S14. Based on the second backlight feature value of each backlight zone, compensate the first pixel data of each pixel in the image to be displayed to obtain the compensated second pixel data for display.

[0110] The target compensation factor of a pixel can be determined based on the second backlight feature value of each backlight zone; the first pixel data of the pixel can be compensated using the target compensation factor to obtain the second pixel data of the pixel.

[0111] Steps S11 to S14 of this embodiment essentially improve upon traditional display algorithms based on screen characteristics and chip resource characteristics. By combining the first backlight feature values ​​of each backlight zone corresponding to the image to be displayed with the screen characteristics of the display module, the backlight driving values ​​of the light sources in each backlight zone are smoothed, thereby reducing the backlight differences between adjacent backlight zones. Simultaneously, the influence of backlight diffusion in the backlight zones is eliminated according to a pre-set backlight diffusion factor group. Furthermore, based on the second backlight feature values ​​of each backlight zone, the first pixel data of each pixel in the image to be displayed is compensated, which can improve the contrast of the image to be displayed, reduce power consumption, enhance image display details, and thus improve the display effect. Moreover, the above-described display control method can be deployed on low-end chips, such as Field Programmable Gate Arrays (FPGAs), thereby reducing the cost of display products.

[0112] The display control method provided in this disclosure will be described in detail below with reference to specific embodiments.

[0113] In some embodiments, Figure 3 This is a schematic flowchart illustrating a method for determining a first backlight feature value for a backlight zone, as provided in an embodiment of this disclosure. Figure 3 As shown, determining the first backlight characteristic value of each backlight zone of the backlight module in step S11 specifically includes steps S111 to S113, wherein:

[0114] S111. Based on the first pixel data of each pixel in the image to be displayed, perform grayscale feature extraction on each pixel to obtain the first grayscale value of each pixel.

[0115] The first pixel data of a pixel includes the sub-pixel values ​​of each sub-pixel (R, G, and B) contained in that pixel, denoted as R(u,v), G(u,v), and B(u,v).

[0116] For example, for any pixel, the largest subpixel value can be used as the first grayscale value of that pixel, as shown in the following formula (2):

[0117] gray max (u,v)=max(R(u,v),G(u,v),B(u,v))……..Formula (2)

[0118] Among them, gray max (u,v) represents the first grayscale value of pixel (u,v); max() represents the maximum value; R(u,v) represents the subpixel value of subpixel R of pixel (u,v); G(u,v) represents the subpixel value of subpixel G of pixel (u,v); B(u,v) represents the subpixel value of subpixel B of pixel (u,v).

[0119] S112. For any backlight partition, based on the first grayscale value of each pixel corresponding to the backlight partition, determine the maximum value among the first grayscale values ​​as the second grayscale value of the backlight partition, and determine the average value of the first grayscale value of each pixel corresponding to the backlight partition as the third grayscale value of the backlight partition.

[0120] For example, for any backlight zone, the first backlight feature value can be extracted using the maximum value method and / or the average value method.

[0121] For example, the second grayscale value can be determined using the maximum value method for any backlight partition. Specifically, the maximum value among the first grayscale values ​​of each pixel corresponding to the backlight partition can be used as the second grayscale value of that backlight partition, as shown in the following formula (3):

[0122] BL max =max(gray max )…………..……Formula (3)

[0123] Among them, BL max This represents the second grayscale value of a certain backlight zone; max() indicates taking the maximum value; gray max This represents the first grayscale value of any pixel in a certain backlight zone.

[0124] For example, the second grayscale value can be determined by averaging for any backlight partition. Specifically, the average of the first grayscale values ​​of each pixel corresponding to the backlight partition can be used as the third grayscale value of the backlight partition, as shown in the following formula (4):

[0125]

[0126] Among them, BL ave This represents the third grayscale value of a certain backlight zone; This represents the sum of the first grayscale values ​​of each pixel in a certain backlight zone; M and m represent the number of rows and columns of pixels in a certain backlight zone, respectively. Taking a 14.96-inch vehicle display screen as an example, M = m = 50.

[0127] S113. Determine the first backlight feature value of the backlight zone based on the second gray value, the third gray value and the pre-set weighting coefficient.

[0128] The pre-set weighting coefficients range from 0 to 1.

[0129] The second and third gray values ​​can be weighted using weighting coefficients to obtain the first backlight feature value of a backlight zone.

[0130] For example, for any backlight zone, the first backlight characteristic value can be determined according to the following formula (5):

[0131] BL = P × BL ave +(1-P)×BL max ……..……Formula (5)

[0132] Where BL represents the first backlight characteristic value of a certain backlight zone; P represents the weighting coefficient; BL max BL represents the second grayscale value of a certain backlight zone. ave This represents the third grayscale value of a certain backlight zone.

[0133] When P = 0, BL = BL max That is, the first backlight feature value is determined by using the maximum value method.

[0134] When P = 1, BL = BL ave That is, the first backlight feature value is determined by using the average value method.

[0135] While the maximum value method can greatly preserve image details, it results in ineffective control of image brightness in dark areas, insufficient contrast improvement, and limited power consumption reduction. The average value method can significantly reduce backlight and power consumption; however, for high-contrast areas, the backlight reduction exceeds the limits achievable by pixel compensation, leading to inaccurate image reproduction and poor display quality. Therefore, this embodiment uses both the maximum value method and the average value method to extract the first backlight feature value, retaining the advantages of both methods to some extent while mitigating their disadvantages. For example, the weighting coefficient ranges from 0.5 to 0.9. For instance, a P value of 0.85 can result in a very small halo effect on the vehicle display screen.

[0136] In some embodiments, Figure 4 This is a schematic flowchart illustrating a process for determining the backlight drive value after light source adjustment in a backlight zone, as provided in an embodiment of this disclosure. Figure 4 As shown, the backlight drive value after adjusting the light source in step S12 backlight partition specifically includes steps S121 to S124, wherein:

[0137] S121. Based on a preset mapping method, the first backlight feature value of each backlight zone is mapped to the corresponding backlight drive value before adjustment.

[0138] After obtaining the first backlight feature value of each backlight zone, the first backlight feature value of each backlight zone can be mapped to the corresponding backlight drive value before adjustment based on a preset mapping method. For example, the backlight drive value corresponding to the first backlight feature value can be retrieved by looking up a mapping lookup table, where different first backlight feature values ​​and their corresponding backlight drive values ​​are pre-stored. Alternatively, a pre-designed mapping algorithm can be used to map the first backlight feature value to the corresponding backlight drive value before adjustment. In subsequent processes, the backlight drive value obtained in step S121 can be input to the driving component (e.g., the driving chip) of the backlight assembly, so that the LEDs of each backlight zone of the backlight panel emit backlight corresponding to the target image. This completes the backlight processing.

[0139] Figure 5 This is a schematic diagram of an image to be displayed according to an embodiment of the present disclosure, such as... Figure 5 As shown, the backlight drive value of the backlight zones before adjustment is obtained through grayscale feature statistics. However, the backlight drive values ​​of adjacent backlight zones can differ significantly, leading to block effects. Applying mean filtering, maximum value filtering, or other processing methods will undoubtedly increase the brightness of the illuminated backlight zones, thereby increasing the halo effect and impacting the display quality.

[0140] S122. For any backlight zone, compare the backlight drive value before adjustment with the value of the first preset threshold.

[0141] If the backlight drive value before adjustment is less than the first preset threshold, proceed to step S123; if the backlight drive value before adjustment is greater than or equal to the first preset threshold, proceed to step S124.

[0142] The first preset threshold can be a reference backlight driving value determined empirically, such as... Figure 6 The backlight drive value indicated by node O in the diagram.

[0143] S123. Using a nonlinear mapping algorithm with display module parameter gamma < 1, determine the backlight drive value after the light source is adjusted in the backlight zone.

[0144] Figure 6 This is a schematic diagram of a gamma curve provided in an embodiment of the present disclosure, such as... Figure 6 As shown, the horizontal axis x represents the backlight drive value before adjustment, the vertical axis y represents the backlight drive value after adjustment, and 0 represents the baseline backlight drive value. The gamma parameter of the display module specifically reflects the brightness of the color at different gray levels.

[0145] like Figure 6As shown, taking RGB color depth of 10 bits as an example, the range of backlight drive value is [0, 1023]. Taking 0 in the range as the reference point, for the part of the backlight drive value before adjustment that is less than 0, a non-linear transformation is performed using a curve function of gamma < 1 to obtain the mapped adjusted backlight drive value.

[0146] S124. Using a nonlinear mapping algorithm with display module parameter gamma > 1, determine the backlight drive value after the light source is adjusted in the backlight zone.

[0147] like Figure 6 As shown, taking RGB color depth of 10 bits as an example, the range of backlight drive value is [0, 1023]. Taking 0 in the range as the reference point, for the part of the backlight drive value before adjustment that is greater than or equal to 0, a nonlinear transformation is performed using a curve function of gamma > 1 to obtain the mapped adjusted backlight drive value.

[0148] In this embodiment, steps S121 to S124 above utilize the first backlight characteristic values ​​of each backlight zone corresponding to the image to be displayed, combined with the screen characteristic gamma parameter of the display module, to achieve the desired result. Figure 6 The nonlinear transformation shown can increase smaller backlight drive values ​​and decrease larger backlight drive values, thereby making the backlight transition between adjacent backlight zones with large differences smoother, thus reducing halos and improving the display effect.

[0149] In some embodiments, for step S13, determining the second backlight characteristic value of each backlight zone specifically includes: for any backlight zone, the first backlight characteristic value of the backlight zone and the first backlight characteristic value of the first neighboring zone of the backlight zone can be weighted using N×N backlight diffusion factors in the backlight diffusion factor group to determine the second backlight characteristic value of each backlight zone.

[0150] In this backlight diffusion factor group, a larger value of N results in higher accuracy of the backlight diffusion simulation, but also a greater computational load; conversely, a smaller value of N results in lower accuracy of the backlight diffusion simulation, but a smaller computational load. Typically, N in the backlight diffusion factor group is set based on a combination of the accuracy and computational requirements of the light diffusion simulation. This embodiment uses N=9 as an example, meaning that backlight diffusion simulation is performed on 9×9 backlight zones.

[0151] The first neighboring partition includes backlight partitions whose partition distance from the backlight partition is less than or equal to a first preset distance threshold. For example, when N=9, the first preset distance threshold can be 4, then the first neighboring partition includes 9×9-1 backlight partitions centered on the 5th row, 5th column backlight partition, spaced 4 backlight partitions above, below, left, and right. As another example, when N=5, the first preset distance threshold can be 2, then the first neighboring partition includes 5×5-1 backlight partitions centered on the 3rd row, 3rd column backlight partition, spaced 2 backlight partitions above, below, left, and right.

[0152] Figure 7 A schematic diagram of a backlight zone and its first adjacent zone provided in an embodiment of this disclosure, as shown below. Figure 2 and 7 As shown, the second backlight characteristic value of backlight partition e5 can be obtained by using the 9×9 backlight diffusion factors p1~p81 in the backlight diffusion factor group and the first backlight characteristic value of the first neighboring partitions (a1~e4, e6~i9) of the backlight partition e5 with weighted summation.

[0153] It should also be noted that when the backlight partition located at the center is located at the edge of the entire backlight module, the first neighboring partition of the backlight partition located at the center also includes a virtual partition whose partition distance from the backlight partition is less than or equal to a first preset distance threshold.

[0154] In one scenario, the first backlight characteristic value of each virtual partition is preset to a fixed value. The preset fixed value can be set based on actual experience, for example, 0. Of course, other data can also be selected, and this embodiment does not specifically limit this.

[0155] In another scenario, each virtual partition is obtained by mirroring a backlight partition, such as a first mirror partition. The first backlight feature value of each first mirror partition is the first backlight feature value of the corresponding mirrored backlight partition. Taking this as an example... Figure 8 A flowchart illustrating a method for determining a second backlight feature value for a backlight zone, as provided in this embodiment of the disclosure, is shown below. Figure 8 As shown, the specific steps include S131 to S133, wherein:

[0156] S131. Based on the size information of N×N backlight diffusion factors and the size information of multiple backlight partitions divided by the backlight module, a preset mirroring algorithm is used to determine multiple first virtual mirror areas of the backlight module.

[0157] Each first virtual image region includes at least N rows and N columns of first image partitions.

[0158] Figure 9A schematic diagram of the first virtual mirror region provided in the embodiments of this disclosure, as shown below. Figure 9 As shown, there are a total of 8 first virtual mirror regions. Among them, the first virtual mirror region located at the upper left corner of the backlight module is 91, the first virtual mirror region located above the backlight module is 92, and the first virtual mirror region located on the left side of the backlight module is 93. This embodiment of the disclosure uses the first virtual mirror regions 91, 92, and 93 as examples to illustrate the setting of the first mirror partition in each virtual mirror region. The setting of the first mirror partition in the first virtual mirror regions in other directions is similar and will not be described again.

[0159] The dimensions of the N×N backlight diffusion factors are represented by N rows and N columns. The dimensions of the multiple backlight zones divided into the backlight module are represented by W rows and H columns, where W represents the number of backlight zones in the row direction and H represents the number of backlight zones in the column direction. Taking a 14.96-inch automotive display as an example, the backlight module is pre-divided into 48×24 backlight zones, where W=48 and H=24.

[0160] like Figure 9 As shown, the first virtual mirror region 91 includes N rows and N columns of first mirror partitions, each of which is obtained by mirroring the backlight partition based on the upper left vertex 94; the first virtual mirror region 92 includes N rows and W columns of first mirror partitions, each of which is obtained by mirroring the backlight partition based on the boundary 95; the first virtual mirror region 93 includes H rows and N columns of first mirror partitions, each of which is obtained by mirroring the backlight partition based on the boundary 96.

[0161] S132. Determine the first backlight feature value of the first mirror partition based on the first backlight feature value of the backlight partition corresponding to the first mirror partition.

[0162] In one scenario, a dedicated memory can be allocated to store the first backlight feature value of the first mirror partition. The first backlight feature value of the first mirror partition is the same as the first backlight feature value of the backlight partition mirrored by the first mirror partition. Then, the first backlight feature value of the first mirror partition can be directly retrieved from the memory corresponding to the first mirror partition.

[0163] However, if there are many first mirror partitions, the additional storage space required to store the first backlight feature values ​​of the first mirror partitions is large. For low-end chips, such as the GW2A-18 FPGA chip, block memory (BRAM) resources are very limited, so it is not possible to allocate separate BRAM storage for the mirrored data. Therefore, in the case of an FPGA chip, after determining each first mirror partition, a call address is configured for at least some of the first mirror partitions, and the first backlight feature values ​​of the first mirror partitions are read using the call addresses of the first mirror partitions.

[0164] Taking a backlight diffusion factor group including a 9×9 backlight diffusion factor as an example, for the first virtual mirror region 91, only the call addresses of each first mirror partition in rows 5-9 and columns 5-9 need to be configured. For the first virtual mirror region 92, only the call addresses of each first mirror partition in rows 5-9 need to be configured. For the first virtual mirror region 93, only the call addresses of each first mirror partition in columns 5-9 need to be configured.

[0165] Eighty-one backlight diffusion factors are stored in ROM, and the call address of the first mirror partition is stored in BRAM. It should be noted that the total amount of data in the call address is much smaller than the total amount of data in the first backlight feature values ​​of each first mirror partition.

[0166] Specifically, this embodiment only requires one BRAM. Data is stored in rows and columns, for example, starting from the address of the first backlight feature value of the backlight partition in row 5, column 5. When performing 9×9 convolution calculation, the first backlight feature value of backlight partition e5 and the first neighboring partitions (a1~e4, e6~i9) of the backlight partition are weighted and summed. When reading the first neighboring partition of row 1, the read BRAM address is mirrored and offset to row 9, thereby reading the first backlight feature value corresponding to the first neighboring partition of row 9 as the first backlight feature value of the first neighboring partition of row 1. When reading the first neighboring partition of row 2, the read BRAM address is mirrored and offset to row 8, thereby reading the first backlight feature value corresponding to the first neighboring partition of row 8 as the first backlight feature value of the first neighboring partition of row 2. When reading the first neighboring partition of row 3, the read BRAM address is mirrored and offset to row 7, thereby reading the first backlight feature value corresponding to the first neighboring partition of row 7 as the first backlight feature value of the first neighboring partition of row 3. When reading the first neighboring partition in row 4, the read BRAM address is mirrored and offset to row 6, thereby reading the first backlight feature value corresponding to the first neighboring partition in row 6, which is then used as the first backlight feature value of the first neighboring partition in row 4. Similarly, when reading the first neighboring partition in column 1, the read BRAM address is mirrored and offset to column 9, thereby reading the first backlight feature value corresponding to the first neighboring partition in column 9, which is then used as the first backlight feature value of the first neighboring partition in column 1. When reading the first neighboring partition in column 2, the read BRAM address is mirrored and offset to column 8, thereby reading the first backlight feature value corresponding to the first neighboring partition in column 8, which is then used as the first backlight feature value of the first neighboring partition in column 2. When reading the first neighboring partition in column 3, the read BRAM address is mirrored and offset to column 7, thereby reading the first backlight feature value corresponding to the first neighboring partition in column 7, which is then used as the first backlight feature value of the first neighboring partition in column 3. When reading the first neighboring partition in column 4, the read BRAM address is mirrored and offset to column 6, thereby reading the first backlight feature value corresponding to the first neighboring partition in column 6, which is then used as the first backlight feature value of the first neighboring partition in column 4. This method can achieve 9×9 convolution without increasing the amount of BRAM used, simply by mirroring the read row and column addresses, thus meeting the requirements of low chip resource utilization.

[0167] S133. For any backlight zone, the first backlight characteristic value of the backlight zone and the first backlight characteristic value of the first neighboring zone of the backlight zone are weighted using N×N backlight diffusion factors in the backlight diffusion factor group to determine the second backlight characteristic value of each backlight zone.

[0168] Taking backlight zone e5 as an example, the first backlight feature value of backlight zone e5 and the first backlight feature values ​​of its first neighboring zones (including the surrounding backlight zones and the first mirror zone), multiplied by the sum of the corresponding obtained backlight diffusion factors, are the second backlight feature value of backlight zone e5.

[0169] Here, the backlight diffusion factor group can eliminate the influence of backlight zone light diffusion, thereby improving the display effect.

[0170] In some embodiments, Figure 10 This is a schematic diagram of a pixel compensation process provided in an embodiment of the present disclosure, as shown below. Figure 10 As shown, it includes steps S14-1-1 to S14-1-3, wherein:

[0171] S14-1-1 Filter the second backlight feature value of each backlight zone to obtain the fourth backlight feature value of each backlight zone.

[0172] In certain display scenarios, the brightness differences between different backlight zones are significant. Even after performing backlight simulations in the aforementioned S131-S133 processes, noticeable differences still exist, leading to block effects during compensation. To improve this deficiency, embodiments of this disclosure employ mean filtering to process the second backlight characteristic values ​​of each backlight zone, obtaining the fourth backlight characteristic value for each backlight zone.

[0173] Specifically, for each backlight zone, a pre-determined set of filtering coefficients can be used to filter the second backlight characteristic value of the backlight zone and the second backlight characteristic value of the second neighboring zone of the backlight zone to determine the fourth backlight characteristic value of the backlight zone.

[0174] The filter coefficient set consists of n×n filter coefficients, where n is a positive integer. A larger value of n in the filter coefficient set results in higher filtering accuracy but also greater computational complexity; conversely, a smaller value of n results in lower filtering accuracy but less computational complexity. Typically, the value of n in the filter coefficient set is set based on a combination of the required filtering accuracy and computational complexity. This embodiment uses n=5 as an example, i.e., performing mean filtering on 5×5 filter coefficients.

[0175] The second neighboring partition includes backlight partitions whose partition distance from the backlight partition is less than or equal to a second preset distance threshold. For example, when n=5, the second preset distance threshold can be 2, then the second neighboring partition includes 5×5-1 backlight partitions with the backlight partition in the 3rd row and 3rd column as the center, with 2 backlight partitions spaced above, below, left and right.

[0176] Figure 11a This is a schematic diagram of a backlight zone and its second adjacent zone provided in an embodiment of this disclosure. Figure 11bA schematic diagram of a filter coefficient group provided in an embodiment of this disclosure is shown below. Figure 11a and 11b As shown, the second backlight feature value of backlight partition B33 can be obtained by using the 5×5 filter coefficients q1~q25 in the filter coefficient group and the second backlight feature values ​​of the second neighboring partitions (B11~B32, B34~B55) of the backlight partition with weighted summation.

[0177] It should also be noted that when the backlight partition located at the center is located at the edge of the entire backlight module, the second neighboring partition of the backlight partition located at the center also includes a virtual partition whose partition distance from the backlight partition is less than or equal to a second preset distance threshold.

[0178] In one scenario, the second backlight characteristic value of each virtual partition is preset to a fixed value. The preset fixed value can be set based on actual experience, for example, 0. Of course, other data can also be selected, and this embodiment does not specifically limit this.

[0179] In another scenario, each virtual partition is obtained by mirroring a backlight partition, such as a second mirror partition. The second backlight feature value of each second mirror partition is the second backlight feature value of the corresponding mirrored backlight partition. For example, in this case... Figure 12 A flowchart illustrating a method for determining a fourth backlight feature value for a backlight zone, as provided in this embodiment of the disclosure, is shown below. Figure 12 As shown, the specific steps include S14-1-11 to S14-1-13, wherein:

[0180] S14-1-11. Based on the size information of n×n filter coefficients and the multiple backlight partitions divided by the backlight module, multiple second virtual mirror areas of the backlight module are determined using a preset mirroring algorithm.

[0181] Each second virtual mirror region includes at least n rows and n columns of second mirror partitions. The size information of the n×n filter coefficients also corresponds to n rows and n columns. The size information of the multiple backlight partitions divided by the backlight module is also W rows and H columns, where W represents the number of backlight partitions divided in the row direction of the backlight module, and H represents the number of backlight partitions divided in the column direction of the backlight module. Taking a 14.96-inch automotive display as an example, the backlight module is pre-divided into 48×24 backlight partitions, where W=48 and H=24.

[0182] The principle for determining the second virtual image region is the same as that for determining the first virtual image region, and the repeated parts will not be repeated.

[0183] S14-1-12. Determine the second backlight feature value of the second mirror partition based on the second backlight feature value of the backlight partition corresponding to the mirror of the second mirror partition.

[0184] In one scenario, a dedicated memory can be allocated to store the second backlight feature value of the second mirror partition. The second backlight feature value of the second mirror partition is identical to the second backlight feature value of the backlight partition it mirrors. Subsequently, the second backlight feature value of the second mirror partition can be directly retrieved from the memory corresponding to that second mirror partition.

[0185] It should be noted that if there are many second mirror partitions, the additional storage space required to store the second backlight feature values ​​of the second mirror partitions is large. For low-end chips, such as the GW2A-18 FPGA chip, block memory (BRAM) resources are very limited, so it is not possible to allocate separate BRAM for the mirrored data. Therefore, in the case of an FPGA chip, after determining each second mirror partition, a call address is configured for at least some of the second mirror partitions, and the second backlight feature values ​​of the second mirror partitions are read using the configured call addresses of the second mirror partitions.

[0186] The 25 filter coefficients are stored in ROM, and the call address of the second mirror partition is stored in BRAM. It should be noted that the total amount of data in the call address is much smaller than the total amount of data in the second backlight feature values ​​of each second mirror partition.

[0187] Specifically, this embodiment only requires one BRAM, and data is stored in rows and columns. For example, storage starts from the address of the second backlight feature value of the backlight partition in the 3rd row and 3rd column. When performing 5×5 filtering calculation, the second backlight feature value of backlight partition B11 and the second neighboring partitions (B11~B32, B34~B55) of the backlight partition are weighted and summed. When reading the second neighboring partition of the 1st row, the read BRAM address is mirrored and offset to the 5th row, thereby reading the second backlight feature value corresponding to the second neighboring partition of the 5th row as the second backlight feature value of the second neighboring partition of the 1st row. When reading the second neighboring partition of the 2nd row, the read BRAM address is mirrored and offset to the 4th row, thereby reading the second backlight feature value corresponding to the second neighboring partition of the 4th row as the second backlight feature value of the second neighboring partition of the 2nd row. Similarly, when reading the second neighboring partition of column 1, the read BRAM address is mirrored and offset to column 5, thereby reading the second backlight feature value corresponding to the second neighboring partition of column 5, which is used as the second backlight feature value of the second neighboring partition of column 1. When reading the second neighboring partition of column 2, the read BRAM address is mirrored and offset to column 4, thereby reading the second backlight feature value corresponding to the second neighboring partition of column 4, which is used as the second backlight feature value of the second neighboring partition of column 2. This method can achieve 5×5 filtering without increasing the amount of BRAM used, simply by mirroring and offsetting the read row and column addresses, thus meeting the requirements of low chip resource utilization.

[0188] S14-1-13. For any backlight zone, the second backlight characteristic value of the backlight zone and the second backlight characteristic value of the second neighboring zone of the backlight zone are weighted using the n×n filter coefficients in the filter coefficient group to determine the fourth backlight characteristic value of each backlight zone.

[0189] Taking backlight zone B11 as an example, the second backlight feature value of backlight zone B11 and the second backlight feature values ​​of its second neighboring zones (including the surrounding backlight zones and the second mirror zone), multiplied by the sum of the corresponding obtained filtering coefficients, are the fourth backlight feature value of backlight zone B11.

[0190] In steps S14-1-11 to S14-1-13 above, filtering through the filter coefficient group can improve the block effect and thus enhance the display effect.

[0191] S14-1-2. Based on the fourth backlight feature value of each backlight zone, the third backlight feature value of each pixel in the image to be displayed is determined using a preset linear interpolation algorithm.

[0192] The preset linear interpolation algorithm can be, for example, a bilinear interpolation algorithm, a trilinear interpolation algorithm, a nearest neighbor interpolation algorithm, etc., and this embodiment does not specifically limit it.

[0193] For example, based on the fourth backlight feature value of each backlight zone, the third backlight feature value of each pixel in the image to be displayed is determined using a bilinear interpolation algorithm.

[0194] Figure 13 This is a schematic flowchart illustrating a method for determining the third backlight feature value of each pixel, as provided in an embodiment of this disclosure. Figure 13 As shown, the specific steps include S14-1-21 to S14-1-24, wherein:

[0195] S14-1-21. Divide multiple backlight zones into multiple backlight zone groups, with each backlight zone group containing 2×2 backlight zones.

[0196] S14-1-22. For each backlight zone group, determine the central area of ​​the backlight zone group based on the center position of each backlight zone in the backlight zone group.

[0197] The number of pixels in the central area is equal to the number of pixels in the backlight zones. Taking a 14.96-inch automotive display as an example, the number of pixels in the central area is 50×50.

[0198] Figure 14a This is a schematic diagram of bilinear interpolation provided in an embodiment of this disclosure. Figure 14b for Figure 14a A schematic diagram of the corresponding interpolation model is shown below. Figure 14a and Figure 14b As shown, 41 represents the backlight zone group, 42 represents the backlight zone, and 421, 422, 423, and 424 represent the center points of the four backlight zones 411, respectively. The coordinates of the center points are mapped to, for example, (0, 0), (0, 1), (1, 0), and (1, 1) in the bilinear interpolation algorithm.

[0199] The formula (6) for calculating the third backlight feature value f(i,j) of any pixel (i,j) within the central region 43 enclosed by the center points of the four backlight partitions is as follows:

[0200] f(i,j)=A1×(1-x)×(1-y)+A2×x×(1-x)+A3×(1-x)×y+A4×x×y…..……..Formula 6)

[0201] Where A1, A2, A3, and A4 represent the fourth backlight feature values ​​of the four backlight partitions 411, 421, 422, 423, and 424, respectively. The value of x is mapped to the i / W value corresponding to the actual pixel point (i,j), and the value of x is mapped to the j / H value corresponding to the actual pixel point (i,j), where the range of i is [0,W-1] and the range of j is [0,H-1]. Thus, according to formula (6), we can obtain W×H values ​​that correspond one-to-one with the W×H pixels in the central region 43.

[0202] However, the values ​​of i / W and j / H are both decimals. In the GW2A-18 FPGA, the digital signal processor (i.e., the DSP multiplier) does not support decimal calculations, so data such as x, y, (1-x), and (1-y) need to be quantized.

[0203] S14-1-23. Based on the size information of the central region, determine the quantization data for linear interpolation of each pixel.

[0204] The size information of the central region is also known as the number of pixels in the central region, which is W×H pixels. The data "1" is quantized to 50, the data x is quantized to 50x, and the data y is quantized to 50y.

[0205] In the GW2A-18 FPGA, the digital signal processor (DSP multiplier) supports bit width calculations of 9×9, 18×18, and 36×36, with a total of 48 multipliers. The 9×9 bit-width DSP does not support calculations on unquantized data. Therefore, in this embodiment, the position data of each pixel in the central region is first quantized. This ensures that the 9×9 bit-width DSP can be utilized, thereby reducing the waste of DSP resources.

[0206] After using a 9×9 DSP, the second product operation can use an 18×18 DSP multiplier, avoiding waste of resources.

[0207] S14-1-24. For any backlight partition group, based on the fourth backlight feature value of each backlight partition in the backlight partition group and the quantization data of the pixels in the central region, the third backlight feature value of each pixel in the central region is determined using a preset linear interpolation algorithm.

[0208] Referring to formula (6), determine the intermediate backlight feature value f(i,j)′ of each pixel in the central region: f(i,j)′=A1×(50-50x)×(50-50y)+A2×50x×(50-50x)+A3×(50-50x)×50y+A4×50x×50y

[0209] Then, for any pixel, the third backlight feature value of the pixel is f(i,j) = f(i,j)′ / 50.

[0210] The process for determining the third backlight feature value of each pixel in other central regions is similar, and repeated parts will not be described again. In this step, the central regions of each backlight partition group constitute multiple backlight partitions of the backlight module. Therefore, by determining the third backlight feature value of each pixel in each central region, the third backlight feature value of each pixel in each backlight partition can be obtained.

[0211] S14-1-3. Based on the third backlight feature value of each pixel in the image to be displayed, compensate the first pixel data of each pixel in the image to be displayed to obtain the compensated second pixel data.

[0212] Figure 15 This is a schematic diagram illustrating a process of compensating the first pixel data of each pixel in an image to be displayed, as provided in an embodiment of this disclosure, to obtain compensated second pixel data. Figure 15 As shown, the specific steps include S14-1-31 to S14-1-33, wherein:

[0213] S14-1-31. For any pixel in the image to be displayed, determine the first compensation factor of the pixel based on the third backlight feature value of the pixel.

[0214] Taking pixel (i,j) as an example, the process of determining the second compensation factor is shown in the following formula (7):

[0215]

[0216] Where factor(i,j) represents the first compensation factor for pixel (i,j); BL base Represents a constant that is actually measured, such as BL. base Get the preset maximum pixel grayscale value; BL pix (i,j) represents the third backlight feature value of pixel (i,j); γ is a constant value, for example, 2.2.

[0217] S14-1-32. Determine the second compensation factor of the pixel based on the first compensation factor and the first gray value of the pixel.

[0218] Taking pixel (i,j) as an example, the process of determining the first compensation factor is shown in the following formula (8):

[0219]

[0220] Where, factor min (i,j) is the first compensation factor for pixel (i,j); gray max(i,j) represents the first gray value of pixel (i,j); factor(i,j) represents the first compensation factor of pixel (i,j).

[0221] S14-1-33. Using the second compensation factor, the first pixel data of the pixel is compensated to obtain the second pixel data of the pixel.

[0222] Taking pixel (i,j) as an example, the process of determining the second pixel data of pixel (i,j) is shown in the following formula (9):

[0223] R′(i,j)=R(i,j)×factor min (i,j)

[0224] G′(i,j)=G(i,j)×factor min (i,j)

[0225] B′(i,j)=B(i,j)×factor min (i,j)……………..Formula(9)

[0226] The second pixel data includes the sub-pixel values ​​of each sub-pixel (R, G, and B) contained in the pixel, namely R′(i,j), G′(i,j), and B′(i,j).

[0227] In some embodiments, Figure 16 This is a schematic diagram of another pixel compensation process provided in an embodiment of this disclosure, as shown below. Figure 16 As shown, it includes steps S14-2-1 to S14-2-2, wherein:

[0228] S14-2-1. Based on the second backlight feature value of each backlight zone, the third backlight feature value of each pixel in the image to be displayed is determined using a preset linear interpolation algorithm.

[0229] The process of determining the third backlight feature value of each pixel in this step can be found in the detailed implementation process of determining the third backlight feature value of each pixel in step S14-1-2 above. The repeated parts will not be described again.

[0230] S14-2-2. Based on the third backlight feature value of each pixel in the image to be displayed, the first pixel data of each pixel in the image to be displayed is compensated to obtain the compensated second pixel data.

[0231] The process of obtaining the compensated second pixel data in this step can be found in the detailed implementation process of obtaining the compensated second pixel data in step S14-1-3 above. The repeated parts will not be described again.

[0232] In some embodiments, when the display conditions of the target image are met, the backlight driving values ​​of multiple backlight zones and the second pixel data of each pixel are simultaneously input to the driving component and the display module.

[0233] In other words, if the display conditions of the image to be displayed are met, the backlight driving values ​​of multiple backlight zones and the second pixel data of each pixel are input into the driving component and the display module in the backlight module, respectively, so that the driving component drives the light source of multiple backlight zones to emit backlight corresponding to the image to be displayed, and at the same time the display module displays the image to be displayed.

[0234] In this embodiment of the disclosure, backlight data (backlight driving values ​​of each backlight area) and pixel data (second pixel data of each pixel) corresponding to the same image to be displayed are simultaneously sent to the backlight module and the display module, respectively, to ensure the matching of backlight data and pixel data.

[0235] To facilitate understanding of the various embodiments of this disclosure, the implementation flow of the display control method is described below with a complete example. Figure 17 This is a schematic flowchart illustrating the display control method provided in the embodiments of this disclosure, as shown below. Figure 17 As shown, it includes steps S21 to S29, wherein:

[0236] S21. Input the image to be displayed;

[0237] S22. Perform grayscale feature extraction by weighting the average value method and the maximum value method, and execute steps S23 and S28 simultaneously.

[0238] S23, 9×9 convolution determines the second backlight feature value of each backlight zone;

[0239] S24, 5×5 filtering determines the fourth backlight characteristic value of each backlight zone;

[0240] S25. Use bilinear interpolation to determine the third backlight feature value of each pixel in the image to be displayed;

[0241] S26. Compensate the first pixel data of each pixel in the image to be displayed;

[0242] S27. Input the compensated second pixel data into the display module for image display.

[0243] S28, gamma nonlinear transformation, to determine the backlight drive value after the light source is adjusted in the backlight zone;

[0244] S29. Input the adjusted backlight drive value of the backlight zone into the drive component in the backlight module, so that the drive component drives the light sources of multiple backlight zones to emit backlight corresponding to the image to be displayed.

[0245] The display control method disclosed herein improves upon traditional algorithms based on screen characteristics and chip resource characteristics, enabling it to enhance contrast, reduce power consumption, and improve image display details, while also being deployable on low-end chips to reduce product costs.

[0246] The above is a complete description of the display control method provided in this disclosure.

[0247] Those skilled in the art will understand that, in the above-described method of the specific implementation, the order in which each step is written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0248] Secondly, this disclosure also provides a display control device corresponding to the display control method. Since the principle of the device in this disclosure is similar to the above-mentioned display control method in this disclosure, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be described again.

[0249] Figure 18 This is a schematic diagram of a display control device provided in an embodiment of the present disclosure, such as... Figure 18 As shown, the system includes a first processing module 31, a second processing module 32, a third processing module 33, and a fourth processing module 34. The first processing module 31 is configured to determine the first backlight feature value of each backlight zone of the backlight module based on the first pixel data of each pixel in the image to be displayed. The second processing module 32 is configured to determine the backlight driving value of the light source in each backlight zone based on the first backlight feature value of each backlight zone. The third processing module 33 is configured to determine the second backlight feature value of each backlight zone based on a pre-set backlight diffusion factor group and the first backlight feature value of each backlight zone. The backlight diffusion factor group includes N×N backlight diffusion factors, where N is a positive integer. The fourth processing module 34 is configured to compensate the first pixel data of each pixel in the image to be displayed based on the second backlight feature value of each backlight zone to obtain compensated second pixel data for display.

[0250] The embodiments disclosed herein essentially improve upon traditional display algorithms based on screen characteristics and chip resource characteristics. By combining the first backlight feature values ​​of each backlight zone corresponding to the image to be displayed with the screen characteristics of the display module, the backlight drive values ​​of the light sources in each backlight zone are smoothed, thereby reducing backlight differences between adjacent backlight zones. Simultaneously, the influence of backlight diffusion in the backlight zones is eliminated according to a pre-set backlight diffusion factor group. Furthermore, based on the second backlight feature values ​​of each backlight zone, the first pixel data of each pixel in the image to be displayed is compensated, which can improve the contrast of the image to be displayed, reduce power consumption, enhance image display details, and thus improve the display effect. Moreover, the above-described display control method can be deployed on low-end chips, such as FPGAs, thereby reducing the cost of display products.

[0251] Thirdly, this disclosure also provides a display device corresponding to the display control method. Since the principle of the display device in this disclosure for solving the problem is similar to the above-mentioned display control method in this disclosure, the implementation of the display device can refer to the implementation of the method, and the repeated parts will not be described again.

[0252] Figure 19 A schematic diagram of a display device provided in an embodiment of this disclosure, such as... Figure 19 As shown, the display device includes a backlight module 51, a display module 52, and a display control device 53. The display control device 53 is connected to the backlight module 51 and the display module 52 respectively, and the display control device 53 adopts the display control device of the second aspect described above. The backlight module 51 includes a driving component and multiple backlight zones. The driving component is used to drive the multiple backlight zones to emit backlight according to the backlight driving values ​​of the multiple backlight zones. The display module 52 is used to display according to the input second pixel data.

[0253] In some embodiments, the display control device 53 may be a field-programmable gate array (FPGA) or other types of logic devices, and this disclosure does not limit it.

[0254] In some embodiments, display module 52 includes a 14.96-inch display screen.

[0255] Fourthly, embodiments of this disclosure also provide an electronic device, Figure 20 A schematic diagram of an electronic device provided in an embodiment of this disclosure, such as... Figure 20As shown, the electronic device includes one or more processors 601, a memory 602, and one or more I / O interfaces 603. The memory 602 stores one or more programs, which, when executed by the one or more processors, cause the one or more processors to implement any of the display control methods described in the above embodiments; the one or more I / O interfaces 603 are connected between the processor and the memory, configured to enable information interaction between the processor and the memory.

[0256] The processor 601 is a device with data processing capabilities, including but not limited to a central processing unit (CPU); the memory 602 is a device with data storage capabilities, including but not limited to random access memory (RAM, more specifically SDRAM, DDR, etc.), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), and flash memory (FLASH); the I / O interface (read / write interface) 603 is connected between the processor 601 and the memory 602, enabling information exchange between the processor 601 and the memory 602, including but not limited to a data bus (Bus).

[0257] In some embodiments, the processor 601, memory 602, and I / O interface 603 are interconnected via bus 604, and thus connected to other components of the computing device.

[0258] In some embodiments, the one or more processors 601 include a field-programmable gate array (FPGA).

[0259] Fifthly, embodiments of this disclosure also provide a computer non-transient readable storage medium. This computer non-transient readable storage medium stores a computer program, wherein when executed by a processor, the program implements the steps of any of the display control methods described in the above embodiments.

[0260] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a machine-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication component, and / or installed from a removable medium. When the computer program is executed by a central processing unit (CPU), it performs the functions defined above in the system of this disclosure.

[0261] It should be noted that the computer-readable non-transient readable medium disclosed herein may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. Computer-readable storage media may be, for example, but not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disc read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. The transmitted data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The computer-readable signal medium can also be any non-transient readable computer storage medium other than a computer-readable storage medium, which can transmit, propagate, or transfer a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the non-transient readable computer storage medium can be transmitted using any suitable medium, including but not limited to: wireless, wire, optical fiber, RF, etc., or any suitable combination thereof.

[0262] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the drawings. For example, two adjacent blocks may actually represent substantially parallel execution, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0263] It is understood that the above embodiments are merely exemplary embodiments used to illustrate the principles of this disclosure, and this disclosure is not limited thereto. For those skilled in the art, various modifications and improvements can be made without departing from the spirit and substance of this disclosure, and these modifications and improvements are also considered to be within the scope of protection of this disclosure.

Claims

1. A display control method, wherein, include: Based on the first pixel data of each pixel in the image to be displayed, determine the first backlight feature value of each backlight zone of the backlight module; Based on the first backlight characteristic value of each backlight zone, determine the backlight driving value of the light source in each backlight zone; The first neighboring partition of the backlight partition includes a backlight partition whose partition distance from the backlight partition is less than or equal to a first preset distance threshold; the first neighboring partition also includes a first mirror partition whose partition distance from the backlight partition is less than or equal to the first preset distance threshold; Based on the size information of N×N backlight diffusion factors and the size information of multiple backlight partitions divided by the backlight module, a multiple first virtual mirror regions of the backlight module are determined using a preset mirroring algorithm. Each of the first virtual mirror regions includes at least N rows and N columns of first mirror partitions; The first backlight feature value of the first mirror partition is determined based on the first backlight feature value of the backlight partition corresponding to the first mirror partition. The backlight diffusion factor group includes N×N backlight diffusion factors, where N is a positive integer; for any backlight partition, the first backlight feature value of the backlight partition and the first backlight feature value of the first neighboring partition of the backlight partition are weighted using the N×N backlight diffusion factors in the pre-set backlight diffusion factor group to determine the second backlight feature value of each backlight partition. Based on the second backlight feature value of each backlight zone, the first pixel data of each pixel in the image to be displayed is compensated to obtain the compensated second pixel data for display.

2. The display control method according to claim 1, wherein, The step of determining the first backlight feature value of each backlight zone of the backlight module based on the first pixel data of each pixel in the image to be displayed includes: Based on the first pixel data of each pixel in the image to be displayed, grayscale features are extracted from each pixel to obtain the first grayscale value of each pixel. For any of the backlight partitions, based on the first grayscale values ​​of each pixel corresponding to the backlight partition, the maximum value among the first grayscale values ​​is determined as the second grayscale value of the backlight partition, and the average value of the first grayscale values ​​of each pixel corresponding to the backlight partition is determined as the third grayscale value of the backlight partition. The first backlight feature value of the backlight partition is determined based on the second gray value, the third gray value, and the preset weighting coefficient; the preset weighting coefficient ranges from 0 to 1.

3. The display control method according to claim 2, wherein, The weighting coefficients range from 0.5 to 0.

9.

4. The display control method according to claim 1, wherein, The step of determining the backlight drive value of the light source in each of the backlight zones based on the first backlight feature value of each of the backlight zones includes: Based on a preset mapping method, the first backlight feature value of each backlight zone is mapped to the corresponding backlight drive value before adjustment. For any backlight zone, if the backlight drive value before adjustment is less than a first preset threshold, a non-linear mapping algorithm with display module parameter gamma < 1 is used to determine the backlight drive value after adjustment of the light source in the backlight zone; if the backlight drive value before adjustment is greater than or equal to the first preset threshold, a non-linear mapping algorithm with display module parameter gamma > 1 is used to determine the backlight drive value after adjustment of the light source in the backlight zone.

5. The display control method according to claim 1, wherein, The step of determining the first backlight feature value of the first mirrored partition based on the first backlight feature value of the backlight partition corresponding to the first mirrored partition includes: Configure a call address for at least a portion of the first mirror partition, and use the configured call address of the first mirror partition to read the first backlight feature value of the first mirror partition.

6. The display control method according to claim 1, wherein, The step of compensating the first pixel data of each pixel in the image to be displayed based on the second backlight feature value of each of the backlight zones to obtain the compensated second pixel data includes: Based on the second backlight feature value of each backlight zone, the third backlight feature value of each pixel in the image to be displayed is determined using a preset linear interpolation algorithm. Based on the third backlight feature value of each pixel in the image to be displayed, the first pixel data of each pixel in the image to be displayed is compensated to obtain the compensated second pixel data.

7. The display control method according to claim 1, wherein, The step of compensating the first pixel data of each pixel in the image to be displayed based on the second backlight feature value of each of the backlight zones to obtain the compensated second pixel data includes: The second backlight feature value of each backlight zone is filtered to obtain the fourth backlight feature value of each backlight zone; Based on the fourth backlight feature value of each backlight zone, the third backlight feature value of each pixel in the image to be displayed is determined using a preset linear interpolation algorithm. Based on the third backlight feature value of each pixel in the image to be displayed, the first pixel data of each pixel in the image to be displayed is compensated to obtain the compensated second pixel data.

8. The display control method according to claim 7, wherein, The step of filtering the second backlight feature value of each of the backlight zones to obtain the fourth backlight feature value of each of the backlight zones includes: For each of the backlight zones, a predetermined set of filtering coefficients is used to filter the second backlight feature value of the backlight zone and the second backlight feature value of the second neighboring zones of the backlight zone to determine the fourth backlight feature value of the backlight zone; wherein, the second neighboring zones include backlight zones whose zone distance from the backlight zone is less than or equal to a second preset distance threshold.

9. The display control method according to claim 8, wherein, The second neighboring partition also includes a second mirror partition whose partition distance from the backlight partition is less than or equal to a second preset distance threshold; the filter coefficient group includes n×n filter coefficients, where n is a positive integer; Before determining the fourth backlight feature value of the backlight partition by filtering the second backlight feature value of the backlight partition and the second backlight feature value of the second neighboring partition of the backlight partition using a predetermined set of filtering coefficients, the method further includes: Based on the size information of n×n filter coefficients and the multiple backlight partitions divided by the backlight module, a multiple second virtual mirror region of the backlight module is determined using a preset mirroring algorithm; The second backlight feature value of the second mirror partition is determined based on the second backlight feature value of the backlight partition corresponding to the mirror of the second mirror partition.

10. The display control method according to claim 9, wherein, The step of determining the second backlight feature value of the second mirrored partition based on the second backlight feature value of the backlight partition corresponding to the second mirrored partition includes: Configure a call address for at least a portion of the second mirror partition, and use the configured call address of the second mirror partition to read the second backlight feature value of the second mirror partition.

11. The display control method according to claim 7, wherein, The step of determining the third backlight feature value of each pixel in the image to be displayed based on the fourth backlight feature value of each of the backlight zones using a preset linear interpolation algorithm includes: The multiple backlight zones are divided into multiple backlight zone groups, and each backlight zone group includes 2×2 backlight zones; For each of the backlight partition groups, the central region of the backlight partition group is determined according to the center position of each of the backlight partitions in the backlight partition group; the number of pixels in the central region is equal to the number of pixels in the backlight partition. Based on the size information of the central region, determine the quantization data for linear interpolation of each pixel; For any of the backlight partition groups, the third backlight feature value of each pixel in the central region is determined by using a preset linear interpolation algorithm based on the fourth backlight feature value of each backlight partition in the backlight partition group and the quantized data of the pixel in the central region; the central region of each backlight partition group constitutes multiple backlight partitions of the backlight module.

12. The display control method according to claim 7, wherein, The step of compensating the first pixel data of each pixel in the image to be displayed based on the third backlight feature value of each pixel in the image to be displayed, to obtain the compensated second pixel data, includes: For any pixel in the image to be displayed, a first compensation factor for the pixel is determined based on the third backlight feature value of the pixel. The second compensation factor of the pixel is determined based on the first compensation factor and the first gray value of the pixel. The second compensation factor is used to compensate the first pixel data of the pixel to obtain the second pixel data of the pixel.

13. A display control device, comprising a first processing module, a second processing module, a third processing module, and a fourth processing module; The first processing module is configured to determine the first backlight feature value of each backlight partition of the backlight module based on the first pixel data of each pixel in the image to be displayed. The second processing module is configured to determine the backlight driving value of the light source in each of the backlight zones based on the first backlight feature value of each of the backlight zones. The first neighboring partition of the backlight partition includes a backlight partition whose partition distance from the backlight partition is less than or equal to a first preset distance threshold; the first neighboring partition also includes a first mirror partition whose partition distance from the backlight partition is less than or equal to the first preset distance threshold; The third processing module is configured to determine multiple first virtual mirror regions of the backlight module based on the size information of N×N backlight diffusion factors and the size information of multiple backlight partitions divided by the backlight module using a preset mirroring algorithm. Each of the first virtual mirror regions includes at least N rows and N columns of first mirror partitions; The first backlight feature value of the first mirror partition is determined based on the first backlight feature value of the backlight partition corresponding to the first mirror partition. The backlight diffusion factor group includes N×N backlight diffusion factors, where N is a positive integer. For any backlight partition, the first backlight feature value of the backlight partition and the first backlight feature value of the first neighboring partition of the backlight partition are weighted using the N×N backlight diffusion factors in the pre-set backlight diffusion factor group to determine the second backlight feature value of each backlight partition. The fourth processing module is configured to compensate the first pixel data of each pixel in the image to be displayed based on the second backlight feature value of each backlight partition, so as to obtain the compensated second pixel data for display.

14. A display device, wherein, include: A backlight module, a display module, and a display control device, wherein the display control device is connected to the backlight module and the display module respectively, and the display control device is the display control device according to claim 13; The backlight module includes a driving component and multiple backlight zones. The driving component is used to drive the multiple backlight zones to emit backlight according to the backlight driving values ​​of the multiple backlight zones. The display module is used to display data based on the input second pixel data.

15. The display device according to claim 14, wherein, The display module includes a 14.96-inch display screen.

16. An electronic device, wherein, include: One or more processors; Memory, used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the display control method as described in any one of claims 1 to 12.

17. The electronic device according to claim 16, wherein, The processor includes a field-programmable gate array (FPGA).

18. A computer-defined non-transient readable storage medium, wherein, The computer non-transient readable storage medium stores a computer program that, when executed by a processor, performs the steps of the display control method as described in any one of claims 1 to 12.

Images