A instrument screen display method and device based on local dimming

Abstract

The present invention is a method and device for instrument screen display based on local dimming, comprising: acquiring a frame of image data; performing partition error correction according to the pixel value of the image data to obtain partition backlight data; performing mixed light simulation calculation according to the partition backlight data to obtain pixel backlight data; calculating pixel compensation parameters corresponding to the image data according to the pixel backlight data; processing the image data according to the pixel compensation parameters to obtain processed image data, and displaying the processed image data based on the partition backlight data; using an error correction method to perform backlight calculation to obtain calculation parameters corresponding to backlight partitions, thereby solving the contradiction between reducing module power consumption and maintaining image quality; reducing the usage of BRAM resources by intermediate cache data to reduce FPGA chip costs.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to an instrument screen display method based on local dimming, an instrument screen display device based on local dimming, a computer device and a storage medium. Background Art

[0002] In the automotive field, in the cockpit of electric vehicles, high dynamic contrast video images are displayed to the driver and the co-driver, which can provide users with a good visual experience. Specifically, in the image processing technology of the car display screen, the technical indicator pursued by local dimming is to make the bright field brighter and the dark field darker in the picture, so as to improve the display contrast of the picture. The contrast of ordinary displays is generally 5000:1, and the use of local dimming technology can improve the backlight brightness on the one hand and reduce the degree of light leakage in the dark field on the other hand, so the contrast can be increased to 100000:1. At this contrast, the image can highlight the three-dimensional effect of the picture, and compared with the case of full backlight, it can reduce the power consumption of the display module and enhance the expression of dark field details. At present, the local dimming technology used in the central control screen of the smart cockpit has not yet matured and has not been widely used. There are several technical deficiencies: the cost of the chip used to carry the local dimming technology is high; the expression of dark field details is not strong; the real-time performance of large-resolution video processing is poor; the ability to balance power consumption reduction and image quality is insufficient. Summary of the invention

[0003] In view of the above problems, embodiments of the present invention are proposed to provide an instrument screen display method based on local dimming, an instrument screen display device based on local dimming, a computer device and a storage medium that overcome the above problems or at least partially solve the above problems.

[0004] To achieve the above object, an embodiment of the present invention proposes an instrument screen display method based on local dimming, the method comprising:

[0005] Get a frame of image data;

[0006] Performing partition error correction according to the pixel values ​​of the image data to obtain partition backlight data;

[0007] Perform mixed light simulation calculation according to the partition backlight data to obtain pixel backlight data;

[0008] Calculate pixel compensation parameters corresponding to the image data according to the pixel backlight data;

[0009] The image data is processed according to the pixel compensation parameters to obtain processed image data, and the processed image data is displayed based on the partition backlight data.

[0010] Preferably, performing partition error correction according to the pixel values ​​of the image data to obtain partition backlight data includes:

[0011] Performing a partition operation on each frame of image data to obtain a partition of each frame of image data;

[0012] configuring local correction parameters of the partitions of each frame of image data;

[0013] According to the local correction parameter, a D trigger is used as a data register of the local correction parameter, and when it is detected that the video picture is unchanged and the pixel compensation in the partition has not overflowed, the local correction parameter is iteratively decreased in the next frame image;

[0014] When the local correction parameter is reduced to the point where pixel compensation overflow occurs, the iterative reduction operation is stopped.

[0015] Preferably, the method comprises:

[0016] A normalized brightness value is obtained according to the average brightness value of the partition, the maximum brightness value of the partition, the brightness difference value of the partition, and the local correction parameter;

[0017] The normalized brightness value is determined as initial subarea backlight data.

[0018] Preferably, performing mixed light simulation calculation according to the partition backlight data to obtain pixel backlight data includes:

[0019] Performing a pre-convolution operation on the partitioned backlight data to obtain backlight pre-processing data;

[0020] Performing an interpolation operation on the backlight preprocessing data to obtain backlight interpolation data;

[0021] Performing a convolution operation on the backlight interpolation data to obtain backlight convolution data;

[0022] The backlight convolution data is padded with zeros to obtain pixel backlight data.

[0023] Preferably, the step of calculating pixel compensation parameters corresponding to the image data according to the pixel backlight data includes:

[0024] Calculating a pixel compensation parameter for each pixel according to the pixel backlight data;

[0025] After the step of calculating the pixel compensation parameter of each pixel according to the pixel backlight data, the method further comprises: combining the three-channel value of each pixel with the pixel compensation parameter respectively to obtain the compensated pixel three-channel value;

[0026] Determine whether any one of the three channel values ​​of the compensation pixel is greater than a preset threshold;

[0027] When any one of the three-channel values ​​of the compensated pixel is greater than a preset threshold, return to the step of calculating the pixel compensation parameter of each pixel based on the pixel backlight data, and combine the three-channel values ​​of each pixel with the pixel compensation parameters respectively to obtain the three-channel values ​​of the compensated pixel, until the three-channel values ​​of the compensated pixel are all less than the preset threshold.

[0028] Preferably, the local correction parameter is used as a data register of the local correction parameter by using a D flip-flop, and when it is detected that the video picture is unchanged and the pixel compensation in the partition has not overflowed, the local correction parameter is iteratively decreased in the next frame image, including:

[0029] Determine whether the average brightness of pixels in the same partition between frames is the same;

[0030] If the average brightness of pixels in multiple partitions is the same, it is determined that the video picture remains unchanged, and the local correction parameter is subjected to a decreasing iterative operation.

[0031] The embodiment of the present invention provides an instrument screen display device based on local dimming, the device comprising:

[0032] An image data acquisition module, used to acquire a frame of image data;

[0033] A backlight error correction module, used for performing partition error correction according to the pixel value of the image data to obtain partition backlight data;

[0034] A light mixing simulation module is used to perform light mixing simulation calculations based on the partition backlight data to obtain pixel backlight data;

[0035] An image pixel compensation module, used for calculating pixel compensation parameters corresponding to the image data according to pixel backlight data;

[0036] A display module is used to process the image data according to the pixel compensation parameters to obtain processed image data, and to display the processed image data based on the partition backlight data.

[0037] Preferably, the backlight error correction module comprises:

[0038] A partition operation submodule, used for performing a partition operation on each frame of image data to obtain a partition of each frame of image data;

[0039] A configuration submodule, used to configure local correction parameters of a partition of each frame of image data;

[0040] A decrementing iterative submodule is used to use a D flip-flop as a data register of the local correction parameter according to the local correction parameter, and when it is detected that the video picture is unchanged and the pixel compensation in the partition has not overflowed, the local correction parameter is decremented and iterated in the next frame of the image;

[0041] The stop iteration submodule is used to stop the iterative decrement operation when the local correction parameter is reduced to cause pixel compensation overflow.

[0042] An embodiment of the present invention discloses a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above-mentioned instrument screen display method based on local dimming when executing the computer program.

[0043] The embodiment of the present invention discloses a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned instrument screen display method based on local dimming are implemented.

[0044] In the embodiment of the present invention, the error correction method is used to perform backlight calculation, which is the calculation parameter corresponding to the backlight partition. When the inter-frame image changes, all parameters are kept at the preset value; when the inter-frame image remains static, the parameters are iteratively decreased every frame until the iterative operation is stopped when the pixel overflow is caused. By feedback controlling the local correction parameters, the contradiction between reducing the power consumption of the module and maintaining the image quality is solved; the problem that the prior art adopts forward design, performs sliding window and interpolation calculations in a cycle for multiple times, and adopts batch calculation mode in hardware design, and the BRAM resource usage is large and cannot be adapted to low-cost FPGA chips is solved. The embodiment of the present invention can reverse the data required for five rounds of operations with the backlight pixel as the starting point, and adopts pipeline design in hardware to reduce the usage of BRAM resources for intermediate cache data to reduce the cost of FPGA chips; the interface for mutual conversion between LVDS and AXIS protocols is used to receive RGB video image data, and the initial backlight data is calculated by the error correction method, and the pixel backlight is calculated by the BMA light mixing algorithm. Nonlinear pixel compensation is performed on the image according to the pixel backlight, and overflow judgment and processing operations are performed to detect inter-frame changes and feedback control local correction parameters. The partition backlight data is output through the SPI communication protocol, and the compensated image is output through LVDS. The partition backlight data is delayed by one frame relative to the image. The FPGA chip architecture can calculate the backlight data within one frame time and complete the transmission, as well as perform pixel compensation operations and image display. The backlight data is delayed by one frame time relative to the video image, and the frame rate reaches 60 frames per second, embodying the advantages of high real-time and low latency. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0046] Figure 1 is a system architecture diagram of an instrument screen display system based on local dimming according to an embodiment of the present invention;

[0047] Figure 2 It is a flowchart of a method for displaying an instrument screen based on local dimming according to an embodiment of the present invention;

[0048] Figure 3 It is a flowchart of a partition backlight data acquisition step according to an embodiment of the present invention;

[0049] Figure 4 is a flowchart of a step of obtaining pixel backlight data according to an embodiment of the present invention;

[0050] Figure 5 is a schematic diagram of a BMA process according to an embodiment of the present invention;

[0051] Figure 6 is a schematic diagram of backlight analog value expansion of a 4x4 pixel matrix according to an embodiment of the present invention;

[0052] Figure 7 is a schematic diagram of an interpolation operation according to an embodiment of the present invention;

[0053] Figure 8 is a schematic diagram of 9 arrays according to an embodiment of the present invention;

[0054] Fig. 9 is a schematic diagram of a filtering template according to an embodiment of the present invention;

[0055] Fig.10 is a schematic diagram of another BMA process according to an embodiment of the present invention;

[0056] Fig.11 is a flowchart of a step of obtaining pixel backlight data according to an embodiment of the present invention;

[0057] Fig.12 This is a schematic diagram of an original image, pixel compensation effect and backlight simulation effect according to an embodiment of the present invention;

[0058] Fig.13It is a structural block diagram of an instrument screen display device embodiment based on local dimming according to an embodiment of the present invention;

[0059] Fig.14 The diagram is a diagram of the internal structure of a computer device according to an embodiment. DETAILED DESCRIPTION

[0060] In order to make the technical problems, technical solutions and beneficial effects solved by the embodiments of the present invention more clearly understood, the embodiments of the present invention are further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0061] Reference Figure 1 , showing a system architecture diagram of an instrument screen display system based on local dimming according to an embodiment of the present invention, including a video source, an FPGA chip, and a screen;

[0062] The FPGA chip is provided with a peripheral interface, a communication protocol interface, a backlight error correction module, a mixed light simulation module, and an image pixel compensation module; the screen may include a backlight LED lamp and an LCD panel; an optical compensation film may be provided between the backlight LED lamp and the LCD panel, and the optical compensation film is used to suppress the halo phenomenon. The peripheral interface may include an input and output LVDS TO AXIS interface, and the LVDS TO AXIS interface exchanges the external differential data LVDS with the on-chip protocol AXIS. Of course, other types of interfaces may also be included, and the embodiments of the present invention do not impose too many restrictions on this.

[0063] Secondly, the communication protocol interface may include an interface corresponding to the SPI communication protocol for driving the backlight chip, which is mainly used to output and control each frame of backlight data obtained through the SPI protocol.

[0064] The video source can be stored in a memory, and the video stream in the memory is processed by multiple modules of the FPGA chip and then transmitted to the screen for display.

[0065] Specifically, the backlight error correction module is mainly used to analyze the image content to obtain the partition backlight data, the mixed light simulation module is mainly used to perform mixed light simulation calculations based on the partition backlight data to obtain the pixel backlight data, and the image pixel compensation module is mainly used to calculate the pixel compensation parameters corresponding to the pixel backlight data. The specific data processing flow can be referred to Figure 2 and the corresponding content.

[0066] Reference Figure 2, shows a flowchart of a method for displaying an instrument screen based on local dimming according to an embodiment of the present invention, which may specifically include the following steps:

[0067] Step 101, obtaining a frame of image data;

[0068] In the embodiment of the present invention, the FPGA chip can extract a certain frame of image data from the video source. For example, the FPGA chip can extract the first frame of image data for data processing.

[0069] Step 102, performing partition error correction according to the pixel values ​​of the image data to obtain partition backlight data;

[0070] In an embodiment of the present invention, the initial partition backlight data can be determined first: specifically, a normalized brightness value is obtained based on the average brightness value of the partition, the maximum brightness value of the partition, the brightness difference value of the partition, and a local correction parameter; the normalized brightness value is determined as the initial partition backlight data.

[0071] Reference Figure 3 , shows a schematic flow chart of a sub-area backlight data acquisition step according to an embodiment of the present invention, wherein the sub-area error correction is performed according to the pixel value of the image data to obtain the sub-area backlight data, including the following sub-steps:

[0072] Sub-step S11, performing a partition operation on each frame of image data to obtain partitions of each frame of image data;

[0073] Sub-step S12, configuring local correction parameters of the partitions of each frame of image data;

[0074] Sub-step S13, using a D flip-flop as a data register of the local correction parameter according to the local correction parameter, and when it is detected that the video picture is unchanged and the pixel compensation in the partition has not overflowed, performing a decrement iteration operation on the local correction parameter in the next frame image;

[0075] In sub-step S14, when the local correction parameter is reduced to cause pixel compensation overflow, the iterative reduction operation is stopped.

[0076] In a specific example, the initial partition backlight data is calculated using an error correction method, and the algorithm expression is as follows:

[0077]

[0078] Where P diff_i =P max_i -P avg_i , k i represents the normalized brightness value of the backlight of the i-th partition, ranging from 0 to 1; P avg_i Yes D iThe average brightness of the partition; P max_i Yes D i The maximum brightness of the partition; P diff_i Yes D i Brightness difference of partitions; is the local correction parameter, namely D i The error correction factor of the partition, n is D i The total number of partitions. The number of display partitions is consistent with the number of backlight partitions.

[0079] In the error correction method, when When is the average method, when The average value method often leads to too dark backlight. In order to maintain the original brightness of the image, it is easy to cause quality problems such as pixel overcompensation overflow. The maximum value method can improve the overall brightness of the backlight, but it is not conducive to reducing the power consumption of the module. The embodiment of the present invention adopts the error correction method, which is D i The partition corresponds to a local correction parameter In the process of pixel compensation, the local correction parameters are set on the premise of no overflow. The value of D is adjusted to [0,1], and each D i The partitions can be controlled differently according to the feedback Parameters, locally dynamically adjustable The parameters can be refined to reduce each D i The power consumption of the partition. The feedback control method can balance the contradiction between module power consumption and image quality.

[0080] In the FPGA design of the embodiment of the present invention, the partition backlight k i The communication protocol interface is sent through the SPI interface. The communication protocol interface has a FIFO buffer mechanism, so it can buffer the k from the backlight error correction module. i The backlight error correction module uses a D flip-flop as The data register is in the initial state When the video image is detected to be unchanged and D i If the pixel compensation in the partition does not overflow, then in the next frame of the image The parameter is iterated in descending order, and the iterative operation is in is a constant selected by the user. When the parameter is reduced to the point where pixel compensation overflow occurs, further iterative reduction is stopped. When a video image change is detected, it is reset. The backlight error correction module is responsible for initializing and storing n Parameters, iterative adjustment The feedback mechanism of the parameters is in the charge of the image pixel compensation module, so the backlight error correction module and the image pixel compensation module form a feedback closed-loop control mechanism to obtain the most reasonable Parameters to balance the contradiction between power consumption and image quality.

[0081] Specifically, the local correction parameter is used according to the local correction parameter. A D trigger is used as a data register of the local correction parameter. When it is detected that the video picture is unchanged and the pixel compensation in the partition has not overflowed, the local correction parameter is iteratively decreased in the next frame image. It can include: judging whether the average brightness of pixels in the same partition between frames is the same; if the average brightness of pixels in multiple partitions are the same, it is determined that the video picture is unchanged, and the local correction parameter is iteratively decreased.

[0082] Step 103, performing mixed light simulation calculation according to the partition backlight data to obtain pixel backlight data;

[0083] In the embodiment of the present invention, after obtaining the partition backlight data, a mixed light simulation calculation can be performed according to the partition backlight data to obtain pixel backlight data; specifically, referring to Figure 4 , shows a schematic flow chart of a step of obtaining pixel backlight data according to an embodiment of the present invention, wherein the mixed light simulation calculation is performed according to the partition backlight data to obtain the pixel backlight data, including the following sub-steps:

[0084] Sub-step S21, performing a pre-convolution operation on the partitioned backlight data to obtain backlight pre-processing data;

[0085] Sub-step S22, performing an interpolation operation on the backlight pre-processing data to obtain backlight interpolation data;

[0086] Sub-step S23, performing a convolution operation on the backlight interpolation data to obtain backlight convolution data;

[0087] Sub-step S24, performing a zero-padding operation on the backlight convolution data to obtain pixel backlight data.

[0088] In a practical application, the mini LED lights of the screen hardware device of the present invention are arranged in 24 rows and 60 columns, and the LCD image resolution is 1920×720. The 60×24 partition backlight data is finally expanded to a 1920×720 pixel backlight through multiple rounds of circular convolution and interpolation. The specific operation is to select a convolution kernel that satisfies a+2b+2c+4d=1, such as Figure 6As shown in the figure, after convolution of 60×24 two-dimensional data, linear interpolation is performed in 2×2 mode to obtain 120×48 data. After five rounds of convolution and interpolation cycle operations, two-dimensional data results of 120×48, 240×96, 480×192, 960×384, and 1920×768 are output in sequence. Finally, the first and last 24 rows of 768 rows in 1920×768 are removed to obtain 1920×720 pixel backlights, and the pixel backlight data is used as the calculation basis of pixel compensation.

[0089] In the embodiment of the present invention, the steps of interpolation followed by convolution are adopted, and in order to achieve a blur effect similar to that of convolution followed by interpolation, a convolution operation is added in front, i.e., data preprocessing, which is completed in the idle time between frames. When counting i (indicating pixel rows), the 29th and 31st rows are skipped every 32. The process is as follows Figure 5 shown.

[0090] In a specific example of an embodiment of the present invention, an improved BMA (Blur Mask Algorithm) can be used. For example, five rounds of BMA can be set. The advantage of using this method is that only one row of intermediate data values ​​can be stored in each of the five rounds of BMA, that is, 60 are stored in the first round, 120 are stored in the second round, and 960 are stored in the fifth round, which greatly saves storage resource consumption. It should be noted that the above-mentioned number of BMA rounds is only an example of the embodiment of the present invention. Those skilled in the art can also set other numbers of BMA rounds, and the embodiment of the present invention does not impose too many restrictions on this.

[0091] like Figure 6 As shown, a backlight value needs to be expanded into a 4x4 pixel matrix backlight simulation value. Assume that the previous pipeline has obtained Figure 6 The values ​​corresponding to the 9 convolution kernels in the solid-line box, that is, m1 and m3, are already known, so the next-level pipeline only needs to know the two values ​​of m2 and m4 to get the values ​​required by the convolution kernel. At this time, m4 is the result of the previous round of BMA pipeline, so only the value of m2 is needed, and this data needs to be stored when calculating the previous row. This is the intermediate variable that needs to be stored.

[0092] In the embodiment of the present invention, the interpolation operation adopts the nearest neighbor interpolation method, that is, one data is converted into four data, such as Figure 7 As shown in Figure 2, the convolution operation uses a 3x3 convolution kernel, which means that the middle result is obtained after every 9 arrays are calculated. For example, if you want to calculate the convolution result corresponding to the b2 position, you need to use Figure 8 The nine data corresponding to the box (a1 to a3, b1 to b3, c1 to c3), and then according to Fig. 9The filtering template can be obtained by f(b2)=a*b2+b*(b1+b3)+c*(a2+c2)+d*(a1+a3+c1+c3) to obtain the result.

[0093] like Fig.10 As shown, the pipeline design of BMA from the second round to the fifth round can be said to be consistent, and the first round has an additional step of reading the preprocessing result BRAM. Fig.10 Schematic diagram of the BMA hardware pipeline in an embodiment of the present invention.

[0094] In the embodiment of the present invention, the data required for five rounds of operations are reversed with the 1920x720 pixel backlight as the starting point. Each round of operation only needs to cache part of the intermediate results instead of all, and the cache space required for each round is greatly reduced. The hardware adopts a pipeline processing method, and the data in the BRAM is continuously cyclically overwritten and updated with the pipeline operation. Each round of operation is adjusted to interpolation operation, convolution operation, and zero padding operation. The BRAM resources required for this operation require a total of 5 BRAMs.

[0095] Step 104, calculating pixel compensation parameters corresponding to the image data according to the pixel backlight data;

[0096] Reference Fig.11 , shows a schematic flow chart of a step of obtaining pixel backlight data according to an embodiment of the present invention, wherein the step of calculating the pixel compensation parameters corresponding to the image data according to the pixel backlight data comprises the following sub-steps:

[0097] Sub-step S31, calculating a pixel compensation parameter of each pixel according to the pixel backlight data;

[0098] Sub-step S32, combining the three-channel values ​​of each pixel with the pixel compensation parameters respectively to obtain compensated pixel three-channel values;

[0099] Sub-step S33, determining whether any one of the three channel values ​​of the compensation pixel is greater than a preset threshold;

[0100] Sub-step S34, when any one of the three-channel values ​​of the compensated pixel is greater than a preset threshold, return to the step of calculating the pixel compensation parameter of each pixel according to the pixel backlight data, combining the three-channel values ​​of each pixel with the pixel compensation parameters respectively to obtain the three-channel values ​​of the compensated pixel, until the three-channel values ​​of the compensated pixel are all less than the preset threshold.

[0101] In a practical application, the image pixel compensation module calculates the 1920×720 pixel compensation parameter ε according to the 1920×720 pixel backlight value. i , the calculation expression is as follows;

[0102]

[0103] The pixel backlight value P i ∈[0,255], gamma parameter γ = 2.2, each pixel is multiplied by the corresponding ε i Get the compensated pixel value;

[0104]

[0105] Where P i r , P i g , P i b is the value of the three channels of the i-th pixel of the original image, and is the value of the three channels of the compensation pixel. The image pixel compensation module performs pixel compensation and overflow judgment and overflow processing simultaneously. and If any one of them is greater than 255, it is considered overflow. If all three channels are less than 255, it is considered not overflow. If overflow occurs, the compensation coefficient ε is recalculated. i =255 / P i j , and re-execute formula (3), where j represents one of the overflowed channels of R, G and B, and recalculate the compensation coefficient ε i It can handle overflow problems while keeping the original color tone of the pixel unchanged.

[0106] The image pixel compensation module is used in the image m D i Points are placed on the partition to determine whether there is a change in the image between frames. The specific method is to determine whether the same D i The average pixel brightness P of the partition avg_i Are they the same? If m D i Partition P avg_i If the values ​​are the same, it is considered that there is no change between frames, otherwise it is considered that there is a change between frames. When there is no change between frames, the image pixel compensation module controls the communication protocol interface through the feedback signal. The parameter is iterated in descending order, and the iterative operation is Iterate once per frame. i Stop when a partition overflows Iteration operation on the parameters. D without overflow i The partitions are still iterated decrementally by frames until an overflow occurs. The feedback control of parameters can minimize the display power consumption without causing pixel overflow. When the image changes between frames, the image pixel compensation module controls the communication protocol interface through the feedback signal to reset all parameters to

[0107] Step 105 , processing the image data according to the pixel compensation parameters to obtain processed image data, and displaying the processed image data based on the partition backlight data.

[0108] In an embodiment of the present invention, after obtaining the pixel compensation parameters, the pixel value compensation can be performed on the image data using the pixel compensation parameters, and at the same time, the display parameters of the screen backlight LED lights are controlled according to the partition backlight data through the communication protocol interface, and the processed image data is displayed based on the partition backlight data.

[0109] Reference Fig.12 , shows a schematic diagram of the original image, pixel compensation effect and backlight simulation effect of an embodiment of the present invention. Specifically, from top to bottom are schematic diagrams of the original image, pixel compensation effect and backlight simulation effect. It uses a low-cost FPGA chip to implement the local dimming algorithm. On the basis of maintaining the original image quality, it further highlights the dark field details, reduces the module power consumption, and meets the real-time requirements. The dark field detail expression is as follows Fig.12 The experimental results are shown.

[0110] In the embodiment of the present invention, the error correction method is used to perform backlight calculation, which is the calculation parameter corresponding to the backlight partition. When the inter-frame image changes, all parameters are kept at the preset value; when the inter-frame image remains static, the parameters are iteratively decreased every frame until the iterative operation is stopped when the pixel overflow is caused. By feedback controlling the local correction parameters, the contradiction between reducing the power consumption of the module and maintaining the image quality is solved; the problem that the prior art adopts forward design, performs sliding window and interpolation calculations in a cycle for multiple times, and adopts batch calculation mode in hardware design, and the BRAM resource usage is large and cannot be adapted to low-cost FPGA chips is solved. The embodiment of the present invention can reverse the data required for five rounds of operations with the backlight pixel as the starting point, and adopts pipeline design in hardware to reduce the usage of BRAM resources for intermediate cache data to reduce the cost of FPGA chips; the interface for mutual conversion between LVDS and AXIS protocols is used to receive RGB video image data, and the initial backlight data is calculated by the error correction method, and the pixel backlight is calculated by the BMA light mixing algorithm. Nonlinear pixel compensation is performed on the image according to the pixel backlight, and overflow judgment and processing operations are performed to detect inter-frame changes and feedback control local correction parameters. The partition backlight data is output through the SPI communication protocol, and the compensated image is output through LVDS. The partition backlight data is delayed by one frame relative to the image. The FPGA chip architecture can calculate the backlight data within one frame time and complete the transmission, as well as perform pixel compensation operations and image display. The backlight data is delayed by one frame time relative to the video image, and the frame rate reaches 60 frames / second, embodying the advantages of high real-time and low latency.

[0111] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0112] Reference Fig.13 , shows a structural block diagram of an instrument screen display device embodiment based on local dimming according to an embodiment of the present invention, which may specifically include the following modules:

[0113] The image data acquisition module 301 is used to acquire a frame of image data;

[0114] A backlight error correction module 302, configured to perform partition error correction according to the pixel values ​​of the image data to obtain partition backlight data;

[0115] A light mixing simulation module 303 is used to perform light mixing simulation calculation according to the partition backlight data to obtain pixel backlight data;

[0116] An image pixel compensation module 304 is used to calculate pixel compensation parameters corresponding to the image data according to the pixel backlight data;

[0117] The display module 305 is used to process the image data according to the pixel compensation parameters to obtain processed image data, and to display the processed image data based on the partition backlight data.

[0118] Preferably, the backlight error correction module comprises:

[0119] A partition operation submodule, used for performing a partition operation on each frame of image data to obtain a partition of each frame of image data;

[0120] A configuration submodule, used to configure local correction parameters of a partition of each frame of image data;

[0121] A decrementing iterative submodule is used to use a D flip-flop as a data register of the local correction parameter according to the local correction parameter, and when it is detected that the video picture is unchanged and the pixel compensation in the partition has not overflowed, the local correction parameter is decremented and iterated in the next frame of the image;

[0122] The stop iteration submodule is used to stop the iterative decrement operation when the local correction parameter is reduced to cause pixel compensation overflow.

[0123] Preferably, the device comprises:

[0124] A brightness value acquisition module is used to obtain a normalized brightness value according to the brightness average value of the partition, the brightness maximum value of the partition, the brightness difference value of the partition, and the local correction parameter;

[0125] The brightness value module is used to determine the normalized brightness value as initial subarea backlight data.

[0126] Preferably, the light mixing simulation module includes:

[0127] A pre-convolution operation submodule, used for performing a pre-convolution operation on the partitioned backlight data to obtain backlight pre-processing data;

[0128] An interpolation operation submodule, used for performing an interpolation operation on the backlight preprocessing data to obtain backlight interpolation data;

[0129] A convolution operation submodule, used for performing a convolution operation on the backlight interpolation data to obtain backlight convolution data;

[0130] The zero-padding operation submodule is used to perform a zero-padding operation on the backlight convolution data to obtain pixel backlight data.

[0131] Preferably, the image pixel compensation module comprises:

[0132] A pixel compensation parameter submodule, used to calculate a pixel compensation parameter of each pixel according to the pixel backlight data;

[0133] A compensation pixel three-channel value submodule is used to combine the three-channel value of each pixel with the pixel compensation parameter to obtain the compensation pixel three-channel value;

[0134] A judgment submodule, used to judge whether any one of the three channel values ​​of the compensation pixel is greater than a preset threshold;

[0135] The return submodule is used to return the pixel compensation parameter of each pixel calculated according to the pixel backlight data when any one of the three-channel values ​​of the compensated pixel is greater than a preset threshold, and combine the three-channel values ​​of each pixel with the pixel compensation parameters respectively to obtain the three-channel values ​​of the compensated pixel, until the three-channel values ​​of the compensated pixel are all less than the preset threshold.

[0136] Preferably, the decrementing iterator module comprises:

[0137] An average brightness judgment unit, used to judge whether the average brightness of pixels in the same partition between frames is the same;

[0138] The decrementing and iterative operation unit is used to determine that the video picture remains unchanged if the average brightness of pixels in multiple partitions is the same, and to perform a decrementing and iterative operation on the local correction parameter.

[0139] Each module in the above instrument screen display device based on local dimming can be implemented in whole or in part by software, hardware and their combination. Each module can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the corresponding operations of each module.

[0140] The instrument screen display device based on local dimming provided above can be used to execute the instrument screen display method based on local dimming provided in any of the above embodiments, and has corresponding functions and beneficial effects.

[0141] In one embodiment, a computer device is provided. The computer device may be an automotive electronic instrument panel device. The internal structure diagram thereof may be as follows: Fig.14 As shown. The automotive electronic instrument screen device includes a processor, a memory, a network interface, a display screen and an input device connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a method for displaying an instrument screen based on local dimming is implemented. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a key, trackball or touchpad set on the computer device housing, or an external keyboard, touchpad or mouse, etc.

[0142] Those skilled in the art will understand that Fig.14 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0143] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, Figures 1 to 11 The steps described.

[0144] In one embodiment, a computer readable storage medium is provided on which a computer program is stored. When the computer program is executed by a processor, Figures 1 to 11 The steps described

[0145] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0146] It will be appreciated by those skilled in the art that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0147] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0148] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0149] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable terminal device. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0150] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0151] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0152] The above describes in detail an instrument screen display method based on local dimming, an instrument screen display device based on local dimming, a computer device and a storage medium provided by the present invention. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as limiting the present invention.

Claims

1. A method for displaying an instrument screen based on local dimming, characterized in that: The method comprises: Get a frame of image data; Performing partition error correction according to the pixel values ​​of the image data to obtain partition backlight data; Perform mixed light simulation calculation according to the partition backlight data to obtain pixel backlight data; Calculate pixel compensation parameters corresponding to the image data according to the pixel backlight data; Processing the image data according to the pixel compensation parameters to obtain processed image data, and displaying the processed image data based on the partition backlight data; The performing partition error correction according to the pixel value of the image data to obtain partition backlight data includes: Performing a partition operation on each frame of image data to obtain a partition of each frame of image data; configuring local correction parameters of the partitions of each frame of image data; According to the local correction parameter, a D trigger is used as a data register of the local correction parameter, and when it is detected that the video picture is unchanged and the pixel compensation in the partition has not overflowed, the local correction parameter is iteratively decreased in the next frame image; When the local correction parameter is reduced to the point where pixel compensation overflow occurs, the iterative reduction operation is stopped; The method of using a D trigger as a data register of the local correction parameter according to the local correction parameter, and performing a decreasing iterative operation on the local correction parameter in the next frame image when detecting that the video picture is unchanged and the pixel compensation in the partition has not overflowed, includes: Determine whether the average brightness of pixels in the same partition between frames is the same; If the average brightness of pixels in multiple partitions is the same, it is determined that the video picture remains unchanged, and the local correction parameter is subjected to a decreasing iterative operation.

2. The instrument screen display method based on local dimming according to claim 1, characterized in that: The method comprises: A normalized brightness value is obtained according to the average brightness value of the partition, the maximum brightness value of the partition, the brightness difference value of the partition, and the local correction parameter; The normalized brightness value is determined as initial subarea backlight data.

3. The instrument screen display method based on local dimming according to claim 1, characterized in that: The performing mixed light simulation calculation according to the partition backlight data to obtain pixel backlight data includes: Performing a pre-convolution operation on the partitioned backlight data to obtain backlight pre-processing data; Performing an interpolation operation on the backlight preprocessing data to obtain backlight interpolation data; Performing a convolution operation on the backlight interpolation data to obtain backlight convolution data; The backlight convolution data is padded with zeros to obtain pixel backlight data.

4. The instrument screen display method based on local dimming according to claim 1, characterized in that: The step of calculating pixel compensation parameters corresponding to the image data according to the pixel backlight data includes: Calculating a pixel compensation parameter for each pixel according to the pixel backlight data; After the step of calculating the pixel compensation parameter of each pixel according to the pixel backlight data, the method further comprises: combining the three-channel value of each pixel with the pixel compensation parameter respectively to obtain the compensated pixel three-channel value; Determine whether any one of the three channel values ​​of the compensation pixel is greater than a preset threshold; When any one of the three-channel values ​​of the compensated pixel is greater than a preset threshold, return to the step of calculating the pixel compensation parameter of each pixel based on the pixel backlight data, and combine the three-channel values ​​of each pixel with the pixel compensation parameters respectively to obtain the three-channel values ​​of the compensated pixel, until the three-channel values ​​of the compensated pixel are all less than the preset threshold.

5. An instrument screen display device based on local dimming, characterized in that: The device comprises: An image data acquisition module, used to acquire a frame of image data; A backlight error correction module, used for performing partition error correction according to the pixel value of the image data to obtain partition backlight data; A light mixing simulation module is used to perform light mixing simulation calculations based on the partition backlight data to obtain pixel backlight data; An image pixel compensation module, used for calculating pixel compensation parameters corresponding to the image data according to pixel backlight data; A display module, used for processing the image data according to the pixel compensation parameter to obtain processed image data, and displaying the processed image data based on the partition backlight data; The backlight error correction module comprises: A partition operation submodule, used for performing a partition operation on each frame of image data to obtain a partition of each frame of image data; A configuration submodule, used to configure local correction parameters of a partition of each frame of image data; A decrementing iterative submodule is used to use a D flip-flop as a data register of the local correction parameter according to the local correction parameter, and when it is detected that the video picture is unchanged and the pixel compensation in the partition has not overflowed, the local correction parameter is decremented and iterated in the next frame of the image; The stop iteration submodule is used to stop the iterative decrement operation when the local correction parameter is reduced to cause pixel compensation overflow; The decrement iterator module includes: An average brightness judgment unit, used to judge whether the average brightness of pixels in the same partition between frames is the same; The decrementing and iterative operation unit is used to determine that the video picture remains unchanged if the average brightness of pixels in multiple partitions is the same, and to perform a decrementing and iterative operation on the local correction parameter.

6. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that: When the processor executes the computer program, the steps of the instrument screen display method based on local dimming described in any one of claims 1 to 4 are implemented.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the instrument screen display method based on local dimming described in any one of claims 1 to 4 are implemented.

Images