Display control method, display apparatus, computer device, and storage medium
By analyzing and filtering the brightness information of the backlight partition, the problem of backlight mutation in high-speed dynamic scenes is solved, and the local light control and image details of the display effect are improved.
Patent Information
- Application Number
- PCT/CN2024/075720
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-02-04
- Publication Date
- 2025-08-07
AI Technical Summary
In the high-speed dynamic scenario, the problem of backlight mutations in high-speed moving objects when displaying at high-speed dynamics cannot effectively suppress the backlight change problem when high-speed moving objects cross the backlight partition, resulting in poor display effect.
By analyzing the brightness information of multiple backlight partitions pre-divided by the backlight module, the first brightness information, the second brightness information and the third brightness information are determined, and weighted processing is performed in combination with the influence coefficient. Then, the backlight characteristic value is filtered and pixel data compensation is compensated to improve the local light control effect.
It effectively suppresses the backlight change when an object moves at high speed across the backlight partition, and improves the local light control effect and image display details of the display effect.
Smart Images

Figure CN2024075720_07082025_PF_FP_ABST
Abstract
Description
Display control method, display device, computer equipment, and storage medium Technical Field
[0001] The present disclosure belongs to the field of display technology, and particularly relates to a display control method, a display device, a computer equipment, and a storage medium. Background Art
[0002] With the rapid development of display technology, display products are gradually developing into ultra-large display screens with high resolution and high refresh rate. Applications such as in-vehicle displays, monitoring and command, high-definition broadcasting, high-end cinemas, medical diagnosis, advertising displays, conference and exhibition, office displays, and virtual reality have achieved relatively good display effects.
[0003] Summary of the Invention
[0004] The present disclosure aims to solve at least one of the technical problems existing in the prior art and provides a display control method, a display device, a computer device and a storage medium.
[0005] In a first aspect, the technical solution adopted to solve the technical problem of the present disclosure is a display control method, comprising:
[0006] For any backlight partition among a plurality of backlight partitions pre-divided by the backlight module, determining first brightness information, second brightness information, and third brightness information of the backlight partition based on first pixel data of each pixel in an image to be displayed; the first brightness information represents a maximum value of brightness characteristics of each pixel in the backlight partition, the second brightness information represents an average value of the brightness characteristics of each pixel in the backlight partition, and the third brightness information represents a brightness characteristic value determined based on the brightness characteristics of each pixel in the backlight partition and the brightness characteristics of each pixel in a first adjacent backlight partition surrounding the backlight partition;
[0007] Determining a first backlight characteristic value of the backlight partition according to the first brightness information, the second brightness information, and the third brightness information of the backlight partition;
[0008] filtering the first backlight characteristic value of each of the backlight subareas to obtain a second backlight characteristic value of each of the backlight subareas;
[0009] The first pixel data of each pixel point in the image to be displayed is compensated according to the second backlight characteristic value of each backlight subarea to obtain compensated second pixel data for display.
[0010] In some embodiments, determining the third brightness information of the backlight subarea according to the first pixel data of each pixel point in the image to be displayed includes:
[0011] Extracting grayscale features of each pixel point according to first pixel data of each pixel point in the image to be displayed to obtain a grayscale feature value of each pixel point;
[0012] For any of the backlight partitions, the backlight partition is taken as a central backlight partition, and the backlight partitions within a first preset distance range from the central backlight partition are taken as first adjacent backlight partitions;
[0013] determining fourth brightness information of each sub-region based on the grayscale characteristic value of each pixel in the central backlight region and the first adjacent backlight region, and each pre-divided sub-region of the central backlight region and each sub-region of the first adjacent backlight region; the fourth brightness information represents an average brightness characteristic of each pixel in the sub-region;
[0014] The third brightness information of the central backlight partition is determined according to the fourth brightness information of each sub-partition and a predetermined distance weight coefficient corresponding to each sub-partition.
[0015] In some embodiments, the step of determining the distance weight coefficient corresponding to each sub-region includes:
[0016] determining, according to the first position information of the central backlight partition and the second position information of each of the sub-partitions in the central backlight partition and the first adjacent backlight partition, a first distance between each of the sub-partitions and the central backlight partition;
[0017] For any of the sub-regions, a distance weight coefficient corresponding to the sub-region is determined according to the first distance between the sub-region and the central backlight region and the sum of the first distances between each of the sub-regions and the central backlight region.
[0018] In some embodiments, determining the third brightness information of the central backlight partition according to the fourth brightness information of each of the sub-partitions and a predetermined distance weight coefficient corresponding to each of the sub-partitions includes:
[0019] For any of the sub-regions, calculating a product of a distance weight coefficient corresponding to the sub-region and the fourth brightness information of the sub-region as an intermediate brightness feature of the sub-region;
[0020] For one of the backlight sub-regions, a sum of the intermediate brightness features of all the sub-regions is calculated as the third brightness information of the central backlight sub-region.
[0021] In some embodiments, determining the first brightness information and the second brightness information of the backlight partition according to the first pixel data of each pixel point in the image to be displayed includes:
[0022] Extracting grayscale features of each pixel point according to first pixel data of each pixel point in the image to be displayed to obtain a grayscale feature value of each pixel point;
[0023] determining a maximum value among the grayscale characteristic values according to the grayscale characteristic values of the pixels corresponding to the backlight partition, and using the maximum value among the grayscale characteristic values as first brightness information of the backlight partition;
[0024] According to the grayscale characteristic values of each pixel point corresponding to the backlight partition, an average value of each grayscale characteristic value is calculated, and the average value is used as the second brightness information of the backlight partition.
[0025] In some embodiments, determining the first backlight characteristic value of the backlight partition according to the first brightness information, the second brightness information, and the third brightness information of the backlight partition includes:
[0026] Calculating a product of the first brightness information of the backlight partition and a first influence coefficient of the maximum brightness feature as a first intermediate sub-feature under the influence of the maximum brightness feature;
[0027] Calculating a product of the second brightness information of the backlight partition and a second influence coefficient of the average brightness feature as a second intermediate sub-feature under the influence of the average brightness feature;
[0028] Calculating a product of the third brightness information of the backlight partition and the third influence coefficient of the position feature as a third intermediate sub-feature under the influence of the position feature;
[0029] The sum of the first intermediate sub-feature, the second intermediate sub-feature, and the third intermediate sub-feature is used as the first backlight feature value of the backlight subarea.
[0030] In some embodiments, the first influence coefficient and the second influence coefficient are determined based on the brightness of the display scene corresponding to the video to be played; the third influence coefficient is determined based on the moving speed of an object in the display scene corresponding to the video to be played; the sum of the first influence coefficient, the second influence coefficient and the third influence coefficient is 1;
[0031] The first influence coefficient is negatively correlated with the brightness of the display scene, the second influence coefficient is positively correlated with the brightness of the display scene; and the third influence coefficient is positively correlated with the moving speed of the object.
[0032] In some embodiments, filtering the first backlight characteristic value of each backlight partition to obtain the second backlight characteristic value of each backlight partition includes:
[0033] Filtering the first backlight eigenvalue of each of the backlight subareas to obtain a backlight filtering eigenvalue of each of the backlight subareas;
[0034] For any of the backlight partitions, the second backlight eigenvalue of the backlight partition is determined based on a predetermined brightness attenuation area related to the backlight partition, a filter kernel corresponding to the brightness attenuation area, and the backlight filter eigenvalues of each backlight partition in the brightness attenuation area; the filter kernel includes a backlight attenuation coefficient corresponding to each backlight partition in the brightness attenuation area.
[0035] In some embodiments, filtering the first backlight characteristic value of each backlight partition to obtain the backlight filtering characteristic value of each backlight partition includes:
[0036] For any of the backlight partitions, the backlight partition is divided into a central backlight partition, and the backlight partitions within a second preset distance range from the central backlight partition are divided into second adjacent backlight partitions;
[0037] taking the maximum value of the first backlight eigenvalue of the central backlight subarea and the first backlight eigenvalue of the second adjacent backlight subarea as the regional maximum eigenvalue of the central backlight subarea;
[0038] Adjusting the maximum eigenvalue of the region according to a preset adjustment factor to determine the weighted brightness eigenvalue of the central backlight partition;
[0039] The maximum value between the weighted brightness eigenvalue and the first backlight eigenvalue of the central backlight subarea is used as the backlight filtering eigenvalue of the central backlight subarea.
[0040] In some embodiments, determining the second backlight eigenvalue of the backlight partition based on a predetermined brightness attenuation region associated with the backlight partition, a filter kernel corresponding to the brightness attenuation region, and backlight filter eigenvalues of each backlight partition in the brightness attenuation region includes:
[0041] When the number of the backlight partitions in the brightness attenuation region is equal to a preset value, using a filter kernel corresponding to the brightness attenuation region, weighted processing is performed on the backlight filter eigenvalues of the respective backlight partitions in the brightness attenuation region to obtain a second backlight eigenvalue of the backlight partition; wherein the preset value is the same as the number of the backlight attenuation coefficients in the filter kernel;
[0042] In the case that the number of backlight partitions in the brightness attenuation area is less than a preset value, a preset mirroring algorithm is used to supplement virtual backlight partitions for the brightness attenuation area based on the backlight partitions in the brightness attenuation area and their backlight filtering eigenvalues, and the backlight filtering eigenvalues of the virtual backlight partitions are determined; and the backlight filtering eigenvalues of each backlight partition and each virtual backlight partition in the brightness attenuation area are weightedly processed using the filter kernel corresponding to the brightness attenuation area to obtain a second backlight eigenvalue of the backlight partition.
[0043] In some embodiments, after filtering the first backlight characteristic value of each backlight subarea to obtain the backlight filtering characteristic value of each backlight subarea, the method further includes:
[0044] Feature mapping is performed on the backlight filter feature values of each backlight partition to obtain a backlight driving value of each backlight partition for backlight driving.
[0045] In some embodiments, compensating the first pixel data of each pixel point in the image to be displayed according to the second backlight characteristic value of each backlight partition to obtain compensated second pixel data includes:
[0046] For any of the backlight partitions, determining a third backlight characteristic value of each pixel in the image to be displayed using a preset linear interpolation algorithm according to the second backlight characteristic value of the backlight partition;
[0047] For any pixel in the image to be displayed, determining a compensation factor for the pixel according to a third backlight characteristic value of the pixel;
[0048] For any pixel point in the image to be displayed, the compensation factor is used to compensate the first pixel data of the pixel point to obtain compensated second pixel data.
[0049] In a second aspect, an embodiment of the present disclosure further provides a display method, comprising: obtaining a video stream to be played, detecting a preset number of consecutive frames of images to be displayed in the video stream, and determining whether there is a moving object with a moving speed greater than a preset speed;
[0050] When it is detected that the moving speed of the moving object is greater than a preset speed, each frame of the image to be displayed is displayed according to the display control method as described in any one of the first aspects.
[0051] In a third aspect, an embodiment of the present disclosure further provides a driving device, which is configured to execute the steps of the display control method as described in any one of the first aspects.
[0052] In some embodiments, the driving device includes a field programmable gate array (FPGA).
[0053] In a fourth aspect, an embodiment of the present disclosure further provides a display device, comprising a driving device and a display screen;
[0054] The driving device is configured to determine, for any backlight partition among a plurality of backlight partitions pre-divided by the backlight module, first brightness information, second brightness information, and third brightness information of the backlight partition based on first pixel data of each pixel in the image to be displayed; the first brightness information represents a maximum value of brightness characteristics of each pixel in the backlight partition, the second brightness information represents an average value of brightness characteristics of each pixel in the backlight partition, and the third brightness information represents a brightness characteristic value determined based on the brightness characteristics of each pixel in the backlight partition and the brightness characteristics of each pixel in a first adjacent backlight partition surrounding the backlight partition; determine a first backlight characteristic value of the backlight partition based on the first brightness information, the second brightness information, and the third brightness information of the backlight partition; filter the first backlight characteristic value of each backlight partition to obtain a second backlight characteristic value of each backlight partition; and compensate the first pixel data of each pixel in the image to be displayed based on the second backlight characteristic value of each backlight partition to obtain compensated second pixel data;
[0055] The display screen is configured to perform display according to the received second pixel data.
[0056] In some embodiments, the display device further comprises a backlight module; the backlight module comprises a plurality of backlight partitions and backlight driving components corresponding one to one with the backlight partitions;
[0057] The driving device is further configured to perform feature mapping on the backlight filtering feature values of each backlight partition to obtain a backlight driving value of each backlight partition;
[0058] Each of the backlight driving components is configured to drive the backlight sub-area to emit backlight according to the received backlight driving value of the backlight sub-area.
[0059] In a fifth aspect, an embodiment of the present disclosure further provides a computer device, comprising: a processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the computer device is running, the processor and the memory communicate through the bus, and when the machine-readable instructions are executed by the processor, the steps of the display control method as described in any one of the first aspects, or the steps of the display method as described in the second aspect are performed.
[0060] In a sixth aspect, an embodiment of the present disclosure further provides a computer non-volatile readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the display control method as described in any one of the first aspects, or the steps of the display method as described in the second aspect are executed. BRIEF DESCRIPTION OF THE DRAWINGS
[0061] Figure 1a is a schematic diagram of an object moving at a close distance;
[0062] Figure 1b is a schematic diagram of an object moving at high speed over a long distance;
[0063] FIG2 is a flow chart of a display control method provided by an embodiment of the present disclosure;
[0064] FIG3 is a schematic diagram of calculating third brightness information of a backlight partition according to an embodiment of the present disclosure;
[0065] 4 is a flowchart of determining first brightness information, second brightness information, and third brightness information according to first pixel data according to an embodiment of the present disclosure;
[0066] FIG5 is a schematic diagram of the first filtering of the central backlight partition provided by an embodiment of the present disclosure;
[0067] FIG6 is a schematic diagram of brightness attenuation of a backlight partition in a test center according to an embodiment of the present disclosure;
[0068] FIG7 is a fitting curve diagram of the brightness decay process of FIG6 ;
[0069] FIG8 is a schematic diagram of a filter kernel corresponding to a brightness attenuation region provided by an embodiment of the present disclosure;
[0070] FIG9a is a schematic diagram of secondary filtering in a case provided by an embodiment of the present disclosure;
[0071] FIG9 b is a schematic diagram of secondary filtering in another case provided by an embodiment of the present disclosure;
[0072] FIG10a is a schematic diagram of bilinear interpolation provided by an embodiment of the present disclosure;
[0073] FIG10 b is a schematic diagram of the interpolation model corresponding to FIG10 a ;
[0074] FIG11 is a schematic diagram of a specific flow chart of a display control method provided by an embodiment of the present disclosure;
[0075] FIG12 is a flow chart of a display method provided by an embodiment of the present disclosure;
[0076] FIG13 is a schematic diagram of a driving device provided by an embodiment of the present disclosure;
[0077] FIG14 is a schematic diagram of a display device provided by an embodiment of the present disclosure;
[0078] FIG15 is a schematic structural diagram of a computer device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION
[0079] In order to make the purpose, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. The components of the embodiments of the present disclosure generally described and shown in the drawings herein can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present disclosure provided in the drawings is not intended to limit the scope of the disclosure for which protection is sought, but merely represents selected embodiments of the present disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without making creative work are within the scope of protection of the present disclosure.
[0080] Unless otherwise defined, the technical or scientific terms used in this disclosure should have the usual meanings understood by people with ordinary skills in the field to which this disclosure belongs. The words "first", "second" and similar words used in this disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. Similarly, words such as "one", "an" or "the" do not indicate a quantity limitation, but rather indicate the existence of at least one. Words such as "include" or "comprise" mean that the elements or objects appearing before the word include the elements or objects listed after the word and their equivalents, without excluding other elements or objects. Words such as "connect" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the object being described changes, the relative positional relationship may also change accordingly.
[0081] In this disclosure, "multiple or several" refers to two or more. "And / or" describes the relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can mean: A exists alone, A and B exist simultaneously, or B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship.
[0082] In related technologies, for traditional image display, the image information input to the system is used to extract brightness features to determine the backlight drive value to drive the backlight panel; and the input image information is used to simulate pixel compensation to improve the display effect.
[0083] However, for high refresh rate displays in high-speed dynamic scenes, the above-mentioned traditional image display algorithms have certain drawbacks and cannot suppress the sudden backlight changes caused by high-speed moving objects crossing backlight zones. It should be noted that the so-called "high-speed dynamic scenes" refer to the presence of objects moving at high speed across backlight zones during video playback.
[0084] Figure 1a illustrates an object moving at close range, while Figure 1b illustrates an object moving at high speed over long distances. As shown in Figure 1a, the object may be moving within the display range corresponding to a single backlight partition; as shown in Figure 1b, the object may be moving between adjacent backlight partitions, across the display range corresponding to the corresponding backlight partitions. As shown in Figures 1a and 1b, A represents the object before movement, A' represents the object after movement, and B represents the backlight partition. The figures illustrate 3×4 backlight partitions, namely B1-1 to B3-4. For example, a completely black background and a brightness decay region (or backlight diffusion region) are used. A white block is illuminated, and the pixels within the white block move rapidly. In a traditional algorithm, the white block moves within the display range corresponding to a single backlight partition. Since the image brightness characteristics within the region [B1-1 to B3-3] are not changed, the backlight brightness within the region [B1-1 to B3-3] remains unchanged. The white block moves rapidly across the display range corresponding to the backlight partition. The areas B1-1, B2-1 and B3-1 suddenly change from a fixed brightness to 0; the areas B1-4, B2-4 and B3-4 suddenly change from a brightness of 0 to a fixed brightness. Therefore, in such a moving scene, the movement of a high-speed moving object across the display range corresponding to the backlight partition will cause a sudden backlight change (flicker), which is especially obvious in high-speed moving scenes.
[0085] In view of this, the embodiments of the present disclosure provide a display control method, which is mainly aimed at high-speed dynamic movement scenes, suppressing the backlight mutation when the object moves at high speed across the display range corresponding to the backlight partition, and effectively improving the local light control effect.
[0086] The display control method provided in the embodiments of the present disclosure may be executed by a display device, such as an in-vehicle display device or a large advertising display screen. Alternatively, the display control method may be executed by a display system, which may be a hardware display system, a software display system, or a combination of hardware and software display systems.
[0087] Exemplarily, the display device is a liquid crystal display device. Generally, a liquid crystal display device includes a display module and a backlight module. The display module can also be understood as a display screen; the backlight module includes a plurality of pre-divided backlight partitions, and each backlight partition has a backlight driving component corresponding to one of them. Each backlight partition corresponds to at least one light source. The backlight driving component receives a backlight driving value to drive the backlight partition to emit light. The backlight driving component receives a backlight driving value to drive the backlight partition to emit light, specifically driving the backlight source in the backlight partition to emit backlight. Backlight is a form of lighting, mainly used in liquid crystal display. The backlight source is a light source located behind the liquid crystal display (LCD), and its luminous effect will directly affect the visual effect of the liquid crystal display.
[0088] FIG2 is a flow chart of a display control method provided by an embodiment of the present disclosure. As shown in FIG2 , the display control method includes steps S11 to S14 .
[0089] S11 . For any backlight partition among the plurality of backlight partitions pre-divided by the backlight module, determine first brightness information, second brightness information, and third brightness information of the backlight partition according to first pixel data of each pixel point in the image to be displayed.
[0090] Each backlight partition corresponds to a plurality of pixels. For example, each backlight partition includes M×m pixels.
[0091] The image to be displayed is an image acquired from an image acquisition device or retrieved from an image resource in memory. The first pixel data may be, for example, the sub-pixel values of each sub-pixel (R, G, and B) contained in a pixel. The resolution of the image to be displayed may be, for example, 4K (3840×2160), with a refresh rate of 60Hz.
[0092] The first brightness information represents the maximum value of the brightness characteristics of each pixel point in the backlight partition, and the second brightness information represents the average value of the brightness characteristics of each pixel point in the backlight partition; the third brightness information represents the brightness characteristic value determined based on the brightness characteristics of each pixel point in the backlight partition and the brightness characteristics of each pixel point in the first adjacent backlight partition surrounding the backlight partition.
[0093] The brightness characteristics corresponding to the first brightness information and the second brightness information may be grayscale characteristics of the pixels in the backlight partition. For example, the maximum value of the brightness characteristics of each pixel in the backlight partition may be understood as the maximum value of the grayscale characteristic values of each pixel in the backlight partition. The grayscale characteristic value of a pixel refers to the maximum value of the sub-pixel values of each sub-pixel (R, G, and B) in the pixel. For another example, the average value of the brightness characteristics of each pixel in the backlight partition may be understood as the average value of the grayscale characteristic values of each pixel in the backlight partition.
[0094] The brightness characteristic value represented by the third brightness information refers to the brightness characteristics of each pixel in the backlight partition, as well as the brightness characteristics of each pixel in the first adjacent backlight partition surrounding the backlight partition, and refers to the backlight contribution of the backlight partition as a whole, or can also be understood as the impact of position distribution on the brightness of the backlight partition. The backlight partition and the first adjacent backlight partition are both pre-divided into multiple sub-partitions, and the brightness characteristic value represented by the third brightness information is mainly obtained by weighting the average value (or maximum value) of the brightness characteristics of each pixel in the sub-partition, where the weighting factor can be defined according to the distance between each sub-partition and the center of the backlight partition.
[0095] S12: Determine a first backlight characteristic value of the backlight partition according to the first brightness information, the second brightness information, and the third brightness information of the backlight partition.
[0096] Specifically, the brightness characteristic values in each brightness information are weighted by using the influence coefficients under different brightness characteristics, and finally the first backlight characteristic value obtained by weighting the brightness characteristic values is obtained.
[0097] Exemplarily, a pre-set first influence coefficient corresponding to the first brightness information, a second influence coefficient corresponding to the second brightness information, and a third influence coefficient corresponding to the third brightness information are known, and the first brightness information and the first influence coefficient, the second brightness information and the second influence coefficient, and the third brightness information and the third influence coefficient are weightedly summed to obtain the first backlight characteristic value.
[0098] S13 , filtering the first backlight characteristic value of each backlight subarea to obtain a second backlight characteristic value of each backlight subarea.
[0099] In a possible embodiment, for any backlight partition (referred to as the central backlight partition), the smooth transition between the first backlight eigenvalue of the central backlight partition and the first backlight eigenvalue of the second adjacent backlight partition within a certain distance range around it is considered, and the central backlight partition and the second adjacent backlight partition are filtered once to obtain a filtering result. Specifically, the central backlight partition can be filtered once according to the first backlight eigenvalue of the central backlight partition and the first backlight eigenvalue of the second adjacent backlight partition within a first preset distance range around the central backlight partition to obtain a filtering result (that is, the backlight filtering eigenvalue of the central backlight partition). The filtering result can be directly used as the second backlight eigenvalue of the backlight partition. The second adjacent backlight partition can be a circle of backlight partitions surrounding the central backlight partition. For example, a 3×3 backlight partition is formed including the central backlight partition and multiple second adjacent backlight partitions.
[0100] In another possible embodiment, based on the consideration of the smooth transition of the first backlight eigenvalue between backlight partitions in the above embodiment, on this basis, the influence of backlight diffusion is further considered, and the central backlight partition and the surrounding third adjacent backlight partitions are subjected to secondary filtering to obtain a backlight diffusion result. Specifically, the central backlight partition can be subjected to secondary filtering based on the first backlight eigenvalue of the central backlight partition and the first backlight eigenvalue of the third adjacent backlight partition within a brightness attenuation area centered on the central backlight partition to obtain a backlight diffusion result, that is, the second backlight eigenvalue of the central backlight partition. The brightness attenuation area is a brightness attenuation range measured based on an optical experiment. The third adjacent backlight partition can be four circles of backlight partitions surrounding the central backlight partition. For example, a 9×9 backlight partition is formed including the central backlight partition and a plurality of third adjacent backlight partitions.
[0101] S14 , compensating the first pixel data of each pixel point in the image to be displayed according to the second backlight characteristic value of each backlight subarea and a predetermined compensation factor to obtain compensated second pixel data for display.
[0102] Specifically, for any backlight partition, the third backlight characteristic value of each pixel in the backlight partition can be determined based on the second backlight characteristic value of the backlight partition using the first preset algorithm; then, the compensation factor of the pixel can be determined based on the third backlight characteristic value of the pixel; then, for any pixel, the first pixel data of the pixel is compensated using the compensation factor to obtain the compensated second pixel data of the pixel.
[0103] The first preset algorithm may be but is not limited to an interpolation algorithm; the second preset algorithm refers to the following formula (13).
[0104] The above steps S11 to S14 of the disclosed embodiment are mainly aimed at high-speed dynamic moving objects and high refresh rate display scenes, and fully consider the brightness characteristics within a single backlight partition (e.g., the center backlight partition), namely the first brightness information and the second brightness information, and in particular, the average brightness characteristics of each sub-partition within the center backlight partition and the first adjacent backlight partition, and the impact on the brightness of the center backlight partition, namely the third brightness information. For a single backlight partition, the first brightness information, the second brightness information, and the third brightness information are combined to determine the first backlight characteristic value of the backlight partition, effectively suppressing the backlight mutation when the object moves at high speed across the corresponding display range of the backlight partition, thereby improving the local light control effect.
[0105] Specifically, as shown in Figures 1a and 1b, compared with the traditional algorithm, it can be seen that the white block of the embodiment of the present disclosure moves within the display range corresponding to a single backlight partition (recorded as the center backlight partition). Although the maximum value of the brightness characteristic indicated by the first brightness information and the average value of the brightness characteristic indicated by the second brightness information in the image in the [B1-1 to B3-3] area are not changed, the present disclosure changes the positional characteristics within the center backlight partition. The positional characteristics are reflected in the brightness characteristic performance, that is, the brightness characteristics of the center backlight partition indicated by the third brightness information. Considering the influence of the positional characteristics on the center backlight partition, the general rule is: the farther the white block is from the center of the center backlight partition, the darker the brightness of the center backlight partition; conversely, the closer the white block is to the center of the center backlight partition, the brighter the brightness of the center backlight partition. As shown in Figures 1a and 1b, the white block gradually moves away from the column of areas B1-1, B2-1, and B3-1. Therefore, the brightness of the column of areas B1-1, B2-1, and B3-1 gradually decreases; the white block first approaches and then moves away from the column of areas B1-2, B2-2, and B3-2. Therefore, the brightness of the column of areas B1-2, B2-2, and B3-2 gradually changes from bright to dark; the white block gradually moves closer to the column of areas B1-3, B2-3, and B3-3. Therefore, the brightness of the column of areas B1-3, B2-3, and B3-3 gradually becomes brighter. Based on this, when the white block bends and crosses into the backlight partition where B2-3 is located, B1-1, B2-1 and B3-1 gradually become darkest, and B1-4, B2-4 and B3-4 gradually become brightest, thereby effectively solving the problem of backlight mutation when the object moves at high speed across the corresponding display range of the backlight partition, and improving the local light control effect.
[0106] In addition, the present disclosure further filters the first backlight eigenvalue of the backlight partition, taking into account the smooth transition of the first backlight eigenvalue between the backlight partitions and the influence of backlight diffusion, and filtering the first backlight eigenvalue of the backlight partition. This can improve the contrast of the image to be displayed after subsequent pixel compensation, enhance the image display details, and thus improve the display effect.
[0107] The display control method provided by the embodiment of the present disclosure is described in detail below with reference to specific embodiments.
[0108] In some embodiments, for step S11, first brightness information and second brightness information of the backlight partition are determined based on first pixel data of each pixel point in the image to be displayed. For the specific process, see the following steps S11-1-1 to S11-1-3.
[0109] S11-1-1. Perform grayscale feature extraction on each pixel point according to the first pixel data of each pixel point in the image to be displayed to obtain a grayscale feature value of each pixel point.
[0110] The first pixel data of a pixel point includes sub-pixel values of each sub-pixel (R, G, and B) contained in the pixel point, which are recorded as R(u,v), G(u,v), and B(u,v).
[0111] For example, for any pixel (u, v), the maximum sub-pixel value among the sub-pixels can be used as the grayscale characteristic value of the pixel, see the following formula (1): gray max (u,v)=max(R(u,v),G(u,v),B(u,v))……..Formula (1)
[0112] Among them, gray max (u,v) represents the grayscale eigenvalue of the pixel (u,v); max() represents the maximum value; R(u,v) represents the sub-pixel value of the sub-pixel R of the pixel (u,v); G(u,v) represents the sub-pixel value of the sub-pixel G of the pixel (u,v); B(u,v) represents the sub-pixel value of the sub-pixel B of the pixel (u,v).
[0113] S11-1-2. Determine the maximum value among the grayscale characteristic values according to the grayscale characteristic values of the pixels corresponding to the backlight partition, and use the maximum value among the grayscale characteristic values as the first brightness information of the backlight partition.
[0114] Specifically, the maximum value method can be used to determine the unique maximum value of the grayscale characteristic value in the backlight partition as the first brightness information of the backlight partition, see the following formula (2):
[0115] Among them, BL max Indicates the first brightness information of the backlight partition, that is, the maximum value of the brightness characteristic indicated by the first brightness information; max() indicates taking the maximum value; represents the grayscale characteristic value of each pixel in the backlight partition, and n represents the number of pixels in the backlight partition.
[0116] S11-1-3. Calculate an average value of the grayscale characteristic values according to the grayscale characteristic values of the pixels corresponding to the backlight partition, and use the average value as the second brightness information of the backlight partition.
[0117] Specifically, the average value method can be used to determine the average value of each grayscale characteristic value in the backlight partition as the second brightness information of the backlight partition, see the following formula (3):
[0118] Among them, BL ave The second brightness information representing the backlight partition, that is, the average value of the brightness characteristic indicated by the second brightness information; It represents the cumulative sum of the grayscale eigenvalues of each pixel in the backlight partition; M and m represent the number of rows and columns of pixels in the backlight partition respectively.
[0119] In some embodiments, for step S11, the third brightness information of the backlight partition is determined based on the first pixel data of each pixel point in the image to be displayed. For the specific process, see the following steps S11-2-1 to S11-2-4.
[0120] S11-2-1. Perform grayscale feature extraction on each pixel point according to the first pixel data of each pixel point in the image to be displayed to obtain a grayscale feature value of each pixel point.
[0121] The implementation process of this step can refer to the specific implementation process of the above step S11-1-1. The grayscale characteristic value of each pixel point is determined according to formula (1), and the repeated parts are not repeated here.
[0122] S11-2-2. For any backlight partition, take the backlight partition as the central backlight partition, and take the backlight partitions within a first preset distance range from the central backlight partition as first adjacent backlight partitions.
[0123] The first preset distance range can be a range of one backlight partition away from the central backlight partition. In this case, the first adjacent backlight partitions are a circle of backlight partitions surrounding the central backlight partition, including eight first adjacent backlight partitions: top, bottom, left, right, upper left, lower left, upper right, and lower right. For example, as shown in FIG3 , the central backlight partition is B2-2, and the multiple first adjacent backlight partitions surrounding it include B1-1, B1-2, B1-3, B2-1, B2-3, B3-1, B3-2, and B3-3.
[0124] S11-2-3. Determine the fourth brightness information of each sub-partition based on the grayscale characteristic values of each pixel in the central backlight partition and the first adjacent backlight partition, as well as the pre-divided sub-partitions of the central backlight partition and the first adjacent backlight partition; wherein the fourth brightness information represents the average value of the brightness characteristics of each pixel in the sub-partition.
[0125] The following sub-division method can be used to divide any backlight partition into sub-divisions: The backlight partition can be evenly divided into N×N sub-divisions, where N is a positive integer greater than or equal to 2 and less than or equal to the total number of pixels in the backlight partition. In the disclosed embodiment, N is 3, and the backlight partition is divided into 3×3 sub-divisions. As shown in Figure 3, the center backlight partition B2-2 and the first adjacent backlight partition are divided into a total of 3×3×(8+1)=81 sub-divisions.
[0126] For any sub-region, the fourth brightness information is determined, referring to the following formula (4), which is the same as the principle of determining the second brightness information of the backlight region, that is, referring to the above formula (3).
[0127] Among them, BL′ ave The fourth brightness information of the sub-region is represented by the average brightness feature value of each pixel in the sub-region; Represents the cumulative sum of the grayscale feature values of each pixel in the sub-partition; M′ and m′ represent the number of rows and columns of pixels in the sub-partition respectively.
[0128] S11-2-4: Determine the third brightness information of the central backlight partition according to the fourth brightness information of each sub-partition and a predetermined distance weight coefficient corresponding to each sub-partition.
[0129] FIG3 is a schematic diagram of calculating the third brightness information of the central backlight partition according to an embodiment of the present disclosure. As shown in FIG3, the fourth brightness information of each sub-partition 31 is weighted according to the distance weight coefficient corresponding to each sub-partition 31. Specifically, for any sub-partition 31, the product of the distance weight coefficient corresponding to the sub-partition 31 and the fourth brightness information of the sub-partition 31 is calculated as the intermediate brightness feature of the sub-partition 31; for a central backlight partition B2-2, the sum of the intermediate brightness features of all sub-partitions 31 is calculated as the third brightness information of the central backlight partition, see the following formula (5): BL'
[0130] Among them, BL pox Indicates the third brightness information of the center backlight partition; BL' ave (i, j) represents the fourth brightness information of sub-region (i, j); W(i, j) represents the distance weight coefficient of sub-region (i, j); BL′ ave (i,j)×W(i,j) represents the median brightness feature of sub-region (i,j); represents the sum of the intermediate brightness features of all sub-regions in the central backlight region and the first adjacent backlight region; N×N represents the number of rows and columns of sub-regions in the backlight region.
[0131] In some embodiments, the process of determining the distance weight coefficient corresponding to each sub-region is described in S21 to S22 below.
[0132] S21 . Determine first distances between each sub-region and the central backlight region according to first position information of the central backlight region and second position information of each sub-region in the central backlight region and a first adjacent backlight region.
[0133] The first position information of the central backlight partition represents the coordinates of a pre-set, fixed position of the central backlight partition. The pre-set fixed position may be the center position of the center point of the central backlight partition, the vertex position of the upper left corner of the central backlight partition, or the vertex position of the upper right corner of the central backlight partition. This disclosure uses the example of the first position information representing the coordinates of the center point of the central backlight partition as an example.
[0134] The second position information of the subpartition represents the coordinates of a pre-set, fixed position of the subpartition. The pre-set fixed position can be the center position of the subpartition's center point, the vertex position of the subpartition's upper left corner, or the vertex position of the subpartition's upper right corner. This disclosure uses the example of the second position information representing the center position coordinates of the subpartition's center point as an example.
[0135] Specifically, given the center coordinates of the central backlight partition and the center coordinates of each sub-partition, the distance between the center point of each sub-partition and the center point of the backlight partition is determined in sequence, and recorded as the first distance L(i, j).
[0136] S22 . For any sub-region, determine a distance weight coefficient corresponding to the sub-region according to a first distance between the sub-region and the central backlight region and a sum of first distances between each sub-region and the central backlight region.
[0137] Specifically, for any sub-area (i, j), the first distance L(i, j) between the center point of each sub-area and the center point of the central backlight area is known, and the sum of the first distances between each sub-area and the central backlight area is Determine the distance weight coefficient corresponding to the sub-partition, see the following formula (6).
[0138] Wherein, W(i,j) represents the distance weight coefficient of sub-region (i,j); L(i,j) represents the first distance between sub-region (i,j) and the central backlight region; represents the sum of the first distances between each sub-region and the central backlight region.
[0139] In some embodiments, FIG4 is a flowchart of determining first brightness information, second brightness information, and third brightness information according to first pixel data provided by an embodiment of the present disclosure. As shown in FIG4 , it specifically includes S31 to S35 .
[0140] S31. According to the first pixel data of each pixel in the image to be displayed, grayscale features of each pixel are extracted to obtain grayscale feature values of each pixel, and the following steps S32, S33 and S34 are executed simultaneously.
[0141] See the processing of formula (1).
[0142] S32 : Determine first brightness information of the backlight partition using a maximum value method according to the grayscale characteristic value of each pixel point corresponding to the backlight partition.
[0143] See the processing of formula (2).
[0144] S33 : Determine a second brightness feature of the backlight partition using an average value method according to the grayscale feature value of each pixel point corresponding to the backlight partition.
[0145] See the processing of formula (3).
[0146] S34 . For any backlight partition, take the backlight partition as the central backlight partition, and take the backlight partitions within a first preset distance range from the central backlight partition as first adjacent backlight partitions, and sequentially execute the following S35 .
[0147] S35. Determine fourth brightness information of each sub-area according to the grayscale characteristic value of each pixel in the central backlight area and the first adjacent backlight area, and the pre-divided sub-areas of the central backlight area and the first adjacent backlight area.
[0148] See the processing of formula (4).
[0149] S36 : Determine the third brightness information of the central backlight partition according to the fourth brightness information of each sub-partition and a predetermined distance weight coefficient corresponding to each sub-partition.
[0150] See the processing of formula (5).
[0151] In some embodiments, with respect to step S12 , the brightness features in each brightness information are weighted using the influence coefficients under different brightness features, and finally a first backlight characteristic value after weighting each brightness feature is obtained.
[0152] Among them, the influence coefficients under different brightness characteristics include a first influence coefficient corresponding to the maximum brightness characteristic, a second influence coefficient corresponding to the average brightness characteristic, and a third influence coefficient corresponding to the position characteristic. These three influence coefficients are determined based on the application scenario. The usage conditions in different application scenarios are different. The first influence coefficient may be different, the second influence coefficient may be different, and the third influence coefficient may be different.
[0153] Specifically, the first influence coefficient and the second influence coefficient are determined based on the brightness of the display scene corresponding to the video to be played; the third influence coefficient is determined based on the moving speed of the object within the display scene corresponding to the video to be played; the sum of the first influence coefficient, the second influence coefficient and the third influence coefficient is 1.
[0154] Among them, the video to be played can be the video containing the image to be displayed in the present disclosure, or it can also be a video of the same type as the video containing the image to be displayed. The so-called "video of the same type" can be understood as a video for the same shooting scene, or a video for the same shooting object, or a video for the same category of objects, etc. The display scene corresponding to the video to be played refers to the scene of the display screen displayed by the video to be played. The brightness of the display scene is obtained by playing the video and calculating the brightness distribution function. The object movement speed is calculated by the actual frame rate of the playing video and the position change of the object in the video.
[0155] The first influence coefficient is negatively correlated with the brightness of the display scene, the second influence coefficient is positively correlated with the brightness of the display scene; and the third influence coefficient is positively correlated with the moving speed of the object.
[0156] For example, for a scene with many dark details, such as a large area of gray or black pixels with only a small number of white pixels, the first influence coefficient can be appropriately increased to ensure dark details.
[0157] For example, for scenes with more bright details, such as when the overall picture is bright and the bright content has distinct layers, the second influence coefficient can be appropriately increased to ensure the bright details.
[0158] For example, for a scene in which an object moves at a relatively fast distance and speed, the third influence coefficient may be appropriately increased to achieve a better display effect.
[0159] Specifically, the first backlight characteristic value of the backlight subarea is determined, as shown in steps S121 to S124 below.
[0160] S121, calculate the product of the first brightness information of the backlight partition and the first influence coefficient of the maximum brightness feature as the first intermediate sub-feature under the influence of the maximum brightness feature. See formula (7). Z1=BL max ×P0…………………….Formula (7)
[0161] Among them, Z1 represents the first intermediate sub-feature under the influence of the maximum brightness feature; BL max It represents the first brightness information of the backlight partition, that is, the maximum value of the brightness feature indicated by the first brightness information; P0 represents the first influence coefficient of the maximum brightness feature.
[0162] S122, calculate the product of the second brightness information of the backlight partition and the second influence coefficient of the average brightness feature as the second intermediate sub-feature under the influence of the average brightness feature. See formula (8). Z2 = BL ave ×P1…………………….Formula (8)
[0163] Among them, Z2 represents the second intermediate sub-feature under the influence of the average brightness feature; BL ave represents the second brightness information of the backlight partition, that is, the average value of the brightness feature indicated by the second brightness information; P1 represents the second influence coefficient of the average brightness feature.
[0164] S123, calculate the product of the third brightness information of the backlight partition and the third influence coefficient of the position feature as the third intermediate sub-feature under the influence of the position feature. See formula (9). Z3 = BL pox ×P2…………………….Formula (9)
[0165] Among them, Z3 represents the third intermediate sub-feature under the influence of position feature; BL pox It represents the third brightness information of the backlight partition, that is, the brightness characteristics of the backlight partition under the influence of the position characteristics of the pixel points of the backlight partition on the brightness distribution; P2 represents the third influence coefficient of the position characteristics.
[0166] S124: taking the sum of the first intermediate sub-feature, the second intermediate sub-feature and the third intermediate sub-feature as the first backlight feature value BL of the backlight sub-region feature See formula (10). BL feature =Z1+Z2+Z3=BL max ×P0+BL ave ×P1+BL pox ×P2 formula(10)
[0167] Among them, P0+P1+P2=1.
[0168] In some embodiments, for step S13, the smooth transition of the first backlight characteristic value between backlight partitions and the influence of backlight diffusion are comprehensively considered, and the first backlight characteristic value of each backlight partition is processed to obtain the second backlight characteristic value of each backlight partition, which specifically includes the following steps S131 to S132.
[0169] S131 : Filter the first backlight eigenvalue of each backlight subarea to obtain a backlight filtering eigenvalue of each backlight subarea.
[0170] In one possible implementation, for any backlight partition (denoted as a central backlight partition), a second adjacent backlight partition within a second preset distance range is determined with the backlight partition as the center; thereafter, a custom filter kernel can be selected, and a weighted summation method can be used to weight the first backlight eigenvalue of the central backlight partition and the first backlight eigenvalue of the second adjacent backlight partition around the central backlight partition to obtain the backlight filter eigenvalue of the central backlight partition.
[0171] In another possible implementation, it specifically includes S131-1 to S131-4, wherein: S131-1, for any backlight partition, the backlight partition is divided into a central backlight partition, and the backlight partition within a second preset distance range from the central backlight partition is used as a second adjacent backlight partition.
[0172] The second preset distance range may be a user-defined filtering range, for example, a range of one backlight partition away from the central backlight partition. In this case, the second adjacent backlight partitions are a circle of backlight partitions surrounding the central backlight partition, including eight second adjacent backlight partitions: top, bottom, left, right, upper left, lower left, upper right, and lower right. For example, as shown in FIG5 , the central backlight partition is B5, and the multiple first adjacent backlight partitions surrounding it include B1, B2, B3, B4, B6, B7, and B8.
[0173] S131 - 2 : Taking the maximum value of the first backlight feature value of the central backlight partition and the first backlight feature value of the second adjacent backlight partition as the regional maximum feature value of the central backlight partition.
[0174] Figure 5 is a schematic diagram of the first filtering of the central backlight partition provided by an embodiment of the present disclosure, taking the 3×3 backlight partitions surrounding the central backlight partition as the second adjacent backlight partition as an example. A1, A2, A3, A4, A5, A6, A7, A8, and A9 represent the first backlight characteristic values of backlight partitions B1, B2, B3, B4, B5, B6, B7, B8, and B9, respectively.
[0175] As shown in FIG5 , the maximum value M1 = MAX(A1:A9) of the first backlight eigenvalues of the 3×3 backlight subareas is counted, ie, the maximum eigenvalue of the central backlight subarea.
[0176] S131 - 3 . Adjust the maximum eigenvalue of the region according to a preset adjustment factor to determine the weighted brightness eigenvalue of the central backlight partition.
[0177] If filtering is performed according to the maximum regional eigenvalue, the final display effect of the entire 3×3 backlight partition will be very bright. Therefore, a specific adjustment factor can be selected according to the actual application scenario to adjust the maximum regional eigenvalue and determine the weighted brightness eigenvalue M2=M1×δ of the backlight partition.
[0178] Here, δ represents the preset adjustment factor, ranging from 0 to 1 (inclusive). δ is set based on the actual application scenario and requirements. For example, if the ambient light intensity is very high, δ can be set to a higher value between 0 and 1, such as 0.8 or 0.9. If the ambient light intensity is very low, δ can be set to a lower value between 0 and 1, such as 0, 0.1, or 0.2. If the ambient light intensity is within the acceptable range for the human eye, δ can be set to 0.5.
[0179] S131 - 4 . Use the maximum value between the weighted brightness eigenvalue and the first backlight eigenvalue of the central backlight subarea as the backlight filtering eigenvalue of the central backlight subarea.
[0180] Compare the weighted brightness characteristic value M2 of the central backlight partition and the first backlight characteristic value A5 of the central backlight partition to determine the maximum value BL between the two. fil =MAX[M2,A5], recorded as the backlight filtering eigenvalue of the central backlight partition.
[0181] S132. For any backlight partition, determine a second backlight eigenvalue of the backlight partition based on a predetermined brightness attenuation region associated with the backlight partition, a filter kernel corresponding to the brightness attenuation region, and backlight filter eigenvalues of each backlight partition in the brightness attenuation region.
[0182] The brightness decay region is primarily determined through testing. For example, by lighting a single central backlight partition and measuring its backlight decay using an optical instrument, the influence of backlight diffusion can be disregarded when the brightness of the surrounding adjacent backlight partitions decays to less than 5% of the brightness of the central backlight partition. This disclosure uses the example of a 9×9 backlight partition with the central backlight partition as the center for illustration.
[0183] Figure 6 is a schematic diagram of the brightness attenuation of the test center backlight partition provided by an embodiment of the present disclosure, and Figure 7 is a fitting curve diagram of the brightness attenuation process in Figure 6, wherein the horizontal axis (distance) represents the distance to the center of the central backlight partition; the vertical axis (relative intensity) represents the relative light intensity, wherein the solid line represents the fitting curve in the horizontal direction, and the dotted line represents the fitting curve in the vertical direction.
[0184] Figure 8 is a schematic diagram of the filter kernel corresponding to the brightness attenuation area provided by an embodiment of the present disclosure. As shown in Figure 8, the filter kernel includes backlight attenuation coefficients corresponding to each backlight partition in the brightness attenuation area, namely b1~b81, which are pre-defined parameter information.
[0185] After the first filtering of S131, the influence of backlight diffusion is taken into consideration and a secondary filtering process is performed. Exemplarily, FIG9a is a schematic diagram of secondary filtering in a case provided by an embodiment of the present disclosure. As shown in FIG9a, for any backlight partition (denoted as a central backlight partition), a brightness attenuation area corresponds to the central backlight partition e5 as the center. When the number of backlight partitions in the brightness attenuation area is equal to the preset value, that is, the central backlight partition does not belong to the backlight partition close to the edge of the backlight module, at this time, the filter kernel corresponding to the brightness attenuation area is used to perform weighted processing on the backlight filter eigenvalues of each backlight partition in the brightness attenuation area to obtain the second backlight eigenvalue of the backlight partition.
[0186] Taking the brightness attenuation region covering the area occupied by 9×9 backlight partitions as an example, the preset value is set to 81 = 9×9. The preset value is the same as the number of backlight attenuation coefficients in the filter kernel, as shown in Figure 8. The filter kernel shown in Figure 8 is used to perform a weighted summation of the backlight filter eigenvalues of the 9×9 backlight partitions in the brightness attenuation region shown in Figure 9a to obtain the second backlight eigenvalue of the central backlight partition, as shown in Formula (11).
[0187] Among them, BL spread represents the second backlight characteristic value of the central backlight partition; b1 to b81 represent the backlight attenuation coefficients corresponding to the respective backlight partitions in the brightness attenuation area in the filter kernel; Indicates the backlight filter characteristic values corresponding to each backlight partition in the brightness attenuation area.
[0188] As another example, FIG9b is a schematic diagram of secondary filtering in another case provided by an embodiment of the present disclosure. As shown in FIG9b, for any backlight partition (denoted as a central backlight partition), a brightness attenuation area corresponds to the central backlight partition as the center. When the number of backlight partitions in the brightness attenuation area is less than a preset value, that is, the central backlight partition belongs to a backlight partition close to the edge of the backlight module. At this time, according to the backlight partitions in the brightness attenuation area and their backlight filter eigenvalues, a preset mirror algorithm is used to supplement the virtual backlight partitions for the brightness attenuation area, and the backlight filter eigenvalues of the virtual backlight partitions are determined. Specifically, with the upper left corner vertex of the central backlight partition as the mirror center point 90, the backlight partitions in the brightness attenuation area are mirrored to obtain a plurality of virtual backlight partitions in the first virtual area 91. According to the mirror mapping, the backlight filter eigenvalues of the virtual backlight partitions are determined. For example, the backlight filter eigenvalues of the virtual backlight partitions a1, d1 and a4, that is, the backlight filter eigenvalues of the backlight partitions h8, h5 and e8 in the brightness attenuation area. Similarly, with the top edge 92 of the central backlight partition as the mirror symmetry axis, the backlight partitions in the brightness attenuation area are mirrored to obtain multiple virtual backlight partitions in the second virtual area 93. For example, the backlight filter eigenvalues of the virtual backlight partitions a5, a9 and d9, that is, the backlight filter eigenvalues of the backlight partitions h5, h9 and e9 in the brightness attenuation area. Similarly, with the left side 94 of the central backlight partition as the mirror symmetry axis, the backlight partitions in the brightness attenuation area are mirrored to obtain multiple virtual backlight partitions in the second virtual area 95. For example, the backlight filter eigenvalues of the virtual backlight partitions e1, i1 and i4, that is, the backlight filter eigenvalues of the backlight partitions e8, i8 and i5 in the brightness attenuation area.
[0189] Then, using the filter kernel corresponding to the brightness attenuation region, the backlight filter eigenvalues of each backlight partition and each virtual backlight partition in the brightness attenuation region are weightedly processed to obtain a second backlight eigenvalue for the backlight partition. Specifically, the backlight filter eigenvalues of the backlight partition and the virtual backlight partition in the brightness attenuation region shown in FIG. 9 b are weighted and summed using the filter kernel shown in FIG. 8 to obtain the second backlight eigenvalue for the center backlight partition.
[0190] In some embodiments, after determining the backlight filter characteristic values of the backlight partitions in step S131-4, the method further includes: performing feature mapping on the backlight filter characteristic values of each backlight partition to obtain the backlight driving value of each backlight partition for backlight driving, see formula (12). driver =(BL fil ×16384) / 1023……………Formula (12)
[0191] Among them, BL driver Indicates the backlight driving value of the backlight partition; BL fil Indicates the backlight filter characteristic value of the backlight partition; conversion between characteristic data and corresponding format data of the backlight driver module 514, 16384=2 14 ;1023=2 10 .
[0192] In some embodiments, for step S14 , determining the compensated second pixel data specifically includes the following steps S141 to S143 .
[0193] S141 . For any backlight partition, determine a third backlight characteristic value of each pixel in the image to be displayed according to the second backlight characteristic value of the backlight partition using a preset linear interpolation algorithm.
[0194] Among them, the preset linear interpolation algorithm can be, for example, a bilinear interpolation algorithm, a trilinear interpolation algorithm, a nearest neighbor interpolation algorithm, etc., which is not specifically limited in the embodiment of the present disclosure.
[0195] Exemplarily, for any backlight partition, a bilinear interpolation algorithm is used to determine the third backlight characteristic value of each pixel in the image to be displayed based on the second backlight characteristic value of the backlight partition. Specifically, the method includes steps S141-1 to S141-2, wherein:
[0196] S141 - 1 . Divide the plurality of backlight partitions into a plurality of backlight partition groups, each backlight partition group including 2×2 backlight partitions.
[0197] S141-2. For any backlight zone group, determine a central area of the backlight zone group according to the center positions of the backlight zones in the backlight zone group, and determine a third backlight characteristic value of a pixel in the central area according to the second backlight characteristic value of each backlight zone in the backlight zone group.
[0198] The number of pixels in the central area is equal to the number of pixels in the backlight subarea.
[0199] Figure 10a is a schematic diagram of bilinear interpolation provided by an embodiment of the present disclosure, and Figure 10b is a schematic diagram of the interpolation model corresponding to Figure 10a. As shown in Figures 10a and 10b, 41 represents a backlight partition group, 42 represents a backlight partition, and 421, 422, 423, and 424 respectively represent the center points of the four backlight partitions 411. The coordinates of the center points are mapped to the bilinear interpolation algorithm as (0, 0), (0, 1), (1, 0), and (1, 1), for example.
[0200] The calculation formula (13) for the third backlight characteristic value f(i, j) of any pixel point (i, j) in the central area 43 surrounded by the center points of the four backlight subareas is as follows: BL pixel =f(i,j)=f(0,0)×(1-x)×(1-y)+f(1,0)×x×(1-x)+f(0,1)×(1-x)×y+f(1,1)×x×y…………………………Formula (13)
[0201] Among them, BL pixel represents the third backlight characteristic value of pixel (i, j); f(0,0), f(1,0), f(0,1), and f(1,1) represent the second backlight characteristic values BL of the four backlight subareas 421, 422, 423, and 424 respectively. spread The value of x is mapped to the value of i / M corresponding to the actual pixel point (i, j), and the value of x is mapped to the value of j / m corresponding to the actual pixel point (i, j), where the value range of i is [0, M-1] and the value range of j is [0, m-1]. In this way, according to formula (13), M×m values can be obtained, which correspond one-to-one to the M×m pixels in the central area 43.
[0202] Each backlight partition group is traversed to determine the third backlight characteristic value of each pixel in the image to be displayed.
[0203] S142 . For any pixel in the image to be displayed, determine a compensation factor for the pixel according to the third backlight characteristic value of the pixel.
[0204] Taking pixel (i, j) as an example, the process of determining the compensation factor is as follows:
[0205] Among them, F com (i, j) represents the compensation factor of pixel (i, j); BL pixel (i, j) represents the third backlight characteristic value of pixel point (i, j); γ is a constant value, for example, 2.2.
[0206] S143 . For any pixel point in the image to be displayed, use the compensation factor to compensate the first pixel data of the pixel point to obtain compensated second pixel data.
[0207] Taking pixel (i, j) as an example, the process of determining the second pixel data of the pixel point is as follows: R new (i,j)=R(i,j)×F com (i,j) G new (i,j)=G(i,j)×F com (i,j) B new (i,j)=B(i,j)×F com (i,j)……….…..Formula (15)
[0208] Where R(i,j), G(i,j) and B(i,j) represent the sub-pixel values (R, G and B) of the pixel point (i,j) respectively; F com (i,j) represents the compensation factor of pixel (i,j).
[0209] To facilitate understanding of the various embodiments of the present disclosure, the following describes an implementation process of the display control method using a complete example. FIG11 is a schematic diagram of a specific flow chart of the display control method provided by an embodiment of the present disclosure. As shown in FIG11 , the method includes steps S41 to S49, wherein:
[0210] S41: Receive an image to be displayed.
[0211] S42: Grayscale feature extraction, synchronous calculation of first brightness information, second brightness information, and third brightness information.
[0212] S43: Calculate the first backlight characteristic value.
[0213] For the specific process, please refer to steps S121 to S124.
[0214] S44: First filtering process, executing S45 and S49 simultaneously.
[0215] For the specific process, please refer to steps S131-1 to S131-4.
[0216] S45: Perform a second filtering process to determine a second backlight characteristic value.
[0217] For the specific process, please refer to step S132 and its specific implementation process.
[0218] S46, backlight interpolation.
[0219] For the specific process, please refer to steps S141-1 to S141-2 and their specific implementation process.
[0220] S47. Pixel compensation.
[0221] For the specific process, please refer to steps S142 to S143.
[0222] S48. The second pixel data is sent to the display screen for display.
[0223] S49: Mapping the backlight filter characteristic value to a backlight driving value.
[0224] S410 , sending the backlight driving value to the backlight module data.
[0225] Those skilled in the art will understand that in the above-mentioned method of the specific implementation method, the writing order of each step does not mean a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.
[0226] The above is the complete description of the display control method disclosed herein.
[0227] In addition, the present disclosure further provides a display method. FIG12 is a flow chart of a display method provided by an embodiment of the present disclosure. As shown in FIG12 , the method specifically includes steps S51 to S55.
[0228] S51: Obtain the video stream to be played.
[0229] S52: Detect a preset number of consecutive frames of images to be displayed in the video stream, and determine whether there is a moving object with a moving speed greater than a preset speed.
[0230] The preset number of consecutive frames is determined based on practical experience and may be two or three frames. The object's speed can be calculated based on the frame rate of the video stream and the distance the object moves in the consecutive multiple frames. Only when the object's speed exceeds the preset speed are the consecutive multiple frames displayed according to the display control method described above, specifically including the following steps S53 to S56.
[0231] S53. When it is detected that the moving speed of the moving object is greater than a preset value, for any backlight partition among the multiple backlight partitions pre-divided by the backlight module, the first brightness information, the second brightness information and the third brightness information of the backlight partition are determined according to the first pixel data of each pixel point in the image to be displayed.
[0232] Among them, the first brightness information represents the maximum value of the brightness characteristics of each pixel point in the backlight partition, the second brightness information represents the average value of the brightness characteristics of each pixel point in the backlight partition; the third brightness information represents the brightness characteristic value determined based on the brightness characteristics of each pixel point in the backlight partition and the brightness characteristics of each pixel point in the adjacent backlight partition surrounding the backlight partition.
[0233] S54 : Determine a first backlight characteristic value of the backlight subarea according to the first brightness information, the second brightness information, and the third brightness information of the backlight subarea.
[0234] S55 : Filter the first backlight characteristic value of each backlight subarea to obtain a second backlight characteristic value of each backlight subarea.
[0235] S56 , compensating the first pixel data of each pixel point in the image to be displayed according to the second backlight characteristic value of each backlight subarea to obtain compensated second pixel data for display.
[0236] The implementation process of the above steps S53 to S56 can refer to the specific implementation process of the above steps S11 to S14, and the repeated parts will not be repeated.
[0237] The disclosed embodiments are primarily targeted at high-speed, dynamically moving objects and high-refresh-rate display scenarios, fully considering the brightness characteristics within a single backlight partition (e.g., the center backlight partition), namely, the first brightness information and the second brightness information, and in particular, the average brightness characteristics of each sub-partition within the center backlight partition and the first adjacent backlight partition, and their impact on the brightness of the center backlight partition, namely, the third brightness information. For a single backlight partition, the first backlight characteristic value of the backlight partition is determined by combining the first brightness information, the second brightness information, and the third brightness information, effectively suppressing backlight mutations when an object moves at high speed across the corresponding display range of the backlight partition, thereby improving the local light control effect.
[0238] In addition, a driving device corresponding to the display control method is also provided in the embodiment of the present disclosure. Since the principle of solving the problem by the driving device in the embodiment of the present disclosure is similar to the above-mentioned display control method in the embodiment of the present disclosure, the implementation of the driving device can refer to the implementation of the method, and the repeated parts will not be repeated.
[0239] The driving device is configured to determine, for any backlight partition among a plurality of backlight partitions pre-divided by the backlight module, first brightness information, second brightness information, and third brightness information of the backlight partition based on first pixel data of each pixel in the image to be displayed; the first brightness information represents the maximum value of the brightness characteristics of each pixel in the backlight partition, the second brightness information represents the average value of the brightness characteristics of each pixel in the backlight partition, and the third brightness information represents the brightness characteristic value determined based on the brightness characteristics of each pixel in the backlight partition and the brightness characteristics of each pixel in a first adjacent backlight partition surrounding the backlight partition; determine the first backlight characteristic value of the backlight partition based on the first brightness information, the second brightness information, and the third brightness information of the backlight partition; filter the first backlight characteristic value of each backlight partition to obtain the second backlight characteristic value of each backlight partition; and compensate the first pixel data of each pixel in the image to be displayed based on the second backlight characteristic value of each backlight partition to obtain compensated second pixel data.
[0240] The driving device of the disclosed embodiment is primarily used for display devices in high-speed, dynamically moving objects and high-refresh-rate display scenarios. It fully considers the brightness characteristics within a single backlight partition (e.g., the center backlight partition), namely, the first brightness information and the second brightness information. In particular, the average brightness characteristics of each sub-partition within the center backlight partition and the first adjacent backlight partition affect the brightness of the center backlight partition, namely, the third brightness information. For a single backlight partition, the first backlight characteristic value of the backlight partition is determined by combining the first, second, and third brightness information. This effectively suppresses sudden backlight changes when an object moves at high speed across the corresponding display range of the backlight partition, thereby improving the local light control effect.
[0241] In some embodiments, the driving device includes a field programmable gate array (FPGA).
[0242] In one embodiment, the driving device is an FPGA chip. In another embodiment, the driving device is a driving chip that integrates a system on chip (SOC) and an FPGA.
[0243] The display control method disclosed herein can be deployed on low-end chips, such as FPGAs, thereby reducing the cost of display products.
[0244] Figure 13 is a schematic diagram of a driver device provided by an embodiment of the present disclosure. As shown in Figure 13, the driver device 100 includes a SOC and an FPGA. The SOC transmits video signals (i.e., images to be displayed) to the FPGA via an 8-way VBO interface. The SOC is primarily used for receiving and transmitting video signals and generating on-screen display (OSD) controls.
[0245] The FPGA receives video signals (images to be displayed) through an 8-channel VBO interface, transmits video signals (secondary pixel data) to the display screen through the 8-channel VBO interface, and transmits backlight drive values to the backlight module through the SPI interface. This FPGA is primarily used for video signal reception and transmission, backlight feature calculation, and pixel compensation.
[0246] As shown in FIG13 , the FPGA primarily includes a video receiving module 51, a write memory control module 52, an AXI bus arbitration module 53, a memory 54, a timing generation module 55, a read memory control module 56, a pixel compensation module 57, a video data transmission module 58, a backlight characteristic value calculation module 59, a first filtering module 510, a second filtering module 511, a backlight interpolation module 512, a driver mapping module 513, and a backlight driver module 514. The video receiving module 51 is configured to receive video signals transmitted by the SOC. The write memory control module 52 is configured to write the received video data into the memory 54 for frame buffering. The AXI bus arbitration module 53 is configured to prioritize access to the memory 54 by the write memory control module 52 and the read memory control module 56 according to a predetermined format. The timing generation module 55 is configured to generate video timing for the output side of the memory 54 based on the timing information of the video receiving module 51, strictly following the video timing on the input side. The timing information of the video receiving module 51 refers to the timing of the received video signal. The memory read control module 56 is configured to read the video data from the memory 54. The pixel compensation module 57 is configured to use the compensation factor F to compensate the read video data. com (i, j) is compensated. The video data sending module 58 is configured to send a video signal to the display screen. The backlight eigenvalue calculation module 59 is configured to calculate the first brightness information, the second brightness information and the third brightness information. The first filtering module 510 is configured to perform the first filtering process of the above-mentioned step S44, which is mainly used to weaken the boundary influence of the backlight partition. The second filtering module 511 is configured to perform the second filtering process of the above-mentioned step S45, which is mainly used to simulate the backlight diffusion influence. The backlight interpolation module 512 is configured to perform the backlight interpolation process of the above-mentioned step S46. The driving mapping module 513 is configured to map the backlight filtering eigenvalues into a data format that can be processed by the backlight driving module 514. The backlight driving module 514 is configured to drive the backlight module.
[0247] In addition, a display device is provided in an embodiment of the present disclosure. FIG14 is a schematic diagram of a display device provided in an embodiment of the present disclosure. As shown in FIG14 , the display device includes a driving device 100 and a display screen 200 .
[0248] The driving device 100 is configured to determine, for any backlight partition among a plurality of backlight partitions pre-divided by the backlight module, first brightness information, second brightness information, and third brightness information of the backlight partition based on first pixel data of each pixel in the image to be displayed; the first brightness information represents the maximum value of the brightness characteristics of each pixel in the backlight partition, the second brightness information represents the average value of the brightness characteristics of each pixel in the backlight partition, and the third brightness information represents the brightness characteristic value determined based on the brightness characteristics of each pixel in the backlight partition and the brightness characteristics of each pixel in a first adjacent backlight partition surrounding the backlight partition; determine the first backlight characteristic value of the backlight partition based on the first brightness information, the second brightness information, and the third brightness information of the backlight partition; filter the first backlight characteristic value of each backlight partition to obtain the second backlight characteristic value of each backlight partition; and compensate the first pixel data of each pixel in the image to be displayed based on the second backlight characteristic value of each backlight partition to obtain compensated second pixel data.
[0249] The display screen 200 is configured to perform display according to the received second pixel data.
[0250] The display device of the disclosed embodiment is primarily intended for use in high-speed, dynamically moving objects and high-refresh-rate display scenarios. It fully considers the brightness characteristics within a single backlight partition (e.g., the center backlight partition), namely, the first brightness information and the second brightness information. In particular, the average brightness characteristics of each sub-partition within the center backlight partition and the first adjacent backlight partition affect the brightness of the center backlight partition, namely, the third brightness information. For a single backlight partition, the first backlight characteristic value of the backlight partition is determined by combining the first, second, and third brightness information. This effectively suppresses sudden backlight changes when an object moves at high speed across the corresponding display range of the backlight partition, thereby improving the local light control effect.
[0251] In some embodiments, as shown in FIG13 , the driving device 100 includes a SOC and a FPGA.
[0252] In some embodiments, as shown in Figure 14, the display device also includes a backlight module 300; the backlight module 300 includes multiple backlight partitions and backlight driving components corresponding to the backlight partitions one by one; the driving mapping module 513 is configured to perform feature mapping on the backlight filtering characteristic values of each backlight partition to obtain the backlight driving value of each backlight partition; the backlight driving module 514 is configured to send the backlight driving value of each backlight partition to the corresponding backlight driving component; each backlight driving component is configured to drive the backlight partition to emit backlight according to the received backlight driving value of the backlight partition.
[0253] Other essential components of the display device should be understood by those skilled in the art and will not be described in detail here, nor should they be construed as limiting the present disclosure.
[0254] Figure 15 is a schematic diagram of the structure of a computer device provided in an embodiment of the present disclosure. As shown in Figure 15, an embodiment of the present disclosure provides a computer device comprising: one or more processors 601, a memory 602, and one or more I / O interfaces 603. The memory 602 stores one or more programs, which, when executed by the one or more processors, enable the one or more processors to implement any of the display control methods or display methods described in the above embodiments; one or more I / O interfaces 603 are connected between the processor and the memory and are configured to enable information exchange between the processor and the memory.
[0255] Among them, the processor 601 is a device with data processing capabilities, including but not limited to a central processing unit (CPU); the memory 602 is a device with data storage capabilities, including but not limited to random access memory (RAM, more specifically SDRAM, DDR, etc.), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), and flash memory (FLASH); the I / O interface (read-write interface) 603 is connected between the processor 601 and the memory 602, and can realize information interaction between the processor 601 and the memory 602, including but not limited to a data bus (Bus), etc.
[0256] In some embodiments, the processor 601 , the memory 602 , and the I / O interface 603 are connected to each other via a bus 604 , and further connected to other components of the computing device.
[0257] According to an embodiment of the present disclosure, a non-transitory computer-readable storage medium is further provided. The non-transitory computer-readable storage medium stores a computer program, wherein when the program is executed by a processor, the program implements the steps of any of the display control methods or display methods described in the above embodiments.
[0258] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a machine-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication part, and / or installed from a removable medium. When the computer program is executed by a central processing unit (CPU), the above-mentioned functions defined in the system of the present disclosure are executed.
[0259] It should be noted that the computer non-transitory readable medium shown in the present disclosure can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or component, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any non-transitory computer-readable storage medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the non-transitory computer-readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wire, optical cable, RF, etc., or any suitable combination thereof.
[0260] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architectures, functions and operations of the devices, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the aforementioned module, program segment, or a part of code contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions marked in the boxes can also occur in an order different from that marked in the accompanying drawings. For example, two connected boxes can actually represent execution in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0261] It is understood that the above embodiments are merely exemplary embodiments for illustrating the principles of the present disclosure, and the present disclosure is not limited thereto. Those skilled in the art may make various modifications and improvements without departing from the spirit and substance of the present disclosure, and such modifications and improvements are also considered to be within the scope of protection of the present disclosure.
Claims
1. A display control method, wherein: include: For any backlight partition among a plurality of backlight partitions pre-divided by the backlight module, determining first brightness information, second brightness information, and third brightness information of the backlight partition based on first pixel data of each pixel in an image to be displayed; the first brightness information represents a maximum value of brightness characteristics of each pixel in the backlight partition, the second brightness information represents an average value of the brightness characteristics of each pixel in the backlight partition; and the third brightness information represents a brightness characteristic value determined based on the brightness characteristics of each pixel in the backlight partition and the brightness characteristics of each pixel in a first adjacent backlight partition surrounding the backlight partition; Determining a first backlight characteristic value of the backlight partition according to the first brightness information, the second brightness information, and the third brightness information of the backlight partition; filtering the first backlight characteristic value of each of the backlight subareas to obtain a second backlight characteristic value of each of the backlight subareas; The first pixel data of each pixel point in the image to be displayed is compensated according to the second backlight characteristic value of each backlight partition to obtain compensated second pixel data for display.
2. The display control method according to claim 1, wherein: Determining third brightness information of the backlight subarea according to first pixel data of each pixel point in the image to be displayed includes: Extracting grayscale features of each pixel point according to first pixel data of each pixel point in the image to be displayed to obtain a grayscale feature value of each pixel point; For any of the backlight partitions, the backlight partition is taken as a central backlight partition, and the backlight partitions within a first preset distance range from the central backlight partition are taken as first adjacent backlight partitions; determining fourth brightness information of each sub-region based on the grayscale characteristic value of each pixel in the central backlight region and the first adjacent backlight region, and each pre-divided sub-region of the central backlight region and each sub-region of the first adjacent backlight region; the fourth brightness information represents an average brightness characteristic of each pixel in the sub-region; The third brightness information of the central backlight partition is determined according to the fourth brightness information of each sub-partition and a predetermined distance weight coefficient corresponding to each sub-partition.
3. The display control method according to claim 2, wherein: The step of determining the distance weight coefficient corresponding to each sub-region includes: determining, according to the first position information of the central backlight partition and the second position information of each of the sub-partitions in the central backlight partition and the first adjacent backlight partition, a first distance between each of the sub-partitions and the central backlight partition; For any of the sub-regions, a distance weight coefficient corresponding to the sub-region is determined according to the first distance between the sub-region and the central backlight region and the sum of the first distances between each of the sub-regions and the central backlight region.
4. The display control method according to claim 3, wherein: The determining the third brightness information of the central backlight partition according to the fourth brightness information of each of the sub-partitions and a predetermined distance weight coefficient corresponding to each of the sub-partitions includes: For any of the sub-regions, calculating a product of a distance weight coefficient corresponding to the sub-region and the fourth brightness information of the sub-region as an intermediate brightness feature of the sub-region; For one of the backlight sub-regions, a sum of the intermediate brightness features of all the sub-regions is calculated as the third brightness information of the central backlight sub-region.
5. The display control method according to claim 1, wherein: Determining first brightness information and second brightness information of the backlight subarea according to first pixel data of each pixel point in the image to be displayed includes: Extracting grayscale features of each pixel point according to first pixel data of each pixel point in the image to be displayed to obtain a grayscale feature value of each pixel point; determining a maximum value among the grayscale characteristic values according to the grayscale characteristic values of the pixels corresponding to the backlight partition, and using the maximum value among the grayscale characteristic values as first brightness information of the backlight partition; According to the grayscale characteristic values of each pixel point corresponding to the backlight partition, an average value of each grayscale characteristic value is calculated, and the average value is used as the second brightness information of the backlight partition.
6. The display control method according to claim 1, wherein: The determining, according to the first brightness information, the second brightness information, and the third brightness information of the backlight partition, a first backlight characteristic value of the backlight partition includes: Calculating a product of the first brightness information of the backlight partition and a first influence coefficient of the maximum brightness feature as a first intermediate sub-feature under the influence of the maximum brightness feature; Calculating a product of the second brightness information of the backlight partition and a second influence coefficient of the average brightness feature as a second intermediate sub-feature under the influence of the average brightness feature; Calculating a product of the third brightness information of the backlight partition and the third influence coefficient of the position feature as a third intermediate sub-feature under the influence of the position feature; The sum of the first intermediate sub-feature, the second intermediate sub-feature, and the third intermediate sub-feature is used as the first backlight feature value of the backlight subarea.
7. The display control method according to claim 6, wherein: The first influence coefficient and the second influence coefficient are determined based on the brightness of the display scene corresponding to the video to be played; the third influence coefficient is determined based on the moving speed of the object in the display scene corresponding to the video to be played; the sum of the first influence coefficient, the second influence coefficient and the third influence coefficient is 1; The first influence coefficient is negatively correlated with the brightness of the display scene, the second influence coefficient is positively correlated with the brightness of the display scene; and the third influence coefficient is positively correlated with the moving speed of the object.
8. The display control method according to claim 1, wherein: The filtering of the first backlight characteristic value of each backlight partition to obtain the second backlight characteristic value of each backlight partition includes: Filtering the first backlight characteristic value of each backlight partition to obtain a backlight filtering characteristic value of each backlight partition; For any of the backlight partitions, the second backlight eigenvalue of the backlight partition is determined based on a predetermined brightness attenuation area related to the backlight partition, a filter kernel corresponding to the brightness attenuation area, and the backlight filter eigenvalues of each backlight partition in the brightness attenuation area; the filter kernel includes a backlight attenuation coefficient corresponding to each backlight partition in the brightness attenuation area.
9. The display control method according to claim 8, wherein: The filtering of the first backlight characteristic value of each backlight partition to obtain the backlight filtering characteristic value of each backlight partition includes: For any of the backlight partitions, the backlight partition is divided into a central backlight partition, and the backlight partitions within a second preset distance range from the central backlight partition are divided into second adjacent backlight partitions; taking the maximum value of the first backlight eigenvalue of the central backlight subarea and the first backlight eigenvalue of the second adjacent backlight subarea as the regional maximum eigenvalue of the central backlight subarea; Adjusting the maximum eigenvalue of the region according to a preset adjustment factor to determine the weighted brightness eigenvalue of the central backlight partition; The maximum value between the weighted brightness eigenvalue and the first backlight eigenvalue of the central backlight subarea is used as the backlight filtering eigenvalue of the central backlight subarea.
10. The display control method according to claim 8, wherein: The determining, based on a predetermined brightness attenuation region associated with the backlight partition, a filter kernel corresponding to the brightness attenuation region, and backlight filter eigenvalues of each backlight partition in the brightness attenuation region, includes: When the number of the backlight partitions in the brightness attenuation region is equal to a preset value, using a filter kernel corresponding to the brightness attenuation region, weighted processing is performed on the backlight filter eigenvalues of the respective backlight partitions in the brightness attenuation region to obtain a second backlight eigenvalue of the backlight partition; wherein the preset value is the same as the number of the backlight attenuation coefficients in the filter kernel; In the case that the number of backlight partitions in the brightness attenuation area is less than a preset value, a preset mirroring algorithm is used to supplement virtual backlight partitions for the brightness attenuation area based on the backlight partitions in the brightness attenuation area and their backlight filtering eigenvalues, and the backlight filtering eigenvalues of the virtual backlight partitions are determined; and the backlight filtering eigenvalues of each backlight partition and each virtual backlight partition in the brightness attenuation area are weightedly processed using the filter kernel corresponding to the brightness attenuation area to obtain a second backlight eigenvalue of the backlight partition.
11. The display control method according to claim 8, wherein: After filtering the first backlight characteristic value of each backlight subarea to obtain the backlight filtering characteristic value of each backlight subarea, the method further includes: Perform feature mapping on the backlight filter characteristic values of each backlight partition to obtain the backlight filter characteristic values of each backlight partition. The backlight driving value of the light partition is used for backlight driving.
12. The display control method according to claim 1, wherein: The compensating the first pixel data of each pixel point in the image to be displayed according to the second backlight characteristic value of each backlight partition to obtain compensated second pixel data includes: For any of the backlight partitions, determining a third backlight characteristic value of each pixel in the image to be displayed using a preset linear interpolation algorithm according to the second backlight characteristic value of the backlight partition; For any pixel in the image to be displayed, determining a compensation factor for the pixel according to a third backlight characteristic value of the pixel; For any pixel point in the image to be displayed, the compensation factor is used to compensate the first pixel data of the pixel point to obtain compensated second pixel data.
13. A display method, wherein: include: Obtaining a video stream to be played, detecting a preset number of consecutive frames of images to be displayed in the video stream, and determining whether there is a moving object with a moving speed greater than a preset speed; When it is detected that the moving speed of the moving object is greater than a preset speed, each frame of the image to be displayed is displayed according to the display control method according to any one of claims 1 to 12. 14 . A driving device configured to execute the steps of the display control method according to claim 1 .
15. A display device comprising a driving device and a display screen; The driving device is configured to determine, for any backlight partition among a plurality of backlight partitions pre-divided by the backlight module, first brightness information, second brightness information, and third brightness information of the backlight partition based on first pixel data of each pixel in an image to be displayed; the first brightness information represents a maximum value of brightness characteristics of each pixel in the backlight partition, the second brightness information represents an average value of brightness characteristics of each pixel in the backlight partition, and the third brightness information represents a brightness characteristic value determined based on the brightness characteristics of each pixel in the backlight partition and the brightness characteristics of each pixel in a first adjacent backlight partition surrounding the backlight partition; Determine the brightness information of the backlight partition according to the first brightness information, the second brightness information and the third brightness information. A first backlight characteristic value of a backlight partition; filtering the first backlight characteristic value of each of the backlight subareas to obtain a second backlight characteristic value of each of the backlight subareas; Compensating first pixel data of each pixel point in the image to be displayed according to the second backlight characteristic value of each backlight subarea to obtain compensated second pixel data; The display screen is configured to perform display according to the received second pixel data.
16. The display device according to claim 15, wherein: Also includes a backlight module; the backlight module includes a plurality of backlight partitions and backlight driving components corresponding to the backlight partitions one by one; The driving device is further configured to perform feature mapping on the backlight filtering feature values of each backlight partition to obtain a backlight driving value of each backlight partition; Each of the backlight driving components is configured to drive the backlight subarea to emit backlight according to the received backlight driving value of the backlight subarea.
17. A computer device, wherein: include: A processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the computer device is running, the processor and the memory communicate via the bus, and when the machine-readable instructions are executed by the processor, the steps of the display control method according to any one of claims 1 to 12 are performed, or the steps of the display method according to claim 13 are performed.
18. A computer non-transitory readable storage medium, wherein: The computer non-transitory readable storage medium stores a computer program, which, when executed by a processor, executes the steps of the display control method according to any one of claims 1 to 12, or the steps of the display method according to claim 13.
Citation Information
Patent Citations
Liquid crystal display method
CN101383132A
Backlight value extraction method and device
CN102117603A
Backlight smoothing method applied to liquid crystal display dynamic dimming and device
CN103514853A
Image processing method and liquid crystal display
CN105304028A
Pixel compensation method and device and terminal equipment
CN109817170A