Tone mapping method, device, equipment and computer readable storage medium

Abstract

The application discloses a tone mapping method, device and equipment and a computer readable storage medium. The method comprises the following steps: obtaining a creation intention parameter graph and a target hardware capability parameter graph corresponding to a to-be-processed image; determining tone mapping information of each pixel point in the to-be-processed image based on the creation intention parameter graph and the target hardware capability parameter graph; and performing tone mapping on each pixel point based on the tone mapping information to obtain a target image. The method can effectively solve the inherent defects of global tone mapping, such as the inability to adapt to regional brightness differences and the imbalance of light and shade in local areas, and make the mapping result have hardware adaptability.

Description

Technical Field

[0001] This application relates to the field of display technology, specifically to a tone mapping method, apparatus, device, and computer-readable storage medium. Background Technology

[0002] With the continuous development of display technology, High Dynamic Range (HDR) video technology has become a standard feature of modern display devices. HDR technology expands the dynamic range of video signals, enabling images to display a wider range of brightness and richer color details, thus providing users with a more realistic visual experience. However, the brightness capabilities of terminal display devices are typically far lower than the brightness range required for HDR content creation. For example, professional monitors can achieve peak brightness of 1000 nits or even 4000 nits, while consumer-grade LCD displays typically have a peak brightness of only 400-800 nits. Therefore, tone mapping (TM) technology is needed to map the brightness range of HDR content to the brightness range that the display device can display.

[0003] Traditional tone mapping methods primarily employ a global tone mapping strategy, applying a uniform mapping curve to the entire image. While global tone mapping is computationally simple, it cannot adapt to brightness differences across different areas of the image, easily leading to overexposure or underexposure in localized areas. Summary of the Invention

[0004] This application provides a tone mapping method, apparatus, device, and computer-readable storage medium, which can effectively solve the inherent defects of global tone mapping in adapting to regional brightness differences and local imbalance of light and dark, and make the mapping results hardware-adaptable.

[0005] The technical solution adopted by this invention to solve the problem is as follows: In a first aspect, this application provides a tone mapping method applied to a display device, comprising: Obtain the creative intent parameter map and the target hardware capability parameter map corresponding to the image to be processed; Based on the creative intent parameter map and the target hardware capability parameter map, the tone mapping information of each pixel in the image to be processed is determined. The target image is obtained by performing tone mapping on each pixel based on tone mapping information.

[0006] In some embodiments of this application, the creative intent parameter map is obtained through the following steps: Receive spatial dynamic metadata sent by the source device; Decode the spatial dynamic metadata to obtain the tone mapping parameter map; The tone mapping parameter map is blurred and diffused according to the resolution of the image to be processed to obtain the creative intent parameter map.

[0007] In some embodiments of this application, the creative intent parameter map is obtained through the following steps: The image to be processed is segmented into regions to obtain multiple region images; Tone mapping parameter statistics were performed on multiple regions of the image to obtain a tone mapping parameter map. The tone mapping parameter map is blurred and diffused according to the resolution of the image to be processed to obtain the creative intent parameter map.

[0008] In some embodiments of this application, the target hardware capability parameter map is obtained through the following steps: Obtain the backlight drive signal values ​​of multiple local dimming zones of the image to be processed; Based on the backlight drive signal value and the panel's black state brightness, a candidate hardware capability parameter diagram is obtained; The candidate hardware capability parameter map is blurred and diffused according to the resolution of the image to be processed to obtain the target hardware capability parameter map.

[0009] In some embodiments of this application, a candidate hardware capability parameter map is obtained based on the backlight drive signal value and the panel's black state brightness, including: Based on the backlight drive signal value, determine the first brightness capability value of each local dimming zone; Based on the panel's black state brightness, determine the second brightness capability value for each local dimming zone; Based on the first brightness capability value and the second brightness capability value, a candidate hardware capability parameter diagram is obtained.

[0010] In some embodiments of this application, a first brightness capability value for each local dimming zone is determined based on the backlight drive signal value, including: The third brightness capability value of each local dimming zone is determined based on the zone's basic brightness value, the backlight drive signal value of each local dimming zone, and the brightness scaling factor of each local dimming zone. Based on the third brightness capability value, determine the first brightness capability value for each local dimming zone.

[0011] In some embodiments of this application, a first luminance capability value for each local dimming zone is determined based on a third luminance capability value, including: The fourth brightness capability value for each local dimming zone is obtained based on the third brightness capability value and the halo brightness increment of each local dimming zone. The fifth brightness capability value for each local dimming zone is obtained based on the fourth brightness capability value and the correction coefficient for each local dimming zone. The first brightness capability value of each local dimming zone is obtained based on the fifth brightness capability value and the temperature compensation coefficient of each local dimming zone.

[0012] In some embodiments of this application, a first brightness capability value for each local dimming zone is determined based on the backlight drive signal value, including: Based on the backlight drive signal value, determine the drive signal level for each local dimming zone; Based on the drive signal level, determine the first brightness capability value for each local dimming zone.

[0013] In some embodiments of this application, a second brightness capability value for each local dimming zone is determined based on the panel's black state brightness, including: Multiply the panel's black state brightness by the correction coefficient for each local dimming zone to obtain the sixth brightness capability value for each local dimming zone; add the sixth brightness capability value to the halo brightness increment of each local dimming zone to obtain the second brightness capability value for each local dimming zone; or, The panel's black state brightness and the halo compensation amount for each local dimming zone are added together to obtain the second brightness capability value for each local dimming zone.

[0014] In some embodiments of this application, the creative intent parameter map includes a first luminance threshold and a second luminance threshold for each pixel, and the target hardware capability parameter map includes a seventh luminance capability value and an eighth luminance capability value for each pixel. Based on the creative intent parameter map and the target hardware capability parameter map, the tone mapping information of each pixel in the image to be processed is determined, including: For any pixel in the image to be processed, the third brightness threshold of the pixel is obtained based on the first brightness threshold and the seventh brightness capability value of the pixel. The fourth brightness threshold of the pixel is obtained based on the second brightness threshold and the eighth brightness capability value of the pixel. The tone mapping information of the pixel is determined based on the third brightness threshold and the fourth brightness threshold of the pixel.

[0015] In some embodiments of this application, a third brightness threshold for a pixel is obtained based on a first brightness threshold and a seventh brightness capability value for that pixel, including: When the first brightness threshold of a pixel is less than or equal to the seventh brightness capability value of the pixel, the first brightness threshold of the pixel is determined as the third brightness threshold of the pixel. When the first brightness threshold of a pixel is greater than the seventh brightness capability value of the pixel, the partition brightness state of the partition to which the pixel belongs is obtained; the first compression ratio of the pixel is determined based on the partition brightness state; the first brightness threshold and the seventh brightness capability value of the pixel are weighted and summed based on the first compression ratio to obtain the third brightness threshold of the pixel.

[0016] In some embodiments of this application, a fourth brightness threshold for a pixel is obtained based on a second brightness threshold and an eighth brightness capability value for that pixel, including: When the second brightness threshold of a pixel is greater than or equal to the eighth brightness capability value of the pixel, the second brightness threshold of the pixel is determined as the fourth brightness threshold of the pixel. When the second brightness threshold of a pixel is less than the eighth brightness capability value of the pixel, the eighth brightness capability value of the pixel is determined as the fourth brightness threshold of the pixel.

[0017] In some embodiments of this application, a third brightness threshold for a pixel is obtained based on a first brightness threshold and a seventh brightness capability value for that pixel, including: The first brightness ratio is obtained based on the first brightness threshold of the pixel and the seventh brightness capability value of the pixel; When the first brightness ratio is greater than or equal to the first threshold, the first brightness threshold of the pixel is determined as the third brightness threshold of the pixel. When the first brightness ratio is greater than or equal to the second threshold and less than the first threshold, the third brightness threshold of the pixel is determined based on the first brightness threshold and the first compression coefficient of the pixel; the second threshold is less than the first threshold. When the first brightness ratio is greater than or equal to the third threshold and less than the second threshold, the third brightness threshold of the pixel is determined based on the first brightness threshold and the second compression coefficient of the pixel; the second compression coefficient is less than the first compression coefficient, and the third threshold is less than the second threshold. When the first brightness ratio is less than the third threshold, the first brightness ratio of the pixels in the image to be processed is averaged to obtain the second brightness ratio; the third compression coefficient is determined based on the second brightness ratio; the first brightness threshold of the pixel and the seventh brightness capability value of the pixel are weighted and summed based on the third compression coefficient to obtain the third brightness threshold of the pixel.

[0018] In some embodiments of this application, the creative intent parameter map includes a first luminance threshold for each pixel, a second luminance threshold for each pixel, a gamma mode parameter for each pixel, and a transition interval parameter for each pixel. The target hardware capability parameter map includes a seventh luminance capability value for each pixel. Based on the creative intent parameter map and the target hardware capability parameter map, the tone mapping information of each pixel in the image to be processed is determined, including: For any pixel in the image information to be processed, the fifth brightness threshold of the pixel is obtained based on the first brightness threshold and the seventh brightness capability value of the pixel. The sixth brightness threshold of the pixel is obtained based on the second brightness threshold and the first scaling factor. The gamma value of the pixel is obtained based on the gamma mode parameters of the pixel. Based on the transition interval parameters of the pixel, the transition smoothness coefficient of the pixel is obtained; The tone mapping information of the pixel is determined based on the fifth brightness threshold, the sixth brightness threshold, the gamma value, and the transition smoothing coefficient.

[0019] In some embodiments of this application, a fifth brightness threshold for a pixel is obtained based on a first brightness threshold and a seventh brightness capability value for that pixel, including: When the first brightness threshold of a pixel is greater than the seventh brightness capability value of the pixel, a second scaling factor is obtained based on the first brightness threshold and the seventh brightness capability value of the pixel; and a fifth brightness threshold of the pixel is obtained based on the second scaling factor and the first brightness threshold of the pixel. When the first brightness threshold of a pixel is less than or equal to the seventh brightness capability value of the pixel, the first brightness threshold and the third scaling factor of the pixel are multiplied to obtain the fifth brightness threshold of the pixel.

[0020] In some embodiments of this application, the gamma value of the pixel is obtained based on the gamma mode parameters of the pixel, including: When the gamma mode parameter of a pixel is the first value, the gamma value of that pixel is determined to be the first parameter value. When the gamma mode parameter of a pixel is the second value, the gamma value of that pixel is determined to be the second parameter value. When the gamma mode parameter of a pixel is not the first value or the second value, the gamma value of the pixel is determined to be the third parameter value; wherein, the first parameter value > the third parameter value > the second parameter value.

[0021] In some embodiments of this application, the transition smoothness coefficient of the pixel is obtained based on the transition interval parameter of the pixel, including: When the transition interval parameter of the pixel is the third value, the transition smoothness coefficient of the pixel is determined to be the fourth parameter value; When the transition interval parameter of the pixel is the fourth value, the transition smoothness coefficient of the pixel is determined to be the fifth parameter value; When the transition interval parameter of a pixel is not the third or fourth value, the transition smoothness coefficient of the pixel is determined to be the sixth parameter value; where the fourth parameter value > the sixth parameter value > the fifth parameter value.

[0022] In some embodiments of this application, the creative intent parameter map includes a tone protection factor for each pixel. After tone mapping is performed on each pixel in the image to be processed based on tone mapping information to obtain the target image, the process includes: For any pixel in the image to be processed, when the hue protection factor of the pixel is greater than the fourth threshold, the saturation coefficient of the pixel is determined according to the first brightness ratio. Based on the saturation coefficient, the color of the pixels in the target image that match the pixel is adjusted.

[0023] Secondly, embodiments of the present invention also provide a tone mapping device, applied to a source-end device, comprising: Based on the image information to be processed, determine the spatial dynamic metadata; Spatial dynamic metadata is sent to the display device so that the display device can determine the creative intent parameter map corresponding to the image to be processed based on the spatial dynamic metadata, and perform tone mapping on each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map.

[0024] In some embodiments of this application, spatial dynamic metadata is determined based on the image information to be processed, including: The image to be processed is segmented into regions to obtain multiple region images; Tone mapping parameter statistics were performed on multiple regions of the image to obtain a tone mapping parameter map. The tone mapping parameter map is encoded to obtain spatial dynamic metadata.

[0025] In some embodiments of this application, the image to be processed is segmented according to a fixed grid of preset size. The segmentation size of the fixed grid includes any one of 4×4 partitions, 8×8 partitions, and 16×16 partitions.

[0026] In some embodiments of this application, the tone mapping parameter map includes at least one of the following: a seventh luminance threshold for each region image, an eighth luminance threshold for each region image, a transition interval parameter for each region image, a black level boost parameter for each region image, a white level gain parameter for each region image, and a gamma mode parameter for each region image.

[0027] Thirdly, embodiments of the present invention also provide a tone mapping device, applied to a display device, comprising: The information acquisition module is used to acquire the creative intent parameter map and the target hardware capability parameter map corresponding to the image to be processed; The information determination module is used to determine the tone mapping information of each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map. The tone mapping module is used to perform tone mapping on each pixel based on tone mapping information to obtain the target image.

[0028] Fourthly, embodiments of the present invention also provide a tone mapping apparatus, applied to a source-end device, comprising: The data determination module is used to determine spatial dynamic metadata based on the image information to be processed; The data sending module is used to send spatial dynamic metadata to the display device, so that the display device can determine the creative intent parameter map corresponding to the image to be processed based on the spatial dynamic metadata, and perform tone mapping on each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map.

[0029] Fifthly, this application also provides a display device, which includes: One or more processors; Memory; and One or more applications, wherein the applications are stored in memory and configured to be executed by a processor to implement the tone mapping method of any of the first aspects.

[0030] Sixthly, this application also provides a source-end device, which includes: One or more processors; Memory; and One or more applications, wherein the applications are stored in memory and configured to be executed by a processor to implement the tone mapping method of any of the second aspects.

[0031] In a seventh aspect, this application also provides a computer-readable storage medium having a computer program stored thereon, the computer program being loaded by a processor to perform the steps in the tone mapping method of either the first or second aspect.

[0032] The beneficial effects of this invention are as follows: Based on the creative intent parameter map and the target hardware capability parameter map, the tone mapping information of each pixel in the image to be processed is determined, so that the tone mapping information can match the real-time backlight emission capability of the current partition of the screen, preventing the mapped output brightness from exceeding the range that the panel hardware can reproduce, and making the mapping result hardware-adaptable; Based on the tone mapping information, tone mapping is performed on each pixel, which can specifically suppress the brightness of highlight pixels to avoid overexposure, and brighten the dark pixels to restore details and prevent underexposure, effectively solving the inherent defects of global tone mapping in being unable to adapt to regional brightness differences and local imbalance of light and dark, and significantly improving the ability to retain image details. Attached Figure Description

[0033] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0034] Figure 1 This is a scene diagram of the tone mapping system provided in an embodiment of the present invention; Figure 2 This is a schematic flowchart of an embodiment of the tone mapping method provided by the present invention; Figure 3 This is a schematic flowchart of a specific embodiment of the tone mapping method provided in this invention; Figure 4 This is a schematic diagram of a specific embodiment of tone mapping parameter statistics provided in this invention. Figure 5 This is a schematic diagram of a specific embodiment of the fuzzy diffusion of tone mapping parameter maps provided in this invention; Figure 6 This is a schematic diagram of a specific embodiment of the fuzzy diffusion of hardware capability parameter diagrams provided in this invention; Figure 7 This is a schematic diagram of a specific embodiment of the process for determining tone mapping information provided in this invention. Figure 8 This is a schematic diagram of a specific embodiment of tone mapping provided in this invention; Figure 9 This is a schematic flowchart of another embodiment of the tone mapping method provided in this invention; Figure 10 This is a schematic diagram of a specific embodiment of the tone mapping device provided in this invention. Figure 11This is a schematic diagram of another specific embodiment of the tone mapping device provided in this invention; Figure 12 This is a schematic diagram of an embodiment of the display device provided in this invention. Detailed Implementation

[0035] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0036] In the description of this application, the terms "first," "second," "third," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined with "first," "second," "third," etc., may explicitly or implicitly include one or more features.

[0037] In this application, the term "exemplary" is used to mean "used as an example, illustration, or description." Any embodiment described as "exemplary" in this application is not necessarily to be construed as being more preferred or advantageous than other embodiments. The following description is provided to enable any person skilled in the art to make and use this application. Details are set forth in the following description for purposes of explanation. It should be understood that those skilled in the art will recognize that this application can be made without using these specific details. In other instances, well-known structures and processes are not described in detail to avoid obscuring the description of this application with unnecessary detail. Therefore, this application is not intended to be limited to the embodiments shown, but is consistent with the broadest scope of the principles and features disclosed in this application.

[0038] It should be noted that since the method in this application embodiment is executed in a display device, the processing objects of each display device exist in the form of data or information, such as time, which is essentially time information. It can be understood that if size, quantity, position, etc. are mentioned in subsequent embodiments, they are all corresponding data that exist so that the display device can process them. Specific details will not be elaborated here.

[0039] This application provides a tone mapping method, apparatus, device, and computer-readable storage medium, which will be described in detail below.

[0040] Please see Figure 1 , Figure 1This is a schematic diagram of a tone mapping system provided in an embodiment of this application. The tone mapping system may include a display device 100, which integrates a tone mapping apparatus, such as... Figure 1 The display device in the middle.

[0041] In this embodiment, the display device 100 is mainly used to acquire the creative intent parameter map and the target hardware capability parameter map corresponding to the image to be processed; based on the creative intent parameter map and the target hardware capability parameter map, the tone mapping information of each pixel in the image to be processed is determined; and the tone mapping is performed on each pixel based on the tone mapping information to obtain the target image. This embodiment, by combining the creative intent parameter map and the target hardware capability parameter map to determine the tone mapping information, can make the tone mapping information match the real-time backlight illumination capability of the current screen partition, and the mapping result has hardware adaptability; by performing pixel-level tone mapping based on the tone mapping information, the inherent defects of global tone mapping in adapting to regional brightness differences and local imbalances in brightness and darkness can be effectively solved.

[0042] In this embodiment, the display device 100 can be a device that includes both receiving and transmitting hardware, i.e., a device with receiving and transmitting hardware capable of performing bidirectional communication on a bidirectional communication link. Such a device may include cellular or other communication devices having a single-line display, a multi-line display, or a cellular or other communication device without a multi-line display. Specifically, the display device 100 can be a desktop terminal or a mobile terminal, and may also be a smart TV, mobile phone, tablet computer, laptop computer, etc.

[0043] Those skilled in the art will understand that Figure 1 The application environment shown is merely one application scenario of the solution in this application and does not constitute a limitation on the application scenario of the solution in this application. Other application environments may include those that are more specific to this application. Figure 1 The number of display devices shown, such as more or fewer, are as follows: Figure 1 Only one display device is shown in the image. It is understood that the tone mapping system may also include one or more other services, which are not limited here.

[0044] In addition, such as Figure 1 As shown, the tone mapping system may also include a memory 200 for storing data, such as parameter diagrams, such as creative intent parameter diagrams, target hardware capability parameter diagrams, tone mapping parameter diagrams, etc., and brightness capability values, such as first brightness capability values, second brightness capability values, etc.

[0045] It should be noted that, Figure 1The schematic diagram of the tone mapping system shown is merely an example. The tone mapping system and scenarios described in this application are intended to more clearly illustrate the technical solutions of this application and do not constitute a limitation on the technical solutions provided in this application. As those skilled in the art will know, with the evolution of tone mapping systems and the emergence of new business scenarios, the technical solutions provided in this application are also applicable to similar technical problems.

[0046] First, this application provides a tone mapping method. The subject of the tone mapping method is a tone mapping device, which is applied to a display device. The tone mapping method includes: obtaining a creative intent parameter map and a target hardware capability parameter map corresponding to the image to be processed; determining the tone mapping information of each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map; and performing tone mapping on each pixel based on the tone mapping information to obtain the target image.

[0047] like Figure 2 The diagram shown is a flowchart of an embodiment of the tone mapping method in this application. This tone mapping method is applied to a display device and includes the following steps S201 to S203, as detailed below: Step S201: Obtain the creative intent parameter map and target hardware capability parameter map corresponding to the image to be processed.

[0048] In this embodiment, the image to be processed is a digital image requiring pixel-by-pixel tone mapping. The image to be processed includes one or more of the following: High Dynamic Range (HDR) image, RAW original image, HDR composite image, and multi-exposure fusion image. The creative intent parameter map is a parameter mapping map with the same resolution as the image to be processed. Each pixel position in the creative intent parameter map stores a corresponding pixel-specific tone mapping control parameter. The creative intent parameter map includes one or more of the following: a first brightness threshold for each pixel in the image to be processed, a second brightness threshold for each pixel, a transition interval parameter for each pixel, a black level boost parameter for each pixel, a white level gain parameter for each pixel, a gamma mode parameter for each pixel, a tone protection factor for each pixel, and a saturation enhancement amount for each pixel.

[0049] Optionally, the creative intent parameter map can be obtained from other devices, or it can be determined by the display device based on the image to be processed, as shown in the reference. Figure 3As shown, in some embodiments, the creative intent parameter map is obtained by the display device through the following steps: receiving spatial dynamic metadata sent by the source device; decoding the spatial dynamic metadata to obtain a tone mapping parameter map; and blurring and diffusing the tone mapping parameter map according to the resolution of the image to be processed to obtain the creative intent parameter map. This embodiment determines the spatial dynamic metadata by the source device and then sends it to the display device. This allows the complex parameter calculation process to be moved forward to the source device, significantly reducing the real-time computational load and overhead of the display device, and improving the processing speed and real-time rendering efficiency of the terminal tone mapping.

[0050] In this embodiment, the source device refers to the image source device of the image to be processed. The source device includes one or more of a player, set-top box, and front-end signal transmission device. Spatial dynamic metadata is a tone mapping control parameter data packet that carries screen spatial partition information and can be updated in real time frame by frame. It is sent to the display terminal after being statistically encoded in blocks by the source device to realize partition-differentiated tone mapping adjustment. In some embodiments, refer to Figure 3 As shown, spatial dynamic metadata is obtained by the source device through the following steps: performing region segmentation on the image to be processed to obtain multiple region images; performing tone mapping parameter statistics on the multiple region images to obtain tone mapping parameter maps; and encoding the tone mapping parameter maps to obtain spatial dynamic metadata.

[0051] Optionally, the image to be processed can be segmented into regions according to a fixed grid of preset size, wherein the division size of the fixed grid is a preset value, for example, the division size of the fixed grid includes any one of 4×4 partitions, 8×8 partitions, and 16×16 partitions. In some embodiments, the tone mapping parameter map includes at least one of the following: a seventh brightness threshold for each region image, an eighth brightness threshold for each region image, a transition interval parameter for each region image, a black level enhancement parameter for each region image, a white level gain parameter for each region image, a gamma mode parameter for each region image, a tone protection factor for each region image, and a saturation enhancement amount for each region image. For example, refer to... Figure 4 As shown, the tone mapping parameter diagram includes the seventh luminance threshold TM_MaxL, the eighth luminance threshold TM_MinL, the transition interval parameter TM_transition, the black level boost parameter TM_BlackLift, the white level gain parameter TM_WhiteGain, and the gamma mode parameter TM_GammaMode for each region image.

[0052] In some embodiments, the step of performing tone mapping parameter statistics on multiple regional images to obtain a tone mapping parameter map specifically includes: for any regional image among the multiple regional images, determining the maximum value of all pixel brightness values ​​of the regional image as the seventh brightness threshold of the regional image; and / or, determining the minimum value of all pixel brightness values ​​of the regional image as the eighth brightness threshold of the regional image; and / or, obtaining a first interval of the regional image based on the seventh brightness threshold and the eighth brightness threshold of the regional image; calculating the slope of the transition curve within the first interval based on the brightness histogram of the regional image; determining the slope of the transition curve as the transition interval parameter; and / or, counting the proportion of pixels with brightness less than the fifth threshold in the regional image, and obtaining the black level enhancement parameter of the regional image based on the proportion of pixels with brightness less than the fifth threshold in the regional image; and / or, counting the proportion of pixels with brightness greater than the sixth threshold in the regional image, and obtaining the white level gain parameter of the regional image based on the proportion of pixels with brightness greater than the sixth threshold in the regional image; and / or, obtaining the gamma mode parameter of the regional image based on the mean brightness value and the standard deviation of the regional image. For example, continue to refer to Figure 4 As shown, after the HDR original frame with 8×8 grid partitions is statistically analyzed, the following parameters can be obtained: the seventh brightness threshold TM_MaxL, the eighth brightness threshold TM_MinL, the transition interval parameter TM_transition, the black level boost parameter TM_BlackLift, the white level gain parameter TM_WhiteGain, and the gamma mode parameter TM_GammaMode corresponding to the Highlight partition, Dark partition, and Mid-tone partition, respectively.

[0053] Optionally, the first region can be represented as , This indicates the seventh brightness threshold. The eighth brightness threshold is used to indicate that, in some embodiments, the step of obtaining the first interval of the regional image based on the seventh brightness threshold and the eighth brightness threshold of the regional image specifically includes: using the eighth brightness threshold of the regional image as the lower limit of the first interval of the regional image and using the seventh brightness threshold of the regional image as the upper limit of the first interval of the regional image to obtain the first interval of the regional image.

[0054] In some embodiments, the step of obtaining the gamma mode parameter of the regional image based on the average brightness value and the standard deviation of the regional image specifically includes: determining the gamma mode parameter of the regional image as a first value when the average brightness value of the regional image is greater than a seventh threshold and the standard deviation of the regional image is less than an eighth threshold; determining the gamma mode parameter of the regional image as a second value when the average brightness value of the regional image is less than a ninth threshold and the standard deviation of the regional image is less than a tenth threshold; and determining the gamma mode parameter of the regional image as a fifth value when the average brightness value of the regional image is greater than the seventh threshold and the standard deviation of the regional image is greater than or equal to the eighth threshold, or when the average brightness value of the regional image is less than the ninth threshold and the standard deviation of the regional image is greater than or equal to the tenth threshold, or when the average brightness value of the regional image is greater than or equal to the ninth threshold and less than or equal to the seventh threshold. Among them, the seventh threshold is greater than the ninth threshold, the eighth threshold is greater than the tenth threshold, and the seventh, eighth, ninth and tenth thresholds can be set according to actual needs. For example, the seventh threshold is 500, the eighth threshold is 200, the ninth threshold is 200 and the tenth threshold is 100. When the mean is greater than 500 and the standard deviation is less than 200, the gamma mode parameter is determined to be 1; when the mean is less than 200 and the standard deviation is less than 100, the gamma mode parameter is determined to be 0; in other cases, the gamma mode parameter is determined to be 0.

[0055] In some embodiments, the tone mapping parameter map includes a tone protection factor for each region image. The step of performing tone mapping parameter statistics on multiple region images to obtain the tone mapping parameter map specifically includes: for any region image of the multiple region images, performing color space conversion on the region image to obtain a converted region image; calculating the proportion of pixels with saturation greater than the eleventh threshold in the converted region image; performing histogram statistics on the chromaticity values ​​of the converted region image to calculate the proportion of pixels within a preset peak range (e.g., ±15°) to the proportion of pixels with saturation greater than the eleventh threshold; and obtaining the tone protection factor of the region image based on the proportion of pixels with saturation greater than the eleventh threshold and the proportion of pixels within the preset peak range to the proportion of pixels with saturation greater than the eleventh threshold.

[0056] In some embodiments, the process of determining the hue protection factor can be expressed as: ,in, Indicates the hue protection factor. This indicates the percentage of pixels with a saturation level greater than the eleventh threshold. This represents the proportion of pixels within a preset peak range to the total number of pixels with saturation greater than the eleventh threshold. For example, if 40% of the pixels in a region of the image are highly saturated (S>0.6), and these pixels are concentrated in the red hue range (concentration=0.8), then... .

[0057] In some embodiments, the tone mapping parameter map includes the saturation enhancement amount of each region image. The step of performing tone mapping parameter statistics on multiple region images to obtain the tone mapping parameter map specifically includes: for any region image of the multiple region images, calculating the average saturation of the region image and the standard deviation of the saturation of the region image; and obtaining the saturation enhancement amount of the region image based on the average saturation of the region image and the standard deviation of the saturation of the region image.

[0058] In some embodiments, the step of obtaining the saturation enhancement amount of the image in a region based on the average saturation and the standard deviation of saturation of the image in that region specifically includes: when the average saturation of the image in that region is less than a twelfth threshold and the standard deviation of saturation of the image in that region is less than a thirteenth threshold, determining the saturation enhancement amount of the image in that region as a sixth value; when the average saturation of the image in that region is greater than a fourteenth threshold, determining the saturation enhancement amount of the image in that region as a seventh value; when the average saturation of the image in that region is less than a twelfth threshold and the standard deviation of saturation of the image in that region is greater than or equal to a thirteenth threshold, or when the average saturation of the image in that region is greater than or equal to a twelfth threshold and less than or equal to a fourteenth threshold, determining the saturation enhancement amount of the image in that region as a seventh value. Wherein, the twelfth threshold is less than the fourteenth threshold, the sixth value > the eighth value > the seventh value, and the twelfth, thirteenth, and fourteenth thresholds can be set according to actual needs, for example, the twelfth threshold is 0.3, the thirteenth threshold is 0.1, and the fourteenth threshold is 0.5. and ,Sure ;like ,Sure ;like and ,or, ,Sure ,in, This indicates the average saturation of the image in that region. This represents the standard deviation of saturation in the image of that region. This indicates the amount of saturation enhancement in the image of that region.

[0059] In this embodiment of the application, the step of encoding the tone mapping parameter map refers to the process of performing data normalization, compression, and format encapsulation on the two-dimensional tone mapping parameter map, converting the structured grid parameter array into a binary bitstream that conforms to the transmission protocol specification. For example, if the image to be processed is divided into regions to obtain 64 region images, each region image includes six tone mapping parameters: a seventh brightness threshold, an eighth brightness threshold, a transition interval parameter, a black level boost parameter, a white level gain parameter, and a gamma mode parameter. The seventh brightness threshold, the eighth brightness threshold, the transition interval parameter, the black level boost parameter, the white level gain parameter, and the gamma mode parameter occupy 10 bits, 8 bits, 6 bits, 6 bits, 6 bits, and 2 bits respectively when encoded. Then, the parameters of the 64 regions are encoded into spatial dynamic metadata, and the total bit width of the obtained spatial dynamic metadata is: 64 regions × (10 + 8 + 6 + 6 + 6 + 2) = 64 × 38 = 2432 bits.

[0060] Optionally, a Gaussian kernel blur diffusion method or a bilateral filter kernel diffusion method can be used to blur the tone mapping parameter map. This embodiment does not limit the method. For example, refer to Figure 5 As shown, when using Gaussian kernel blur diffusion to blur the tone mapping parameter map, the calculation process of the diffusion radius can be expressed as follows: ,in, Indicates the diffusion radius. Indicates the cell size of a fixed grid. This indicates the average size of the local dimming zone. This represents the adjustment coefficient. For example, a bilateral filter kernel diffusion method can be used to blur and diffuse the tone mapping parameter map. A Gaussian kernel is used in the spatial domain and a Gaussian kernel in the luminance domain. The diffusion kernel function can be expressed as: ,in, and Indicates pixel position, Represents the standard deviation of the spatial domain. Indicates the standard deviation of the luminance range. and This indicates the brightness value at the corresponding location.

[0061] In other embodiments, the creative intent parameter map can also be obtained by processing the image to be processed through a display device. In this case, the creative intent parameter map can also be obtained by the display device through the following steps: dividing the image to be processed into regions to obtain multiple region images; performing tone mapping parameter statistics on the multiple region images to obtain tone mapping parameter maps; and blurring and diffusing the tone mapping parameter maps according to the resolution of the image to be processed to obtain the creative intent parameter map.

[0062] Optionally, the process of performing tone mapping parameter statistics on multiple region images to obtain tone mapping parameter maps and blurring and diffusing the tone mapping parameter maps according to the resolution of the image to be processed to obtain creative intent parameter maps has been discussed in the aforementioned steps. For details, please refer to the aforementioned steps, and this embodiment will not repeat them here.

[0063] In this embodiment, the target hardware capability parameter map is a parameter mapping map with the same resolution as the image to be processed. Each pixel position in the target hardware capability parameter map stores the corresponding pixel's exclusive hardware limit performance parameters. The target hardware capability parameter map is used to impose hardware boundary constraints on the output brightness and color range during tone mapping operations. The target hardware capability parameter map includes a seventh brightness capability value and an eighth brightness capability value for each pixel. The seventh brightness capability value represents the maximum real-time output brightness of the screen at that pixel position, and the eighth brightness capability value represents the minimum real-time output brightness of the screen at that pixel position. Optionally, the target hardware capability parameter map can be obtained from other devices, or it can be determined by the display device based on the backlight drive signal values ​​of multiple local dimming zones of the image to be processed and the panel black state brightness. This embodiment does not limit this.

[0064] In some embodiments, the target hardware capability parameter map is obtained by the display device through the following steps: obtaining the backlight drive signal values ​​of multiple local dimming zones of the image to be processed; obtaining a candidate hardware capability parameter map based on the backlight drive signal values ​​and the panel black state brightness; and performing a blur diffusion on the candidate hardware capability parameter map according to the resolution of the image to be processed to obtain the target hardware capability parameter map. This embodiment, by obtaining the candidate hardware capability parameter map based on the backlight drive signal values ​​and the panel black state brightness, can accurately match the real-time luminous state of different zones of the partitioned backlight panel, dynamically obtain the upper and lower limits of the actual achievable brightness of each dimming zone, and provide a constraint benchmark that conforms to the real-time hardware operating conditions for subsequent tone mapping, avoiding mapping deviations caused by mismatch between static hardware parameters and real-time backlight states. By performing blur diffusion processing according to the resolution of the image to be processed to generate the target hardware capability parameter map, the upper and lower limits of the discrete brightness of the partitioned grid can be smoothly interpolated to the pixel level, eliminating the problem of abrupt changes in brightness parameters at the boundaries of the original dimming zones, weakening the visibility of the zone outlines, effectively avoiding display defects such as blocky light-dark boundaries and abrupt backlight zone halos after tone mapping, and improving the uniformity of image transition.

[0065] Optionally, Gaussian kernel fuzzy diffusion can be used to fuzzy diffuse the candidate hardware capability parameter map, or bilateral filter kernel diffusion can be used. This embodiment does not limit the specific method used. For example, refer to... Figure 6 As shown, the target hardware capability parameter map on the right can be obtained by performing fuzzy diffusion on the candidate hardware capability parameter map on the left.

[0066] In some embodiments, the step of obtaining a candidate hardware capability parameter map based on the backlight drive signal value and the panel's black state brightness specifically includes: determining a first brightness capability value for each local dimming zone based on the backlight drive signal value; determining a second brightness capability value for each local dimming zone based on the panel's black state brightness; and obtaining a candidate hardware capability parameter map based on the first and second brightness capability values. This embodiment, by determining the first brightness capability value based on the backlight drive signal value, can dynamically match the real-time light emission drive level of the backlight zones, accurately characterizing the current achievable peak output upper limit of each dimming zone, ensuring that the brightness upper limit constraint fits the real-time working state of the screen, and improving the accuracy of the highlight limit value for tone mapping; by determining the second brightness capability value based on the panel's black state brightness, it can objectively reflect the panel's physical minimum displayable brightness, taking into account the liquid crystal light-blocking performance and the black background difference caused by backlight leakage in the local dimming zones, setting a reasonable hardware lower limit for dark area mapping, avoiding tone mapping compressing dark signals to a brightness range that the screen cannot display, and effectively preventing the loss of dark details and the problem of dull, black shadows in night scenes.

[0067] In some embodiments, the step of determining the first brightness capability value of each local dimming zone based on the backlight drive signal value specifically includes: determining the third brightness capability value of each local dimming zone based on the zone's basic brightness value, the backlight drive signal value of each local dimming zone, and the brightness scaling factor of each local dimming zone; and determining the first brightness capability value of each local dimming zone based on the third brightness capability value.

[0068] In this embodiment, the partition base brightness value is used to characterize the reference base brightness that the backlight of each local dimming partition can output under the action of the corresponding backlight driving signal. The partition base brightness value is the basic reference value for calculating the maximum output peak brightness of the partition and constructing the hardware brightness capability boundary of the partition. In some embodiments, the process of determining the third brightness capability value can be expressed as: ,in, Indicates the first The third brightness capability value of each local dimming zone Indicates the base brightness value for the partition. Indicates the first Backlight drive signal values ​​for each local dimming zone Indicates the first The brightness scaling factor for each local dimming zone.

[0069] In some embodiments, the step of determining the first brightness capability value of each local dimming zone based on the third brightness capability value specifically includes: determining the third brightness capability value of each local dimming zone as the first brightness capability value of each local dimming zone.

[0070] In other embodiments, the step of determining the first brightness capability value of each local dimming zone based on the third brightness capability value specifically includes: obtaining a fourth brightness capability value of each local dimming zone based on the third brightness capability value and the halo brightness increment of each local dimming zone; obtaining a fifth brightness capability value of each local dimming zone based on the fourth brightness capability value and the correction coefficient of each local dimming zone; and obtaining a first brightness capability value of each local dimming zone based on the fifth brightness capability value and the temperature compensation coefficient of each local dimming zone. This embodiment calculates the fourth brightness capability value by superimposing the third brightness capability value of the partition with the halo brightness increment. This quantifies the actual brightness boosting effect caused by crosstalk and halo overflow in adjacent backlight partitions, restoring the true light emission performance of the partition. By introducing a partition-specific correction coefficient to correct the fourth brightness capability value, a fifth brightness capability value is obtained. This allows for targeted calibration of the inherent brightness dispersion error of mass-produced panels, eliminating the inherent brightness deviation of different partitions under the same driving level, further improving the accuracy of brightness capability evaluation for each partition, and ensuring uniformity of the brightness constraint benchmark across the entire screen. By applying a temperature compensation coefficient to the fifth brightness capability value to obtain the final first brightness capability value, this can adapt to the physical characteristics of LED luminous efficiency drifting with operating temperature, avoiding overestimation of the upper limit of brightness in high-temperature environments leading to high-light clipping, and underestimation in low-temperature environments limiting the dynamic range of the image.

[0071] In some embodiments, the process of determining the fourth luminance capability value can be expressed as follows: ,in, Indicates the first The fourth brightness capability value of each local dimming zone Indicates the first The third brightness capability value of each local dimming zone Indicates the first The increase in halo brightness for each local dimming zone.

[0072] In some embodiments, the process of determining the fifth luminance capability value can be expressed as follows: ,in, Indicates the first The fifth brightness capability value of each local dimming zone. Indicates the first Correction coefficients for each local dimming zone.

[0073] In some embodiments, the process of determining the first luminance capability value can be expressed as follows: ,in, Indicates the first The first brightness capability value of each local dimming zone. Indicates the first Temperature compensation coefficient for each local dimming zone.

[0074] In some embodiments, the temperature compensation coefficient is obtained by the following steps: obtaining candidate compensation coefficients based on the current temperature estimate and reference temperature value of each local dimming zone; and obtaining the temperature compensation coefficient of each local dimming zone based on the candidate compensation coefficients and the seventh parameter value.

[0075] Alternatively, the process of determining the temperature compensation coefficient can be expressed as follows: ,in, Indicates the first Temperature compensation coefficient for each local dimming zone This represents the value of the seventh parameter. Indicates the first Current temperature estimates for each local dimming zone. Indicates the reference temperature value. This represents the temperature coefficient. In some embodiments, ,For example, The process of determining the temperature compensation coefficient can be expressed as follows: Furthermore, the current temperature estimate can be calculated by accumulating historical drive signals, and the temperature coefficient and reference temperature value can be set according to actual needs, for example, , .

[0076] In some embodiments, the process of determining the halo brightness increment can be expressed as: , where halo_contribution( ) indicates the first The halo brightness increment of each local dimming zone, where Driver_Signal(j) represents the backlight drive signal value of the j-th local dimming zone. H represents the peak brightness of the j-th local dimming zone. ][j] represents the backlight of the j-th local dimming zone to the j-th local dimming zone. The contribution coefficient of halo brightness generated by each local dimming zone ,in, Indicates the halo amplitude coefficient. Indicates the first The distance between the j-th local dimming zone and the j-th local dimming zone Indicates the halo diffusion coefficient. and It can be configured according to actual needs, for example, The value range is 0.05 to 0.15. It is 0.5 times the width of the partition.

[0077] In other embodiments, the step of determining the first brightness capability value of each local dimming zone based on the backlight drive signal value specifically includes: determining the drive signal level of each local dimming zone based on the backlight drive signal value; and determining the first brightness capability value of each local dimming zone based on the drive signal level. For example, the backlight drive signal is divided into 10 levels (0-9), each level corresponding to a pre-calibrated brightness output value (calibrated at the factory through measurement) and stored in a lookup table. In the middle, if the first The drive signal level of each local dimming zone is Then the first The first brightness capability value of each local dimming zone .

[0078] In this embodiment, the panel black state brightness is used to characterize the inherent minimum physical brightness limit that the display panel partition can present under the influence of backlight leakage, liquid crystal light blocking performance, and optical film stray light when the backlight is off or the liquid crystal pixels are completely off. In some embodiments, the step of determining the second brightness capability value of each local dimming partition based on the panel black state brightness specifically includes: multiplying the panel black state brightness and the correction coefficient of each local dimming partition to obtain the sixth brightness capability value of each local dimming partition; and adding the sixth brightness capability value and the halo brightness increment of each local dimming partition to obtain the second brightness capability value of each local dimming partition. In this embodiment, the panel's black state brightness is multiplied by the correction coefficient of the corresponding local dimming zone to obtain the sixth brightness capability value. This can correct the inherent problem of inconsistent dark background in the zones when the panel is manufactured, making the initial minimum brightness assessment of each zone more consistent with the actual hardware characteristics of a single panel, and eliminating the inherent errors of color shift and uneven brightness in the dark background of zones of the same specification. By superimposing the zone halo brightness increment on the sixth brightness capability value, the second brightness capability value can be obtained, which can quantify the dark area rise phenomenon caused by light emission crosstalk and side light leakage of adjacent backlight zones, and restore the true minimum display brightness of the zone.

[0079] Optionally, the process of determining the second brightness capability value can be expressed as follows: ,in, Indicates the first The second brightness capability value for each local dimming zone. Indicates the panel's brightness in black state. Indicates the first Correction coefficients for each local dimming zone. Indicates the first The increase in halo brightness for each local dimming zone.

[0080] In other embodiments, the step of determining the second brightness capability value of each local dimming zone based on the panel's black state brightness specifically includes: adding the panel's black state brightness and the halo compensation amount of each local dimming zone to obtain the second brightness capability value of each local dimming zone. This embodiment solves for the second brightness capability value by superimposing the inherent black state brightness of the panel with the corresponding zone's halo compensation amount. This can quantify the dark background brightness enhancement effect caused by light emission crosstalk between adjacent backlight zones and edge light leakage, accurately restore the lowest true brightness that the local dimming zone can actually present, and avoid the problem of underestimating the lower limit of dark areas due to using only a fixed panel black state brightness and ignoring optical crosstalk.

[0081] In this embodiment, the halo compensation amount is used to characterize the additional brightness offset passively increased by the dark background of the current partition due to backlight optical crosstalk caused by the partition size and brightness differences between adjacent partitions. The halo compensation amount can be determined based on the partition size and brightness differences between adjacent partitions. In some embodiments, the process of determining the second brightness capability value can be expressed as follows: ,in, Indicates the first The second brightness capability value for each local dimming zone. Indicates the panel's brightness in black state. Indicates the first The amount of halo compensation for each local dimming zone.

[0082] S202. Based on the creative intent parameter map and the target hardware capability parameter map, determine the tone mapping information of each pixel in the image to be processed.

[0083] In this embodiment, tone mapping information is used to characterize the one-to-one nonlinear transformation mapping relationship between the original brightness value of the pixel in the image to be processed and the output brightness value of the target image. Optionally, when determining the tone mapping information of each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map, the creative intent parameter map and the target hardware capability parameter map can be weighted and fused to obtain a weighted fused parameter map. The tone mapping information of each pixel in the image to be processed can be obtained according to the weighted fused parameter map. Alternatively, the parameter values ​​in the creative intent parameter map and the parameter values ​​in the target hardware capability parameter map can be compared, and the tone mapping information of each pixel in the image to be processed can be determined according to the comparison result. This embodiment determines the tone mapping information of each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map, so that the tone mapping information can match the real-time backlight emission capability of the current partition of the screen, preventing the mapped output brightness from exceeding the reproducible range of the panel hardware, avoiding highlight clipping overflow and forced black distortion in dark areas from the root, and making the mapping result hardware-adaptable.

[0084] In some embodiments, the creative intent parameter map includes a first brightness threshold and a second brightness threshold for each pixel, and the target hardware capability parameter map includes a seventh brightness capability value and an eighth brightness capability value for each pixel, as referenced. Figure 7 As shown, step S202 above, which determines the tone mapping information of each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map, may include steps S301 to S303, as detailed below: S301. For any pixel in the image to be processed, obtain the third brightness threshold of the pixel based on the first brightness threshold and the seventh brightness capability value of the pixel.

[0085] In this embodiment, the first brightness threshold of each pixel is used to characterize the maximum brightness that the pixel is allowed to output after tone mapping processing, and the seventh brightness capability value of each pixel is used to characterize the pixel position and the upper limit of peak brightness that the current hardware of the display panel can stably output. In some embodiments, the step of obtaining the third brightness threshold of the pixel based on the first brightness threshold and the seventh brightness capability value of the pixel specifically includes: when the first brightness threshold of the pixel is less than or equal to the seventh brightness capability value of the pixel, determining the first brightness threshold of the pixel as the third brightness threshold of the pixel; when the first brightness threshold of the pixel is greater than the seventh brightness capability value of the pixel, obtaining the partition brightness state of the partition to which the pixel belongs; determining the first compression ratio of the pixel based on the partition brightness state; and performing a weighted summation of the first brightness threshold and the seventh brightness capability value of the pixel based on the first compression ratio to obtain the third brightness threshold of the pixel. In this embodiment, when the first brightness threshold does not exceed the maximum light emission limit of the pixel hardware (seventh brightness capability value), the first brightness threshold is directly reused as the third brightness threshold. This can save unnecessary compression calculations in scenarios where the image brightness requirement does not reach the hardware limit, reduce the computational load of the algorithm, and fully preserve the highlight adjustment strategy set by the creative intent. When the first brightness threshold exceeds the maximum hardware brightness capability of the pixel, the real-time brightness status of the backlight zone to which the pixel belongs is extracted. This can accurately identify the actual working conditions such as the current load, light emission margin, and temperature rise level of the zone, avoiding the use of a fixed compression coefficient to handle all over-limit scenarios. This allows the compression strategy to dynamically match the real-time working status of the zone, improving the adaptability of brightness constraints.

[0086] In this embodiment, the partition brightness state is used to characterize the brightness level range of the overall real-time luminous brightness of the current local dimming partition. In some embodiments, the step of determining the first compression ratio of a pixel based on the partition brightness state specifically includes: when the value corresponding to the partition brightness state is greater than the fifteenth threshold, determining the first compression ratio of the pixel as the ninth value; when the value corresponding to the partition brightness state is greater than the sixteenth threshold and less than or equal to the fifteenth threshold, determining the first compression ratio of the pixel as the tenth value; when the value corresponding to the partition brightness state is less than or equal to the sixteenth threshold, determining the first compression ratio of the pixel as the eleventh value. Wherein, the fifteenth threshold is greater than the sixteenth threshold. For example, if the fifteenth threshold is 0.8 and the sixteenth threshold is 0.5, when the value corresponding to the partition brightness state is greater than 0.8, the first compression ratio of the pixel is determined to be 0.7; when the value corresponding to the partition brightness state is greater than 0.5 and less than or equal to 0.8, the first compression ratio of the pixel is determined to be 0.5; when the value corresponding to the partition brightness state is less than or equal to 0.5, the first compression ratio of the pixel is determined to be 0.3.

[0087] In some embodiments, the process of determining the third brightness threshold can be expressed as follows: ,in, This indicates the location in the image to be processed. The third brightness threshold of the pixel at that location. Indicates the position as The first brightness threshold of the pixel at that location. Indicates the position as The seventh brightness capability value of the pixel at that location. Indicates the position as The first compression ratio of the pixels at that location.

[0088] In some other embodiments, the step of obtaining the third brightness threshold of a pixel based on the first brightness threshold and the seventh brightness capability value of the pixel specifically includes: obtaining a first brightness ratio based on the first brightness threshold and the seventh brightness capability value of the pixel; when the first brightness ratio is greater than or equal to the first threshold, determining the first brightness threshold of the pixel as the third brightness threshold of the pixel; when the first brightness ratio is greater than or equal to a second threshold and less than the first threshold, determining the third brightness threshold of the pixel based on the first brightness threshold and a first compression coefficient; when the first brightness ratio is greater than or equal to the third threshold and less than the second threshold, determining the third brightness threshold of the pixel based on the first brightness threshold and a second compression coefficient; when the first brightness ratio is less than the third threshold, averaging the first brightness ratios of pixels in the image to be processed to obtain a second brightness ratio; determining a third compression coefficient based on the second brightness ratio; and weighted summing the first brightness threshold and the seventh brightness capability value of the pixel based on the third compression coefficient to obtain the third brightness threshold of the pixel; wherein the second compression coefficient is less than the first compression coefficient, the second threshold is less than the first threshold, and the third threshold is less than the second threshold.

[0089] In some embodiments, the process of determining the first luminance ratio can be expressed as: , Indicates the first brightness ratio. Indicates the position as The first brightness threshold of the pixel at that location. Indicates the position as The seventh brightness capability value of the pixel at that location.

[0090] In some embodiments, when the first brightness ratio is greater than or equal to the second threshold and less than the first threshold, the process of determining the third brightness threshold can be expressed as follows: ,in, Indicates the position as The third brightness threshold of the pixel at that location. Indicates the position as The first brightness threshold of the pixel at that location. This represents the first compression factor.

[0091] In some embodiments, when the first brightness ratio is greater than or equal to a third threshold and less than a second threshold, the process of determining the third brightness threshold can be expressed as follows: ,in, Indicates the position as The third brightness threshold of the pixel at that location. Indicates the position as The first brightness threshold of the pixel at that location. This represents the second compression factor.

[0092] In some embodiments, when the first brightness ratio is less than the third threshold, the process of determining the third brightness threshold can be expressed as follows: ,in, Indicates the position as The third brightness threshold of the pixel at that location. Indicates the position as The first brightness threshold of the pixel at that location. Indicates the position as The seventh brightness capability value of the pixel at that location. This represents the third compression factor.

[0093] In some embodiments, the process of determining the third compression factor can be expressed as follows: ,in, This represents the third compression factor. Indicates the first brightness ratio. This indicates that the average value of the first brightness ratio of the pixels in the image to be processed is calculated.

[0094] Optionally, the first threshold, second threshold, third threshold, first compression coefficient, and second compression coefficient can be set according to actual needs. For example, the first threshold can be 1.0, the second threshold 0.8, the third threshold 0.5, the first compression coefficient 0.95, and the second compression coefficient 0.85. At that time, determine ,exist At that time, determine ,exist At that time, determine .

[0095] S302. Based on the second brightness threshold of the pixel and the eighth brightness capability value of the pixel, the fourth brightness threshold of the pixel is obtained.

[0096] In this embodiment, the second brightness threshold of each pixel is used to characterize the minimum brightness that the pixel is allowed to output after tone mapping processing, and the eighth brightness capability value of each pixel is used to characterize the pixel position and the lowest physical brightness limit that the current hardware of the display panel can stably output. In some embodiments, the step of obtaining the fourth brightness threshold of the pixel based on the second brightness threshold and the eighth brightness capability value of the pixel specifically includes: when the second brightness threshold of the pixel is greater than or equal to the eighth brightness capability value of the pixel, determining the second brightness threshold of the pixel as the fourth brightness threshold of the pixel; when the second brightness threshold of the pixel is less than the eighth brightness capability value of the pixel, determining the eighth brightness capability value of the pixel as the fourth brightness threshold of the pixel.

[0097] S303. Determine the tone mapping information of the pixel based on the third brightness threshold and the fourth brightness threshold of the pixel.

[0098] In some embodiments, the creative intent parameter map includes a transition interval parameter and a gamma mode parameter for each pixel. The step of determining the tone mapping information of a pixel based on a third brightness threshold and a fourth brightness threshold specifically includes: obtaining the slope parameter of the pixel based on the transition interval parameter; obtaining the gamma value of the pixel based on the gamma mode parameter; obtaining first mapping information based on the slope parameter, the gamma value, the third brightness threshold, and the fourth brightness threshold; and determining the tone mapping information of the pixel based on the first mapping information.

[0099] In some embodiments, the step of obtaining the gamma value of a pixel based on its gamma mode parameters specifically includes: determining the gamma value of the pixel as a first parameter value when the gamma mode parameter of the pixel is a first value; determining the gamma value of the pixel as a second parameter value when the gamma mode parameter of the pixel is a second value; and determining the gamma value of the pixel as a third parameter value when the gamma mode parameter of the pixel is neither the first nor the second value; wherein the first parameter value > the third parameter value > the second parameter value. For example, in hour, ;exist hour, When I(x,y).TM_GammaMode is a value other than 1 or 2, gamma = 2.2, where, Indicates the position as The gamma mode parameters of the pixel at that location, This represents the gamma value.

[0100] Optionally, when determining the slope parameter of a pixel based on the transition interval parameter of the pixel, the slope parameter of the pixel can be determined based on the mapping relationship between the transition interval parameter and the slope parameter, or it can be determined based on the value range of the transition interval parameter of the pixel. This embodiment does not limit this.

[0101] In some embodiments, the process of determining the first mapping information can be represented as follows: ,in, , , ,in, This represents the original brightness value of the image to be processed. This indicates that the first mapping information is used to... The brightness value obtained after mapping This represents the third brightness threshold of a pixel. This represents the fourth brightness threshold of a pixel. Represents the gamma value of a pixel. The slope parameter represents the pixel.

[0102] In some embodiments, the step of determining the tone mapping information of the pixel based on the first mapping information specifically includes: determining the first mapping information as the tone mapping information of the pixel.

[0103] In other embodiments, the creative intent parameter map includes a black level boost parameter and a white level gain parameter for each pixel. The step of determining the tone mapping information of the pixel based on the first mapping information specifically includes: determining the tone mapping information of the pixel based on the black level boost parameter, the white level gain parameter, and the first mapping information of the pixel.

[0104] Alternatively, the process of determining tone mapping information can be represented as: ,in, This indicates the use of tone mapping information to... The brightness value obtained after mapping This represents the black level boost parameter for a pixel. This represents the white level gain parameter of a pixel.

[0105] In other embodiments, the creative intent parameter map includes a first brightness threshold, a second brightness threshold, a gamma mode parameter, and a transition interval parameter for each pixel. The target hardware capability parameter map includes a seventh brightness capability value for each pixel. The step S202 above, which determines the tone mapping information of each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map, specifically includes: for any pixel in the image to be processed, obtaining a fifth brightness threshold for the pixel based on the first brightness threshold and the seventh brightness capability value; obtaining a sixth brightness threshold for the pixel based on the second brightness threshold and the first scaling factor; obtaining the gamma value for the pixel based on the gamma mode parameter; obtaining the transition smoothing coefficient for the pixel based on the transition interval parameter; and determining the tone mapping information for the pixel based on the fifth brightness threshold, the sixth brightness threshold, the gamma value, and the transition smoothing coefficient.

[0106] In some embodiments, the step of obtaining the fifth brightness threshold of a pixel based on the first brightness threshold and the seventh brightness capability value of the pixel specifically includes: when the first brightness threshold of the pixel is greater than the seventh brightness capability value of the pixel, obtaining a second scaling factor based on the first brightness threshold and the seventh brightness capability value of the pixel; obtaining the fifth brightness threshold of the pixel based on the second scaling factor and the first brightness threshold of the pixel; and when the first brightness threshold of the pixel is less than or equal to the seventh brightness capability value of the pixel, multiplying the first brightness threshold of the pixel by a third scaling factor to obtain the fifth brightness threshold of the pixel.

[0107] In some embodiments, the process of determining the second scaling factor can be expressed as follows: , This represents the second scaling factor. Indicates the position in the image to be processed The seventh brightness capability value of the pixel. Indicates the position in the image to be processed The first brightness threshold of the pixel, This represents the value of the eighth parameter. This represents the value of the ninth parameter. Optionally, , ,For example, , The process of determining the second scaling factor can be expressed as follows: .

[0108] In some embodiments, when the first brightness threshold of a pixel is greater than the seventh brightness capability value of the pixel, the process for determining the fifth brightness threshold is as follows: , Indicates the position in the image to be processed The fifth brightness threshold for a given pixel, for example. , The process for determining the fifth brightness threshold is as follows: .

[0109] In some embodiments, when the first brightness threshold of a pixel is less than or equal to the seventh brightness capability value of that pixel, the process for determining the fifth brightness threshold is as follows: , Indicates the position in the image to be processed The fifth brightness threshold for that pixel. This represents the third scaling factor. Optionally, ,For example, The process for determining the fifth brightness threshold is as follows: .

[0110] In some embodiments, the process of determining the sixth brightness threshold is as follows: , Indicates the position in the image to be processed The sixth brightness threshold for that pixel. This represents the first compression factor.

[0111] In this embodiment, the process of determining the gamma value of a pixel based on its gamma mode parameters has been described in the preceding steps, and will not be repeated here to avoid repetition.

[0112] In some embodiments, the step of obtaining the transition smoothness coefficient of a pixel based on the transition interval parameter of the pixel specifically includes: when the transition interval parameter of the pixel is a third value, determining the transition smoothness coefficient of the pixel as a fourth parameter value; when the transition interval parameter of the pixel is a fourth value, determining the transition smoothness coefficient of the pixel as a fifth parameter value; when the transition interval parameter of the pixel is neither the third nor the fourth value, determining the transition smoothness coefficient of the pixel as a sixth parameter value; wherein, the fourth parameter value > the sixth parameter value > the fifth parameter value. For example, in At that time, determine ;exist At that time, determine When I(x,y).TM_Transition is not 0 or 2, determine transition_smooth = 0.7, where, Indicates the position in the image to be processed The transition interval parameters of the pixel. This represents the transition smoothing coefficient.

[0113] In some embodiments, the creative intent parameter map includes a tone protection factor for each pixel. After tone mapping is performed on each pixel in the image to be processed based on tone mapping information to obtain the target image, the process includes: for any pixel in the image to be processed, when the tone protection factor of the pixel is greater than a fourth threshold, determining the saturation coefficient of the pixel based on a first brightness ratio; and adjusting the chromaticity of the pixels in the target image that match the pixel based on the saturation coefficient.

[0114] In this embodiment, there is a one-to-one correspondence between pixels in the target image and pixels in the image to be processed. The pixel in the target image that matches a given pixel refers to the pixel in the target image that corresponds to that given pixel. For example, the pixel in the image to be processed located at... The position of the pixel in the target image Pixel matching, based on position in the image to be processed. The saturation coefficient of a pixel at a given location in the target image Color adjustment is performed on each pixel. Optionally, the process of determining the saturation coefficient can be expressed as: ,in, Represents the saturation coefficient. This indicates the first brightness ratio.

[0115] In some embodiments, after obtaining the creative intent parameter map and the target hardware capability parameter map corresponding to the image to be processed, the process includes: smoothing the creative intent parameter map and the target hardware capability parameter map corresponding to the image to be processed, respectively, to obtain smoothed creative intent parameter maps and smoothed target hardware capability parameter maps. This embodiment, by smoothing the creative intent parameter map and the target hardware capability parameter map corresponding to the image to be processed, can suppress parameter abrupt changes between adjacent frames of the two types of parameter maps, making the temporal changes of the pixel-by-pixel tone mapping curve continuous and smooth, effectively avoiding the image brightness flicker problem caused by frame jumps in mapping parameters, and improving the temporal consistency of the video sequence.

[0116] Optionally, the creative intent parameter map and the target hardware capability parameter map corresponding to the image to be processed can be smoothed separately based on the temporal low-pass filtering method. Alternatively, bidirectional temporal filtering combined with scene switching can be used to smooth the creative intent parameter map and the target hardware capability parameter map corresponding to the image to be processed separately. Frame averaging filtering can also be used to smooth the creative intent parameter map and the target hardware capability parameter map corresponding to the image to be processed separately. This embodiment does not limit the specific methods used.

[0117] S203. Perform tone mapping on each pixel based on tone mapping information to obtain the target image.

[0118] In this embodiment, the target image is a pixel-level tone mapping of the image to be processed based on tone mapping information. The resulting tone-mapped image is generated pixel by pixel by combining the creative intent parameter map and the target hardware capability parameter map. The mapping rules are adaptively matched for the bright and dark areas of different pixels. This can specifically suppress the brightness of highlight pixels to avoid overexposure and brighten dark pixels to restore details and prevent underexposure. This effectively solves the inherent defects of global tone mapping in that it cannot adapt to regional brightness differences and local imbalance of brightness and darkness, and significantly improves the ability to retain image details.

[0119] In some embodiments, combined with Figure 8 As shown, the steps described above for performing tone mapping on each pixel based on tone mapping information to obtain the target image specifically include: for any pixel in the image to be processed, determining the target brightness value of that pixel based on its original brightness value and tone mapping information; replacing the original brightness value of each pixel in the image to be processed with the target brightness value of that pixel to obtain the target image. Figure 8As can be seen, the tone mapping method provided in this embodiment uses the backlight zoning capability as the boundary condition to perform differentiated mapping corrections for three scenarios: normal range, over-limit highlights, and under-limit shadows, so that the image mapping effect takes into account both the algorithm intent and hardware feasibility.

[0120] In some embodiments, refer to Figure 9 The diagram shown is a flowchart of another embodiment of the tone mapping method in this application. This tone mapping method is applied to a source device and includes the following steps S401 to S402, as detailed below: S401. Determine the spatial dynamic metadata based on the image information to be processed.

[0121] In this embodiment, the source device refers to the image source device of the image to be processed. The source device includes one or more of a player, set-top box, and front-end signal transmission device. Spatial dynamic metadata is a tone mapping control parameter data packet carrying spatial partitioning information and capable of real-time frame-by-frame updates. It is segmented, statistically encoded, and then sent to the display terminal by the source device to achieve differentiated tone mapping adjustment for each partition. This embodiment determines the spatial dynamic metadata by the source device and then sends it to the display device. This allows the complex parameter calculation process to be moved forward to the source device, significantly reducing the real-time computational load and overhead of the display device, and improving the processing speed and real-time rendering efficiency of the terminal's tone mapping.

[0122] In some embodiments, the step of determining spatial dynamic metadata based on the image information to be processed specifically includes: performing region segmentation on the image to be processed to obtain multiple region images; performing tone mapping parameter statistics on the multiple region images to obtain tone mapping parameter maps; and encoding the tone mapping parameter maps to obtain spatial dynamic metadata.

[0123] Optionally, the image to be processed can be segmented into regions according to a fixed grid of preset size, wherein the division size of the fixed grid is a preset value, for example, the division size of the fixed grid includes any one of 4×4 partitions, 8×8 partitions, and 16×16 partitions. In some embodiments, the tone mapping parameter map includes at least one of the following: a seventh brightness threshold for each region image, an eighth brightness threshold for each region image, a transition interval parameter for each region image, a black level enhancement parameter for each region image, a white level gain parameter for each region image, a gamma mode parameter for each region image, a tone protection factor for each region image, and a saturation enhancement amount for each region image. For example, refer to... Figure 4As shown, the tone mapping parameter map includes at least one of the following: a seventh luminance threshold TM_MaxL for each region image, an eighth luminance threshold TM_MinL for each region image, a transition interval parameter TM_transition for each region image, a black level boost parameter TM_BlackLift for each region image, a white level gain parameter TM_WhiteGain for each region image, and a gamma mode parameter TM_GammaMode for each region image.

[0124] In some embodiments, the step of performing tone mapping parameter statistics on multiple regional images to obtain a tone mapping parameter map specifically includes: for any regional image among the multiple regional images, determining the maximum value of all pixel brightness values ​​of the regional image as the seventh brightness threshold of the regional image; and / or, determining the minimum value of all pixel brightness values ​​of the regional image as the eighth brightness threshold of the regional image; and / or, obtaining a first interval of the regional image based on the seventh brightness threshold and the eighth brightness threshold of the regional image; calculating the slope of the transition curve within the first interval based on the brightness histogram of the regional image; determining the slope of the transition curve as the transition interval parameter; and / or, counting the proportion of pixels with brightness less than the fifth threshold in the regional image, and obtaining the black level enhancement parameter of the regional image based on the proportion of pixels with brightness less than the fifth threshold in the regional image; and / or, counting the proportion of pixels with brightness greater than the sixth threshold in the regional image, and obtaining the white level gain parameter of the regional image based on the proportion of pixels with brightness greater than the sixth threshold in the regional image; and / or, obtaining the gamma mode parameter of the regional image based on the mean brightness value and the standard deviation of the regional image. For example, continue to refer to Figure 4 As shown, after the HDR original frame with 8×8 grid partitions is statistically analyzed, the following parameters can be obtained: the seventh brightness threshold TM_MaxL, the eighth brightness threshold TM_MinL, the transition interval parameter TM_transition, the black level boost parameter TM_BlackLift, the white level gain parameter TM_WhiteGain, and the gamma mode parameter TM_GammaMode corresponding to the Highlight partition, Dark partition, and Mid-tone partition, respectively.

[0125] Optionally, the first region can be represented as , This indicates the seventh brightness threshold. The eighth brightness threshold is used to indicate that, in some embodiments, the step of obtaining the first interval of the regional image based on the seventh brightness threshold and the eighth brightness threshold of the regional image specifically includes: using the eighth brightness threshold of the regional image as the lower limit of the first interval of the regional image and using the seventh brightness threshold of the regional image as the upper limit of the first interval of the regional image to obtain the first interval of the regional image.

[0126] In some embodiments, the step of obtaining the gamma mode parameter of the regional image based on the average brightness value and the standard deviation of the regional image specifically includes: determining the gamma mode parameter of the regional image as a first value when the average brightness value of the regional image is greater than a seventh threshold and the standard deviation of the regional image is less than an eighth threshold; determining the gamma mode parameter of the regional image as a second value when the average brightness value of the regional image is less than a ninth threshold and the standard deviation of the regional image is less than a tenth threshold; and determining the gamma mode parameter of the regional image as a fifth value when the average brightness value of the regional image is greater than the seventh threshold and the standard deviation of the regional image is greater than or equal to the eighth threshold, or when the average brightness value of the regional image is less than the ninth threshold and the standard deviation of the regional image is greater than or equal to the tenth threshold, or when the average brightness value of the regional image is greater than or equal to the ninth threshold and less than or equal to the seventh threshold. Among them, the seventh threshold is greater than the ninth threshold, the eighth threshold is greater than the tenth threshold, and the seventh, eighth, ninth and tenth thresholds can be set according to actual needs. For example, the seventh threshold is 500, the eighth threshold is 200, the ninth threshold is 200 and the tenth threshold is 100. When the mean is greater than 500 and the standard deviation is less than 200, the gamma mode parameter is determined to be 1; when the mean is less than 200 and the standard deviation is less than 100, the gamma mode parameter is determined to be 2; and in other cases, the gamma mode parameter is determined to be 0.

[0127] In some embodiments, the tone mapping parameter map includes a tone protection factor for each region image. The step of performing tone mapping parameter statistics on multiple region images to obtain the tone mapping parameter map specifically includes: for any region image of the multiple region images, performing color space conversion on the region image to obtain a converted region image; calculating the proportion of pixels with saturation greater than the eleventh threshold in the converted region image; performing histogram statistics on the chromaticity values ​​of the converted region image to calculate the proportion of pixels within a preset peak range (e.g., ±15°) to the proportion of pixels with saturation greater than the eleventh threshold; and obtaining the tone protection factor of the region image based on the proportion of pixels with saturation greater than the eleventh threshold and the proportion of pixels within the preset peak range to the proportion of pixels with saturation greater than the eleventh threshold.

[0128] In some embodiments, the process of determining the hue protection factor can be expressed as: ,in, Indicates the hue protection factor. This indicates the percentage of pixels with a saturation level greater than the eleventh threshold. This represents the proportion of pixels within a preset peak range to the total number of pixels with saturation greater than the eleventh threshold. For example, if 40% of the pixels in a region of the image are highly saturated (S>0.6), and these pixels are concentrated in the red hue range (concentration=0.8), then... .

[0129] In some embodiments, the tone mapping parameter map includes the saturation enhancement amount of each region image. The step of performing tone mapping parameter statistics on multiple region images to obtain the tone mapping parameter map specifically includes: for any region image of the multiple region images, calculating the average saturation of the region image and the standard deviation of the saturation of the region image; and obtaining the saturation enhancement amount of the region image based on the average saturation of the region image and the standard deviation of the saturation of the region image.

[0130] In some embodiments, the step of obtaining the saturation enhancement amount of the image in a region based on the average saturation and the standard deviation of saturation of the image in that region specifically includes: when the average saturation of the image in that region is less than a twelfth threshold and the standard deviation of saturation of the image in that region is less than a thirteenth threshold, determining the saturation enhancement amount of the image in that region as a sixth value; when the average saturation of the image in that region is greater than a fourteenth threshold, determining the saturation enhancement amount of the image in that region as a seventh value; when the average saturation of the image in that region is less than a twelfth threshold and the standard deviation of saturation of the image in that region is greater than or equal to a thirteenth threshold, or when the average saturation of the image in that region is greater than or equal to a twelfth threshold and less than or equal to a fourteenth threshold, determining the saturation enhancement amount of the image in that region as an eighth value. Wherein, the twelfth threshold is less than the fourteenth threshold, the sixth value > the eighth value > the seventh value, and the twelfth, thirteenth, and fourteenth thresholds can be set according to actual needs, for example, the twelfth threshold is 0.3, the thirteenth threshold is 0.1, and the fourteenth threshold is 0.5. and ,Sure ;like ,Sure ;like and ,or, ,Sure ,in, This indicates the average saturation of the image in that region. This represents the standard deviation of saturation in the image of that region. This indicates the amount of saturation enhancement in the image of that region.

[0131] In this embodiment of the application, the step of encoding the tone mapping parameter map refers to the process of performing data normalization, compression, and format encapsulation on the two-dimensional tone mapping parameter map, converting the structured grid parameter array into a binary bitstream that conforms to the transmission protocol specification. For example, if the image to be processed is divided into regions to obtain 64 region images, each region image includes six tone mapping parameters: a seventh brightness threshold, an eighth brightness threshold, a transition interval parameter, a black level boost parameter, a white level gain parameter, and a gamma mode parameter. The seventh brightness threshold, the eighth brightness threshold, the transition interval parameter, the black level boost parameter, the white level gain parameter, and the gamma mode parameter occupy 10 bits, 8 bits, 6 bits, 6 bits, 6 bits, and 2 bits respectively when encoded. Then, the parameters of the 64 regions are encoded into spatial dynamic metadata, and the total bit width of the obtained spatial dynamic metadata is: 64 regions × (10 + 8 + 6 + 6 + 6 + 2) = 64 × 38 = 2432 bits.

[0132] S402. Send the spatial dynamic metadata to the display device so that the display device can determine the creative intent parameter map corresponding to the image to be processed based on the spatial dynamic metadata, and perform tone mapping on each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map.

[0133] In this embodiment, after the source device determines the spatial dynamic metadata based on the image information to be processed, it can send the spatial dynamic metadata to the display device through a signal transmission channel (e.g., an HDR signal transmission channel). This allows the display device to determine the creative intent parameter map corresponding to the image to be processed based on the spatial dynamic metadata, and to perform tone mapping on each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map. The specific process of the display device determining the creative intent parameter map corresponding to the image to be processed based on the spatial dynamic metadata, and performing tone mapping on each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map, has been discussed in steps S201-S203 above. Please refer to steps S201-S203 for details; they will not be repeated here.

[0134] To better illustrate the technical effects of the tone mapping method provided in the embodiments of this application, the inventors have provided specific examples.

[0135] Example 1 This embodiment is aimed at mainstream consumer-grade 4K Mini-LED TVs. Typical configurations are shown in Table 1, with a display resolution of 3840×2160, 576 local dimming zones (arranged in 24×24), and the source device adopts an 8×8 fixed grid division.

[0136] Table 1 Specific configuration parameters for Example 1

[0137] The specific steps of Example 1 include: S1. The source end divides the 3840×2160 HDR image into 64 8×8 zones, each zone being 480×270 pixels. Six tone mapping parameters are calculated for each zone: ① Seventh brightness threshold TM_MaxL: the P99 quantile of the zone's brightness value; ② Eighth brightness threshold TM_MinL: the minimum brightness value of all pixels in the zone; ③ Transition parameter TM_Transition: the slope of the transition curve within the interval [TM_MinL, TM_MaxL] based on the zone's brightness histogram; ④ Black level boost parameter TM_BlackLift: calculating the black level boost based on the percentage of pixels with brightness below 50 nits; ⑤ White level gain parameter TM_WhiteGain: the percentage of pixels with brightness above 1000 nits. The pixel ratio of nit is used to calculate the white level gain; ⑥ Gamma mode parameter TM_GammaMode: determined based on the relationship between the mean and standard deviation of the brightness of each zone (mean > 500 and standard deviation < 200 indicates highlight-dominated content, mean < 200 and standard deviation < 100 indicates dark-dominated content, and the rest are standard mode); S2. Encode the parameters of the 64 partitions into spatial dynamic metadata. The encoding format adopts fixed-length encoding, and the total bit width is: 64 partitions × (10 + 8 + 6 + 6 + 6 + 2) = 64 × 38 = 2432 bits; S3. This metadata can be transmitted to the display device via the VSDB (Vendor-Specific Data Block) of HDMI 2.1 or the Metadata channel of DisplayPort; S4. After the display device decodes the 8×8 fixed grid parameter map (i.e. tone mapping parameter map), it uses the Gaussian kernel blur diffusion algorithm to diffuse it to a display resolution of 3840×2160. S5. The display device obtains the backlight drive signals for the 576 local dimming zones of the current frame. For each local dimming zone, the formula is used. Determine the first brightness capability value and use the following formula: Determine the second brightness capability value; obtain a 24×24 candidate capability parameter map based on the first and second brightness capability values; perform fuzz diffusion on the 24×24 candidate capability parameter map to obtain the target hardware capability parameter map; S6. Using steps S301 to S303, obtain the tone mapping information for each pixel; S7. Perform tone mapping on each pixel based on tone mapping information to obtain the target image.

[0138] The inventors discovered through research that Example 1, using an 8×8 fixed grid and a dual-image diffusion mechanism, achieves refined tone mapping control for 576 local dimming (LD) zones. Because the diffusion radius (approximately 120 pixels) is similar to the size of the local dimming zone (160×90 pixels), the parameter transitions between adjacent pixels are smooth and natural, eliminating zone boundary artifacts. Compared to directly using the independent parameters of the 576 zones, the data transmission volume is reduced to approximately 1 / 9 (64 vs 576), significantly reducing metadata bandwidth requirements.

[0139] Example 2 This embodiment is designed for high-end professional-grade Mini-LED displays or high-end TVs. Typical configurations are shown in Table 2, with a display resolution of 7680×4320 (8K), 7920 local dimming zones (arranged in 88×90), and a 16×16 fixed grid at the source end to obtain more refined content perception capabilities.

[0140] Table 2 Specific configuration parameters for Example 2

[0141] The specific steps of Example 2 include: S1. Divide the 8K image into 256 16×16 zones. For each zone, calculate 8 tone mapping parameters: ① Seventh brightness threshold TM_MaxL: the P99.5 quantile of the zone's brightness value; ② Eighth brightness threshold TM_MinL: the minimum brightness value of all pixels in the zone; ③ Transition parameter TM_Transition: calculate the slope of the transition curve within the interval [TM_MinL, TM_MaxL] based on the zone's brightness histogram; ④ Black level boost parameter TM_BlackLift: calculate the black level boost based on the percentage of pixels with brightness below 50 nits; ⑤ White level gain parameter TM_WhiteGain: calculate the white level gain based on the percentage of pixels with brightness above 1000 nits. The pixel ratio of nit is used to calculate the white level gain; ⑥ Gamma mode parameter TM_GammaMode: determined based on the relationship between the mean and standard deviation of the brightness of each zone (mean > 500 and standard deviation < 200 indicates highlight-dominated content, mean < 200 and standard deviation < 100 indicates shadow-dominated content, and the rest are standard mode); ⑦ Hue Preservation factor TM_HuePreservation; ⑧ Saturation Boost amount TM_SaturationBoost; S2. The parameters of the 256 partitions are encoded into a spatial dynamic metadata encoding format using a fixed-length encoding. The total bit width is: 256 partitions × 8 parameters × (8-10 bits) = approximately 80-100Kbps of metadata bandwidth. S3. This metadata can be transmitted to the display device via the VSDB (Vendor-Specific Data Block) of HDMI 2.1 or the Metadata channel of DisplayPort; S4. After the display device decodes the 16×16 fixed grid parameter map (i.e. tone mapping parameter map), it uses a bilateral filtering diffusion algorithm to diffuse it to a display resolution of 7680×4320. S5. The display device acquires the backlight drive signals of 7920 local dimming zones in the current frame, and obtains the first brightness capability value of each local dimming zone based on the fifth brightness capability value and the temperature compensation coefficient of each local dimming zone; the sixth brightness capability value and the halo brightness increment of each local dimming zone are added together to obtain the second brightness capability value of each local dimming zone; the target hardware capability parameter map is determined based on the first brightness capability value and the second brightness capability value. S6. Based on the first brightness threshold and the seventh brightness capability value of the pixel, obtain the first brightness ratio; based on the first brightness ratio, obtain the third brightness threshold of the pixel; based on the third brightness threshold, determine the tone mapping information of the pixel. S7. Perform tone mapping on each pixel based on tone mapping information to obtain the target image; S8. Based on the saturation coefficient, adjust the chromaticity of the pixels that match the target pixel in the target image.

[0142] The inventors discovered that Example 2 achieves accurate pixel-by-pixel tone mapping at 8K resolution through the collaborative processing of a 16×16 fine grid and 7920 partitions. The bilateral filtering diffusion protects the highlight / dark field boundaries while smoothing parameters, preserving the creator's intention for the image structure. The hierarchical compression strategy fully utilizes hardware capabilities while maintaining the overall artistic expression of the image through perceptual consistency constraints. The tone protection factor ensures the color integrity of highly saturated color areas.

[0143] Example 3 This embodiment is aimed at entry-level or cost-sensitive Mini-LED TVs / monitors. Typical configurations are shown in Table 3, with a display resolution of 1920×1080 and only 60 local dimming zones (arranged in 6×10). The source end uses a 4×4 fixed grid to match the limited number of zones.

[0144] Table 3 Specific configuration parameters for Example 3

[0145] The specific steps of Example 3 include: S1. Divide the 1080P image into 16 4×4 zones. For the entry-level scene, a simplified parameter set is used, with only 4 core parameters counted: ① Seventh brightness threshold TM_MaxL: The P95 quantile of the zone's brightness value; ② Eighth brightness threshold TM_MinL: The minimum brightness value of all pixels in the zone; ③ Gamma mode parameter TM_GammaMode: Content type identifier (2 bits, 0=Standard / 1=Cinema / 2=Game / 3=Natural); ④ Transition parameter TM_Transition: Transition interval identifier (2 bits, 0=Smooth / 1=Standard / 2=Sharp / 3=Preserve). S2. Encode the parameters of the 16 partitions into a spatial dynamic metadata encoding format using a fixed-length encoding. The total bit width is: 16×(8+8+2+2) =16×20 = 320 bits. S3. This metadata can be transmitted to the display device via the VSDB (Vendor-Specific Data Block) of HDMI 2.1 or the Metadata channel of DisplayPort; S4. After the display device decodes the 4×4 fixed grid parameter map (i.e. tone mapping parameter map), it uses a bilateral filtering diffusion algorithm to diffuse it to a display resolution of 1920×1080. S5. The display device determines the first brightness capability value of each local dimming zone according to the drive signal level; the panel black state brightness and the halo compensation amount of each local dimming zone are added together to obtain the second brightness capability value of each local dimming zone; the target hardware capability parameter diagram is determined according to the first brightness capability value and the second brightness capability value. S6. Determine the tone mapping information of the pixel based on the fifth brightness threshold, the sixth brightness threshold, the gamma value, and the transition smoothing coefficient. S7. Perform tone mapping on each pixel based on tone mapping information to obtain the target image.

[0146] The inventors discovered that, through a simplified parameter design and calculation process, basic HDR tone mapping effects were achieved on entry-level 60-zone hardware. Although there are compromises in accuracy and detail compared to high-end scenes, the dual-image diffusion fusion mechanism still achieves the following improvements: compared to traditional 60-zone independent tone mapping, it eliminates obvious zone boundary visibility; compared to a single parameter across the entire screen without zone tone mapping, it preserves the brightness differences between different areas of the image; and the metadata bandwidth is only 320 bits, making it compatible with all existing HDR transmission standards.

[0147] To better implement the tone mapping method in the embodiments of this application, a tone mapping device is also provided in the embodiments of this application, which is applied to a display device, such as... Figure 10 As shown, the tone mapping device 600 includes: Information acquisition module 610 is used to acquire the creative intent parameter map and target hardware capability parameter map corresponding to the image to be processed; The information determination module 620 is used to determine the tone mapping information of each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map. The tone mapping module 630 is used to perform tone mapping on each pixel based on tone mapping information to obtain the target image.

[0148] In this embodiment, the tone mapping information of each pixel in the image to be processed is determined based on the creative intent parameter map and the target hardware capability parameter map. This ensures that the tone mapping information matches the real-time backlight emission capability of the current screen partition, preventing the mapped output brightness from exceeding the reproducible range of the panel hardware and making the mapping result hardware-adaptable. By performing tone mapping on each pixel based on the tone mapping information, the brightness of highlight pixels can be suppressed to avoid overexposure, and the brightness of dark pixels can be enhanced to restore details and prevent underexposure. This effectively solves the inherent defects of global tone mapping in adapting to regional brightness differences and local imbalance of light and dark, and significantly improves the ability to retain image details.

[0149] In some embodiments of this application, the creative intent parameter map is obtained by the information acquisition module 610 based on the following steps: Receive spatial dynamic metadata sent by the source device; Decode the spatial dynamic metadata to obtain the tone mapping parameter map; The tone mapping parameter map is blurred and diffused according to the resolution of the image to be processed to obtain the creative intent parameter map.

[0150] In some embodiments of this application, the creative intent parameter map is obtained by the information acquisition module 610 based on the following steps: The image to be processed is segmented into regions to obtain multiple region images; Tone mapping parameter statistics were performed on multiple regions of the image to obtain a tone mapping parameter map. The tone mapping parameter map is blurred and diffused according to the resolution of the image to be processed to obtain the creative intent parameter map.

[0151] In some embodiments of this application, the target hardware capability parameter map is obtained by the information acquisition module 610 based on the following steps: Obtain the backlight drive signal values ​​of multiple local dimming zones of the image to be processed; Based on the backlight drive signal value and the panel's black state brightness, a candidate hardware capability parameter diagram is obtained; The candidate hardware capability parameter map is blurred and diffused according to the resolution of the image to be processed to obtain the target hardware capability parameter map.

[0152] In some embodiments of this application, the information acquisition module 610 obtains a candidate hardware capability parameter map based on the backlight drive signal value and the panel's black state brightness, including: Based on the backlight drive signal value, determine the first brightness capability value of each local dimming zone; Based on the panel's black state brightness, determine the second brightness capability value for each local dimming zone; Based on the first brightness capability value and the second brightness capability value, a candidate hardware capability parameter diagram is obtained.

[0153] In some embodiments of this application, the information acquisition module 610 determines a first brightness capability value for each local dimming zone based on the backlight drive signal value, including: The third brightness capability value of each local dimming zone is determined based on the zone's basic brightness value, the backlight drive signal value of each local dimming zone, and the brightness scaling factor of each local dimming zone. Based on the third brightness capability value, determine the first brightness capability value for each local dimming zone.

[0154] In some embodiments of this application, the information acquisition module 610 determines the first brightness capability value of each local dimming zone based on the third brightness capability value, including: The fourth brightness capability value for each local dimming zone is obtained based on the third brightness capability value and the halo brightness increment of each local dimming zone. The fifth brightness capability value for each local dimming zone is obtained based on the fourth brightness capability value and the correction coefficient for each local dimming zone. The first brightness capability value of each local dimming zone is obtained based on the fifth brightness capability value and the temperature compensation coefficient of each local dimming zone.

[0155] In some embodiments of this application, the information acquisition module 610 determines a first brightness capability value for each local dimming zone based on the backlight drive signal value, including: Based on the backlight drive signal value, determine the drive signal level for each local dimming zone; Based on the drive signal level, determine the first brightness capability value for each local dimming zone.

[0156] In some embodiments of this application, the information acquisition module 610 determines the second brightness capability value of each local dimming zone based on the panel's black state brightness, including: Multiply the panel's black state brightness by the correction coefficient for each local dimming zone to obtain the sixth brightness capability value for each local dimming zone; add the sixth brightness capability value to the halo brightness increment of each local dimming zone to obtain the second brightness capability value for each local dimming zone; or, The panel's black state brightness and the halo compensation amount for each local dimming zone are added together to obtain the second brightness capability value for each local dimming zone.

[0157] In some embodiments of this application, the creative intent parameter map includes a first brightness threshold and a second brightness threshold for each pixel, and the target hardware capability parameter map includes a seventh brightness capability value and an eighth brightness capability value for each pixel. The information determination module 620 determines the tone mapping information of each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map, including: For any pixel in the image to be processed, the third brightness threshold of the pixel is obtained based on the first brightness threshold and the seventh brightness capability value of the pixel. The fourth brightness threshold of the pixel is obtained based on the second brightness threshold and the eighth brightness capability value of the pixel. The tone mapping information of the pixel is determined based on the third brightness threshold and the fourth brightness threshold of the pixel.

[0158] In some embodiments of this application, the information determination module 620 obtains a third brightness threshold for the pixel based on a first brightness threshold and a seventh brightness capability value of the pixel, including: When the first brightness threshold of a pixel is less than or equal to the seventh brightness capability value of the pixel, the first brightness threshold of the pixel is determined as the third brightness threshold of the pixel. When the first brightness threshold of a pixel is greater than the seventh brightness capability value of the pixel, the partition brightness state of the partition to which the pixel belongs is obtained; the first compression ratio of the pixel is determined based on the partition brightness state; the first brightness threshold and the seventh brightness capability value of the pixel are weighted and summed based on the first compression ratio to obtain the third brightness threshold of the pixel.

[0159] In some embodiments of this application, the information determination module 620 obtains a fourth brightness threshold for the pixel based on the second brightness threshold and the eighth brightness capability value of the pixel, including: When the second brightness threshold of a pixel is greater than or equal to the eighth brightness capability value of the pixel, the second brightness threshold of the pixel is determined as the fourth brightness threshold of the pixel. When the second brightness threshold of a pixel is less than the eighth brightness capability value of the pixel, the eighth brightness capability value of the pixel is determined as the fourth brightness threshold of the pixel.

[0160] In some embodiments of this application, the information determination module 620 obtains a third brightness threshold for the pixel based on a first brightness threshold and a seventh brightness capability value of the pixel, including: The first brightness ratio is obtained based on the first brightness threshold of the pixel and the seventh brightness capability value of the pixel; When the first brightness ratio is greater than or equal to the first threshold, the first brightness threshold of the pixel is determined as the third brightness threshold of the pixel. When the first brightness ratio is greater than or equal to the second threshold and less than the first threshold, the third brightness threshold of the pixel is determined based on the first brightness threshold and the first compression coefficient of the pixel; the second threshold is less than the first threshold. When the first brightness ratio is greater than or equal to the third threshold and less than the second threshold, the third brightness threshold of the pixel is determined based on the first brightness threshold and the second compression coefficient of the pixel; the second compression coefficient is less than the first compression coefficient, and the third threshold is less than the second threshold. When the first brightness ratio is less than the third threshold, the first brightness ratio of the pixels in the image to be processed is averaged to obtain the second brightness ratio; the third compression coefficient is determined based on the second brightness ratio; the first brightness threshold of the pixel and the seventh brightness capability value of the pixel are weighted and summed based on the third compression coefficient to obtain the third brightness threshold of the pixel.

[0161] In some embodiments of this application, the creative intent parameter map includes a first brightness threshold, a second brightness threshold, a gamma mode parameter, and a transition interval parameter for each pixel; the target hardware capability parameter map includes a seventh brightness capability value for each pixel; and the information determination module 620 determines the tone mapping information of each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map, including: For any pixel in the image information to be processed, the fifth brightness threshold of the pixel is obtained based on the first brightness threshold and the seventh brightness capability value of the pixel. The sixth brightness threshold of the pixel is obtained based on the second brightness threshold and the first scaling factor. The gamma value of the pixel is obtained based on the gamma mode parameters of the pixel. Based on the transition interval parameters of the pixel, the transition smoothness coefficient of the pixel is obtained; The tone mapping information of the pixel is determined based on the fifth brightness threshold, the sixth brightness threshold, the gamma value, and the transition smoothing coefficient.

[0162] In some embodiments of this application, the information determination module 620 obtains a fifth brightness threshold for the pixel based on a first brightness threshold and a seventh brightness capability value of the pixel, including: When the first brightness threshold of a pixel is greater than the seventh brightness capability value of the pixel, a second scaling factor is obtained based on the first brightness threshold and the seventh brightness capability value of the pixel; and a fifth brightness threshold of the pixel is obtained based on the second scaling factor and the first brightness threshold of the pixel. When the first brightness threshold of a pixel is less than or equal to the seventh brightness capability value of the pixel, the first brightness threshold and the third scaling factor of the pixel are multiplied to obtain the fifth brightness threshold of the pixel.

[0163] In some embodiments of this application, the information determination module 620 obtains the gamma value of the pixel based on the gamma mode parameters of the pixel, including: When the gamma mode parameter of a pixel is the first value, the gamma value of that pixel is determined to be the first parameter value. When the gamma mode parameter of a pixel is the second value, the gamma value of that pixel is determined to be the second parameter value. When the gamma mode parameter of a pixel is not the first value or the second value, the gamma value of the pixel is determined to be the third parameter value; wherein, the first parameter value > the third parameter value > the second parameter value.

[0164] In some embodiments of this application, the information determination module 620 obtains the transition smoothness coefficient of the pixel based on the transition interval parameter of the pixel, including: When the transition interval parameter of the pixel is the third value, the transition smoothness coefficient of the pixel is determined to be the fourth parameter value; When the transition interval parameter of the pixel is the fourth value, the transition smoothness coefficient of the pixel is determined to be the fifth parameter value; When the transition interval parameter of a pixel is not the third or fourth value, the transition smoothness coefficient of the pixel is determined to be the sixth parameter value; where the fourth parameter value > the sixth parameter value > the fifth parameter value.

[0165] In some embodiments of this application, the creative intent parameter map includes a tone protection factor for each pixel. The tone mapping module 630 performs tone mapping on each pixel in the image to be processed based on the tone mapping information. After obtaining the target image, the tone mapping module 630 is further used for: For any pixel in the image to be processed, when the hue protection factor of the pixel is greater than the fourth threshold, the saturation coefficient of the pixel is determined according to the first brightness ratio. Based on the saturation coefficient, the color of the pixels in the target image that match the pixel is adjusted.

[0166] To better implement the tone mapping method in the embodiments of this application, a tone mapping device is also provided in the embodiments of this application, which is applied to the source device, such as... Figure 11 As shown, the tone mapping device 700 includes: The data determination module 710 is used to determine spatial dynamic metadata based on the image information to be processed; The data sending module 720 is used to send spatial dynamic metadata to the display device, so that the display device can determine the creative intent parameter map corresponding to the image to be processed based on the spatial dynamic metadata, and perform tone mapping on each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map.

[0167] In this embodiment, spatial dynamic metadata is determined by the source device and then sent to the display device. This allows the complex parameter calculation process to be moved forward to the source device, significantly reducing the real-time computational load and overhead of the display device, and improving the processing speed and real-time rendering efficiency of the terminal tone mapping. By determining the creative intent parameter map corresponding to the image to be processed based on the spatial dynamic metadata, and performing tone mapping on each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map, the inherent defects of global tone mapping in adapting to regional brightness differences and local imbalance of light and dark can be effectively solved, making the mapping result hardware adaptable and significantly improving the ability to preserve image details.

[0168] In some embodiments of this application, the data determination module 710 is specifically used for: The image to be processed is segmented into regions to obtain multiple region images; Tone mapping parameter statistics are performed on the multiple region images respectively to obtain a tone mapping parameter map; The tone mapping parameter map is encoded to obtain spatial dynamic metadata.

[0169] In some embodiments of this application, the image to be processed is segmented into regions according to a fixed grid of preset size, wherein the segmentation size of the fixed grid includes any one of 4×4 partitions, 8×8 partitions, and 16×16 partitions.

[0170] In some embodiments of this application, the tone mapping parameter map includes at least one of the following: a seventh luminance threshold for each region image, an eighth luminance threshold for each region image, a transition interval parameter for each region image, a black level boost parameter for each region image, a white level gain parameter for each region image, and a gamma mode parameter for each region image.

[0171] This application embodiment also provides a display device that integrates the tone mapping device provided in this application embodiment. The display device includes: One or more processors; Memory; and One or more applications, wherein the applications are stored in memory and configured to be executed by a processor from the steps of the tone mapping method in any of the embodiments described above.

[0172] This application embodiment also provides a source-end device that integrates the tone mapping apparatus provided in this application embodiment. The source-end device includes: One or more processors; Memory; and One or more applications, wherein the applications are stored in memory and configured to be executed by a processor from the steps of the tone mapping method in any of the embodiments described above.

[0173] This application also provides a display device that integrates the tone mapping device provided in this application. For example... Figure 12 As shown, it illustrates a schematic diagram of the display device involved in the embodiments of this application. Specifically: The display device may include components such as a processor 801 with one or more processing cores, a memory 802 with one or more computer-readable storage media, a power supply 803, and an input unit 804. Those skilled in the art will understand that... Figure 12 The display device structure shown does not constitute a limitation on the display device and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein: The processor 801 is the control center of the display device. It connects various parts of the display device via various interfaces and lines. By running or executing software programs and / or modules stored in the memory 802, and by calling data stored in the memory 802, it performs various functions and processes data of the display device, thereby providing overall monitoring of the display device. Optionally, the processor 801 may include one or more processing cores; preferably, the processor 801 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 801.

[0174] The memory 802 can be used to store software programs and modules. The processor 801 executes various functional applications and data processing by running the software programs and modules stored in the memory 802. The memory 802 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the display device, etc. In addition, the memory 802 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 802 may also include a memory controller to provide the processor 801 with access to the memory 802.

[0175] The display device also includes a power supply 803 that supplies power to the various components. Preferably, the power supply 803 can be logically connected to the processor 801 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 803 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0176] The display device may also include an input unit 804, which can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

[0177] Although not shown, the display device may also include display units, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 801 in the display device loads the executable files corresponding to the processes of one or more application programs into the memory 802 according to the following instructions, and the processor 801 runs the application programs stored in the memory 802 to realize various functions, as follows: Obtain the creative intent parameter map and the target hardware capability parameter map corresponding to the image to be processed; Based on the creative intent parameter map and the target hardware capability parameter map, the tone mapping information of each pixel in the image to be processed is determined. The target image is obtained by performing tone mapping on each pixel based on tone mapping information.

[0178] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0179] Therefore, embodiments of this application provide a computer-readable storage medium, which may include: read-only memory (ROM), random access memory (RAM), a magnetic disk, or an optical disk, etc. A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps in any of the tone mapping methods provided in embodiments of this application. For example, the computer program loaded by the processor can execute the following steps: Obtain the creative intent parameter map and the target hardware capability parameter map corresponding to the image to be processed; Based on the creative intent parameter map and the target hardware capability parameter map, the tone mapping information of each pixel in the image to be processed is determined. The target image is obtained by performing tone mapping on each pixel based on tone mapping information.

[0180] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the detailed descriptions of other embodiments above, which will not be repeated here.

[0181] In practice, each of the above units or structures can be implemented as an independent entity or can be arbitrarily combined to be implemented as the same or several entities. For the specific implementation of each of the above units or structures, please refer to the previous method embodiments, which will not be repeated here.

[0182] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0183] The above provides a detailed description of a tone mapping method, apparatus, device, and computer-readable storage medium provided in the embodiments of this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A tone mapping method, characterized in that, Applied to display devices, including: Obtain the creative intent parameter map and the target hardware capability parameter map corresponding to the image to be processed; Based on the creative intent parameter map and the target hardware capability parameter map, determine the tone mapping information of each pixel in the image to be processed; Based on the tone mapping information, tone mapping is performed on each pixel to obtain the target image.

2. The tone mapping method according to claim 1, characterized in that, The creative intent parameter diagram is obtained through the following steps: Receive spatial dynamic metadata sent by the source device; The spatial dynamic metadata is decoded to obtain a tone mapping parameter map; The tone mapping parameter map is blurred and diffused according to the resolution of the image to be processed to obtain the creative intent parameter map.

3. The tone mapping method according to claim 1, characterized in that, The creative intent parameter diagram is obtained through the following steps: The image to be processed is segmented into regions to obtain multiple region images; Tone mapping parameter statistics are performed on the multiple region images respectively to obtain a tone mapping parameter map; The tone mapping parameter map is blurred and diffused according to the resolution of the image to be processed to obtain the creative intent parameter map.

4. The tone mapping method according to claim 1, characterized in that, The target hardware capability parameter map is obtained through the following steps: Obtain the backlight drive signal values ​​of multiple local dimming zones of the image to be processed; Based on the backlight drive signal value and the panel black state brightness, a candidate hardware capability parameter map is obtained; The candidate hardware capability parameter map is blurred and diffused according to the resolution of the image to be processed to obtain the target hardware capability parameter map.

5. The tone mapping method according to claim 4, characterized in that, The step of obtaining the candidate hardware capability parameter map based on the backlight drive signal value and the panel black state brightness includes: Based on the backlight drive signal value, determine the first brightness capability value of each local dimming zone; Based on the panel's black state brightness, determine the second brightness capability value for each local dimming zone; Based on the first brightness capability value and the second brightness capability value, a candidate hardware capability parameter map is obtained.

6. The tone mapping method according to claim 5, characterized in that, The step of determining the first brightness capability value of each local dimming zone based on the backlight drive signal value includes: The third brightness capability value of each local dimming zone is determined based on the zone's basic brightness value, the backlight drive signal value of each local dimming zone, and the brightness scaling factor of each local dimming zone. Based on the third brightness capability value, determine the first brightness capability value for each local dimming zone.

7. The tone mapping method according to claim 6, characterized in that, The step of determining the first brightness capability value of each local dimming zone based on the third brightness capability value includes: The fourth brightness capability value of each local dimming zone is obtained based on the third brightness capability value and the halo brightness increment of each local dimming zone. The fifth brightness capability value of each local dimming zone is obtained based on the fourth brightness capability value and the correction coefficient of each local dimming zone; The first brightness capability value of each local dimming zone is obtained based on the fifth brightness capability value and the temperature compensation coefficient of each local dimming zone.

8. The tone mapping method according to claim 5, characterized in that, The step of determining the first brightness capability value of each local dimming zone based on the backlight drive signal value includes: Based on the backlight drive signal value, determine the drive signal level for each local dimming zone; Based on the drive signal level, determine the first brightness capability value for each local dimming zone.

9. The tone mapping method according to claim 5, characterized in that, The step of determining the second brightness capability value of each local dimming zone based on the panel's black state brightness includes: Multiply the panel's black state brightness by the correction coefficient of each local dimming zone to obtain the sixth brightness capability value of each local dimming zone; add the sixth brightness capability value to the halo brightness increment of each local dimming zone to obtain the second brightness capability value of each local dimming zone; or, The panel's black state brightness and the halo compensation amount of each local dimming zone are added together to obtain the second brightness capability value of each local dimming zone.

10. The tone mapping method according to claim 1, characterized in that, The creative intent parameter map includes a first brightness threshold and a second brightness threshold for each pixel. The target hardware capability parameter map includes a seventh brightness capability value and an eighth brightness capability value for each pixel. Determining the tone mapping information of each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map includes: For any pixel in the image to be processed, the third brightness threshold of the pixel is obtained based on the first brightness threshold and the seventh brightness capability value of the pixel. The fourth brightness threshold of the pixel is obtained based on the second brightness threshold and the eighth brightness capability value of the pixel. The tone mapping information of the pixel is determined based on the third brightness threshold and the fourth brightness threshold of the pixel.

11. The tone mapping method according to claim 10, characterized in that, The step of obtaining the third brightness threshold of the pixel based on the first brightness threshold and the seventh brightness capability value of the pixel includes: When the first brightness threshold of a pixel is less than or equal to the seventh brightness capability value of the pixel, the first brightness threshold of the pixel is determined as the third brightness threshold of the pixel. When the first brightness threshold of a pixel is greater than the seventh brightness capability value of the pixel, the partition brightness state of the partition to which the pixel belongs is obtained; the first compression ratio of the pixel is determined based on the partition brightness state; the first brightness threshold and the seventh brightness capability value of the pixel are weighted and summed based on the first compression ratio to obtain the third brightness threshold of the pixel.

12. The tone mapping method according to claim 10, characterized in that, The step of obtaining the fourth brightness threshold of the pixel based on the second brightness threshold and the eighth brightness capability value of the pixel includes: When the second brightness threshold of a pixel is greater than or equal to the eighth brightness capability value of the pixel, the second brightness threshold of the pixel is determined as the fourth brightness threshold of the pixel. When the second brightness threshold of a pixel is less than the eighth brightness capability value of the pixel, the eighth brightness capability value of the pixel is determined as the fourth brightness threshold of the pixel.

13. The tone mapping method according to claim 10, characterized in that, The step of obtaining the third brightness threshold of the pixel based on the first brightness threshold and the seventh brightness capability value of the pixel includes: The first brightness ratio is obtained based on the first brightness threshold of the pixel and the seventh brightness capability value of the pixel; When the first brightness ratio is greater than or equal to the first threshold, the first brightness threshold of the pixel is determined as the third brightness threshold of the pixel. When the first brightness ratio is greater than or equal to the second threshold and less than the first threshold, the third brightness threshold of the pixel is determined based on the first brightness threshold and the first compression coefficient of the pixel; the second threshold is less than the first threshold. When the first brightness ratio is greater than or equal to the third threshold and less than the second threshold, the third brightness threshold of the pixel is determined according to the first brightness threshold and the second compression coefficient of the pixel; the second compression coefficient is less than the first compression coefficient, and the third threshold is less than the second threshold; When the first brightness ratio is less than the third threshold, the first brightness ratio of the pixels in the image to be processed is averaged to obtain the second brightness ratio; a third compression coefficient is determined based on the second brightness ratio; and the first brightness threshold and the seventh brightness capability value of the pixel are weighted and summed based on the third compression coefficient to obtain the third brightness threshold of the pixel.

14. The tone mapping method according to claim 1, characterized in that, The creative intent parameter map includes a first brightness threshold, a second brightness threshold, a gamma mode parameter, and a transition interval parameter for each pixel. The target hardware capability parameter map includes a seventh brightness capability value for each pixel. Determining the tone mapping information for each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map includes: For any pixel in the image information to be processed, the fifth brightness threshold of the pixel is obtained based on the first brightness threshold and the seventh brightness capability value of the pixel. The sixth brightness threshold of the pixel is obtained based on the second brightness threshold and the first scaling factor. The gamma value of the pixel is obtained based on the gamma mode parameters of the pixel. Based on the transition interval parameters of the pixel, the transition smoothness coefficient of the pixel is obtained; The tone mapping information of the pixel is determined based on the fifth brightness threshold, the sixth brightness threshold, the gamma value, and the transition smoothing coefficient.

15. The tone mapping method according to claim 14, characterized in that, The step of obtaining the fifth brightness threshold of a pixel based on the first brightness threshold and the seventh brightness capability value of the pixel includes: When the first brightness threshold of a pixel is greater than the seventh brightness capability value of the pixel, a second scaling factor is obtained based on the first brightness threshold and the seventh brightness capability value of the pixel; and a fifth brightness threshold of the pixel is obtained based on the second scaling factor and the first brightness threshold of the pixel. When the first brightness threshold of a pixel is less than or equal to the seventh brightness capability value of the pixel, the first brightness threshold and the third scaling factor of the pixel are multiplied to obtain the fifth brightness threshold of the pixel.

16. The tone mapping method according to claim 14, characterized in that, The step of obtaining the gamma value of the pixel based on the gamma mode parameters includes: When the gamma mode parameter of a pixel is the first value, the gamma value of that pixel is determined to be the first parameter value. When the gamma mode parameter of a pixel is the second value, the gamma value of that pixel is determined to be the second parameter value. When the gamma mode parameter of a pixel is not the first value or the second value, the gamma value of the pixel is determined to be the third parameter value; wherein, the first parameter value > the third parameter value > the second parameter value; The step of obtaining the transition smoothness coefficient of the pixel based on the transition interval parameters of the pixel includes: When the transition interval parameter of the pixel is the third value, the transition smoothness coefficient of the pixel is determined to be the fourth parameter value; When the transition interval parameter of the pixel is the fourth value, the transition smoothness coefficient of the pixel is determined to be the fifth parameter value; When the transition interval parameter of the pixel is not the third value or the fourth value, the transition smoothness coefficient of the pixel is determined to be the sixth parameter value; wherein the fourth parameter value > the sixth parameter value > the fifth parameter value.

17. The tone mapping method according to claim 13, characterized in that, The creative intent parameter map includes the tone protection factor for each pixel. After performing tone mapping on each pixel in the image to be processed based on the tone mapping information to obtain the target image, the process includes: For any pixel in the image to be processed, when the hue protection factor of the pixel is greater than the fourth threshold, the saturation coefficient of the pixel is determined according to the first brightness ratio. Based on the saturation coefficient, the chromaticity of the pixels in the target image that match the pixel is adjusted.

18. A tone mapping method, characterized in that, Applied to source-end devices, including: Based on the image information to be processed, determine the spatial dynamic metadata; The spatial dynamic metadata is sent to the display device so that the display device can determine the creative intent parameter map corresponding to the image to be processed based on the spatial dynamic metadata, and perform tone mapping on each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map.

19. The tone mapping method according to claim 18, characterized in that, The step of determining spatial dynamic metadata based on the image information to be processed includes: The image to be processed is segmented into regions to obtain multiple region images; Tone mapping parameter statistics are performed on the multiple region images respectively to obtain a tone mapping parameter map; The tone mapping parameter map is encoded to obtain spatial dynamic metadata.

20. The tone mapping method according to claim 19, characterized in that, The image to be processed is segmented into regions according to a fixed grid of preset size. The grid size includes any one of 4×4, 8×8, or 16×16 partitions.

21. The tone mapping method according to claim 19, characterized in that, The tone mapping parameter map includes at least one of the following: a seventh brightness threshold for each region image, an eighth brightness threshold for each region image, a transition interval parameter for each region image, a black level boost parameter for each region image, a white level gain parameter for each region image, and a gamma mode parameter for each region image.

22. A tone mapping device, characterized in that, Applied to display devices, including: The information acquisition module is used to acquire the creative intent parameter map and the target hardware capability parameter map corresponding to the image to be processed; The information determination module is used to determine the tone mapping information of each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map. The tone mapping module is used to perform tone mapping on each pixel based on the tone mapping information to obtain the target image.

23. A tone mapping device, characterized in that, Applied to source-end devices, including: The data determination module is used to determine spatial dynamic metadata based on the image information to be processed; The data sending module is used to send the spatial dynamic metadata to the display device, so that the display device can determine the creative intent parameter map corresponding to the image to be processed based on the spatial dynamic metadata, and perform tone mapping on each pixel in the image to be processed based on the creative intent parameter map and the target hardware capability parameter map.

24. A display device, characterized in that, The display device includes: One or more processors; Memory; and One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the tone mapping method of any one of claims 1 to 17.

25. A source-end device, characterized in that, The source-end device includes: One or more processors; Memory; and One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the tone mapping method of any one of claims 18 to 21.

26. A computer-readable storage medium, characterized in that, It stores a computer program, which is loaded by a processor to perform the steps of the tone mapping method according to any one of claims 1 to 21.

Images