Methods, apparatuses, devices, media, and modules for displaying high dynamic range data

Abstract

The application relates to the technical field of display, and discloses a method, device, equipment, medium and module for displaying high dynamic range data, the method comprising the following steps: performing luminance mapping on at least one target image in high dynamic range data to obtain a luminance mapping result of the target image; determining luminance characteristic information, a luminance peak area and a luminance promotion threshold according to the luminance mapping result, and determining a luminance adjustment curve coefficient of the target image according to the luminance promotion threshold; determining a first luminance promotion coefficient of a pixel in the target image according to the luminance adjustment curve; filtering the pixel in the target image according to the first luminance promotion coefficient to obtain a second luminance promotion coefficient; and promoting the luminance of each pixel in the target image according to the second luminance promotion coefficient to obtain an absolute luminance value for displaying the target image. By determining the luminance adjustment curve and filtering, the absolute luminance value for displaying the target image is finally determined, so that the picture details that can be displayed by the equipment when displaying an HDR video are improved.

Description

Technical Field

[0001] This application relates to the field of display technology, and in particular to a method, apparatus, device, medium, and module for displaying high dynamic range data. Background Technology

[0002] Glass-based micro light-emitting diode (Micro LED) splicing display products utilize a glass substrate as the backplane, offering advantages such as high brightness, high contrast, and seamless splicing. They are suitable for high-end commercial displays, home theaters, command and control applications, and other scenarios. Display brightness includes peak brightness and typical brightness. Peak brightness is the maximum brightness the screen can support for a short period; maintaining peak brightness for too long will cause screen burn-in. Peak brightness is typically measured in nits. Typical brightness is the safe brightness range the screen can maintain for an extended period without burn-in, measured by continuous brightness under full-screen white or standard color conditions.

[0003] High Dynamic Range (HDR) is an image or video processing technique designed to expand the brightness range, enabling the image to simultaneously present brighter highlights and darker shadow details, thus more closely resembling the real world as seen by the human eye.

[0004] Images are typically divided into bright and non-bright areas. Bright areas, such as lights or the sun, require peak brightness to display, so a high peak brightness on a monitor is beneficial for improving dynamic range. For display devices that prioritize ultimate image quality, achieving higher peak brightness is absolutely crucial. However, in HDR video, the peak brightness of source material, based on the Perceptual Quantization (PQ) (ST2084) curve, reaches 10,000 nits, far exceeding the peak and typical brightness of general-purpose monitors. Since a monitor's peak brightness cannot be maintained for too long, it can cause burn-in. This results in existing monitors being unable to display the details of HDR video, leading to detail loss. Summary of the Invention

[0005] This application proposes a method, apparatus, device, medium, and module for displaying high dynamic range data, which can improve the image details that display devices can display when displaying HDR video.

[0006] In a first aspect, this application proposes a method for displaying high dynamic range data, comprising: Brightness mapping is performed on at least one frame of the target image in the high dynamic range data to obtain the brightness mapping result of the target image; Based on the brightness mapping result, brightness feature information, brightness peak area and brightness enhancement threshold are determined, and the brightness adjustment curve coefficient of the target image is determined based on the brightness enhancement threshold; The first brightness enhancement coefficient of the pixels in the target image is determined based on the brightness adjustment curve; The pixels in the target image are filtered according to the first brightness enhancement coefficient to obtain the second brightness enhancement coefficient; The brightness of each pixel in the target image is increased according to the second brightness enhancement coefficient to obtain an absolute brightness value for displaying the target image.

[0007] In some embodiments, determining brightness feature information, brightness peak area, and brightness enhancement threshold based on the brightness mapping result, and determining the brightness adjustment curve of the target image based on the brightness enhancement threshold, includes: Based on the brightness mapping results, determine the brightness feature information, the brightness peak area, and the brightness enhancement threshold; The first slope is determined based on the coordinates of the left and right endpoints; wherein, the x-coordinate of the left endpoint is determined based on the brightness enhancement threshold, and the y-coordinate is determined based on the brightness enhancement threshold and the brightness enhancement value; the x-coordinate of the right endpoint is determined based on the maximum brightness value of the display device, and the y-coordinate is determined based on the peak brightness value of the display device; the brightness enhancement value is determined based on the maximum brightness value of the display device and the brightness enhancement threshold. The first endpoint slope coefficient and the second endpoint slope coefficient are determined based on the maximum brightness value and the peak brightness value of the display device, as well as the coordinates of the left endpoint and the right endpoint; A brightness adjustment curve is determined based on the first slope, the coordinates of the left endpoint, the slope coefficient of the first endpoint, and the slope coefficient of the second endpoint, wherein the brightness adjustment curve includes: a first brightness adjustment curve coefficient, a second brightness adjustment curve coefficient, a third brightness adjustment curve coefficient, and a fourth brightness adjustment curve coefficient.

[0008] In some embodiments, determining the brightness feature information, the brightness peak region, and the brightness enhancement threshold based on the brightness mapping result includes: Based on the brightness mapping result, the brightness information of each pixel in the target image is determined, and brightness feature information is obtained; The brightness mapping results are statistically analyzed based on the brightness of the pixels from high to low to obtain a statistical result of the number of pixels sorted by brightness. The number of pixels in the statistical results is summed from high to low brightness until the summation is greater than the number of pixels with the maximum peak brightness, thus obtaining a first brightness threshold; wherein, the number of pixels with the maximum peak brightness is determined based on the resolution and a preset peak brightness area ratio; The brightness value of each partition is determined based on the preset partition information and the brightness feature information, and the partition with the largest brightness value is taken as the second brightness threshold. The brightness enhancement threshold and the brightness peak region are determined based on the first brightness threshold and the second brightness threshold; wherein, the location of all pixels whose brightness is greater than the brightness enhancement threshold is the brightness peak region.

[0009] In some embodiments, determining a first brightness enhancement coefficient for pixels in the target image based on the brightness adjustment curve includes... If the brightness feature information of the pixel is greater than or equal to the brightness enhancement threshold, and the pixel is located in the brightness peak region, a first brightness enhancement coefficient of the pixel is determined according to the brightness adjustment curve and the brightness feature information. If the brightness feature information of a pixel is less than the brightness enhancement threshold and the pixel is not located in the brightness peak region, a first brightness enhancement coefficient of the pixel is determined based on the brightness enhancement value and the brightness feature information; wherein the brightness enhancement value is determined based on the maximum brightness value of the display device and the brightness enhancement threshold.

[0010] In some embodiments, filtering the pixels in the target image according to the first brightness enhancement coefficient to obtain a second brightness enhancement coefficient includes: According to the preset brightness mode, intra-frame filtering is performed on the pixel to obtain the third brightness enhancement coefficient of the pixel; Based on the stored brightness enhancement coefficient of the previous frame and the third brightness enhancement coefficient, the target image is subjected to inter-frame filtering pixel by pixel to obtain the second brightness enhancement coefficient.

[0011] In some embodiments, increasing the brightness of each pixel in the target image according to the second brightness enhancement coefficient to obtain an absolute brightness value for displaying the target image includes: The brightness of each pixel in the target image is increased according to the second brightness enhancement coefficient using the following calculation method to obtain the absolute brightness value used to display the target image:

[0012] Where TMOFusionImage(i,j) represents the absolute brightness value, (i,j) represents the pixel position, and vFUnc result(i,j)TMOMaxImage represents the second brightness enhancement coefficient, and TMOMaxImage represents brightness feature information.

[0013] In some embodiments, after increasing the brightness of each pixel in the target image according to the second brightness enhancement coefficient to obtain an absolute brightness value for displaying the target image, the method further includes: Perform color gamut mapping on the absolute brightness value to obtain the color gamut mapping result; Based on the color gamut mapping results and the photoelectric conversion table, the electrical signal used for display is determined.

[0014] In some embodiments, before determining the electrical signal for display based on the color gamut mapping result and the photoelectric conversion table, the method further includes: The value of the electrical signal used for display is determined based on the color gamut mapping result; Record the color gamut mapping results and the corresponding electrical signal values ​​to determine the photoelectric conversion table.

[0015] In some embodiments, determining the electrical signal for display based on the mapping result includes: The color gamut mapping result is expanded by performing an expansion operation on the result as follows:

[0016] Wherein, RGBfixed represents the extended bit mapping result, RGB output This represents the color gamut mapping result, where n represents the extension value; The electrical signal used for display is determined based on the transfer function of the display device and the extended mapping result.

[0017] Secondly, this application also provides an apparatus for displaying high dynamic range data, comprising: A brightness mapping module is used to perform brightness mapping on at least one frame of a target image in high dynamic range data to obtain the brightness mapping result of the target image; The brightness adjustment curve determination module is used to determine brightness feature information, brightness peak area and brightness enhancement threshold according to the brightness mapping result, and to determine the brightness adjustment curve coefficient of the target image according to the brightness enhancement threshold; A coefficient determination module is used to determine a first brightness enhancement coefficient of pixels in the target image based on the brightness adjustment curve. The filtering module is used to filter the pixels in the target image according to the first brightness enhancement coefficient to obtain the second brightness enhancement coefficient; A brightness enhancement module is used to enhance the brightness of each pixel in the target image according to the second brightness enhancement coefficient, so as to obtain an absolute brightness value for displaying the target image.

[0018] Thirdly, this application also provides an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, when the processor executes the computer program, it implements the method for displaying high dynamic range data as described in any of the first aspects.

[0019] Fourthly, this application also provides a computer-readable storage medium having computer-readable instructions stored thereon, which can be executed by a processor to implement the method for displaying high dynamic range data as described in any of the first aspects.

[0020] Fifthly, this application also provides a display module, comprising: a display panel, characterized in that it further comprises an electronic device as described in the third aspect.

[0021] The advantages of this application are as follows: A peak brightness region and a brightness enhancement threshold are determined based on the brightness mapping result, and the brightness enhancement threshold is used to determine the brightness adjustment curve of the target image. Then, the brightness of the pixels in the high dynamic range target image is enhanced according to the brightness adjustment curve, making the brightness of the target image in the high dynamic range data correspond more precisely to the brightness of the display device, achieving a more detailed and richer brightness mapping, thereby displaying more high dynamic range image details. The pixels in the target image are filtered according to a first brightness enhancement coefficient to obtain a second brightness enhancement coefficient, which avoids the impact of excessively high brightness on image details and adverse effects on the display device caused by pixels enhanced by the brightness enhancement coefficient. The brightness of each pixel in the target image is enhanced according to the second brightness enhancement coefficient to obtain the absolute brightness value used to display the target image. This allows for the display of more high dynamic range image details without exceeding the peak brightness and peak brightness display time of the display, while also avoiding the risk of screen burn-in. Attached Figure Description

[0022] Various other advantages and benefits will become apparent to those skilled in the art upon reading the following detailed description of preferred embodiments. The accompanying drawings are for illustrative purposes only and are not intended to limit the scope of this application. Furthermore, the same reference numerals denote the same parts throughout the drawings. In the drawings: Figure 1 This is a schematic diagram illustrating the steps of a method for displaying high dynamic range data provided in this application; Figure 2 This is a schematic diagram of the process of a method for displaying high dynamic range data provided in this application; Figure 3 This is a schematic diagram of the brightness adjustment curve of a method for displaying high dynamic range data provided in this application; Figure 4A This is a schematic diagram of a target image without brightness enhancement, provided in this application as a method for displaying high dynamic range data; Figure 4B This is a schematic diagram of a target image for brightness enhancement, as provided in this application, regarding a method for displaying high dynamic range data. Figure 5A This is a schematic diagram of another target image without brightness enhancement, representing a method for displaying high dynamic range data provided in this application; Figure 5B This is a schematic diagram of another target image used to enhance brightness in a method for displaying high dynamic range data provided in this application; Figure 6 This is a schematic diagram of a device for displaying high dynamic range data provided in this application; Figure 7 This is a schematic diagram of another device for displaying high dynamic range data provided in this application. Detailed Implementation

[0023] Exemplary embodiments of the present disclosure will now be described in more detail with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the disclosure to those skilled in the art. It should be noted that, unless otherwise stated, the technical or scientific terms used in this application should have the ordinary meaning understood by those skilled in the art to which this application pertains.

[0024] To address some problems in related technologies, embodiments of this disclosure provide a method, apparatus, device, medium, and module for displaying high dynamic range data. The technical solutions of this disclosure will be described in detail below through specific embodiments.

[0025] Example 1 like Figure 1 The diagram shown is a schematic of a method for displaying high dynamic range data provided in an embodiment of this application. The method includes steps S100 to S500.

[0026] Step S100: Perform brightness mapping on at least one frame of the target image in the high dynamic range data to obtain the brightness mapping result of the target image.

[0027] High-dynamic-range data includes video data of HDR source content, such as HDR video. By extracting the frame image to be processed from the high-dynamic-range data as the target image and performing brightness mapping, the brightness mapping result of the target image is obtained.

[0028] By performing brightness mapping on at least one frame of target image in the high-dynamic-range data, the brightness and color gamut of the target frame image can be adapted to the display device for display, such as the screen for displaying this high-dynamic-range data.

[0029] The brightness of high-dynamic-range data (such as HDR video) usually ranges between 0.001 - 10000 nits, and the brightness of display devices such as indoor display screens is generally within the range of 500 - 1500 nits. The peak brightness of the source content produced based on the PQ (ST2084) curve is 10000 nits, and the peak brightness of the source content produced based on the HLG curve is 2000 nits. If the display device does not perform special processing on the source content, there will be an overflow phenomenon, resulting in the loss of high-brightness details. Therefore, it is necessary to convert the brightness range of the content from the master version to the brightness range of the target display device, so as to maximize the retention of the creator's visual intention.

[0030] Step S200, determine the brightness feature information, brightness peak area, and brightness enhancement threshold according to the brightness mapping result, and determine the brightness adjustment curve of the target image according to the brightness enhancement threshold.

[0031] Since Micro LED has the property of self-emission, each pixel can emit light independently, and a small area (<A% of the screen) can burst out with ultra-high brightness. Although the high-dynamic data source content after brightness mapping can be accurately adapted to the maximum brightness of the display device, it may not be adapted to the ultra-high brightness range that can burst out in a small area. Therefore, it is necessary to further enhance the brightness of the highlighted part in the target image according to the screen area of the display device and the picture brightness characteristics (such as brightness feature information) in the target image, so that the highlighted picture has a wider brightness range to display picture details.

[0032] Determining the brightness peak area and brightness enhancement threshold according to the brightness mapping result can determine the area that needs to enhance the brightness according to the peak brightness of the display device according to the brightness distribution of each frame of target image. According to the brightness distribution of the target image, a brightness enhancement threshold T is determined for each frame of target image, so as to determine the brightness adjustment curve and obtain a brightness adjustment curve. The obtained brightness adjustment curve can more precisely correspond the brightness of the target image in the high-dynamic-range data to the brightness of the display device, so that the display device can display more picture details in the target image.

[0033] Step S300, determine the first brightness enhancement coefficient of the pixels in the target image according to the brightness adjustment curve.

[0034] Improving the original brightness of the target image based on the brightness adjustment curve can effectively enhance the dynamic range of the target image.

[0035] Step S400: Filter the pixels in the target image according to the first brightness enhancement coefficient to obtain the second brightness enhancement coefficient.

[0036] By filtering the pixels in the target image and adjusting the first brightness enhancement coefficient to obtain the second brightness enhancement coefficient, the excessive brightness of the pixels enhanced by the brightness enhancement coefficient can be effectively avoided, thus preventing the impact on image details and adverse effects on the display device.

[0037] Step S500: Increase the brightness of each pixel in the target image according to the second brightness enhancement coefficient to obtain the absolute brightness value used to display the target image.

[0038] The brightness of each pixel in the target image is increased by the second brightness enhancement coefficient to obtain the absolute brightness value used to display the target image. This can display more high dynamic range image details without exceeding the peak brightness of the display and the peak brightness display time, while also avoiding the risk of screen burn-in.

[0039] like Figure 2 As shown, in the embodiments of this application, brightness mapping is performed on at least one frame of the target image in the high dynamic range data to obtain the brightness mapping result of the target image, including: mapping the brightness of the target image frame by frame to a preset brightness range according to a preset standard to obtain the brightness mapping result of the target image.

[0040] The preset standards include the ITU-R BT.2100 standard; the preset brightness range includes the typical brightness range of the screen. Based on the ITU-R BT.2100 standard, the brightness of the target image in the high dynamic range data can be mapped to the typical brightness range of the screen frame by frame. For a frame of the target image, the RGB channel values ​​are normalized pixel by pixel, and brightness mapping processing is performed on each color channel according to the preset standards to obtain preprocessed data. After inverse normalization of the preprocessed data, the linear light signal is converted into a display signal using an EOTF lookup table to obtain the brightness mapping result of the target image, which is denoted as TMOImage. The calculation method is as follows: For target images in HDR source material that uses static metadata, a brightness adjustment curve based on the BT.2390 standard can be used to record the minimum brightness L of the display device. min Maximum brightness L max Read the white point brightness L from the master display of the HDR source (high dynamic range data). w and master display black level brightness L BTherefore, the maximum normalized value of the display device's brightness (maxLum) and the minimum normalized value of the display's brightness (minLum) are calculated: minLum=(PQEOTF -1 [L min ]-PQEOTF -1 [L B ] / PQEOTF -1 [L w ]-PQEOTF -1 [L B ]) maxLum=(PQEOTF -1 [L max ]-PQEOTF -1 [L B ] / PQEOTF -1 [L w ]-PQEOTF -1 [L B ]) Here, PQ is the perceptual quantization curve, belonging to the absolute brightness system, and EOTF is the electro-optical conversion function of the display device. This curve is an international standard, defined in ITU-R BT.2100.

[0041] Next, the luminance mapping inflection point is determined based on the maximum normalized value of luminance, i.e., the luminance mapping inflection point threshold KS is calculated:

[0042] Next, EETF curves are applied to the grayscale values ​​pixel by pixel and RGB channel by channel: E1=(E'-PQEOTF -1 [L B ]) / (PQEOTF -1 [L w ]-PQEOTF -1 [L B ]) E2 = E1 for E1 < KS E2=P[E1] for KS≤E1≤1 E3 = E2 + minLum(1 - E2) 4

[0043] In this context, E1, E2, and E3 are intermediate values, and E4 is the luminance mapping result denoted as TMOImage. P represents the mapping relationship. The calculation of E1, E2, E3, and E4 is performed per RGB channel. The value of the three-channel E4 is denoted as the luminance mapping result TMOImage, which represents the physical luminance value of each pixel and can be image data.

[0044] Because the brightness range of the target image in an HDR source (e.g., 0.05 nit to 4000 nits) calculated by EOTF may not match the actual brightness range of the display device (e.g., 0.05 nit to 1000 nits), E1, E2, E3, and E4 can compress or enhance the brightness range of the high dynamic range data source to match the brightness range of the display device, that is, between the minimum and typical brightness of the display device.

[0045] For high dynamic range data with SDR source material, tone mapping needs to be performed frame by frame to map the brightness to the range supported by the display. According to the BT2446 standard, the brightness of the SDR source material in the target image can be mapped to the brightness range of the display device to obtain the brightness mapping result of the target image.

[0046] like Figure 2 As shown, in one embodiment, brightness feature information, brightness peak area and brightness enhancement threshold are determined according to the brightness mapping result, and the brightness adjustment curve of the target image is determined according to the brightness enhancement threshold, including steps S210 to S240.

[0047] S210, determine the brightness characteristic information, brightness peak area and brightness enhancement threshold based on the brightness mapping result.

[0048] S220, determine the first slope based on the coordinates of the left endpoint and the right endpoint; wherein, the horizontal coordinate of the left endpoint is determined based on the brightness enhancement threshold, and the vertical coordinate is determined based on the brightness enhancement threshold and the brightness enhancement value; the horizontal coordinate of the right endpoint is determined based on the maximum brightness value of the display device, and the vertical coordinate is determined based on the peak brightness value of the display device; the brightness enhancement value is determined based on the maximum brightness value of the display device and the brightness enhancement threshold.

[0049] To facilitate FPGA integration, the brightness adjustment curve in this application's embodiments represents the brightness enhancement ratio or coefficient corresponding to each brightness level; it is the overall value after enhancement, not just the value of that enhancement. By statistically analyzing the maximum and minimum brightness of the target image, it can be determined whether the target image is a solid color image. For target images that are solid colors, curve mapping is not performed, i.e., the embodiments of this application are not used for processing.

[0050] Both the left and right endpoints are used to create the brightness adjustment curve. For example... Figure 3As shown, the left endpoint of the brightness adjustment curve represents the brightness enhancement threshold T, the right endpoint represents the typical screen brightness value (using the maximum brightness value MAX_brightness), and the right endpoint represents the peak screen brightness value (using the peak brightness value PEAK_brightness). To ensure curve continuity, the left endpoint's ordinate is the original brightness value (brightness enhancement threshold T) plus the brightness enhancement value kup, i.e., T + kup. Let the left endpoint coordinates be (x0, y0) and the right endpoint coordinates be (x1, y1). That is, x0 represents the brightness enhancement threshold T, y0 represents the sum of the brightness enhancement threshold T and the brightness enhancement value kup, x1 represents the maximum brightness value MAX_brightness, and y1 represents the peak brightness value PEAK_brightness. Wherein, as... Figure 3 As shown, the left endpoint is the intersection of the two curves, and the right endpoint is the maximum value of the curve's ordinate on the right side.

[0051] Let the change in the horizontal axis be dx = x1 - x0, the change in the vertical axis be dy = y1 - y0, and the first slope be delta = dx / dy.

[0052] S230, determine the slope coefficient of the first endpoint and the slope coefficient of the second endpoint based on the maximum brightness value and peak brightness value of the display device, as well as the coordinates of the left endpoint and the right endpoint; Determine the curve coefficients. Based on the maximum brightness value MAX_brightness and the peak brightness value PEAK_brightness, set the endpoint slope coefficients s1 (first endpoint slope coefficient) and s0 (second endpoint slope coefficient). A high-order polynomial curve can be constructed between the two points using cubic spline interpolation, and the curve can be solved. That is, s0 = y'(x0), s1 = y'(x1). When the pixel's brightness feature information TMOMaxImage(i,j) is less than the brightness enhancement threshold T, the brightness adjustment curve enhances the pixel's brightness to the range (0, y0 + kup), which is the position of the blue curve in the image. Here, y0 + kup will not exceed MAX_brightness. The horizontal axis represents the brightness value before enhancement, and the vertical axis represents the brightness value after enhancement. When the pixel's brightness feature information TMOMaxImage(i,j) is greater than or equal to the brightness enhancement threshold T, the brightness adjustment curve enhances the pixel's brightness to (T, PEAK_brightness), which is the position of the red curve in the image.

[0053] S240, the brightness adjustment curve is determined based on the first slope, the coordinates of the left endpoint, the slope coefficient of the first endpoint, and the slope coefficient of the second endpoint. The brightness adjustment curve includes: a first brightness adjustment curve coefficient, b second brightness adjustment curve coefficient, c third brightness adjustment curve coefficient, and d fourth brightness adjustment curve coefficient. The four brightness adjustment curve coefficients are determined as follows: a=f(s1,s0,delta), b= f(s1,s0,delta), c=f(s1), d=f(y0) In one embodiment, determining the brightness feature information, the brightness peak area, and the brightness enhancement threshold based on the brightness mapping result includes steps S211 to S215.

[0054] Step S211: Determine the brightness information of each pixel in the target image based on the brightness mapping result to obtain brightness feature information.

[0055] Specifically, the brightness information of each pixel in the target image is determined based on the brightness mapping result to obtain brightness feature information. This includes: obtaining brightness feature information based on the maximum brightness information of the three channels of each pixel in the target image, or obtaining brightness feature information based on a preset weighting coefficient and the brightness information of each pixel in the target image. The brightness information of each pixel is its own brightness feature information; the final obtained brightness feature information includes the brightness information of all pixels in the entire target image.

[0056] The luminance mapping result TMOImage is traversed, and its luminance features are calculated pixel by pixel to obtain the luminance information of each pixel, denoted as TMOMaxImage. Each pixel includes a luminance mapping result TMOImage(i,j), where i represents the vertical coordinate of the pixel and j represents the horizontal coordinate of the pixel. The luminance information can be determined directly by taking the maximum value of each pixel's three channels, i.e., TMOMaxImage = max(R,G,B), or by taking the weighted luminance value of each pixel as the luminance information according to a preset weighting coefficient. Where R is the brightness value of the red channel, G is the brightness value of the green channel, and B is the brightness value of the blue channel. This ultimately yields brightness feature information for all pixels in the target image.

[0057] Step S212: Statistically analyze the brightness mapping results based on the brightness of the pixels from high to low to obtain a statistical result of the number of pixels sorted by brightness.

[0058] The determination of the PEAK (peak brightness) range is strongly correlated with the area of ​​the PEAK region (peak brightness area), which is determined by the basic performance of the display device. Therefore, peak brightness area detection is required (e.g., Figure 2 (As shown). The screen resolution of the display device is... For example, if the maximum area ratio for peak screen brightness is set to A, then the number of peak pixels (pixels that can be displayed at peak brightness) per frame is calculated based on the screen resolution. This represents the number of pixels with the maximum peak brightness. Histogram statistics are performed on the brightness mapping result TMOImage to obtain the statistical results of the number of pixels sorted from highest to lowest brightness.

[0059] Step S213: Sum the number of pixels in the statistical results according to the brightness of the pixels from high to low until the summation result is greater than the number of pixels with the maximum peak brightness, and obtain the first brightness threshold; wherein, the number of pixels with the maximum peak brightness is determined according to the resolution and the preset peak brightness area ratio.

[0060] Starting from the total number of pixels with the highest brightness, sum the number of pixels from highest to lowest to obtain the total number of pixels, SumMax. Continue this process until SumMax is greater than the maximum peak brightness pixel count, maxImageO. Use the brightness of the lowest pixel corresponding to the pixel in the summation result at this point as the first brightness threshold T1, thus obtaining the brightness threshold for the peak brightness area.

[0061] The following section provides a detailed explanation of how, in the embodiments of this application, the number of pixels in the statistical results is summed from high to low brightness until the summation result is greater than the number of pixels with the maximum peak brightness, thus obtaining a first brightness threshold.

[0062] Taking a maximum peak brightness pixel count of 160 as an example, assuming that the brightness of the pixels is sorted from high to low, brightness 1 has 20 pixels, brightness 2 has 40 pixels, brightness 3 has 60 pixels, brightness 4 has 30 pixels, brightness 5 has 50 pixels, brightness 6 has 10 pixels, and so on. The brightness values ​​of brightness 1, brightness 2, brightness 3, brightness 4 and brightness 5 are in the following order from high to low: brightness 1 > brightness 2 > brightness 3 > brightness 4 > brightness 5. Starting with the 20 pixels of brightness 1 (the highest brightness value), sum the number of pixels from highest to lowest. The sum of the pixels of brightness 1 and brightness 2 is 20 + 40 = 60, which is less than the maximum peak brightness pixel count of 160. Therefore, sum it with the pixels of brightness 3, resulting in 120, which is still less than the maximum peak brightness pixel count of 160. Then sum it with the pixels of brightness 4, resulting in 150, which is less than the maximum peak brightness pixel count of 160. Finally, sum it with the pixels of brightness 5, resulting in 210, which is greater than the maximum peak brightness pixel count of 160. Therefore, the brightness value of brightness 5 at this point is the first brightness threshold.

[0063] Step S214: Determine the partition brightness value of each partition based on the preset partition information and brightness feature information, and take the partition with the largest brightness value as the second brightness threshold T2. Based on the screen distribution of the video wall controller, the brightness values ​​of each zone on the screen can be counted screen by screen, and the number of zones is recorded as follows. If the number of pixels on a single screen is large, the screen can be further divided into partitions based on the area corresponding to the peak brightness, and the number of partitions can be denoted as . Where k1 and k2 represent the number of unidirectional partitions on a single screen. For local dimming products such as LCD and MiniLED, the partition brightness values ​​can be calculated based on their actual partition configuration. Many methods exist for extracting partition brightness features, including the mean method, root mean square method, error correction method, and maximum value method; the appropriate algorithm should be selected based on actual needs.

[0064] The mean method calculates the average value V of the absolute brightness of all pixels within the partition. ave This serves as the brightness value for that partition; The maximum value method iterates through all the brightness values ​​in the partition and selects the maximum value Vmax as the brightness value of the partition. The error correction method adjusts the brightness value by using a correction factor:

[0065] Where Diff represents the difference between the maximum and minimum pixel brightness values ​​in the partition, n represents the gray level, and the average value of all pixel brightness values ​​in the partition plus the correction coefficient is the final brightness value of the partition. The N-fold average method first calculates the average brightness V of all pixels in a single zone. ave Given the maximum value Vmax, the average multiple is set to N, and the weighting coefficient is W. Calculate the brightness value T' of this partition: T'=W×Vmax +(1-W) ×N×V ave If the obtained partition brightness value T' is greater than the maximum screen brightness value, such as 1000 nits, then the brightness value of that partition is 1000. The maximum brightness value of the image's regions is calculated and used as the second brightness threshold T2, thus obtaining the brightness threshold used for region brightness. A minimum brightness threshold T2min can be set. When the second brightness threshold T2 is lower than the minimum brightness threshold T2min, the minimum brightness threshold T2min is used as the second brightness threshold T2.

[0066] Step S215: Determine the brightness enhancement threshold and the brightness peak area based on the first brightness threshold and the second brightness threshold; wherein, the location of all pixels with brightness greater than the brightness enhancement threshold is the brightness peak area.

[0067] The maximum value of the first brightness threshold T1 and the second brightness threshold T2 is taken as the brightness enhancement threshold T of the target image in this frame, i.e., T = max(T1, T2). The second brightness threshold T2 better matches the brightness characteristics of the image, while the first brightness threshold T1 ensures that the brightness peak area does not exceed the maximum load capacity of the display device's screen. In one embodiment, determining the first brightness enhancement coefficient of a pixel in the target image based on the brightness adjustment curve includes: determining the first brightness enhancement coefficient of the pixel based on the brightness adjustment curve and the brightness characteristic information when the brightness characteristic information of the pixel is greater than or equal to the brightness enhancement threshold and the pixel is located in the brightness peak area; determining the first brightness enhancement coefficient of the pixel based on the brightness enhancement value and the brightness characteristic information when the brightness characteristic information of the pixel is less than the brightness enhancement threshold and the pixel is not located in the brightness peak area; wherein, the brightness enhancement value is determined based on the maximum brightness value of the display device and the brightness enhancement threshold.

[0068] In this application, the brightness enhancement threshold represents the maximum value that each pixel can reach after enhancement. It is the overall value after enhancement, rather than a threshold that only represents the part of the value that can be enhanced.

[0069] like Figure 2 As shown, in the embodiments of this application, the first brightness enhancement coefficient vFunc is obtained by calculating the brightness enhancement coefficient pixel by pixel. Since the pixel will be located in the brightness peak region (PEAK region) when the pixel brightness feature value TMOMaxImage is greater than or equal to the brightness enhancement threshold T, and the pixel will be located in the non-brightness peak region (non-PEAK region) when the pixel brightness feature value TMOMaxImage is less than the brightness enhancement threshold T, the embodiments of this application only further explain the acquisition of the first brightness enhancement coefficient vFunc in the above two cases.

[0070] If the pixel's brightness feature value TMOMaxImage is greater than or equal to the brightness enhancement threshold T, and the pixel is located in the peak brightness region (PEAK region), then the brightness of the pixel needs to be significantly enhanced. Its first brightness enhancement coefficient vFunc is determined as follows: vFunc=f(a,b,c,d,TMOMaxImage) Where a is the coefficient of the first brightness adjustment curve, b is the coefficient of the second brightness adjustment curve, c is the coefficient of the third brightness adjustment curve, d is the coefficient of the fourth brightness adjustment curve, and f is the function.

[0071] If the pixel's brightness characteristic value TMOMaxImage is less than the brightness enhancement threshold T, and the pixel is located in a non-peak brightness region (non-PEAK region), there is no need to significantly enhance the pixel's brightness. Assuming the brightness enhancement threshold T = 900 nits, the brightness in the 900-1000 nit range can be enhanced to 1000-3000 nits, while the brightness range of 0-900 nits can be adjusted accordingly to 0-1000 nits, thus revealing more image details. The first brightness enhancement coefficient vFunc is determined as follows: vFunc=f(kup,TMOMaxImage) Where kup is the brightness enhancement value. The brightness value of the pixel after being enhanced by the first brightness enhancement coefficient is less than the maximum brightness value of the screen, MAX_brightness.

[0072] In the embodiments of this application, the brightness enhancement value kup can be set to a certain value as needed, as long as (brightness enhancement threshold T + brightness enhancement value kup) ≤ the maximum screen brightness value MAX_brightness. Furthermore, the brightness enhancement value kup can also be calculated in the following way: kup=f(a1,a2,a3,α,β,γ,(MAX brightness -Y), where a1 is the calculation parameter for the first endpoint, a2 is the calculation parameter for the second endpoint, a3 is the calculation parameter for the third endpoint, and α, β, γ are all slope parameters. Substituting Y into y0, MAX brightness This represents the maximum screen brightness value, MAX_brightness.

[0073] When a pixel's brightness is below the brightness enhancement threshold T, the original brightness can be slightly increased according to the brightness adjustment curve. When a pixel's brightness is above the brightness enhancement threshold T, the original brightness is peaked according to the brightness adjustment curve. In this case, the brightness range of a single frame of the target image is increased from the minimum brightness value min_brightness to the typical brightness value typical_brightness to the minimum brightness value min_brightness to the peak brightness value peak_brightness, thereby effectively improving the dynamic range of the target image.

[0074] like Figure 2 As shown, in one embodiment, filtering pixels in the target image according to a first brightness enhancement coefficient to obtain a second brightness enhancement coefficient includes: performing intra-frame filtering on pixels according to a preset brightness mode to obtain a third brightness enhancement coefficient for pixels; and performing inter-frame filtering on the target image pixel by pixel according to the stored brightness enhancement coefficient of the previous frame and the third brightness enhancement coefficient to obtain the second brightness enhancement coefficient.

[0075] The preset brightness mode is the brightness mode of the display device, which is determined according to the user's settings when using the display device, such as setting the display device to high brightness mode or low brightness mode. If the brightness enhancement coefficient of the previous frame is not stored, and the current target image is the first frame, then the third brightness enhancement coefficient of the target image will be used as the stored brightness enhancement coefficient of the previous frame.

[0076] Since the brightness increase in the peak brightness area (PEAK area) is much greater than that in the non-peak brightness area (non-PEAK area), intra-frame filtering can prevent uneven transitions between the peak brightness area and the non-peak brightness area. Furthermore, when the ambient light is dim, excessively high screen brightness may cause user discomfort; therefore, the implementation of this application divides the peak brightness enhancement scheme into a high-brightness mode and a low-brightness mode.

[0077] In high-brightness mode, intra-frame filtering is performed on pixels to obtain the third brightness enhancement coefficient of the pixels. This includes intra-frame filtering of pixels in the target image below a threshold, while retaining the original brightness enhancement value for pixels above the threshold. In low-brightness mode, intra-frame filtering is performed on pixels to obtain the third brightness enhancement coefficient of the pixels. This includes intra-frame filtering of the entire target image. Mean filtering, box filtering, Gaussian filtering, and other methods can be used to smooth backlight data. All of the above filtering methods can be expressed by the following formula, the difference being the convolution kernel Filter(m,n). The width and height of the convolution kernel can be different, but both the width and height of the convolution kernel must be odd numbers.

[0078] vFunc_pad(N) represents the data after the brightness enhancement coefficient is expanded, vFunc_Filter(N)(i,j) represents the third brightness enhancement coefficient, and Filter represents the filter convolution kernel.

[0079] Since convolution processing requires data from surrounding pixels, the brightness enhancement coefficient needs to be expanded. This involves expanding the first brightness enhancement coefficient (vFUnc) of the pixels surrounding the pixel to be processed into the data, resulting in data with expanded brightness enhancement coefficients. In mean filtering and box filtering, the weight of each pixel in its neighborhood is equal. In Gaussian filtering, the weight of the center point is increased, and the weight of the center point is decreased. Based on this, the sum of the different weights of each pixel in the neighborhood is calculated. For this type of filtering, to ensure good display of image edges, a backlight expansion step can be performed before intra-frame filtering. This involves using the image boundary as a symmetry axis, combined with the size of the filter kernel... Where m is the size of the filter kernel on the vertical axis and n is the size of the filter kernel on the horizontal axis, the resolution is achieved through mirror symmetry. The target image's image resolution is expanded to Where H is the resolution of the image on the vertical axis, W is the resolution of the image on the horizontal axis, a is the vertical expansion value, and b is the horizontal expansion value.

[0080] Alternatively, median filtering can be selected. Median filtering takes the pixel values ​​of the current pixel and its neighboring pixels (usually an odd number of pixels), sorts these pixel values, and uses the middle pixel value as the current pixel value. That is: vFunc Filter(N)(i,j) =median(I(i,j),i,j)∈[xa,x+a]×[yb,y+b] Where x and y are the position coordinates of the pixel in the target image (original image), vFunc Filter(N)(i,j) This is the third brightness enhancement factor, and median is a function that returns the median of a given set of values.

[0081] Retain the brightness enhancement coefficient vFUnc_before (brightness enhancement coefficient vFUnc_result) from the previous frame, and perform inter-frame filtering on the brightness pixel by pixel: vFUnc_result=f(vFUnc_before, vFUnc,α,β) Where α and β are inter-frame filtering coefficients, vFUnc is substituted into the third brightness enhancement coefficient; vFUnc_result is the second brightness enhancement coefficient.

[0082] Inter-frame filtering (inter-frame backlight processing) can make brightness changes more uniform and prevent sudden brightness changes, as well as screen flickering and jittering.

[0083] In one embodiment, increasing the brightness of each pixel in the target image according to a second brightness enhancement coefficient to obtain an absolute brightness value for displaying the target image includes: increasing the brightness of each pixel in the target image according to the second brightness enhancement coefficient using the following calculation method to obtain an absolute brightness value for displaying the target image:

[0084] Where TMOFusionImage(i,j) represents the absolute brightness value after enhancement according to the second brightness enhancement factor, (i,j) represents the pixel position, and vFUnc result(i,j) This represents the second brightness enhancement factor, and TMOMaxImage represents brightness feature information.

[0085] After obtaining the second brightness enhancement coefficient vFUnc_result, the actual brightness value of each pixel is calculated channel by channel based on the second brightness enhancement coefficient to obtain the absolute brightness value TMOFusionImage of the target image, which is the final HDR PEAK image.

[0086] Absolute brightness values ​​can enhance the peak brightness area based on the display device's peak brightness, thereby revealing more bright details and achieving a more vivid HDR effect. At the same time, the brightness of non-peak brightness areas is slightly increased, thus avoiding uneven transitions at the boundary between peak and non-peak brightness areas.

[0087] like Figure 2 As shown, in one embodiment, after increasing the brightness of each pixel in the target image according to the second brightness enhancement coefficient to obtain the absolute brightness value for displaying the target image, the method further includes: performing color gamut mapping on the absolute brightness value to obtain a color gamut mapping result; and determining the electrical signal for display based on the color gamut mapping result and the photoelectric conversion table.

[0088] Color gamut mapping is used to convert the color gamut of a target image from one display device to another. Since different display devices may have different color gamuts, color gamut mapping aims to maintain visual consistency of colors as much as possible, avoiding color distortion or information loss. It maps the color gamut of the absolute brightness values ​​(HDR PEAK images) of the target image based on the actual color gamut of the display device's screen. The main methods of color gamut mapping include color gamut clipping and color gamut compression. Color gamut clipping directly clips colors outside the target color gamut to the boundary of the target color gamut without changing colors within the target gamut. Color gamut clipping can be achieved through nearest-nearest-point mapping or projection mapping. Color gamut compression adjusts all colors, including those inside and outside the target gamut, to fit the entire color space to the target color gamut. Color gamut compression can be achieved through linear compression, non-linear compression, perceptual mapping, and other methods. The advantages of color gamut clipping and color gamut compression can also be combined, performing color gamut clipping on key areas and color gamut compression on the rest.

[0089] Taking an HDR source with a color gamut of BT.2020 and a display device with a display capability of BT.709 as an example, the color gamut mapping result is determined using the following method according to the International Telecommunication Union (ITU) recommended matrix:

[0090] Among them, matrix The matrix represents the red, green, and blue color gamut values ​​of the absolute brightness. The matrix represents the red, green, and blue color gamut values ​​of the display device's monitor. Recommended matrix by the International Telecommunication Union.

[0091] RGB_output = min(PEAK_brightness,max(0,RGB_709).

[0092] Where RGB_output represents the color gamut mapping result, PEAK_brightness represents the peak brightness value, and RGB_709 represents the matrix. This refers to the red, green, and blue color gamut values ​​of the display device's monitor.

[0093] The above methods can prevent the obtained color gamut mapping results from overflowing and going out of bounds, so that they can be better displayed by the display device.

[0094] In one embodiment, before determining the electrical signal for display based on the color gamut mapping result and the photoelectric conversion table, the method further includes: determining the value of the electrical signal for display based on the color gamut mapping result; recording the color gamut mapping result and the value of the corresponding electrical signal; and determining the photoelectric conversion table.

[0095] The RGB_output result obtained after gamut mapping is an absolute luminance value, which needs to be converted into an electrical signal for display. This is achieved by performing photoelectric conversion on the absolute luminance values ​​of the RGB three channels pixel by pixel. Methods for photoelectric conversion include determining the electrical signal based on the screen gamma value or based on the Opto-Electrical Transfer Function (OETF) formula of the PQ curve.

[0096] The electrical signal is calculated based on the screen gamma value as follows: E_RGB=RGB_output gamma The electrical signal is calculated using the OEFT formula of the PQ curve as follows: E_RGB = PQ_OEFT (RGB_output) Where E_RGB is the electrical signal, RGB_output is the color gamut mapping result, which is the absolute brightness value, gamma is the screen gamma value, and PQ_OEFT is the OEFT formula for the PQ curve.

[0097] In one embodiment, determining the electrical signal for display based on the mapping result includes: performing a bit-expanding operation on the mapping result to obtain a bit-expanded mapping result: Where RGBfixed represents the extended mapping result, RGB output RGB_output represents the color gamut mapping result, and n represents the extension value; the electrical signal used for display is determined based on the transfer function of the display device and the extension mapping result.

[0098] The transfer function of the display device includes the gamma value and the PQ curve. OETF conversion from linear optical signal to nonlinear electrical signal requires more potential to represent details in low-brightness areas. For hardware processors such as FPGAs, floating-point data cannot be used to represent absolute brightness values. If the absolute brightness value is rounded to an integer, significant loss of detail in low-brightness areas occurs. Assuming a display bit width of 10 bits, the electrical signal corresponding to 1 nit of absolute brightness is 176, and the electrical signal corresponding to 2 nits is 221, resulting in severe image blockiness. Therefore, a bit-expanding operation is needed on the absolute brightness value RGB_output, and the expanded mapping result... , among which RGB output This represents the RGB_output color gamut mapping result, where n is determined by the algorithm's precision. Since the OETF curve contains decimals, all parameters can be expanded using the same method. The final calculation result is then shifted. The method of determining the electrical signal based on the screen gamma value can also be achieved by expanding the absolute brightness value RGB_output to improve image detail in bright areas. The electrical signal is obtained from the expanded absolute brightness value as follows:

[0099] Among them, PQ OEFT The OEFT formula for the PQ curve, RGB output Represents the absolute brightness value RGB_output, E RGB This represents the electrical signal. The two methods for determining the electrical signal can be chosen based on the specific situation. Generally, for 8-bit depths and brightness levels below 500 nits, the method of determining the electrical signal based on the screen's gamma value can be used; for 10-bit depths and brightness levels ranging from 1000 to 2000 nits, the method of determining the electrical signal based on the OETF formula of the PQ curve can be used.

[0100] like Figure 4A , 4B Figures 5A and 5B illustrate a schematic diagram of displaying high dynamic range data on a display device based on the final obtained electrical signal, according to an embodiment of this application. Here, is a target image without brightness enhancement. Figure 4B A target image for brightness enhancement. Figure 4B The lighter-colored middle section and the upper part of the image have more detail. Figure 5A Another target image that has not undergone brightness enhancement. Figure 5B Another target image for brightness enhancement. Figure 5B The lighter-colored patterned areas show more detail. Therefore, it is evident that by improving brightness through the embodiments of this application, the display device can exhibit more image detail, resulting in a significant increase in brightness.

[0101] In the embodiments of this application, a lookup table method can be used to record the data before and after photoelectric conversion (mapping results and their corresponding electrical signal values), thereby determining a photoelectric conversion table for lookup. If the absolute brightness value RGB_output is expanded by 2 bits... n Then change the lookup table to a single The table, with two rows and two columns, stores the absolute luminance value (mapping result) and the corresponding electrical signal value, respectively. This allows the corresponding electrical signal value to be obtained by looking up the photoelectric conversion table after obtaining the absolute luminance value (RGB_output), without requiring calculation.

[0102] In one implementation, a segmented lookup table method can also be used to save resources. Since the 0-1 nit brightness range corresponds to multiple level signals, the 1-108 nit brightness range corresponds to one level signal every few levels, and after 108 nit, tens, hundreds, or thousands of brightness values ​​correspond to one level signal, the brightness value and level signal value are non-linear. Low-brightness areas require more level signals to display details. Taking PQ OETF as an example, when the absolute brightness value RGB_output > 108 nits, multiple brightness values ​​correspond to one electrical signal value. Therefore, when the absolute brightness value RGB_output > 108, no bit expansion is needed; it is saved as a lookup table 1 with (PEAK_brightness-108) rows and 2 columns, i.e., peak brightness up to 108 nits. For low-brightness values, such as the 0-108 nit brightness range, bit expansion n1 is performed to find the boundary point K1, and it is saved as... Create a lookup table 2 with 2 rows and 2 columns, where K1 is the brightness dividing point, i.e., from 108 nits to K1. Continue to expand the brightness values ​​(0-K1) by bits, repeating the above operation until the value of the electrical signal stored in the lookup table meets the accuracy requirements.

[0103] The photoelectric conversion table in the form of a segmented lookup table has a size compression rate of more than 99%, achieving low-resource storage while meeting accuracy requirements.

[0104] In the embodiments of this application, the first brightness threshold T is the brightness value determined by summing the number of pixels in the statistical results according to the brightness of pixels from high to low until the summation result is greater than the number of pixels with the maximum peak brightness. The second brightness threshold T2 is the maximum brightness value among the partition brightness values ​​of all partitions determined according to preset partition information and brightness feature information. The first brightness enhancement coefficient vFunc is the brightness enhancement coefficient of the pixel determined according to the mapping curve and brightness feature information when the brightness feature information of the pixel is greater than or equal to the brightness enhancement threshold and the pixel is located in the brightness peak area. The second brightness enhancement coefficient vFUnc_result is the brightness coefficient obtained by performing inter-frame filtering on the target image pixel by pixel according to the stored brightness enhancement coefficient of the previous frame and the third brightness enhancement coefficient. The third brightness enhancement coefficient vFunc_Filter is the brightness enhancement coefficient of the pixel obtained by performing intra-frame filtering on the pixel according to the preset brightness mode.

[0105] The coefficients a for the first brightness adjustment curve, b for the second brightness adjustment curve, c for the third brightness adjustment curve, and d for the fourth brightness adjustment curve are all coefficients used to determine the brightness adjustment curve.

[0106] The first slope delta, the first endpoint slope coefficient s1, and the second endpoint slope coefficient s0 are all parameters or coefficients used to determine the brightness adjustment curve.

[0107] The first endpoint calculation parameter a1, the second endpoint calculation parameter a2, and the third endpoint calculation parameter a3 are all parameters used to determine the brightness enhancement value kup.

[0108] Example 2 This application also provides a device for displaying high dynamic range data, such as... Figure 6 As shown, it includes: The brightness mapping module 100 is used to perform brightness mapping on at least one frame of the target image in the high dynamic range data to obtain the brightness mapping result of the target image. The brightness adjustment curve determination module 200 is used to determine the brightness feature information, brightness peak area and brightness enhancement threshold according to the brightness mapping result, and to determine the brightness adjustment curve coefficient of the target image according to the brightness enhancement threshold. The coefficient determination module 300 is used to determine the first brightness enhancement coefficient of the pixels in the target image based on the brightness adjustment curve. The filtering module 400 is used to filter the pixels in the target image according to the first brightness enhancement coefficient to obtain the second brightness enhancement coefficient; The brightness enhancement module 500 is used to enhance the brightness of each pixel in the target image according to the second brightness enhancement coefficient, so as to obtain the absolute brightness value used to display the target image.

[0109] In one embodiment, the brightness adjustment curve determination module includes: The feature acquisition unit 210 is used to determine the brightness feature information, the brightness peak area and the brightness enhancement threshold based on the brightness mapping result; The brightness adjustment curve determination unit 220 is used to determine a first slope based on the coordinates of the left endpoint and the right endpoint; wherein, the horizontal coordinate of the left endpoint is determined based on the brightness enhancement threshold, and the vertical coordinate is determined based on the brightness enhancement threshold and the brightness enhancement value; the horizontal coordinate of the right endpoint is determined based on the maximum brightness value of the display device, the vertical coordinate is determined based on the peak brightness value of the display device, and the brightness enhancement value is determined based on the maximum brightness value of the display device and the brightness enhancement threshold. The first endpoint slope coefficient and the second endpoint slope coefficient are determined based on the maximum brightness value and peak brightness value of the display device, as well as the coordinates of the left endpoint and the right endpoint. The brightness adjustment curve is determined based on the first slope, the coordinates of the left endpoint, the first endpoint slope coefficient, and the second endpoint slope coefficient. The brightness adjustment curve includes: the first brightness adjustment curve coefficient, the second brightness adjustment curve coefficient, the third brightness adjustment curve coefficient, and the fourth brightness adjustment curve coefficient.

[0110] In one embodiment, such as Figure 7 As shown, it also includes: The color gamut mapping module 600 is used to perform color gamut mapping on absolute brightness values ​​to obtain color gamut mapping results. The photoelectric conversion module 700 is used to determine the electrical signal for display based on the color gamut mapping results and the photoelectric conversion table.

[0111] The apparatus for displaying high dynamic range data provided in this embodiment is based on the same concept as the method for displaying high dynamic range data described above, and therefore can at least achieve the beneficial effects that the method for displaying high dynamic range data described above can achieve, which will not be repeated here.

[0112] Example 3 This application also provides an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the method for displaying high dynamic range data as described in Embodiment 1.

[0113] The electronic device provided in this embodiment is based on the same concept as the above-described method for displaying high dynamic range data, and therefore can at least achieve the beneficial effects that the above-described method for displaying high dynamic range data can achieve, which will not be repeated here.

[0114] Example 4 This application also provides a computer-readable storage medium having computer-readable instructions stored thereon, which can be executed by a processor to implement the method for displaying high dynamic range data of Embodiment 1.

[0115] The computer-readable storage medium provided in this embodiment is based on the same concept as the above-described method for displaying high dynamic range data, and therefore can at least achieve the beneficial effects that the above-described method for displaying high dynamic range data can achieve, which will not be repeated here.

[0116] Example 5 This application also provides a display module, including: a display panel, and an electronic device as described in Embodiment 3.

[0117] The display module provided in this embodiment is based on the same concept as the above-described method for displaying high dynamic range data, and therefore can at least achieve the beneficial effects that the above-described method for displaying high dynamic range data can achieve, which will not be elaborated here.

[0118] In the embodiments of this application, by performing brightness mapping on at least one frame of the target image in the high dynamic range data, the brightness and color gamut of the target frame image can be adapted to the display device used for display, such as a screen used to display this high dynamic range data. By detecting the brightness peak area, the obtained brightness adjustment curve can more precisely correspond the brightness of the target image in the high dynamic range data to the brightness of the display device, thereby enabling the display device to display more image details in the target image. Boosting the original brightness of the target image according to the brightness adjustment curve can effectively improve the dynamic range of the target image. By filtering the pixels in the target image and adjusting the first brightness enhancement coefficient, the transition between the brightness peak area and the non-brightness peak area within the frame is smoothed. Then, inter-frame smoothing is performed to obtain the second brightness enhancement coefficient, which can effectively avoid the impact on image details and adverse effects on the display device caused by excessively high brightness of pixels enhanced by the brightness enhancement coefficient. The brightness of each pixel in the target image is increased by a second brightness enhancement coefficient to obtain an absolute brightness value for displaying the target image. This allows for the display of more high dynamic range image details without exceeding the display's peak brightness and peak brightness display time, while also ensuring that the peak brightness time at the same location does not exceed a specified duration, thus avoiding screen burn-in risk. The implementation of this application also allows for switching between high and low brightness modes to ensure the displayed image matches the viewing environment. The OETF conversion fixed-point algorithm determines the photoelectric conversion table, achieving low resource storage while meeting accuracy requirements. The implementation of this application reasonably maps the brightness of HDR source material based on the display's peak and typical brightness. By reasonably mapping the HDR source material, its brightness and color gamut are adapted to the screen, displaying more image details while avoiding detail loss due to overflow truncation. Simultaneously, it can fully utilize the display device's peak brightness to brighten high-brightness images in small local areas of the HDR source material, displaying more high-brightness image details and achieving a more vivid HDR display effect. The implementation method of this application comprises five main parts: brightness mapping, peak brightness detection, brightness enhancement, intra-frame and inter-frame filtering, and color gamut mapping. It boasts advantages such as simple structure, low resource consumption, simple algorithm, and ease of FPGA integration. This implementation method can achieve content adaptation based on the brightness adjustment curve, enabling the video wall controller to support HDR PEAK functionality. This fully utilizes the peak brightness of the video wall controller, enhancing the detail and brightness of the displayed image. It is suitable for MLED display video wall controllers and other applications requiring HDR image quality enhancement, such as other display devices that need to fully utilize peak brightness to improve image contrast, color performance, and visual impact. The implementation method of this application effectively utilizes the screen's peak brightness, offering advantages such as low resource consumption and high dynamic range.

[0119] It should be noted that the above embodiments are illustrative of this application and not restrictive, and those skilled in the art can design alternative embodiments without departing from the scope of the appended claims. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application, and they should all be covered within the scope of the claims and specification of this application. In particular, as long as there is no structural conflict, the various technical features mentioned in the various embodiments can be combined in any way.

[0120] In the claims, any reference signs placed between parentheses should not be construed as limiting the claims. The word "comprising" does not exclude the presence of devices or steps not listed in the claims. The word "a" or "an" preceding a device does not exclude the presence of a plurality of such devices. This application can be implemented by means of hardware comprising several different devices and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third, etc., does not indicate any order. These words can be interpreted as names.

[0121] The above are merely preferred embodiments of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for displaying high dynamic range data, characterized in that, include: Brightness mapping is performed on at least one frame of the target image in the high dynamic range data to obtain the brightness mapping result of the target image; Based on the brightness mapping result, brightness feature information, brightness peak area and brightness enhancement threshold are determined, and the brightness adjustment curve of the target image is determined based on the brightness enhancement threshold; The first brightness enhancement coefficient of the pixels in the target image is determined based on the brightness adjustment curve; The pixels in the target image are filtered according to the first brightness enhancement coefficient to obtain the second brightness enhancement coefficient; The brightness of each pixel in the target image is increased according to the second brightness enhancement coefficient to obtain an absolute brightness value for displaying the target image.

2. The method according to claim 1, characterized in that, The step of determining brightness feature information, brightness peak area, and brightness enhancement threshold based on the brightness mapping result, and determining the brightness adjustment curve of the target image based on the brightness enhancement threshold, includes: Based on the brightness mapping results, determine the brightness feature information, the brightness peak area, and the brightness enhancement threshold; The first slope is determined based on the coordinates of the left and right endpoints; wherein, the x-coordinate of the left endpoint is determined based on the brightness enhancement threshold, and the y-coordinate is determined based on the brightness enhancement threshold and the brightness enhancement value; the x-coordinate of the right endpoint is determined based on the maximum brightness value of the display device, and the y-coordinate is determined based on the peak brightness value of the display device; the brightness enhancement value is determined based on the maximum brightness value of the display device and the brightness enhancement threshold. The first endpoint slope coefficient and the second endpoint slope coefficient are determined based on the maximum brightness value and the peak brightness value of the display device, as well as the coordinates of the left endpoint and the right endpoint; A brightness adjustment curve is determined based on the first slope, the coordinates of the left endpoint, the slope coefficient of the first endpoint, and the slope coefficient of the second endpoint, wherein the brightness adjustment curve includes: a first brightness adjustment curve coefficient, a second brightness adjustment curve coefficient, a third brightness adjustment curve coefficient, and a fourth brightness adjustment curve coefficient.

3. The method according to claim 2, characterized in that, The step of determining the brightness feature information, the brightness peak region, and the brightness enhancement threshold based on the brightness mapping result includes: Based on the brightness mapping result, the brightness information of each pixel in the target image is determined, and brightness feature information is obtained; The brightness mapping results are statistically analyzed based on the brightness of the pixels from high to low to obtain a statistical result of the number of pixels sorted by brightness. The number of pixels in the statistical results is summed from high to low brightness until the summation is greater than the number of pixels with the maximum peak brightness, thus obtaining a first brightness threshold; wherein, the number of pixels with the maximum peak brightness is determined based on the resolution and a preset peak brightness area ratio; The brightness value of each partition is determined based on the preset partition information and the brightness feature information, and the partition with the largest brightness value is taken as the second brightness threshold. The brightness enhancement threshold and the brightness peak region are determined based on the first brightness threshold and the second brightness threshold; wherein, the location of all pixels whose brightness is greater than the brightness enhancement threshold is the brightness peak region.

4. The method according to claim 2, characterized in that, The step of determining the first brightness enhancement coefficient of the pixels in the target image based on the brightness adjustment curve includes... If the brightness feature information of the pixel is greater than or equal to the brightness enhancement threshold, and the pixel is located in the brightness peak region, a first brightness enhancement coefficient of the pixel is determined according to the brightness adjustment curve and the brightness feature information. If the brightness feature information of a pixel is less than the brightness enhancement threshold and the pixel is not located in the brightness peak region, a first brightness enhancement coefficient of the pixel is determined based on the brightness enhancement value and the brightness feature information.

5. The method according to claim 1, characterized in that, The step of filtering the pixels in the target image according to the first brightness enhancement coefficient to obtain the second brightness enhancement coefficient includes: According to the preset brightness mode, intra-frame filtering is performed on the pixel to obtain the third brightness enhancement coefficient of the pixel; Based on the stored brightness enhancement coefficient of the previous frame and the third brightness enhancement coefficient, the target image is subjected to inter-frame filtering pixel by pixel to obtain the second brightness enhancement coefficient.

6. The method according to claim 1, characterized in that, The step of increasing the brightness of each pixel in the target image according to the second brightness enhancement coefficient to obtain an absolute brightness value for displaying the target image includes: The brightness of each pixel in the target image is increased according to the second brightness enhancement coefficient using the following calculation method to obtain the absolute brightness value used to display the target image: Where TMOFusionImage(i,j) represents the absolute brightness value, (i,j) represents the pixel position, and vFUnc result(i,j) TMOMaxImage represents the second brightness enhancement coefficient, and TMOMaxImage represents brightness feature information.

7. The method according to claim 1, characterized in that, After increasing the brightness of each pixel in the target image according to the second brightness enhancement coefficient to obtain an absolute brightness value for displaying the target image, the method further includes: Perform color gamut mapping on the absolute brightness value to obtain the color gamut mapping result; Based on the color gamut mapping results and the photoelectric conversion table, the electrical signal used for display is determined.

8. The method according to claim 7, characterized in that, Before determining the electrical signal for display based on the color gamut mapping result and the photoelectric conversion table, the method further includes: The value of the electrical signal used for display is determined based on the color gamut mapping result; Record the color gamut mapping results and the corresponding electrical signal values ​​to determine the photoelectric conversion table.

9. The method according to claim 8, characterized in that, The step of determining the electrical signal for display based on the color gamut mapping result includes: The color gamut mapping result is expanded by performing an expansion operation on the result as follows: Wherein, RGBfixed represents the extended bit mapping result, RGB output This represents the color gamut mapping result, where n represents the extension value; The electrical signal used for display is determined based on the transfer function of the display device and the extended mapping result.

10. A device for displaying high dynamic range data, characterized in that, include: A brightness mapping module is used to perform brightness mapping on at least one frame of a target image in high dynamic range data to obtain the brightness mapping result of the target image; The brightness adjustment curve determination module is used to determine brightness feature information, brightness peak area and brightness enhancement threshold according to the brightness mapping result, and to determine the brightness adjustment curve coefficient of the target image according to the brightness enhancement threshold; A coefficient determination module is used to determine a first brightness enhancement coefficient of pixels in the target image based on the brightness adjustment curve. The filtering module is used to filter the pixels in the target image according to the first brightness enhancement coefficient to obtain the second brightness enhancement coefficient; A brightness enhancement module is used to enhance the brightness of each pixel in the target image according to the second brightness enhancement coefficient, so as to obtain an absolute brightness value for displaying the target image.

11. An electronic device, comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, when the processor executes the computer program, it implements the method for displaying high dynamic range data as described in any one of claims 1-9.

12. A computer-readable storage medium, characterized in that, It stores computer-readable instructions that can be executed by a processor to implement the method for displaying high dynamic range data as described in any one of claims 1-9.

13. A display module, comprising: The display panel is characterized by further comprising the electronic device as described in claim 11.

Images