Method and device for displaying high dynamic range data, equipment, medium and module

Abstract

The invention relates to the technical field of display, and discloses a method and device for displaying high dynamic range data, equipment, a medium and a module, and the method comprises the steps: carrying out the brightness mapping of at least one frame of target image in the high dynamic range data, and obtaining a brightness mapping result of the target image; determining brightness feature information, a brightness peak region and a brightness improvement threshold according to the brightness mapping result, and determining a brightness adjustment curve coefficient of the target image according to the brightness improvement threshold; determining a first brightness improvement coefficient of pixels in the target image according to the brightness adjustment curve; filtering pixels in the target image according to the first brightness improvement coefficient to obtain a second brightness improvement coefficient; and improving the brightness of each pixel in the target image according to the second brightness improvement coefficient to obtain an absolute brightness value for displaying the target image. The absolute brightness value used for displaying the target image is finally determined by determining the brightness adjustment curve and filtering, and picture details which can be displayed when the device displays the HDR video can be improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of display, in particular to a method, device, equipment, medium and module for displaying high dynamic range data. BACKGROUND

[0002] Glass-based Micro Light Emitting Diode (Micro LED) splicing display product is a Micro LED display technology using a glass substrate as a backboard, which has advantages such as high brightness, high contrast, seamless splicing, and is suitable for high-end commercial display, home theater, command and control, etc. The brightness of the display includes peak brightness and typical brightness. The peak brightness is the highest limit brightness supported by the screen in a short time, and the peak brightness cannot last too long, otherwise the screen will be burned. The peak brightness of the display is usually measured in nits. The typical brightness is the safe brightness range that the screen can display for a long time without burning the screen, which is measured by the continuous brightness under full-screen white or standard color.

[0003] High Dynamic Range (HDR) is an image or video processing technology that aims to expand the brightness range, so that the picture can simultaneously present brighter bright parts and darker dark part details, so as to be closer to the real world seen by the human eye.

[0004] The picture is usually divided into high-light parts and non-high-light parts, such as light, sun, etc. The high-light part needs to be presented by the ability of peak brightness, so the high peak brightness of the display is beneficial to improve the dynamic range. For display devices that focus on extreme picture quality, it is absolutely essential to achieve higher peak brightness. However, in the HDR video, the peak brightness of the film source made based on the perceptual quantization PQ (ST2084) curve is 10000 nits, which is much higher than the peak brightness and typical brightness of general display. The peak brightness of the display cannot last too long, otherwise it will cause screen burn, which makes it difficult for the picture details of the HDR video to be presented by the existing display, resulting in loss of details. SUMMARY

[0005] The present application provides a method, device, equipment, medium and module for displaying high dynamic range data, which can improve the picture details that the display device can present when displaying HDR video.

[0006] In a first aspect, the present application provides a method for displaying high dynamic range data, comprising: mapping luminance of at least one target image in high dynamic range data to obtain a luminance mapping result of the target image; determining luminance feature information, a luminance peak area and a luminance boosting threshold according to the luminance mapping result, and determining a luminance adjustment curve coefficient of the target image according to the luminance boosting threshold; determining a first luminance boosting coefficient of a pixel in the target image according to the luminance adjustment curve; filtering the pixel in the target image according to the first luminance boosting coefficient to obtain a second luminance boosting coefficient; boosting luminance of each pixel in the target image according to the second luminance boosting coefficient to obtain an absolute luminance value for displaying the target image.

[0007] In some embodiments, the determining luminance feature information, a luminance peak area and a luminance boosting threshold according to the luminance mapping result, and determining a luminance adjustment curve of the target image according to the luminance boosting threshold comprises: determining luminance feature information, a luminance peak area and the luminance boosting threshold according to the luminance mapping result; determining a first slope according to a left end point coordinate and a right end point coordinate; wherein an abscissa of the left end point is determined according to the luminance boosting threshold, an ordinate of the left end point is determined according to the luminance boosting threshold and a luminance boosting value, an abscissa of the right end point is determined according to a maximum luminance value of a display device, and an ordinate of the right end point is determined according to a peak luminance value of the display device, the luminance boosting value is determined according to the maximum luminance value of the display device and the luminance boosting threshold; determining a first end point slope coefficient and a second end point slope coefficient according to the maximum luminance value and the peak luminance value of the display device and the left end point coordinate and the right end point coordinate; determining a luminance adjustment curve according to the first slope, the left end point coordinate, the first end point slope coefficient and the second end point slope coefficient, wherein the luminance adjustment curve comprises a first luminance adjustment curve coefficient, a second luminance adjustment curve coefficient, a third luminance adjustment curve coefficient and a fourth luminance adjustment curve coefficient.

[0008] In some embodiments, the determining luminance feature information, a luminance peak area and the luminance boosting threshold according to the luminance mapping result comprises: determining luminance information of each pixel in the target image according to the luminance mapping result to obtain luminance feature information; statistically analyzing the luminance mapping result according to luminance from high to low to obtain a statistical result of the number of pixels according to luminance sorting; Sum the number of pixels in the statistical result from high to low according to the brightness of the pixels until the sum result is greater than the maximum peak brightness pixel number, to obtain a first brightness threshold; wherein the maximum peak brightness pixel number is determined according to the resolution and a preset peak brightness area proportion; Determine the partition brightness value of each partition according to the preset partition information and the brightness feature information, and take the maximum partition brightness value as a second brightness threshold; Determine the brightness enhancement threshold and the brightness peak area according to the first brightness threshold and the second brightness threshold; wherein the positions of all the pixels with brightness greater than the brightness enhancement threshold are the brightness peak area.

[0009] In some embodiments, the determining, according to the brightness adjustment curve, the first brightness enhancement coefficient of the pixel in the target image comprises In the case that the brightness feature information of the pixel is greater than or equal to the brightness enhancement threshold and the pixel is located in the brightness peak area, determining, according to the brightness adjustment curve and the brightness feature information, the first brightness enhancement coefficient of the pixel; In the case that the brightness feature information of the pixel is less than the brightness enhancement threshold and the pixel is not located in the brightness peak area, determining, according to the brightness enhancement value and the brightness feature information, the first brightness enhancement coefficient of the pixel; wherein the brightness enhancement value is determined according to the maximum brightness value of the display device and the brightness enhancement threshold.

[0010] In some embodiments, the filtering, according to the first brightness enhancement coefficient, the pixel in the target image to obtain a second brightness enhancement coefficient comprises: According to a preset brightness mode, performing intra-frame filtering on the pixel to obtain a third brightness enhancement coefficient of the pixel; According to the stored brightness enhancement coefficient of the previous frame and the third brightness enhancement coefficient, performing inter-frame filtering on the target image pixel by pixel to obtain a second brightness enhancement coefficient.

[0011] In some embodiments, the enhancing, according to the second brightness enhancement coefficient, the brightness of each pixel in the target image to obtain an absolute brightness value for displaying the target image comprises: Enhancing, according to the second brightness enhancement coefficient, the brightness of each pixel in the target image to obtain an absolute brightness value for displaying the target image by the following calculation method:

[0012] Wherein, TMOFusionImage(i,j) represents the absolute brightness value, (i,j) represents the position of the pixel, vFUnc result(i,j)TMOMaxImage represents the luminance feature information.

[0013] In some embodiments, after the luminance of each pixel in the target image is boosted according to the second luminance boosting coefficient to obtain an absolute luminance value for displaying the target image, the method further comprises: color gamut mapping the absolute luminance value to obtain a color gamut mapping result; determining an electric signal for display according to the color gamut mapping result and an opto-electric conversion table.

[0014] In some embodiments, before the electric signal for display is determined according to the color gamut mapping result and the opto-electric conversion table, the method further comprises: determining a value of the electric signal for display according to the color gamut mapping result; recording the color gamut mapping result and the value of the electric signal corresponding thereto to determine the opto-electric conversion table.

[0015] In some embodiments, the determining the electric signal for display according to the mapping result comprises: performing a bit extension operation on the color gamut mapping result to obtain a bit-extended mapping result by:

[0016] wherein RGBfixed represents the bit-extended mapping result, RGB output represents the color gamut mapping result, and n represents a bit extension value; determining the electric signal for display according to a transfer function of a display device and the bit-extended mapping result.

[0017] In a second aspect, the present application further provides a device for displaying high dynamic range data, comprising: a luminance mapping module configured to perform luminance mapping on at least one target image in high dynamic range data to obtain a luminance mapping result of the target image; a luminance adjustment curve determining module configured to determine luminance feature information, a luminance peak region and a luminance boosting threshold according to the luminance mapping result, and determine a luminance adjustment curve coefficient of the target image according to the luminance boosting threshold; a coefficient determining module configured to determine a first luminance boosting coefficient of a pixel in the target image according to the luminance adjustment curve; a filtering module configured to filter the pixel in the target image according to the first luminance boosting coefficient to obtain a second luminance boosting coefficient; a luminance boosting module configured to boost luminance of each pixel in the target image according to the second luminance boosting coefficient to obtain an absolute luminance value for displaying the target image.

[0018] In a third aspect, the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method for displaying high dynamic range data according to any one of the first aspect when executing the computer program.

[0019] In a fourth aspect, the present application provides a computer readable storage medium having computer readable instructions stored thereon, wherein the computer readable instructions are executable by a processor to implement the method for displaying high dynamic range data according to any one of the first aspect.

[0020] In a fifth aspect, the present application provides a display module, comprising a display panel, and further comprising the electronic device according to the third aspect.

[0021] The present application has the advantages that: the luminance peak value region and the luminance boosting threshold are determined according to the luminance mapping result, the luminance adjustment curve of the target image is determined according to the luminance boosting threshold, then the luminance of the pixels of the target image in the high dynamic range data is boosted according to the luminance adjustment curve, the luminance of the target image in the high dynamic range data is more finely corresponded to the luminance of the display device, more fine and rich luminance mapping is achieved, and more high dynamic range picture details can be exhibited; the pixels in the target image are filtered according to the first luminance boosting coefficient to obtain the second luminance boosting coefficient, which can avoid the influence of the luminance of the pixels boosted by the luminance boosting coefficient on the picture details and the adverse influence on the display device; the luminance of each pixel in the target image is boosted according to the second luminance boosting coefficient to obtain the absolute luminance value for displaying the target image, which can exhibit more high dynamic range picture details without exceeding the peak luminance of the display and the display time of the peak luminance, and can also avoid the risk of screen burn-in. BRIEF DESCRIPTION OF DRAWINGS

[0022] Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The accompanying drawings are included to provide a description of the preferred embodiments and are not intended to limit the scope of the present application. Moreover, the same reference numerals in different figures represent the same or similar components. In the drawings: Figure 1 is a schematic diagram of the steps of the method for displaying high dynamic range data provided by the present application; Figure 2 is a schematic diagram of the flow of the method for displaying high dynamic range data provided by the present application; Figure 3 is a schematic diagram of a luminance adjustment curve of a method for displaying high dynamic range data provided by the present application; Figure 4A is a schematic diagram of a target image without luminance enhancement of a method for displaying high dynamic range data provided by the present application; Figure 4B is a schematic diagram of a target image with luminance enhancement of a method for displaying high dynamic range data provided by the present application; Figure 5A is a schematic diagram of another target image without luminance enhancement of a method for displaying high dynamic range data provided by the present application; Figure 5B is a schematic diagram of another target image with luminance enhancement of a method for displaying high dynamic range data provided by the present application; Figure 6 is a schematic diagram of an apparatus for displaying high dynamic range data provided by the present application; Figure 7 is a schematic diagram of another apparatus for displaying high dynamic range data provided by the present application. DETAILED DESCRIPTION

[0023] Exemplary embodiments of the present disclosure will be described in detail with reference to the drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that the present disclosure can be more thoroughly understood and the scope of the present disclosure can be accurately conveyed to those skilled in the art. It should be noted that, unless otherwise specified, the technical terms or scientific terms used in the present application should be understood in their usual meanings by those skilled in the art to which the present application belongs.

[0024] To solve some problems in the related art, the present disclosure provides a method, apparatus, device, medium and module for displaying high dynamic range data, which will be described in detail below through specific embodiments.

[0025] Embodiment One As shown in FIG. 1, a schematic diagram of a method for displaying high dynamic range data provided by the present embodiment is shown, which includes steps S100-S500. Figure 1

[0026] Step S100, performing luminance mapping on at least one frame of target image in the high dynamic range data to obtain a luminance mapping result of the target image.

[0027] ​The high dynamic range data includes video data of an HDR video source. By extracting a frame image to be processed as a target image from the high dynamic range data, luminance mapping is performed to obtain a luminance mapping result of the target image.

[0028] By performing luminance mapping on at least one target image in the high dynamic range data, the luminance and color gamut of the target frame image can be adapted to a display device for display, such as a screen for displaying the high dynamic range data.

[0029] The luminance of high dynamic range data (such as an HDR video) is generally distributed between 0.001-10000 nits, and the luminance of a display device such as an indoor display screen is generally in the range of 500-1500 nits. The peak luminance of a video source made based on a PQ (ST2084) curve is 10000 nits, and the peak luminance of a video source made based on an HLG curve is 2000 nits. If the display device does not have special processing for the video source, there will be an overflow phenomenon, resulting in loss of high-light details. Therefore, it is necessary to convert the content from the luminance range of the master to the luminance range of the target display device, so as to maximize the preservation of the visual intent of the creator.

[0030] In step S200, the luminance feature information, the luminance peak region, and the luminance boost threshold are determined according to the luminance mapping result, and the luminance adjustment curve of the target image is determined according to the luminance boost threshold.

[0031] Since Micro LED has the property of self-emission, each pixel can emit light independently, and a small area (<A% screen) can burst out super high luminance. Although the high dynamic data video source after luminance mapping can accurately adapt to the maximum luminance of the display device, it does not necessarily adapt to the super high luminance range that can be burst out by a small area. Therefore, it is necessary to further boost the luminance of the high-light part in the target image according to the screen area of the display device and the picture luminance features (such as the luminance feature information) in the target image, so that the high-light picture has more luminance range to display picture details.

[0032] According to the luminance mapping result, the luminance peak region and the luminance boost threshold are determined, which can determine the region that needs to be boosted in luminance according to the peak luminance of the display device according to the luminance distribution of each target image. According to the luminance distribution of the target image, a luminance boost threshold T is determined for each target image, so as to determine the luminance adjustment curve, and obtain a luminance adjustment curve. The obtained luminance adjustment curve can more finely correspond the luminance of the target image in the high dynamic range data to the luminance of the display device, so that the display device can display more picture details in the target image.

[0033] In step S300, the first luminance boost coefficient of the pixels in the target image is determined according to the luminance adjustment curve.

[0034] According to the luminance adjustment curve, the original luminance of the target image is enhanced, and the dynamic range of the target image can be effectively improved.

[0035] In step S400, the first luminance enhancement coefficient is used to filter the pixels in the target image, and the second luminance enhancement coefficient is obtained.

[0036] By filtering the pixels in the target image, the first luminance enhancement coefficient is adjusted to obtain the second luminance enhancement coefficient, which can effectively avoid the influence of the luminance of the pixels enhanced by the luminance enhancement coefficient being too high on the picture details and the adverse effects on the display device.

[0037] In step S500, the luminance of each pixel in the target image is enhanced according to the second luminance enhancement coefficient, and the absolute luminance value for displaying the target image is obtained.

[0038] According to the second luminance enhancement coefficient, the luminance of each pixel in the target image is enhanced, and the absolute luminance value for displaying the target image is obtained, which can display more high dynamic range picture details without exceeding the peak luminance of the display and the peak luminance display time, and can also avoid the risk of screen burn-in.

[0039] As shown in Figure 2 In the embodiments of the present application, the luminance of at least one frame of target image in high dynamic range data is mapped to obtain the luminance mapping result of the target image, which includes: according to the preset standard, the luminance of the target image is mapped into the preset luminance range frame by frame to obtain the luminance mapping result of the target image.

[0040] The preset standard includes ITU-R BT.2100 standard; the preset luminance range includes the typical luminance range of the screen. Based on the ITU-R BT.2100 standard, the luminance of the target image in the high dynamic range data can be mapped into the range of the typical luminance of the screen frame by frame. For a frame of target image, the RGB channel value is normalized pixel by pixel, and the luminance of each color channel is mapped according to the preset standard to obtain the preprocessed data. After the preprocessed data is de-normalized, the linear optical signal is converted into a display signal using an EOTF lookup table to obtain the luminance mapping result of the target image, which is recorded as TMOImage. The calculation method is as follows: For the target image in the HDR film source using static metadata, the luminance adjustment curve of BT.2390 standard can be used to record the minimum luminance L min , the maximum luminance L max , read the master display white field luminance L w and the master display black field luminance L BmaxLum = (PQEOTF [L] - PQEOTF [L]) / PQEOTF [L] - PQEOTF [L]) where PQ is the perceptual quantization curve, belonging to the absolute luminance system, and EOTF is the electro-optical transfer function of the display device. This curve is an international standard, defined in ITU-R BT.2100. minLum = (PQEOTF [L] - PQEOTF [L]) / PQEOTF [L] - PQEOTF [L]) -1 [L min ]-PQEOTF -1 [L B ] / PQEOTF -1 [L w ]-PQEOTF -1 [L B ]) maxLum = (PQEOTF [L] - PQEOTF [L]) / PQEOTF [L] - PQEOTF [L]) -1 [L max ]-PQEOTF -1 [L B ] / PQEOTF -1 [L w ]-PQEOTF -1 [L B ]) where PQ is the perceptual quantization curve, belonging to the absolute luminance system, and EOTF is the electro-optical transfer function of the display device. This curve is an international standard, defined in ITU-R BT.2100.

[0041] Then, the luminance mapping inflection point is determined according to the luminance maximum normalized value, i.e. the luminance mapping inflection point threshold KS is calculated:

[0042] Then, the gray scale value is mapped by EETF curve pixel by pixel and RGB channel by RGB channel: E1 = (E’ - PQEOTF [L]) / (PQEOTF [L] - PQEOTF [L]) -1 [L B ]) / (PQEOTF -1 [L w ] - PQEOTF [L]) -1 [L B ]) E2 = E1 for E1 < KS E2 = P [E1] for KS≤E1≤1 E3 = E2 + minLum(1 - E2) 4

[0043] wherein, E1, E2 and E3 are intermediate values, E4 is the luminance mapping result, denoted as TMOImage. P represents the mapping relationship, and the calculation of E1, E2, E3 and E4 is calculated by RGB channel, and the value of three channels E4 is denoted as the luminance mapping result TMOImage. The luminance mapping result TMOImage represents the physical luminance value of each pixel, which can be image data.

[0044] Since the luminance range (such as 0.05 nit-4000 nit) of the target image in the HDR film source calculated by the EOTF may not match the luminance range (such as 0.05 nit-1000 nit) of the actual display device. Through E1, E2, E3 and E4, the luminance range of the high dynamic range data film source can be compressed or boosted to the luminance range of the display device, that is, between the minimum luminance and the typical luminance of the display device.

[0045] For high dynamic range data that is an SDR film source, tone mapping needs to be performed frame by frame to map the luminance to the range supported by the display. According to the BT2446 standard, the SDR film source luminance in the target image can be mapped to the luminance range of the display device to obtain the luminance mapping result of the target image.

[0046] As shown in FIG. 2, Figure 2 In one embodiment, the luminance feature information, the luminance peak area and the luminance boost threshold are determined according to the luminance mapping result, and the luminance adjustment curve of the target image is determined according to the luminance boost threshold, including steps S210-S240.

[0047] S210, determining the luminance feature information, the luminance peak area and the luminance boost threshold according to the luminance mapping result.

[0048] S220, determining the first slope according to the left end point coordinate and the right end point coordinate; wherein, the horizontal coordinate of the left end point is determined according to the luminance boost threshold, the vertical coordinate is determined according to the luminance boost threshold and the luminance boost value, the horizontal coordinate of the right end point is determined according to the maximum luminance value of the display device, and the vertical coordinate is determined according to the peak luminance value of the display device. The luminance boost value is determined according to the maximum luminance value of the display device and the luminance boost threshold.

[0049] In order to facilitate FPGA integration, the luminance adjustment curve in the embodiment of the present application represents the luminance boost ratio or luminance boost coefficient corresponding to each luminance, which is the overall value after boosting, not only the value of the boosted part. By counting the maximum luminance and minimum luminance of the target image, it can be determined whether the target image is a pure color image. For the target image that is a pure color image, no curve mapping is performed, that is, no processing is performed using the embodiment of the present application.

[0050] The left end point and the right end point are both used to establish the luminance adjustment curve. As shown in FIG. 3, Figure 3As shown, the left end point of the brightness adjustment curve has a horizontal coordinate of the brightness boost threshold T, and a right end point has a horizontal coordinate of a typical brightness value of the screen, where the maximum brightness value MAX_brightness is used, and a vertical coordinate of a peak brightness value of the screen, where the peak brightness value PEAK_brightness is used. To ensure continuity of the curve, the vertical coordinate of the left end point is the original brightness value (brightness boost threshold T) + brightness boost value kup, i.e. T+kup. Denote the left end point coordinates as (x0, y0), and the right end point coordinates as (x1, y1). That is, the value of x0 is the brightness boost threshold T, the value of y0 is the sum of the brightness boost threshold T and the brightness boost value kup, the value of x1 is the maximum brightness value MAX_brightness, and the value of y1 is the peak brightness value PEAK_brightness. Wherein, as shown in the figure, Figure 3 As shown, the left end point is the intersection of the two curves, and the right end point is the maximum value of the curve on the right side of the vertical coordinate.

[0051] Denote the horizontal coordinate change amount dx = x1-x0, and the vertical coordinate change amount dy = y1-y0, and the first slope delta = dx / dy.

[0052] S230, determining a first end point slope coefficient and a second end point slope coefficient according to the maximum brightness value and the peak brightness value of the display device, and the left end point coordinates and the right end point coordinates; Determine the curve coefficient, set the end point slope coefficient s1 (the first end point slope coefficient) and s0 (the second end point slope coefficient) according to the maximum brightness value MAX_brightness and the peak brightness value PEAK_brightness. A high-degree polynomial curve can be constructed between two points by using a cubic spline interpolation method, and the calculation is solved. That is, s0=y'(x0), s1=y'(x1). When the brightness feature information TMOMaxImage(i,j) of the pixel is less than the brightness boost threshold T, the brightness adjustment curve boosts the brightness of this pixel to the range of (0, y0+kup), i.e. the blue curve position in the image. Wherein, y0+kup will not exceed MAX_brightness. The horizontal coordinate represents the brightness value before boosting, and the vertical coordinate represents the brightness value after boosting. When the brightness feature information TMOMaxImage(i,j) of the pixel is greater than or equal to the brightness boost threshold T, the brightness adjustment curve boosts the brightness of this pixel to (T, PEAK_brighness), i.e. the red curve position in the image.

[0053] S240, determining a brightness adjustment curve according to the first slope, the left end point coordinates, the first end point slope coefficient and the second end point slope coefficient, wherein the brightness adjustment curve comprises: a first brightness adjustment curve coefficient a, a second brightness adjustment curve coefficient b, a third brightness adjustment curve coefficient c and a fourth brightness adjustment curve coefficient d. The four brightness adjustment curve coefficients are determined in the following manner: a = f(s1, s0, delta), b = f(s1, s0, delta), c = f(s1), d = f(y0) In one embodiment, determining the brightness feature information, the brightness peak area and the brightness promotion threshold according to the brightness mapping result comprises steps S211-S215.

[0054] In step S211, the brightness information of each pixel in the target image is determined according to the brightness mapping result, and the brightness feature information is obtained.

[0055] In step S211, the brightness information of each pixel in the target image is determined according to the brightness mapping result, and the brightness feature information is obtained.

[0056] The brightness feature of the brightness mapping result TMOImage is calculated pixel by pixel, and the brightness information of each pixel is obtained, denoted as TMOMaxImage. Each pixel includes a brightness mapping result TMOImage(i,j), where i represents the vertical coordinate of the pixel and j represents the horizontal coordinate of the pixel. The brightness information of each pixel can be directly determined by taking the maximum value of the three channels, i.e. TMOMaxImage = max(R,G,B), or the weighted brightness value of each pixel can be taken as the brightness information according to a preset weighting coefficient, i.e. ; where R is the brightness value of the red channel, G is the brightness value of the green channel, and B is the brightness value of the blue channel. The brightness feature information of all pixels in the target image is finally obtained.

[0057] In step S212, the brightness mapping result is counted according to the brightness from high to low, and the counting result of the number of pixels sorted according to the brightness is obtained.

[0058] The determination of the PEAK (brightness peak) range is strongly related to the area of the PEAK area (brightness peak area), which is determined by the basic performance of the display device, so the brightness peak area detection (as shown in Figure 2 ) needs to be performed. Taking the screen resolution of the display device as , for example, the maximum area ratio of the screen peak brightness is set as A, and the number of single-frame Peak pixels (pixels that can display peak brightness) is calculated according to the screen resolution , which is the maximum peak luminance pixel quantity. The histogram statistics of the luminance mapping result TMOImage are performed to obtain the statistics of the pixel quantity according to the luminance from high to low.

[0059] In step S213, the pixel quantity in the statistics is summed according to the luminance of the pixel from high to low until the sum is greater than the maximum peak luminance pixel quantity, to obtain a first luminance threshold; wherein the maximum peak luminance pixel quantity is determined according to the resolution and the preset peak luminance area proportion.

[0060] The pixel quantity is summed from high to low from the total quantity of the highest luminance pixel to obtain a sum result SumMax of the total quantity of the pixel until the sum result SumMax is greater than the maximum peak luminance pixel quantity maxImageO. The luminance of the lowest pixel corresponding to the pixel in the sum result at this time is taken as the first luminance threshold T1 to obtain the luminance threshold for the peak luminance area.

[0061] The following specifically describes the sum of the pixel quantity in the statistics according to the luminance of the pixel from high to low until the sum is greater than the maximum peak luminance pixel quantity to obtain the first luminance threshold in the embodiment of the application.

[0062] Taking the maximum peak luminance pixel quantity maxImageO as 160 for example, assuming that after the luminance of the pixel is sorted from high to low, luminance 1 has 20 pixels, luminance 2 has 40 pixels, luminance 3 has 60 pixels, luminance 4 has 30 pixels, luminance 5 has 50 pixels, and luminance 6 has 10 pixels, wherein the luminance values of luminance 1, luminance 2, luminance 3, luminance 4 and luminance 5 are in the order of luminance 1 greater than luminance 2 greater than luminance 3 greater than luminance 4 greater than luminance 5 from high to low. The pixel quantity is summed from high to low from the 20 pixels of luminance 1 with the highest luminance value, that is, the sum of the pixels of luminance 1 and luminance 2 is 20+40=60, which is less than the maximum peak luminance pixel quantity 160, so the sum is further performed with the pixels of luminance 3 to obtain 120, which is still less than the maximum peak luminance pixel quantity 160, and the sum is further performed with the pixels of luminance 4 to obtain 150, which is less than the maximum peak luminance pixel quantity 160, and the sum is further performed with the pixels of luminance 5 to obtain 210, which is greater than the maximum peak luminance pixel quantity 160, so the luminance value of luminance 5 at this time is the first luminance threshold.

[0063] In step S214, the partition luminance value of each partition is determined according to the preset partition information and the luminance feature information, and the maximum partition luminance value is taken as a second luminance threshold T2. According to the screen distribution of the touch control device, the partition luminance value of the screen can be counted screen by screen, and the number of partitions is denoted as N. If the number of pixels of the single screen is large, the single screen can be further partitioned according to the area corresponding to the peak luminance, and the number of partitions is denoted as wherein k1 and k2 are both the number of single-screen one-way partitioning. For LCD and MiniLED partitioning light control products, the partition luminance value can be counted according to the actual partitioning situation. There are many methods for extracting the partition luminance feature, including mean method, root mean square method, error correction method, maximum value method, etc. The appropriate algorithm can be selected according to actual needs.

[0064] The mean method calculates the average value V ave of all pixel absolute luminance values in the partition as the luminance value of the partition; The maximum value method selects the maximum value Vmax as the luminance value of the partition by traversing all luminance values in the partition; The error correction method adjusts the luminance value by using a correction coefficient correction:

[0065] wherein Diff represents the difference between the maximum and minimum values of the pixel luminance values in the partition, n represents the gray level, and the average value of all pixel luminance values in the partition plus the correction coefficient correction is the final luminance value of the partition; The N times average value method first calculates the average value V ave and the maximum value Vmax of all pixel luminance values in the single partition, sets the average value multiple as N, and sets the weighted weight coefficient as W. The luminance value T' of the partition is calculated as: T' = W × Vmax + (1-W) × N × V ave If the obtained partition luminance value T' is greater than the maximum luminance value of the screen, such as 1000 nits, the luminance value of the partition is 1000. The maximum partition luminance value of the image is counted as the second luminance threshold T2, and the luminance threshold for partition luminance is obtained. A minimum luminance threshold T2min can be set, and when the second luminance threshold T2 is lower than the minimum luminance threshold T2min, the minimum luminance threshold T2min is used as the second luminance threshold T2.

[0066] In step S215, the luminance promotion threshold and the luminance peak area are determined according to the first luminance threshold and the second luminance threshold. The positions of all pixels with luminance greater than the luminance promotion threshold are the luminance peak area.

[0067] The maximum value of the first luminance threshold T1 and the second luminance threshold T2 is the luminance promotion threshold T of the target image of the frame, i.e. T = max(T1, T2). The second luminance threshold T2 is more in line with the luminance characteristics of the image, while the first luminance threshold T1 can ensure that the luminance peak area does not exceed the maximum load capacity of the screen of the display device. In an embodiment, the first luminance promotion coefficient of the pixel in the target image is determined according to the luminance adjustment curve, including: in the case that the luminance characteristic information of the pixel is greater than or equal to the luminance promotion threshold and the pixel is located in the luminance peak area, the first luminance promotion coefficient of the pixel is determined according to the luminance adjustment curve and the luminance characteristic information; in the case that the luminance characteristic information of the pixel is less than the luminance promotion threshold and the pixel is not located in the luminance peak area, the first luminance promotion coefficient of the pixel is determined according to the luminance promotion value and the luminance characteristic information; wherein the luminance promotion value is determined according to the maximum luminance value of the display device and the luminance promotion threshold.

[0068] In the embodiments of the present application, the luminance promotion threshold represents the maximum value that each pixel can reach after promotion, which is the overall value after promotion, not only the threshold value of the part of the value that can be promoted.

[0069] As shown in Figure 2 In the embodiments of the present application, the first luminance promotion coefficient vFunc is obtained by calculating the luminance promotion coefficient pixel by pixel. Since in the case that the pixel luminance characteristic value TMOMaxImage is greater than or equal to the luminance promotion threshold T, the pixel is located in the luminance peak area (PEAK area), and in the case that the pixel luminance characteristic value TMOMaxImage is less than the luminance promotion threshold T, the pixel is located in the non-luminance peak area (non-PEAK area), therefore the embodiments of the present application only further describe the acquisition of the first luminance promotion coefficient vFunc in the above two cases.

[0070] In the case that the pixel luminance characteristic value TMOMaxImage is greater than or equal to the luminance promotion threshold T and the pixel is located in the luminance peak area (PEAK area), the luminance of the pixel needs to be greatly promoted, and the first luminance promotion coefficient vFunc is determined by the following way: vFunc = f(a, b, c, d, TMOMaxImage) Wherein, a is the first luminance adjustment curve coefficient, b is the second luminance adjustment curve coefficient, c is the third luminance adjustment curve coefficient, d is the fourth luminance adjustment curve coefficient, and f is a function function.

[0071] If the pixel's brightness characteristic value TMOMaxImage is less than the brightness enhancement threshold T, and the pixel is located in a non-peak brightness region (non-PEAK region), there is no need to significantly enhance the pixel's brightness. Assuming the brightness enhancement threshold T = 900 nits, the brightness in the 900-1000 nit range can be enhanced to 1000-3000 nits, while the brightness range of 0-900 nits can be adjusted accordingly to 0-1000 nits, thus revealing more image details. The first brightness enhancement coefficient vFunc is determined as follows: vFunc=f(kup,TMOMaxImage) Where kup is the brightness enhancement value. The brightness value of the pixel after being enhanced by the first brightness enhancement coefficient is less than the maximum brightness value of the screen, MAX_brightness.

[0072] In the embodiments of this application, the brightness enhancement value kup can be set to a certain value as needed, as long as (brightness enhancement threshold T + brightness enhancement value kup) ≤ the maximum screen brightness value MAX_brightness. Furthermore, the brightness enhancement value kup can also be calculated in the following way: kup=f(a1,a2,a3,α,β,γ,(MAX brightness -Y), where a1 is the calculation parameter for the first endpoint, a2 is the calculation parameter for the second endpoint, a3 is the calculation parameter for the third endpoint, and α, β, γ are all slope parameters. Substituting Y into y0, MAX brightness This represents the maximum screen brightness value, MAX_brightness.

[0073] When a pixel's brightness is below the brightness enhancement threshold T, the original brightness can be slightly increased according to the brightness adjustment curve. When a pixel's brightness is above the brightness enhancement threshold T, the original brightness is peaked according to the brightness adjustment curve. In this case, the brightness range of a single frame of the target image is increased from the minimum brightness value min_brightness to the typical brightness value typical_brightness to the minimum brightness value min_brightness to the peak brightness value peak_brightness, thereby effectively improving the dynamic range of the target image.

[0074] like Figure 2 As shown, in one embodiment, filtering pixels in the target image according to a first brightness enhancement coefficient to obtain a second brightness enhancement coefficient includes: performing intra-frame filtering on pixels according to a preset brightness mode to obtain a third brightness enhancement coefficient for pixels; and performing inter-frame filtering on the target image pixel by pixel according to the stored brightness enhancement coefficient of the previous frame and the third brightness enhancement coefficient to obtain the second brightness enhancement coefficient.

[0075] wherein the preset brightness mode is a brightness mode of the display device, and is determined according to a setting of a user when using the display device, for example, the user sets the display device as a high brightness mode or a low brightness mode. In a case where the brightness enhancement coefficient of the previous frame is not stored, for example, the current target image is a first frame, the third brightness enhancement coefficient of the target image is taken as the brightness enhancement coefficient of the previous frame which has been stored.

[0076] Since the brightness enhancement amplitude of the peak brightness area (PEAK area) is much larger than that of the non-peak brightness area (non-PEAK area), the transition between the peak brightness area and the non-peak brightness area can be prevented from being uneven by the intra-frame filtering. In addition, when the external environment is dark, the screen brightness which is too high can cause the user to feel uncomfortable, and therefore the embodiments of the present application divide the peak brightness enhancement scheme into a high brightness mode and a low brightness mode.

[0077] In the high brightness mode, the intra-frame filtering is performed on the pixels to obtain the third brightness enhancement coefficient of the pixels, including: performing the intra-frame filtering on the pixels which are lower than the threshold value in the target image, and keeping the original brightness enhancement value for the pixels which are higher than the threshold value. In the low brightness mode, the intra-frame filtering is performed on the pixels to obtain the third brightness enhancement coefficient of the pixels, including: performing the intra-frame filtering on the whole target image. The backlight data can be smoothed by using the mean filtering, the box filtering, the Gaussian filtering and the like. The above-mentioned various filtering modes can be expressed by the following formula, and the difference lies in the convolution kernel Filter(m, n). The width and the height of the convolution kernel can be different, but the width and the height of the convolution kernel must be odd numbers:

[0078] vFunc_pad(N) is the data after the brightness enhancement coefficient is expanded, vFunc_Filter(N)(i, j) is the third brightness enhancement coefficient, and Filter is the filter convolution kernel.

[0079] Since the data of other positions around the pixel is needed in the process of the convolution, the brightness enhancement coefficient needs to be expanded, that is, the first brightness enhancement coefficient vFunc of the pixels around the pixel to be processed is expanded into the data to obtain the data after the brightness enhancement coefficient is expanded. In the mean filtering and the box filtering, the weight of each pixel in the neighborhood is equal. In the Gaussian filtering, the weight value of the center point is increased, and the weight value of the center point is decreased, and the sum of the different weights of the pixel values in the neighborhood is calculated on this basis. For these filtering modes, in order to make the image edge also have good display effect, a step of backlight expansion can be performed before the intra-frame filtering, that is, taking the image boundary as the symmetry axis, combining the size of the filter kernel where m is the size of the filter kernel in the vertical coordinate, n is the size of the filter kernel in the horizontal coordinate, and the image resolution of the target image with resolution is expanded to where H is the resolution of the image in the vertical axis, W is the resolution of the image in the horizontal axis, a is the vertical expansion value, and b is the horizontal expansion value.

[0080] In addition, a median filter mode can also be selected. The median filter takes the pixel values of the current pixel point and its surrounding adjacent pixel points, usually an odd number of pixel points, sorts these pixel values, and takes the pixel value in the middle position after sorting as the pixel value of the current pixel point. That is: vFunc Filter(N)(i,j) = median(I(i,j), i,j) ∈ [x-a,x+a] x [y-b,y+b] where x and y are the position coordinates of the pixel in the target image (original image), vFunc Filter(N)(i,j) is the third luminance enhancement coefficient, and median is a function that returns the median value of a given set of values.

[0081] The luminance enhancement coefficient vFUnc_before of the previous frame (the luminance enhancement coefficient vFUnc_result of the previous frame) is retained, and the luminance is filtered frame by frame: vFUnc_result = f(vFUnc_before, vFUnc, a, b) where a and b are both inter-frame filtering coefficients, vFUnc here is the third luminance enhancement coefficient; and vFUnc_result is the second luminance enhancement coefficient.

[0082] Through inter-frame filtering (inter-frame backlight processing), the luminance change can be more uniform, and the occurrence of luminance mutation, picture flicker, and jitter can be prevented.

[0083] In one embodiment, the luminance of each pixel in the target image is enhanced according to the second luminance enhancement coefficient to obtain an absolute luminance value for displaying the target image, including: the luminance of each pixel in the target image is enhanced according to the second luminance enhancement coefficient to obtain an absolute luminance value for displaying the target image by the following calculation method:

[0084] where TMOFusionImage(i,j) represents the absolute luminance value after enhancement according to the second luminance enhancement coefficient, (i,j) represents the position of the pixel, vFUnc result(i,j) represents the second luminance enhancement coefficient, and TMOMaxImage represents the luminance feature information.

[0085] After obtaining the second brightness enhancement coefficient vFUnc_result, the actual brightness value of each pixel is calculated channel by channel based on the second brightness enhancement coefficient to obtain the absolute brightness value TMOFusionImage of the target image, which is the final HDR PEAK image.

[0086] Absolute brightness values ​​can enhance the peak brightness area based on the display device's peak brightness, thereby revealing more bright details and achieving a more vivid HDR effect. At the same time, the brightness of non-peak brightness areas is slightly increased, thus avoiding uneven transitions at the boundary between peak and non-peak brightness areas.

[0087] like Figure 2 As shown, in one embodiment, after increasing the brightness of each pixel in the target image according to the second brightness enhancement coefficient to obtain the absolute brightness value for displaying the target image, the method further includes: performing color gamut mapping on the absolute brightness value to obtain a color gamut mapping result; and determining the electrical signal for display based on the color gamut mapping result and the photoelectric conversion table.

[0088] Color gamut mapping is used to convert the color gamut of a target image from one display device to another. Since different display devices may have different color gamuts, color gamut mapping aims to maintain visual consistency of colors as much as possible, avoiding color distortion or information loss. It maps the color gamut of the absolute brightness values ​​(HDR PEAK images) of the target image based on the actual color gamut of the display device's screen. The main methods of color gamut mapping include color gamut clipping and color gamut compression. Color gamut clipping directly clips colors outside the target color gamut to the boundary of the target color gamut without changing colors within the target gamut. Color gamut clipping can be achieved through nearest-nearest-point mapping or projection mapping. Color gamut compression adjusts all colors, including those inside and outside the target gamut, to fit the entire color space to the target color gamut. Color gamut compression can be achieved through linear compression, non-linear compression, perceptual mapping, and other methods. The advantages of color gamut clipping and color gamut compression can also be combined, performing color gamut clipping on key areas and color gamut compression on the rest.

[0089] Taking an HDR source with a color gamut of BT.2020 and a display device with a display capability of BT.709 as an example, the color gamut mapping result is determined using the following method according to the International Telecommunication Union (ITU) recommended matrix:

[0090] Among them, matrix The matrix represents the red, green, and blue color gamut values ​​of the absolute brightness. The matrix represents the red, green, and blue color gamut values ​​of the display device's monitor. Recommended matrix by the International Telecommunication Union.

[0091] RGB_output = min(PEAK_brightness, max(0, RGB_709).

[0092] wherein RGB_output represents the color gamut mapping result, PEAK_brightness represents the peak brightness value, RGB_709 represents the matrix i.e. the red, green and blue three-channel color gamut values of the display of the display device.

[0093] In the above manner, the color gamut mapping result obtained can be prevented from overflowing and out of bounds, so that it can be better displayed by the display device.

[0094] In one embodiment, before determining the electrical signal for display according to the color gamut mapping result and the opto-electric conversion table, it further comprises: determining the value of the electrical signal for display according to the color gamut mapping result; recording the color gamut mapping result and the value of the electrical signal corresponding thereto, and determining the opto-electric conversion table.

[0095] The color gamut mapping result RGB_output obtained after color gamut mapping is an absolute brightness value, which needs to be converted into an electrical signal for display. The RGB three-channel absolute brightness values are opto-electrically converted pixel by pixel. The method of opto-electric conversion includes determining the electrical signal according to the screen gamma value or determining the electrical signal according to the Opto-Electrical Transfer Function (OETF) formula of the PQ curve.

[0096] The electrical signal is calculated according to the screen gamma value in the following manner: E_RGB = RGB_output gamma The electrical signal is calculated using the OEFT formula of the PQ curve in the following manner: E_RGB = PQ_OEFT (RGB_output) wherein E_RGB is the electrical signal, RGB_output is the color gamut mapping result, which is an absolute brightness value, gamma is the screen gamma value, and PQ_OEFT is the OEFT formula of the PQ curve.

[0097] In one embodiment, determining the electrical signal for display according to the mapping result comprises: performing a bit extension operation on the mapping result in the following manner to obtain a bit-extended mapping result: wherein RGBfixed represents the bit-extended mapping result, RGB output represents the color gamut mapping result RGB_output, and n represents the bit extension value; and determining the electrical signal for display according to the transfer function of the display device and the bit-extended mapping result.

[0098] The transfer function of the display device includes the gamma value and the PQ curve. OETF conversion from linear optical signal to nonlinear electrical signal requires more potential to represent details in low-brightness areas. For hardware processors such as FPGAs, floating-point data cannot be used to represent absolute brightness values. If the absolute brightness value is rounded to an integer, significant loss of detail in low-brightness areas occurs. Assuming a display bit width of 10 bits, the electrical signal corresponding to 1 nit of absolute brightness is 176, and the electrical signal corresponding to 2 nits is 221, resulting in severe image blockiness. Therefore, a bit-expanding operation is needed on the absolute brightness value RGB_output, and the expanded mapping result... , among which RGB output This represents the RGB_output color gamut mapping result, where n is determined by the algorithm's precision. Since the OETF curve contains decimals, all parameters can be expanded using the same method. The final calculation result is then shifted. The method of determining the electrical signal based on the screen gamma value can also be achieved by expanding the absolute brightness value RGB_output to improve image detail in bright areas. The electrical signal is obtained from the expanded absolute brightness value as follows:

[0099] Among them, PQ OEFT The OEFT formula for the PQ curve, RGB output Represents the absolute brightness value RGB_output, E RGB This represents the electrical signal. The two methods for determining the electrical signal can be chosen based on the specific situation. Generally, for 8-bit depths and brightness levels below 500 nits, the method of determining the electrical signal based on the screen's gamma value can be used; for 10-bit depths and brightness levels ranging from 1000 to 2000 nits, the method of determining the electrical signal based on the OETF formula of the PQ curve can be used.

[0100] like Figure 4A , 4B Figures 5A and 5B illustrate a schematic diagram of displaying high dynamic range data on a display device based on the final obtained electrical signal, according to an embodiment of this application. Here, is a target image without brightness enhancement. Figure 4B A target image for brightness enhancement. Figure 4B The lighter-colored middle section and the upper part of the image have more detail. Figure 5A Another target image that has not undergone brightness enhancement. Figure 5B Another target image for brightness enhancement. Figure 5B The lighter-colored patterned areas show more detail. Therefore, it is evident that by improving brightness through the embodiments of this application, the display device can exhibit more image detail, resulting in a significant increase in brightness.

[0101] In the embodiments of the present application, the data before and after photoelectric conversion (mapping results and the values of the electrical signals corresponding thereto) can be recorded by using a lookup table method, so as to determine a photoelectric conversion table for lookup. If the absolute brightness value RGB_output is expanded by 2 bits n , then the lookup table is a table with 2 rows and 2 columns, which stores the absolute brightness value (mapping result) and the value of the corresponding electrical signal, respectively. Thus, after the absolute brightness value RGB_output is obtained, the value of the corresponding electrical signal can be obtained by looking up the photoelectric conversion table, without the need for calculation.

[0102] In an embodiment, a segmented lookup table method can also be used to save resource quantity. Since the brightness range of 0-1 nit corresponds to multiple electrical level signals, the brightness range of 1-108 nit corresponds to an electrical level signal every few times, and after 108 nit, several tens or several hundreds or several thousands of brightness values correspond to one electrical level signal, the brightness value and the electrical level signal value are nonlinear, and more electrical level signals are needed to display details at low brightness. Taking the PQ OETF as an example, when the absolute brightness value RGB_output is greater than 108 nit, multiple brightness values correspond to one electrical signal value, and thus when the absolute brightness value RGB_output is greater than 108, there is no need to perform expansion operation, and a lookup table 1 with 2 rows and 2 columns is stored, i.e., the peak brightness to 108 nit. The low-brightness brightness value, such as the brightness range of 0-108 nit, is expanded by n1, a demarcation point K1 is found, and a lookup table 2 with 2 rows and 2 columns is stored, wherein K1 is the brightness demarcation point, i.e., 108 nit to K1. The brightness value of (0-K1) is continuously expanded, and the above operation is repeated until the value of the electrical signal stored in the lookup table meets the accuracy requirement.

[0103] The photoelectric conversion table in the form of the segmented lookup table has a compression rate of greater than 99%, and realizes low resource quantity storage under the premise of meeting the accuracy requirement.

[0104] ​​In the embodiments of the present application, the first luminance threshold T is a luminance value determined according to the luminance of the pixels from high to low, the sum of the number of pixels in the statistical result until the sum result is greater than the lowest luminance of the pixel corresponding to the maximum peak luminance pixel number. The second luminance threshold T2 is the maximum luminance value among the partition luminance values of all partitions determined according to the preset partition information and the luminance feature information. The first luminance enhancement coefficient vFunc is the luminance enhancement coefficient of the pixel determined according to the mapping curve and the luminance feature information in the case that the luminance feature information of the pixel is greater than or equal to the luminance enhancement threshold, and the pixel is located in the luminance peak area. The second luminance enhancement coefficient vFUnc_result is the luminance coefficient obtained by performing inter-frame filtering on the target image pixel by pixel according to the stored luminance enhancement coefficient of the previous frame and the third luminance enhancement coefficient. The third luminance enhancement coefficient vFunc_Filter is the luminance enhancement coefficient of the pixel obtained by performing intra-frame filtering on the pixel according to the preset luminance mode.

[0105] The first luminance adjustment curve coefficient a, the second luminance adjustment curve coefficient b, the third luminance adjustment curve coefficient c, and the fourth luminance adjustment curve coefficient d are all coefficients used to determine the luminance adjustment curve.

[0106] The first slope delta, the first end point slope coefficient s1, and the second end point slope coefficient s0 are all parameters or coefficients used to determine the luminance adjustment curve.

[0107] The first end point calculation parameter a1, the second end point calculation parameter a2, and the third end point calculation parameter a3 are all parameters used to determine the luminance enhancement value kup.

[0108] Embodiment two The present application also provides a device for displaying high dynamic range data, as shown in Figure 6 The device comprises: A luminance mapping module 100 is configured to perform luminance mapping on at least one target image in the high dynamic range data to obtain a luminance mapping result of the target image. A luminance adjustment curve determination module 200 is configured to determine luminance feature information, a luminance peak area, and a luminance enhancement threshold according to the luminance mapping result, and determine luminance adjustment curve coefficients of the target image according to the luminance enhancement threshold. A coefficient determination module 300 is configured to determine a first luminance enhancement coefficient of a pixel in the target image according to the luminance adjustment curve. A filtering module 400 is configured to filter the pixel in the target image according to the first luminance enhancement coefficient to obtain a second luminance enhancement coefficient. A luminance enhancement module 500 is configured to enhance the luminance of each pixel in the target image according to the second luminance enhancement coefficient to obtain an absolute luminance value for displaying the target image.

[0109] In one embodiment, the brightness adjustment curve determination module includes: The feature acquisition unit 210 is used to determine the brightness feature information, the brightness peak area and the brightness enhancement threshold based on the brightness mapping result; The brightness adjustment curve determination unit 220 is used to determine a first slope based on the coordinates of the left endpoint and the right endpoint; wherein, the horizontal coordinate of the left endpoint is determined based on the brightness enhancement threshold, and the vertical coordinate is determined based on the brightness enhancement threshold and the brightness enhancement value; the horizontal coordinate of the right endpoint is determined based on the maximum brightness value of the display device, the vertical coordinate is determined based on the peak brightness value of the display device, and the brightness enhancement value is determined based on the maximum brightness value of the display device and the brightness enhancement threshold. The first endpoint slope coefficient and the second endpoint slope coefficient are determined based on the maximum brightness value and peak brightness value of the display device, as well as the coordinates of the left endpoint and the right endpoint. The brightness adjustment curve is determined based on the first slope, the coordinates of the left endpoint, the first endpoint slope coefficient, and the second endpoint slope coefficient. The brightness adjustment curve includes: the first brightness adjustment curve coefficient, the second brightness adjustment curve coefficient, the third brightness adjustment curve coefficient, and the fourth brightness adjustment curve coefficient.

[0110] In one embodiment, such as Figure 7 As shown, it also includes: The color gamut mapping module 600 is used to perform color gamut mapping on absolute brightness values ​​to obtain color gamut mapping results. The photoelectric conversion module 700 is used to determine the electrical signal for display based on the color gamut mapping results and the photoelectric conversion table.

[0111] The apparatus for displaying high dynamic range data provided in this embodiment is based on the same concept as the method for displaying high dynamic range data described above, and therefore can at least achieve the beneficial effects that the method for displaying high dynamic range data described above can achieve, which will not be repeated here.

[0112] Example 3 This application also provides an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the method for displaying high dynamic range data as described in Embodiment 1.

[0113] The electronic device provided in this embodiment is based on the same concept as the above-described method for displaying high dynamic range data, and therefore can at least achieve the beneficial effects that the above-described method for displaying high dynamic range data can achieve, which will not be repeated here.

[0114] Example 4 This application also provides a computer-readable storage medium storing computer-readable instructions thereon, which can be executed by a processor to implement the method for displaying high dynamic range data of Embodiment 1.

[0115] The computer readable storage medium provided by the embodiment can achieve the beneficial effects of the method for displaying high dynamic range data, and details are not described herein.

[0116] Embodiment five The application also provides a display module, comprising a display panel, and the electronic device as described in Embodiment Three.

[0117] The display module provided by the embodiment can achieve the beneficial effects of the method for displaying high dynamic range data, and details are not described herein.

[0118] In the embodiments of the present application, by performing luminance mapping on at least one target image in high dynamic range data, the luminance and color gamut of the target image can be adapted to the display device for display, such as a screen for displaying the high dynamic range data. By detecting the luminance peak area, the resulting luminance adjustment curve can more finely correspond the luminance of the target image in the high dynamic range data to the luminance of the display device, so that the display device can exhibit more picture details in the target image. According to the original luminance of the target image, the luminance is boosted according to the luminance adjustment curve, which can effectively improve the dynamic range of the target image. By filtering the pixels in the target image, adjusting the first luminance boosting coefficient, smoothing the transition between the luminance peak area and the non-luminance peak area in the frame, and then performing inter-frame smoothing display to obtain the second luminance boosting coefficient, the luminance of the pixels boosted by the luminance boosting coefficient can be effectively prevented from being too high to affect the picture details and cause adverse effects on the display device. According to the second luminance boosting coefficient, the luminance of each pixel in the target image is boosted to obtain the absolute luminance value for displaying the target image, which can exhibit more picture details of high dynamic range without exceeding the peak luminance of the display and the peak luminance display time, and also can prevent the peak luminance time at the same position from exceeding the specified time length, thereby avoiding the risk of screen burn-in. The embodiments of the present application can also switch between high-brightness and low-brightness modes, so that the displayed picture meets the viewing environment. The OETF conversion fixed-point algorithm determines the photoelectric conversion table, which can be stored with low resource amount while meeting the accuracy requirements. The embodiments of the present application map the luminance of the HDR film source according to the peak luminance and typical luminance of the display, so that the luminance and color gamut of the HDR film source are adapted to the screen, which can exhibit more picture details while avoiding detail loss caused by overflow and truncation. At the same time, the peak luminance of the display of the display device can be fully utilized to brighten the high-brightness image in the local small area of the HDR film source, exhibit more high-brightness picture details, and achieve more vivid HDR display effect. The embodiments of the present application include five parts: luminance mapping, luminance peak area detection, luminance boosting, intra-frame and inter-frame filtering, and color gamut mapping, which have the advantages of simple structure, low resource amount, simple algorithm, and easy FPGA integration. The embodiments of the present application can realize content adaptation based on the luminance adjustment curve, so that the control panel supports the HDR PEAK function, thereby fully utilizing the peak luminance of the control panel, improving the details and luminance of the displayed image, and being applicable to MLED display control panels and other situations requiring HDR picture quality improvement, such as other display devices that need to fully utilize the peak luminance to improve the contrast, color performance, and visual impact of the picture. The embodiments of the present application can effectively utilize the peak luminance of the screen, and have the advantages of low resource amount and high dynamic range.

[0119] It should be noted that the above-mentioned embodiments illustrate rather than limit the application, and that one skilled in the art will be able to design many alternative embodiments without departing from the scope of the appended claims. In the drawings, like numerals refer to like elements throughout the several views. As will be realized, the application is capable of modifications in various obvious aspects, all without departing from the scope of the present application. Accordingly, the drawings and descriptions are to be regarded as illustrative in nature, and explanations made are chosen for the purposes of exemplification, as complementary to the disclosure. It should be understood that the various embodiments of the application can be practiced with modification and alteration, and are not limited to the above specific embodiments. Having thus described the application with the details and particularity required by the patent laws, what is claimed and desired protected by Letters Patent is set forth in the appended claims.

[0120] In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word comprising should not be interpreted as implying exclusivity of any elements listed therein. The words "a" or "an" preceding an element do not exclude the presence of two or more such elements. The application can be implemented by means of both hardware and software, and any combination thereof. In a unit claim, several devices can be listed with a comma. The use of the term "about" followed by a value and / or a term "at least" with a value should not be construed as being limited to the value or to the term "at least" preceding the value except specifically as recited in the claims. The use of the term "about" followed by a value and / or the term "at least" with a value is meant to encompass not only the specific value stated preceding the term "about" or "at least" but also any value or range of values specifically followed by the term "about" or "at least". For example, "about 90.5%" (or "at least 90.5%") should encompass 90.5% and any number greater than 90.5% such as 90.50.5%, 90.51%, 90.52%, 90.53%, 90.54%, 90.55%, 90.56%, 90.57%, 90.58%, 90.59%, 90.60%, 90.61%, 90.62%, 90.63%, 90.64%, 90.65%, 90.66%, 90.67%, 90.68%, 90.69%, 90.70%, 90.71%, 90.72%, 90.73%, 90.74%, 90.75%, 90.76%, 90.77%, 90.78%, 90.79%, 90.80%, 90.81%, 90.82%, 90.83%, 90.84%, 90.85%, 90.86%, 90.87%, 90.88%, 90.89%, 90.90%, 90.91%, 90.92%, 90.93%, 90.94%, 90.95%, 90.96%, 90.97%, 90.98%, 90.99%, and 91.0%.

[0121] The above description is the preferred specific embodiments of the application. However, the protection scope of the application is not limited to this. Any changes or replacements within the technical scope disclosed by the application can be easily thought of by those skilled in the art. Therefore, the protection scope of the application should be subject to the protection scope of the claims.

Claims

1. A method for displaying high dynamic range data, characterized in that, include: Brightness mapping is performed on at least one frame of the target image in the high dynamic range data to obtain the brightness mapping result of the target image; Based on the brightness mapping result, brightness feature information, brightness peak area and brightness enhancement threshold are determined, and the brightness adjustment curve of the target image is determined based on the brightness enhancement threshold; The first brightness enhancement coefficient of the pixels in the target image is determined based on the brightness adjustment curve; The pixels in the target image are filtered according to the first brightness enhancement coefficient to obtain the second brightness enhancement coefficient; The brightness of each pixel in the target image is increased according to the second brightness enhancement coefficient to obtain an absolute brightness value for displaying the target image.

2. The method according to claim 1, characterized in that, The step of determining brightness feature information, brightness peak area, and brightness enhancement threshold based on the brightness mapping result, and determining the brightness adjustment curve of the target image based on the brightness enhancement threshold, includes: Based on the brightness mapping results, determine the brightness feature information, the brightness peak area, and the brightness enhancement threshold; The first slope is determined based on the coordinates of the left and right endpoints; wherein, the x-coordinate of the left endpoint is determined based on the brightness enhancement threshold, and the y-coordinate is determined based on the brightness enhancement threshold and the brightness enhancement value; the x-coordinate of the right endpoint is determined based on the maximum brightness value of the display device, and the y-coordinate is determined based on the peak brightness value of the display device; the brightness enhancement value is determined based on the maximum brightness value of the display device and the brightness enhancement threshold. The first endpoint slope coefficient and the second endpoint slope coefficient are determined based on the maximum brightness value and the peak brightness value of the display device, as well as the coordinates of the left endpoint and the right endpoint; A brightness adjustment curve is determined based on the first slope, the coordinates of the left endpoint, the slope coefficient of the first endpoint, and the slope coefficient of the second endpoint, wherein the brightness adjustment curve includes: a first brightness adjustment curve coefficient, a second brightness adjustment curve coefficient, a third brightness adjustment curve coefficient, and a fourth brightness adjustment curve coefficient.

3. The method according to claim 2, characterized in that, The step of determining the brightness feature information, the brightness peak region, and the brightness enhancement threshold based on the brightness mapping result includes: Based on the brightness mapping result, the brightness information of each pixel in the target image is determined, and brightness feature information is obtained; The brightness mapping results are statistically analyzed based on the brightness of the pixels from high to low to obtain a statistical result of the number of pixels sorted by brightness. The number of pixels in the statistical results is summed from high to low brightness until the summation is greater than the number of pixels with the maximum peak brightness, thus obtaining a first brightness threshold; wherein, the number of pixels with the maximum peak brightness is determined based on the resolution and a preset peak brightness area ratio; The brightness value of each partition is determined based on the preset partition information and the brightness feature information, and the partition with the largest brightness value is taken as the second brightness threshold. The brightness enhancement threshold and the brightness peak region are determined based on the first brightness threshold and the second brightness threshold; wherein, the location of all pixels whose brightness is greater than the brightness enhancement threshold is the brightness peak region.

4. The method according to claim 2, characterized in that, The step of determining the first brightness enhancement coefficient of the pixels in the target image based on the brightness adjustment curve includes... If the brightness feature information of the pixel is greater than or equal to the brightness enhancement threshold, and the pixel is located in the brightness peak region, a first brightness enhancement coefficient of the pixel is determined according to the brightness adjustment curve and the brightness feature information. If the brightness feature information of a pixel is less than the brightness enhancement threshold and the pixel is not located in the brightness peak region, a first brightness enhancement coefficient of the pixel is determined based on the brightness enhancement value and the brightness feature information.

5. The method according to claim 1, characterized in that, The step of filtering the pixels in the target image according to the first brightness enhancement coefficient to obtain the second brightness enhancement coefficient includes: According to the preset brightness mode, intra-frame filtering is performed on the pixel to obtain the third brightness enhancement coefficient of the pixel; Based on the stored brightness enhancement coefficient of the previous frame and the third brightness enhancement coefficient, the target image is subjected to inter-frame filtering pixel by pixel to obtain the second brightness enhancement coefficient.

6. The method according to claim 1, characterized in that, The step of increasing the brightness of each pixel in the target image according to the second brightness enhancement coefficient to obtain an absolute brightness value for displaying the target image includes: The brightness of each pixel in the target image is increased according to the second brightness enhancement coefficient using the following calculation method to obtain the absolute brightness value used to display the target image: Where TMOFusionImage(i,j) represents the absolute brightness value, (i,j) represents the pixel position, and vFUnc result(i,j) TMOMaxImage represents the second brightness enhancement coefficient, and TMOMaxImage represents brightness feature information.

7. The method according to claim 1, characterized in that, After increasing the brightness of each pixel in the target image according to the second brightness enhancement coefficient to obtain an absolute brightness value for displaying the target image, the method further includes: Perform color gamut mapping on the absolute brightness value to obtain the color gamut mapping result; Based on the color gamut mapping results and the photoelectric conversion table, the electrical signal used for display is determined.

8. The method according to claim 7, characterized in that, Before determining the electrical signal for display based on the color gamut mapping result and the photoelectric conversion table, the method further includes: The value of the electrical signal used for display is determined based on the color gamut mapping result; Record the color gamut mapping results and the corresponding electrical signal values ​​to determine the photoelectric conversion table.

9. The method according to claim 8, characterized in that, The step of determining the electrical signal for display based on the color gamut mapping result includes: The color gamut mapping result is expanded by performing an expansion operation on the result as follows: Wherein, RGBfixed represents the extended mapping result, RGB output This represents the color gamut mapping result, where n represents the extension value; The electrical signal used for display is determined based on the transfer function of the display device and the extended mapping result.

10. A device for displaying high dynamic range data, characterized in that, include: A brightness mapping module is used to perform brightness mapping on at least one frame of a target image in high dynamic range data to obtain the brightness mapping result of the target image; The brightness adjustment curve determination module is used to determine brightness feature information, brightness peak area and brightness enhancement threshold according to the brightness mapping result, and to determine the brightness adjustment curve coefficient of the target image according to the brightness enhancement threshold; A coefficient determination module is used to determine a first brightness enhancement coefficient of pixels in the target image based on the brightness adjustment curve. The filtering module is used to filter the pixels in the target image according to the first brightness enhancement coefficient to obtain the second brightness enhancement coefficient; A brightness enhancement module is used to enhance the brightness of each pixel in the target image according to the second brightness enhancement coefficient, so as to obtain an absolute brightness value for displaying the target image.

11. An electronic device, comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, when the processor executes the computer program, it implements the method for displaying high dynamic range data as described in any one of claims 1-9.

12. A computer-readable storage medium, characterized in that, It stores computer-readable instructions that can be executed by a processor to implement the method for displaying high dynamic range data as described in any one of claims 1-9.

13. A display module, comprising: The display panel is characterized by further comprising the electronic device as described in claim 11.

Images