Video display method and device, electronic equipment and storage medium
By obtaining the video source metadata and preset correspondence relationships, the driving current and pulse width modulation duty cycle of the LED display are optimized based on the PQ function, and the problems of high power consumption and risk of dead lights in HDR video source display are solved. Improved display effect.
Patent Information
- Application Number
- CN202411370154.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-27
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2044-09-27
AI Technical Summary
LED displays have high power consumption, high risk of dead lights and poor high grayscale display effects in high dynamic range (HDR) video source display.
By obtaining the type and metadata of the video source, preset the correspondence between driving current and brightness, determine the target driving current and pulse width modulation duty cycle based on the PQ inverse function and grayscale processing depth, and optimize the driving method of the LED display to adapt to HDR video source content.
While ensuring the accurate reproduction of HDR video source content, it optimizes highlight details, balances power consumption, reduces the risk of dead lights, and improves display effect.
Smart Images

Figure CN119091790A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of display technology and relates to a video display method, device, electronic device and storage medium. Background Art
[0002] Since LED display screens have the advantages of high color gamut, high brightness, large viewing angle, and long life, their application scenarios are constantly enriched, and they are gradually widely used in the display application scenarios of some high dynamic range (HDR) video sources.
[0003] For HDR video sources with higher content brightness, the display device generally has higher brightness requirements. If the LED display screen's lamps are always driven at the maximum current, the LED display screen driven by pulse width modulation (PWM) technology will increase power consumption and risk of lamp failure. At the same time, there may also be a problem of poor high grayscale display effects for HDR video sources. Summary of the invention
[0004] The present application provides a video display method, device, electronic device and storage medium, which can solve the technical problems of high power consumption, high risk of dead lights and poor high grayscale display effect of current LED display screens.
[0005] A first aspect of an embodiment of the present application provides a video display method, comprising:
[0006] Obtaining the type of video source and a preset corresponding relationship; the preset corresponding relationship is a pre-stored corresponding relationship between the driving current of the LED display screen and the display brightness;
[0007] When the type of the video source is a high dynamic range image, obtaining metadata corresponding to the video source;
[0008] Determine a first target driving current corresponding to the video source according to the metadata and the preset corresponding relationship;
[0009] Determine a first pulse width modulation duty cycle for driving the video source based on the metadata, the PQ inverse function, the PQ function, and the grayscale processing depth of the LED display screen;
[0010] The LED display screen is driven based on the first target driving current and the first pulse width modulation duty cycle to display the video source.
[0011] A second aspect of the embodiment of the present application further provides a video display device, including:
[0012] A first acquisition unit is used to acquire the type of the video source and a preset corresponding relationship; the preset corresponding relationship is a pre-stored corresponding relationship between the driving current of the LED display screen and the display brightness;
[0013] A second acquisition unit, configured to acquire metadata corresponding to the video source when the type of the video source is a high dynamic range image;
[0014] A first determining unit, configured to determine a first target driving current corresponding to the video source according to the metadata and the preset corresponding relationship;
[0015] A second determining unit, configured to determine a first pulse width modulation duty cycle for driving the video source based on the metadata, the PQ inverse function, the PQ function, and the grayscale processing depth of the LED display screen;
[0016] A driving unit is used to drive the LED display screen to display the video source based on the first target driving current and the first pulse width modulation duty cycle.
[0017] A third aspect of an embodiment of the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the video display method described in the first aspect above.
[0018] A fourth aspect of an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps of the video display method described in the first aspect are implemented.
[0019] A fifth aspect of the embodiments of the present application further provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the steps of the video display method described in the first aspect above.
[0020] In an embodiment of the present application, the driving current of the LED display screen is configured as a first target driving current according to metadata of the video source, and a first pulse width modulation duty cycle for driving the video source is determined based on the metadata, the PQ inverse function, the PQ function, and the grayscale processing depth of the LED display screen. The first target driving current and the first pulse width modulation duty cycle are designed according to the video source content and the driving capability and grayscale processing capability of the LED display screen. While ensuring accurate reproduction of the main HDR video source content and maintaining the contrast of the original HDR video source content, the highlight details are optimized, the display effect of the HDR video source is improved, and at the same time, the power consumption is balanced and the risk of dead lights is reduced. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] Figure 1A first structural schematic diagram of a display system provided in an embodiment of the present application.
[0022] Figure 2a This is an EETF mapping curve diagram of the SOC end provided in an embodiment of the present application.
[0023] Figure 2b This is a graph of the EOTF mapping curve in the LED control module provided in an embodiment of the present application.
[0024] Figure 2c This is a photoelectric display curve diagram of the SOC+LED control module combination provided in the embodiment of the present application.
[0025] Figure 2d A system-level optical mapping curve diagram provided in an embodiment of the present application.
[0026] Figure 3 A schematic diagram of the implementation flow of the video display method provided in an embodiment of the present application.
[0027] Figure 4 This is a schematic diagram of the implementation flow of step 303 of the video display method provided in an embodiment of the present application.
[0028] Figure 5 This is a schematic diagram of the implementation flow of step 304 of the video display method provided in an embodiment of the present application.
[0029] Figure 6 A tone mapping curve diagram provided for an embodiment of the present application.
[0030] Figure 7 This is a schematic diagram of the implementation flow of step 502 of the video display method provided in an embodiment of the present application.
[0031] Figure 8a This is a brightness curve diagram obtained without performing the vector interception step provided in the embodiment of the present application.
[0032] Figure 8b This is a target linear brightness curve diagram provided in an embodiment of the present application.
[0033] Fig. 9 A comparison diagram of normalized EOTF curves of video sources with a brightness range provided in an embodiment of the present application.
[0034] Fig.10 This is a second structural schematic diagram of the LED display system provided in an embodiment of the present application.
[0035] Fig.11 This is a structural block diagram of a video display device provided in an embodiment of the present application.
[0036] Fig.12 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0037] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0038] like Figure 1 , which is a first structural schematic diagram of an LED display system provided in an embodiment of the present application, the LED display system includes a video source decoding module 111 and an LED control module 112. The video source decoding module 111 can be implemented using a SOC system-level board, and the LED control module 112 can include a sending card connected to the video source decoding module 111, and a receiving card connected to the sending card.
[0039] For external video sources, such as HDR video sources or SDR video sources stored in USB flash drives, HDMI external devices, or other external storage devices, SOC can parse HDR video sources and extract metadata. SOC has rich image quality processing functions, and it performs HDR display mapping (Electro-Electro Transfer Function, EETF mapping) in the image quality processing module. The mapped and decoded RGB data can be sent to the sending card through the low voltage differential signal transmission interface (LVDs) or the high-definition multimedia transmission interface (HDMI). Then the gamma mapping module of the sending card performs mapping, thereby completing the system-level electro-optical mapping (Electro-Optical Transfer Function, EOTF mapping) of the entire end-to-end link.
[0040] In traditional LED display systems, the display data after SOC mapping no longer contains any brightness information of the original video source. The driving current and EOTF mapping of the back-end LED control module are fixed values and curves, which makes the traditional LED display system have the following two disadvantages: First, the entire system uses a set of mapping curves, which cannot be adapted to HDR video sources with different dynamic ranges, resulting in poor picture quality of some HDR video sources; second, the system is designed with a fixed driving current, and the lights of the LED display are always driven at the maximum current, which increases power consumption and the risk of dead lights.
[0041] For example, when the system is mapped to be designed according to 1000nit, if the maximum brightness of the HDR video source is 600nit, the driving current of the LED display will be large, the power consumption will be high, and the risk of LED display dead light will be increased. If the content brightness of the HDR video source is 2000nit, which is higher than the display brightness of the LED display, there will be high grayscale overexposure, and there will be a problem of poor high grayscale display effect of the HDR video source.
[0042] For example, Figure 2a As shown in the figure, it is an EETF mapping curve designed by SOC based on the maximum brightness of the video source of 1000nit and the maximum display brightness of the LED display of 1000nit. The horizontal axis represents the normalized coding value of the input grayscale data, for example, the normalized coding value of 128 grayscale of 8bit is 128 / 255=0.5019; the vertical axis is the normalized coding value after mapping.
[0043] like Figure 2b As shown, it is an EOTF mapping curve diagram in the LED control module of 10-bit grayscale display, that is, a gamma mapping curve diagram, the horizontal axis is the input grayscale data, and the vertical axis is the display brightness.
[0044] like Figure 2c , which is a photoelectric display curve (i.e., system-level EOTF mapping curve) after the SOC+LED control module is combined. The horizontal axis is the input grayscale data, and the vertical axis is the display brightness.
[0045] To illustrate the problems of system-level mapping in traditional LED display systems, Figure 2c The system-level EOTF mapping curve shown is converted into a system-level optical mapping curve (Optical Transfer Function, OOTF mapping) for explanation, as shown in FIG. Figure 2d As shown, the horizontal axis is the brightness of the video source, and the vertical axis is the brightness after display mapping.
[0046] See also Figure 2d The presented curve can accurately reproduce the brightness of content with a video source brightness of 0.0001 to 1000 nit when displayed on a 0 to 1000 nit display device. In the range of 800 nit to 1000 nit, the curve is smooth and can ensure highlight details. However, for content greater than 1000 nit, the highlight details will disappear, that is, the high grayscale display effect of the HDR video source is poor. Therefore, HDR video sources with different content brightness are mapped according to one curve, which will result in poor picture quality for some HDR video sources (for example, video sources with a brightness range greater than the display capability of the display).
[0047] In view of the above problems, the embodiments of the present application provide a video display method, which can solve the technical problems of high power consumption, high risk of dead lights and poor high grayscale display effect of current LED display screens. The video display method can be applied to the above Figure 1 The LED display system shown.
[0048] like Figure 3 As shown, the video display method can be implemented by adopting the following steps 301 to 305.
[0049] Step 301, obtaining the type of video source and the preset corresponding relationship.
[0050] In the embodiment of the present application, the above-mentioned preset corresponding relationship is a corresponding relationship between the LED display screen driving current and the display brightness pre-stored in the LED display system.
[0051] In one embodiment, the types of the video sources may include high dynamic range images HDR and standard dynamic range images SDR.
[0052] When playing a video source that needs to be played, the video source can be identified to obtain an identification result that the type of the video source is an HDR video source (i.e., a high dynamic range image) or an SDR video source (i.e., a standard dynamic range image).
[0053] In the embodiments of the present application, the dynamic range refers to the relative ratio of the highest and lowest values of the electrical signal, which is reflected in the details that can be displayed in the highlight area and the dark area of the photo. The larger the dynamic range, the richer the layers. The HDR video source is a video file that uses HDR technology. The HDR function can adjust the unbalanced state of the picture where the dark parts are particularly dark and the bright parts are particularly dazzling to an effect where the dark parts do not lose details, the bright parts are brighter, and the overall color is richer, bringing a real picture that is closer to what the human eye sees. Standard dynamic range images, that is, SDR images, are generally used for non-drawing, editing, and displays that do not require high color gamut work.
[0054] Step 302: When the type of the video source is a high dynamic range image, metadata corresponding to the video source is obtained.
[0055] HDR metadata is a set of data embedded in the HDR signal to provide the signal receiving display with parameter information about the hierarchical display, aiming to ensure the best display effect for the same image on different displays. In the embodiment of the present application, when the type of the video source is a high dynamic range image, the metadata corresponding to the video source may include the maximum brightness of the source content max_display_mastering_luminance, the minimum brightness of the source content min_display_mastering_luminance, and the average brightness of the brightest frame maxfall.
[0056] In one embodiment of the present application, the type of the video source in step 301 and the metadata in step 302 may be transmitted to the LED control module at the application layer.
[0057] Step 303: Determine a first target driving current corresponding to the video source according to the metadata and the preset corresponding relationship.
[0058] In one embodiment of the present application, Figure 4 As shown, the above step 303 can be implemented by adopting the following steps 401 to 404.
[0059] Step 401, determining a source brightness reference value Lv_reference of a video source according to metadata;
[0060] In the embodiment of the present application, for a video source containing maxfall metadata, maxfall can be used as the source brightness reference value Lv_reference to determine the first target drive current corresponding to the video source. For a video source not containing maxfall metadata, max_display_mastering_luminance can be used as the source brightness reference value Lv_reference to determine the first target drive current corresponding to the video source.
[0061] Step 402 , determining the maximum display brightness value LV_display_max corresponding to the LED display screen under the maximum driving current Imax and the maximum display brightness values LV_display_k corresponding to the k adjustable driving currents i_k respectively according to a preset corresponding relationship.
[0062] Step 403: When Lv_reference>LV_display_max, Imax is determined as the first target driving current I corresponding to the video source.
[0063] Step 404, when Lv_reference < LV_display_max, calculate the difference delta(Lv_reference - LV_display_k) between Lv_reference and LV_display_k in sequence according to the arrangement order of i_k, and use the i_k corresponding to the minimum delta(Lv_reference - LV_display_k) and LV_display_k > Lv_reference as the first target drive current I corresponding to the video source.
[0064] Specifically, in the above step 404, the first target drive current corresponding to the video source can be determined according to the order of i_k from large to small, or according to the order of i_k from small to large, or any other order. This application does not limit this.
[0065] In practical applications, the drive current of the LED display supports debugging of register values within a certain range. By adjusting different drive currents, different maximum display brightness values LV_display can be obtained. Therefore, the maximum display brightness value LV_display_max corresponding to the LED display at the maximum drive current Imax, and the maximum display brightness values LV_display_k corresponding to k adjustable drive currents i_k can be determined through experiments and recorded in the above preset correspondence. Then, by comparing the relationship between Lv_reference and LV_display_max, the first target drive current corresponding to the video source and the maximum display brightness value LV_display_k corresponding to the first target drive current are finally determined. The selection of the drive current (the first target drive current) adapted to the video source is realized based on the metadata of the video source and the above preset correspondence, which is beneficial to reducing the power consumption of the LED display and the risk of dead lights.
[0066] In the embodiments of this application, for the sake of unified description, the first target drive current can be uniformly marked as I, and the maximum display brightness value corresponding to the LED display at the first target drive current I can be uniformly marked as LV_display_I. Based on this, when Lv_reference > LV_display_max, I is equal to Imax, and LV_display_I is equal to LV_display_max; when Lv_reference < LV_display_max, I is equal to the i_k corresponding to the minimum delta(Lv_reference - LV_display_k) and LV_display_k > Lv_reference, and LV_display_I is equal to the LV_display_k corresponding to this i_k.
[0067] Step 304 : determining a first pulse width modulation duty cycle for driving the video source based on the metadata, the PQ inverse function, the PQ function, and the grayscale processing depth of the LED display screen.
[0068] In the embodiment of the present application, for the LED display screen under PWM drive, the brightness of the display screen is proportional to the product of the driving current and the PWM duty cycle. Therefore, after the first target driving current is determined, it is also necessary to determine the duty cycle corresponding to each grayscale of the video source, that is, the first pulse width modulation duty cycle, and then drive the display screen to display the video source based on the first target driving current and the first pulse width modulation duty cycle.
[0069] Step 305 : driving the display screen to display the video source based on the first target driving current and the first pulse width modulation duty cycle.
[0070] In an embodiment of the present application, the driving current of the LED display is configured as a first target driving current according to metadata of the video source, and a first pulse width modulation duty cycle for driving the video source is determined based on the metadata, the PQ inverse function, the PQ function, and the grayscale processing depth of the LED display. The first target driving current and the first pulse width modulation duty cycle are designed according to the video source content and the driving capability and grayscale processing capability of the LED display. While ensuring accurate reproduction of the main HDR video source content and maintaining the contrast of the original HDR video source content, the highlight details are optimized, the display effect of the HDR video source is improved, and at the same time, the power consumption is balanced and the risk of dead lights is reduced.
[0071] Specifically, in one embodiment of the present application, Figure 5 As shown, in the above step 304, the process of determining the first pulse width modulation duty cycle for driving the video source based on the metadata, the PQ inverse function, the PQ function and the grayscale processing depth of the LED display screen can be implemented by the following steps 501 to 503.
[0072] Step 501 : determining a tone mapping curve corresponding to a video source based on a PQ inverse function according to a maximum display brightness value corresponding to a first target driving current, a preset minimum display brightness value, and metadata.
[0073] Above Figure 4 In the steps shown, the value of the first target driving current I has been determined, and the maximum display brightness value corresponding to the first target driving current I is LV_display_I; the LED display screen is a self-luminous display device, and the dark state brightness is 0nit. For subsequent calculations, in the embodiment of the present application, the preset minimum display brightness value LV_display__min>0 is taken. For example, LV_display_min can be set to 0.005.
[0074] The aforementioned step 401 has determined the source brightness reference value Lv_reference of the video source, and the metadata obtained in the aforementioned step 302 includes the minimum brightness min_display_mastering_luminance of the source content; the formula defining the PQ inverse function applied in the numerical conversion process of the present application is:
[0075] Among them, L=C / 100000, indicating a linear normalized color value; m1=0.1593; m2=78.8437; c1=c3-c2; c2=18.8516; c3=18.6875.
[0076] C represents any brightness value among LV_display_I, LV_display_min, Lv_reference, and min_display_mastering_luminance.
[0077] Let L W =Lv_reference / 10000; L B =min_display_mastering_luminance / 10000;
[0078] L min =LV_display_min / 10000; L max =LV_display_I / 10000.
[0079] Next, the following calculation is performed based on the above PQ inverse function:
[0080] minLum=(PQEOTF -1 [L min ]-PQEOTF -1 [L B ]) / (PQEOTF -1 [L W ]-
[0081] PQEOTF -1 [L B ]);
[0082] maxLum=(PQEOTF -1 [L max ]-PQEOTF -1 [L B ]) / (PQEOTF -1 [L W ]-
[0083] PQEOTF-1 [L B ]);
[0084] Among them, PQEOTF -1 is the inverse function of PQ, as shown in the above formula
[0085] Next, let E1 = (E'-PQEOTF -1 [L B ]) / (PQEOTF -1 [L W ]-PQEOTF -1 [L B ]); E' corresponds to the full grayscale normalized vector value. For example, for a 10-bit display system, the vector of E' consists of floating-point data in [0,1], and the number of elements is 2^10-1, that is, 1024. The element values are i / 1023, i represents an integer value from 0 to 1023 with a step length of 1.
[0086] Next, the high grayscale and low grayscale mapping control points KS and b are introduced, and the expressions are as follows: KS = a*maxLum+c; b = minLum; a and c are adjustable parameters. In one embodiment, a = 1.5; b is -0.5;
[0087] Next, based on the following steps S1 to S5, the tone mapping curve is calculated according to KS and the spline interpolation method:
[0088] Step S1: construct variable T = (E1-KS) / (1-KS);
[0089] Step S2: Calculate the cubic spline interpolation curve
[0090] P_E1=(2*T^3-3*T^2+1)*KS+(T^3-2*T^2+T)*(1-KS)+(-2
[0091] *T^3+3*T^2)*maxLum
[0092] Step S3: Let
[0093] Step S4: Let E3 = E2 + b*(1-E2) 4 for 1≤E2≤1;
[0094] Step S5: Calculate:
[0095] E4=E3*(PQEOTF -1 [L W ]-PQEOTF -1 [L B])+PQEOTF -1 [L B ]; E4 is color
[0096] The basic form of the tone mapping curve.
[0097] like Figure 6 As shown, the ordinate represents E4, the abscissa represents the input grayscale value, and if it is a 10-bit mapping process, the abscissa represents an integer value from 0 to 1023.
[0098] Step 502: determine a target brightness curve corresponding to the video source based on the tone mapping curve and the PQ function.
[0099] In one embodiment of the present application, Figure 7 As shown, the determination of the target brightness curve in the above step 502 can be implemented based on the following steps 701 to 704.
[0100] Step 701 : determining, based on the tone mapping curve, a minimum abscissa value corresponding to when the ordinate of the tone mapping curve reaches a maximum value.
[0101] For example, Figure 6 As shown in the figure, the ordinate of the tone mapping curve reaches its maximum value at point A (860, 0.74). The ordinates of the coordinate points with abscissas greater than 860 on the tone mapping curve are all equal to the ordinate 0.74 of point A, and the ordinates of the coordinate points with abscissas less than 860 on the tone mapping curve are all less than the ordinate 0.74 of point A. Therefore, the abscissa 860 corresponding to point A is the minimum abscissa value corresponding to the maximum value of the ordinate of the tone mapping curve.
[0102] Step 702: intercepting the grayscale vector corresponding to the video source based on the minimum horizontal coordinate value to obtain an intercepted vector.
[0103] Step 703: perform interpolation calculation on the intercepted vector to obtain a target grayscale vector having a length equal to the total number of grayscale gradients of the system.
[0104] Step 704 , mapping the brightness values of the grayscale values in the target grayscale vector based on the PQ function to obtain a target linear brightness curve corresponding to the video source.
[0105] In practical applications, the above-mentioned minimum horizontal coordinate value is generally smaller than the maximum value of the grayscale vector corresponding to the video source. Therefore, it is necessary to intercept the grayscale vector corresponding to the video source, and then perform interpolation calculation and brightness value mapping to make the details of the video source more delicate and improve the display effect of the video source.
[0106] Continuing from the above example, when the tone mapping curve corresponding to the video source is as follows Figure 6When the tone mapping curve is shown, the minimum horizontal coordinate value corresponding to the maximum value of the vertical coordinate of the tone mapping curve is 860, which means that the LED display screen can display the display brightness of 0 to 1000 nit using the gray level of 0 to 860. If the vector is not intercepted, Figure 8a As shown in the figure, the gray level of 860 to 1000 on the LED display will be wasted, and after vector interception, Figure 8b As shown in the figure, the LED display has a total of 1024 grayscale gradients in the 0-1023 gray stage, which can be used to express the brightness range of 0-1000nit, so the presentation of the video source will be more delicate.
[0107] In the embodiment of the present application, when the video source is a video source encoded with 10-bit data, and the maximum display brightness of the video source is 1000nit, when the ordinate of the tone mapping curve reaches the maximum value, the corresponding minimum abscissa value is 860. Since 860 is less than 1023, the grayscale vector corresponding to the video source can be intercepted to obtain an intercepted vector with a grayscale value located at [0, 860]. Then, the intercepted vector is interpolated to obtain a target grayscale vector with a length equal to the total number of grayscale gradients of the system, which is 1024. Then, the brightness value of each grayscale value in the target grayscale vector is mapped based on the PQ function to obtain the following: Figure 8b The brightness mapping curve shown is used to make the details of the video source appear more delicate.
[0108] In the process of performing brightness value mapping on each grayscale value in the target grayscale vector based on the PQ function in step 704, the PQ function can be used. Implementation, where m1 = 0.1593; m2 = 78.8437; c1 = c3-c2; c2 = 18.8516; c3 = 18.6875; the dependent variable N corresponds to each grayscale value in the target grayscale vector, and each grayscale value in the target grayscale vector is substituted into N to obtain the corresponding P value, which is the target brightness value corresponding to the video source in the target brightness curve, recorded as LV_target'.
[0109] It should be noted that the above steps 701 to 704 are merely examples of a method for determining a target brightness curve. In other embodiments of the present application, other methods may be used to determine the target brightness curve, and the present application does not impose any limitation thereto.
[0110] For example, in one embodiment of the present application, in the above process of intercepting the grayscale vector corresponding to the video source to obtain the intercepted vector, in addition to determining the minimum horizontal coordinate value corresponding to when the vertical coordinate of the tone mapping curve reaches the maximum value based on the tone mapping curve, the interception can also be performed by determining the horizontal coordinate value corresponding to when the vertical coordinate of the tone mapping curve reaches a preset coordinate value, or by determining the horizontal coordinate value corresponding to when the vertical coordinate of the tone mapping curve tends to be stable. The vertical coordinate of the tone mapping curve tends to be stable refers to the situation where the change rate of the slope of the tone mapping curve is less than the preset change rate threshold.
[0111] Step 503 : converting each target brightness value corresponding to the video source in the target brightness curve into a first pulse width modulation duty cycle based on the grayscale processing depth of the LED display screen.
[0112] In the embodiment of the present application, the target brightness curve in the above step 503 can be implemented based on the following steps 901 to 902.
[0113] Step 901, performing brightness mapping on each grayscale value in the target grayscale vector to obtain brightness values as each target brightness value corresponding to the video source in the target brightness curve;
[0114] Step 902: convert each target brightness value corresponding to the video source in the target brightness curve into a first pulse width modulation duty cycle E5'(i) based on the formula E5'(i)=floor((LV_target'(i) / max(LV_target'))*power(2, bit)).
[0115] Among them, floor means rounding, power means the power function with base 2 and exponent bit, bit is a parameter determined based on the grayscale processing depth of the LED display, and the value range can be 12-16; LV_target'(i) is the i-th target brightness value to be calculated for duty cycle, and max(LV_target') is the maximum target brightness value among the target brightness values corresponding to the video source.
[0116] In the embodiments of the present application, the driving current (the first target driving current) of the LED display screen is adjusted according to the configuration of the metadata of the video source, and based on the maximum display brightness value of the LED display screen, the preset minimum display brightness value, and the metadata, the tone mapping curve corresponding to the video source is determined based on the inverse PQ function. Then, based on the tone mapping curve and the PQ function, the target linear brightness curve corresponding to the video source is determined. Finally, based on the gray-scale processing depth of the LED display screen, each target brightness value corresponding to the video source in the target linear brightness curve is converted into the first pulse-width modulation duty ratio, and the display screen is driven based on the first target driving current and the first pulse-width modulation duty ratio to display the video source. It realizes the design of the driving current and the electro-optical mapping curve according to the video source content, the driving ability of the LED display screen, and the gray-scale level. While ensuring the accurate reproduction of the main HDR content and maintaining the contrast of the original HDR content, it optimizes the high-brightness details, balances the power consumption, and reduces the risk of dead lights while optimizing the HDR display effect.
[0117] For example, when the HDR video source is only 600 nits, which is significantly lower than the display ability of the display device, 1000 nits, low driving current can be used for LED display to save power while achieving accurate brightness reproduction. When the peak brightness of the HDR source reaches 2000 nits, which is significantly higher than the brightness limit of the display ability of the display device, 1000 nits, the maximum driving current within the power consumption design consideration range of the LED is adopted, and tone mapping is performed to better ensure the manifestation of high-brightness details.
[0118] As Fig. 9 shown, Fig. 9 In [figure], curve 1 is the normalized EOTF curve when the maximum brightness of the input video source content is 1000 nits and the maximum display brightness of the LED display screen is 1000 nits. Assume the current is I2_1 at this time. Curve 2 is the normalized EOTF curve when the maximum brightness of the input video source content is 800 nits and the maximum display brightness of the LED display screen is 800 nits. Assume the current is I2_2 at this time, then I2_2 < I2_1, that is, at the 800-nit input video source, power consumption can be saved by reducing the driving current.
[0119] Fig. 9 In [figure], curve 3 is the EOTF mapping curve corresponding to the situation where the maximum brightness of the input source content is 2000 nits and the maximum brightness of the LED display screen is 1000 nits. The driving current at this moment is still I2_1. Compared with the curves in [reference] and [reference], there is no obvious over-saturation area in this curve 3, so the high-brightness detail display will be better. Figure 2c and Figure 2d In [reference],
[0120] In one embodiment of the present application, when the type of the video source is a standard dynamic range image, the second target driving current corresponding to the video source can also be determined according to the maximum display brightness in the video source and a preset corresponding relationship, and then the grayscale data of the video source is mapped according to a preset gamma function to obtain the second pulse width modulation duty cycle corresponding to each grayscale data of the video source; and then the display screen is driven to display the video source based on the second target driving current and the second pulse width modulation duty cycle.
[0121] When the type of the video source is a standard dynamic range image, in the process of determining the second target driving current corresponding to the video source according to the maximum display brightness in the video source and the preset corresponding relationship, the aforementioned Figure 4 The steps shown are not repeated here.
[0122] In the above process of mapping the grayscale data of the video source according to the preset gamma function to obtain the second pulse width modulation duty cycle corresponding to each grayscale data of the video source, the formula
[0123] E=floor(E_max*power(G / Gmax,gamma)) maps the grayscale data of the video source to obtain the second pulse width modulation duty cycle corresponding to each grayscale data of the video source. Among them, E represents the second pulse width modulation duty cycle, E_max represents the maximum pulse width modulation duty cycle, which is related to the grayscale level of the LED display driving system. G represents the grayscale data of the video source, and Gmax represents the maximum value of the grayscale data. For example, for a 10-bit encoded video source, Gmax is 1023, and G is an integer value within [0, 1023]. Floor represents rounding calculation. Gamma represents a preset exponent value, that is, an exponent value designed according to the display effect, such as 2.2, 2.4, 2.6, 2.8, etc.
[0124] There are many HDR technical specifications, and HDR10 is the most widely used. HDR10 video sources generally contain metadata for the display end to map reference. Therefore, this application can adjust the LED drive current according to the metadata configuration, and cooperate with software algorithms and hardware control to further balance the display effect of the HDR video source and the choice of drive current.
[0125] like Fig.10As shown, it is a second structural schematic diagram of the LED display system provided by the embodiment of the present application, and the LED display system may include a video source decoding module 11, a computing module 12, a first storage unit 13, a second storage unit 14 and an LED display screen 15. Among them, the video source decoding module 11 is a chip capable of extracting metadata from the video source frame information and realizing data conversion processing from YUV to RGB, for example, an HDMI decoding chip, a SOC chip or a DSP chip, etc. The output of the video source decoding module 11 after decoding the video source is divided into two parts: an image data stream and a computing stream. Among them, the computing stream obtains two parts, one is a current driving signal output to the LED display screen, which is used to control the driving current of the LED display screen, and the other is a pulse width modulation duty cycle after EOTF mapping, which is stored in the second storage unit for image data stream display, and acts together with the driving current to drive the LED display screen to realize brightness display under different grayscales. The corresponding relationship between the driving current and the display brightness of the LED display screen is pre-stored in the first storage unit. The computing module is used to execute the relevant method steps in each of the aforementioned embodiments, and the computing module can be implemented using FPGA, that is, the processor type in the traditional sending card, or it can be implemented in various hardware forms such as ASIC or GPU.
[0126] It should be noted that the video source decoding module 11 may also include some modules in the computing module, for example, the video source brightness and screen brightness computing processing module and the EETF computing conversion unit, and this application does not limit this. Figure 1 The video source decoding module 111 in may be a video source decoding module having the same function.
[0127] It should be noted that, for the sake of simplicity of description, the aforementioned method embodiments are all expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited to the described order of actions, and in some embodiments of the present application, certain steps can be performed in other orders as needed.
[0128] like Fig.11As shown, the embodiment of the present application further provides a video display device 110, which may include a first acquisition unit 101, a second acquisition unit 102, a first determination unit 103, a second determination unit 104 and a driving unit 105. The first acquisition unit is used to acquire the type of the video source and a preset corresponding relationship; the preset corresponding relationship is a pre-stored corresponding relationship between the driving current of the LED display screen and the display brightness; the second acquisition unit is used to acquire metadata corresponding to the video source when the type of the video source is a high dynamic range image; the first determination unit is used to determine the first target driving current corresponding to the video source according to the metadata and the preset corresponding relationship; the second determination unit is used to determine the first pulse width modulation duty cycle for driving the video source based on the metadata, the PQ inverse function, the PQ function and the grayscale processing depth of the LED display screen; the driving unit is used to drive the LED display screen to display the video source based on the first target driving current and the first pulse width modulation duty cycle.
[0129] It should be noted that, for the convenience and simplicity of description, the specific working process of the video display device 110 described above can refer to the corresponding process of the video display method described above, and will not be repeated here. Each unit module of the video display device 110 can respectively perform the corresponding steps in the above method embodiment, so each unit module will not be repeated here, and please refer to the description of the above corresponding steps for details.
[0130] like Fig.12 As shown, the embodiment of the present application also provides an electronic device. The electronic device may include: a processor 90, a memory 91, and a computer program 92 stored in the memory 91 and executable on the processor 90. When the processor 90 executes the computer program 92, the steps in the above-mentioned video display method embodiments are implemented, for example, Figure 3 Steps 301 to 305 are shown.
[0131] The computer program may be divided into one or more units, which are stored in the memory 91 and executed by the processor 90 to complete the present application. The one or more units may be a series of computer program instruction segments that can complete specific functions, and the instruction segments are used to describe the process of the computer program executing the video display method in the electronic device. For example, the computer program may be divided into Fig.11 The first acquisition unit, the second acquisition unit, the first determination unit, the second determination unit and the driving unit are shown.
[0132] An embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a central processing module, the steps of the video display method described in any of the above embodiments are implemented.
[0133] An embodiment of the present application also provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the steps of the video display method described in any of the above embodiments.
[0134] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0135] Those of ordinary skill in the art will appreciate that the steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0136] In the embodiments provided in the present application, it should be understood that the disclosed terminals and methods can be implemented in other ways. For example, the terminal embodiments described above are only schematic. For example, the division of each component is only a logical function division, and there may be other division methods in actual implementation, such as multiple components can be combined or integrated into another system, or a feature can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through an interface, system or unit, which can be electrical, mechanical or other forms.
[0137] If implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the computer-readable medium does not include electric carrier signals and telecommunication signals.
[0138] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.
Claims
1. A video display method, characterized in that: The video display method includes: Obtaining the type of the video source and a preset corresponding relationship; the preset corresponding relationship is a pre-stored corresponding relationship between the driving current of the LED display screen and the display brightness; When the type of the video source is a high-dynamic-range image, obtaining the metadata corresponding to the video source; Determining a first target driving current corresponding to the video source according to the metadata and the preset corresponding relationship; Determining a first pulse-width modulation duty cycle for driving the video source based on the metadata, the PQ inverse function, the PQ function, and the gray-scale processing depth of the LED display screen; Driving the LED display screen based on the first target driving current and the first pulse-width modulation duty cycle to display the video source.
2. The video display method according to claim 1, characterized in that: The determining the first target driving current corresponding to the video source according to the metadata and the preset corresponding relationship includes: Determining a source brightness reference value Lv_reference of the video source according to the metadata; Determining, according to the preset corresponding relationship, a display maximum brightness value LV_display_max corresponding to the LED display screen at the maximum driving current Imax, and display maximum brightness values LV_display_k corresponding to k adjustable driving currents i_k respectively; When Lv_reference > LV_display_max, determining Imax as the first target driving current I corresponding to the video source; When Lv_reference < LV_display_max, calculating a difference delta(Lv_reference - LV_display_k) between Lv_reference and LV_display_k according to the arrangement order of i_k, and using the i_k corresponding to the smallest delta(Lv_reference - LV_display_k) and LV_display_k > Lv_reference as the first target driving current I corresponding to the video source.
3. The video display method according to claim 1, characterized in that: The video display method further includes: determining a display maximum brightness value corresponding to the first target driving current according to the preset corresponding relationship; the determining the first pulse-width modulation duty cycle for driving the video source based on the metadata, the PQ inverse function, the PQ function, and the gray-scale processing depth of the LED display screen includes: Determining a tone mapping curve corresponding to the video source based on the PQ inverse function according to the display maximum brightness value corresponding to the first target driving current, a preset display minimum brightness value, and the metadata; Determining a target brightness curve corresponding to the video source based on the tone mapping curve and the PQ function; Converting each target brightness value corresponding to the video source in the target brightness curve into the first pulse-width modulation duty cycle based on the gray-scale processing depth of the LED display screen.
4. The video display method according to claim 3, characterized in that: The abscissa of the tone mapping curve is a gray-scale value, and the ordinate is a tone mapping value; the determining the target linear brightness curve corresponding to the video source based on the tone mapping curve and the PQ function includes: Determine, based on the tone mapping curve, a minimum abscissa value corresponding to when the ordinate of the tone mapping curve reaches a maximum value; Based on the minimum horizontal coordinate value, a grayscale vector corresponding to the video source is intercepted to obtain an intercepted vector; Performing interpolation calculation on the intercepted vector to obtain a target grayscale vector whose length is equal to the total number of grayscale gradients of the system; Based on the PQ function, brightness values are mapped to each grayscale value in the target grayscale vector to obtain a target linear brightness curve corresponding to the video source.
5. The video display method according to claim 4, characterized in that: The step of converting each target brightness value corresponding to the video source in the target brightness curve into the first pulse width modulation duty cycle based on the grayscale processing depth of the LED display screen includes: Performing brightness mapping on each grayscale value in the target grayscale vector to obtain brightness values as each target brightness value corresponding to the video source in the target brightness curve; Based on the formula E5'(i)=floor((LV_target'(i) / max(LV_target'))*power(2, bit)), each target brightness value corresponding to the video source in the target brightness curve is converted into the first pulse width modulation duty cycle E5'(i); Among them, floor means rounding, power means a power function with base 2 and exponent bit, bit is a parameter determined based on the grayscale processing depth of the LED display screen; LV_target'(i) is each target brightness value corresponding to the video source, and max(LV_target') is the maximum target brightness value among each target brightness value corresponding to the video source.
6. The video display method according to any one of claims 1 to 5, characterized in that: The video display method further includes: When the type of the video source is a standard dynamic range image, determining a second target driving current corresponding to the video source according to the maximum display brightness in the video source and the preset corresponding relationship; Mapping the grayscale data of the video source according to a preset gamma function to obtain a second pulse width modulation duty cycle corresponding to each grayscale data of the video source; The display screen is driven to display the video source based on the second target driving current and the second pulse width modulation duty cycle.
7. The video display method according to claim 6, characterized in that: The step of mapping the grayscale data of the video source according to a preset gamma function to obtain a second pulse width modulation duty cycle corresponding to each grayscale data of the video source includes: Based on the formula E=floor(E_max*power(G / Gmax,gamma)), the grayscale data of the video source is mapped to obtain the second pulse width modulation duty cycle corresponding to each grayscale data of the video source; wherein E represents the second pulse width modulation duty cycle, E_max represents the maximum pulse width modulation duty cycle, G represents the grayscale data of the video source, Gmax represents the maximum value of the grayscale data, floor represents rounding calculation, and Gamma represents a preset index value.
8. A video display device, characterized in that: The video display device comprises: A first acquisition unit is used to acquire the type of the video source and a preset corresponding relationship; the preset corresponding relationship is a pre-stored corresponding relationship between the driving current of the LED display screen and the display brightness; A second acquisition unit, configured to acquire metadata corresponding to the video source when the type of the video source is a high dynamic range image; A first determining unit, configured to determine a first target driving current corresponding to the video source according to the metadata and the preset corresponding relationship; A second determining unit, configured to determine a first pulse width modulation duty cycle for driving the video source based on the metadata, the PQ inverse function, the PQ function, and the grayscale processing depth of the LED display screen; A driving unit is used to drive the LED display screen to display the video source based on the first target driving current and the first pulse width modulation duty cycle.
9. An electronic device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein when the computer program is executed by the processor, the steps of the video display method according to any one of claims 1 to 7 are implemented.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the video display method according to any one of claims 1 to 7 is implemented.
Citation Information
Patent Citations
Display management for high dynamic range video
CN107211076A
Peak luminance promotion method, memory medium and smart television
CN107465961A
Video display processing method and device, computer equipment and storage medium
CN116156140A
