Smart color gamut clipping with hue preservation and compatible with super-white levels
The method addresses issues of super-white loss and hue shifts in gamut clipping by using a scaling factor-based approach to preserve super-white levels and maintain color accuracy during HDR to SDR conversion.
Patent Information
- Application Number
- PCT/EP2026/062056
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-05-15
- Filing Date
- 2026-04-27
- Publication Date
- 2026-11-19
AI Technical Summary
Existing gamut clipping methods in video content conversion from HDR to SDR cause issues such as loss of super-white signals and hue shifts due to basic clipping processes, which are not adequately addressed by current techniques.
A method and device for gamut clipping that involves detecting RGB pixels in the super-white range, determining a scaling factor based on the difference between maximum and minimum components, and applying this factor to scale components to preserve super-white levels and avoid hue shifts during conversion from a broader color gamut (e.g., BT.2020) to a narrower color gamut (e.g., BT.709).
The proposed method effectively preserves super-white levels and prevents hue shifts during color gamut conversion, ensuring high-quality image reproduction in SDR systems by maintaining accurate color representation.
Smart Images

Figure EP2026062056_19112026_PF_FP_ABST
Abstract
Description
[0001] 2025PF00253
[0002] SMART COLOR GAMUT CLIPPING WITH HUE PRESERVATION AND COMPATIBLE WITH SUPER- WHITE LEVELS
[0003] 1. CROSS REFERENCE TO RELATED APPLICATIONS
[0004] This application claims priority to European Application No. 25305693.1, filed May 15, 2025, which is incorporated herein by reference in its entirety.
[0005] 2. TECHNICAL FIELD
[0006] At least one of the present embodiments generally relates to the field of production of video and more particularly to a method, a device and a system for reducing issues introduced by a clipping in a conversion of a video content from a first color gamut to a second color gamut.
[0007] 3. BACKGROUND
[0008] In order to ensure interoperability between video devices, many video systems comprise at least one conversion stage allowing for instance converting a YUV signal with a given Transfer function and given color gamut to a YUV signal with another transfer function and another color gamut
[0009] This is particularly true in a single stream HDR (High Dynamic Range) / SDR(Standard dynamic Range) system wherein a single stream allow distributing a SDR and a HDR version of the same content. For example, the standard SL-HDR1 (High-Performance Single Layer High Dynamic Range (HDR) System for use in Consumer Electronics devices; Part 7: Directly Standard Dynamic Range (SDR)Compatible HDR System (SL-HDR1); ETSI TS 103 433-1 VI.4.1 (2021-08) allows transmitting a HDR version of a content in the form of a SDR version of the content with metadata allowing the conversion from SDR to HDR. Typically, the SDR version is using YUV “8” bits or “10” bits with a BT.709 transfer function and a BT.709 color gamut, as described in BT.709 recommendation (Recommendation ITU-R BT.709-6, Parameter values for the HDTV standards for production and international programme exchange, 06 / 2015). The HDR on its side is generally using a YUV “10” bits or “12” bits with a PQ or HLG transfer function and a BT.2020 color gamut as described in BT.2100 recommendation (Recommendation ITU-R BT.2100-2, Image2025PF00253
[0010] parameter values for high dynamic range television for use in production and international programme exchange, 07 / 2018).
[0011] A conversion from HDR YUV data to SDR YUV data is typically called a tone mapping (TM) while the inverse conversion is typically called inverse tone mapping (ITM). A typical TM comprises a color gamut conversion of RGB values from a first color gamut to a second color gamut. Such conversion may require a clipping of the values outputted by the color gamut conversion to make sure that the output of the color gamut conversion fits well within the second color gamut. It has been observed that a basic clipping may create some issues when the basically clipped RGB values in the second color gamut are then converted in YUV values for the SDR YUV data.
[0012] It is desirable to overcome the above drawbacks.
[0013] It is particularly desirable to propose an improved gamut clipping method limiting the issues created by the basic gamut clipping method.
[0014] 4. BRIEF SUMMARY
[0015] In a first aspect, one or more of the present embodiments provide a method comprising:
[0016] obtaining a first YUV picture in a first color gamut;
[0017] applying a conversion process to the first YUV picture to obtain a second YUV picture in a second color gamut, the first color gamut encompassing the second color gamut, the conversion process comprising for a first YUV pixel of the first YUV picture:
[0018] obtaining a first RGB pixel in the second color gamut from the first YUV pixel; and,
[0019] applying a clipping process to the first RGB pixel to obtain a second RGB pixel in the second color gamut;
[0020] wherein the clipping process comprises:
[0021] detecting that the first RGB pixel is in a range of values corresponding to superwhites;
[0022] determining a scaling factor based on a difference between a maximum of components R, G and B of the first RGB pixel and a minimum of components R, G and B of the first RGB pixel; and,2025PF00253
[0023] for each component R, G and B of the first RGB pixel, applying (706) the scaling factor to the component to obtain a scaled component; and,
[0024] obtaining a clipped component as a minimum between the scaled component and a maximum value of said component in the range of values corresponding to superwhites.
[0025] In an embodiment, the first RGB pixel is in the range of values corresponding to super-whites if at least one component of the first RGB pixel is higher than a maximum range value, the maximum range value defining a lower bound of the range of values corresponding to super-whites, and responsive to the difference is equal to a maximum between the maximum range value and the maximum of components R, G and B of the first RGB pixel minus the maximum range value, the scaling factor is equal to the maximum between the maximum range value and the maximum of components R, G and B of the first RGB pixel.
[0026] In an embodiment, the first RGB pixel is in the range of values corresponding to super-whites if at least one component of the first RGB pixel is higher than a maximum range value, the maximum range value defining a lower bound of the range of values corresponding to super-whites, and responsive to the difference is equal to zero, the scaling factor is equal to the maximum range value and applying (706) the scaling factor to the component to obtain a scaled component amounts at applying no scaling to the component to obtain the scaled component.
[0027] In an embodiment, the first RGB pixel is in the range of values corresponding to super-whites if at least one component of the first RGB pixel is higher than a maximum range value, the maximum range value defining a lower bound of the range of values corresponding to super-whites, and responsive to the difference is between zero and a maximum between the maximum range value and the maximum of components R, G and B of the first RGB pixel minus the maximum range value, the scaling factor is based on an increasing function of the difference with values between the maximum range value and a maximum between the maximum range value and the maximum of components R, G and B of the first RGB pixel.
[0028] In an embodiment, each component of the first RGB pixel has a normalized value in a normalized linear light representation.2025PF00253
[0029] In a second aspect, one or more of the present embodiments provide a device comprising electronic circuitry configured for:
[0030] obtaining a first YUV picture in a first color gamut;
[0031] applying a conversion process to the first YUV picture to obtain a second YUV picture in a second color gamut, the first color gamut encompassing the second color gamut, the conversion process comprising for a first YUV pixel of the first YUV picture:
[0032] obtaining a first RGB pixel in the second color gamut from the first YUV pixel; and,
[0033] applying a clipping process to the first RGB pixel to obtain a second RGB pixel in the second color gamut;
[0034] wherein the clipping process comprises:
[0035] detecting that the first RGB pixel is in a range of values corresponding to superwhites;
[0036] determining a scaling factor based on a difference between a maximum of components R, G and B of the first RGB pixel and a minimum of components R, G and B of the first RGB pixel; and,
[0037] for each component R, G and B of the first RGB pixel, applying the scaling factor to the component to obtain a scaled component; and,
[0038] obtaining a clipped component as a minimum between the scaled component and a maximum value of said component in the range of values corresponding to superwhites.
[0039] In an embodiment, the first RGB pixel is in the range of values corresponding to super-whites if at least one component of the first RGB pixel is higher than a maximum range value, the maximum range value defining a lower bound of the range of values corresponding to super-whites, and responsive to the difference is equal to a maximum between the maximum range value and the maximum of components R, G and B of the first RGB pixel minus the maximum range value, the scaling factor is equal to the maximum between the maximum range value and the maximum of components R, G and B of the first RGB pixel.
[0040] In an embodiment, the first RGB pixel is in the range of values corresponding to super-whites if at least one component of the first RGB pixel is higher than a maximum range value, the maximum range value defining a lower bound of the range of values2025PF00253
[0041] corresponding to super-whites, and responsive to the difference is equal to zero, the scaling factor is equal to the maximum range value and applying (706) the scaling factor to the component to obtain a scaled component amounts at applying no scaling to the component to obtain the scaled component.
[0042] In an embodiment, the first RGB pixel is in the range of values corresponding to super-whites if at least one component of the first RGB pixel is higher than a maximum range value, the maximum range value defining a lower bound of the range of values corresponding to super-whites, and responsive to the difference is between zero and a maximum between the maximum range value and the maximum of components R, G and B of the first RGB pixel minus the maximum range value, the scaling factor is based on an increasing function of the difference with values between the maximum range value and a maximum between the maximum range value and the maximum of components R, G and B of the first RGB pixel.
[0043] In an embodiment, each component of the first RGB pixel has a normalized value in a normalized linear light representation.
[0044] In a third aspect, one or more of the present embodiments provide a non-transitory information storage medium storing program code instructions for implementing the method of the first aspect.
[0045] In a fourth aspect, one or more of the present embodiments provide a computer program comprising program code instructions for implementing the method of the first aspect.
[0046] 5. BRIEF SUMMARY OF THE DRAWINGS
[0047] Fig. 1A illustrates schematically an example of context in which various embodiments are implemented;
[0048] Fig. IB illustrates a two-dimensional (2D) representation of the BT.709 color gamut and of the BT.2020 color gamut;
[0049] Fig. 1C illustrates a process executed by a tone mapping module;
[0050] Fig. ID illustrates schematically a gamut clipping;
[0051] Fig. IE illustrates a gamut mapping;
[0052] Fig. IF illustrates schematically a process executed by a color gamut conversion module comprised in an inverse tone mapping module;2025PF00253
[0053] Fig. 1G illustrates schematically a process executed by a color gamut conversion module comprised in a tone mapping module;
[0054] Fig. 1H represents a waveform of an input image representing a luminance ramp; Fig. II represents a waveform of an output image;
[0055] Fig. 1J illustrates a shift of a pixel in the CIE 1931 chromaticity diagram due to a basic clipping;
[0056] Fig. IK illustrates a shift of a pixel in the CIE 1931 chromaticity diagram due to a basic clipping;
[0057] Fig. 2A illustrates schematically an example of hardware architecture of a processing module able to implement various aspects and embodiments;
[0058] Fig. 2B illustrates a block diagram of an example of a first system in which various aspects and embodiments are implemented;
[0059] Fig. 2C illustrates a block diagram of an example of a second system in which various aspects and embodiments are implemented;
[0060] Fig. 3 illustrates a basic clipping curve;
[0061] Fig. 4 illustrates a process for converting first YUV data in a first color gamut into second YUV data in a second color gamut, the first color gamut encompassing the second color gamut;
[0062] Fig. 5 illustrates the conversion process executed during the process of Fig. 4;
[0063] Fig. 6 illustrates schematically a clipping process preventing hue shift when clipping; Fig. 7 illustrates schematically a clipping process preventing hue shift and preserving super-white level signals when clipping;
[0064] Fig. 8 illustrates the first embodiment of a progressive intermediate scaling;
[0065] Fig. 9 illustrates the second embodiment of a progressive intermediate scaling;
[0066] Fig. 10 represents a waveform of an output image resulting from an application of the process of Fig. 7 on a luminance ramp;
[0067] Fig. 11 illustrates a first comparison of a basic clipping method and the clipping process of Fig. 7 in the CIE 1931 chromaticity diagram; and,
[0068] Fig. 12 illustrates a second comparison of a basic clipping method and the clipping process of Fig. 7 in the CIE 1931 chromaticity diagram.
[0069] 6. DETAILED DESCRIPTION2025PF00253
[0070] Fig. 1A illustrates an example of context in which the various embodiments are implemented.
[0071] In Fig. 1A, a source device 10 provides a video content to a ITM module 11. The source device 10 is for instance a SDR camera generating a SDR version of the video content. The SDR version corresponds to first YUV data YUVrwith a first transfer function and a first color gamut. For example, the first YUV data YUV are YUV “8” bits or “10” bits with a BT.709 transfer function (i.e., the first transfer function or first OETF) and a BT.709 color gamut (i.e., the first color gamut).
[0072] The ITM module 11 converts the first YUV data YUV into second YUV data YUV2with a second transfer function and a second color gamut. The second YUV data YUV2are for example “10” bits or “12” bits HDR data with a PQ or HLG transfer function and a BT.2020 color gamut.
[0073] The second YUV data YUV2are then provided to a routing and switching module 12. The routing and switching module 12 is in charge of routing the second YUV data YUV2(i.e., te HDR data) to a TM module 13.
[0074] The TM module 13 converts the second YUV data into third YUV data YUV3with a third transfer function and a third color gamut. For example, the third transfer function is identical to the first transfer function and the third color gamut is identical to the first color gamut. Due to roundings and quantizations performed by the ITM and the TM modules, the third YUV data YUV3are SDR data corresponding to an approximation of the first YUV data YUVr.
[0075] The third YUV data YUV3are then provided to a distribution module 14 in charge of distributing these data for example on a network. The distribution module 14 generally comprises an encoding module in charge of encoding the third YUV data YUV3representing a SDR version of the video content in a bitstream using a video compression format such as AVC ((ISO / CEI 14496-10 / ITU-T H.264), HEVC (ISO / IEC 23008-2 - MPEG-H Part 2, High Efficiency Video Coding / ITU-T H.265)), VVC (ISO / IEC 23090-3 - MPEG-I, Versatile Video Coding / ITU-T H.266), AV1,VP9, EVC (ISO / CEI 23094-1 Essential Video Coding) or any other video compression format adapted to encode SDR video contents. The output of the encoding system is a bitstream representing the encoded third YUV data YUV3.
[0076] In a single stream HDR / SDR system based on SL-HDR1, an additional module, not represented in Fig. 1A, generates SL-HDR1 metadata allowing converting SDR2025PF00253
[0077] data in HDR data. These metadata are then provided along with the bitstream to a receiving system (not represented in Fig. 1 A) for instance via a network. The receiving system can then decide to either decode and display only the SDR version of the video content or to decode the SDR version of the video content and to generate a reconstructed HDR version of the video content applying an ITM based on the SL-HDR1 metadata. The reconstructed HDR version of the video content is then displayed by the receiving system.
[0078] As explained in the document EBUR 103 (Recommendation EBU R 103, Video Signal Tolerance in Digital Television Systems, Version 3.0, 05 / 2020), the HDR and SDR content can be encoded with four different representations:
[0079] • Legal Range (or Narrow Range or Nominal Video Range). For “10” bits contents:
[0080] o Y is encoded in the range [64..940]; ranges [4..63] and [941..1019] are not used.
[0081] o U and V are encoded in the range [64..960]; ranges [4..63] and [961..1019] are not used.
[0082] • Full Range: For “10” bits contents:
[0083] o Y is encoded in the range [4..1019],
[0084] o U and V are encoded in the range [4..1019],
[0085] • Extended Range: This format uses the Legal Range (or Narrow Range or Nominal Video Range) signals for the useful video signal and uses two extended ranges (Sub-Blacks and Super- Whites) for extra usage. For “10” bits contents:
[0086] o Useful video signal:
[0087] ■ Y is encoded in the range [64..940],
[0088] ■ U and V are encoded in the range [64..960], o Sub-Blacks: Y is encoded in the range [4..63] and can be typically used for monitor calibration.
[0089] o Super- Whites: Y is encoded in the range [941..1019] and can be typically used for extra dynamic range signaling. One can note that after application of an EOTF, the value “1019” corresponds to “1811” nits in HLG (“1.811” when normalized) and to “24077” nits in PQ (“24.077” when normalized).2025PF00253
[0090] Fig. IB illustrates a two-dimensional (2D) representation of the BT.709 color gamut and of the BT.2020 color gamut. A color gamut is generally represented by a volume in a three-dimensional (3D) space but to facilitate the understanding, color gamuts are represented in a 2D space in Fig. IB. As can be seen the BT.2020 color gamut is wider than (i.e. encompasses) the BT.709 color gamut.
[0091] As seen above in relation to Fig. 1A, the TM module 13 typically obtains aHDR content with a BT.2020 color gamut from which it generates a SDR content with a BT.709 color gamut.
[0092] FIG. 1C illustrates a process executed by the TM module 13.
[0093] The process of Fig. 1C is for example executed by a processing module 20 of the TM module 13 described later in relation to Fig. 2A.
[0094] In a step 130, the processing module 20 transforms the HDR in the BT.2020 color gamut in a HDR content in the BT.709 color gamut.
[0095] In a step 131, the processing module 20 transforms the HDR content in the BT.709 color gamut in SDR content in a BT.709 color gamut.
[0096] Various types of transforms may be applied during step 130. In a first example, this transform is a gamut clipping. When applying a gamut clipping, all pixels within the BT.709 color gamut are unchanged and all pixels that are between the BT.709 color gamut and the BT.2020 color gamut are mapped to the border of the BT.709 color gamut as shown in Fig. ID.
[0097] Fig. ID illustrates schematically a gamut clipping.
[0098] Gamut clipping may introduce some artefacts such as lack of details (many different pixels within the BT.2020 color gamut are mapped to the same pixels at the BT.709 color gamut’s border) or color shifts between original pixels in the BT.2020 color gamut and resulting clipped pixels on the BT.709 color gamut’s border. On the other hand, gamut clipping generally produces well saturated images.
[0099] In a second example, the transform may be a gamut mapping. When applying gamut mapping, a preserved area is defined within the BT.709 color gamut. All pixels within the preserved area within the BT.709 color gamut are unchanged. All the pixels between the preserved area within the BT.709 color gamut and the BT.2020 color gamut are mapped between the preserved area within the BT.709 color gamut and the BT.709 color gamut as shown in Fig. IE.2025PF00253
[0100] Fig. IE illustrates a gamut mapping.
[0101] Gamut mapping generally resolves the issues introduced by the gamut clipping: lack of details and, if well designed, color shifts between the original pixel in the BT.2020 color gamut and resulting clipped pixel on the BT.709 color border. On the other hand, gamut mapping may produce less saturated images than gamut clipping, and gamut mapping is far more complex to implement.
[0102] Fig. IF illustrates schematically a process executed by a color gamut conversion module comprised in the ITM module 11.
[0103] The process of Fig. IF is for example implemented by a processing module 20 of the ITM module 11, the processing module 20 being described later in relation to Fig. 2A.
[0104] In the example of Fig. IF, the first YUV data YUVrwere encoded or generated with a transfer function TF1 and a color gamut CGI . The second YUV data YUV2have a transfer function TF2 and a color gamut CG2.
[0105] In a step 110, the processing module 20 converts the YUV data YUV (with a transfer function TF1 and a color gamut CGI) into RGB data RGB (with a transfer function TF1 and a color gamut CGI) using a YUV to RGB matrix dedicated to the color gamut CGI .
[0106] In a step 111, the processing module 20 converts the RGB data RGB-^ (with a transfer function TF1 and a color gamut CGI) to RGB data RGBin(in the linear domain with no transfer function and a color gamut CGI ) using a non-linear converter dedicated to the TF 1 to linear transform.
[0107] In a step 112, the processing module 20 converts the RGB data RGBin(in the linear domain with no transfer function and a color gamut CGI) to RGB data RGB2lin(in the linear domain with no transfer function and a color gamut CG2) using a RGB to RGB matrix dedicated to the CGI to CG2 color gamut transform.
[0108] In a step 113, the processing module 20 converts the RGB video RGB2lin(in the linear domain with no transfer function and a color gamut CG2) to RGB data RGB2(with a transfer function TF2 and a color gamut CG2) using a non-linear converter dedicated to the linear to TF2 transform.
[0109] In a step 114, the processing module 20 converts the RGB data RGB2(with a transfer function TF2 and a color gamut CG2) to YUV data YUV2(with a transfer2025PF00253
[0110] function TF2 and a color gamut CG2) using a RGB to YUV matrix dedicated to the color gamut CG2.
[0111] Gamut clipping is generally realized on RGB components in the linear light domain. The RGB components are obtained using the typical conversion process depicted in Fig. 1G.
[0112] Fig. 1G illustrates schematically a process executed by a color gamut conversion module comprised in the TM module 13.
[0113] Fig. 1G is a more detailed version of the step 130 of Fig. 1C.
[0114] The process of Fig. 1G is for example implemented by a processing module 20 of the TM module 13.
[0115] In the example of Fig. 1G, the processing module 20 of the TM module 13 obtains the second YUV data YUV2from the ITM module 11 via the HDR content routing and switching module 12.
[0116] In a step 1300, the processing module 20 converts the YUV data YUV2(with the transfer function TF2 and the color gamut CG2) into RGB data RGB2(with the transfer function TF2 and a color gamut CG2) using a YUV to RGB matrix dedicated to the color gamut CG2.
[0117] In a step 1301, the processing module 20 converts the RGB data RGB2(with a transfer function TF2 and the color gamut CG2) to RGB data RGB2in(in the linear domain with no transfer function and the color gamut CG2) using a non-linear converter dedicated to the TF2 to linear transform.
[0118] In a step 1302, the processing module 20 converts the RGB data RGB2lin(in the linear domain with no transfer function and the color gamut CG2) to RGB data RGB3lin(in the linear domain with no transfer function and a color gamut CG3) using a RGB to RGB matrix dedicated to the CG2 to CG3 color gamut transform.
[0119] In a step 1303, the processing module 20 applies a gamut clipping to the RGB data RGB3in(in the linear domain with no transfer function and the color gamut CG3), to produce RGB data C_RGB3lin(in the linear domain with no transfer function and the color gamut CG3).
[0120] In a step 1304, the processing module 20 converts the RGB video C_RGB3in(in the linear domain with no transfer function and a color gamut CG3) to RGB data RGB3(with the transfer function TF3 and a color gamut CG3) using a non-linear converter dedicated to the linear to TF3 transform.2025PF00253
[0121] In a step 1305, the processing module 20 converts the RGB data RGB3(with the transfer function TF3 and a color gamut CG3) to YUV data YUV3(with the transfer function TF3 and the color gamut CG3) using a RGB to YUV matrix dedicated to the color gamut CG3.
[0122] Generally, the conversions of steps 110, 111, 112, 113, 114 and 1300, 1301, 1302, 1304, 1305 are done in floating-point format for a better accuracy. At the end of the processes of Figs. IF and 1G, a quantization is applied to the YUV data YUV2and YUV3(in floating point values) into YUV “8”, “10” or “12” bits fix-point values.
[0123] In an example, the transfer function TF1 and TF3 are BT.1886 (as described in document Recommendation ITU-R BT.1886-0, Reference electro-optical transfer function for flat panel displays used in HDTV studio production, 03 / 2011} or BT.709, the color gamuts CGI and CG3 are BT.709, the transfer function TF2 is PQ or HLG and the color gamut CG2 is BT.2020.
[0124] In step 1302, as the color gamut CG2 (typically BT.2020) is broader than the color gamut CG3 (typically BT.709), a gamut clipping method is applied (in step 1303) to make sure that the RGB data resulting from the conversion from the color gamut CG2 to the color gamut CG3 fits well within the color gamut CG3 boundaries.
[0125] One can note that, for questions of consistency of colors, the ITM module 11 may produce a HDR content in the color gamut CG2 (for example BT.2020) but with colors limited to the color gamut CGI (for example BT.709). Therefore, the gamut clipping is appropriate in the TM module 13.
[0126] Supposing that the RGB data RGB3inare normalized values, a basic gamut clipping (or basic clipping) method may be the following:
[0127] C_R_P_RGB3in= Max (0, Min(l, R_P_RGB3in}}
[0128] C_G_P_RGB3in= Max (0, Min(l, G_P_RGB3lin}
[0129] C_B_P_RGB3in= Max (0, Min(l, B_P_RGB3lin}}
[0130] Where R_P_RGB3in(respectively G_P_RGB3in, B_P_RGB3in} represents the component R (respectively G, B) of a pixel P_RGB3linof the RGB data RGBff C_R_P_RGB3in(respectively C_G_P_RGB3in, C_B_P_RGB3in} represents the component R (respectively G, B) of a pixel C_P_RGB3linof the RGB data C_RGB3lin, Max(x,y) takes the maximum of x and y and Min(x,y) takes the minimum of x and v.
[0131] Fig.3 illustrates a basic clipping.
[0132] However, when applying such a basic clipping method, two issues may occur:2025PF00253
[0133] • Issue “1”: the super-whites signals are removed.
[0134] • Issue “2”: as mentioned in the Recommendation BT.2407 (Recommendation ITU-R BT.2407-0, Colour gamut conversion from Recommendation ITU-R BT.2020 to Recommendation ITU-R BT.709, 10 / 2017) section 2.4, some color shift issues may appear on the components C_R_P_RGB3lin, C_R_P_RGB3linand C_R_P_RGB3linand therefore subsequently on components R_P_YUV3, G_P_YUV3. B_P_YUV3of a pixel P_YUV3ofthe YUV data YUV3.
[0135] To illustrate the issue “1”, let’s take an example of an application of the process of Fig. 1G to an input image representing a luminance ramp in HD format where each line of “1920” pixels is made with:
[0136] • Pixel i = 0 to 4: Y = 4, U = V = 512;
[0137] • Pixel i = 4to 1019: Y = i, U = V = 512;
[0138] • Pixel i = 1020 to 1023: Y = 1019, U = V = 512;
[0139] • Pixel i = 1024 to 1027: Y = 4, U = V = 512;
[0140] • Pixel i = 1028 to 1919: Y = (i - 1024) (i.e. 4 to 895).
[0141] Fig. 1H represents a waveform of the Y component of the input image representing a luminance ramp.
[0142] Fig. II represents a waveform of the Y component of the output image resulting from an application of the process of Fig. 1G. We can clearly see that the super-white levels have been lost during the conversion. This is not acceptable and this needs to be resolved.
[0143] Regarding the issue 2, the color shift may happen when an input color of step 1302 (in the wider color gamut CG2) has the following characteristics:
[0144] • it fits within the output color gamut (i.e., the smaller color gamut CG3);
[0145] • it has one or more of its R, G and B components that is close to a maximum value (i.e., equal to “1” in a normalized linear light representation). In addition, step 1302 generates at least one output R, G or B value larger than the maximum value.
[0146] • it has one or more of its R, G and B components with a value that is far from a minimum value (i.e. equal to “0” in normalized linear light representation) and far from the maximum value. In addition, step 13022025PF00253
[0147] generates at least one output R, G or B value within an acceptable range ( i.e., [0..1] in normalized linear light representation).
[0148] Let’s take some examples with some RGB values which colors are represented in a CIE 1931 chromaticity diagram, with (x, y) coordinates. These (x, y) coordinates are computed from the RGB linear light components using the following steps:
[0149] • Step 1 : step l is a step of conversion of RGB components into XYZ components using a RGB to XYZ matrix.
[0150] When RGB components are in the BT.2020 space, the RGB to XYZ matrix is:
[0151] X 0.63696 0.14462 0.16888 R
[0152] Y = 0.2627 0.678 0.0593 G
[0153] Z
[0154]
[0155] 0 0.02807 1.06099. B.
[0156] When RGB components are in the BT.709 space, the RGB to XYZ matrix is:
[0157] X' 0.41239 0.35758 0.18048 R
[0158] Y 0.21264 0.71517 0.07219 G
[0159] Z. .0.01933 0.1192 0.95053. B.
[0160] • Step 2: step 2 is a step of conversion of XYZ components into (x, y) components using the following formulas:
[0161] x = X / (X + Y + Z)
[0162] y = Y / (X + Y + Z)
[0163] Let’s analyze steps 1302 and 1303.
[0164] The RGB BT.2020 to RGB BT.709 matrix is given below:
[0165] 1.660491 -0.58764 —0.07285'
[0166] M = -0.12455 1.1329 -0.00835
[0167] -0.01815 -0.10058 1.11873 .
[0168] Example 1:
[0169] R_P_RGB2lin= 1, G_P_RGB2lin= 0.2 and B_P_RGB2lin= 0.11, where R_P_RGB2in(respectively G_P_RGB2inand B_P_RGB2n) is the component R (respectively G and B) of a pixel P_RGB2inof the RGB data RGB2m. In (x, y) coordinates: x = 0.565, y = 0.334.
[0170] The RGB BT.2020 to RGB BT.709 matrix produces the following RGB BT.709 components:2025PF00253
[0171] R_P_RGB3lin= 1.535, G_P_RGB3lin= 0.1012, B_P_RGB3lin= 0.085, where R_P_RGB3lin(respectively G_P_RGB3linand B_P_RGB3in) is the component R (respectively G and B) of a pixel P_RGB3inof the RGB data RGB3m. In (x, y) coordinates: x = 0.565 - y = 0.334.
[0172] The basic clipping method produces the following RGB BT.709 components: C_R_P_RGB3in= 1.0, C_G_P_RGB3in= 0.1012, C_B_P_RGB3lin= 0.085, where C_R_P_RGB3in(respectively C_R_P_RGB3inand C_R_P_RGB3in) is the component R (respectively G and B) of a pixel C_P_RGB3inof the clipped RGB data C_RGB3in. In (x, y) coordinates: x = 0.535 - y = 0.336.
[0173] The plot of these “3” pixels in the CIE 1931 chromaticity diagram is given in Fig. 1J.
[0174] Fig. 1 J illustrates a shift of a pixel in the CIE 1931 chromaticity diagram due to a basic clipping.
[0175] As can be seen in Fig. 1J, the original BT.2020 pixel and the converted BT.709 pixel before clipping are within the BT.709 color gamut and are matching. The clipped BT.709 pixel has shifted from the original BT.2020 pixel and the converted BT.709 pixel before clipping, producing a hue shift that is visible.
[0176] Example 2:
[0177] R_P_RGB2lin= 1, G_P_RGB2lin= 0.2 and B_P_RGB2lin= 1. In (x, y) coordinates: x = 0.3539, y = 0.194.
[0178] The RGB BT.2020 to RGB BT.709 matrix produces the following RGB BT.709 components:
[0179] R_P_RGB3lin= 1.4701, G_P_RGB3lin= 0.0937, B_P_RGB3lin= 1.0805. In (x, y) coordinates: x = 0.3539, y = 0.194.
[0180] The basic clipping method produces the following RGB BT.709 components: C_R_P_RGB3in= 1.0, C_G_P_RGB3in= 0.0937, C_B_P_RGB3lin= 1.0. In (x, y) coordinates: x = 0.3197, y = 0.1796.
[0181] The plot of these “3” pixels in the CIE 1931 chromaticity diagram is given in Fig. IK.
[0182] Fig. IK illustrates a shift of a pixel in the CIE 1931 chromaticity diagram due to a basic clipping.
[0183] Again, in Fig. IK, the original BT.2020 pixel and the converted BT.709 pixel before clipping are within the BT.709 color gamut and are matching. The clipped2025PF00253
[0184] BT.709 pixel has shifted from the original BT.2020 pixel and the converted BT.709 pixel before clipping, producing a hue shift that is visible.
[0185] The various embodiments described below proposes a new clipping method compatible with the high-level part of the Extended Range content, i.e. that allows Super-White levels passthrough (i.e., super-white levels preservation), and that avoids hue shifts on the video signal, when converting video signal from a first color gamut (typically BT.2020) to a smaller second color gamut (typically BT.709) using gamut clipping.
[0186] Fig. 2A illustrates schematically an example of hardware architecture of a processing module 20 comprised at least in the ITM module 11, in the TM module 13 or in a receiving system.
[0187] The processing module 20 comprises, connected by a communication bus 205: a processor or CPU (central processing unit) 200 encompassing one or more microprocessors, general purpose computers, special purpose computers, and processors based on a multi-core architecture, as non-limiting examples; a random access memory (RAM) 201 ; a read only memory (ROM) 202; a storage unit 203, which can include non-volatile memory and / or volatile memory, including, but not limited to, Electrically Erasable Programmable Read-Only Memory (EEPROM), Read-Only Memory (ROM), Programmable Read-Only Memory (PROM), Random Access Memory (RAM), Dynamic Random Access Memory (DRAM), Static Random Access Memory (SRAM), flash, magnetic disk drive, and / or optical disk drive, or a storage medium reader, such as a SD (secure digital) card reader and / or a hard disc drive (HDD) and / or a network accessible storage device; at least one communication interface 204 for exchanging data with other modules, devices, systems or equipment. The communication interface 204 can include, but is not limited to, a transceiver configured to transmit and to receive data over a communication network 21 (not represented in Fig. 2A). The communication interface 204 can include, but is not limited to, a modem or a network card.
[0188] For example, in the ITM module 11, the communication interface 204 enables the processing module 20 to receive YUV data YUVrand to output YUV data YUV2. In the TM module 13, the communication interface 204 enables the processing module 20 to receive YUV data YUV2and to output YUV data YUV3.2025PF00253
[0189] The processor 200 is capable of executing instructions loaded into the RAM 201 from the ROM 202, from an external memory (not shown), from a storage medium, or from a communication network. When the processing module 20 is powered up, the processor 200 is capable of reading instructions from the RAM 201 and executing them. These instructions form a computer program causing, for example, the implementation by the processor 200 of a process comprising the processes described in relation to Figs.
[0190] 4, 5, 6 and 7.
[0191] All or some of the algorithms and steps of these processes may be implemented in software form by the execution of a set of instructions by a programmable machine such as a DSP (digital signal processor) or a microcontroller, or be implemented in hardware form by a machine or a dedicated component such as a FPGA (field-programmable gate array) or an ASIC (application-specific integrated circuit). The processor 200, a DSP, a microcontroller, a FPGA and an ASIC are therefore examples of electronic circuitry adapted to implement (or configured for implementing) the processes described in relation to Figs. 4, 5, 6 and 7.
[0192] Fig.2C illustrates a block diagram of an example of a receiving system in which various aspects and embodiments are implemented.
[0193] The receiving system can be embodied as a device including various components or modules and is configured to receive, for example, A bitstream comprising the SDR version of a video content along with SL-HDR1 metadata and to generate either a reconstructed SDR version of the video content or a reconstructed HDR version of the video content. Examples of such system include, but are not limited to, various electronic systems such as a personal computer, a laptop computer, a smartphone, a tablet, a television or a set top box. Components of the receiving system, singly or in combination, can be embodied in a single integrated circuit (IC), multiple ICs, and / or discrete components. For example, in at least one embodiment, the receiving system comprises one processing module 20 that implements all processes executed by the receiving system. In various embodiments, the receiving system is communicatively coupled to one or more other systems, or other electronic devices, via, for example, a communications bus or through dedicated input and / or output ports.
[0194] The input to the processing module 20 can be provided through various input modules as indicated in block 22. Such input modules include, but are not limited to, (i) a radio frequency (RF) module that receives an RF signal transmitted, for example,2025PF00253
[0195] over the air by a broadcaster, (ii) a component (COMP) input module (or a set of COMP input modules), (iii) a Universal Serial Bus (USB) input module, and / or (iv) a High Definition Multimedia Interface (HDMI) input module. Other examples, not shown in Fig. 2C, include composite video.
[0196] In various embodiments, the input modules of block 22 have associated respective input processing elements as known in the art. For example, the RF module can be associated with elements suitable for (i) selecting a desired frequency (also referred to as selecting a signal, or band-limiting a signal to a band of frequencies), (ii) down-converting the selected signal, (iii) band-limiting again to a narrower band of frequencies to select (for example) a signal frequency band which can be referred to as a channel in certain embodiments, (iv) demodulating the down-converted and bandlimited signal, (v) performing error correction, and (vi) demultiplexing to select the desired stream of data packets. The RF module of various embodiments includes one or more elements to perform these functions, for example, frequency selectors, signal selectors, band-limiters, channel selectors, filters, downconverters, demodulators, error correctors, and demultiplexers. The RF portion can include a tuner that performs various of these functions, including, for example, down-converting the received signal to a lower frequency (for example, an intermediate frequency or a near-baseband frequency) or to baseband. Various embodiments rearrange the order of the abovedescribed (and other) elements, remove some of these elements, and / or add other elements performing similar or different functions. Adding elements can include inserting elements in between existing elements, such as, for example, inserting amplifiers and an analog-to-digital converter. In various embodiments, the RF module includes an antenna.
[0197] Additionally, the USB and / or HDMI modules can include respective interface processors for connecting the receiving system to other electronic devices across USB and / or HDMI connections. It is to be understood that various aspects of input processing, for example, Reed-Solomon error correction, can be implemented, for example, within a separate input processing IC or within the processing module 20 as necessary. Similarly, aspects of USB or HDMI interface processing can be implemented within separate interface ICs or within the processing module 20 as necessary. The demodulated, error corrected, and demultiplexed stream is provided to the processing module 20.2025PF00253
[0198] Various elements of the receiving system can be provided within an integrated housing. Within the integrated housing, the various elements can be interconnected and transmit data therebetween using suitable connection arrangements, for example, an internal bus as known in the art, including the Inter-IC (I2C) bus, wiring, and printed circuit boards. For example, in the receiving system, the processing module 20 is interconnected to other elements of the receiving system by the bus 205.
[0199] The communication interface 204 of the processing module 20 allows the receiving system to communicate on the communication network 21. The communication network 21 can be implemented, for example, within a wired and / or a wireless medium.
[0200] Data is streamed, or otherwise provided, to the receiving system, in various embodiments, using a wireless network such as a Wi-Fi network, for example IEEE 802.11 (IEEE refers to the Institute of Electrical and Electronics Engineers). The WiFi signal of these embodiments is received over the communications network 21 and the communications interface 204 which are adapted for Wi-Fi communications. The communications network 21 of these embodiments is typically connected to an access point or router that provides access to external networks including the Internet for allowing streaming applications and other over-the-top communications. Still other embodiments provide streamed data to the receiving system using the RF connection of the input block 22. As indicated above, various embodiments provide data in a nonstreaming manner, for example, when the receiving module is a smartphone or a tablet. Additionally, various embodiments use wireless networks other than Wi-Fi, for example a cellular network or a Bluetooth network.
[0201] The receiving system can provide an output signal to various output devices using the communication network 21 or the bus 205. For example, the receiving system can provide a video content to a display device 16.
[0202] The receiving system can provide an output signal to various output devices, including the display device 16, speakers 26, and other peripheral devices 27. The display device 16 includes one or more of, for example, a touchscreen display, an organic light-emitting diode (OLED) display, a curved display, and / or a foldable display. The display device 16 can be for a television, a tablet, a laptop, a smartphone (mobile phone), or other devices. The display device 16 can also be integrated with other components (for example, as in a smartphone or a tablet), or separate (for2025PF00253
[0203] example, an external monitor for a laptop). The display device 16 is compatible with video contents generated by the receiving device. The other peripheral devices 27 include, in various examples of embodiments, one or more of a stand-alone digital video disc (or digital versatile disc) (DVR, for both terms), a disk player, a stereo system, and / or a lighting system. Various embodiments use one or more peripheral devices 27 that provide a function based on the output of the receiving system. For example, a disk player performs the function of playing the output of the receiving module.
[0204] In various embodiments, control signals are communicated between the receiving system and the display device 16, speakers 26, or other peripheral devices 27 using signaling such as AV. Link, Consumer Electronics Control (CEC), or other communications protocols that enable device-to-device control with or without user intervention. The output devices can be communicatively coupled to the receiving module via dedicated connections through respective interfaces. Alternatively, the output devices can be connected to the receiving module using the communication network 21 via the communication interface 204. The display device 16 and speakers 26 can be integrated in a single unit with the other components of the receiving module in an electronic device such as, for example, a television. In various embodiments, the display interface includes a display driver, such as, for example, a timing controller (T Con) chip.
[0205] The display device 16 and speakers 26 can alternatively be separate from one or more of the other components, for example, if the RF module of input block 22 is part of a separate set-top box. In various embodiments in which the display device 16 and speakers 26 are external components, the output signal can be provided via dedicated output connections, including, for example, HDMI ports, USB ports, or COMP outputs.
[0206] Fig.2B illustrates a block diagram of an example of the ITM module 11 or the TM module 13 adapted to convert YUV video data with a first transfer function and in a first color gamut into YUV video data with a second transfer function and in a second color gamut in which various aspects and embodiments are implemented.
[0207] ITM module 11 (respectively TM module 13) can be embodied as a device including the various components and modules described above and is configured to perform one or more of the aspects and embodiments described in this document.2025PF00253
[0208] In an embodiment, the ITM module 11 and the TM module 13 are included in a same system.
[0209] Examples of such devices include, but are not limited to, various electronic devices such as personal computers, laptop computers, a camera, a smartphone and a server. Elements or modules of the ITM module 11 (respectively the TM module 13), singly or in combination, can be embodied in a single integrated circuit (IC), multiple ICs, and / or discrete components. For example, in at least one embodiment, the ITM module 11 (respectively the TM module 13) comprises one processing module 20 that implement a conversion of YUV video data with a first transfer function and in a first color gamut to YUV video data with a second transfer function and in a second color gamut. In various embodiments, the ITM module 11 (respectively the TM module 13) is communicatively coupled to one or more other systems, or other electronic devices, via, for example, a communications bus or through dedicated input and / or output ports.
[0210] The input to the processing module 20 can be provided through various input modules as indicated in block 22 already described in relation to Fig. 2C.
[0211] Various elements of the ITM module 11 (respectively the TM module 13) can be provided within an integrated housing. Within the integrated housing, the various elements can be interconnected and transmit data therebetween using suitable connection arrangements, for example, an internal bus as known in the art, including the Inter-IC (I2C) bus, wiring, and printed circuit boards. For example, in the ITM module 11 (respectively the TM module 13), the processing module 20 is interconnected to other elements of the ITM module 11 (respectively the TM module 13) by the bus 205.
[0212] The communication interface 204 of the processing module 20 allows the ITM module 11 (respectively the TM module 13) to communicate on the communication network 21. The communication network 21 can be implemented, for example, within a wired and / or a wireless medium.
[0213] Data is streamed, or otherwise provided, to the color gamut conversion module, in various embodiments, using a wireless network such as a Wi-Fi network, for example IEEE 802.11 (IEEE refers to the Institute of Electrical and Electronics Engineers). The Wi-Fi signal of these embodiments is received over the communications network 21 and the communications interface 204 which are adapted for Wi-Fi communications. The communications network 21 of these embodiments is typically connected to an2025PF00253
[0214] access point or router that provides access to external networks including the Internet for allowing streaming applications and other over-the-top communications. Still other embodiments provide streamed data to the ITM module 11 (respectively the TM module 13) using the RF connection of the input block 22. As indicated above, various embodiments provide data in a non-streaming manner.
[0215] When a figure is presented as a flow diagram, it should be understood that it also provides a block diagram of a corresponding apparatus. Similarly, when a figure is presented as a block diagram, it should be understood that it also provides a flow diagram of a corresponding method / process.
[0216] The implementations and aspects described herein can be implemented in, for example, a method or a process, an apparatus, a software program, a data stream, or a signal. Even if only discussed in the context of a single form of implementation (for example, discussed only as a method), the implementation of features discussed can also be implemented in other forms (for example, an apparatus or program). An apparatus can be implemented in, for example, appropriate hardware, software, and firmware. The methods can be implemented, for example, in a processor, which refers to processing devices in general, including, for example, a computer, a microprocessor, an integrated circuit, or a programmable logic device. Processors also include communication devices, such as, for example, computers, smartphones (cell phones), portable / personal digital assistants ("PDAs"), tablets, and other devices that facilitate communication of information between end-users.
[0217] Reference to “one embodiment” or “an embodiment” or “one implementation” or “an implementation”, as well as other variations thereof, means that a particular feature, structure, characteristic, and so forth described in connection with the embodiment is included in at least one embodiment. Thus, the appearances of the phrase “in one embodiment” or “in an embodiment” or “in one implementation” or “in an implementation”, as well any other variations, appearing in various places throughout this application are not necessarily all referring to the same embodiment.
[0218] Additionally, this application may refer to “determining” various pieces of information. Determining the information can include one or more of, for example, estimating the information, calculating the information, predicting the information, retrieving the information from memory or obtaining the information for example from another device, module or from user.2025PF00253
[0219] Further, this application may refer to “accessing” various pieces of information. Accessing the information can include one or more of, for example, receiving the information, retrieving the information (for example, from memory), storing the information, moving the information, copying the information, calculating the information, determining the information, predicting the information, or estimating the information.
[0220] Additionally, this application may refer to “receiving” various pieces of information. Receiving is, as with “accessing”, intended to be a broad term. Receiving the information can include one or more of, for example, accessing the information, or retrieving the information (for example, from memory). Further, “receiving” is typically involved, in one way or another, during operations such as, for example, storing the information, processing the information, transmitting the information, moving the information, copying the information, erasing the information, calculating the information, determining the information, predicting the information, or estimating the information.
[0221] It is to be appreciated that the use of any of the following
[0222]
[0223] “and / or”, and “at least one of’, “one or more of’ for example, in the cases of “A / B”, “A and / or B” and “at least one of A and B”, “one or more of A and B” is intended to encompass the selection of the first listed option (A) only, or the selection of the second listed option (B) only, or the selection of both options (A and B). As a further example, in the cases of “A, B, and / or C” and “at least one of A, B, and C”, “one or more of A, B and C” such phrasing is intended to encompass the selection of the first listed option (A) only, or the selection of the second listed option (B) only, or the selection of the third listed option (C) only, or the selection of the first and the second listed options (A and B) only, or the selection of the first and third listed options (A and C) only, or the selection of the second and third listed options (B and C) only, or the selection of all three options (A and B and C). This may be extended, as is clear to one of ordinary skill in this and related arts, for as many items as are listed.
[0224] As will be evident to one of ordinary skill in the art, implementations or embodiments can produce a variety of signals formatted to carry information that can be, for example, stored or transmitted. The information can include, for example, instructions for performing a method, or data produced by one of the described implementations or embodiments. For example, a signal can be formatted to carry a2025PF00253
[0225] video content in the first or the second format of a described embodiment. Such a signal can be formatted, for example, as an electromagnetic wave (for example, using a radio frequency portion of spectrum) or as a baseband signal. The formatting can include, for example, encoding a video content in the first or the second format in an encoded stream (or bitstream) and modulating a carrier with the encoded stream. The information that the signal carries can be, for example, analog or digital information. The signal can be transmitted over a variety of different wired or wireless links, as is known. The signal can be stored on a processor-readable medium.
[0226] Various embodiments may refer to a bitstream. Bitstreams include, for example, any series or sequence of bits, and do not require that the bits be, for example, transmitted, received, or stored.
[0227] The various embodiments below are related to gamut clipping in the context of High Dynamic Range video (and even Standard Dynamic Range) that uses super-white levels. Let’s consider a device receiving a HDR video (or a SDR video), generally in “10” bits video format and in BT.2020 color gamut and using either PQ or HLG format (or BT.709 / BT.1886 format). If this device needs to convert the BT.2020 color gamut video into a BT.709 color gamut video, as seen above, using a basic gamut clipping method may produce hue shift in the resulting BT.709 video. The various embodiments propose is a new gamut clipping method that prevents hue shifts, while still allowing super- white levels preservation (i.e., super- white levels passthrough).
[0228] The proposed solution defines a gamut clipping method that has two features:
[0229] • Feature 1: it does not introduce hue shift when clipping to the highest value 1;
[0230] • Feature 2: it allows super-white levels preservation, i.e. it does not clip to “1” any component that belong to a super-white signal.
[0231] Fig- 4 illustrates a process for converting first YUV data in a first color gamut into second YUV data in a second color gamut, the first color gamut encompassing the second color gamut.
[0232] The process of Fig. 4 is for example executed by the processing module 20 of the TM module 13.2025PF00253
[0233] The first YUV data are for example the YUV data YUV2and the second YUV data are for example the YUV data YUV3described in relation to Fig. 1G.
[0234] In a step 40, the processing module 20 obtains the YUV data YUV2.
[0235] In a step 41, the processing module 20 applies a conversion process to the YUV data YUV2to obtain the YUV data YUV3.
[0236] Fig- 5 illustrates the conversion process executed in step 41.
[0237] In a step 410, the processing module 20 determines if all pixels of the YUV data YUV2have been processed. If no, step 410 is followed by a step 411.
[0238] In step 411, the processing module 20 obtains a pixel P_YUV2of the YUV data ruv2.
[0239] In a step 412, the processing module 20 applies steps 1300, 1301 and 1302 to obtain a pixel P_RGB3nof the RGB data RGB3nfrom the pixel Pyuv2■
[0240] In a step 413, the processing module 20 applies a gamut clipping method (corresponding to step 1303 in Fig. 1G) according to various embodiments described below to obtain a pixel C_P_RGB3inof the RGB data C_RGB3infrom the pixel P_RGB3lin.
[0241] In a step 414, the processing module 20 applies steps 134 and 135 to obtain a pixel P_YUV3of the YUV data YUV3.
[0242] Step 414 is followed by step 410 to continue with the next pixel of the YUV data YUV2. If no pixel remains in the YUV data YUV2the processing module stops the conversion process.
[0243] As detailed earlier, the (x, y) coordinates of a pixel in the CIE 1931 chromaticity diagram are obtained using linear combinations from the R, G and B components in the linear light domain. This means that: if all the R, G and B components are modified by a common multiplication factor, the resulting (x, y) coordinates does not change, therefore the hue remains the same; if any of the R, G and B components is modified by a multiplication factor that is different from the other R, G or B components, then the (x, y) coordinates are modified, therefore introducing a hue shift.
[0244] To prevent any hue shift when clipping, the principle of feature 1 is therefore to apply the same multiplication factor on the “3” R, G and B components, whenever one or more of the R, G and B components are above “1”.
[0245] RGB3lin2025PF00253
[0246] Fig- 6 illustrates schematically a clipping process preventing hue shift when clipping.
[0247] The process of Fig. 6 is applied in step 413 on a pixel P_RGB3linof the RGB data RGB3lin. The RGB data RGB3linare normalized, i.e., each component R, G or B of each pixel P_RGB3linof the RGB data RGB3linis in a normalized linear light representation. A value in such normalized linear light representation should be in [0..1] if in legal range (i.e., between “64” and “940” for a component Y). In this range “0” is called minimum range value min_range value and “1” is called maximum range value max range alue in the following. However, sub-blacks and super-whites are out of this range.
[0248] In a step 601, the processing module 20 obtains a pixel P_RGB3in.
[0249] In a step 602, the processing module 20 determines a maximum RGBMax between the components R, G and B of the pixel P_RGB3linand a scaling factor scale as a maximum between the maximum RGBMax and the maximum range value (i.e., “1”).
[0250] RGBMax = MAX(R_P_RGB3lin, G_P_RGB3in, B_P_RGB3in)
[0251] where MAX(x,y,z) outputs the maximum of x, y and z.
[0252] scale = M AX( / ??.o range value, RGBMax
[0253] where MAX(x,y) outputs the maximum of x and y.
[0254] In a step 603, the processing module 20 determines if scale if greater than max range value.
[0255] If scale > max range value, the processing module 20 applies a scaling in a step 604 to the components R, G and B of the pixel P_RGB3linby dividing each component by the scaling factor scale to obtain clipped components as follows:
[0256] C_R_P_RGB3in= R_P_RGB3in / scale,'
[0257] C_G_P_RGB3in= G_P_RGB3in / scale'
[0258] C_B_P_RGB3in= R_P_RGB3in / scale.
[0259] Step 604 is followed by a step 605 that ends the process.2025PF00253
[0260] If scale = max range value, the processing module 20 continues directly with step 605.
[0261] The process of Fig. 6 allows respecting feature 1, i.e., it prevents from hue shift when clipping. However, the process of Fig. 6 doesn’t allow to respect the feature 2 which is to preserve the super-white level signals.
[0262] Super-white levels generally concern the luminance component Y and not the chrominance components U and V. In other words, for super-white levels, U and V are generally close to their achromatic value, i.e. value 512 in “10” bits coding (see Table 9 in document Recommendation ITU-R BT.709-6, Parameter values for the HDTV standards for production and international programme exchange, 06 / 2015). This also means that R and G and B values are equal. For detecting a super- white level signal, a very simple method consists in checking if the R, G and B components are all equal and above the maximum range value max range value (when the components R, G and B are normalized. The maximum range value max_rangepvalue corresponds therefore to a lower bound of a range of values corresponding to the super-whites.
[0263] However, due to cumulative errors in the multiple quantization and transformation steps of any video system, some cases can appear where R, G and B values belonging to a super-white signal are not equal but relatively close to each other. Therefore, a pre-conditioning of the input R, G and B components should be introduced, before applying a clipping process. The pre-conditioning acts as a super-white level signal detector and is added to process of Fig. 6 to build a new gamut clipping strategy that is described hereafter.
[0264] Fig- 7 illustrates schematically a clipping process preventing hue shift and preserving super-white level signals when clipping.
[0265] The process of Fig. 6 is applied in step 413 on a pixel P_RGB3linof the RGB data RGBf11. Again, the RGB data RGBf11are normalized.
[0266] In a step 701, the processing module 20 obtains a pixel P_RGB^in.
[0267] In a step 702, the processing module 20 determines a maximum RGBMax between the components R, G and B of the pixel P_RGBfl n. a minimum RGBMin between the components R, G and B of the pixel P_RGBfn. a range value RGBRange,2025PF00253
[0268] a first scaling factor scale as a maximum between the maximum RGBMax and the maximum range value max_range value (max range value = 1 here), and a second scaling factor scale NFR initialized to the value of scale.
[0269] RGBMax = MAX(R_P_RGBjl n, G_P_RGBjl n, B_P_RGBjl n)
[0270] where MAX(x,y,z) outputs the maximum of x, y and z.
[0271]
[0272] RGBMin = , G_P_RGB3lin, B_P_RGB3in)
[0273] where MIN(x,y,z) outputs the minimum of x, y and z.
[0274] RGB Range = RGBMax - RGBMin.
[0275] scale = M AXfmo range value, RGBMax
[0276] where MAX(x,y) outputs the maximum of x and y.
[0277] In a step 703, the processing module 20 determines if scale is greater than the maximum range value max range _value. Step 703 allows distinguishing between a pixel corresponding to a potential super-white level (scale > max range value and a pixel not corresponding to a potential super-white level (scale < max range value). Pixel corresponding to a super-white level are in a range of values corresponding to super- whites.
[0278] If scale > max range value, the processing module 20 determines in a step 704, if the minimum RGBMin is greater than the maximum range value max_range value.
[0279] If RGBMin> max_range value in step 704, it is considered that the pixel P_RGB3lincorresponds to a super-white level. In order to process a super-white level, step 704 is followed by steps 705.
[0280] During step 705, the processing module 20 updates the second scaling factor scale NFR. To do so, a maximum value of the RGB component in the super-white (i.e., in the range of super-white values) NFRmax is defined. As a component of a superwhite signal has a maximum value, i.e. “24.077” for PQ or “1.811” for HLG, the maximum value NFRmax may be set to “24.077” when in PQ mode or “1.811” when in HLG mode, but another maximum value NFRmax may be chosen.
[0281] Then, to consider the cumulative errors in the multiple quantization and transformation steps of any video system, a progressive scaling is applied to the R, G and B components. If the difference between the highest value and the lowest value2025PF00253
[0282] (i.e., RGBRange) is not null, then a scaling is applied to ensure a smooth transition between a super-white signal and non-super-white signal detection. Two extreme conditions are then defined:
[0283] • Extreme condition 1 : When RGBrange is maximal (RGBrange equal to scale - max range value), then scale NFR = scale. This ensures smooth transition between super-white signal and non-super-white signal;
[0284] • Extreme condition 2: if all the three R, G and B components are equal, i.e RGBrange is miminal (for instance RGBrange = 0) then no scaling is applied, i.e. scale factor scale NFR = 1.
[0285] Between these two extreme conditions, a progressive intermediate scaling is applied.
[0286] In a first embodiment of a progressive intermediate scaling, the second scaling factor scale NFR = RGBRange + max range value (eq. 1).
[0287] Fig- 8 illustrates the first embodiment of a progressive intermediate scaling. In a second embodiment of a progressive intermediate scaling, the second scaling factor scale NFR is computed based on a power function.
[0288] Fig- 9 illustrates the second embodiment of a progressive intermediate scaling. In Fig. 9, the second scaling factor scale NFR is computed as follows:
[0289] scale_NFR = (scale — max_ranqe_value) X ( - RGBRange - \ _|_
[0290]
[0291] \scale-max_range_valuej max_range_value (eq. 2)
[0292] In summary, during step 705, if RGBrange = scale - max range value then scale NFR = scale,' Otherwise, if RGBRange = 0 then scale NFR = max range value,' otherwise, (RGBRange in [0 .. scale - max range value]) scale NFR is determined by using for example equations eq. 1 or eq. 2 to ensure a progressive intermediate scaling.
[0293] After step 705, the processing module 20 continues with step 706.2025PF00253
[0294] l RGBMin< max range value in step 704, the processing module 20 continues with step 706.
[0295] During step 706, the processing module 20 applies a scaling to the components of the pixel P_RGB3inas follows:
[0296] C_R_P_RGB3lin= R_P_RGB3lin / scale_NFR- C_G_P_RGB3in= G_P_RGB3lin / scale_NFR- C_B_P_RGB3in= R_P_RGB3in / scale_NFR.
[0297] Step 706 is followed by a step 707 during which a final clipping is applied as follows:
[0298] C_R_P_RGB3in= MIN(C_7?_P_7?GBjm, NFRmaxF
[0299] C_G_P_RGB3in= MW(C_G_P_RGB3lin, NFRmax ,
[0300] C_B_P_RGB3in= MTN(C_B_P_RGB3in, NFRmax).
[0301] Step 707 or step 703 when scale < max_range_value are followed by a step 708 that ends the process.
[0302] The gamut clipping process of Fig. 7 has been tested on the luminance ramp of Fig. 1H and on different contents on which hue shift artefacts were appearing when using a basic clipping method. This new gamut clipping process is solving the hue shift artefacts issues and allows super-white levels preservation.
[0303] Fig.10 represents a waveform of the output image resulting from an application of the process of Fig. 7 on the luminance ramp of Fig. 1H.
[0304] As can be seen in Fig. 10, the super- white level signals are now preserved.
[0305] Going back to example 1 above (R_P_RGB2in= 1, G_P_RGB2lin= 0.2 and B_P_RGB2in= 0.11), the clipping process of Fig. 7 produces the following RGB BT.709 components:
[0306] C_R_P_RGB3in= 1.0, C_G_P_RGB3in= 0.0659, C_B_P_RGB3lin= 0.055. In (x, y) coordinates: x = 0.565, y = 0.334.2025PF00253
[0307] Fig. 11 illustrates a first comparison of a basic clipping method and the clipping process of Fig. 7 in the CIE 1931 chromaticity diagram based on example 1.
[0308] Going back to example 2 above (R_P_RGB2in= 1, G_P_RGB2in= 0.2 and B_P_RGB2in= 1), the clipping process of Fig. 7 produces the following RGB BT.709 components:
[0309] C_R_P_RGB3in= 1.0, C_G_P_RGB3in= 0.0637, C_B_P_RGB3lin= 0.735. In (x, y) coordinates: x = 0.3539, y = 0.194.
[0310] Fig. 12 illustrates a second comparison of a basic clipping method and the clipping process of Fig. 7 in the CIE 1931 chromaticity diagram based on example 2.
[0311] In both examples, we clearly see on that figure that the original BT.2020 pixel and the converted BT.709 pixel before clipping are within the BT.709 color gamut and that there are matching. The BT.709 pixel after basic clipping has shifted from the original BT.2020 pixel and the converted BT.709 pixel before clipping, producing a hue shift that is very visible. The BT.709 pixel after the clipping process of Fig. 7 is now matching with the original BT.2020 pixel and the converted BT.709 pixel before clipping.
[0312] It should be noted that the various embodiments of a clipping method described above are also applicable to P3 contents into a BT2020 container. These embodiments are also applicable to other color management workflows such as the Academy Color Encoding System (ACES) that is characterized by other color spaces than BT.2020 or P3 or BT.709.
[0313] We described above a number of embodiments. Features of these embodiments can be provided alone or in any combination. Further, embodiments can include one or more of the following features, devices, or aspects, alone or in any combination, across various claim categories and types:
[0314] • A bitstream or signal that includes one or more of the described video content with converted color gamut using the proposed gamut clipping method, or variations thereof.
[0315] • Creating and / or transmitting and / or receiving and / or decoding a bitstream or signal that includes one or more of the described video content with converted color gamut using the proposed gamut clipping method, or variations thereof.2025PF00253
[0316] A server, camera, TV, set-top box, cell phone, tablet, personal computer or other electronic device that performs at least one of the embodiments described.
[0317] A TV, set-top box, cell phone, tablet, personal computer or other electronic device that performs at least one of the embodiments described, and that displays (e.g. using a monitor, screen, or other type of display) a resulting picture.
[0318] A TV, set-top box, cell phone, tablet, personal computer or other electronic device that tunes (e.g. using a tuner) a channel to receive a signal including an encoded video content with converted color gamut, and performs at least one of the embodiments described.
[0319] A TV, set-top box, cell phone, tablet, or other electronic device that receives (e.g. using an antenna) a signal over the air that includes a video content with converted color gamut, and performs at least one of the embodiments described.
[0320] A server, camera, cell phone, tablet, personal computer or other electronic device that tunes (e.g. using a tuner) a channel to transmit a signal including a video content with converted color gamut, and performs at least one of the embodiments described.
[0321] A server, camera, cell phone, tablet, personal computer or other electronic device that transmits (e.g. using an antenna) a signal over the air that includes a video content with converted color gamut, and performs at least one of the embodiments described.
Claims
2025PF00253Claims1. A method comprising:obtaining (40) a first YUV picture in a first color gamut;applying (41) a conversion process to the first YUV picture to obtain a second YUV picture in a second color gamut, the first color gamut encompassing the second color gamut, the conversion process comprising for a first YUV pixel of the first YUV picture:obtaining (412) a first RGB pixel in the second color gamut from the first YUV pixel; and,applying (413) a clipping process to the first RGB pixel to obtain a second RGB pixel in the second color gamut;wherein the clipping process comprises:detecting (703, 704) that the first RGB pixel is in a range of values corresponding to super-whites;determining (705) a scaling factor based on a difference between a maximum of components R, G and B of the first RGB pixel and a minimum of components R, G and B of the first RGB pixel; and,for each component R, G and B of the first RGB pixel, applying (706) the scaling factor to the component to obtain a scaled component; and,obtaining (707) a clipped component as a minimum between the scaled component and a maximum value of said component in the range of values corresponding to superwhites.
2. The method of claim 1 wherein, the first RGB pixel is in the range of values corresponding to super-whites if at least one component of the first RGB pixel is higher than a maximum range value, the maximum range value defining a lower bound of the range of values corresponding to super-whites, and responsive to the difference is equal to a maximum between the maximum range value and the maximum of components R, G and B of the first RGB pixel minus the maximum range value, the scaling factor is equal to the maximum between the maximum range value and the maximum of components R, G and B of the first RGB pixel.332025PF002533. The method of claim 1 wherein, the first RGB pixel is in the range of values corresponding to super-whites if at least one component of the first RGB pixel is higher than a maximum range value, the maximum range value defining a lower bound of the range of values corresponding to super-whites, and responsive to the difference is equal to zero, the scaling factor is equal to the maximum range value and applying (706) the scaling factor to the component to obtain a scaled component amounts at applying no scaling to the component to obtain the scaled component.
4. The method of claim 1 wherein, the first RGB pixel is in the range of values corresponding to super-whites if at least one component of the first RGB pixel is higher than a maximum range value, the maximum range value defining a lower bound of the range of values corresponding to super-whites, and responsive to the difference is between zero and a maximum between the maximum range value and the maximum of components R, G and B of the first RGB pixel minus the maximum range value, the scaling factor is based on an increasing function of the difference with values between the maximum range value and a maximum between the maximum range value and the maximum of components R, G and B of the first RGB pixel.
5. The method of any previous claim wherein, each component of the first RGB pixel has a normalized value in a normalized linear light representation.
6. A device comprising electronic circuitry configured for:obtaining (40) a first YUV picture in a first color gamut;applying (41) a conversion process to the first YUV picture to obtain a second YUV picture in a second color gamut, the first color gamut encompassing the second color gamut, the conversion process comprising for a first YUV pixel of the first YUV picture:obtaining (412) a first RGB pixel in the second color gamut from the first YUV pixel; and,applying (413) a clipping process to the first RGB pixel to obtain a second RGB pixel in the second color gamut;wherein the clipping process comprises:detecting (703, 704) that the first RGB pixel is in a range of values corresponding to super-whites;342025PF00253determining (705) a scaling factor based on a difference between a maximum of components R, G and B of the first RGB pixel and a minimum of components R, G and B of the first RGB pixel; and,for each component R, G and B of the first RGB pixel, applying (706) the scaling factor to the component to obtain a scaled component; and,obtaining (707) a clipped component as a minimum between the scaled component and a maximum value of said component in the range of values corresponding to superwhites.
7. The device of claim 6 wherein, the first RGB pixel is in the range of values corresponding to super-whites if at least one component of the first RGB pixel is higher than a maximum range value, the maximum range value defining a lower bound of the range of values corresponding to super-whites, and responsive to the difference is equal to a maximum between the maximum range value and the maximum of components R, G and B of the first RGB pixel minus the maximum range value, the scaling factor is equal to the maximum between the maximum range value and the maximum of components R, G and B of the first RGB pixel.
8. The device of claim 6 wherein, the first RGB pixel is in the range of values corresponding to super-whites if at least one component of the first RGB pixel is higher than a maximum range value, the maximum range value defining a lower bound of the range of values corresponding to super-whites, and responsive to the difference is equal to zero, the scaling factor is equal to the maximum range value and applying (706) the scaling factor to the component to obtain a scaled component amounts at applying no scaling to the component to obtain the scaled component.
9. The device of claim 6 wherein, the first RGB pixel is in the range of values corresponding to super-whites if at least one component of the first RGB pixel is higher than a maximum range value, the maximum range value defining a lower bound of the range of values corresponding to super-whites, and responsive to the difference is between zero and a maximum between the maximum range value and the maximum of components R, G and B of the first RGB pixel minus the maximum range value, the scaling factor is based on an2025PF00253increasing function of the difference with values between the maximum range value and a maximum between the maximum range value and the maximum of components R, G and B of the first RGB pixel.
10. The device of any previous claim from claim 6 to 9 wherein, each component of the first RGB pixel has a normalized value in a normalized linear light representation.
11. Non-transitory information storage medium storing program code instructions for implementing the method of any previous claim 1 to 5.
12. A computer program comprising program code instructions for implementing the method of any previous claim 1 to 5.
