Tone mapping with configurable HDR and SDR diffuse white levels

By employing a configurable HDR diffuse white level and dynamic tone mapping, the method addresses the limitations of fixed HDR diffuse white, enhancing artistic freedom and image quality in HDR content production.

JP2024542946APending Publication Date: 2024-11-19INTERDIGITALCE PATENT HLDG SAS
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2024523392
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2021-11-08
Filing Date
2022-10-24
Publication Date
2024-11-19

Smart Images

  • Figure 2024542946000001_ABST
    Figure 2024542946000001_ABST
Patent Text Reader

Abstract

1. A method comprising: obtaining high dynamic range data (401); calculating a first tone mapping curve from the high dynamic range data corresponding to a low high dynamic range value of the combined tone mapping curve, the first tone mapping curve terminating at a point, called a first point, having an abscissa representing a high dynamic range diffuse white and an ordinate representing a standard dynamic range diffuse white, the combined tone mapping curve making it possible to obtain standard dynamic range data from the high dynamic range data; and completing the combined tone mapping curve with a second tone mapping curve for the high standard dynamic range starting from the first point (404).
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] At least one of the present embodiments generally relates to a method and device for generating a standard dynamic range (SDR) video from a high dynamic range (HDR) video, and in particular to a method and device for defining a tone mapping curve. [Background technology]

[0002] Recent advances in display technology allow for an extended dynamic range of color, brightness, and contrast in displayed images. The term image, as used herein, refers to image content, which may be, for example, video or a still picture or image.

[0003] High dynamic range (HDR) video consists of video with an extended dynamic range compared to that of standard dynamic range (SDR) video. HDR video is captured by an HDR capture device and displayed by a display device capable of brighter whites and deeper blacks. To address this, HDR-enabled coding standards allow for increased maximum luminance and use at least 10-bit dynamic range (compared to a maximum of 8-bit for non-professional SDR video and a maximum of 10-bit for professional SDR video) to maintain matched accuracy over this extended range.

[0004] HDR production is an emerging field, and there is a transition phase where both HDR and SDR content coexist. During this coexistence phase, the same live content is produced simultaneously in HDR and SDR versions. Users can then view either the HDR or SDR version of the content depending on their preferences or capabilities.

[0005] The current trends in the content production industry are as follows: First, generate the HDR content, then use an automated tool to automatically derive the SDR content from the HDR content. Second, it applies a controlled and safe approach to HDR production to avoid delivering bad HDR content to users, which may be counterproductive to HDR technology.

[0006] In that regard, several recommendations have been introduced by the ITU-R document "Report ITU-R BT.2408-3, Guidance for operational practices in HDR television production, 07 / 2019", hereafter simply referred to as the BT.2408-3 report. One important recommendation introduced in the BT.2408-3 report is the constraint to set HDR diffuse white to a fixed value equal to "203" nits. This constraint makes it possible to use a fixed 3D Look-Up Table (LUT) to perform the SDR to HDR conversion (i.e., Inverse Tone Mapping (ITM)) and the HDR to SDR conversion (Tone Mapping (TM)).

[0007] Setting HDR diffuse white to a fixed value equal to 203 nits is a strong constraint for content creators: in fact, these constraints do not utilize HDR cameras to their full potential and photo ops / directors are severely limited in their choices / artistic intent.

[0008] It would be desirable to overcome the above deficiencies.

[0009] It would be particularly desirable to propose a system that allows for more flexibility, more artistic freedom in HDR / SDR content production. Summary of the Invention

[0010] In a first aspect, one or more of the present embodiments provide a method, the method including: obtaining high dynamic range data; calculating a first tone mapping curve from the high dynamic range data corresponding to a low high dynamic range value of the combined tone mapping curve, the first tone mapping curve ending at a point, called a first point, having an abscissa representing a high dynamic range diffuse white and an ordinate representing a standard dynamic range diffuse white, the combined tone mapping curve enabling the first tone mapping curve to obtain standard dynamic range data from the high dynamic range data; and completing the combined tone mapping curve using a second tone mapping curve for the high standard dynamic range starting from the first point.

[0011] In one embodiment, the second tone mapping curve is a straight line.

[0012] In one embodiment, the second tone mapping curve comprises a parabola.

[0013] In one embodiment, the method further includes calculating the standard dynamic range data from the high dynamic range data using the combined tone mapping curve.

[0014] In one embodiment, the method includes estimating metadata representative of the joint tone mapping curve.

[0015] In one embodiment, calculating the first tone mapping curve includes obtaining an intermediate tone mapping curve from the high dynamic range data, where non-linear luminance values ​​of the high dynamic range data that are less than the high dynamic range diffuse white are mapped to non-linear luminance values ​​of the standard dynamic range data, rescaling the abscissa of the intermediate tone mapping curve from a range of luminance values ​​of the high dynamic range data between 0 and the high dynamic range diffuse white to a range of luminance values ​​of the high dynamic range data between 0 and a maximum luminance value of the high dynamic range data, and mapping the ordinate of the intermediate tone mapping curve to a range of luminance values ​​of the standard dynamic range data between 0 and a value that depends on the standard dynamic range diffuse white to obtain the first tone mapping curve.

[0016] In one embodiment, prior to mapping, the ordinates of the mid-tone mapping curve are transformed in a perceptually uniform domain such that the transformed ordinate values ​​are between 0 and the maximum ordinate value corresponding to the maximum luminance value of the standard dynamic range data.

[0017] In a second aspect, one or more of the present embodiments provide a device comprising an electronic circuit configured to obtain high dynamic range data, calculate a first tone mapping curve from the high dynamic range data corresponding to a low high dynamic range value of the combined tone mapping curve, the first tone mapping curve ending at a first point having an abscissa representing a high dynamic range diffuse white and an ordinate representing a standard dynamic range diffuse white, the combined tone mapping curve enabling obtaining standard dynamic range data from the high dynamic range data, and complete the combined tone mapping curve using a second tone mapping curve for the high standard dynamic range starting from the first point.

[0018] In one embodiment, the second curve is a straight line.

[0019] In one embodiment, the second curve comprises a parabola.

[0020] In one embodiment, the electronic circuitry is further configured to calculate the standard dynamic range data from the high dynamic range data using the joint tone mapping curve.

[0021] In an embodiment, the electronic circuitry is further configured to estimate metadata representative of the combined tone mapping curve.

[0022] In one embodiment, calculating the first tone mapping curve comprises: The method includes obtaining an intermediate tone mapping curve from the high dynamic range data, where non-linear luminance values ​​of the high dynamic range data that are less than the high dynamic range diffuse white are mapped to non-linear luminance values ​​of the standard dynamic range data; rescaling the abscissa of the intermediate tone mapping curve from a range of luminance values ​​of the high dynamic range data between 0 and the high dynamic range diffuse white to a range of luminance values ​​of the high dynamic range data between 0 and a maximum luminance value of the high dynamic range data; and mapping the ordinate of the intermediate tone mapping curve to a range of luminance values ​​of the standard dynamic range data between 0 and a value dependent on the standard dynamic range diffuse white to obtain a first tone mapping curve.

[0023] In one embodiment, prior to mapping, the ordinates of the mid-tone mapping curve are transformed in a perceptually uniform domain such that the transformed ordinate values ​​are between 0 and the maximum ordinate value corresponding to the maximum luminance value of the standard dynamic range data.

[0024] In a third aspect, one or more of the present embodiments provide a signal generated using the method of the first aspect or using the device of the second aspect.

[0025] In a fourth aspect, one or more of the present embodiments provide a computer program comprising program code instructions for implementing a method according to the first aspect.

[0026] In a fifth aspect, one or more of the present embodiments provide a non-transitory information storage medium storing program code instructions for implementing a method according to the first aspect. [Brief description of the drawings]

[0027] [Figure 1A] Specifies the scale of luminance values ​​on which diffuse white appears. [Figure 1B] This shows the separation of the scale of luminance values ​​when the diffuse white is fixed at 203 nits. [Diagram 2] 1 illustrates a schematic of the context of various embodiments; [Figure 3A] 1 illustrates generally an example of a hardware architecture of a processing module capable of implementing various aspects and embodiments. [Figure 3B] 1 illustrates a block diagram of an example of a first system in which various aspects and embodiments may be implemented. [Figure 3C] FIG. 2 illustrates a block diagram of an example of a second system in which various aspects and embodiments may be implemented. [Figure 4] 4 illustrates an example of a tone mapping curve construction method according to various embodiments. [Diagram 5] Provides examples of tone mapping curves in the SL-HDR1 context. [Figure 6] 4 shows the tone mapping curve obtained by the tone mapping curve construction method of SL-HDR1. [Figure 7] 4 shows a tone mapping curve obtained by the tone mapping curve construction method of various embodiments. [Figure 8] 1 provides an example of a tone mapping lookup table. [Figure 9] 4 illustrates generally in detail the rescaling process applied to a tone mapping look-up table; [Figure 10] 13 provides examples of the shapes of tone mapping curves corresponding to transformed tone mapping lookup tables in the perceptually uniform domain. [Figure 11] 13 provides examples of tone mapping curve shapes corresponding to rescaled tone mapping lookup tables. [Figure 12] We provide an example of a combined TM curve obtained by combining a specular TM curve and a detail TM curve implemented using a straight line. [Figure 13] We provide an example of a combined TM curve obtained by combining a specular TM curve and a detail TM curve implemented using a parabola. [Figure 14] 1 illustrates an example process for determining intensity mapping parameters. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0028] As mentioned earlier, the BT.2408-3 report proposed some recommendations, especially constraints on diffuse white. Diffuse white is defined in the BT.2408-3 report as "the white color provided by a card that approximates a perfect reflecting diffuser by minimizing specular highlights and minimizing spectral power absorptance, being not only colorimetrically gray but also spectrally gray." A "perfect reflecting diffuser" is defined as "an ideal isotropic non-fluorescent diffuser with a spectral radiance coefficient equal to 1 at each wavelength of interest."

[0029] In other words, diffuse white is the luminance level of a video signal that separates: A scene with all the details, corresponding to luminance levels below diffuse white. Specular, i.e. very bright pixels, typically close to white, with very little detail and corresponding to luminance levels above the diffuse white level.

[0030] Figure 1A shows the scale of luminance values ​​on which diffuse white appears. As can be seen, diffuse white separates the set of all possible luminance values ​​into two parts.

[0031] The concept of diffuse white is valid for HDR and SDR signals.

[0032] The BT.2408-3 report specifies that HDR diffuse white is equal to "203" nits.

[0033] However, the "203" nit limit is only a recommendation, and many content creators disagree with that recommendation.

[0034] In fact, this specification has the major drawback of constraining HDR content: for a typical 1000 nit HDR content, only a small amount of the HDR luminance range [0; 203 nit] is devoted to scene detail, and the largest part of the HDR luminance range [203; 1000 nit] is reserved for specular reflections that do not introduce detail.

[0035] FIG. 1B shows the separation of the luminance value scales when the diffuse white is fixed at 203 nits.

[0036] One of the reasons for this restriction is the need for controlled and "very safe" live HDR content generation. In addition, this restriction has the following advantages: · Implementing HDR to SDR conversion (i.e. tone mapping (TM)) is simpler since HDR diffuse white defined at '203' nits needs to be mapped to SDR diffuse white, which is typically defined at 90%-100% of the maximum SDR value (i.e. 90nit-100nit). Therefore tone mapping can be implemented using a very basic static 3D-LUT. Implementing SDR to HDR conversion (i.e. Inverse Tone Mapping (ITM)) is also simpler for the same reason, and ITM can also be implemented with a very basic static 3D-LUT.

[0037] However, such a ratio between the luminance values ​​assigned to scene details and the luminance values ​​assigned to the specular reflections caused by a diffuse white of 203 nits makes the resulting HDR image very dull and unattractive.

[0038] The following embodiments make it possible to remove these drawbacks by proposing a system that allows more flexibility and more artistic freedom in HDR creation, thus making it possible to obtain more attractive HDR content by using: Configurable and dynamic HDR diffuse white level (tone mapping) from HDR to SDR; -Dynamic HDR to SDR conversion (tone mapping).

[0039] FIG. 2 illustrates an example of a context in which various embodiments may be implemented.

[0040] In Fig. 2, a source device 20, for example an HDR camera, generates HDR video and provides the HDR video to an encoding device 21. The encoding device applies a tone mapping (TM) process to the HDR video to generate SDR video. The SDR video is then encoded using a video compression standard, such as, for example, AVC ((ISO / CEI 14496-10 / ITU-T H.264), HEVC (ISO / IEC 23008-2-MPEG-H Part 2, High Efficiency Video Coding / ITU-T H.265)), VVC (ISO / IEC 23090-3-MPEG-I, Versatile Video Coding / ITU-T H.266), or any other video compression standard.

[0041] Encoding device 21 provides (transmits over a communications network) a stream containing encoded SDR video to decoding device 22. The decoding device decodes the encoded SDR video and provides the decoded SDR video to display device 23. Display device 23 is capable of displaying the SDR video.

[0042] In another embodiment, decoding device 22 decodes the encoded SDR video and applies an inverse tone mapping (ITM) process to the decoded SDR video to generate HDR video. The generated HDR video is then provided to a display device 23 capable of displaying the HDR video. In this embodiment, for example, encoding device 21 provides metadata representing TM curves along with the SDR data. These metadata help guide the ITM process applied by decoding device 22.

[0043] 3A illustrates generally one example of a hardware architecture for a processing module 30 capable of implementing various processes executed by the encoding device 21 or the decoding device 22. For example, the processing module 30 is adapted to implement the processes described below in connection with FIG. The processing module 30 includes a processor or central processing unit (CPU) 300, which may include, by way of non-limiting example, one or more microprocessors, general purpose computers, special purpose computers, and processors based on multi-core architectures, connected by a communication bus 305; a random access memory (RAM) 301; a read only memory (ROM) 302; and a memory device such as an electrically erasable programmable read-only memory (EEPROM), a read only memory (ROM), a programmable read-only memory (PROM), a random access memory (RAM), a dynamic random access memory (DRAM), a static random access memory (SRAM), a flash, a magnetic disk drive, and / or an optical disk drive, or a secure digital (SD) card reader and / or a hard disk drive. The system includes a storage unit 303, which may include non-volatile and / or volatile memory, including but not limited to a storage media reader and / or a network accessible storage device, such as a storage drive (HDD), and at least one communication interface 304 for exchanging data with other modules, devices, or equipment. The communication interface 304 may include but is not limited to a transceiver configured to transmit and receive data over a communication channel.The communication interface 304 may include, but is not limited to, a modem or a network card.

[0044] When processing module 30 implements the processes of encoding device 21, communications interface 304 may, for example, enable processing module 30 to receive HDR video and provide a stream including encoded SDR video. When processing module 30 implements the processes of decoding device 22, communications interface 304 may, for example, enable processing module 30 to receive a stream including encoded SDR video and provide decoded SDR or HDR video.

[0045] The processor 300 can execute instructions loaded into the RAM 301 from a ROM 302, an external memory (not shown), a storage medium, or a communication network. When the processing module 30 is powered on, the processor 300 can read instructions from the RAM 301 and execute them. These instructions form, for example, a computer program that causes the processor 300 to carry out a process of the encoding device 21 or a process of the decoding device 22, which will be described below in connection with FIG. 4.

[0046] All or part of the algorithms and steps of the processes performed by the encoding device 21 or the decoding device 22 may be implemented in software form by execution of a set of instructions by a programmable machine such as a Digital Signal Processor (DSP) or a microcontroller, or may be implemented in hardware form by a machine or dedicated component such as a Field-Programmable Gate Array (FPGA) or an Application-Specific Integrated Circuit (ASIC).

[0047] FIG. 3C illustrates a block diagram of an example of a decoding device 22 in which various aspects and embodiments may be implemented. The decoding device 22 may be embodied as a device including various components described below and configured to perform one or more of the aspects and embodiments described herein. Examples of such devices include various electronic devices, such as, but not limited to, personal computers, laptop computers, smartphones, tablet computers, digital multimedia set-top boxes, digital television receivers, personal video recording systems, and connected home appliances. The elements of the decoding device 22, alone or in combination, may be embodied in a single Integrated Circuit (IC), multiple ICs, and / or separate components. For example, in at least one embodiment, the decoding device 22 includes one processing module 30 that implements a decoding module or an ITM module. However, in another embodiment, the decoding device 22 may include a first processing module 30 that implements a decoding module and a second processing module 30 that implements an ITM module, or one processing module 30 that implements a decoding module and an ITM module. In various embodiments, decoding device 22 is communicatively coupled to one or more other systems or other electronic devices, for example, via a communications bus or through dedicated input and / or output ports, and is configured to implement one or more of the aspects described herein.

[0048] The decoding device 22 includes at least one processing module 30 capable of implementing a decoding module.

[0049] Input to processing module 30 may be provided via various input modules, as shown in input block 32. Such input modules may include, but are not limited to, (i) a radio frequency (RF) module that receives, for example, a radio frequency (RF) signal transmitted over the air from a broadcast station, (ii) a component (COMP) input module (or a set of COMP input modules), (iii) a Universal Serial Bus (USB) input module, and / or (iv) a High Definition Multimedia Interface (HDMI) input module. Other examples include composite video, not shown in FIG. 3C.

[0050] In various embodiments, the input modules of input block 32 have associated respective input processing elements as known in the art. For example, the RF module may be associated with elements suitable for (i) selecting a desired frequency (also referred to as selecting a signal or band-limiting a signal to a frequency band), (ii) down-converting the selected signal, (iii) band-limiting again to a narrower frequency band to select a signal frequency band, which in certain embodiments may be referred to (for example) as a channel, (iv) demodulating the down-converted and band-limited signal, (v) performing error correction, and (vi) demultiplexing to select a desired stream of data packets. The RF module of various embodiments includes one or more elements that perform these functions, such as a frequency selector, a signal selector, a band limiter, a channel selector, a filter, a down-converter, a demodulator, an error corrector, and a demultiplexer. The RF section may include, for example, a tuner that performs various of these functions, including down-converting a received signal to a lower frequency (e.g., an intermediate frequency or a frequency close to baseband) or to baseband. In one embodiment of a set-top box, the RF module and its associated input processing elements receive RF signals transmitted over a wired (e.g., cable) medium and perform frequency selection by filtering, downconverting, and refiltering to a desired frequency band. Various embodiments rearrange the order of the above-described (and other) elements, remove some of these elements, and / or add other elements that perform similar or different functions. Adding elements may include inserting elements between existing elements, such as, for example, inserting amplifiers and analog-to-digital converters. In various embodiments, the RF module includes an antenna.

[0051] Additionally, the USB module and / or the HDMI module may include respective interface processors for connecting the decoding device 22 to other electronic devices via a USB connection and / or an HDMI connection. It should be understood that various aspects of the input processing, e.g., Reed-Solomon error correction, may be implemented, for example, in a separate input processing IC or within the decoding device 22, as appropriate. Similarly, aspects of the USB or HDMI interface processing may be implemented in a separate interface IC or within the processing module 30, as appropriate. The demodulated, error corrected, and demultiplexed stream is provided to the processing module 30.

[0052] The various elements of the decoding device 22 may be provided within a unitary housing. Within the unitary housing, the various elements may be interconnected and transmit data between them using any suitable connection arrangement, e.g., an internal bus, including an Inter-IC (I2C) bus, wiring, and printed circuit boards, as known in the art. For example, in the decoding device 22, the processing module 30 is interconnected to the other elements of the decoding device 22 by a bus 305.

[0053] The communication interface 304 of the processing module 30 enables the decoding device 22 to communicate over a communication channel 31. The communication channel 31 may be implemented, for example, in a wired and / or wireless medium.

[0054] In various embodiments, data is streamed or otherwise provided to the decoding device 22 using a wireless network such as a Wi-Fi network, e.g., IEEE 802.11 (IEEE refers to the Institute of Electrical and Electronics Engineers). The Wi-Fi signal in these embodiments is received by a communication channel 31 and a communication interface 304 adapted for Wi-Fi communication. The communication channel 31 in these embodiments is typically connected to an access point or router that provides access to external networks, including the Internet, to enable streaming applications and other over-the-top communications. In other embodiments, a set-top box that delivers data through an HDMI connection of the input block 32 is used to provide the streamed data to the decoding device 22. In yet other embodiments, an RF connection of the input block 32 is used to provide the streamed data to the decoding device 22. As indicated above, various embodiments provide the data in a non-streaming manner. Additionally, various embodiments use wireless networks other than Wi-Fi, e.g., a cellular network or a Bluetooth network.

[0055] The decoding device 22 can provide output signals to various output devices, including a display device 23, speakers 36, and other peripheral devices 37. The display device 23 of various embodiments includes, for example, one or more of a touch screen display, an Organic Light-Emitting Diode (OLED) display, a curved display, and / or a foldable display. The display device 23 can be for a television, a tablet, a laptop, a mobile phone (smartphone), or other device. The display device 23 can also be integrated with other components (e.g., like a smartphone) or can be separate (e.g., an external monitor for a laptop). The other peripheral devices 37, in various example embodiments, include one or more of a standalone digital video disc (or digital versatile disc) (DVR in both terms), a disc player, a stereo system, and / or a lighting system. Various embodiments use one or more peripheral devices 37 that provide functionality based on the output of the decoding device 22. For example, a disc player performs the functionality of playing the output of the decoding device 22.

[0056] In various embodiments, control signals are communicated between the decoding device 22 and the display device 23, speakers 36, or other peripheral devices 37 using signal transmission such as AV.Link, Consumer Electronics Control (CEC), or other communication protocols that allow control between devices with or without user intervention. The output devices can be communicatively coupled to the decoding device 22 via dedicated connections through respective interfaces 33, 34, and 35. Alternatively, the output devices can be connected to the decoding device 22 using the communication channel 31 via the communication interface 304. The display device 23 and speakers 36 can be integrated into a single unit with other components of the decoding device 22 in an electronic device such as, for example, a television. In various embodiments, the display interface 33 includes a display driver, such as, for example, a Timing Controller (T Con) chip.

[0057] Alternatively, display device 23 and speakers 36 may be separate from one or more of the other components, for example if the RF module of input 32 is part of a separate set-top box. In various embodiments in which display device 23 and speakers 36 are external components, the output signal may be provided via a dedicated output connection including, for example, an HDMI port, a USB port, or a COMP output.

[0058] FIG. 3B illustrates a block diagram of an example of an encoding device 21 in which various aspects and embodiments are implemented. The encoding device 21 is very similar to the decoding device 22. The encoding device 21 may be embodied as a device including various components described below and configured to perform one or more of the aspects and embodiments described herein. Examples of such devices include, but are not limited to, various electronic devices such as personal computers, laptop computers, smartphones, tablet computers, cameras, and servers. The elements of the encoding device 21, alone or in combination, may be embodied in a single Integrated Circuit (IC), multiple ICs, and / or separate components. For example, in at least one embodiment, the encoding device 21 comprises a processing module 30 that performs the processes of the encoding device 21. In various embodiments, the encoding device 21 is communicatively coupled to one or more other systems or other electronic devices, for example, via a communication bus or through dedicated input and / or output ports. In various embodiments, the encoding device 21 is configured to implement one or more of the aspects described herein.

[0059] Input to processing module 30 may be provided via various input modules, as shown in input block 32 already described with respect to FIG. 3C.

[0060] The various elements of the encoding device 21 may be provided within a unitary housing, where the various elements may be interconnected and transmit data between them using any suitable connection arrangement, e.g., an internal bus, including an Inter-IC (I2C) bus, wiring, and printed circuit boards, as known in the art. For example, in the encoding device 21, the processing module 30 is interconnected to the other elements of the encoding device 21 by a bus 305.

[0061] The communications interface 304 of the processing module 30 enables the encoding device 21 to communicate over a communications channel 31 .

[0062] Data is streamed or otherwise provided to the encoding device 21 in various embodiments using a wireless network such as a Wi-Fi network, e.g., IEEE 802.11 (IEEE refers to the Institute of Electrical and Electronics Engineers). The Wi-Fi signal in these embodiments is received by a communication channel 31 and a communication interface 304 adapted for Wi-Fi communication. The communication channel 31 in these embodiments is typically connected to an access point or router that provides access to external networks, including the Internet, to enable streaming applications and other over-the-top communications. In other embodiments, an RF connection of the input block 32 is used to provide the streamed data to the encoding device 21.

[0063] As noted above, various embodiments provide data in a non-streaming manner. Additionally, various embodiments use wireless networks other than Wi-Fi, such as cellular networks or Bluetooth networks.

[0064] The data provided to the encoding device 21 is typically raw HDR video, for example provided by an HDR camera 20 connected to the encoding device 21.

[0065] Encoding device 21 may provide output signals to various output devices, such as decoding device 22, which may store and / or decode the output signals.

[0066] Various implementations involve decoding. As used in this application, "decoding" may encompass all or part of the processes performed on a received encoded video stream to generate a final output suitable for, e.g., a display. In various embodiments, such processes include one or more of the processes typically performed by a decoder, such as, e.g., entropy decoding, inverse quantization, inverse transform, and prediction.

[0067] Various implementations involve encoding. Similar to the above discussion regarding "decoding," as used in this application, "encoding" may encompass all or part of the processes performed on an input RAW SDR video to generate, for example, an encoded SDR video stream. In various embodiments, such processes include one or more of the processes typically performed by an encoder, such as, for example, partitioning, prediction, transformation, quantization, and entropy coding.

[0068] Where a figure is presented as a flow diagram, it should be understood that the figure also provides a block diagram of the corresponding apparatus. Similarly, where a figure is presented as a block diagram, it should be understood that the figure also provides a flow diagram of the corresponding method / process.

[0069] The implementations and aspects described herein may be implemented, for example, in a method or process, an apparatus, a software program, a data stream, or a signal. Even if discussed in the context of only a single implementation form (e.g., discussed only as a method), the implementation of the discussed features may also be implemented in other forms (e.g., an apparatus or a program). For example, an apparatus may be implemented in suitable hardware, software, and firmware. A method may be implemented, for example, in a processor, where a processor refers to a general processing device including, for example, a computer, a microprocessor, an integrated circuit, or a programmable logic device. Processors also include communication devices, such as, for example, computers, mobile phones, portable / personal digital assistants ("PDAs"), and other devices that facilitate communication of information between end users.

[0070] References to "one embodiment" or "an embodiment" or "one implementation" or "an implementation," as well as other variations thereof, mean that a particular feature, structure, characteristic, etc. described in connection with that embodiment is included in at least one embodiment. Thus, the appearances of the phrases "in one embodiment" or "an embodiment" or "in one implementation" or "in an implementation," as well as other variations thereof, appearing in various places throughout this application are not necessarily all referring to the same embodiment.

[0071] Additionally, the application may refer to "determining" various information. Determining information may include, for example, one or more of estimating information, calculating information, predicting information, retrieving information from a memory, or retrieving information from, for example, another device, module, or user.

[0072] Additionally, the application may refer to "accessing" various information. Accessing information may include, for example, one or more of receiving information, retrieving information (e.g., from a memory), storing information, moving information, copying information, calculating information, determining information, predicting information, or estimating information.

[0073] Additionally, the application may refer to "receiving" various information. Receiving, like "accessing," is intended to be a broad term. Receiving information may include, for example, one or more of accessing information or retrieving information (e.g., from a memory). Furthermore, "receiving" generally involves in some manner, for example, an operation such as storing information, processing information, transmitting information, moving information, copying information, erasing information, calculating information, determining information, predicting information, or estimating information.

[0074] Use of any of the terms " / ", "and / or", "at least one of", "one or more", e.g., "A / B", "A and / or B", "at least one of A and B", "one or more of A and B" is intended to encompass the selection of only the first listed alternative (A), or the selection of only the second listed alternative (B), or the selection of both alternatives (A and B). As a further example, "A, B, and / or C" and "at least one of A, B, and C", "one or more of A, B, and C" are intended to encompass the selection of only the first listed alternative (A), or the selection of only the second listed alternative (B), or the selection of only the third listed alternative (C), or the selection of only the first and second listed alternatives (A and B), or the selection of only the first and third listed alternatives (A and C), or the selection of only the second and third listed alternatives (B and C), or the selection of all three alternatives (A, B, and C). This may be expanded to include as many of the items listed as would be apparent to one of ordinary skill in this and related arts.

[0075] Also, as used herein, the term "signaling" means to indicate something, especially to a corresponding decoder. For example, in certain embodiments, an encoder signals the use of some coding tools. In this way, in embodiments, the same parameters can be used at both the encoder and decoder sides. Thus, for example, an encoder can transmit a specific parameter to a decoder (explicit signaling) so that the decoder can use the same specific parameter. In contrast, if the decoder already has the specific parameter as well as other parameters, a non-transmitting signaling (implicit signaling) can be used to simply allow the decoder to know and select the specific parameter. By avoiding the transmission of any actual function, bit savings are realized in various embodiments. It will be understood that signaling can be achieved in various ways. For example, one or more syntax elements, flags, etc. are used in various embodiments to signal information to a corresponding decoder. The above relates to the verb form of the word "signal", which may also be used as a noun in this specification.

[0076] As would be apparent to one skilled in the art, implementations can result in a variety of signals formatted to carry information that can be, for example, stored or transmitted. Information can include, for example, instructions for performing a method or data generated by one of the described implementations. For example, a signal can be formatted to carry encoded SDR video. Such a signal can be formatted, for example, as an electromagnetic wave (e.g., using a radio frequency portion of the spectrum) or as a baseband signal. Formatting can include, for example, encoding the encoded video stream and modulating a carrier wave with the encoded video stream. The information that the signal carries can be, for example, analog information or digital information. As is known, the signal can be transmitted over a variety of different wired or wireless links. The signal can be stored in a processor-readable medium.

[0077] Various embodiments may refer to a bitstream, which may include, for example, any series or sequence of bits, not necessarily data bits, for example, being transmitted, received, or stored.

[0078] Some of the following embodiments relate to constructing a tone mapping curve. How to construct a tone mapping curve, together with the variables that define this curve, is detailed in section 7.2.3.1 of specification ETSI TS 103 433-1 v1.4.1, High-Performance Single Layer High Dynamic Range (HDR) System for use in Consumer Electronics devices; Part 1: Directly Standard Dynamic Range (SDR) Compatible HDR System (SL-HDR1), 08 / 2021, hereinafter referred to as SL-HDR1.

[0079] FIG. 5 provides an example of a tone mapping curve in the SL-HDR1 context.

[0080] The tone mapping curve is applied in a perceptually uniform region and is a piecewise curve that contains three parts. Bottom section: The bottom section is linear and its steepness is determined by the parameter shadowGain. · Upper section: The upper section is also linear and its steepness is determined by the parameter highlightGain. Mid Section: The mid section is a parabola that provides a smooth bridge between the two linear sections. The width of the crossover is determined by the parameter midToneWidthAdjFactor.

[0081] The example tone mapping curve in FIG. 3 is the result of a method of constructing a tone mapping curve that does not consider either HDR or SDR diffuse white.

[0082] The main constraints followed by the TM curve construction method described in SL-HDR1 are the following:

[0083] Map the HDR null luminance value (0 nit) to the SDR minimum value (0 nit) which is defined as the origin. Map the HDR peak luminance value (i.e. maximum HDR luminance value) to the SDR maximum value (100nit), which is defined as the maximum target point. Define the TM curve between the origin and the maximum target.

[0084] FIG. 6 shows the tone mapping curve obtained by the TM curve construction method of SL-HDR1.

[0085] In the TM curve construction method proposed in the following embodiments, HDR diffuse white and SDR diffuse white are considered with two additional constraints: -HDR diffuse white value that is always less than or equal to HDR peak luminance, · SDR diffuse white value that is always below SDR max (100nit).

[0086] The principle of the new TM curve construction method is as follows. · Map the HDR null luminance value (0 nit) to the minimum SDR value (0 nit) defined as the origin (the same as the TM curve construction method for SL-HDR1). · Map the HDR diffuse white value (0 < HDR diffuse white < HDR peak luminance) to the SDR diffuse white value (0 < SDR diffuse white < SDR maximum value) defined as the diffuse white target. · Define the TM curve between the origin and the diffuse white target. This TM curve construction method for SL-HDR1 is used with a slight modification of replacing the maximum target point with the diffuse white target point. That is, as follows. ○ The HDR peak luminance value is replaced with the HDR diffuse white value, which is the new input parameter. ○ The SDR maximum value (100 nit) is replaced with the SDR diffuse white value, which is the new input parameter. · Define the specular reflection mapping curve between the diffuse white target and the maximum target. The corresponding pixels correspond to the specular reflection part of the content.

[0087] Figure 7 shows the tone mapping curves obtained by the TM curve construction methods of various embodiments.

[0088] Hereinafter, the tone mapping curves obtained by the TM curve construction methods of various embodiments are referred to as combined TM curves. As seen in the example of the combined TM curve in Figure 7, this combined TM curve is composed of two parts, namely, a first part called the detail TM curve and a second part called the specular reflection TM curve. The detail TM curve is involved in mapping the details of the picture. The detail TM curve is between the origin (0,0) and the diffuse white target start point. The specular reflection TM curve is involved in mapping the specular reflection of the picture. The specular reflection TM curve can be of any shape such as a straight line, a curve, a parabola, etc. The only constraint of the specular reflection TM curve is that it starts at the diffuse white target start point and ends at the maximum target end point. Compared with the normal TM curve, the combined TM mapping curve is considered to use a new control point, the diffuse white target start point.

[0089] 4 illustrates an example of a tone mapping curve construction method according to various embodiments. The method of FIG. 4 may be performed, for example, by processing module 30 of encoding device 21.

[0090] In step 401, the processing module 30 obtains HDR data representing HDR video content, for example, raw HDR video content.

[0091] Step 401 is followed by steps 402 and 403, in which the processing module 30 calculates from the HDR data a detail TM curve as represented in relation to FIG.

[0092] In step 402, the processing module 30 calculates the TM curve from the HDR data.

[0093] In one embodiment, we reuse a variant of the TM curve construction method of SL-HDR1 in step 402. The original TM curve construction method of SL-HDR1 uses the maximum peak luminance of the HDR data as the HDR maximum value, and maps this maximum peak luminance value of the HDR data to the SDR maximum value, i.e., "100" nits.

[0094] In the variant of the TM curve construction method of SL-HDR1, the HDR maximum peak luminance value is replaced by the HDR diffuse white value, which means that the TM curve construction method now maps the HDR diffuse white value to the SDR maximum value. In that case, the HDR value higher than the HDR diffuse white value can be ignored or set to the HDR diffuse white value. In other words, the variant of the TM curve construction method of SL-HDR1 is identical to the TM curve construction method of SL-HDR1 in all its characteristics, except for the fact that the maximum peak luminance value is replaced by the HDR diffuse white value.

[0095] The output of this transformation is a tone mapping LUT in the gamma 2.4 domain, i.e., the tone mapping LUT maps the non-linear luminance values ​​(gamma 2.4) of the HDR data to the non-linear luminance values ​​(gamma 2.4) of the SDR data. An example of the shape of the TM curve corresponding to such a LUT is shown in Figure 8. In the example of Figure 8, the TM LUT is a 1001 entry LUT. The abscissa ranges from "0" to "1000", and each entry is the ratio (HDR luminance value in nits) / (HDR diffuse white value in nits). 2,4* In other words, each entry of the TM LUT in the range [0;1000] that is less than or equal to HDR diffuse white represents an HDR value in [0;HDR diffuse white]. The ordinate ranges from 0 to 1023, and each value is expressed as ((SDR luminance in nits) / (SDR maximum in nits)). 2,4* represents 1023. SDR luminance values ​​stay in the range [0;SDR max].

[0096] In step 403 , the processing module 30 applies a rescaling to the TM curve calculated in step 402 .

[0097] Rescaling the TM curve corresponds to rescaling the abscissa of the TM LUT from [0;HDR diffuse white] to [0;HDR peak luminance] (i.e. the HDR value range is from [0;HDR diffuse white] to [0;HDR peak luminance]), while keeping the ordinate at [0;SDR max] by adding an SDR diffuse white constraint.

[0098] FIG. 9 shows in schematic form the details of the rescaling process applied in step 403.

[0099] In step 4031, the processing module 30 transforms the TM LUT in the perceptually uniform domain. To do so, for each abscissa value i between “0” and LUTSize=1001 (i.e., i∈[0;LUTSize−1]), the transformed ordinate SDR_PU_Y[i] is calculated as follows:

[0100]

number

[0101] FIG. 10 provides an example of the shape of the TM curve corresponding to a transformed TM LUT in the perceptually uniform domain.

[0102] In step 4032, processing module 30 calculates a rescaled TM LUT from the transformed TM LUT. In other words, the rescaled TM LUT is a rescaled version of the transformed TM LUT, as follows:

[0103] The abscissa of the rescaled TM LUT ranges from '0' to (LUTSize-1), where the abscissa value (LUTSize-1) corresponds to the HDR peak luminance value (i.e., the maximum luminance value of the HDR data). The rescaled ordinate ranges from "0" to "1", with the maximum value "1" corresponding to maximum SDR brightness (=100nit). The maximum of the transformed TM LUT abscissa, corresponding to the HDR diffuse white value, is now mapped to the integer abscissa rescalePerceptualInputDiffuseWhitePoint, calculated as follows: rescalePerceptualInputDiffuseWhitePoint=HDR_Diffuse_White / Maximum Peak Brightness) (1 / 2.4)* LUTSize+0.5, where HDR_Diffuse_White is the HDR diffuse white value. The maximum value of the transformed TM LUT ordinate, which corresponds to the maximum SDR luminance value ('100' nits), is now mapped to the ordinate rescalePerceptualOutput, which is calculated as follows: rescalePerceptualOutput=SdrOETF(SDR_Diffuse_White / 100) (1 / 2.4) Each value of the rescaled TM LUT ordinate SDR_PU_Y_rescaled[i] from abscissa i=0 to (rescalePerceptualInputDiffuseWhitePoint-1) is calculated as follows: curRescalePerceptualInput=(i / rescalePerceptualInput), SDR_PU_Y_rescaled[i]=SDR_PU_Y[curRescalePerceptualInput] * rescalePerceptualOutput. Where rescalePerceptualInput=(HDR_Diffuse_White / max peak brightness) (1 / 2.4) ).

[0104] As can be seen, the transformed ordinate SDR_PU_Y[i] is mapped to [0;rescalePerceptualOutput] to obtain SDR_PU_Y_rescaled[i].

[0105] FIG. 11 provides an example of the shape of a TM curve corresponding to a rescaled TM LUT.

[0106] As can be seen in FIG. 11, the detail TM curve corresponding to the low SDR (and HDR) values ​​of the combined TM curve ends at the point of the highest SDR value with an abscissa representing HDR diffuse white (i.e., rescalePerceptualInputDiffuseWhitePoint) and an ordinate representing SDR diffuse white (i.e., rescalePerceptualOutput).

[0107] In step 404, the processing module 30 completes the rescaled TM LUT for abscissas between rescalePerceptualInputDiffuseWhitePoint and (LUTSize-1), and for ordinates between rescalePerceptualOutput and "1". In other words, the processing module completes the current rescaled TM LUT that represents only the detail TM curve with a portion that represents the specular TM curve.

[0108] Before completing the rescaled TM LUT, the processing module 30 corrects the abscissa rescalePerceptualInputDiffuseWhitePoint and the ordinate rescalePerceptualOutput as necessary.

[0109] If the last values ​​of the already calculated values ​​of the rescaled TM LUT with respect to the abscissa rescalePerceptualInputDiffuseWhitePoint are all equal, i.e. if the rescaled TM LUT calculated in step 4032 ends with a horizontal line up to the rescalePerceptualInputDiffuseWhitePoint, this line needs to be removed. This is done by updating the abscissa rescalePerceptualInputDiffuseWhitePoint. The update involves iterating through the ordinates SDR_PU_Y_rescaled[i] of the rescaled TM LUT one by one in reverse order from abscissa i=rescalePerceptualInputDiffuseWhitePoint until we find a value of the abscissa i whose value of the ordinate is different from the value of the ordinate corresponding to the next value of the abscissa (i-1), i.e. SDR_PU_Y_rescaled[i]≠SDR_PU_Y_rescaled[i-1]).

[0110] For the ordinate rescalePerceptualOutput, if the maximum value of the ordinate of the rescaled TM LUT does not reach the maximum value (i.e., "1"), then the ordinate SDR_PU_Y_rescaled[rescalePerceptualInputDiffuseWhitePoint-1] is lower than the theoretical ordinate rescalePerceptualOutput value calculated above. Therefore, rescalePerceptualOutput needs to be updated as follows: rescalePerceptualOutput=min(rescalePerceptualOutput,SDR_PU_Y_rescaled[rescalePerceptualInputDiffuseWhitePoint-1]) Here, min(x,y) is the minimum value between x and y.

[0111] The specular TM curve can be any shape, such as a straight line, a curve, a parabola, etc.

[0112] Below we show two examples of specular TM curves: a straight line and a parabola.

[0113] Specular TM curve implemented using straight lines The Detail TM curve ends at the point (rescalePerceptualInputDiffuseWhitePoint-1,rescalePerceptualOutput) and is renamed P1(x1,y1). ·x1=rescalePerceptualInputDiffuseWhitePoint-1, ·y1=rescalePerceptualOutput.

[0114] The specular TM curve is represented by a straight line between P1 and the last point of SDR_PU_Y_rescaled in the rescaled TM LUT (i.e., LUTSize-1],1). The specular TM LU Tm_PerceptualDiffuseWhiteLUTY[i] corresponding to the specular TM curve is calculated for each abscissa i between rescalePerceptualInputDiffuseWhitePoint and LUTSize (i.e., i∈[rescalePerceptualInputDiffuseWhitePoint;LUTSize-1]) as follows: m_PerceptualDiffuseWhiteLUTY[i]=rescalePerceptualOutput+(i-rescalePerceptualInputDiffuseWhitePoint) * specularStep. Here, specularStep=(1-rescalePerceptualOutput) / (LUTSize-1-rescalePerceptualInputDiffuseWhitePoint).

[0115] FIG. 12 provides an example of a combined TM curve obtained by combining a specular TM curve and a detail TM curve implemented using a straight line.

[0116] Specular TM curve implemented using a parabola Again, the Detail TM curve ends at the point (rescalePerceptualInputDiffuseWhitePoint-1,rescalePerceptualOutput) and is renamed P1(x1,y1). ·x1=rescalePerceptualInputDiffuseWhitePoint-1, ·y1=rescalePerceptualOutput.

[0117] The trend at the end of the Detail TM curve can be represented by a straight line having the following equation: DtmYtm=atm.x+btm,

[0118] The specular reflection TM curve can be thought of as consisting of two parts: A straight line between point P2(x2,y2) and the last point of the rescaled TM LUT SDR_PU_Y_rescaled (i.e. LUTSize-1,1), with the following equation: (Ds)y=as.x+bs, A parabola between points P1 and P2. It has the equation ap.x 2 +bp.x+cp.

[0119] FIG. 13 provides an example of a combined TM curve obtained by combining a specular TM curve and a detail TM curve implemented using a parabola.

[0120] In Figure 13 it is as follows: ·Ptm1 is the intersection point of (Dtm) and the line (Dy1):y=1, and the abscissa is xXmax. ·PX is the intersection of (Dtm) and (Ds), and the abscissa xX of the point PX is the midpoint of [x1;x2].

[0121] The trend atm of (Dtm) can be calculated from the last calculated value of the rescaled TM LUT SDR_PU_Y_rescaled.

[0122] For example, the trend atm can be calculated as follows: Using the last two points: atm=SDR_PU_Y_rescaled[x1-1]-SDR_PU_Y_rescaled[x1-2], Using the last three points: atm = (SDR_PU_Y_rescaled[x1-1]-SDR_PU_Y_rescaled[x1-3]) / 2, Using the last 4 points: atm = (SDR_PU_Y_rescaled[x1-1]-SDR_PU_Y_rescaled[x1-4]) / 3, Using the N last points: atm = (SDR_PU_Y_rescaled[x1-1]-SDR_PU_Y_rescaled[x1-N]) / (N-1), · Or from any combination of previous values ​​of atm.

[0123] Next, we can calculate btm: btm=y1-atm * x1.

[0124] Next, we can calculate xXmax: xXmax=(1-y1+atm * x1) / atm.

[0125] The location of the point PX depends on the trend or steepness of the linear portion of the specular reflection TM curve. In order to construct a consistent parabolic curve (Ps), the xX abscissa of the point PX can only vary between the next value of the abscissa x1 of the point P1 and the previous value of the abscissa xXmax of the point Ptm1, i.e., xX is in the range [x1+1, xXmax-1].

[0126] Depending on the xX position, the trend or steepness of the linear part (Ds) of the specular TM curve changes, which means different precision when mapping the specular values ​​of HDR content. The steepness of the linear part (Ds) of the specular mapping curve is configurable via a value Specular_Steepness in the range [0;1], which fixes the xX abscissa of the PX point as follows: If Specular_Steepness=0, xX=x1+1, Otherwise, if Specular_Steepness=1, then xX=xXmax-1, Else, xX=x1+1+Specular_Steepness * (xXmax-x1-2).

[0127] Then yX and x2 can be calculated as follows: yX=atm * xX+btm, x2=2 * xX-x1.

[0128] As and bs can be calculated as follows: ·as=(1-yX) / (LUTSize-1-xX), ·bs=(1000 * yX-xX) / (LUTSize-1-xX).

[0129] y2 can be calculated as follows: y2=as * x2+bs.

[0130] Then, ap, bp and cp can be calculated as follows: ap=(as-atm) / 2 / (x2-x1), bp=(y2-y1) / (x2-x1)-ap * (x2+x1), ·Cp=y1-ap * x1 * x1-bp * x1.

[0131] Now that all parameters have been calculated, the rescaled TM LUT SDR_PU_Y_rescaled[i], which represents the parabolic portion of the specular TM curve, can be calculated for each i between x1 and x2 (i.e., i ∈ [x1;x2[)) as follows:

[0132] SDR_PU_Y_rescaled[i]=ap * i * i+bp * i+cp, The rescaled TM LUTSDR_PU_Y_rescaled[i], which represents the straight line portion of the specular TM curve, can be calculated for each i between x2 and LUTSize (i.e., i∈[x2;LUTSize[) as follows: SDR_PU_Y_rescaled[i]=as * i+bs,

[0133] The combination of a straight line segment and a parabolic segment forms a specular TM curve, and the combination of a detail TM curve and a specular TM curve forms a combined TM curve.

[0134] In SL-HDR1, the TM curve is represented by a variable called the luminance mapping variable, which is provided, for example in the form of metadata, to a device responsible for applying tone mapping to the HDR data (or to a device responsible for applying inverse tone mapping to the SDR data).

[0135] In step 405 applied in the context of SL-HDR1, the processing module 30 estimates luminance mapping variables representing the combined TM curve represented by the rescaled TM LUT SDR_PU_Y_rescaled obtained in step 404.

[0136] As described in SL-HDR1, the luminance mapping variables are defined by two sets of parameters: The first set of parameters includes five parameters used to define the luminance mapping curve: tmInputSignalBlackLevelOffset, tmInputSignalWhiteLevelOffset, shadowGain, highlightGain, midToneWidthAdjFactor. The second set of parameters contains a limited number of pairs (tmOutputFineTuningX[i], tmOutputFineTuningY[i]) used in the tone mapping output fine tuning function. These pairs define the coordinates of the pivot points, where the first coordinate tmOutputFineTuningX[i] corresponds to the position of the pivot point and the second coordinate tmOutputFineTuningY[i] corresponds to the value of the pivot point. The number of pivot points is given by the parameter tmOutputFineTuningNumVal.

[0137] FIG. 14 illustrates an example of a process for determining the intensity mapping parameters.

[0138] In step 1401, the processing module 30 estimates a first set of parameters. In a first embodiment of step 1401, the first set of parameters is determined by default as a function of the HDR peak luminance value whatever the rescaled TM LUT SDR_PU_rescale[i] value.

[0139] In another embodiment of step 1401, if the combined TM curve obtained using the rescaled TM LUT SDR_PU_rescale look is very far from the luminance mapping curve derived from the default set of parameters calculated according to the first embodiment, an additional process is performed. For example, if the slope at the origin of the TM curve and the slope of the luminance mapping curve derived from the default set of parameters are very different, the parameter shadowGain defined in SL-HDR1 is modified to better match at low luminance levels.

[0140] In steps 1402 and 1403, the processing module 30 recursively determines a second set of parameters by optimizing the positions (tmOutputFineTuningX) and values ​​(tmOutputFineTuningY) of the pivot points. In the embodiment of step 1402, the number of pivot points (given by the parameter tmOutputFineTuningNumVal) is fixed to "10", which is the maximum value possible in SL-HDR1. However, the value of the parameter tmOutputFineTuningNumVal may be less than "10".

[0141] During step 1402, the processing module 30 applies an initialization process to the pivot points. In this initialization process, an initial set of pivot points is defined. The number of pivot points in the initial set can be set to different values ​​ranging from "10" to the number of points of the rescaled TM LUT SDR_PU_rescal. As an example, the number of pivot points is set to "65". During the initialization process, each pivot point is given an initial value.

[0142] In step 1403, the processing module 30 recursively removes pivot points to keep the number of pivot points in the set equal to tmOutputFineTuningNumVal at the end of step 1403. To determine which pivot points can be removed, a criterion based on a cost function is applied. Several cost functions can be used. A cost function corresponding to an error function between the rescaled TM LUT SDR_PU_rescale and the reconstructed rescaled TM LUT SDR_PU_rescale based on the estimated parameters; A cost function corresponding to the error function between an upsampled version of the tone mapping output tweak function with an initial pivot point of 65 and an upsampled version of the tone mapping output tweak function with the remaining pivot points.

[0143] Of course, in a context different from the SL-HDR1 context, the processing module 30 may calculate other variables representing the TM curve different from the luminance mapping variables defined in SL-HDR1.

[0144] In step 406, the processing module 30 generates SDR data from the HDR data and the combined TM curve obtained in step 401. In one embodiment, the processing module 30 of the encoding device encodes the SDR data, for example according to the format VVC, and transmits the encoded SDR data to the decoding device 22 together with metadata representing the luminance mapping variables.

[0145] Note that in step 402, the rescaling step 403 can be avoided by constructing a TM curve represented by a LUT whose abscissa is [0;HDR diffuse white] and whose ordinate is in the range [0;SDR diffuse white]. This LUT, called the replacement LUT, replaces the rescaled TM LUT in steps 404, 405, and 406 and represents the detail TM curve. Furthermore, the transformation of the TM LUT in the perceptually uniform domain in step 4031 is optional, and the rescaling in step 4032 is applied directly to the TM LUT.

[0146] Several embodiments have been described above. The features of these embodiments may be provided alone or in any combination. In addition, the embodiments may include one or more of the following features, devices, or aspects, across various claim categories and types, alone or in any combination. A bitstream or signal containing one or more of the described SDR or HDR data and / or metadata, or variations thereof. Creating and / or transmitting and / or receiving and / or decoding bitstreams or signals containing one or more of the described SDR or HDR data and / or metadata, or variations thereof. A server, camera, television, set-top box, mobile phone, tablet, personal computer, or other electronic device that executes at least one of the described embodiments. A television, set-top box, mobile phone, tablet, personal computer, or other electronic device that performs at least one of the described embodiments and displays the resulting images (e.g., using a monitor, screen, or other type of display). A television, set-top box, mobile phone, tablet, personal computer, or other electronic device that tunes to a channel (e.g., using a tuner) to receive a signal that includes encoded SDR or HDR data and / or metadata and that performs at least one of the described embodiments. A television, set-top box, mobile phone, tablet, personal computer, or other electronic device that receives a signal containing SDR or HDR data and / or metadata wirelessly (e.g., using an antenna) and executes at least one of the described embodiments. A server, camera, mobile phone, tablet, personal computer, or other electronic device that tunes a channel (e.g., using a tuner) to transmit a signal including SDR or HDR data and / or metadata and performs at least one of the described embodiments. A server, camera, mobile phone, tablet, personal computer, or other electronic device that wirelessly transmits (e.g., using an antenna) a signal containing SDR or HDR data and / or metadata and executes at least one of the described embodiments.

Claims

1. Acquiring high dynamic range data (401); Calculating (402, 403) a first tone mapping curve from the high dynamic range data corresponding to a low high dynamic range value of a combined tone mapping curve, the first tone mapping curve terminating at a first point having an abscissa representing a high dynamic range diffuse white and an ordinate representing a standard dynamic range diffuse white, the combined tone mapping curve making it possible to obtain standard dynamic range data from the high dynamic range data; completing (404) the combined tone mapping curve with a second tone mapping curve for a high standard dynamic range starting from the first point; The method includes:

2. The method of claim 1 , wherein the second tone mapping curve is a straight line.

3. The method of claim 1 , wherein the second tone mapping curve comprises a parabola.

4. The method of any one of claims 1 to 3, further comprising calculating (406) the standard dynamic range data from the high dynamic range data using the combined tone mapping curve.

5. The method of any one of claims 1 to 4, comprising estimating (405) metadata representative of the combined tone mapping curve.

6. Calculating the first tone mapping curve comprises: obtaining a midtone mapping curve from the high dynamic range data, wherein non-linear luminance values ​​of the high dynamic range data that are less than the high dynamic range diffuse white are mapped to non-linear luminance values ​​of the standard dynamic range data; rescaling the abscissa of the mid-tone mapping curve from a range of luminance values ​​of the high dynamic range data between 0 and the high dynamic range diffuse white to a range of luminance values ​​of the high dynamic range data between 0 and a maximum luminance value of the high dynamic range data; Mapping an ordinate of the intermediate tone mapping curve to a range of luminance values ​​of the standard dynamic range data between 0 and a value that is dependent on the standard dynamic range diffuse white to obtain the first tone mapping curve; The method according to any one of claims 1 to 5, comprising:

7. 7. The method of claim 6, wherein prior to the mapping, the ordinates of the mid-tone mapping curve are transformed in a perceptually uniform domain, with transformed ordinate values ​​between 0 and a maximum ordinate value corresponding to a maximum luminance value of the standard dynamic range data.

8. A device comprising an electronic circuit, the electronic circuit comprising: acquiring high dynamic range data (401); Calculating (402, 403) a first tone mapping curve from the high dynamic range data corresponding to a low high dynamic range value of a combined tone mapping curve, the first tone mapping curve terminating at a first point having an abscissa representing a high dynamic range diffuse white and an ordinate representing a standard dynamic range diffuse white, the combined tone mapping curve making it possible to obtain standard dynamic range data from the high dynamic range data; completing the combined tone mapping curve with a second tone mapping curve for a high standard dynamic range starting from the first point (404); The device is configured as follows:

9. The device of claim 8 , wherein the second tone mapping curve is a straight line.

10. The device of claim 8 , wherein the second tone mapping curve comprises a parabola.

11. The device of any one of claims 8 to 10, wherein the electronic circuitry is further configured to calculate (406) the standard dynamic range data from the high dynamic range data using the combined tone mapping curve.

12. The device of any one of claims 8 to 11, wherein the electronic circuitry is further configured to estimate (405) metadata representative of the combined tone mapping curve.

13. Calculating the first tone mapping curve comprises: obtaining a midtone mapping curve from the high dynamic range data, wherein non-linear luminance values ​​of the high dynamic range data that are less than the high dynamic range diffuse white are mapped to non-linear luminance values ​​of the standard dynamic range data; rescaling the abscissa of the mid-tone mapping curve from a range of luminance values ​​of the high dynamic range data between 0 and the high dynamic range diffuse white to a range of luminance values ​​of the high dynamic range data between 0 and a maximum luminance value of the high dynamic range data; Mapping an ordinate of the intermediate tone mapping curve to a range of luminance values ​​of the standard dynamic range data between 0 and a value that is dependent on the standard dynamic range diffuse white to obtain the first tone mapping curve; The device according to any one of claims 8 to 12, comprising:

14. 14. The device of claim 13, wherein prior to the mapping, the ordinate of the mid-tone mapping curve is transformed in a perceptually uniform domain, with transformed ordinate values ​​between 0 and a maximum ordinate value corresponding to a maximum luminance value of the standard dynamic range data.

15. A signal generated using the method of any one of claims 1 to 7 or using the device of any one of claims 8 to 14.

16. A computer program comprising program code instructions for implementing the method according to any one of claims 1 to 7.

17. A non-transitory information storage medium storing program code instructions for implementing the method according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Video signal conversion device and program

    JP2021064917A

  • High dynamic range images from low dynamic range images

    US20060104533A1