Associate pixel reduction methods with SL-HDR
By generating and encoding SL-HDR metadata and adjusting tone mapping to match the brightness of display devices, the problem of high power consumption in HDR video is solved, achieving reduced power consumption and preservation of artistic intent, thus improving the sustainability of video display.
Patent Information
- Application Number
- CN202580026715.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-04-09
- Filing Date
- 2025-03-17
- Publication Date
- 2026-11-17
AI Technical Summary
In existing technologies, HDR video consumes twice as much energy as SDR video, resulting in excessive energy consumption. Furthermore, existing methods struggle to maintain the artistic intent and viewing experience quality of video content while reducing energy consumption.
By generating and encoding SL-HDR metadata, using energy-aware information for preprocessing and postprocessing, tone mapping is adjusted to match the brightness capabilities of the display device, peak brightness is reduced to reduce energy consumption, and video quality is maintained.
It achieves the goal of reducing display power consumption while maintaining the artistic intent and viewing experience quality of high dynamic range video, meeting the requirements of sustainable display.
Smart Images

Figure CN123125869A_ABST
Abstract
Description
[0001] 1. Cross-references to related applications This application claims priority to European application number 24305575.3, filed on 9 April 2024, which is incorporated herein by reference in its entirety. 2. Technical Field At least one of these embodiments generally relates to the field of displaying standard dynamic range (SDR) video or high dynamic range (HDR) video, and more particularly, to a method and apparatus for controlling the energy consumed for displaying SDR or HDR video. 3. Background Technology Recent advances in display technology have allowed for an expanded dynamic range of color, brightness, and contrast in images to be displayed. The term "image" here refers to image content, which may be, for example, a video, a still image, or a photograph.
[0004] High Dynamic Range (HDR) video describes video with a dynamic range greater than that of Standard Dynamic Range (SDR) video. HDR video-based applications involve capture, production, content / encoding, and display. HDR capture and display devices are capable of rendering brighter whites and deeper blacks. To accommodate this, the HDR coding standard allows for higher maximum brightness and uses at least 10 bits of dynamic range (compared to the (non-professional) 8 bits and (professional) 10 bits of dynamic range in SDR video) to maintain accuracy across this extended range.
[0005] HDR and SDR content will coexist for periods of time, whether long or short. Various technologies such as SL-HDR1 (ETSI TS 103 433-1), SL-HDR2 (ETSI TS 103 433-2), or SL-HDR3 (ETSI TS 103 433-3 v1.1.1) have been developed to allow the joint distribution of HDR and SDR versions of the same video content.
[0006] HDR technology offers a better viewer experience (or quality of experience (QoE)) for video content, but it consumes significantly more energy than SDR. In fact, displaying HDR video consumes up to twice the energy of SDR video. Current trends in many fields focus on reducing energy consumption in hopes of overcoming these drawbacks.
[0007] Specifically, a solution is expected to be proposed that allows control or reduction of the energy consumed by the display of video content (SDR or HDR) while preserving as much of the QoE as possible for the user and the artistic intent of the content creator. 4. Summary of the Invention In a first aspect, one or more of the embodiments in this paper provide a method comprising: Obtain first standard dynamic range (SDR) content and SL-HDR metadata, the SL-HDR metadata allowing the generation of first high dynamic range (HDR) content from the first SDR content; Preprocessing is applied to the first SDR content to obtain the second SDR content, which allows for a reduction in the energy consumed to display the second SDR content relative to the energy consumed to display the first SDR content, or a reduction in the energy consumed to display the output HDR content generated from the second SDR content relative to the energy consumed to display the output HDR content generated from the first SDR content. The energy-sensing information is signaled in the SL-HDR metadata, including a flag indicating that the first SDR content has been preprocessed to obtain the second SDR content; and... Encode the second SDR content and SL-HDR metadata.
[0009] In an embodiment, the energy-sensing information further includes syntax elements indicating the energy reduction rate.
[0010] In an embodiment, the energy-aware information further includes syntax elements that indicate the process used in various methods to generate second SDR content from first SDR content.
[0011] In an embodiment, the energy-sensing information further includes a syntax element indicating whether the first SDR content must be regenerated to generate the output HDR content.
[0012] In a second aspect, one or more of the embodiments in this paper provide a method comprising: A reconstructed version of second standard dynamic range (SDR) content and SL-HDR metadata is obtained, the SL-HDR metadata allowing the generation of first high dynamic range (HDR) content from first SDR content, the SL-HDR metadata including energy-aware information including a flag indicating that the first SDR content has been preprocessed to obtain the second SDR content, the second SDR content allowing the acquisition of energy reduction in the energy consumed to display the second SDR content relative to the energy consumed to display the first SDR content, or the acquisition of energy reduction in the energy consumed to display output HDR content generated from the second SDR content relative to the energy consumed to display output HDR content generated from the reconstructed version of the first SDR content; Based on energy sensing information, it is determined whether to regenerate the output SDR content corresponding to the first SDR content from the second SDR content, or to keep the second SDR content as the output SDR content. Based on the determination, intermediate SDR content is obtained from the output SDR content; and... Output HDR content is generated from the output SDR content.
[0013] In an embodiment, the energy-sensing information further includes syntax elements indicating the energy reduction rate.
[0014] In an embodiment, the energy-aware information further includes syntax elements that indicate the process used in various methods to generate second SDR content from first SDR content.
[0015] In an embodiment, the energy-sensing information further includes a syntax element indicating whether the first SDR content must be regenerated to generate the output HDR content.
[0016] In an embodiment, in response to regenerating output SDR content corresponding to the first SDR content from the second SDR content, the intermediate SDR content is a linear combination between the second SDR content and the output SDR content.
[0017] In the embodiments, the weighting factor used in the linear combination depends on the energy reduction ratio.
[0018] In a third aspect, one or more of the embodiments in this invention provide a device including electronic circuitry configured to: Obtain first standard dynamic range (SDR) content and SL-HDR metadata, the SL-HDR metadata allowing the generation of first high dynamic range (HDR) content from the first SDR content; Preprocessing is applied to the first SDR content to obtain the second SDR content, which allows for a reduction in the energy consumed to display the second SDR content relative to the energy consumed to display the first SDR content, or a reduction in the energy consumed to display the output HDR content generated from the second SDR content relative to the energy consumed to display the output HDR content generated from the first SDR content. The energy-sensing information is signaled in the SL-HDR metadata, including a flag indicating that the first SDR content has been preprocessed to obtain the second SDR content; and... Encode the second SDR content and SL-HDR metadata.
[0019] In a fourth aspect, one or more of the present embodiments provide a device including electronic circuitry configured to: A reconstructed version of second standard dynamic range (SDR) content and SL-HDR metadata is obtained, the SL-HDR metadata allowing the generation of first high dynamic range (HDR) content from first SDR content, the SL-HDR metadata including energy-aware information including a flag indicating that the first SDR content has been preprocessed to obtain the second SDR content, the second SDR content allowing the acquisition of energy reduction in the energy consumed to display the second SDR content relative to the energy consumed to display the first SDR content, or the acquisition of energy reduction in the energy consumed to display output HDR content generated from the second SDR content relative to the energy consumed to display output HDR content generated from the reconstructed version of the first SDR content; Based on energy sensing information, it is determined whether to regenerate the output SDR content corresponding to the first SDR content from the second SDR content, or to keep the second SDR content as the output SDR content. Based on the determination, intermediate SDR content is obtained from the output SDR content; and... Generate output HDR content from output SDR content.
[0020] In embodiments of the third or fourth aspect, the energy-aware information further includes at least one of the following: a syntax element indicating the energy reduction rate, a syntax element indicating the process for generating second SDR content from first SDR content in a variety of methods, and a syntax element indicating whether the first SDR content must be regenerated to generate output HDR content.
[0021] In a third or fourth embodiment, in response to regenerating output SDR content corresponding to the first SDR content from the second SDR content, the intermediate SDR content is a linear combination between the second SDR content and the output SDR content.
[0022] In the third or fourth embodiment, the weighting factor used in the linear combination depends on the energy reduction ratio.
[0023] In a fifth aspect, one or more of the embodiments in this embodiment provide a non-transitory information storage medium that stores program code instructions for implementing the method according to the first or second aspect.
[0024] In a sixth aspect, one or more of the present embodiments provide a device computer program that includes program code instructions for implementing the method according to the first or second aspect.
[0025] In a seventh aspect, one or more of the present embodiments provide a signal including second standard dynamic range (SDR) content and SL-HDR metadata, the SL-HDR metadata allowing the generation of first high dynamic range (HDR) content from first SDR content, the SL-HDR metadata including energy-aware information including a flag indicating that the first SDR content has been preprocessed to obtain second SDR content, the second SDR content allowing for the acquisition of energy reduction in the energy consumed to display the second SDR content relative to the energy consumed to display the first SDR content, or the acquisition of energy reduction in the energy consumed to display output HDR content generated from the second SDR content relative to the energy consumed to display output HDR content generated from a reconstructed version of the first SDR content. 5. Description of the attached drawings Figure 1 Examples of contexts in which various embodiments are implemented are illustrated schematically; Figure 2A The tone mapping curve is illustrated. Figure 2B The diagram illustrates the inverse tone mapping curve that is not properly adapted. Figure 2C The diagram illustrates an inverse tone mapping curve with display adaptation; Figure 3 It presents some energy consumption values for different types of scenes (i.e., bright, medium, and dim scene brightness).
[0027] Figure 4A An example of a hardware architecture for a processing module capable of implementing various aspects and embodiments is illustrated schematically. Figure 4B The diagram illustrates a block diagram of an example of a first system that implements various aspects and embodiments; and Figure 4C The diagram illustrates a block diagram of an example of a second system that implements various aspects and embodiments; Figure 5 The illustrations depict processes performed by a first system according to various embodiments; and, Figure 6 The illustration shows the process performed by System B according to various embodiments. 6. Detailed Implementation Methods The following examples relate to a global video chain (production, encoding, transmission, decoding, and display rendering) and a reduction in the total energy consumed by this global video chain.
[0029] This context represents the distribution of compressed HDR data representing video content, while also distributing associated SDR data representing the same video content.
[0030] In the following examples, various examples rely on the SL-HDR1 HDR distribution technology (ETSI TS 103 433-1). However, these various embodiments are also applicable to any HDR distribution technology that relies on dynamic metadata (e.g., Dolby Vision, HDR10+, SL-HDR2, SL-HDR3).
[0031] HDR technology offers better QoE for video content on the screen, but consumes significantly more power than SDR. HDR monitors sometimes consume up to twice the power of SDR monitors.
[0032] As HDR technology has evolved, it appears that not all HDR-enabled display devices (or HDR displays) possess the same capabilities for displaying HDR data. For example, for some HDR displays, the reconstructed HDR data might have a maximum brightness value of around "1000" nits (i.e., peak brightness), while the HDR display might be limited to rendering only up to "500" nits. The risk in that case is that the HDR display might have a coarsely cropped value above "500" nits (and especially highlights). Therefore, respect for the artistic intent of the video content is not guaranteed.
[0033] When it comes to images, artistic intent often relies on tone, that is, the distribution of shadows, midtones, and highlights in a scene. This is part of the color grading that artists (i.e., content creators) must perform in order to convey the desired emotion and / or define the visual signature of the content.
[0034] Tone regions can be defined as follows: • Shading: This corresponds to the lowest part of the color distribution of the content under consideration (e.g., represented by a histogram of the image's brightness values); • Mid-tone: This corresponds to the middle part of the color distribution of the content under consideration; • Highlights: These correspond to the highest part of the color distribution of the content under consideration.
[0035] In addition to these three tonal regions, black points are generally defined as the pixels with the lowest sample values present in shadows, while white points correspond to the pixels with the brightest sample values present in highlights.
[0036] Clearly, defining such black and white points is crucial during color grading performed by the artist. Increasing the black point results in the clipping of areas darker than the black point. Similarly, decreasing the white point results in the clipping of areas brighter than the white point. Clipping highlights can lead to the loss of valuable highlight details.
[0037] A more "artistic intent"-friendly solution based on display adaptation is proposed. Display adaptation allows the reconstructed HDR signal to be adapted to the display device's brightness capabilities, while allowing for the highest possible QoE and preserving the artistic intent of the HDR signal. For example, display adaptation adjusts the hue to retain highlights that cannot be clipped.
[0038] By definition, a higher QoE (Quality of Efficiency) is achieved when the display adaptation enables the reconstructed HDR signal to match the brightness of the display device. However, this still comes with high power consumption. To make a trade-off between power consumption and QoE possible, the various embodiments described below propose adding a power consumption dimension to adjust the peak brightness of the video content. The adjusted peak brightness is then used to adapt the reconstructed HDR signal to reduce emitted light and thus reduce power consumption. Obviously, reducing the peak brightness will globally darken each frame of the video.
[0039] Reducing the energy consumption of electronic devices has become a requirement not only for electronic device manufacturers, but also for limiting environmental impact as much as possible and promoting the emergence of a sustainable display industry.
[0040] The advancements in display resolution, from SD to HD, and from 2K to 4K, and soon to 8K and higher, have led to a corresponding increase in the energy demands of display devices. This is inconsistent with the overall need to reduce energy consumption. In fact, displays are a significant source of energy consumption, both for battery-powered devices (such as smartphones) and for the entire video distribution chain.
[0041] Organic light-emitting diode (OLED) displays are becoming increasingly widely used due to their numerous advantages over transmissive displays such as thin-film transistor liquid crystal displays (TFT-LCDs). Instead of using a uniform backlight, OLED displays consist of LEDs that act as image pixels. Therefore, OLED power consumption is highly dependent on the image content and can be easily estimated by considering the brightness levels of the displayed image pixels. Although OLED displays consume energy in a controlled manner, they remain the most significant energy source in the video transmission chain.
[0042] Several methods have been used to reduce the power consumption of a display by decreasing the amount of emitted light. These methods may rely on controlling the display's peak brightness and can therefore significantly modify the tonal distribution.
[0043] Because of user-accessible brightness settings, peak brightness control of a monitor can be performed, for example, manually. A very common and straightforward method is to use the monitor's brightness settings. User-manipulated brightness control can simply involve increasing or decreasing offsets in the red, green, and blue signals. Improper brightness adjustments can result in very poor quality for black and white values, which may be cropped, overexposed, or underexposed. Manually adjusting brightness can completely ruin artistic intent.
[0044] Because the monitor's peak brightness is adjusted based on the peak brightness of ambient light, peak brightness control can also be done automatically. The basic idea is to reduce peak brightness in dark environments and increase peak brightness when ambient light is high. However, due to a lack of prior information, the methods used by monitor manufacturers are proprietary and fail to respect artistic intent. To respect artistic intent, it would be necessary to determine black and white points and analyze the tonal distribution of different scenes in the video content. Doing this on the side of the monitor seems unreasonable.
[0045] A more ingenious solution for controlling the peak brightness of a display is to use energy-sensing images, which are images that require less energy to display on a display, especially an OLED display. Examples of methods for calculating energy-sensing images can be found in document WO2022 / 238183, document with international application number PCT / EP2023 / 062360, and document with international application number PCT / EP2024 / 055276.
[0046] Figure 1 Examples of contexts in which various embodiments are implemented are illustrated schematically.
[0047] exist Figure 1 In this context, a source device 10, such as a camera or a streaming system providing video content, generates the video content. The source device 10 is, for example, an SDR or HDR camera that generates SDR or HDR video content, respectively.
[0048] The video content is then provided to the preprocessing module 11. For example, the preprocessing module 11 adapts the content to the SL-HDRx standard. For example, the SL-HDRx standard is SL-HDR1. Therefore, when the video content is an HDR video, the preprocessing module 11 applies tone mapping (TM) to the HDR video to generate an SDR video and generates SL-HDR1 metadata. When the video content is an SDR video, the preprocessing module 11 first estimates the HDR video and then applies TM to the estimated HDR video to generate an SDR video and generates SL-HDR1 metadata. HDR videos have a peak brightness known as the main display peak brightness, which typically corresponds to a peak brightness defined by the content creator. The SL-HDR1 metadata includes information representing the inverse tone mapping function and color correction function that allow HDR video to be obtained from SDR video. This metadata can be dynamic and adapted to each image or group of images.
[0049] The SDR video and SL-HDR1 metadata are then provided to the encoding module 13. The encoding module 13 encodes the SDR video and SL-HDR1 metadata into a bitstream (i.e., encoded as video data) using a video compression format such as AVC (ISO / CEI 14496-10 / ITU-T H.264), HEVC (ISO / IEC 23008-2 – MPEG-H Part 2, High Efficiency Video Coding / ITU-T H.265), VVC (ISO / IEC 23090-3 – MPEG-I, Versatile Video Coding / ITU-T H.266), AV1, VP9, EVC (ISO / CEI 23094-1 Essential Video Coding), or any other video compression format suitable for encoding the SDR video and SL-HDR1 metadata. For example, SL-HDR1 metadata is encoded in the SL-HDR information SEI message as specified in Appendix A.2 of the ETSI TS 103.433 specification. The output of encoding module 13 is a bitstream (i.e., video data) representing the encoded SDR video and SL-HDR1 metadata.
[0050] The encoding module 13 then provides the video data to the decoding module 14, for example, via a network. The decoding module 14 decodes the bitstream to obtain a decoded (i.e., reconstructed) version of the SDR video and SL-HDR1 metadata.
[0051] The reconstructed SDR video is directly provided to a display device 18 suitable for displaying SDR content.
[0052] SDR video and SL-HDR1 metadata are also provided to post-processing module 16. Post-processing module 16 applies an inverse tone mapping (ITM) step and a color correction step to the SDR video to obtain HDR video.
[0053] Color correction involves calculating a lookup table (LUT) lutCC() based on SL-HDR1 metadata. The LUT lutCC() is then used to reconstruct the HDR chroma signal of the HDR video.
[0054] For both constant luminance (CL) and non-constant luminance (NCL) modes, lutCC(Y) = f(Y)·(1 / Y), where f(Y) = 1 / (R·sgf(1 / Y)) and Y is the value representing luminance. The function sgf(1 / Y) corresponds to the color correction function encoded in the SL-HDR1 metadata.
[0055] In NCL mode, f(Y) is a constant function, i.e., f(Y) = Ω, such that lutCC(Y) = Ω.(1 / Y).
[0056] In CL mode, f(Y) is not a constant function.
[0057] The ITM step involves exporting a LUT lutMapY() from the SL-HDR1 metadata. Then, the LUT lutMapY() is used to perform inverse tone mapping on the luminance signal of the SDR video to reconstruct the HDR luminance signal of the HDR video.
[0058] When display adaptation is required (i.e., in response to the HDR display 17 having a peak brightness of a display that is lower than the peak brightness of the main display (hereinafter referred to as the target display peak brightness), the target display peak brightness is considered during inverse tone mapping. Three cases are considered: • The target display's peak brightness is the same as the main display's peak brightness. In that case, the ITM curve is the inverse of the TM curve applied by preprocessing module 11. Therefore, LUT lutMapY() is directly exported from SL-HDR1 metadata.
[0059] • The target display's peak brightness is "100" nits (i.e., the HDR display 17 is an SDR display). In that case, the ITM curve equals the identity mapping in the linear domain. In other words, when the target display's peak brightness is "100" nits, the brightness of the reconstructed HDR signal is equal to the brightness of the reconstructed SDR signal. Note that the latter holds true for NCL mode, but not for CL mode.
[0060] • The target display's peak brightness is between 100 nits and the main display's peak brightness. The ITM curve lies between the identity mapping and inverse tone mapping curves specified in the SL-HDR1 metadata.
[0061] Figure 2A The diagram illustrates the TM curve used by preprocessing module 11 to generate SDR video from raw HDR video.
[0062] Figure 2B The diagram illustrates the process of... Figure 2A The ITM curve is obtained by inverting the TM curve. Figure 2A TM curve and Figure 2B The sequential application of the ITM curves allows (theoretically) the return to the original HDR video.
[0063] Figure 2C The diagram illustrates the adaptation process when the application displays the data. Figure 2A Multiple ITM curves were obtained from the TM curve.
[0064] An example of the procedure for deriving LUTlutMapY() when the peak brightness of the target display is between “100” nits and the peak brightness of the main display is described in Annex E of the document ETSI TS 103 433-1 V1.2.1 (High-PerformanceSingle Layer High Dynamic Range (HDR) System for use in Consumer Electronicsdevices; Part 1: Directly Standard Dynamic Range (SDR) Compatible HDR System (SL-HDR1) (hereinafter referred to as SL-HDR1)). Essentially, the process involves calculating the first LUT lutMapY'(), representing the ITM curve without display adaptation (i.e., the first LUT lutMapY'() allows the reconstructed SDR signal to be transformed into an HDR signal with a peak brightness equal to the peak brightness of the primary display), as described in Section 7.2.3.1.2 of document S1-HDR1, and then calculating the second LUT lutMapY''(), which allows the HDR signal with a peak brightness equal to the peak brightness of the primary display to be mapped to an HDR signal with a peak brightness equal to the peak brightness of the primary display. LUT lutMapY() is then a combination of the first LUT lutMapY'() and the second LUT lutMapY''(). In Annex E of document S1-HDR1, the target display peak brightness is referred to as the maximum brightness of the rendered display and is determined by the variable L. pdisp express.
[0065] One advantage of the display adaptation process in Appendix E of the SL-HDR1 document is that it preserves as much as possible the artistic intent defined by the content creator.
[0066] Once reconstructed, the HDR video is then provided to the HDR display 17.
[0067] It can be noted that the post-processing module 16 can be integrated into the HDR display 17.
[0068] Figure 3This section presents some power consumption values for different types of HDR scenes (i.e., bright, medium, and dark scenes). The power consumption value is a function of peak brightness, expressed in nits. In this example, the OLED (Organic Light Emitting Diode) screen used for testing has a target display peak brightness of "1000" nits. Therefore, its power consumption is the highest for this value, as it utilizes the screen's full capacity. Reducing the peak brightness of the displayed content allows for a reduction in power consumption. Interestingly, the amount of reduction depends significantly on the scene brightness.
[0069] Figure 4A Examples of hardware architectures for processing module 40, such as those used in preprocessing module 11, pre-energy sensing module 12 (described later), post-energy sensing module 15 (described later), or postprocessing module 16, are illustrated schematically. The processing module 40, connected via communication bus 405, includes: a processor or CPU (Central Processing Unit) 400, which, as a non-limiting example, includes one or more microprocessors, general-purpose computers, special-purpose computers, and processors based on multi-core architectures; random access memory (RAM) 5001; read-only memory (ROM) 402; a storage unit 403, which may include non-volatile memory and / or volatile memory, including but not limited to electrically erasable programmable read-only memory (EEPROM), read-only memory (ROM), programmable read-only memory (PROM), random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), flash memory, disk drives and / or optical disk drives, or storage media readers such as SD (Secure Digital) card readers and / or hard disk drives (HDDs) and / or network-accessible storage devices; and at least one communication interface 404 for exchanging data with other modules, devices, systems, or equipment. The communication interface 404 may include, but is not limited to, a transceiver configured to transmit and receive data via communication network 41. The communication interface 404 may include, but is not limited to, a modem or network interface card (NIC).
[0070] For example, the communication interface 404 enables, for example, the processing module 40 to receive HDR or SDR data and output HDR or SDR data as well as SL-HDR1 metadata.
[0071] Processor 400 is capable of executing instructions loaded into RAM 401 from ROM 402, external memory (not shown), storage medium, or communication network. When processing module 40 is powered on, processor 400 is capable of reading instructions from RAM 401 and executing them. When processing module 40 is included in preprocessing module 11, these instructions form a computer program that enables, for example, processor 400 to implement the TM process (when the source module generates HDR video).
[0072] When the processing module 40 is included in the preprocessing module 11, these instructions form a computer program that causes, for example, the processor 400 to implement the TM process and generate SL-HDR1 metadata.
[0073] When the processing module 40 is included in the pre-energy sensing module 12 (described later in this document), these instructions form a computer program that enables, for example, the processor 400 to perform pre-processing of the SDR content (i.e., SDR data) generated by the pre-processing module 11, thereby allowing for reduced energy consumption.
[0074] When the processing module 40 is included in the post-energy sensing module 15 (described later in this document), these instructions form a computer program that enables, for example, the processor 400 to implement a process for regenerating the SDR content generated by the preprocessing module 11 from the output of the pre-energy sensing module 12.
[0075] When processing module 40 is included in post-processing module 16, these instructions form a computer program that causes, for example, processor 400 to implement an ITM process, which includes a display adaptation according to embodiments described below in this disclosure.
[0076] All or some of the algorithms and steps of the process can be implemented in software by executing a set of instructions by a programmable machine (such as a DSP (Digital Signal Processor) or a microcontroller), or in hardware by a machine or a dedicated component (such as a FPGA (Field Programmable Gate Array) or an ASIC (Application-Specific Integrated Circuit)). Microprocessors, DSPs, FPGAs, and ASICs are considered electronic circuits.
[0077] Figure 4C The diagram illustrates a block diagram of an example system A that implements a post-processing module in various aspects and embodiments.
[0078] System A can be implemented as a device comprising various components or modules and configured to generate HDR or SDR displayable video. Examples of such systems include, but are not limited to, various electronic systems such as personal computers, laptops, smartphones, tablets, TVs, or set-top boxes. Components of System A can be implemented individually or in combination in a single integrated circuit (IC), multiple ICs, and / or discrete components. For example, in at least one embodiment, System A includes at least one processing module 40 implementing a decoding module 14, a post-energy sensing module 15, and a post-processing module 16. In various embodiments, System A is communicatively coupled to one or more other systems or other electronic devices via, for example, a communication bus or through dedicated input and / or output ports.
[0079] The inputs to the processing module 40 can be provided by various input modules, as shown in block 42. Such input modules include, but are not limited to: (i) a radio frequency (RF) module that receives, for example, RF signals transmitted over the air by a broadcaster; (ii) a component (COMP) input module (or a set of COMP input modules); (iii) a universal serial bus (USB) input module; and / or (iv) a high-definition multimedia interface (HDMI) input module. Figure 4C Other examples not shown include composite video.
[0080] In various embodiments, the input module of block 42 has associated corresponding input processing elements as known in the art. For example, the RF module may be associated with elements suitable for: (i) selecting a desired frequency (also known as selecting a signal, or limiting a signal band to a band), (ii) down-converting the selected signal, (iii) band-limiting the narrower band again to select (e.g.,) a signal band that may be referred to as a channel in some embodiments), (iv) demodulating the down-converted and band-limited signal, (v) performing error correction, and (vi) demultiplexing to select a desired data packet stream. The RF module in various embodiments includes one or more elements for performing these functions, such as a frequency selector, signal selector, band limiter, channel selector, filter, downconverter, demodulator, error corrector, and demultiplexer. The RF section may include a tuner that performs various of these functions, including, for example, down-converting a received signal to a lower frequency (e.g., intermediate frequency or near-baseband frequency) or baseband. Various embodiments rearrange the order of the above (and other) components, remove some of these components, and / or add other components that perform similar or different functions. Adding components may include inserting components between existing components, such as, for example, inserting amplifiers and analog-to-digital converters. In various embodiments, the RF module includes an antenna.
[0081] Furthermore, the USB and / or HDMI modules may include corresponding interface processors for connecting System A to other electronic devices across USB and / or HDMI connections. It should be understood that various aspects of input processing, such as Reed-Solomon error correction, may be implemented as needed, for example, in a separate input processing IC or within processing module 40. Similarly, various aspects of USB or HDMI interface processing may be implemented as needed within a separate interface IC or within processing module 40. Demodulation, error correction, and demultiplexing streams are provided to processing module 40.
[0082] Various components of System A can be provided within an integrated housing. Within the integrated housing, the various components can be interconnected and data can be transferred between them using a suitable connection arrangement, such as internal buses known in the art, including inter-IC (I2C) buses, wiring, and printed circuit boards. For example, in System A, processing module 40 is interconnected to other components of System A via bus 405.
[0083] The communication interface 404 of the processing module 40 allows system A to communicate on the communication channel 41. The communication channel 41 can be implemented, for example, in a wired and / or wireless medium.
[0084] In various embodiments, data is streamed or otherwise provided to System A using a wireless network, such as a Wi-Fi network, for example, IEEE 802.11 (IEEE refers to the Institute of Electrical and Electronics Engineers). In these embodiments, the Wi-Fi signal is received via a communication network 41 and a communication interface 404 adapted for Wi-Fi communication. The communication network 41 in these embodiments is typically connected to an access point or router that provides access to external networks, including the Internet, to allow streaming applications and other over-the-top communications. Other embodiments use the RF connection of input block 42 to provide streaming data to System A. As shown above, various embodiments provide data in a non-streaming manner, for example, when System A is a smartphone or tablet computer. Furthermore, various embodiments use wireless networks other than Wi-Fi, such as cellular networks or Bluetooth networks.
[0085] System A can use communication network 41 or bus 405 to provide output signals to various output devices. For example, System A can provide reconstructed HDR video.
[0086] System A can provide output signals to various output devices, including an HDR display 17, speakers 46, and other peripheral devices 47. The HDR display 17 in various embodiments includes one or more of, for example, a touchscreen display, an organic light-emitting diode (OLED) display, a curved display, and / or a foldable display. The HDR display 17 can be used in televisions, tablet computers, laptop computers, cellular phones (mobile phones), or other devices. The HDR display 17 can also be integrated with other components (e.g., as in a smartphone) or separate (e.g., an external monitor for a laptop computer). In various examples of embodiments, the other peripheral devices 47 include one or more of a standalone digital video disc (or digital multifunction disc) (DVR, for both terms), a disc player, a stereo system, and / or a lighting system. Various embodiments use one or more peripheral devices 47 that provide functionality based on the output of System A. For example, a disc player performs the function of playing the output of System A.
[0087] In various embodiments, control signals are transmitted between System A and the HDR display 17, speaker 46, or other peripheral devices 47 using signaling protocols such as AV.Link, Consumer Electronics Control (CEC), or other communication protocols, which enable device-to-device control with or without user intervention. Output devices can be communicatively coupled to System A via dedicated connections through corresponding interfaces 43, 44, and 45. Alternatively, output devices can be connected to System A via communication interface 404 using communication network 41. The HDR display 17 and speaker 46 can be integrated into a single unit with other components of System A in electronic devices such as, for example, televisions. In various embodiments, display interface 43 includes a display driver, such as, for example, a timing controller (TCon) chip.
[0088] For example, if the RF module of block 42 is part of a separate set-top box, the HDR display 17 and speaker 46 can alternatively be separate from one or more other components. In various embodiments where the HDR display 17 and speaker 46 are external components, the output signal can be provided via a dedicated output connection, including, for example, an HDMI port, a USB port, or a COMP output.
[0089] Figure 4B A block diagram illustrating an example of a system B suitable for implementing a preprocessing module 11, which incorporates various aspects and embodiments.
[0090] System B may be implemented as a device including the various components or modules described above, and configured to perform one or more of the aspects and embodiments described in this document.
[0091] Examples of such devices include, but are not limited to, various electronic devices such as personal computers, laptops, cameras, smartphones, and servers. Components or modules of System B may be implemented individually or in combination in a single integrated circuit (IC), multiple ICs, and / or discrete components. For example, in at least one embodiment, System B includes at least one processing module 40 that implements a preprocessing module 11, a pre-energy sensing module 12, and an encoding module 13. In various embodiments, System B is communicatively coupled to one or more other systems or other electronic devices via, for example, a communication bus or through dedicated input and / or output ports.
[0092] Input to processing module 40 can be obtained through methods such as... Figure 4C The various input modules shown in block 42, which have already been described, are provided.
[0093] Various components of System B can be provided within an integrated housing. Within the integrated housing, the various components can be interconnected and transmit data therebetween using suitable connection arrangements (e.g., internal buses as known in the art, including inter-IC (I2C) buses, wiring, and printed circuit boards). For example, in System B, processing module 40 is interconnected with other components of System B via bus 405.
[0094] The communication interface 404 of the processing module 40 allows system B to communicate on the communication network 41. For example, the communication network 41 can be implemented in wired and / or wireless media.
[0095] In various embodiments, data is streamed or otherwise provided to System B using a wireless network, such as a Wi-Fi network, for example, IEEE 802.11 (IEEE refers to the Institute of Electrical and Electronics Engineers). In these embodiments, the Wi-Fi signal is received via a communication network 41 and communication interface 404 adapted for Wi-Fi communication. The communication network 41 in these embodiments is typically connected to an access point or router that provides access to external networks, including the Internet, to allow streaming applications and other over-the-top communications. Other embodiments use the RF connection of input block 42 to provide streaming data to System B. As shown above, various embodiments provide data in a non-streaming manner.
[0096] When a diagram is presented as a flowchart, it should be understood that it also provides a block diagram of the corresponding apparatus. Similarly, when a diagram is presented as a block diagram, it should be understood that it also provides a flowchart of the corresponding method / process.
[0097] The implementations and aspects described herein can be implemented, for example, in a method or process, apparatus, software program, data stream, or signal. Even if discussed only in the context of a single form of implementation (e.g., discussed only as a method), the implementation of the discussed features can also be implemented in other forms (e.g., apparatus or program). An apparatus can be implemented, for example, in suitable hardware, software, and firmware. A method can be implemented, for example, in a processor, which generally refers to a processing device, including, for example, a computer, microprocessor, integrated circuit, or programmable logic device. A processor also includes communication devices, such as, for example, a computer, cellular phone, portable / personal digital assistant (“PDA”), smartphone, tablet computer, and other devices that facilitate the transfer of information between end users.
[0098] References to “an embodiment” or “an embodiment” or “an implementation” or “implementation”, and other variations thereof, mean that the specific features, structures, characteristics, etc., described in connection with the embodiment are included in at least one embodiment. Therefore, the phrases “in an embodiment” or “in an embodiment” or “in an implementation” or “in an implementation” appearing throughout this application, and any other variations thereof, do not necessarily refer to the same embodiment.
[0099] Furthermore, this application may relate to "determining" fragments of various information. Determining information may include one or more of, for example, estimation information, calculation information, prediction information, information retrieved from memory, or information obtained, for example, from another device, module, or user.
[0100] Furthermore, this application may relate to “accessing” fragments of various information. Accessing information may include one or more of the following: receiving information, retrieving information (e.g., retrieving information from memory), storing information, moving information, copying information, calculating information, determining information, predicting information, or estimating information.
[0101] Furthermore, this application may relate to "receiving" fragments of various information. As with "access," receiving is intended to be a broad term. Receiving information may include one or more of, for example, accessing information or retrieving information (e.g., retrieving information from memory). Moreover, "receiving" is generally referred to in one or more ways during operations such as, for example, storing information, processing information, transmitting information, moving information, copying information, erasing information, calculating information, determining information, predicting information, or estimating information.
[0102] To be understood, for example, in the cases of “A / B,” “A and / or B,” and “at least one of A and B,” “one or more of A and B,” the use of any of the following “ / ,” “and / or,” and “at least one of…,” “one or more of…” is intended to cover selecting only the first listed option (A), or only the second listed option (B), or selecting both options (A and B). As a further example, in the cases of “A, B, and / or C,” and “at least one of A, B, and C,” “one or more of A, B, and C,” such wording is intended to cover selecting only the first listed option (A), or only the second listed option (B), or only the third listed option (C), or only the first and second listed options (A and B), or only the first and third listed options (A and C), or only the second and third listed options (B and C), or selecting all three options (A, B, and C). As will be clear to those skilled in the art and related fields, this can be extended to as many entries as possible listed.
[0103] As will be apparent to those skilled in the art, implementations or embodiments can generate various signals formatted to carry, for example, information that can be stored or transmitted. The information may include, for example, instructions for performing a method or data generated by one of the described implementations or embodiments. For example, a signal may be formatted to carry an SDR image or video sequence and SL-HDRx metadata of a described embodiment. Such a signal may be formatted as, for example, electromagnetic waves (e.g., using the radio frequency portion of the spectrum) or as a baseband signal. Formatting may include, for example, encoding the SDR image or video sequence in an encoded stream (i.e., in video data) with SL-HDR1 metadata and modulating a carrier wave with the encoded stream. The information carried by the signal may be, for example, analog or digital information. It is well known that signals can be transmitted via a variety of different wired or wireless links. The signal may be stored on a processor-readable medium.
[0104] The proposed embodiments aim to reduce energy consumption by adjusting the amount of emitted light. These embodiments rely on adjusting the target output peak brightness by taking into account HDR dynamic metadata and energy-aware preprocessing of the SDR content generated by preprocessing module 11.
[0105] In this embodiment, the pre-energy sensing module 12 applies energy-sensing preprocessing to the SDR content generated by the preprocessing module 11. The pre-energy sensing module 12 outputs energy-sensing SDR content. The pre-energy sensing module 12 applies, for example, the energy-sensing preprocessing method described in document PCT / EP2023 / 062360 to the SDR content generated by the preprocessing module 11. This energy-sensing preprocessing method allows for reduced energy consumption when a user views energy-sensing SDR content or HDR content reconstructed from energy-sensing SDR content (i.e., HDR data). Therefore, the encoding module 13 encodes the energy-sensing SDR content output by the pre-energy sensing module 12, rather than encoding the SDR content generated by the preprocessing module 11.
[0106] After the energy-sensing SDR content and SL-HDR1 metadata (e.g., embedded in the SL-HDR information SEI message) are decoded by the decoding module 14, two options are possible for displaying the HDR content: reconstructing the HDR content from the decoded energy-sensing SDR content, or reconstructing the HDR content from the regenerated SDR content corresponding to the SDR content generated by the preprocessing module 11 from the decoded energy-sensing SDR content.
[0107] In terms of energy consumption, the regenerated SDR content has the same characteristics as the SDR content generated by the preprocessing module 11. However, due to the encoding by the encoding module 13 and the decoding by the decoding module 14, and because the encoding is lossy, there are slight differences between the regenerated SDR content and the SDR content generated by the preprocessing module 11.
[0108] In this embodiment, the regenerated SDR content is produced by post-processing of the energy-sensing SDR content applied by the post-energy-sensing module 15. When the user's strategy is not to reduce energy consumption and maintain their optimal service experience, the post-energy-sensing module 15 applies methods such as those described in document PCT / EP2024 / 055276.
[0109] To cover both options, a new signal notification is proposed in the SL-HDR metadata. This new signal notification is included, for example, in the SL-HDR Information SEI message syntax (as specified in Appendix A.2 of the ETSI TS 103.433 specification).
[0110] The new signal notification uses a first information indicating whether the SDR content generated by the SL-HDR tone mapping module is energy-aware preprocessed, a second information indicating how much energy the energy-aware SDR content has reduced compared to the initial SDR content (e.g., the SDR content provided by the preprocessing module 11), and a third information indicating the method used to generate the energy-aware SDR content.
[0111] The first piece of information is indicated by the flag eam_sdr_pre_processing, which indicates whether the SDR content has been preprocessed by energy sensing.
[0112] If the flag `eam_sdr_pre_processing` indicates that the SDR content has been energy-aware preprocessed, then a second piece of information, representing the ratio between the energy consumed by the energy-aware SDR content and the initial SDR content, is signaled by the syntax element `eam_sdr_reduction_ratio`. Table TAB1 provides an example of the semantics of the syntax element `eam_sdr_reduction_ratio`, encoded using "2" bits: eam_sdr_reduction_ratio Semantics 0 The reduction rate is 5%. 1 The reduction rate is 10%. 2 The reduction rate is 20%. 3 The reduction rate is 30%. Table TAB1.
[0113] In another embodiment, when the flag `eam_pre_processing` indicates that the SDR content has been energy-aware preprocessed, the syntax element `eam_sdr_reduction_ratio` specifies the expected energy reduction rate of the HDR content generated by the post-processing module 16 from the decoded energy-aware SDR content. For example, the value of the syntax element `eam_sdr_reduction_ratio` is between "0" and "100", and it is encoded using "7" bits.
[0114] If the flag `eam_sdr_pre_processing` indicates that the SDR content has been preprocessed with energy awareness, then third information indicating the method used to generate the energy awareness SDR content is encoded in the syntax element `eam_sdr_reduction_method`. Table TAB2 provides examples of the semantics of the syntax element `eam_sdr_reduction_method`. eam_sdr_reduction_method Semantics 0 Linear scaling method 1 Histogram cutting 2 CNN-based networks 3 Reversible Neural Network 4 User-defined
[0115] Table TAB2.
[0116] In another embodiment, the additional syntax element eam_sdr_recover indicates whether the initial SDR content must be regenerated before reconstructing the HDR video content or rendering it on the screen.
[0117] In the variant, the syntax element eam_sdr_recover has the semantics represented in table TAB3: eam_sdr_recover Semantics 00 The original SDR content should not be restored, and HDR content should not be generated. 01 The original SDR content should be restored, and HDR content should not be generated. 10 The original SDR content should not be restored, and HDR content should be generated from the energy-sensing SDR content. 11 The original SDR content should be restored, and HDR content should be generated from the restored original SDR content. Table TAB3.
[0118] Due to the semantics above, several scenarios are possible. In each scenario, the pre-energy sensing module 12 generates energy-sensing SDR content from the SDR content generated by the preprocessing module 11, and the encoding module 13 encodes the energy-sensing SDR content together with SL-HDR1 metadata. System A then distributes the data output by the encoding module 13.
[0119] Figure 5 The illustration shows the process performed by system A according to various embodiments.
[0120] In step 500, the processing module 40 of the pre-energy sensing module 12 obtains the SDR content and SL_HDR1 metadata from the preprocessing module 11.
[0121] In step 501, the processing module 40 of the pre-energy sensing module 12 applies energy-sensing preprocessing to the SDR content to obtain energy-sensing SDR content. Energy-sensing preprocessing is, for example, one of the processes shown in Table TAB2. Energy-sensing SDR content allows for, for example, one of the energy reductions shown in Table TAB1 (for displaying energy-sensing SDR content or for displaying HDR content obtained by post-processing the energy-sensing SDR content by the post-processing module 16).
[0122] In step 502, the processing module 40 of the pre-energy sensing module 12 signals energy sensing information in the SL-HDR1 metadata. For example, the processing module 40 of the pre-energy sensing module 12 signals: a flag equal to "1" for eam_pre_processing, indicating that the SDR content has been energy-sensing preprocessed by the pre-energy sensing module 12; a syntax element eam_sdr_reduction_ratio, specifying the expected energy reduction ratio of the HDR content generated by the post-processing module 16 from the energy-sensing SDR content (e.g., eam_sdr_reduction_ratio=2); a syntax element eam_sdr_reduction_method (e.g., eam_sdr_reduction_method=1), indicating the method used to generate the energy-sensing SDR content; and an optional syntax element eam_sdr_recover, indicating whether the initial SDR content must be regenerated before reconstructing the HDR content.
[0123] In step 503, the processing module 40 of the encoding module 13 encodes the energy-sensing SDR content and SL-HDR metadata.
[0124] Figure 6 The illustration shows the process performed by System B according to various embodiments.
[0125] In step 600, the processing module 40 of the decoding module 14 reconstructs the energy-sensing SDR content and SL-HDR metadata.
[0126] In step 601, the processing module 40 of the post-energy sensing module 15 obtains the reconstructed energy-sensing SDR content and SL-HDR metadata.
[0127] In step 601, the processing module 40 of the post-energy sensing module 15 obtains energy sensing information. The processing module 40 of the post-energy sensing module 15 determines from the flag `eam_pre_processing` that the SDR content has been preprocessed with energy sensing, determines from the syntax element `eam_sdr_reduction_ratio` the expected energy reduction ratio (or the expected energy reduction ratio) by displaying the HDR content obtained from the post-processing of the energy-sensing SDR content by the post-processing module 16, and determines from the syntax element `eam_sdr_reduction_method` the method used to generate the energy-sensing SDR content. Optionally, the processing module 40 of the post-energy sensing module 15 obtains the syntax element `eam_sdr_recover`.
[0128] In step 602, based on the decoded energy-aware information or optionally based on the value of the syntax element eam_sdr_recover, the processing module 400 of the post-energy-aware module 15 determines whether it is necessary to regenerate SDR content representing the initial SDR content generated by the preprocessing module 11 from the energy-aware SDR content.
[0129] It can be noted that, in the embodiment, when the pre-energy sensing module 12 systematically applies the same method to generate energy-sensing SDR content with the same energy reduction ratio, it can simply signal the flag eam_pre_processing. Based on this flag, the processing module 400 of the post-energy sensing module 15 can systematically determine that it must regenerate SDR content representing the initial SDR content generated by the preprocessing module 11 from the energy-sensing SDR content.
[0130] If it is necessary to regenerate the SDR content representing the initial SDR content, the processing module 40 of the post-energy sensing module 15 applies energy sensing post-processing to the energy-sensing SDR content in step 603 to regenerate these SDR contents. For example, the processing module 40 of the post-energy sensing module 15 applies the method described in document PCT / EP2024 / 055276.
[0131] Step 603 or step 602, which indicates that the SDR content of the initial SDR content does not need to be regenerated, is followed by step 604.
[0132] During step 604, the processing module 40 of the post-processing module 16 generates HDR content from the SDR content provided by the post-energy sensing module 15. Therefore, depending on the energy sensing information included in the SL-HDR metadata, the processing module 40 of the post-processing module 16 generates HDR content from the energy sensing content or from the SDR content representing the initial SDR content.
[0133] In a variant, during step 603, the processing module 40 of the post-energy sensing module 15 generates hybrid SDR content from the energy-sensing SDR content and from the SDR content representing the initial SDR content. The hybrid SDR content is generated by a linear combination between the energy-sensing SDR content and the SDR content representing the initial SDR content.
[0134] The first method for obtaining hybrid SDR content is represented by the following equation: new sdr (x,y;t)=α×EA sdr (x,y;t)+(1-α)×Reco sdr (x,y;t) Among them, EA sdr (x,y;t) is the sample at position (x,y) of image t in the energy-aware SDR content. sdr (x,y;t) represents the sample at position (x,y) of the image t of the initial SDR content, while α is a parameter that varies between "0" and "1".
[0135] When parameter α equals "0", HDR content is reconstructed from energy-sensing SDR content.
[0136] When parameter α equals "1", HDR content is reconstructed from the SDR content representing the initial SDR content.
[0137] When the parameter α is in the range of 0 to 1, HDR content is more or less energy-aware.
[0138] In the first approximation, we can assume that the parameter α depends linearly on the attenuation ratio given by the syntax element eam_sdr_reduction_ratio, as follows: Where target is the expected new reduction, and target <target(eam_sdr_reduction_ratio )。
[0139] For example, according to Table TAB1, if eam_sdr_reduction_ratio equals "0", then target(eam_sdr_reduction_ratio) = 5%. In this example, the variable target, i.e., the expected new target, should be between 5% and 0%.
[0140] According to Table TAB1, if eam_sdr_reduction_ratio equals "2", then target(eam_sdr_reduction_ratio) = 20%. In this example, the variable target, i.e., the expected reduction rate of the new target, should be between 20% and 0%.
[0141] We have described many embodiments above. The features of these embodiments may be provided individually or in any combination. Furthermore, embodiments may include one or more of the following features, devices, or aspects, individually or in any combination, across various claim classes and types: A TV, set-top box, cellular phone, tablet computer, personal computer, or other electronic device that performs at least one of the described embodiments and displays (e.g., using a monitor, screen, or other type of display) the resulting image.
[0142] • A TV, set-top box, cellular phone, tablet computer, personal computer or other electronic device that tunes (e.g., uses a tuner) to receive signals including encoded SDR video and SL-HDR metadata and performs at least one of the described embodiments.
[0143] • A TV, set-top box, cellular phone, tablet computer or other electronic device that receives signals including encoded SDR video and SL-HDR over the air (e.g., using an antenna) and performs at least one of the described embodiments.
[0144] • A server, camera, cellular phone, tablet computer, personal computer or other electronic device that tunes (e.g., uses a tuner) a channel to transmit signals including SDR video and SL-HDR metadata and performs at least one of the described embodiments.
[0145] • A server, camera, cellular phone, tablet computer, personal computer or other electronic device that transmits signals including SDR video and SL-HDR metadata over the air (e.g., using an antenna) and performs at least one of the described embodiments.
Claims
1. A method comprising: Obtain (500) Standard Dynamic Range (SDR) content and metadata; The first SDR content is preprocessed by (501) to obtain the second SDR content, which allows for a reduction in the energy consumed to display the second SDR content relative to the energy consumed to display the first SDR content, or a reduction in the energy consumed to display the output HDR content generated from the second SDR content relative to the energy consumed to display the output HDR content generated from the first SDR content. Signal (502) energy-aware information in the metadata, the energy-aware information including a syntax element indicating that the first SDR content has been preprocessed to obtain the second SDR content; as well as, Encode the second SDR content and metadata.
2. The method according to claim 1, wherein, Energy-sensing information further includes grammatical elements that indicate the rate of energy reduction.
3. The method according to claim 1 or 2, wherein, The energy-sensing information further includes syntactic elements that indicate the process used in various methods to generate second SDR content from first SDR content.
4. The method according to claim 1, 2 or 3, wherein, The energy-sensing information further includes syntax elements indicating whether the first SDR content must be regenerated to generate the output HDR content.
5. A method comprising: Obtain (601) a reconstructed version of second standard dynamic range (SDR) content and metadata, the metadata including energy-aware information, the energy-aware information including syntax elements indicating that first SDR content has been preprocessed to obtain second SDR content, the second SDR content allowing for energy reduction in the energy consumed to display the second SDR content relative to the energy consumed to display the first SDR content, or energy reduction in the energy consumed to display output HDR content generated from the second SDR content relative to the energy consumed to display output HDR content generated from the reconstructed version of the first SDR content; Based on the energy sensing information, determine (602) whether to regenerate the third SDR content corresponding to the first SDR content from the second SDR content, or to keep the second SDR content as the third SDR content; Based on the determination, (603) intermediate SDR content is obtained from the third SDR content; and, HDR content is generated from intermediate SDR content (604).
6. The method according to claim 5, wherein, Energy-sensing information further includes grammatical elements that indicate the rate of energy reduction.
7. The method according to claim 5 or 6, wherein, The energy-sensing information further includes syntactic elements that indicate the process used in various methods to generate second SDR content from first SDR content.
8. The method according to claim 5, 6 or 7, wherein, The energy-sensing information further includes syntax elements indicating whether the first SDR content must be regenerated to generate the output HDR content.
9. The method according to any of the preceding claims 5 to 8, wherein, In response to regenerating a third SDR content corresponding to the first SDR content from the second SDR content, the intermediate SDR content is a linear combination between the second SDR content and the third SDR content.
10. The method according to claim 9, which is dependent on claim 6, wherein, The weighting factor used in linear combinations depends on the energy reduction rate.
11. An apparatus including electronic circuitry, said electronic circuitry being configured to: Obtain (500) Standard Dynamic Range (SDR) content and metadata; The first SDR content is preprocessed by (501) to obtain the second SDR content, which allows for a reduction in the energy consumed to display the second SDR content relative to the energy consumed to display the first SDR content, or a reduction in the energy consumed to display the output HDR content generated from the second SDR content relative to the energy consumed to display the output HDR content generated from the first SDR content. Signal (502) energy-aware information, the energy-aware information including a syntax element indicating that the first SDR content has been preprocessed to obtain the second SDR content; as well as, Encode the second SDR content and metadata.
12. An apparatus including electronic circuitry, said electronic circuitry being configured to: Obtain (601) a reconstructed version of second standard dynamic range (SDR) content and metadata, the metadata including energy-aware information, the energy-aware information including syntax elements indicating that first SDR content has been preprocessed to obtain second SDR content, the second SDR content allowing for energy reduction in the energy consumed to display the second SDR content relative to the energy consumed to display the first SDR content, or energy reduction in the energy consumed to display output HDR content generated from the second SDR content relative to the energy consumed to display output HDR content generated from the reconstructed version of the first SDR content; Based on the energy sensing information, determine (602) whether to regenerate the third SDR content corresponding to the first SDR content from the second SDR content, or to keep the second SDR content as the third SDR content; Based on the determination, (603) intermediate SDR content is obtained from the third SDR content; and, HDR content is generated from intermediate SDR content (604).
13. The device according to claim 11 or 12, wherein, The energy-aware information further includes at least one of the following: a syntax element indicating the energy reduction rate, a syntax element indicating the method used to generate the second SDR content from the first SDR content among a variety of methods, and a syntax element indicating whether the first SDR content must be regenerated to generate the output HDR content.
14. The device according to claim 11, 12 or 13, wherein, In response to regenerating a third SDR content corresponding to the first SDR content from the second SDR content, the intermediate SDR content is a linear combination between the second SDR content and the third SDR content.
15. The device according to claim 14, which is dependent on claim 13, wherein, The weighting factor used in linear combinations depends on the energy reduction rate.
Citation Information
Patent Citations
Pixel modification to reduce energy consumption of a display device
WO2022238183A1
