Apparatus and method for controlling smart tone mapping roll-off for HDR content
The smart tone mapping roll-off control method addresses the lack of clear criteria in conventional HDR content display by determining roll-off and performer based on metadata and video capability information, ensuring efficient and consistent image quality across different displays.
Patent Information
- Application Number
- PCT/KR2026/005839
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-05-07
- Filing Date
- 2026-05-06
- Publication Date
- 2026-11-12
AI Technical Summary
Conventional methods lack clear criteria for determining whether to perform tone mapping roll-off in High Dynamic Range (HDR) content, leading to issues such as clipping of bright areas or inefficient use of display brightness, and ambiguity about which device should perform the roll-off, resulting in inconsistent image quality across different display environments.
An apparatus and method for smart tone mapping roll-off control that determines whether to perform roll-off, the performer, and the roll-off curve by comparing HDR content metadata and video capability information, using metadata such as mastering display luminance and video capability information to optimize image output.
Ensures efficient utilization of display performance while maintaining image quality by automatically adjusting brightness and dynamic range, preserving detail in bright areas, and providing consistent image quality across various display environments.
Smart Images

Figure KR2026005839_12112026_PF_FP_ABST
Abstract
Description
Device and method for smart tone mapping roll-off control of HDR content
[0001] The present disclosure relates to an apparatus and method for optimizing and providing High Dynamic Range (HDR) content to a display device. Specifically, the present disclosure relates to an apparatus and method for controlling the brightness and dynamic range of an image by determining whether to perform tone mapping roll-off, the entity performing the roll-off, and a roll-off curve based on HDR content metadata and video capability information of the display device.
[0002] HDR (High Dynamic Range) content includes metadata such as mastering display luminance information, maximum content light level (MaxCLL), and maximum frame average light level (MaxFALL) during content creation to provide more realistic image representation based on a high brightness range and a wide dynamic range. Meanwhile, the display device (sink device) provides the source device with supported maximum luminance, minimum luminance, and HDR support characteristics through video capability information such as EDID, DisplayID, or DPCD. The source device can perform tone mapping using this information to produce image output that matches the performance of the display.
[0003] However, in conventional technology, clear criteria are not defined for determining whether to perform roll-off by considering the metadata of HDR content and the luminance characteristics of the display. Consequently, bright areas of content exceeding the maximum brightness limit of the display may be clipped, resulting in the loss of detail, or conversely, roll-off may be performed even when unnecessary, leading to a failure to fully utilize the maximum brightness of the display. This problem not only degrades the viewer's visual experience but also causes inefficient use of the display device's performance.
[0004] Furthermore, since the criteria for determining whether the source or sink device is responsible for performing the roll-off are unclear, issues may arise where duplicate tone mapping is performed on the same content or where the roll-off is not executed at the appropriate time. In particular, the absence of a systematic method to determine whether to perform a roll-off and which device performs it, based on a comparison between HDR content metadata and the video capability information of the sink device, limits the ability to provide consistent image quality across various display environments.
[0005] Therefore, a technology is required that can efficiently utilize the performance of the display while maintaining the image quality of HDR content by determining whether to perform roll-off based on HDR content metadata and video capability information of the sync device, comparing the maximum and average brightness of the content with the luminance characteristics of the display, and providing control criteria including the entity performing the roll-off and the curve.
[0006] To solve the aforementioned problems, the present disclosure provides an apparatus and method for supporting smart tone mapping roll-off control, which can determine whether to perform roll-off, the performer, and the roll-off curve by comparing the luminance characteristics of the content and the luminance limit of the display based on HDR content metadata and video capability information of the display device.
[0007] The technical problems to be solved in this disclosure are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure belongs from the description below.
[0008] According to various embodiments of the present disclosure, a method of operating a source device comprises: acquiring content information corresponding to High Dynamic Range (HDR) content; receiving video capability information of the sink device from a sink device; generating comparison result information by comparing content maximum brightness information included in the content information with display maximum brightness information included in the video capability information; determining roll-off control information including whether to perform a roll-off, a roll-off performer, and roll-off curve information based on smart tone mapping roll-off function information included in the video capability information and the comparison result information; generating video data based on the content information, the comparison result information, and the roll-off curve information when the roll-off control information indicates roll-off performance by the source device; and transmitting the video data to the sink device, wherein when the roll-off control information indicates roll-off performance by the sink device, the video data is HDR video data in which the content information is maintained, and when the roll-off control information indicates roll-off performance by the source device, the video data is HDR video data in which the roll-off curve information is reflected.
[0009] According to various embodiments of the present disclosure, a method of operating a sink device comprises: transmitting video capability information of the sink device to a source device; receiving video data from the source device; generating comparison result information based on content information corresponding to the video data and the video capability information; identifying roll-off control information including whether to perform a roll-off, a roll-off performer, and roll-off curve information based on smart tone mapping roll-off function information included in the video capability information and the comparison result information; and, when the roll-off control information indicates that a roll-off is performed by the sink device, performing a roll-off on the video data based on the content information, the comparison result information, and the roll-off curve information, wherein when the roll-off control information indicates that a roll-off is performed by the source device, the video data is High Dynamic Range (HDR) video data with the roll-off curve information reflected, and when the roll-off control information indicates that a roll-off is performed by the sink device, the video data is HDR video data with the content information retained.
[0010] According to various embodiments of the present disclosure, a source device comprises: an optical sensor; a processor; a memory; and a transceiver, wherein the memory stores instructions for performing operations based on execution by the processor, the operations include: acquiring content information corresponding to High Dynamic Range (HDR) content; receiving video capability information of the sink device from the sink device; generating comparison result information by comparing content maximum brightness information included in the content information with display maximum brightness information included in the video capability information; determining roll-off control information including whether to perform a roll-off, the entity performing the roll-off, and roll-off curve information based on smart tone mapping roll-off function information included in the video capability information and the comparison result information; and, if the roll-off control information indicates roll-off performance by the source device, generating video data based on the content information, the comparison result information and the roll-off curve information. A source device is provided that includes the step of transmitting the video data to the sink device, wherein if the roll-off control information indicates roll-off performance by the sink device, the video data is HDR video data in which the content information is maintained, and if the roll-off control information indicates roll-off performance by the source device, the video data is HDR video data in which the roll-off curve information is reflected.
[0011] According to various embodiments of the present disclosure, a sink device comprises: an optical sensor; a processor; a memory; and a transceiver, wherein the memory stores instructions for performing operations based on execution by the processor, and the operations include: transmitting video capability information of the sink device to a source device; receiving video data from the source device; generating comparison result information based on content information corresponding to the video data and the video capability information; and identifying roll-off control information including whether to perform a roll-off, a roll-off performing agent, and roll-off curve information based on smart tone mapping roll-off function information included in the video capability information and the comparison result information. The method includes the step of performing a roll-off on the video data based on the content information, the comparison result information, and the roll-off curve information when the roll-off control information indicates a roll-off performance by the sink device, wherein when the roll-off control information indicates a roll-off performance by the source device, the video data is HDR (High Dynamic Range) video data reflecting the roll-off curve information, and when the roll-off control information indicates a roll-off performance by the sink device, the video data is HDR video data in which the content information is maintained. A sink device is provided.
[0012] According to various embodiments of the present disclosure, in one or more non-transitory computer-readable media storing one or more instructions, the one or more instructions perform operations based on being executed by one or more processors, and the operations include: acquiring content information corresponding to High Dynamic Range (HDR) content; receiving video capability information of the sink device from the sink device; generating comparison result information by comparing content maximum brightness information included in the content information and display maximum brightness information included in the video capability information; determining roll-off control information including whether to perform a roll-off, the entity performing the roll-off, and roll-off curve information based on smart tone mapping roll-off function information included in the video capability information and the comparison result information; and, if the roll-off control information indicates roll-off performance by the source device, generating video data based on the content information, the comparison result information and the roll-off curve information. A computer-readable medium is provided that includes the step of transmitting the video data to the sink device, wherein if the roll-off control information indicates a roll-off performed by the sink device, the video data is HDR video data in which the content information is retained, and if the roll-off control information indicates a roll-off performed by the source device, the video data is HDR video data in which the roll-off curve information is reflected.
[0013] According to various embodiments of the present disclosure, in one or more non-transitory computer-readable media storing one or more instructions, the one or more instructions perform operations based on being executed by one or more processors, and the operations include: transmitting video capability information of the sink device to a source device; receiving video data from the source device; generating comparison result information based on content information corresponding to the video data and the video capability information; and identifying roll-off control information including whether to perform a roll-off, the entity performing the roll-off, and roll-off curve information based on smart tone mapping roll-off function information included in the video capability information and the comparison result information. A computer-readable medium is provided that includes the step of performing a roll-off on the video data based on the content information, the comparison result information, and the roll-off curve information when the roll-off control information indicates a roll-off performance by the sink device, wherein when the roll-off control information indicates a roll-off performance by the source device, the video data is HDR (High Dynamic Range) video data reflecting the roll-off curve information, and when the roll-off control information indicates a roll-off performance by the sink device, the video data is HDR video data in which the content information is retained.
[0014] To solve the aforementioned problem, the present disclosure may provide an apparatus and method for supporting smart tone mapping roll-off control, which can determine whether to perform roll-off, the entity performing the roll-off, and the roll-off curve by comparing the luminance characteristics of the content and the luminance limit of the display based on HDR content metadata and video capability information of the display device.
[0015] The drawings attached below are intended to aid in understanding the present disclosure and may provide embodiments of the present disclosure together with the detailed description. However, the technical features of the present disclosure are not limited to specific drawings, and the features disclosed in each drawing may be combined with one another to form new embodiments. Reference numerals in each drawing may denote structural elements.
[0016] FIG. 1 is a block diagram showing a system according to various embodiments of the present disclosure.
[0017] FIG. 2 is a diagram illustrating an example of an operation process in which, when a sensor is not provided in both the source device and the sink device, the source device receives an HPD signal, checks the video capability of the sink device, performs general video rendering, and transmits video data.
[0018] Figure 3 illustrates an example of a graph showing the difference in tone mapping curves according to the luminance output characteristics based on the PQ EOTF-based code value (Gray level) and whether or not there is a roll-off operation.
[0019] FIG. 4 illustrates an example of a method for rendering a video signal of a source device according to the prior art.
[0020] FIG. 5 illustrates an example of a method for performing a smart tone mapping roll-off function of a source device according to one embodiment of the present disclosure.
[0021] FIG. 6 illustrates an example of a method for receiving a video signal and outputting an image of a sink device according to the prior art.
[0022] FIG. 7 illustrates an example of a method for performing a smart tone mapping roll-off function of a sink device according to one embodiment of the present disclosure.
[0023] FIG. 8 illustrates an example of a data transmission and reception flow for performing a smart tone mapping roll-off function between a source device and a sink device according to one embodiment of the present disclosure.
[0024] [Correction pursuant to Rule 91 06.07.2026] FIG. 9 is a drawing illustrating an example of a method of operation of a source device according to various embodiments of the present disclosure.
[0025] [Correction pursuant to Rule 91 06.07.2026] FIG. 10 is a drawing illustrating an example of a method of operation of a sink device according to various embodiments of the present disclosure.
[0026] In various embodiments of the present disclosure, "A or B" may mean "only A," "only B," or "both A and B." Alternatively, in various embodiments of the present disclosure, "A or B" may be interpreted as "A and / or B." For example, in various embodiments of the present disclosure, "A, B or C" may mean "only A," "only B," "only C," or "any combination of A, B and C."
[0027] In various embodiments of the present disclosure, a slash ( / ) or a comma used may mean "and / or." For example, "A / B" may mean "A and / or B." Accordingly, "A / B" may mean "only A," "only B," or "both A and B." For example, "A, B, C" may mean "A, B or C."
[0028] In various embodiments of the present disclosure, "at least one of A and B" may mean "only A," "only B," or "both A and B." Additionally, in various embodiments of the present disclosure, the expressions "at least one of A or B" or "at least one of A and / or B" may be interpreted as synonymous with "at least one of A and B."
[0029] Additionally, in various embodiments of the present disclosure, “at least one of A, B and C” may mean “only A,” “only B,” “only C,” or “any combination of A, B and C.” Also, “at least one of A, B or C” or “at least one of A, B and / or C” may mean “at least one of A, B and C.”
[0030]
[0031] FIG. 1 is a block diagram showing a system according to various embodiments of the present disclosure.
[0032] Hereinafter, devices that transmit and receive video, audio, and control data will be collectively referred to as AV (audio / video) systems. Examples of AV systems include HDMI and DisplayPort.
[0033] Referring to FIG. 1, the AV system may include a source device (100) and a sink device (200). In particular, in the AV system, the device that transmits video / audio data corresponds to the source device (100), and the device that receives video / audio data corresponds to the sink device (200). At this time, cables and connectors may be provided as physical devices that connect the two devices to support data transmission and reception.
[0034] Cables and connectors can perform pairing of four channels providing TMDS (Transition Minimized Differential Signaling) data channels and TMDS clock channels. TMDS data channels can be used to transmit video data, audio data, and auxiliary data.
[0035] Additionally, the AV system provides the VESA (Video Electronics Standards Association) Display Data Channel (DDC). The DDC is used for exchanging configuration and status information between source and sink devices. The CEC protocol can provide high-level control functions between various audio-visual products in the user environment and may be used optionally. Furthermore, the optional HDMI Ethernet and Audio Return Channel (HEAC) may provide Ethernet-compatible data networking between the Audio Return Channel (ARC) and connected devices from the opposite direction from the TMDS.
[0036] Video data, audio data, and auxiliary data can be transmitted / received through three TMDS data channels. The TMDS clock typically runs the video pixel rate and is transmitted through the TMDS clock channel. The TMDS clock can be used as a frequency reference for data recovery in the three TMDS data channels at the receiver. At the source device, 8 bits of data per TMDS data channel can be converted into a 10-bit DC-balanced, transition-minimized sequence and transmitted serially at a rate of 10 bits per TMDS clock period.
[0037] To transmit audio data and auxiliary data through TMDS channels, AV systems use a packet structure. To achieve high reliability for audio data and control data, data can be transmitted as 10-bit words generated using BCH error correction codes and error reduction coding.
[0038] The source device can read the E-EDID (Enhanced Extended Display Identification Data) of the DDC (Display Data Channel) sink device to determine the configuration information and available functions of the sink device. The E-EDID may also be referred to as EDID information below.
[0039] The utility line can be used for optional extension functions such as HEAC.
[0040] The source device (100) can receive EDID (Extended Display Identification Data) information from the sink device (200) through a DDC channel. The source device (100) can parse the received EDID information to recognize configuration information and support functions of the sink device (200). The EDID information may include at least one block containing various information regarding the sink device (200).
[0041] In particular, EDID information according to one embodiment of the present invention may include information regarding the function and power supply capability of the sink device (200) in power transmission and reception. The source device (100) recognizes the power transmission / reception capability of the sink device (200) through this EDID information and, accordingly, can transmit power to the sink device (200) or receive power from the sink device (200).
[0042] The source device (100) includes at least one of a display unit (110), a user input interface unit (120), a control unit (180), a transmitter (Tx), a memory unit (140), a storage unit (150), a multimedia unit (160), a power control unit (130), and a power supply unit (170).
[0043] The sink device (200) includes at least one of an EDID EEPROM (210), a power control unit (220), a display unit (230), a user input interface unit (240), a receiver (Rx), a control unit (280), a power supply unit (250), a memory unit (260), and a multimedia unit (270). In the following description, the description of units performing the same operation will not be duplicated.
[0044] The source device (100) represents a physical device that transmits or streams content stored in the storage unit (150) to the sink device (200). The source device (100) can send a request message to the sink device (200) or receive and process a request message received from the sink device (200). The source device (100) can provide a UI that processes a response message sent by the sink device (200) in response to the transmitted request message and delivers it to the user, and if the source device (100) includes a display unit (110), this UI can be provided as a display. Additionally, the source device (100) can request power to be supplied from the sink device (200).
[0045] The sink device (200) receives content from the source device (100) and can send a request message to the source device (100) or process a message received from the source device (100) and send a response message. The sink device (200) can also provide a User Interface (UI) that processes a response message received from the source device (100) and delivers it to a user, and if the sink device (200) includes a display unit, it can provide this UI as a display. Additionally, the sink device (200) can supply power requested by the source device (100) to the source device (100).
[0046] The user input interface unit (120, 240) can receive user action or input, and as an example, the user input interface (120, 240) may correspond to a remote controller, a voice receiving / recognition device, a touch input sensing / receiving device, etc.
[0047] The control unit (180, 280) can control the overall operation of each device. In particular, the control unit (180, 280) can perform communication between the units included in each device and control the operation of each unit.
[0048] The memory unit (140, 260) represents a volatile physical device in which various types of data are temporarily stored.
[0049] A storage unit (150) represents a non-volatile physical device capable of storing various types of data.
[0050] The EDID EEPROM (210) represents an EEPROM that stores EDID information.
[0051] The memory unit (140, 260), storage unit (150), and EDID EEPROM (210) described above all serve the function of storing data, and they may all be collectively referred to as memory units.
[0052] The display unit (110, 230) can display received data or content, data stored in the memory unit, UI, etc., under the control of the control unit (180, 280).
[0053] The multimedia unit (160, 270) can play various types of multimedia. The multimedia unit (160, 270) may be implemented separately from the control unit (180, 280) or may be implemented as a single physical configuration with the control unit (180, 280).
[0054] The power supply unit (170, 250) can supply power required for the operation of the source device (100), the sink device (200), and the units included therein.
[0055] The transmitter (Tx) is a unit equipped in the source device (100) for transmitting and receiving data, and performs data transmission and reception including not only audio / video data but also messages such as commands, requests, actions, and responses between devices.
[0056] The receiver (Rx) is a unit equipped in the sink device (200) for transmitting and receiving data, and performs data transmission and reception including not only audio / video data but also messages such as commands, requests, actions, and responses between devices.
[0057] The power control unit (130, 220) can manage and control power transmission and reception between devices through the transceiver.
[0058] Among the units described above, units other than the transmitter (Rx), receiver (Tx), and control unit (180, 280) may be optionally included in the source device (100) or sink device (200) according to the embodiment and may not correspond to essential component units.
[0059] Previously, power transfer between source and sink devices was not supported in AV systems. As a result, when operating portable devices for extended periods, there was the inconvenience of having to constantly connect an external power cable to ensure optimal operation. To resolve this inconvenience, this specification proposes a method to ensure optimal operation of the AV system without the need for a separate external device by enabling a wired interface in the AV system to support a power transfer function.
[0060] For the sake of convenience of explanation, the device supplying (or transmitting) power will be referred to as the P-Source device, and the device receiving (or supplying) power will be referred to as the P-Sync device. Additionally, a device that simultaneously supports the functions of both the P-Source device and the P-Sync device will be referred to as a Dual device.
[0061]
[0062] Objectives of the various embodiments of the present disclosure
[0063] The present disclosure relates to a method and apparatus capable of automatically enabling or disabling a roll-off function during a tone mapping process in order to effectively display High Dynamic Range (HDR) content on a display device. Hereinafter, this function is referred to as Smart Tone Mapping Roll-off.
[0064] The Smart Tone Mapping Roll-Off function utilizes two key pieces of information. The first is HDR content metadata, which includes information such as color space information, maximum and minimum luminance, transfer function, and the format of the metadata used (e.g., SMPTE ST 2086, CTA-861.3). The second is video capability information of the sink device (e.g., DPCD, EDID, DisplayID), which includes information such as supported color spaces, maximum luminance, minimum luminance, and the HDR metadata format supported by the display.
[0065] Roll-off is a technique that smoothly reduces brightness while maintaining detail in bright areas, contributing to the preservation of highlight areas in HDR content that might be lost due to the display's maximum brightness limit.
[0066] The smart tone mapping roll-off function according to the present disclosure is characterized by the source device or sink device comparing the maximum luminance and average luminance values included in the HDR content metadata and the video capability information of the sink device to automatically determine whether to enable the smart tone mapping roll-off function and who performs it. Specifically, the source device or sink device determines whether to perform the roll-off by automatically adjusting the Perceptual Quantizer (PQ) curve value by comparing the maximum luminance value indicated in the HDR content metadata and the video capability information of the sink device. This function is displayed in the video capability information block of the sink device (e.g., DPCD, EDID, DisplayID), and a source device supporting the function checks this and determines whether to enable the roll-off.
[0067] The entity responsible for executing the smart tone mapping roll-off function is determined by whether the source device and the sink device support the function. If only the source device supports the function, the source device performs video rendering after executing a roll-off on the PQ curve by comparing the metadata of the HDR content with the HDR information included in the video capability information of the sink device. If only the sink device supports the function, the sink device executes the roll-off by checking the metadata value of the HDR content and adjusting the output luminance according to the PQ value. If both the source device and the sink device support the function, the source device checks the video capability information block of the sink device to determine which device takes the lead in executing the roll-off. Through this, the present disclosure enables the effective overcoming of the display's luminance limitations while maintaining the original production intent of the HDR content to the greatest extent possible.
[0068] Prior art in the technical field to which the various embodiments of the present disclosure belong
[0069] (1) Perceptual Quantizer Electro-Optical Transfer Function (PQ EOTF)
[0070] PQ code values play a crucial role in effectively representing the luminance information of HDR content and are defined within a range from 0 to 1024. PQ code values are expressed as integers from 0 to 1024, where 0 represents complete darkness and 1024 represents the maximum luminance level. PQ adopts a method of non-linearly mapping luminance, effectively preserving detail in both dark and bright areas. Due to these non-linear mapping characteristics, HDR content can provide a wider dynamic range and realistic color reproduction.
[0071] [Table 1] below is a lookup table showing the correspondence between PQ code values and luminance levels according to the SMPTE ST 2084 standard based on Gamma 2.2.
[0072] EOTF SMPTE ST 2084 10-bit PQ Code ValueLuminance Level (cd / m²)EOTF SMPTE ST 2084 10-bit PQ Code ValueLuminance Level (cd / m²)0038424.7080.001545049.79160.005445250.83240.011951595.50360.0277520100.234 70.0496592199.15480.0520616249.03560.0738668299.55640.101668401.51990.2979692499.33 1200.498712598.331530.992728691.161561.051768990.021932.015769998.932062.4838071,4042534.9628462,0002545.0318842,8032565.1728923,01330710.059244,02434014.96102310,000
[0073] In [Table 1], the luminance level is also called luminous intensity.
[0074]
[0075] (2) Source Tone Mapping
[0076] Source Tone Mapping is a process in which a source device utilizes the EDID (Extended Display Identification Data) information of a sink device to convert the brightness and contrast of HDR content to match the characteristics of the display.
[0077] The source device first reads EDID information from the sink device. The EDID information includes information regarding display characteristics such as resolution, color depth, refresh rate, maximum brightness, and minimum brightness supported by the sink device. The source device extracts brightness-related data from this and uses it as a reference value for source tone mapping.
[0078] The source device performs source tone mapping based on the extracted luminance information. Source tone mapping is a process that adjusts the wide dynamic range required by HDR content to fit within the range capable of being expressed by the sink device, and includes processing such as luminance adjustment and contrast ratio correction. The video data with completed source tone mapping is transmitted to the sink device, which outputs the data to the display without any additional processing.
[0079] In this way, source tone mapping converts the hue and brightness of HDR content to match the display characteristics based on the EDID information of the sink device, thereby minimizing the loss of video information due to differences in dynamic range and providing an optimal viewing experience.
[0080]
[0081] FIG. 2 illustrates an example of a source tone mapping sequence in which a source device performs tone mapping for HDR content based on EDID information of a sink device and transmits the result to the sink device.
[0082] Referring to Fig. 2, the source tone mapping sequence operates as follows.
[0083] After the source device reads the mastered HDR content, it reads the EDID information (HDR Static Metadata Descriptor Type 1) of the sink device to determine the luminance characteristics of the display. Based on the information obtained in this way, the source device performs tone mapping for the HDR content and transmits the tone-mapped video data to the sink device. The sink device outputs the received video data as is without any additional processing.
[0084]
[0085] (3) CTA-861-H Section 6.9
[0086] [Table 2] shows the classification of content items and groups by data byte number defined in HDR Static Metadata Descriptor Type 1 of the CTA-861 standard.
[0087]
[0088] HDR Static Metadata Descriptor Type 1 includes luminance-related parameters for source HDR tone mapping, and the main parameters are as follows.
[0089] max_display_mastering_luminance is the Mastering Display Luminance value representing the maximum luminance for a 10% patch of the display used for content mastering. min_display_mastering_luminance is the minimum luminance value for a 10% patch of the same mastering display. MaxCLL (Maximum Content Light Level) represents the maximum luminance level based on a single pixel within the content, and MaxFALL (Maximum Frame-Average Light Level) represents the maximum luminance level based on a frame, calculated as the average of all pixel values within a single frame.
[0090] Referring to [Table 2], Data Bytes 19 and 20 specify the max_display_mastering_luminance value. This value is encoded as an unsigned 16-bit value in units of 1 cd / m², where 0x0001 represents 1 cd / m² and 0xFFFF represents 65,535 cd / m². Data Bytes 21 and 22 specify the min_display_mastering_luminance value. This value is encoded as an unsigned 16-bit value in units of 0.0001 cd / m², where 0x0001 represents 0.0001 cd / m² and 0xFFFF represents 6.5535 cd / m². Data Bytes 23 and 24 contain the MaxCLL value. The corresponding value is encoded as an unsigned 16-bit value in units of 1 cd / m², where 0x0001 represents 1 cd / m² and 0xFFFF represents 65,535 cd / m². Data Bytes 25 and 26 contain the MaxFALL value. This value is also encoded as an unsigned 16-bit value in units of 1 cd / m², where 0x0001 represents 1 cd / m² and 0xFFFF represents 65,535 cd / m².
[0091]
[0092] (4) Dynamic Range and Mastering InfoFrame (DRAM) - Source InfoFrame Secondary Data Packet (SDP)
[0093] A Dynamic Range and Mastering InfoFrame (DRAM) is a data structure for transferring information related to the dynamic range of a video signal from a source device to a sink device, and includes a transfer function and static metadata.
[0094]
[0095] InfoFrame Type codeInfoFrame Type = 0x07InfoFrame Version numberVersion = 0x01Length of Info FrameLength of following HDR Metadata InfoFrameData Byte 1F17=0 F16=0 F15=0 F14=0 F13=0Transfer_Function (3 bits)Data Byte 2F27=0 F26=0 F25=0 F24=0 F23=0Static_Metadata_Descriptor_ID (3 bits)Data Byte 3Static_Metadata_DescriptorData Byte nStatic_Metadata_Descriptor
[0096] Transfer_FunctionTransfer Function in the signal0Traditional gamma ― SDR Luminance Range1Traditional gamma ― HDR Luminance Range2Perceptual Quantization (PQ) based on SMPTE ST 2084
[0041] 3Hybrid Log-Gamma (HLG) based on Rec. ITU-R BT.2100
[0048] 4 - 7Reserved for future use
[0097] Static_Metadata_Descriptor_IDMetadata Descriptor0Static Metadata Type 11 - 7Reserved for future use
[0098] [Table 3] shows the overall structure of the DRAM InfoFrame. The DRAM InfoFrame includes the InfoFrame Type code (0x07), version number (0x01), and length information of the HDR metadata InfoFrame. Data Byte 1 includes the Transfer Function and other flags, and Data Byte 2 includes the Static_Metadata_Descriptor_ID. Data Bytes 3 through n include Static_Metadata_Descriptor information.
[0099] [Table 4] indicates the meaning of the Transfer_Function values defined in Data Byte 1. A value of 0 represents the traditional gamma-based SDR luminance range, and a value of 1 represents the traditional gamma-based HDR luminance range. A value of 2 represents the Perceptual Quantization (PQ) method based on SMPTE ST 2084, and a value of 3 represents the Hybrid Log-Gamma (HLG) method based on Rec. ITU-R BT.2100. Values 4 through 7 are reserved for future use.
[0100] [Table 5] shows the meaning of the Static_Metadata_Descriptor_ID values defined in Data Byte 2. A value of 0 represents Static Metadata Type 1, and values 1 through 7 are reserved for future use.
[0101]
[0102] (5) HDR Static Metadata Data Block (HDR SMDB)
[0103]
[0104] bitsByte #765432101CTA Tag Code (0x07)Length of following data block = n bytes2CTA Extended Tag Code (0x06)3F37=0F36=0TF_5TF_4TF_3TF_2TF_1TF_04SM_7SM_6SM_5SM_4SM_3SM_2SM_1SM_05Desired Content Max Luminance data6Desired Content Max Frame-average Luminance data7Desired Content Min Luminance data
[0105] TF_nSupported EOTFTF_0Traditional gamma ― SDR Luminance RangeTF_1Traditional gamma ― HDR Luminance RangeTF_2Perceptual Quantization (PQ) based on SMPTE ST 2084
[0041] TF_3Hybrid Log-Gamma (HLG) based on Rec. ITU-R BT.2100
[0048] TF_4 to TF_5Reserved for future use (0)
[0106] SM_nSupported Static Metadata DescriptorSM_0Static Metadata Type 1SM_1 to SM_7Reserved for future use (0)
[0107] [Table 6] shows the bit structure per byte of the HDR SMDB. Byte 1 contains the CTA tag code (0x07) and data block length information, and Byte 2 contains the CTA extended tag code (0x06). Byte 3 contains bit fields TF_0 to TF_5 indicating the types of supported electro-optical transfer functions (EOTF). Byte 4 contains bit fields SM_0 to SM_7 indicating the types of supported static metadata descriptors. Byte 5 contains Desired Content Max Luminance data preferred by the sink device for optimal content rendering, Byte 6 contains Desired Content Max Frame-average Luminance data, and Byte 7 contains Desired Content Min Luminance data.
[0108] Bytes 5 to 7 of [Table 6] contain luminance information preferred by the sink device for optimal content rendering.
[0109] Byte 5 represents the Desired Content Max Luminance data. This is the absolute maximum luminance (in cd / m²) of the content preferred by the sink device to optimize content rendering in small areas of the screen, and is expressed as a perceptually encoded 8-bit value. Byte 6 represents the Desired Content Max Frame-average Luminance data. This is the maximum frame-average luminance (in cd / m²) of the content preferred by the sink device for optimal content rendering, and is likewise expressed as a perceptually encoded 8-bit value. The luminance values represented by Bytes 5 and 6 are calculated using the following formula: Luminance value = 50 · 2^(CV / 32)
[0110] Here, CV(Code Value) is the decimal value of the corresponding byte.
[0111] Byte 7 represents the Desired Content Min Luminance data. This is the minimum content luminance (in cd / m²) preferred by the sink device for optimal content rendering; it is expressed as a perceptually encoded 8-bit value and is calculated using the following formula: Desired Content Min Luminance = Desired Content Max Luminance · (CV / 255)² / 100
[0112] Here, CV(Code Value) is the decimal value of Byte 7.
[0113] [Table 7] shows the types of electro-optical transfer functions (EOTFs) supported by HDR SMDB. TF_0 represents the traditional gamma-based SDR luminance range, and TF_1 represents the traditional gamma-based HDR luminance range. TF_2 represents the perceptual quantization (PQ) method based on SMPTE ST 2084, and TF_3 represents the hybrid log-gamma (HLG) method based on Rec. ITU-R BT.2100, while TF_4 and TF_5 are reserved for future use.
[0114] [Table 8] shows the types of static metadata descriptors supported by HDR SMDB. SM_0 represents Static Metadata Type 1, and SM_1 through SM_7 are reserved for future use. When SM_0 is set to '1', the sink device informs the source device that it supports Static Metadata Type 1.
[0115]
[0116] (6) SMPTE ST 2084
[0117] SMPTE ST 2084 is a standard that defines the Electro-Optical Transfer Function (EOTF) of HDR video, representing luminance non-linearly based on the Perceptual Quantizer (PQ) curve to match human visual perception characteristics. This standard is designed to represent the luminance and color of HDR content more naturally and efficiently, and provides a significantly wider dynamic range compared to conventional SDR by optimizing the ratio between maximum and minimum luminance.
[0118]
[0119] (7) SMPTE ST 2086:2014
[0120] SMPTE ST 2086:2014 is a metadata standard that defines the mastering display characteristics of HDR content. By accurately describing the color and luminance characteristics of the display during the mastering and transmission of high-definition video content, it enables consistent color reproduction and luminance to be maintained on various display devices.
[0121] The main items of SMPTE ST 2086:2014 metadata are as follows.
[0122] Display Primaries represent the nominal primary colors of the mastering display as three pairs of xy chromaticity coordinates, with metadata values displayed to four decimal places. Chromaticity of White Point represents the nominal white point of the mastering display as xy chromaticity coordinates, also displayed to four decimal places. Maximum Display Mastering Luminance represents the nominal maximum luminance of the mastering display in cd / m² units, with up to four significant figures and two decimal places. Minimum Display Mastering Luminance represents the nominal minimum luminance of the mastering display in cd / m² units, with up to three significant figures and four decimal places.
[0123] SMPTE ST 2086:2014 accurately defines the color and luminance characteristics of mastering displays to ensure the quality of HDR content. This standard contributes to ensuring interoperability between content creators and display manufacturers during the production and transmission of HDR video, and to providing consistent color reproduction and viewing experiences across various display devices. As such, metadata based on SMPTE ST 2086:2014 is designed to maximize the visual quality of HDR content and enable optimal performance in diverse display environments. Metadata information for major HDR movie content currently available on the market is shown in [Table 9].
[0124] TitleStudioMaster (cd / m²)MaxCLL (cd / m²)MaxFALL (cd / m²)ArrivalParamount10001,514172Baby DriverSony Pictures40004,491315Bridge on the River KwaiSony Pictures400010,000272Close Encounters of the Third KindSony Pictures400010,000791Crouching Tiger Hidden DragonSony Pictures40008,985215DaVinci Code, TheSony Pictures40004,897653Fifth Element, TheSony Pictures400010,000724InfernoSony Pictures400010,0003,647Mad Max: Fury RoadWarner Bros.40009,9193,242Magnificent Seven, TheSony Pictures40006,968428Men in Black IISony Pictures400010,000860LifeSony Pictures40006,414952
[0125] (8) Sink Data Block (Example: DPCD, EDID, DisplayID)
[0126] (8-1) DPCD
[0127] DisplayPort Configuration Data (DPCD) is a data structure used to share information necessary for transmission after a connection is established between a source device and a sink device. Unlike EDID, which transmits information from the sink device to the source device unidirectionally, DPCD supports bidirectional communication between the source and sink devices. On the source device side, DPCD is used to display source device information or configure the sink device, while on the sink device side, it is used to declare its capabilities and status. DPCD is transmitted via the DisplayPort AUX channel.
[0128] (8-2) EDID
[0129] EDID (Extended Display Identification Data) is a standardized data format defined by the Video Electronics Standards Association (VESA) used by sink devices to transmit their capabilities and characteristics to source devices. Designed for unidirectional communication from the sink device to the source device, EDID contains information such as the display manufacturer, product type, supported timing and resolution, color characteristics, and audio capabilities. The source device reads the EDID to determine the sink device's capabilities and configures optimal video and audio output settings accordingly. EDID data typically consists of 128-byte or 256-byte blocks, and multiple blocks can be used as needed. EDID is utilized across various video interfaces, including VGA, DVI, HDMI, and DisplayPort, and is transmitted via the I²C bus in most cases. While EDID primarily provides static data with limited real-time status updates or bidirectional communication capabilities, it supports Plug and Play functionality, ensuring compatibility between source and sink devices without requiring manual user configuration.
[0130] (8-3) DisplayID
[0131] DisplayID is a data format designed to describe the characteristics and functions of a sink device in more detail and with greater flexibility. Like EDID, it is used to transmit information from a sink device to a source device, but it offers more extended functionality and flexibility. DisplayID adopts a modular structure that allows various data blocks to be added or modified as needed, and it includes basic display parameters, timing information, color characteristics, and audio functions. Furthermore, it supports the latest display technologies such as high resolutions of 4K or higher, high frame rates, HDR, and Wide Color Gamut, and is designed to accommodate transmission via various video interfaces including DisplayPort, HDMI, and USB-C. Unlike EDID, DisplayID features a variable-length structure and can contain up to 256 data blocks, allowing it to flexibly adapt to future advancements in display technology. DisplayID can be transmitted via the I²C bus or the DisplayPort AUX channel, effectively supporting the complexity and diversity of modern display technologies while maintaining backward compatibility with EDID.
[0132]
[0133] (9) Tone Mapping Luminance according to PQ code value
[0134] Tone Mapping Luminance based on PQ code values is an important concept in HDR content processing, as it determines how the input PQ code values are ultimately expressed as luminance on the display via the PQ EOTF. Tone mapping is a process that converts the wide dynamic range of HDR content to match the luminance range that the sync device can express, and the main methods are as follows.
[0135] Roll-off is a method that preserves detail in highlight areas by smoothly reducing brightness in high-luminance regions. Clipping is a method that sets a specific luminance threshold and clips all luminance information exceeding that threshold; for example, on a display with a maximum luminance of 1,000 cd / m², all luminance information exceeding 1,000 cd / m² is clipped. Knee is a method that prevents clipping by gradually adjusting luminance information when a specific threshold is reached, thereby preserving detail through a smooth transition.
[0136] Figure 3 illustrates an example of a graph showing the difference in tone mapping curves according to the luminance output characteristics based on the PQ EOTF-based code value (Gray level) and whether or not there is a roll-off operation.
[0137] Figure 3 is a graph showing the luminance (unit: nits) output characteristics according to the code value (Code Value, Gray level) based on the PQ EOTF, and also shows the difference in tone mapping curves depending on whether roll-off operation is performed.
[0138] In Fig. 3, the x-axis represents the PQ code value (Gray level) and the y-axis represents the luminance (nits), and the maximum luminance of the display is set to 800 cd / m². The graph displays the original PQ-EOTF curve, the output curve of the display with roll-off in operation (dotted line), and the output curve of the display with roll-off not in operation (solid line), respectively.
[0139] In the case of displays where roll-off does not operate, all luminance information exceeding the maximum luminance of 800 cd / m² is clipped upon reaching this level, resulting in the loss of detail in the highlight area. Conversely, in the case of displays where roll-off operates, luminance begins to be gradually compressed from the knee point and transitions into a smooth curved form until it reaches the clip point, thereby more effectively preserving detail in the highlight area within the maximum luminance limit. The knee point represents the luminance point where roll-off begins, and the clip point represents the point where luminance compression is completed and converges to the maximum luminance.
[0140]
[0141] Problems with conventional technology
[0142] In conventional technology, clear criteria for executing roll-off are not defined, leading to two problems. First, if roll-off is not executed, highlight areas of HDR content exceeding the display's maximum brightness limit are clipped, resulting in a loss of detail. Second, if roll-off is executed even when unnecessary, the display's maximum brightness performance cannot be fully utilized. These issues can negatively impact the viewer's content viewing experience.
[0143] Therefore, it is necessary to establish criteria for automatically determining whether to perform roll-off by comparing the maximum brightness values included in the HDR content metadata and the video capability information of the sync device. This allows viewers to appreciate HDR content more effectively and optimally utilize the display's maximum brightness performance.
[0144]
[0145] Effects of various embodiments of the present disclosure
[0146] The present disclosure provides criteria for a source device (e.g., video player, GPU) or a sink device (e.g., TV, monitor) to automatically enable or disable a smart tone mapping roll-off function by comparing the maximum luminance and average luminance values included in the HDR content metadata and the video capability information of the sink device.
[0147] The Smart Tone Mapping Roll-Off function refers to a function in which a source device or sink device determines whether to enable roll-off by automatically adjusting the Perceptual Quantizer (PQ) curve value by comparing the metadata of HDR content with the maximum luminance value indicated in the sink device's video capability information. This function is displayed in the sink device's video capability information block (e.g., DPCD, EDID, DisplayID), and a source device that supports the function checks this and determines whether to enable roll-off.
[0148]
[0149] Composition and operation of various embodiments of the present disclosure
[0150] Overview
[0151] If only the source device supports the Smart Tone Mapping Roll-off function, the source device compares the metadata of the HDR content with the HDR information contained in the sink device's video capability information to perform a roll-off on the PQ curve, and then performs video rendering. If only the sink device supports this function, the sink device checks the metadata values of the HDR content and performs the roll-off by adjusting the output brightness according to the PQ values. If both the source and sink devices support this function, the source device checks the sink device's video capability information block to determine which device takes the initiative in performing the roll-off.
[0152] A sink device may indicate one or more types of supported roll-off curves in its video capability information (e.g., DPCD, EDID, DisplayID), and a source device may check this information to support the corresponding curve types. If the sink device indicates in its video capability information that it does not support the Smart Tone Mapping Roll-Off function, the source device renders the video signal by specifying the roll-off curve type itself. Conversely, if the source device does not support the Smart Tone Mapping Roll-Off function, the sink device outputs the video after performing Smart Tone Mapping Roll-Off by specifying the roll-off curve type itself.
[0153] Whether to perform smart tone mapping roll-off can be determined by comparing HDR content metadata (mastering display luminance, MaxCLL) with the panel max luminance indicated in the video capability information of the sink device, an example of which is shown in [Table 10] and [Reference 1]. The core of the present disclosure is to provide a criterion for automatically determining whether to perform the smart tone mapping roll-off function through the comparison of such luminance-related data.
[0154]
[0155] [Table 10] shows the criteria for determining whether to perform smart tone mapping roll-off based on the comparison results of the Mastering Display Luminance, which is HDR content metadata, and the Panel EDID Max Luminance indicated in the video capability information of MaxCLL and the sink device.
[0156] When the mastering display brightness is not 0, and MaxCLL is not 0 and MaxCLL is less than or equal to the mastering display brightness (Case 1), roll-off is not performed based on the panel maximum brightness. Specifically, this applies when MaxCLL is equal to the panel maximum brightness and the mastering display brightness (Case 1a), when the mastering display brightness is greater than the panel maximum brightness and the panel maximum brightness is greater than MaxCLL (Case 1b), or when the panel maximum brightness is greater than or equal to the mastering display brightness (Case 1c). When MaxCLL is greater than or equal to the mastering display brightness and exceeds the panel maximum brightness (Case 2), roll-off is performed based on MaxCLL.
[0157] If MaxCLL is 0 or greater than the mastering display brightness (Else), or if there is no information about MaxCLL or it is greater than the mastering display brightness (Case 3), roll-off is not performed based on the panel's maximum brightness. On the other hand, if the mastering display brightness exceeds the panel's maximum brightness or MaxCLL is greater than or equal to the mastering display brightness (Case 4), roll-off is performed based on the mastering display brightness.
[0158] When the mastering display brightness is 0 (Else), or when there is no mastering display brightness information and MaxCLL is 0 or less than the panel maximum brightness (Case 5j, 5k), roll-off is not performed based on the panel maximum brightness, and when MaxCLL is greater than or equal to the panel maximum brightness (Case 5l), roll-off is performed based on MaxCLL.
[0159]
[0160] [Reference 1] Example code comparing metadata (Mastering Display Luminance, MaxCLL) and the maximum brightness indicated on the display's EDID (Panel EDID Max Luminance).
[0161] def determine_case(MaxCLL, Mastering_Display_Luminance, Panel_EDID_Max_Luminance):
[0162] if Mastering_Display_Luminance != 0:
[0163] if MaxCLL != 0:
[0164] # Case 1
[0165] if Panel_EDID_Max_Luminance == Mastering_Display_Luminance:
[0166] return "Case 1a: Metadata = Display 성능"
[0167] elif Mastering_Display_Luminance > Panel_EDID_Max_Luminance > MaxCLL:
[0168] return "Case 1b: Roll Off 수행하지 않음"
[0169] elif Panel_EDID_Max_Luminance >= MaxCLL:
[0170] return "Case 1c: Roll Off 수행하지 않음"
[0171] # Case 2
[0172] elif Mastering_Display_Luminance >= MaxCLL > Panel_EDID_Max_Luminance:
[0173] return "Case 2d: Roll Off 수행"
[0174] else:
[0175] # Case 3
[0176] if Panel_EDID_Max_Luminance > Mastering_Display_Luminance:
[0177] return "Case 3e: Roll Off not performed"
[0178] elif MaxCLL > Panel_EDID_Max_Luminance > Mastering_Display_Luminance:
[0179] return "Case 3f: Roll Off not performed"
[0180] elif MaxCLL > Panel_EDID_Max_Luminance <= Mastering_Display_Luminance:
[0181] return "Case 3g: Roll Off not performed"
[0182] # Case 4
[0183] elif Mastering_Display_Luminance > Panel_EDID_Max_Luminance and MaxCLL == 0:
[0184] return "Case 4h: Perform Roll Off"
[0185] elif MaxCLL > Mastering_Display_Luminance > Panel_EDID_Max_Luminance:
[0186] return "Case 4i: Perform Roll Off"
[0187] else:
[0188] # Case 5
[0189] if Mastering_Display_Luminance == 0 and MaxCLL == 0:
[0190] return "Case 5j: Roll Off not performed"
[0191] elif Mastering_Display_Luminance == 0 and MaxCLL < Panel_EDID_Max_Luminance:
[0192] return "Case 5k: Roll Off not performed"
[0193] elif Mastering_Display_Luminance == 0 and MaxCLL >= Panel_EDID_Max_Luminance:
[0194] return "Case 5l: Perform Roll Off"
[0195]
[0196] System components
[0197] The smart tone mapping roll-off function proposed in this disclosure is structured to automatically determine whether to perform a roll-off and the initiative to perform it (source device or sink device) by comparing the metadata of HDR content with the video capability information of the sink device. The main components of the system for this purpose are as follows.
[0198] (1) The HDR content metadata processing module reads static metadata included in the HDR content and uses it as a reference value for roll-off judgment. The main information used is Mastering Display Luminance max / min, MaxCLL (Maximum Content Light Level), MaxFALL (Maximum Frame-Average Light Level), and SMPTE ST 2086-based color space and white point information. These values represent the maximum and average luminance limits intended by the original content in PQ-based tone mapping and are used as key input values for comparison with the luminance limits of the sink device.
[0199] (2) The video capability information blocks (EDID, DisplayID, DPCD) of the sink device are static information structures for the source device to query the roll-off related capabilities supported by the sink device. These blocks contain information regarding whether the smart tone mapping roll-off function is supported, the types of roll-off curves that can be supported (Knee, Roll-off, Clip, etc.), whether the sink device can perform its own tone mapping, and the roll-off execution initiative (source device-led, sink device-led, or cooperative method). This video capability information can be defined in any of the blocks of EDID, DisplayID, or DPCD, and the source device reads this information after receiving the Hot Plug Detect (HPD) to determine the roll-off operation method.
[0200] Table 11 shows Case 1: EDID, DisplayID, and CTA Block.
[0201] Byte #NameDefinitionX ByteSmart Tone Mapping Roll off function, roll off curve type, whether Smart Tone Mapping roll off is supported, and indication of who leads this function between Source and Sink, and
[0202] Table 12 shows Case 2: DPCD Block.
[0203] DPCD RegisterAddressNameDescriptor0xxxxh[X] Smart Tone Mapping Roll-off Function Indicates the type of roll-off curve, whether Smart Tone Mapping roll-off is supported, and who between Source and Sink will lead this function.
[0204] (3) The roll-off judgment module is a core logic that determines whether to perform roll-off by comparing HDR content metadata with the panel EDID Max Luminance. Based on the judgment rules for Case 1 to Case 5 defined in [Table 10] (comparison between mastering display luminance, MaxCLL, and panel EDID Max Luminance), if the luminance range of the content is within the display's expressible range, roll-off is not required; if the luminance of the content exceeds the display's Max Luminance and protection of details in the highlight area is required, roll-off is performed. The judgment result of the module is directly transmitted to the actual tone mapping process performed by the source device or sink device.
[0205] (4) The roll-off initiative determination module is a component that determines which device, the source device or the sink device, will perform the smart tone mapping roll-off. If only the source device supports the function, the source device performs the roll-off by adjusting the PQ curve; if only the sink device supports the function, the sink device applies the roll-off based on HDR metadata. If both the source device and the sink device support the function, the source device checks the video capability information of the sink device to determine the initiative for performing the roll-off and the type of roll-off curve to apply, and transmits the determined initiative information to the sink device through the video capability information path of the sink device. This prevents duplicate tone mapping or missing tone mapping and enables consistent video output.
[0206] (5) The PQ-based tone mapping and roll-off application module is a module in which the source device or sink device adjusts the luminance mapping for each segment based on the PQ EOTF. The application method consists of a roll-off that implements a smooth reduction in high luminance areas, a knee that is the point where the roll-off begins, and a clip that is the point where luminance compression is completed and converges to the maximum luminance. The selection of the roll-off curve is automatically applied based on the video capability information and the result of the roll-off judgment module.
[0207] (6) The final video output module is configured to output video with the roll-off applied result to the actual panel. The sink device outputs HDR frames with PQ values adjusted depending on whether roll-off is performed, and in the case of the sink device-led method, the roll-off result is reflected up to the subsequent tone mapping and output. In the case of the source device-led method, the sink device outputs the received video data as is without additional processing.
[0208]
[0209] Operation Overview
[0210] The Smart Tone Mapping Roll-Off function operates by comparing the metadata of HDR content with the video capability information of the sink device to automatically determine whether to perform a roll-off and which device should take the initiative (source device or sink device). The overall operation flow is as follows.
[0211] (1) The source device reads static metadata (SMPTE ST 2086, Static Metadata Type 1, etc.) of the HDR content being played to obtain HDR production environment information such as mastering display maximum / minimum brightness, MaxCLL, MaxFALL, chromaticity, and white point. These values define the brightness range required by the content and are used as criteria values to determine the need for roll-off application.
[0212] (2) After receiving the Hot Plug Detect (HPD), the source device checks the EDID, DisplayID, or DPCD of the sink device for information regarding whether the smart tone mapping roll-off function is supported, the type of roll-off curve supported by the sink device, whether the sink device can perform its own roll-off, and the initiative to perform the roll-off. This information is used by the source device to determine how to perform the roll-off.
[0213] (3) The source device compares the HDR content metadata with the panel EDID Max Luminance provided by the sink device to determine whether the sink device can sufficiently express the luminance range of the content, whether there is a risk of clipping in the highlight area, and whether roll-off needs to be enabled or disabled. At this stage, the judgment rules for Case 1 to Case 5 defined in [Table 10] are applied, and the result is determined as either roll-off being performed or roll-off not needed.
[0214] (4) The initiative to perform roll-off is determined by the functional support range of the source device and the sink device. If only the source device supports the function, the source device performs the roll-off by adjusting the PQ curve; if only the sink device supports the function, the sink device performs the roll-off directly. If both the source device and the sink device support the function, the source device checks the video capability information of the sink device to determine the initiative to perform roll-off and the type of curve to apply, and then transmits this to the sink device. This step prevents duplicate tone mapping and maintains a consistent output policy.
[0215] (5) The device (source device or sink device) that has the initiative to perform the roll-off actually applies the PQ EOTF-based roll-off. The application method consists of a roll-off that implements a smooth reduction in high luminance areas, a knee point-based smooth curve transition, and a clipping method to limit the maximum luminance upper limit, and the curve to be applied is determined by the video capability information of the sink device or an internal algorithm.
[0216] (6) In the source device-led method, the source device generates a video frame with roll-off applied and transmits it to the sink device, and the sink device outputs the received frame as is without additional processing. In the sink device-led method, the source device transmits the original HDR frame, and the sink device performs roll-off at the end and outputs it. Through this, the highlight area of the HDR content is naturally reproduced within the maximum brightness range of the sink device, and visual consistency is ensured without unnecessary clipping.
[0217]
[0218] The smart tone mapping roll-off function of the present disclosure consists of a series of processes including collecting HDR content metadata, querying video capability information of a sink device, determining whether to perform a roll-off, determining the initiative to perform a roll-off, applying a PQ-based roll-off, communication between a source device and a sink device, and final video output, and these components are organically combined to realize the automatic execution of a roll-off function optimized for the luminance and dynamic range characteristics of HDR content.
[0219]
[0220] FIG. 4 illustrates an example of a method for rendering a video signal of a source device according to the prior art.
[0221] Referring to FIG. 4, the source device receives a Hot Plug Detect (HPD), reads the video capability information (e.g., EDID, DisplayID, or DPCD) of the sink device, and proceeds with rendering the video signal after verifying the information. In the prior art, the process is limited to reading the video capability information of the sink device, and there is no process to determine whether to perform a roll-off by comparing HDR content metadata with the maximum brightness information of the sink device. As a result, the source device renders the video signal without automatically determining whether to apply a roll-off, which may lead to problems such as clipping and unnecessary roll-off execution as described above.
[0222]
[0223] FIG. 5 illustrates an example of a method for performing a smart tone mapping roll-off function of a source device according to one embodiment of the present disclosure.
[0224] Referring to FIG. 5, after receiving a frame, the source device reads the video capability information (e.g., EDID, DisplayID, or DPCD) of the sink device to determine whether the sink device supports a smart tone mapping roll-off function.
[0225] If the sink device does not support the Smart Tone Mapping Roll-Off function (No Branch), the source device compares the HDR content metadata with the HDR information indicated in the sink device's video capability information. Based on the comparison result, the source device applies Smart Tone Mapping Roll-Off to the HDR content metadata to match the HDR information indicated in the sink device's video capability information and proceeds with video rendering.
[0226] If the sink device supports the Smart Tone Mapping Roll-Off function (Yes branch), the source device checks whether it has the initiative to perform the Smart Tone Mapping Roll-Off function. If the source device has the initiative (Yes branch), the source device compares the HDR content metadata with the sink device's video capability information to select the type of roll-off curve (PQ value change) supported by the sink device, proceeds with video rendering, and simultaneously indicates in the sink device's video capability information that the source device has the initiative for the Smart Tone Mapping Roll-Off function while selecting the roll-off curve type. If the source device does not have the initiative (No branch), the source device renders the video signal using the conventional method, and the sink device compares the HDR content metadata value with the sink device's video capability information to perform Smart Tone Mapping Roll-Off.
[0227]
[0228] FIG. 6 illustrates an example of a method for receiving a video signal and outputting an image of a sink device according to the prior art.
[0229] Referring to FIG. 6, in the prior art, the sink device receives a video signal from the source device and outputs the video immediately without a separate judgment process. That is, the prior art sink device does not have a process to determine whether to perform roll-off by comparing HDR content metadata with its own maximum brightness information, and performs only a simple operation of outputting the received video signal as is. As a result, problems such as clipping and unnecessary roll-off execution described above may occur.
[0230]
[0231] FIG. 7 illustrates an example of a method for performing a smart tone mapping roll-off function of a sink device according to one embodiment of the present disclosure.
[0232] Referring to FIG. 7, after the sink device receives a video signal from the source device, it checks whether the source device has designated the source device as the lead in performing the smart tone mapping roll-off function and whether the roll-off curve type is indicated in the video capability information of the sink device.
[0233] If the source device takes the initiative in the smart tone mapping roll-off function and the type of roll-off curve is indicated in the sink device's video capability information (Yes branch), the sink device outputs the received video data as video without performing smart tone mapping roll-off. This is because the source device has already generated and transmitted a video frame with roll-off applied.
[0234] If the source device does not take the initiative for the smart tone mapping roll-off function (no branch), the sink device performs the smart tone mapping roll-off independently and outputs the video. In this case, the sink device directly applies the roll-off to the original HDR video data received from the source device and outputs it, thereby effectively reproducing the highlight areas of the HDR content within the display's maximum brightness limit.
[0235]
[0236] FIG. 8 illustrates an example of a data transmission and reception flow for performing a smart tone mapping roll-off function between a source device and a sink device according to one embodiment of the present disclosure.
[0237] Referring to FIG. 8, the sink device transmits a Hot Plug Detect (HPD) signal to the source device to indicate the connection. Upon receiving the HPD, the source device checks the sink device's EDID, DisplayID, or DPCD to read the sink device's video capability information. Subsequently, the source device checks the block information contained in the EDID, DisplayID, or DPCD to determine whether the sink device supports a smart tone mapping roll-off function.
[0238] Once the verification of support for the Smart Tone Mapping Roll-Off function is complete, the source device determines whether the initiative to execute the roll-off lies with the source device or the sink device, and indicates this in the sink device's Video Capability information. Subsequently, the source device performs video rendering based on the roll-off initiative information and transmits the rendered video data to the sink device. The sink device processes the received video data according to the roll-off initiative information and outputs the final image.
[0239]
[0240] [Explanation regarding Source device claim]
[0241] The embodiments described above will be explained in detail below with reference to FIG. 9 regarding the operation of the terminal. The methods described below are distinguished only for the convenience of explanation, and it is obvious that, as long as they are not mutually excluded, a part of one method may be substituted with a part of another method or combined with one another and applied.
[0242] FIG. 9 is a drawing illustrating an example of the operation process of a source device according to various embodiments of the present disclosure.
[0243] According to various embodiments of the present disclosure, a method performed by a source device is provided.
[0244] The source device includes a processor; memory; and a transceiver. The memory stores instructions for performing operations based on what is executed by the processor.
[0245] In step S901, the source device acquires content information corresponding to HDR (High Dynamic Range) content.
[0246] In step S902, the source device receives video capability information of the sink device from the sink device.
[0247] In step S903, the source device generates comparison result information by comparing the content maximum brightness information included in the content information with the display maximum brightness information included in the video capability information.
[0248] In step S904, the source device determines roll-off control information including whether to perform a roll-off, the entity performing the roll-off, and roll-off curve information, based on the smart tone mapping roll-off function information included in the video capability information and the comparison result information.
[0249] In step S905, the source device generates video data based on the content information, the comparison result information, and the roll-off curve information when the roll-off control information indicates that the source device is performing a roll-off.
[0250] In step S906, the source device transmits the video data to the sink device.
[0251] If the above roll-off control information indicates that a roll-off is performed by the sink device, the video data is HDR video data in which the content information is retained.
[0252] If the above roll-off control information indicates roll-off performance by the source device, the video data is HDR video data reflecting the roll-off curve information.
[0253] According to various embodiments of the present disclosure, the content information may include maximum content light level information, maximum frame average light level information, mastering display maximum brightness information, and mastering display minimum brightness information.
[0254] According to various embodiments of the present disclosure, the video capability information may include information on whether smart tone mapping roll-off is supported, information on the type of roll-off curve, information on the initiative to perform roll-off, information on maximum display brightness, knee point information, and clip point information.
[0255] According to various embodiments of the present disclosure, the comparison result information may represent at least one of a first state in which the content maximum brightness information is greater than the display maximum brightness information, a second state in which the content maximum brightness information is less than or equal to the display maximum brightness information, and a third state in which the maximum frame average light level information is located within a predetermined range with respect to the display maximum brightness information.
[0256] According to various embodiments of the present disclosure, the smart tone mapping roll-off function information may represent at least one of a first support state in which the source device performs a roll-off, a second support state in which the sink device performs a roll-off, and a third support state in which the source device and the sink device can perform a roll-off.
[0257] According to various embodiments of the present disclosure, when the smart tone mapping roll-off function information indicates the first support state, the roll-off performing entity included in the roll-off control information may represent the source device. When the smart tone mapping roll-off function information indicates the second support state, the roll-off performing entity may represent the sink device. When the smart tone mapping roll-off function information indicates the third support state, the roll-off performing entity may represent either the source device or the sink device according to the roll-off performing initiative information.
[0258] According to various embodiments of the present disclosure, the roll-off curve information may include knee point-related information indicating a roll-off start position, clip point-related information indicating a saturation start position, and curve type information indicating a luminance compression shape between the knee point and the clip point.
[0259] According to various embodiments of the present disclosure, content information may include maximum content light level (MaxCLL) information, maximum frame average light level (MaxFALL) information, mastering display maximum luminance information, and mastering display minimum luminance information. Such content information defines luminance characteristics in the environment where HDR content is produced and is utilized as a key criterion value for determining the necessity of performing roll-off through comparison with the display maximum luminance of the sink device. In the prior art, there was no systematic comparison criterion between such content information and display capability information; however, the present disclosure enables the appropriate activation and deactivation of roll-off by clearly defining this.
[0260] According to various embodiments of the present disclosure, video capability information may include information on whether smart tone mapping roll-off is supported, roll-off curve type information, roll-off execution initiative information, display maximum brightness information, knee point information, and clip point information. Video capability information may be defined in the EDID, DisplayID, or DPCD block of the sink device, and the source device reads this information after receiving the HPD to determine the roll-off operation method. The roll-off curve type information may include one or more roll-off curves that the sink device can support, and the source device may select the optimal curve by referring to this. The roll-off execution initiative information may indicate one of source device-led, sink device-led, or cooperative methods that can be performed by both. This prevents duplicate tone mapping or tone mapping omission between the source device and the sink device, and enables consistent video output.
[0261] According to various embodiments of the present disclosure, the comparison result information may represent at least one of a first state in which the content maximum brightness information is greater than the display maximum brightness information, a second state in which the content maximum brightness information is less than or equal to the display maximum brightness information, and a third state in which the maximum frame average light level information is located within a predetermined range relative to the display maximum brightness information. The first state corresponds to a situation where roll-off application is required because the content maximum brightness exceeds the display's expressible range, and the second state corresponds to a situation where roll-off is unnecessary because the display can sufficiently express the content's brightness range. The third state is a boundary situation in which the maximum frame average light level is close to the display maximum brightness and can be used as an additional criterion for more precisely determining whether to apply roll-off. By defining the comparison result information in multiple stages in this manner, precise roll-off control corresponding to various content and display environments is possible.
[0262] According to various embodiments of the present disclosure, smart tone mapping roll-off function information may represent at least one of a first support state in which a source device performs roll-off, a second support state in which a sink device performs roll-off, and a third support state in which both the source device and the sink device can perform roll-off. In the first support state, the source device generates video data by applying a roll-off curve and transmits it to the sink device, so the sink device can output the received video data as is without additional tone mapping processing. In the second support state, the source device transmits the original HDR video data as is, and the sink device performs roll-off directly based on content information and comparison result information. In the third support state, the source device refers to roll-off execution initiative information within the video capability information of the sink device to finally determine the entity performing the roll-off, thereby enabling efficient roll-off processing without functional overlap between the two parties.
[0263] According to various embodiments of the present disclosure, roll-off curve information may include knee point-related information indicating a roll-off start position, clip point-related information indicating a saturation start position, and curve type information indicating a luminance compression form between the knee point and the clip point. The knee point defines the luminance point where roll-off begins on the PQ curve, and the clip point defines the saturation point where luminance compression is completed and converges to the maximum luminance of the display. The curve type information determines the luminance compression method between the knee point and the clip point, and a type supported by the sink device may be selected from among various curve forms based on linear, exponential, or polynomial principles. By defining the roll-off curve with three parameters—knee point, clip point, and curve type—flexible roll-off control optimized for various display characteristics and content environments is possible.
[0264] According to various embodiments of the present disclosure, a source device is provided. The source device comprises a processor; a memory; and a transceiver, and the processor may be configured to perform the method of operation of the source device according to FIG. 9.
[0265] According to various embodiments of the present disclosure, a device for controlling a source device is provided. The device comprises at least one processor and at least one memory operably connected to the at least one processor. The at least one memory may be configured to store instructions for performing a method of operating the source device according to FIG. 9 based on execution by the at least one processor.
[0266] According to various embodiments of the present disclosure, one or more non-transitory computer-readable media (CRMs) storing one or more instructions are provided. The one or more instructions perform operations based on execution by one or more processors, and the operations may include a method of operation of a source device according to FIG. 9.
[0267]
[0268] [Explanation regarding Sink device claim]
[0269] The embodiments described above will be explained in detail below with reference to FIG. 10 regarding the operation of the terminal. The methods described below are distinguished only for the convenience of explanation, and it is obvious that, as long as they are not mutually excluded, a part of one method may be substituted with a part of another method or combined with one another and applied.
[0270] FIG. 10 is a drawing illustrating an example of the operation process of a sink device according to various embodiments of the present disclosure.
[0271] According to various embodiments of the present disclosure, a method performed by a sink device is provided.
[0272] The sink device includes a processor; memory; and a transceiver. The memory stores instructions for performing operations based on execution by the processor.
[0273] In step S1001, the sink device transmits video capability information of the sink device to the source device.
[0274] In step S1002, the sink device receives video data from the source device.
[0275] In step S1003, the sink device generates comparison result information based on content information corresponding to the video data and the video capability information.
[0276] In step S1004, the sink device identifies roll-off control information including whether to perform a roll-off, the entity performing the roll-off, and roll-off curve information, based on the smart tone mapping roll-off function information included in the video capability information and the comparison result information.
[0277] In step S1005, if the roll-off control information indicates that the sink device is performing a roll-off, the sink device performs a roll-off on the video data based on the content information, the comparison result information, and the roll-off curve information.
[0278] If the above roll-off control information indicates roll-off execution by the source device, the video data is HDR (High Dynamic Range) video data reflecting the roll-off curve information.
[0279] If the above roll-off control information indicates that a roll-off is performed by the sink device, the video data is HDR video data in which the content information is retained.
[0280] According to various embodiments of the present disclosure, the content information may include maximum content light level information, maximum frame average light level information, mastering display maximum brightness information, and mastering display minimum brightness information.
[0281] According to various embodiments of the present disclosure, the video capability information may include information on whether smart tone mapping roll-off is supported, information on the type of roll-off curve, information on the initiative to perform roll-off, information on maximum display brightness, knee point information, and clip point information.
[0282] According to various embodiments of the present disclosure, the comparison result information may represent at least one of a first state in which the content maximum brightness information is greater than the display maximum brightness information, a second state in which the content maximum brightness information is less than or equal to the display maximum brightness information, and a third state in which the maximum frame average light level information is located within a predetermined range with respect to the display maximum brightness information.
[0283] According to various embodiments of the present disclosure, the smart tone mapping roll-off function information may represent at least one of a first support state in which the source device performs a roll-off, a second support state in which the sink device performs a roll-off, and a third support state in which the source device and the sink device can perform a roll-off.
[0284] According to various embodiments of the present disclosure, when the smart tone mapping roll-off function information indicates the first support state, the roll-off performing entity included in the roll-off control information may represent the source device. When the smart tone mapping roll-off function information indicates the second support state, the roll-off performing entity may represent the sink device. When the smart tone mapping roll-off function information indicates the third support state, the roll-off performing entity may represent either the source device or the sink device according to the roll-off performing initiative information.
[0285] According to various embodiments of the present disclosure, the roll-off curve information may include knee point-related information indicating a roll-off start position, clip point-related information indicating a saturation start position, and curve type information indicating a luminance compression shape between the knee point and the clip point.
[0286] According to various embodiments of the present disclosure, content information may include maximum content light level (MaxCLL) information, maximum frame average light level (MaxFALL) information, mastering display maximum luminance information, and mastering display minimum luminance information. Such content information defines luminance characteristics in the environment where HDR content is produced and is utilized as a key criterion value for determining the necessity of performing roll-off through comparison with the display maximum luminance of the sink device. In the prior art, there was no systematic comparison criterion between such content information and display capability information; however, the present disclosure enables the appropriate activation and deactivation of roll-off by clearly defining this.
[0287] According to various embodiments of the present disclosure, video capability information may include information on whether smart tone mapping roll-off is supported, roll-off curve type information, roll-off execution initiative information, display maximum brightness information, knee point information, and clip point information. Video capability information may be defined in the EDID, DisplayID, or DPCD block of the sink device, and the source device reads this information after receiving the HPD to determine the roll-off operation method. The roll-off curve type information may include one or more roll-off curves that the sink device can support, and the source device may select the optimal curve by referring to this. The roll-off execution initiative information may indicate one of source device-led, sink device-led, or cooperative methods that can be performed by both. This prevents duplicate tone mapping or tone mapping omission between the source device and the sink device, and enables consistent video output.
[0288] According to various embodiments of the present disclosure, the comparison result information may represent at least one of a first state in which the content maximum brightness information is greater than the display maximum brightness information, a second state in which the content maximum brightness information is less than or equal to the display maximum brightness information, and a third state in which the maximum frame average light level information is located within a predetermined range relative to the display maximum brightness information. The first state corresponds to a situation where roll-off application is required because the content maximum brightness exceeds the display's expressible range, and the second state corresponds to a situation where roll-off is unnecessary because the display can sufficiently express the content's brightness range. The third state is a boundary situation in which the maximum frame average light level is close to the display maximum brightness and can be used as an additional criterion for more precisely determining whether to apply roll-off. By defining the comparison result information in multiple stages in this manner, precise roll-off control corresponding to various content and display environments is possible.
[0289] According to various embodiments of the present disclosure, smart tone mapping roll-off function information may represent at least one of a first support state in which a source device performs roll-off, a second support state in which a sink device performs roll-off, and a third support state in which both the source device and the sink device can perform roll-off. In the first support state, the source device generates video data by applying a roll-off curve and transmits it to the sink device, so the sink device can output the received video data as is without additional tone mapping processing. In the second support state, the source device transmits the original HDR video data as is, and the sink device performs roll-off directly based on content information and comparison result information. In the third support state, the source device refers to roll-off execution initiative information within the video capability information of the sink device to finally determine the entity performing the roll-off, thereby enabling efficient roll-off processing without functional overlap between the two parties.
[0290] According to various embodiments of the present disclosure, roll-off curve information may include knee point-related information indicating a roll-off start position, clip point-related information indicating a saturation start position, and curve type information indicating a luminance compression form between the knee point and the clip point. The knee point defines the luminance point where roll-off begins on the PQ curve, and the clip point defines the saturation point where luminance compression is completed and converges to the maximum luminance of the display. The curve type information determines the luminance compression method between the knee point and the clip point, and a type supported by the sink device may be selected from among various curve forms based on linear, exponential, or polynomial principles. By defining the roll-off curve with three parameters—knee point, clip point, and curve type—flexible roll-off control optimized for various display characteristics and content environments is possible.
[0291] According to various embodiments of the present disclosure, a sink device is provided. The sink device comprises a processor; a memory; and a transceiver, and the processor may be configured to perform the method of operation of the sink device according to FIG. 10.
[0292] According to various embodiments of the present disclosure, a device for controlling a sink device is provided. The device comprises at least one processor and at least one memory operably connected to the at least one processor. The at least one memory may be configured to store instructions for performing a method of operating a sink device according to FIG. 10 based on execution by the at least one processor.
[0293] According to various embodiments of the present disclosure, one or more non-transitory computer-readable media (CRMs) storing one or more instructions are provided. The one or more instructions perform operations based on execution by one or more processors, and the operations may include a method of operation of a sink device according to FIG. 10.
[0294] The claims described in various embodiments of the present disclosure may be combined in various ways. For example, the technical features of the method claims of various embodiments of the present disclosure may be combined to be implemented as a device, and the technical features of the device claims of various embodiments of the present disclosure may be combined to be implemented as a method. Furthermore, the technical features of the method claims and the technical features of the device claims of various embodiments of the present disclosure may be combined to be implemented as a device, and the technical features of the method claims and the technical features of the device claims of various embodiments of the present disclosure may be combined to be implemented as a method.
Claims
1. In the method of operating a source device, A step of acquiring content information corresponding to HDR (High Dynamic Range) content; A step of receiving video capability information of the sink device from the sink device; A step of generating comparison result information by comparing content maximum brightness information included in the above content information and display maximum brightness information included in the above video capability information; A step of determining roll-off control information including whether to perform a roll-off, the entity performing the roll-off, and roll-off curve information based on smart tone mapping roll-off function information included in the video capability information and the comparison result information; When the roll-off control information indicates roll-off performance by the source device, a step of generating video data based on the content information, the comparison result information and the roll-off curve information; and The method includes the step of transmitting the above video data to the sink device, When the above roll-off control information indicates roll-off performance by the sink device, the video data is HDR video data in which the content information is retained, and When the above roll-off control information indicates roll-off performance by the source device, the video data is HDR video data reflecting the roll-off curve information, method.
2. In Paragraph 1, The above content information includes maximum content light level information, maximum frame average light level information, mastering display maximum brightness information, and mastering display minimum brightness information. method.
3. In Paragraph 1, The above video capability information includes information on whether smart tone mapping roll-off is supported, information on the type of roll-off curve, information on the roll-off execution initiative, information on maximum display brightness, knee point information, and clip point information. method.
4. In Paragraph 1, The above comparison result information represents at least one of a first state in which the content maximum brightness information is greater than the display maximum brightness information, a second state in which the content maximum brightness information is less than or equal to the display maximum brightness information, and a third state in which the maximum frame average light level information is located within a predetermined range with respect to the display maximum brightness information. method.
5. In Paragraph 1, The smart tone mapping roll-off function information indicates at least one of a first support state in which the source device performs a roll-off, a second support state in which the sink device performs a roll-off, and a third support state in which the source device and the sink device can perform a roll-off. method.
6. In Paragraph 1, When the smart tone mapping roll-off function information indicates the first support state, the roll-off performing entity included in the roll-off control information indicates the source device, and When the above smart tone mapping roll-off function information indicates the above second support state, the entity performing the roll-off indicates the above sink device, and If the smart tone mapping roll-off function information indicates the third support state, the roll-off performing entity indicates one of the source device or the sink device according to the roll-off performing initiative information, method.
7. In Paragraph 1, The above roll-off curve information includes knee point-related information indicating a roll-off start position, clip point-related information indicating a saturation start position, and curve type information indicating a luminance compression shape between the knee point and the clip point. method.
8. In the method of operating a sink device, A step of transmitting video capability information of the sink device to the source device; A step of receiving video data from the source device; A step of generating comparison result information based on content information corresponding to the video data and the video capability information; A step of identifying roll-off control information including whether to perform a roll-off, the entity performing the roll-off, and roll-off curve information based on smart tone mapping roll-off function information included in the video capability information and the comparison result information; and When the roll-off control information indicates roll-off performance by the sink device, the method includes the step of performing a roll-off for the video data based on the content information, the comparison result information, and the roll-off curve information. When the above roll-off control information indicates roll-off execution by the source device, the video data is HDR (High Dynamic Range) video data reflecting the roll-off curve information, and When the above roll-off control information indicates the performance of roll-off by the above sink device, the video data is HDR video data in which the above content information is maintained, method.
9. In Paragraph 8, The above content information includes maximum content light level information, maximum frame average light level information, mastering display maximum brightness information, and mastering display minimum brightness information. method.
10. In Paragraph 8, The above video capability information includes information on whether smart tone mapping roll-off is supported, information on the type of roll-off curve, information on the roll-off execution initiative, information on maximum display brightness, knee point information, and clip point information. method.
11. In Paragraph 8, The above comparison result information represents at least one of a first state in which the content maximum brightness information is greater than the display maximum brightness information, a second state in which the content maximum brightness information is less than or equal to the display maximum brightness information, and a third state in which the maximum frame average light level information is located within a predetermined range with respect to the display maximum brightness information. method.
12. In Paragraph 8, The smart tone mapping roll-off function information indicates at least one of a first support state in which the source device performs a roll-off, a second support state in which the sink device performs a roll-off, and a third support state in which the source device and the sink device can perform a roll-off. method.
13. In Paragraph 8, When the smart tone mapping roll-off function information indicates the first support state, the roll-off performing entity included in the roll-off control information indicates the source device, and When the above smart tone mapping roll-off function information indicates the above second support state, the entity performing the roll-off indicates the above sink device, and If the smart tone mapping roll-off function information indicates the third support state, the roll-off performing entity indicates one of the source device or the sink device according to the roll-off performing initiative information, method.
14. In Paragraph 8, The above roll-off curve information includes knee point-related information indicating a roll-off start position, clip point-related information indicating a saturation start position, and curve type information indicating a luminance compression shape between the knee point and the clip point. method.
15. In a source device, It includes a processor; memory; and a transceiver, The above memory stores instructions for performing operations based on execution by the processor, and The above operations are, A step of acquiring content information corresponding to HDR (High Dynamic Range) content; A step of receiving video capability information of the sink device from the sink device; A step of generating comparison result information by comparing content maximum brightness information included in the above content information and display maximum brightness information included in the above video capability information; A step of determining roll-off control information including whether to perform a roll-off, the entity performing the roll-off, and roll-off curve information based on smart tone mapping roll-off function information included in the video capability information and the comparison result information; When the roll-off control information indicates roll-off performance by the source device, a step of generating video data based on the content information, the comparison result information and the roll-off curve information; and The method includes the step of transmitting the above video data to the sink device, When the above roll-off control information indicates roll-off performance by the sink device, the video data is HDR video data in which the content information is retained, and When the above roll-off control information indicates roll-off performance by the source device, the video data is HDR video data reflecting the roll-off curve information, Source device.
16. In a sink device, It includes a processor; memory; and a transceiver, The above memory stores instructions for performing operations based on execution by the processor, and The above operations are, A step of transmitting video capability information of the sink device to the source device; A step of receiving video data from the source device; A step of generating comparison result information based on content information corresponding to the video data and the video capability information; A step of identifying roll-off control information including whether to perform a roll-off, the entity performing the roll-off, and roll-off curve information based on smart tone mapping roll-off function information included in the video capability information and the comparison result information; and When the roll-off control information indicates roll-off performance by the sink device, the method includes the step of performing a roll-off for the video data based on the content information, the comparison result information, and the roll-off curve information. When the above roll-off control information indicates roll-off execution by the source device, the video data is HDR (High Dynamic Range) video data reflecting the roll-off curve information, and When the above roll-off control information indicates the performance of roll-off by the above sink device, the video data is HDR video data in which the above content information is maintained, Sink device.
17. In one or more non-transitory computer-readable media storing one or more instructions, The above one or more instructions perform operations based on being executed by one or more processors, and The above operations are, A step of acquiring content information corresponding to HDR (High Dynamic Range) content; A step of receiving video capability information of the sink device from the sink device; A step of generating comparison result information by comparing content maximum brightness information included in the above content information and display maximum brightness information included in the above video capability information; A step of determining roll-off control information including whether to perform a roll-off, the entity performing the roll-off, and roll-off curve information based on smart tone mapping roll-off function information included in the video capability information and the comparison result information; When the roll-off control information indicates roll-off performance by the source device, a step of generating video data based on the content information, the comparison result information and the roll-off curve information; and The method includes the step of transmitting the above video data to the sink device, When the above roll-off control information indicates roll-off performance by the sink device, the video data is HDR video data in which the content information is retained, and When the above roll-off control information indicates roll-off performance by the source device, the video data is HDR video data reflecting the roll-off curve information, Computer-readable media.
18. In one or more non-transitory computer-readable media storing one or more instructions, The above one or more instructions perform operations based on being executed by one or more processors, and The above operations are, A step of transmitting video capability information of the sink device to the source device; A step of receiving video data from the source device; A step of generating comparison result information based on content information corresponding to the video data and the video capability information; A step of identifying roll-off control information including whether to perform a roll-off, the entity performing the roll-off, and roll-off curve information based on smart tone mapping roll-off function information included in the video capability information and the comparison result information; and When the roll-off control information indicates roll-off performance by the sink device, the method includes the step of performing a roll-off for the video data based on the content information, the comparison result information, and the roll-off curve information. When the above roll-off control information indicates roll-off execution by the source device, the video data is HDR (High Dynamic Range) video data reflecting the roll-off curve information, and When the above roll-off control information indicates the performance of roll-off by the above sink device, the video data is HDR video data in which the above content information is maintained, Computer-readable media.
