Device and method for performing source device-based tone mapping on basis of luminance support information for each of various patch sizes of sink device

Abstract

According to various embodiments of the present disclosure, the provided method comprises the steps of: receiving a Hot Plug Detection (HPD) signal from a sink device; receiving, from the sink device, first information related to an Extended Display Identification (EDID) or a DisplayID (DPID) or DisplayPort Configuration Data (DPCD); identifying second information related to High Dynamic Range (HDR) content; generating, on the basis of the second information and luminance support information for each patch size included in the first information, output content information obtained by applying source-based tone mapping to the HDR content; and transmitting the output content information to the sink device.

Description

Device and method for performing source device-based tone mapping based on luminance support information for various patch sizes of a sink device

[0001] The present disclosure relates to a device and method for performing source device-based tone mapping based on luminance support information for various patch sizes of a sink device.

[0002]

[0003] Since each display has different characteristics, the supported luminance information may also differ depending on the patch size of the sink device. However, previously, only the maximum / minimum luminance for 10% and 100% patch sizes was indicated in the sink device information (e.g., EDID, DisplayID, DPCD, etc.) and transmitted to the source device. The source device performed tone mapping using only this information. The maximum / minimum luminance information for 10% and 100% patch sizes is insufficient for accurate tone mapping due to the following factors.

[0004] (1) Current Proposal: Support for peak luminance according to patch size is generally considered together with current proposal, which controls the brightness of the display. Smaller patch sizes can support higher brightness per pixel through current proposal. On the other hand, larger patch sizes can make it difficult to control the current per pixel, which can lower peak luminance.

[0005] (2) Display Technology: Various technologies exist, including LCD, OLED, and QLED, each with different electrical and optical characteristics. These differences can lead to variations in pixel brightness and color reproducibility.

[0006] (3) Display size: Large and small displays may have different pixel densities, which may affect brightness and color reproduction.

[0007] As the types and characteristics of displays become more diverse, rather than indicating only luminance support information for 10% and 100% patch sizes in the sync device information (e.g., EDID, DisplayID, DPCD, etc.) as before, it is necessary to indicate maximum / minimum luminance information according to various patch sizes in the sync device information (e.g., EDID, DisplayID, DPCD, etc.) for more accurate tone mapping.

[0008]

[0009] To solve the above-described problem, the present disclosure provides a device and method for performing source device-based tone mapping based on luminance support information for various patch sizes of a sink device.

[0010] The technical problems to be achieved in the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0011]

[0012] According to various embodiments of the present disclosure, a method for operating a source device (Source) is provided, comprising: receiving a hot plug detection (HPD) signal from a sink device (Sink); receiving first information related to EDID (Extended Display Identification) or DPID (DisplayID) or DPCD (DisplayPort Configuration Data) from the sink device; identifying second information related to HDR content (High Dynamic Range contents); generating output content information by applying Source based Tone Mapping to the HDR content based on luminance support information for each patch size included in the first information and the second information; and transmitting the output content information to the sink device.

[0013] According to various embodiments of the present disclosure, a source device (Source) is provided, comprising: a processor; a memory; and a transceiver, wherein the memory stores instructions for performing operations based on what is executed by the processor, the operations comprising: receiving a hot plug detection (HPD) signal from a sink device (Sink); receiving first information related to EDID (Extended Display Identification) or DPID (DisplayID) or DPCD (DisplayPort Configuration Data) from the sink device; identifying second information related to HDR content (High Dynamic Range contents); generating output content information by applying Source based Tone Mapping to the HDR content based on luminance support information for each patch size included in the first information and the second information; and transmitting the output content information to the sink device.

[0014] According to various embodiments of the present disclosure, a computer-readable medium storing one or more commands is provided, wherein the one or more commands perform operations based on being executed by one or more processors, the operations comprising: receiving a hot plug detection (HPD) signal from a sink device; receiving first information related to EDID (Extended Display Identification) or DPID (DisplayID) or DPCD (DisplayPort Configuration Data) from the sink device; identifying second information related to HDR content (High Dynamic Range contents); generating output content information by applying Source Based Tone Mapping to the HDR content based on luminance support information for each patch size included in the first information and the second information; and transmitting the output content information to the sink device.

[0015]

[0016] To solve the above-described problem, the present disclosure can provide a device and method for performing source device-based tone mapping based on luminance support information for various patch sizes of a sink device.

[0017]

[0018] The accompanying drawings are intended to aid in understanding the present disclosure and, together with detailed descriptions, may provide embodiments of the present disclosure. However, the technical features of the present disclosure are not limited to specific drawings, and the features disclosed in each drawing may be combined with each other to form new embodiments. Reference numerals in each drawing may indicate structural elements.

[0019] FIG. 1 is a block diagram illustrating a system according to various embodiments of the present disclosure.

[0020] FIG. 2 is a diagram illustrating an example of a sequence of source device-based tone mapping.

[0021] FIG. 3 is a diagram illustrating an example of a flowchart of source device-based tone mapping.

[0022] FIG. 4 is a diagram illustrating an example of a flowchart of conventional source device-based tone mapping.

[0023] FIG. 5 is a diagram illustrating an example of a flowchart of source device-based tone mapping according to various embodiments of the present disclosure.

[0024] FIG. 6 is a diagram illustrating an example of an operation method of a source device (Source) according to various embodiments of the present disclosure.

[0025]

[0026] In various embodiments of the present disclosure, “A or B” may mean “only A,” “only B,” or “both A and B.” In other words, in various embodiments of the present disclosure, “A or B” may be interpreted as “A and / or B.” For example, in various embodiments of the present disclosure, “A, B or C” may mean “only A,” “only B,” “only C,” or “any combination of A, B and C.”

[0027] In various embodiments of the present disclosure, a slash ( / ) or a comma may mean "and / or." For example, "A / B" may mean "A and / or B." Accordingly, "A / B" may mean "only A," "only B," or "both A and B." For example, "A, B, C" may mean "A, B, or C."

[0028] In various embodiments of the present disclosure, “at least one of A and B” may mean “only A,” “only B,” or “both A and B.” Furthermore, in various embodiments of the present disclosure, the expressions “at least one of A or B” or “at least one of A and / or B” may be interpreted as equivalent to “at least one of A and B.”

[0029] Additionally, in various embodiments of the present disclosure, “at least one of A, B and C” can mean “only A,” “only B,” “only C,” or “any combination of A, B and C.” Additionally, “at least one of A, B or C” or “at least one of A, B and / or C” can mean “at least one of A, B and C.”

[0030]

[0031] FIG. 1 is a block diagram illustrating a system according to various embodiments of the present disclosure.

[0032] Hereinafter, devices that transmit and receive video / audio / control data will be collectively referred to as an AV (audio / video) system. Examples of AV systems include HDMI and DisplayPort.

[0033] Referring to FIG. 1, an AV system may include a source device (100) and a sink device (200). In particular, a device transmitting audio / video data in the AV system may correspond to the source device (100), and a device receiving video / audio data may correspond to the sink device (200). In this case, cables and connectors may be provided as physical devices that connect the two devices to support data transmission and reception.

[0034] Cables and connectors can pair four channels, each providing a Transition Minimized Differential Signaling (TMDS) data channel and a TMDS clock channel. The TMDS data channels can be used to carry video data, audio data, and auxiliary data.

[0035] Additionally, the AV system provides the Video Electronics Standards Association (VESA) Display Data Channel (DDC). DDC is used to exchange configuration and status information between source and sink devices. The CEC protocol can provide high-level control functions between various audiovisual products in the user environment and can also be used optionally. In addition, the optional HEAC (HDMI Ethernet and Audio Return Channel) can provide ARC (Audio Return Channel) and Ethernet-compatible data networking between connected devices in the opposite direction from TMDS.

[0036] Video data, audio data, and additional data can be transmitted / received over three TMDS data channels. The TMDS clock, which typically runs the video pixel rate, is transmitted over the TMDS clock channel. The TMDS clock can be used as a frequency reference for data recovery on the three TMDS data channels at the receiver. At the source device, 8 bits of data per TMDS data channel can be converted into a 10-bit DC-balanced, transition-minimized sequence that can be serially transmitted at a rate of 10 bits per TMDS clock period.

[0037] To transmit audio data and additional data over TMDS channels, AV systems use a packet structure. To achieve high reliability for audio and control data, data can be transmitted as 10-bit words generated using BCH error correction and error reduction coding.

[0038] A source device can read the Enhanced Extended Display Identification Data (E-EDID) of a Display Data Channel (DDC) sink device to determine the sink device's configuration information and capabilities. E-EDID may also be referred to as EDID information hereinafter.

[0039] The utility line can be used for optional extensions such as HEAC.

[0040] The source device (100) can receive EDID (Extended Display Identification Data) information from the sink device (200) via a DDC channel. The source device (100) can parse the received EDID information to recognize configuration information and supported functions of the sink device (200). The EDID information can include at least one block containing various information regarding the sink device (200).

[0041] In particular, EDID information according to one embodiment of the present invention may include information on the function and power supply capability of the sink device (200) in power transmission and reception. The source device (100) recognizes the power transmission / reception capability of the sink device (200) through this EDID information, and accordingly transmits power to the sink device (200) or receives power from the sink device (200).

[0042] The source device (100) includes at least one of a display unit (110), a user input interface unit (120), a control unit (180), a transmitter (Tx), a memory unit (140), a storage unit (150), a multimedia unit (160), a power control unit (130), and a power supply unit (170).

[0043] The sink device (200) includes at least one of an EDID EEPROM (210), a power control unit (220), a display unit (230), a user input interface unit (240), a receiver (Rx), a control unit (280), a power supply unit (250), a memory unit (260), and a multimedia unit (270). Hereinafter, descriptions of units performing the same operation will not be repeated.

[0044] The source device (100) represents a physical device that transmits or streams content stored in the storage unit (150) to the sink device (200). The source device (100) can send a request message to the sink device (200) or receive and process a request message received from the sink device (200). The source device (100) can provide a UI that processes and transmits a response message transmitted by the sink device (200) in response to the transmitted request message to the user, and when the source device (100) includes a display unit (110), this UI can be provided as a display. In addition, the source device (100) can request the sink device (200) to supply power.

[0045] The sink device (200) receives content from the source device (100) and can transmit a request message to the source device (100) or process a message received from the source device (100) and transmit a response message. The sink device (200) can also provide a UI (User Interface) that processes the response message received from the source device (100) and transmits it to the user. If the sink device (200) includes a display unit, this UI can be provided as a display. In addition, the sink device (200) can supply power requested by the source device (100) to the source device (100).

[0046] The user input interface unit (120, 240) can receive a user's action or input, and as an example, the user input interface (120, 240) can correspond to a remote controller, a voice receiving / recognition device, a touch input sensing / receiving device, etc.

[0047] The control unit (180, 280) can control the overall operation of each device. In particular, the control unit (180, 280) can perform communication between units included in each device and control the operation of each unit.

[0048] The memory unit (140, 260) represents a volatile physical device in which various types of data are temporarily stored.

[0049] The storage unit (150) represents a non-volatile physical device capable of storing various types of data.

[0050] EDID EEPROM (210) represents an EEPROM that stores EDID information.

[0051] The above-described memory unit (140, 260), storage unit (150), and EDID EEPROM (210) all serve to store data, and they may all be collectively referred to as memory units.

[0052] The display unit (110, 230) can display received data or content, data stored in the memory unit, UI, etc. under the control of the control unit (180, 280).

[0053] The multimedia unit (160, 270) can play various types of multimedia. The multimedia unit (160, 270) may be implemented separately from the control unit (180, 280), or may be implemented as a single physical configuration with the control unit (180, 280).

[0054] The power supply unit (170, 250) can supply power required for the operation of the source device (100), the sink device (200) and the units included therein.

[0055] A transmitter (Tx) is a unit equipped in a source device (100) that transmits and receives data, and performs data transmission and reception including not only audio / video data but also messages such as commands, requests, actions, and responses between devices.

[0056] The receiver (Rx) is a unit equipped in the sink device (200) that transmits and receives data, and performs data transmission and reception including not only audio / video data but also messages such as commands, requests, actions, and responses between devices.

[0057] The power control unit (130, 220) can manage and control power transmission and reception between devices via a transmitter and receiver.

[0058] Among the above-described units, units other than the transmitter (Rx), receiver (Tx), and control unit (180, 280) may be optionally included in the source device (100) or the sink device (200) depending on the embodiment, and may not be essential component units.

[0059] Previously, AV systems did not support power transfer between source and sink devices. As a result, when operating portable devices for extended periods, the inconvenience of always having to connect an external power cable for optimal operation existed. To address this issue, this specification proposes a method for ensuring optimal AV system operation without the need for external devices by enabling the wired interface to support power transfer.

[0060] For convenience of explanation, below, a device that supplies (or transmits) power will be referred to as a P-source device, and a device that supplies (or receives) power will be referred to as a P-sync device. Additionally, a device that simultaneously supports the functions of a P-source device and a P-sync device will be referred to as a dual device.

[0061]

[0062] Background to various embodiments of the present disclosure

[0063] Various embodiments of the present disclosure aim at a technology used in a source-based tone mapping method. A sink device (Sink) transmits luminance support information according to various patch sizes to a source device (Source) by indicating the information on the sink device (e.g., EDID, DisplayID, DPCD, etc.). By using the luminance support information according to various patch sizes included in the received information on the sink device, the source device (Source) can perform more optimized tone mapping compared to the existing method (in which only the luminance support information of the sink device for patch sizes of 10% and 100% is transmitted from the sink device to the source device). When information on the detailed patch size (Patch Size) is used compared to the existing method, detailed elements such as textures, shadows, and highlights can be more naturally converted, and it is useful for emphasizing or correcting only a desired part, and by changing only a specific area, a desired style can be applied while preserving part of the original content.

[0064]

[0065] The process of source-based tone mapping

[0066] (1) Collection of sink device information (e.g., EDID, DisplayID, DPCD, etc.): The display (EDID Sink) has EDID information that includes information about the resolution, color depth, refresh rate, etc. that the device supports. This information is read by the connected device (usually a graphics card or source device).

[0067] (2) Luminance information extraction: Extract brightness-related data from the sync device information (e.g., EDID, DisplayID, DPCD, etc.). This typically includes information on the maximum and minimum brightness supported by the display.

[0068] (3) Source-based Tone Mapping: Source-based Tone Mapping is performed by utilizing luminance information extracted from the sink device information (e.g., EDID, DisplayID, DPCD, etc.). Source-based Tone Mapping is mainly used to adjust high dynamic range (HDR) images or videos to the lower dynamic range of the display. This includes tasks such as brightness adjustment and contrast ratio correction.

[0069] (4) Adjusted Image Output: Images or videos are output to the display through a source-based tone mapping process. During this process, brightness adjustments are applied based on the display's sync device information (e.g., EDID, DisplayID, DPCD, etc.).

[0070] This process utilizes the display's sink device information (e.g., EDID, DisplayID, DPCD, etc.) to perform source-based tone mapping to convert color tones and contrast to match the display, thereby providing an optimal visual experience while minimizing image loss due to differences in dynamic range.

[0071]

[0072] FIG. 2 is a diagram illustrating an example of a sequence of source device-based tone mapping.

[0073] The sequence of Source based Tone Mapping is as follows.

[0074] (1) The source device (Source) reads the mastered HDR content.

[0075] (2) Read information such as HDR Static Metadata Descriptor Type 1 from the sink device information (e.g. EDID, DisplayID, DPCD, etc.) from the source device (Source).

[0076] (3) Tone mapping for HDR content is performed based on the information read by the source device.

[0077] (4) Transmit the image data on which tone mapping has been performed to the sink device.

[0078] (5) The sink device displays image data on the display device without any separate processing.

[0079]

[0080] CTA-861-H Section 6.9

[0081] HDR Static Metadata Descriptor Type 1 contains the following Luminance-related parameters for source device-based HDR tone mapping.

[0082] (1) max_display_mastering_luminance

[0083] (1-1) Mastering Display Luminance is the maximum luminance for 10% of the display used during content production (mastering).

[0084] (2) min_display_mastering_luminance

[0085] (2-1) Minimum luminance for 10% patch of display used in content production (mastering) as Mastering Display Luminance

[0086] (3) Maximum Content Light Level

[0087] (3-1) MaxCLL: Maximum luminance level per single pixel of the content

[0088] (4) Maximum Frame-average Light Level

[0089] (4-1) MaxFall: Maximum luminance level based on a single frame of content (average of all pixel values ​​in a single frame)

[0090]

[0091] 데이터 바이트 번호(Data Byte Number)컨텐츠(Contents)그룹(Group)Data Byte 3display_primaries_x[0], LSB1Data Byte 4display_primaries_x[0], MSBData Byte 5display_primaries_y[0], LSBData Byte 6display_primaries_y[0], MSBData Byte 7display_primaries_x[1], LSBData Byte 8display_primaries_x[1], MSBData Byte 9display_primaries_y[1], LSBData Byte 10display_primaries_y[1], MSBData Byte 11display_primaries_x[2], LSBData Byte 12display_primaries_x[2], MSBData Byte 13display_primaries_y[2], LSBData Byte 14display_primaries_y[2], MSBData Byte 15white_point_x, LSB2Data Byte 16white_point_x, MSBData Byte 17white_point_y, LSBData Byte 18white_point_y, MSBData Byte 19max_display_mastering_luminance, LSB3Data Byte 20max_display_mastering_luminance, MSBData Byte 21min_display_mastering_luminance, LSB4Data Byte 22min_display_mastering_luminance, MSBData Byte 23Maximum Content Light Level, LSB5Data Byte 24Maximum Content Light Level, MSBData Byte 25Maximum Frame-average Light Level,LSB6Data Byte 26Maximum Frame-average Light Level, MSB,

[0092]

[0093] Data bytes 19-20 specify a value for the max_display_mastering_luminance. This value is coded as an unsigned 16-bit value in units of 1 cd / m2, where 0x0001 represents 1 cd / m2 and 0xFFFF represents 65535 cd / m2.

[0094] Data bytes 21-22 specify a value for the min_display_mastering_luminance. This value is coded as an unsigned 16-bit value in units of 0.0001 cd / m2, where 0x0001 represents 0.0001 cd / m2 and 0xFFFF represents 6.5535 cd / m2.

[0095] Data bytes 23-24 contain the Maximum Content Light Level (MaxCLL). This value is coded as an unsigned 16-bit value in units of 1 cd / m2, where 0x0001 represents 1 cd / m2 and 0xFFFF represents 65535 cd / m2. The algorithm used to calculate MaxCLL is defined in Annex P, section N.

[0096] Data bytes 25-26 contain the Maximum Frame-Average Light Level (MaxFALL). This value is coded as an unsigned 16-bit value in units of 1 cd / m2, where 0x0001 represents 1 cd / m2 and 0xFFFF represents 65535 cd / m2. The algorithm used to calculate MaxFALL is defined in Annex P, section P.2.

[0097]

[0098] SMPTE ST 2086:2014

[0099] The description of Meta Data is as follows.

[0100] 5 Metadata

[0101] 5.1 Display Primaries

[0102] The nominal primaries of the mastering display, as configured for the mastering process, shall be represented as three xy chromaticity coordinates. The metadata value shall be a number with four decimal places.

[0103] 5.2 Chromaticity of White Point

[0104] The nominal chromaticity of the white point of the mastering display, as configured for the mastering process, shall be expressed as an xy chromaticity coordinate. The metadata value shall be a number with four decimal places.

[0105] 5.3 Maximum Display Mastering Luminance

[0106] The nominal maximum display luminance of the mastering display, as configured for the mastering process, shall be expressed in candelas per square meter (cd / m2). The metadata value shall be a number with up to four significant digits and up to two decimal places.

[0107] 5.4 Minimum Display Mastering Luminance

[0108] The nominal minimum display luminance of the mastering display, as configured for the mastering process, shall be expressed in candelas per square meter (cd / m2). The metadata value shall be a number with up to three significant digits and up to four decimal places.

[0109]

[0110] Problems with prior art

[0111] Since each display has different characteristics, the supported luminance information may also differ depending on the patch size of the sink device. However, previously, only the maximum / minimum luminance for 10% and 100% patch sizes was indicated in the sink device information (e.g., EDID, DisplayID, DPCD, etc.) and transmitted to the source device. The source device performed tone mapping using only this information. The maximum / minimum luminance information for 10% and 100% patch sizes is insufficient for accurate tone mapping due to the following factors.

[0112] (1) Current Proposal: Support for peak luminance according to patch size is generally considered together with current proposal, which controls the brightness of the display. Smaller patch sizes can support higher brightness per pixel through current proposal. On the other hand, larger patch sizes can make it difficult to control the current per pixel, which can lower peak luminance.

[0113] (2) Display Technology: Various technologies exist, including LCD, OLED, and QLED, each with different electrical and optical characteristics. These differences can lead to variations in pixel brightness and color reproducibility.

[0114] (3) Display size: Large and small displays may have different pixel densities, which may affect brightness and color reproduction.

[0115] As the types and characteristics of displays become more diverse, rather than indicating only luminance support information for 10% and 100% patch sizes in the sync device information (e.g., EDID, DisplayID, DPCD, etc.) as before, it is necessary to indicate maximum / minimum luminance information according to various patch sizes in the sync device information (e.g., EDID, DisplayID, DPCD, etc.) for more accurate tone mapping.

[0116]

[0117] Composition and operation of the invention

[0118] FIG. 3 is a diagram illustrating an example of a flowchart of source device-based tone mapping.

[0119] A sink device can add luminance support information according to various patch sizes to a block of sink device information (e.g., EDID, DisplayID, DPCD, CTA Extension, etc.) that can express display information.

[0120] For example, the sink device information (e.g., EDID, DisplayID, DPCD, CTA Extension, etc.) may include information on the maximum / minimum luminance supported by the sink device for patch sizes of 1%, 2%, 3%, 99%, 100%.

[0121] The source device (Source) reads luminance support information according to the various patch sizes of the display, performs tone mapping on the content, generates video data, and transmits the generated video data to the sink device (Sink).

[0122] Referring to FIG. 3, a source device (Source) receives a hot plug detection (HPD) signal from a sink device (Sink).

[0123] The source device (Source) receives sink device information related to EDID (Extended Display Identification) or DPID (DisplayID) or DPCD (DisplayPort Configuration Data).

[0124] The source device (Source) obtains luminance support information for each patch size of multiple patch sizes of the sink device from the sink device information.

[0125] The source device (Source) transmits video data (Video Data) with tone mapping applied based on luminance support information for each patch size for HDR content (High Dynamic Range contents) to the sink device (Sink).

[0126]

[0127] FIG. 4 is a diagram illustrating an example of a flowchart of conventional source device-based tone mapping.

[0128] Referring to FIG. 4, the source device (Source) checks the display information (e.g., EDID, DisplayID, DPCD) of the sink device to check the information of the maximum / minimum brightness supported in the display area (10% and 100%) of the sink device (Sink).

[0129] The source device (Source) checks the color information, MaxCLL (Maximum Content Light Level), and mastering information of the display used when producing HDR content to verify information about HDR content.

[0130] The source device (Source) applies source-based tone mapping to HDR content based on information from the HDR content and the display of the sink device.

[0131] The source device (Source) generates final output data with source-based tone mapping applied and transmits it to the sink device (Sink).

[0132]

[0133] FIG. 5 is a diagram illustrating an example of a flowchart of source device-based tone mapping according to various embodiments of the present disclosure.

[0134] Referring to FIG. 5, the source device (Source) checks the display information (e.g., EDID, DisplayID, DPCD) of the sink device to check the information of the maximum / minimum luminance supported in the display area (each of various patch sizes from 1% to 100%) of the sink device (Sink).

[0135] The source device (Source) checks the color information, MaxCLL (Maximum Content Light Level), and mastering information of the display used when producing HDR content to verify information about HDR content.

[0136] The source device (Source) applies source-based tone mapping to HDR content based on information from the HDR content and the display of the sink device.

[0137] The source device (Source) generates final output data with source-based tone mapping applied and transmits it to the sink device (Sink).

[0138]

[0139] Effects according to various embodiments of the present disclosure

[0140] Previously, the luminance support information that could be expressed through the display's sync device information (e.g., EDID, DisplayID, DPCD, etc.) was mainly the maximum / minimum luminance information for patch sizes of 10% and 100%. The source device performed tone mapping using only this information. However, this did not fully reflect the characteristics of the display and resulted in limited operation. However, performing tone mapping using luminance according to various patch sizes has the following advantages.

[0141] (1) Emphasize specific areas: Using luminance support information for various patch sizes allows for more precise adjustments to individual small areas of an image. This allows for more precise control of detailed textures, shadows, highlights, and more within the image.

[0142] (2) Preservation of detail: Using luminance support information for various patch sizes allows transformations to be applied while preserving more of the details of the original image. Using a large patch size may sacrifice details, while using a small patch size can preserve details while applying the transformation.

[0143] (3) High-resolution support: Using luminance support information for various patch sizes allows for more sophisticated transformations even for high-resolution images. High-quality results can be achieved while processing even the smallest details in high-resolution images.

[0144] Therefore, various embodiments of the present disclosure propose a method for adding luminance support information according to various patch sizes to HDR technology and display standards. This allows the source device to perform more accurate tone mapping and provide optimal panel performance by using appropriate luminance information according to the characteristics of the display and patch size.

[0145]

[0146] [Source device (Source) claim related description]

[0147] The embodiments described below are specifically described with reference to FIG. 6 in terms of terminal operation. The methods described below are distinguished for convenience of explanation, and it is understood that, unless mutually exclusive, some components of one method may be substituted for or combined with some components of another method.

[0148] FIG. 6 is a diagram illustrating an example of an operation method of a source device (Source) according to various embodiments of the present disclosure.

[0149] According to various embodiments of the present disclosure, a method is provided that is performed by a source device (Source).

[0150] A source device (Source) includes a processor; a memory; and a transceiver. The memory stores instructions for performing operations based on those executed by the processor.

[0151] At step S601, the source device (Source) receives a hot plug detection (HPD) signal from the sink device (Sink).

[0152] In step S602, the source device (Source) receives first information related to EDID (Extended Display Identification) or DPID (DisplayID) or DPCD (DisplayPort Configuration Data) from the sink device. The first information includes luminance support information for each patch size of a plurality of patch sizes of the sink device.

[0153] At step S603, the source device (Source) identifies second information related to HDR content (High Dynamic Range contents).

[0154] In step S604, the source device (Source) generates output content information by applying source-based tone mapping to the HDR content based on the luminance support information for each patch size and the second information.

[0155] In step S605, the source device (Source) transmits the output content information to the sink device.

[0156]

[0157] According to various embodiments of the present disclosure, the patch size is a numerical value representing the ratio of an area displayed as white for luminance measurement of the sink device when the entire display area of ​​the sink device is 100%, and the remaining area that does not correspond to the patch size in the luminance measurement may be displayed as black.

[0158] According to various embodiments of the present disclosure, the second information may include color information of a display used in producing the HDR content, MaxCLL (Maximum Content Light Level) information, and mastering information.

[0159] According to various embodiments of the present disclosure, the mastering information may include information on maximum luminance and minimum luminance for a 10% patch of the display used in producing the HDR content.

[0160] According to various embodiments of the present disclosure, the luminance support information for each patch size included in the first information may include luminance support information of the sink device for a plurality of arbitrary patch sizes between 0% and 100%. The plurality of arbitrary patch sizes may correspond to a plurality of arbitrary patch sizes set between 0% and 100%. The plurality of arbitrary patch sizes are not limited to patch sizes expressed as integer %, but may correspond to patch sizes expressed as real % between 0% and 100%. The plurality of arbitrary patch sizes may correspond to 0%, 1%, 2%, 3%, ..., 100%, but this is merely exemplary and may be set in various ways.

[0161] According to various embodiments of the present disclosure, the luminance support information for each patch size included in the first information may include luminance support information of the sink device for each of three or more patch sizes ranging from 0% to 100%.

[0162] According to various embodiments of the present disclosure, the output content may be content in which the brightness and contrast of the HDR content are adjusted based on the luminance support information for each patch size.

[0163]

[0164] According to various embodiments of the present disclosure, a source device (Source) is provided. The source device (Source) includes a processor; a memory; and a transceiver, wherein the processor may be configured to perform the method of operating the source device (Source) according to FIG. 6.

[0165]

[0166] According to various embodiments of the present disclosure, a device for controlling a source device (Source) is provided. The device includes at least one processor and at least one memory operably connected to the at least one processor. The at least one memory may be configured to store instructions for performing an operating method of the source device (Source) according to FIG. 7 based on instructions executed by the at least one processor.

[0167]

[0168] According to various embodiments of the present disclosure, one or more non-transitory computer-readable media (CRM) storing one or more commands are provided. The one or more commands, when executed by one or more processors, perform operations, and the operations may include an operating method of a source device (Source) according to FIG. 6.

[0169]

[0170] The claims described in the various embodiments of the present disclosure may be combined in various ways. For example, the technical features of the method claims of the various embodiments of the present disclosure may be combined and implemented as a device, and the technical features of the device claims of the various embodiments of the present disclosure may be combined and implemented as a method. Furthermore, the technical features of the method claims of the various embodiments of the present disclosure may be combined and implemented as a device, and the technical features of the method claims of the various embodiments of the present disclosure may be combined and implemented as a method.

Claims

1. In the method of operating the source device (Source), A step of receiving a hot plug detection (HPD) signal from a sink device; A step of receiving first information related to EDID (Extended Display Identification) or DPID (DisplayID) or DPCD (DisplayPort Configuration Data) from the sink device; The first information includes luminance support information for each patch size for a plurality of patch sizes of the sink device; A step of identifying second information related to HDR content (High Dynamic Range contents); A step of generating output content information by applying source-based tone mapping to the HDR content based on the luminance support information for each patch size and the second information; comprising a step of transmitting the output content information to the sink device; method.

2. In paragraph 1, The above patch size is a numerical value representing the ratio of the area displayed in white for luminance measurement of the sink device when the entire display area of ​​the sink device is 100%, and the remaining area that does not correspond to the patch size in the luminance measurement is displayed in black. method.

3. In paragraph 1, The second information includes color information of the display used in producing the HDR content, MaxCLL (Maximum Content Light Level) information, and mastering information. method.

4. In paragraph 3, The above mastering information includes information on the maximum luminance and minimum luminance for a 10% patch of the display used in the production of the HDR content. method.

5. In paragraph 1, The luminance support information for each patch size included in the first information includes luminance support information of the sink device for a plurality of arbitrary patch sizes between 0% and 100%. method.

6. In paragraph 1, The luminance support information for each patch size included in the first information includes luminance support information of the sink device for each of three or more patch sizes ranging from 0% to 100%. method.

7. In paragraph 1, The above output content is content in which the brightness and contrast of the HDR content are adjusted based on the luminance support information for each patch size. method.

8. In the source device (Source), A processor; memory; and a transceiver, The above memory stores instructions for performing operations based on what is executed by the processor, The above actions are, A step of receiving first information related to EDID (Extended Display Identification) or DPID (DisplayID) or DPCD (DisplayPort Configuration Data) from the sink device; The first information includes luminance support information for each patch size for a plurality of patch sizes of the sink device; A step of identifying second information related to HDR content (High Dynamic Range contents); A step of generating output content information by applying source-based tone mapping to the HDR content based on the luminance support information for each patch size and the second information; comprising a step of transmitting the output content information to the sink device; Source device.

9. In paragraph 8, The above patch size is a numerical value representing the ratio of the area displayed in white for luminance measurement of the sink device when the entire display area of ​​the sink device is 100%, and the remaining area that does not correspond to the patch size in the luminance measurement is displayed in black. Source device.

10. In paragraph 8, The second information includes color information of the display used in producing the HDR content, MaxCLL (Maximum Content Light Level) information, and mastering information. Source device.

11. In paragraph 10, The above mastering information includes information on the maximum luminance and minimum luminance for a 10% patch of the display used in the production of the HDR content. Source device.

12. In paragraph 8, The luminance support information for each patch size included in the first information includes luminance support information of the sink device for a plurality of arbitrary patch sizes between 0% and 100%. Source device.

13. In paragraph 8, The luminance support information for each patch size included in the first information includes luminance support information of the sink device for each of three or more patch sizes ranging from 0% to 100%. Source device.

14. In paragraph 8, The above output content is content in which the brightness and contrast of the HDR content are adjusted based on the luminance support information for each patch size. Source device.

15. In one or more non-transitory computer-readable media storing one or more instructions, The one or more instructions perform operations based on being executed by one or more processors, The above actions are, A step of receiving a hot plug detection (HPD) signal from a sink device; A step of receiving first information related to EDID (Extended Display Identification) or DPID (DisplayID) or DPCD (DisplayPort Configuration Data) from the sink device; The first information includes luminance support information for each patch size for a plurality of patch sizes of the sink device; A step of identifying second information related to HDR content (High Dynamic Range contents); A step of generating output content information by applying source-based tone mapping to the HDR content based on the luminance support information for each patch size and the second information; comprising a step of transmitting the output content information to the sink device; Computer readable medium.

Images