Source color volume information messaging

By utilizing SEI messaging to convey detailed source color volume information, the challenges of encoding and decoding HDR content are addressed, resulting in improved display management and enhanced image quality for HDR and wide gamut content.

JP2025038013AActive Publication Date: 2025-03-18DOLBY LABORATORIES LICENSING CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2024213265
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2016-11-29
Filing Date
2024-12-06
Publication Date
2025-03-18
Estimated Expiration
2037-10-03

AI Technical Summary

Technical Problem

Existing image encoding and decoding methods struggle to efficiently convey and process source color volume information, particularly for high dynamic range (HDR) and wide gamut content, due to limitations in current standards like HEVC, which do not cover all necessary metadata for optimal display management.

Method used

The proposed solution involves using Supplemental Enhancement Information (SEI) messaging to convey source color volume information, including the maximum 2D gamut occupied by the source, maximum, minimum, and average luminance values, and optional 2D gamut slices for these luminance values, allowing for improved display management and HDR content rendering.

Benefits of technology

This approach enables more efficient and effective display management by providing the necessary metadata for accurate tone mapping and gamut mapping, thereby enhancing the quality of HDR content on a wide range of displays.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025038013000001_ABST
    Figure 2025038013000001_ABST
Patent Text Reader

Abstract

To provide an apparatus and a computer program for communicating source color volume information in a coded bitstream using supplemental enhancement information (SEI) messaging.SOLUTION: Data for communicating source color volume information include at least minimum, maximum, and average luminance values and optional data in source data. The optional data include color volume x and y chromaticity coordinates for input color primaries (e.g., red, green, and blue) of the source data, and the color x and y chromaticity coordinates for color primaries corresponding to the minimum, average, and maximum luminance values in the source data. Messaging data signaling an active region in each picture is also included.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to U.S. Provisional Patent Application No. 62 / 427,677, filed November 29, 2016, and U.S. Provisional Patent Application No. 62 / 404,302, filed October 5, 2016, the disclosures of which are incorporated herein by reference in their entireties. technology

[0002] The present invention relates generally to images, and more particularly to conveying and processing source color volume information. [Background technology]

[0003] background ITU-T Recommendation H.265[1] for "Coding of moving images" (also known as HEVC) describes in Annex D, "Supplemental enhancement information" (SEI), and Annex E, "Video usability information" (VUI), a syntax for providing supplemental SEI and VUI information in the coded bitstream to allow a decoder to better map the decoded samples to a display.

[0004] Along with the MPEG / ITU standardization process, the Society of Motion Picture and Television Engineers (SMPTE) has also defined a number of recommendations regarding conveying metadata about color volume information for both source video and target displays. For example, the SMPTE ST 2094 suite of documents (e.g., [5] and [6]) defines metadata for use in color volume transformation of video content. These metadata may vary from scene to scene or frame to frame. For example, such metadata may help a decoder to present high dynamic range (HDR) and wide color gamut (WCG) data on a display that has a smaller color volume than the color volume of the mastering display used to master the source image.

[0005] As used herein, the term "metadata" refers to any auxiliary information that is transmitted as part of an encoded bitstream and that assists a decoder in rendering a decoded image. Such metadata may include, but is not limited to, color space or gamut information, prediction parameters, reference display parameters, and auxiliary signal parameters, as described herein.

[0006] H.265 Annexes D and E address many color volume related metadata, but not all of the metadata required for the most efficient display management of HDR content. At the Joint Working Group on Video Coding (JCT-VC) meeting in Geneva in June 2016, three proposals [2-4] were presented on how to describe content color volume information using SEI or VUI messaging. Some of these proposals were inspired by SMPTE ST.2094 [5], but are very different in scope.

[0007] In [2], a Content-SEI message describing the actual color distribution of the video content is proposed to signal the content gamut in 2D. In the VUI, the variable c In [1], the color_primaries message is used. In [3], multiple primary expressions and spatial regions are proposed to be associated with specified source characteristics. In [4], the Content Color Volume SEI message is proposed to indicate the color volume occupied by the content. It uses an (x,y,Y) description of color coordinates and has slices of luminance Y, with each slice having an associated polygon. These proposals have many shortcomings: they provide information that is of little use to most display manufacturers, they can add significant overhead, and they may require computational overhead that is too large to generate. To improve on existing encoding and decoding methods, the inventors have determined that improved techniques for generating and conveying source color volume information are needed.

[0008] The approaches described in this section are approaches that could be pursued, but not necessarily approaches that have been previously conceived or pursued. Thus, unless otherwise indicated, it should not be assumed that any of the approaches described in this section qualify as prior art merely by virtue of their description in this section. Similarly, unless otherwise indicated, it should not be assumed based on this section that a problem identified with one or more approaches has been recognized in any prior art. [Brief description of the drawings]

[0009] BRIEF DESCRIPTION OF THE DRAWINGS In the figures of the accompanying drawings, in which like references indicate like parts, certain embodiments of the present invention are illustrated, without limitation, in which:

[0010] [Figure 1] FIG. 1 illustrates an example process for a video delivery pipeline, according to one embodiment of the present invention. [Diagram 2] FIG. 2 shows an example of a "maximum" possible color volume plot for a video container format. [Figure 3A] FIG. 3A shows an example of a source content color gamut within a container color volume. [Figure 3B] FIG. 3B shows an example of a 2D slice of the container color volume and the source color volume at a particular luminance (Y) value. [Figure 3C] FIG. 3C shows an example of a 2D slice of the container color volume and the source color volume at a particular luminance (Y) value. [Figure 4] FIG. 4 illustrates an example process for extracting source color volume information from SEI messaging according to one embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Description of Example Embodiments Techniques for conveying source color volume information using SEI messaging are described herein. In the following description, for convenience, numerous details are set forth in order to provide a thorough understanding of the present invention, although it will be apparent that the present invention may be practiced without these details. In other instances, detailed details of well-known structures and devices are not set forth in order to unnecessarily clutter, obscure, or obfuscate the description of the present invention.

[0012] overview Example embodiments described herein relate to techniques for conveying source color volume information using SEI messaging. In a decoder, a processor for extracting SEI messaging detects the presence of source color volume information in an input bitstream. The processor receives a source color volume identification messaging variable identifying the presence of a color volume in the input bitstream. The processor receives a first messaging variable as part of the source color volume information. If the first messaging variable matches a first predetermined value, then for one or more primary colors, the processor generates x and y chromaticity coordinates for the one or more primary colors based on the source color volume information in the input bitstream. The processor generates a minimum luminance value, a maximum luminance value, and an average luminance value based on the source color volume information in the input bitstream. The processor receives a second messaging variable as part of the source color volume information, and if the second messaging variable matches a second predetermined value, then for one or more primary colors, the processor generates x and y chromaticity coordinates for the one or more primary colors corresponding to a minimum luminance value, a maximum luminance value, and an average luminance value based on the source color volume information.

[0013] Source Color Volume Messaging Example 1 illustrates an example process for a video delivery pipeline (100) showing various stages from video capture to display of video content. A sequence of video frames (102) are captured or generated using an image generation block (105). The video frames (102) are captured digitally (e.g., by a digital camera) or generated computer-generated (e.g., using computer animation) to provide video data (107). Alternatively, the video frames (102) may be captured on film by a film camera. The film is converted to a digital format after appropriate editing (not shown) to provide video data (107).

[0014] The video data (107) is then provided to a processor in block (110) for post-production editing. Post-production editing (110) involves adjusting or changing the color or brightness in specific areas of the image to enhance the image quality or achieve a particular look for the image according to the videographer's creative intent. This is sometimes referred to as "color timing" or "color grading." Other editing (e.g., scene selection and sequencing, image cropping, addition of computer-generated visual special effects, etc.) may be performed in block (110) to produce a final version (112) production for distribution. During post-production editing (110), the video image is viewed on a reference display (125) (also referred to as a "target display" since it is for which the studio optimizes the video).

[0015] In some embodiments, prior to video encoding (120), the video content may be analyzed and source color volume metadata (119) may be extracted, e.g., as specified in SMPTE ST 2094-1 [5] or as defined later in this specification. Such metadata may also specify characteristics of a target display (e.g., a reference display (125)) and color remapping information so that a downstream receiver can render the decoded data in the best possible way.

[0016] After post-production (110) and source color volume analysis (115), the final generated video data (117) and associated metadata (119) may be delivered in an appropriate color format (e.g., 10-bit YCbCr in 4:2:0, ICtCp, etc.) to an encoding block (120) for downstream delivery to decoding and playback devices such as television sets, set-top boxes, movie theaters, etc. In some embodiments, the encoding block (120) may include audio and video encoders (such as audio and video encoders specified by ATSC, DVB, DVD, Blu-Ray, and other distribution formats) to generate an encoded bitstream (122). The encoded bitstream (122) may be a single-layer video encoding bitstream (124). The signal (122) may be represented by a single bitstream or by a multi-layer bitstream. For example, in a multi-layer bitstream, the signal (122) may include a base layer (e.g., an SDR layer or a 10-bit HDR (HDR10) layer) and an enhancement layer, which when combined with the base layer produces an HDR bitstream (e.g., a 12-bit HDR signal) with a higher dynamic range than the base layer alone. The signal (122), which is the output bitstream from the encoder (120), may also include additional encoding-related metadata, such as the metadata (119) and prediction parameters and other data to help a decoder better reconstruct the HDR signal.

[0017] At the receiver, the encoded bitstream (122) is decoded by a decoding unit (130) to generate a decoded signal (132) and associated metadata (119). The receiver (or target) display (150) may have characteristics that are quite different from those of the reference (or target) display (125). For example, and without limitation, the reference display (125) may be a 1,000 nits display and the receiver display may be a 500 nits display. A display management module (140) may then be used to map the dynamic range of the decoded signal (132) to the characteristics of the receiver display (150) by generating a display mapping signal (142). As used herein, the term "display management" refers to the processing (e.g., tone mapping and color gamut mapping) required to map an input video signal of a first dynamic range (e.g., 1000 nits) to a display of a second dynamic range (e.g., 500 nits). The display management unit (140) may take into account the metadata (119) to improve the quality of the output video on the display (150). For example, as shown in [7], information about the luminance range of the target (or reference) display (e.g., 125) and the source data may be used at the receiver to better map the dynamic range of the video content to the receiver display (e.g., 150).

[0018] Color Volume Information FIG. 2 shows an example of a "maximum" possible color volume for a given container format (e.g., BT.2020) (also referred to as a "container color volume"). Such a volume may be constructed by two-dimensional (2D) color gamut primaries, a white point chromaticity (e.g., D65), a maximum luminance value (e.g., Lmax=4,000 nits) and a minimum luminance value (e.g., 0.005 nits). Such a plot shows the maximum possible color volume boundary for all colors in the source video content.

[0019] In practice, as shown by the darker "cloud" (305) in FIG. 3A or the darker region (305) in FIGS. 3B and 3C, the source color volume of the source content (e.g., 112) for a particular frame, or even within an entire scene, may be significantly smaller than the maximum possible color volume (310). Since the actual color volume (305) has a very irregular shape, transmitting such source color volume information for each frame or the entire scene requires a lot of information. For example, in one embodiment, color gamut information may be signaled for multiple luminance values ​​(e.g., at 0.1, 1, 10, etc.). The question then becomes, how many luminance values ​​are most important and which are they? One must also consider the overhead on the encoded bitstream that such information requires, as well as the complexity of generating such content on an encoder and / or reconstructing the color volume information on a decoder.

[0020] It is important to convey the minimum and maximum luminance values ​​in the source content, As the inventors will appreciate, conveying the average luminance (or midpoint luminance) is also useful for the receiver. Together, these three values ​​can help generate a reasonable tone curve for display mapping. In this disclosure, we propose to signal the following metadata to describe the source color volume: a) the maximum 2D gamut occupied by the source (e.g., source color volume), b) the source's maximum, minimum and average luminance, and c) optionally, the sliced ​​(2D) gamut for these three luminance values ​​(see, e.g., Figures 3B and 3C). Since the white points of the container primaries and the source content primaries are supposed to be the same, there is no reason to resend such information. This information can be updated as needed, e.g., on a frame-by-frame or scene-by-scene basis. Figures 3B and 3C show examples of 2D slices of the source color volume (305) and the container color volume (310) at specific luminance (Y) values. In Figure 3B, the 2D slice is at Y=84 nits, and in Figure 3C, the 2D slice is at Y=246 nits. The chromaticity (rgb) triangle that encloses the source color volume (305) and is within the container RGB space is given for illustration purposes only. The encoder may choose to define and transmit smaller or larger such regions to the receiver.

[0021] Table 1 shows an example of source color volume SEI messaging according to an embodiment that follows the terminology and syntax of the H.265 specification. The description of the primaries follows the CIE 1931 (x,y) chromaticity coordinates specification for the primaries specified in ISO 11664-1 (see also ISO 11664-3 and CIE 15), using red, green and blue primaries. Other types of primaries may also be used, such as 4-polygon, 5-polygon, or 6-polygon, or other polygon-based primary representations. For the maximum actual color gamut in the source content, in an embodiment, without limitation, the syntax is similar to the specification of the color_primaries parameter (or variable) specified in the H.265 specification in section E.3.1 for Table E.3. It is believed that current source content may reach the P3 color space, but will still be some time away from reaching BT.2020 / 2010 color ("DCI-P3" as defined in SMPTE EG 432-1 and SMPTE RP 431-2). Therefore, if the source gamut is less than or equal to P3 or equal to the BT.2020 / 2010 primaries, Table E.3 may be used. However, for sources whose gamut is greater than P3 and less than BT.2020 / 2010, explicit signalling of the gamut may be required. Luminance values ​​are in nits (cd / m 2 ) units. Alternatively, to save bits, the luminance values ​​may also be coded using a non-linear representation (e.g., as values ​​coded according to the inverse EOTF of SMPTE ST 2084). The color gamut information corresponding to the maximum, minimum and average (mean) luminance values ​​is kept optional, allowing applications to reduce metadata overhead as desired.

[0022] It should be noted that in a preferred embodiment, 1) the source color volume metadata should describe the color volume of the source in its original form before any luma or chroma pre-processing is performed. For example, the source color volume metadata should describe the source color volume before any chroma subsampling (e.g., from 4:4:4 to 4:2:0) or bit depth conversion (e.g., from 12b to 10b) is performed, because chroma subsampling or bit depth conversion changes the color volume information. 2) The source color gamut is typically different from the container primaries. This is shown in Appendix E (e.g., Table E.3). 3) The source color volume is typically different from the mastering display color volume (which may be indicated by the mastering display color volume SEI message).

[0023] In an example embodiment, the parameters (or variables) and encoding semantics in Table 1 may be explained as follows:

[0024] source_colour_volume_id contains an identification number that can be used to identify the purpose of the source colour volume. Values ​​for source_colour_volume_id must be between 0 and 2. 32 -2. Values ​​of source_colour_volume_id may range from 0 to 255 and 512 to 255, as determined by the application. 31 -1 may be used. 31 2 more 32 -2 and below are reserved for future use by ITU-T | ISO / IEC. Decoders should use the range 256 to 511, inclusive, or 2 31 2 more 32 All colour remapping information SEI messages containing values ​​of source_colour_volume_id in the range less than or equal to -2 shall be ignored, and the bitstream shall not contain such values.

[0025] source_colour_volume_cancel_flag, when equal to 1, indicates that the source colour volume SEI message cancels the persistence of any previous source colour volume SEI message in the output order applied to the current layer. When source_colour_volume_cancel_flag is equal to 0, it indicates that the source colour volume will continue.

[0026] source_colour_volume_persistence_flag specifies the persistence of the source colour volume SEI message for the current layer. When source_colour_volume_persistence_flag is equal to 0 it specifies that the source colour volume information applies only to the current picture.

[0027] Let picA be the current picture. source_colour_volume_persistence_flag, when equal to 1, specifies that the source colour volume is persisted in output order for the current layer until one of the following conditions is true: - A new Coded Layer Video Sequence (CLVS) for the current layer begins - The bitstream ends - Picture picB in the current layer in an access unit containing a source colour volume SEI message applicable to the current layer with the same value of source_colour_volume_id is output, where PicOrderCnt(picB) and PicOrderCnt(picA) are the PicOrderCnt values ​​of picB and picA, respectively, immediately after performing the decoding process for the picture order count on picB.

[0028] source_colour_primaries has the same semantics as specified in clause E.3.1 for the colour_primaries syntax element, except that colour_primaries in clause E.3.1 signals the container source primaries, and source_colour_primaries signals the primaries that the source content actually occupies. If the value of source_colour_primaries is equal to 2, then source_colour_primaries are explicitly specified by source_primaries_x[c] and source_primaries_y[c] in the syntax.

[0029] source_primaries_x[c] and source_primaries_y[c] are the arithmetic units defined in ISO 11664-1 (also ISO 11664-3 and CIE Specifies the normalized x and y chromaticity coordinates of the source content primary color component c, according to the CIE 1931 convention for x and y as specified in

[15] , in increments of 0.00002, respectively. In describing source content that uses red, green, and blue primaries, it is suggested that index values ​​c equal to 0 should correspond to the green primary, c equal to 1 to the blue primary, and c equal to 2 to the red primary (see also Appendix E and Table E.3). The values ​​of source_primaries_x[c] and source_primaries_y[c] are in the range 0 to 50,000, inclusive.

[0030] max_source_luminance, min_source_luminance and avg_source_luminance are 0.0001 candela / m 2Specifies the nominal maximum luminance, nominal minimum luminance, and nominal average luminance of the source in (nits), respectively. min_source_luminance is less than avg_source_luminance, and avg_source_luminance is less than max_source_luminance.

[0031] When luminance_colour_primaries_info_present_flag is equal to 1, it specifies that the syntax elements luminance_primaries_x and luminance_primaries_y are present, and when luminance_colour_primaries_info_present_flag is equal to 0, it specifies that the syntax elements luminance_primaries_x and luminance_primaries_y are not present.

[0032] luminance_primaries_x[i][c] and luminance_primaries_y[i][c] are the CIE luminance components of x and y as specified in ISO 11664-1 (see also ISO 11664-3 and CIE 15). Specifies the normalized x and y chromaticity coordinates of a source content primary color component c at some nominal luminance, in steps of 0.00002, respectively, following the 1931 specification. When describing source content luminance, index values ​​0, 1, and 2 correspond to max_source_luminance, min_source_luminance, and avg_source_luminance, respectively. When describing source content that uses red, green, and blue primaries, it is suggested that index value c equal to 0 should correspond to the green primary, c equal to 1 corresponds to the blue primary, and c equal to 2 corresponds to the red primary (also see Appendix E and Table E.3). Values ​​of source_primaries_x[c] and source_primaries_y[c] are in the range 0 to 50,000, inclusive.

[0033] Table 1 shows what is considered the minimum information for a useful representation of a source color volume. Alternative embodiments may specify further details, such as multiple primary [3] or primary color descriptions for more than three slices of luminance (Y), with each slice having an associated polygon.

[0034] Table 1: Source Color Volume SEI Messaging Syntax Examples [Table 1]

[0035] FIG. 4 shows an example process for extracting color volume information for a video source using SEI messaging, according to an embodiment. First (405), the decoder detects whether a first SEI messaging variable (e.g., source_colour_volume_id) is present indicating an identification number (ID) of the source color volume information. If such a variable is present, the decoder may then check whether its value is within an acceptable range (step 407). If not, the process ends (step 409). If so, in step (410), as shown in Table 1, the decoder may also read a further flag regarding the first variable being persisted across the bitstream (see, e.g., syntax elements for source_colour_volume_cancel_flag and source_colour_volume_persistence_flag). In step (412), via a second SEI messaging parameter (e.g., source_colour_primaries), the decoder may check whether the metadata explicitly specifies the color volume that the source data content actually occupies. If it is true (e.g., source_colour_primaries=2), then in step (420) the (x,y) chromaticity coordinates are read for each primary (e.g., red, green and blue); if not, in step (425) the decoder extracts the minimum, maximum and average luminance values. Optionally, the SEI messaging may also specify the (x,y) chromaticity coordinates corresponding to the minimum, mid and maximum luminance primaries specified above. In one embodiment, this may be indicated by a third parameter (e.g., luminance_colour_primaries_info_present_flag=1). If no such information is present (step 430), The process ends (409), and if present (step 435), the decoder extracts the (x,y) chromaticity coordinates for the primary colors for each of the minimum, midpoint and maximum luminance values.

[0036] After extracting the source color volume information, the decoder may use the source color volume data in its display management process (e.g., 140). In one example, the display management may include two steps: tone mapping and gamut mapping. The minimum luminance value, the midpoint luminance value, and the maximum luminance value may be used to generate a tone mapping curve, as described in [6-7]. The maximum RGB gamut and the sliced ​​RGB gamut may be used to perform gamut mapping.

[0037] Active Area Considerations In some embodiments, it may be advantageous to specify the active region as part of the metadata for the source color volume. For example, if the video is encoded in letterbox format, the encoder and decoder should not include the black letterbox area when calculating the luma and chroma characteristics (e.g., minimum luminance, maximum luminance and average luminance) of each video frame. Experimental results have shown that the overall output picture quality can be significantly improved by considering the "framing" or "matting" of frames in a video sequence (e.g., pillarboxing, windowboxing and letterboxing). Although letterbox detection may be implemented by the decoder, thereby reducing the notification overhead of specifying the active picture region, in one embodiment, such notification may be explicitly signaled to support low computational complexity decoders. Table 2 shows an example of source color volume SEI messaging with active region notification, according to one embodiment.

[0038] Table 2: Example of source color volume SEI message syntax with active region notification [Table 2]

[0039] Table 2 is a superset of Table 1 and allows for two different semantics for defining active regions. Semantics 1. In one embodiment, the active region is specified for the decoded picture before conformance window cropping and output. The active region parameters may then be interpreted as follows:

[0040] active_region_flag, when equal to 1, indicates that active region offset parameters follow in the source color volume information SEI message. active_region_flag, when equal to 0, indicates that no active region offset parameters are present.

[0041] active_region_left_offset, active_region_right_offset, active_region_top_offset, and active_region_bottom_offset specify the active rectangular region. If active_region_flag is equal to 0, then active_region_left_offset, active_region_right_offset, active_region_top_offset, and active_region_bottom_offset specify the active rectangular region. The values ​​of region_left_offset, active_region_right_offset, active_region_top_offset and active_region_bottom_offset are inferred to be equal to 0.

[0042] The active region is defined with horizontal picture coordinates from SubWidthC*active_region_left_offset to pic_width_in_luma_samples-SubWidthC*active_region_right_offset+1) and vertical picture coordinates from SubHeightC*active_region_top_offset to pic_height_in_luma_samples-(SubHeightC*active_region_bottom_offset+1). The value of SubWidthC*(active_region_left_offset+active_region_right_offset) is less than pic_width_in_luma_samples and the value of SubHeightC*(active_region_top_offset+active_region_bottom_offset) is less than pic_height_in_luma_samples. Semantics 2. In one embodiment, the active region offset value is specified relative to the final output picture for display. Therefore, the conformance window parameters need to be taken into account. The active region parameters can then be interpreted as follows:

[0043] active_region_flag, when equal to 1, indicates that active region offset parameters follow in the source color volume information SEI message. active_region_flag, when equal to 0, indicates that no active region offset parameters are present.

[0044] active_region_left_offset, active_region_right_offset, active_region_top_offset, and active_region_bottom_offset specify the active rectangular region. If active_region_flag is equal to 0, the values ​​of active_region_left_offset, active_region_right_offset, active_region_top_offset, and active_region_bottom_offset are inferred to be equal to 0.

[0045] The active region is defined using the horizontal picture coordinate from active_region_left_offset+SubWidthC*conf_win_left_offset to CtbSizeY*PicWidthInCtbsY-SubWidthC*conf_win_right_offset-active_region_right_offset-1 and the vertical picture coordinate from active_region_top_offset+SubHeightC*conf_win_top_offset to CtbSizeY*PicHeightInCtbsY-SubHeightC*conf_win_bottom_offset-active_region_bottom_offset-1.

[0046] The value of (active_region_left_offset+active_region_right_offset) is less than CtbSizeY*PicWidthInCtbsY-SubWidthC*(conf_win_right_offset+conf_win_left_offset) and the value of (active_region_top_offset+active_region_bottom_offset) is less than CtbSizeY*PicHeightInCtbsY-SubHeightC * Less than (conf_win_bottom_offset+conf_win_top_offset).

[0047] Each of the documents listed below is incorporated herein by reference in its entirety. References [1]Rec.ITU-T H.265, “Series H:Audiovisual and Multimedia systems,Infrastructure of audiovisual services - Coding of moving video, High efficiency video coding,”ITU,Oct.2014. [2]HM Oh et al., “Content color gamut SEI message”, JCTVC-X0040, May 2016, Geneva, CH. [3]AM Tourapis, “Improvements to the Effective Color Volume SEI”, JCTVC-X0052, May 2016, Geneva, CH. [4] AK Ramasubramonian, “Content color volume SEI message”, JCTVC-X0052, May 2016, Geneva, CH. [5]SMPTE ST 2094-1:2016:“Dynamic Metadata for Color Volume Transform - Core Components,” SMPTE, May 18, 2016. [6]SMPTE ST 2094-10:2016:“Dynamic Metadata for Color Volume Transform - Application #1,”SMPTE,May 18,2016. [7] R. Atkins et al.,USPatent Publication US2016 / 0005349,“Display management for high dynamic range video.”

[0048] Computer system implementation example The embodiments of the present invention may be implemented using computer systems, systems comprised of electronic circuits and components, integrated circuit (IC) devices such as microcontrollers, field programmable gate arrays (FPGAs) or other configurable or programmable logic devices (PLDs), discrete time or digital signal processors (DSPs), application specific ICs (ASICs), and / or apparatuses including one or more of such systems, devices, or components. The computers and / or ICs may perform, control, or execute instructions related to conveying source color volume information using SEI messaging as described herein. The computers and / or ICs may compute any of the various parameters or values ​​related to the processes described herein. Image and video embodiments may be implemented in hardware, software, firmware, and various combinations thereof.

[0049] Certain aspects of the present invention include a computer processor executing software instructions to cause the processor to perform the method of the present invention. For example, one or more processors in a display, an encoder, a set-top box, a transcoder, etc., may perform the method relating to conveying source color volume information using SEI messaging as described above by executing software instructions in a program memory accessible to the processor. The present invention may be provided in the form of a program product. The program product may include any non-transitory medium storing a set of computer-readable signals that include instructions that, when executed by a data processor, cause the data processor to perform the method of the present invention. A program product according to the present invention may take various forms. For example, the program product may include a physical medium, such as a magnetic data storage medium including a floppy disk, a hard disk drive, an optical data storage medium including a CD ROM, a DVD, an electronic data storage medium including a ROM, a flash RAM, etc. The computer-readable signals on the program product may optionally be compressed or encrypted.

[0050] When a component (e.g., a software module, processor, assembly, device, circuit, etc.) is mentioned above, the reference to that component (the “ Unless expressly stated otherwise, any reference to a "means" or "means for performing an action" in a structure (including a reference to a "means for performing an action") should be construed to include any component that performs the function (e.g., is functionally equivalent) of the component in question, as an equivalent of the component in question (including components that are not structurally equivalent to the disclosed structures that perform the function(s) appearing in the example embodiments of the invention described above).

[0051] Equivalents, Extensions, Substitutes, etc. Exemplary embodiments relating to conveying source color volume information using SEI messaging have been described above. In this specification, embodiments of the invention have been described with reference to numerous specific details that may vary from implementation to implementation. Thus, the sole and exclusive indication of what the invention is and what the applicant intends the invention to be is the set of claims issuing from this application in the specific form in which those claims arise, including any subsequent amendments. Any definitions expressly set forth in this specification for terms contained in the claims shall determine the meaning of those terms as used in the claims. Thus, any limitations, elements, properties, features, advantages or attributes not expressly recited in the claims shall not limit the scope of the claims in any way. Thus, the specification and drawings are to be regarded as illustrative, and not restrictive.

Claims

1. A computer program comprising instructions executable by one or more processors, which when executed by said processors: processing a video bitstream including one or more coded pictures and source color volume metadata; extracting information about the source color volume of the video bitstream to generate an output video signal; causing the processor to execute The metadata includes: a source color volume cancel flag, which when set to 1 indicates that the source color volume metadata cancels any persistence of previous source color volume metadata; source color x and y chromaticity coordinates for one or more primary color components, the source color x and y chromaticity coordinates defining normalized x and y chromaticity coordinates, respectively, for a primary color component c of the video bitstream; minimum, maximum and average luminance values ​​respectively specifying minimum, maximum and average luminance values ​​of pixel values ​​in the video bitstream; A computer program comprising:

2. 2. The computer program product of claim 1, wherein the x and y chromaticity coordinates are specified in increments of 0.00002 according to the CIE 1931 convention for x and y as specified in ISO 11664-1.

3. 2. The computer program of claim 1, wherein in describing a color volume using red, green and blue primaries, c=0 corresponds to the green primary, c=1 corresponds to the blue primary and c=2 corresponds to the red primary.

4. The minimum luminance value, the maximum luminance value and the average luminance value are each 0.0001 candela / m 2 2. The computer program of claim 1, specified in units of (nits).

5. 1. An apparatus for extracting source color volume information, comprising: an input and storage unit for receiving a video bitstream and an encoded bitstream including source color volume metadata; a processor for extracting the video bitstream and the source color volume metadata from the encoded bitstream, where the metadata comprises: a source color volume cancel flag, which when set to 1 indicates that the source color volume metadata cancels any persistence of previous source color volume metadata; source color x and y chromaticity coordinates for one or more primary color components, the source color x and y chromaticity coordinates defining normalized x and y chromaticity coordinates, respectively, for a primary color component c of the video bitstream; minimum, maximum and average luminance values ​​respectively specifying minimum, maximum and average luminance values ​​of pixel values ​​in the video bitstream; Including, an output for transmitting the extracted video bitstream and the extracted source color volume metadata to generate an output video signal; An apparatus comprising:

6. 6. The apparatus of claim 5, wherein the output video signal is generated based on the extracted video bitstream, the x, y chromaticity coordinates for the one or more primary color components, the minimum luminance value, the maximum luminance value, and the average luminance value.

7. 6. The apparatus of claim 5, wherein the x and y chromaticity coordinates are specified in increments of 0.00002 according to the CIE 1931 convention for x and y as specified in ISO 11664-1.

8. 6. The apparatus of claim 5, wherein in describing a color volume using red, green and blue primaries, c=0 corresponds to the green primary, c=1 corresponds to the blue primary and c=2 corresponds to the red primary.

9. 6. The apparatus of claim 5, wherein the minimum luminance value, the maximum luminance value and the average luminance value are specified in units of 0.0001 candela / m2 (nits).