High dynamic range metadata validity detection method and apparatus, storage medium, and electronic device

Abstract

The application provides a high dynamic range metadata validity detection method and device, a storage medium and an electronic device, and relates to the field of videos. The electronic device can obtain reference display effects and actual display effects of the same high dynamic range video before and after metadata takes effect, wherein the reference display effects reflect inherent wide color gamut and high dynamic effects of the original video, and the actual display effects reflect real output capabilities after the metadata participates in rendering; the two are directly compared, so as to determine whether the metadata actually changes the display effects. In this way, individual differences of artificial evaluation are avoided, and the metadata validity can be objectively repeatedly verified.

Description

Technical Field

[0001] This application relates to the field of video, and more specifically, to a method, apparatus, storage medium, and electronic device for detecting the validity of high dynamic range metadata. Background Technology

[0002] High Dynamic Range (HDR) video technology solves the problem that traditional standard dynamic range videos struggle to realistically reproduce the tonal gradations and color richness perceived by the human eye. Compared to regular video, HDR video with embedded metadata requires not only the original image data but also accompanying HDR metadata describing how to accurately reproduce the image on different devices.

[0003] Because the image quality of HDR videos highly depends on the synergy between metadata and the original image, after HDR videos with metadata are produced, it is necessary to verify whether the accompanying metadata can function properly and outperform the native HDR image quality. Currently, mainstream HDR effect evaluation methods still rely on subjective assessments of the rendered video image, and no technical path has yet been proposed for objectively verifying the effectiveness of the HDR metadata itself. Summary of the Invention

[0004] To overcome at least one deficiency in the prior art, this application provides a method, apparatus, storage medium, and electronic device for detecting the validity of high dynamic range metadata, which can avoid individual differences in human evaluation and enable objective and repeated verification of metadata validity.

[0005] Firstly, this application provides a method for detecting the validity of high dynamic range metadata, the method comprising: Obtain the high dynamic range video to be tested, wherein the high dynamic range video is a video carrying high dynamic range metadata; Obtain the baseline display effect of the high dynamic range video before the high dynamic range metadata takes effect, and the actual display effect after the high dynamic range metadata takes effect; The benchmark display effect is compared with the actual display effect to obtain the validity detection result of the high dynamic range metadata.

[0006] Secondly, this application provides a high dynamic range metadata validity detection device, the device comprising: The video acquisition module is used to acquire the high dynamic range video to be tested, wherein the high dynamic range video is a video carrying high dynamic range metadata; The effect evaluation module is used to obtain the baseline display effect of the high dynamic range video before the high dynamic range metadata takes effect, and the actual display effect after the high dynamic range metadata takes effect; The validity determination module is used to compare the benchmark display effect with the actual display effect to obtain the validity detection result of the high dynamic range metadata.

[0007] Thirdly, this application provides a storage medium storing a computer program that, when executed by a processor, implements the high dynamic range metadata validity detection method.

[0008] Fourthly, this application provides an electronic device, which includes a processor and a memory, wherein the memory stores a computer program, and the computer program, when executed by the processor, implements the high dynamic range metadata validity detection method.

[0009] Compared with the prior art, this application has the following beneficial effects: The high dynamic range (HDR) metadata validity detection method, apparatus, storage medium, and electronic device provided in this application allow the electronic device to acquire the baseline display effect and the actual display effect of the same HDR video before and after the metadata takes effect. The baseline display effect reflects the inherent wide color gamut and high dynamic range of the original video, while the actual display effect reflects the true output capability after the metadata participates in rendering. By directly comparing the two, it can be determined whether the metadata has actually changed the display effect. This avoids individual differences in human evaluation and allows the validity of the metadata to be objectively and repeatedly verified. Attached Figure Description

[0010] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0011] Figure 1 A flowchart illustrating the high dynamic range metadata validity detection method provided in this application embodiment; Figure 2 A detailed schematic diagram of step S2 provided in the embodiments of this application; Figure 3 This is a schematic diagram of the high dynamic range metadata validity detection device provided in the embodiments of this application; Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0012] To make the objectives, technical solutions, and advantages of the embodiments of this application (hereinafter referred to as "the embodiments") clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. The components of the embodiments of this application described and shown in the accompanying drawings can generally be arranged and designed in various different configurations.

[0013] Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely to illustrate selected embodiments of the application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.

[0014] It should be noted that similar labels and letters in the following figures indicate similar items. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures.

[0015] In the description of this application, it should be noted that the terms "first," "second," "third," etc., are used only for distinguishing descriptions and should not be construed as indicating or implying relative importance. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0016] To make the following description of this embodiment easier to understand, the relevant technical data that may affect the subsequent understanding will be explained first: High Dynamic Range (HDR) is a video rendering technology that breaks through the brightness and color gamut limitations of traditional Standard Dynamic Range (SDR). By expanding the range of brightness and color gamut that an image can display, it makes bright details more transparent, dark details richer, and colors more saturated and realistic. For HDR videos with metadata, this metadata is used to guide the video playback device to accurately map the coded domain signals to the physical display capabilities.

[0017] HDR metadata refers to a set of structured parameters embedded in the HDR video stream that describes how the video content is correctly decoded, tone-mapped, and displayed on the terminal device. Its core function is to bridge the HDR signal at the creation end with the physical display capability at the playback end, ensuring that the wide color gamut and high dynamic range characteristics are faithfully reproduced.

[0018] Hybrid Log-Gamma (HLG) is a photoelectric conversion function compatible with both SDR and HDR. Its core feature is that it uses a gamma curve in low-brightness areas to ensure that SDR devices can display it directly, and uses a logarithmic curve in high-brightness areas to expand the dynamic range, thereby adapting to broadcast television links and real-time production scenarios.

[0019] The Perceptual Quantizer (PQ) is an HDR photoelectric conversion function designed based on the human visual perception model. It can map the brightness range of 0–10000 nits to 10-bit or 12-bit integer quantization code values. Moreover, the PQ curve has extremely strong non-linearity, which can efficiently allocate code value resources to the sensitive areas of the human eye.

[0020] The BT.2020 color gamut refers to the color gamut of the ultra-high-definition video standard defined by the International Telecommunication Union (ITU). Its coverage not only exceeds the corresponding area of ​​the CIE 1931 color gamut diagram but is also significantly larger than the color gamut of the traditional high-definition standard BT.709. This embodiment uses whether the pixel chromaticity coordinates exceed the BT.709 color gamut boundary as the basis for determining wide color gamut pixels.

[0021] The CIE 1931 chromaticity coordinates, a standard colorimetric model established by the International Commission on Illumination, map colors perceptible to the human eye to two-dimensional plane coordinates (x, y), and are a fundamental tool for quantifying the color position of pixels.

[0022] Terminal screen brightness refers to the maximum peak brightness of the target playback device (unit: cd / m²). The corresponding brightness threshold is the effective HDR brightness lower limit set according to industry consensus, representing the initial brightness level at which the human eye can clearly perceive high brightness characteristics. In this embodiment, the proportion of pixels with a brightness ≥203 cd / m² in a single frame is used as one of the indicators for determining effective HDR frames.

[0023] Based on the above professional data, as introduced in the background technology, the current mainstream HDR effect evaluation method still relies on subjective evaluation of the rendered video image, and has not yet proposed a technical path to objectively verify the validity of HDR metadata itself.

[0024] For example, in related technologies, evaluators usually only look at the output screen after the metadata has been applied and rely on experience to judge whether there are obvious image quality defects. They lack the ability to trace whether the metadata actually participates in the rendering process and cannot distinguish whether the image quality problem is caused by insufficient upper limit of the original material or by incorrect metadata configuration.

[0025] It should be noted that the defects in the solutions in the prior art are the result of practice and careful research. Therefore, the discovery process of the above problems and the solutions proposed by the embodiments of this application in the following text should be regarded as contributions to this application in the process of invention and creation, and should not be understood as technical content known to those skilled in the art.

[0026] Based on the discovery of the above-mentioned technical problems, this embodiment provides a method for detecting the validity of high dynamic range metadata. For example... Figure 1 The method includes: S1, acquire the high dynamic range video to be tested.

[0027] High dynamic range video refers to video that carries high dynamic range metadata.

[0028] S2, obtain the baseline display effect of the high dynamic range video before the high dynamic range metadata takes effect, and the actual display effect after the high dynamic range metadata takes effect.

[0029] S3 compares the baseline display effect with the actual display effect to obtain the validity test results of the high dynamic range metadata.

[0030] In this implementation, the electronic device can acquire the baseline and actual display effects of the same high dynamic range video before and after the metadata takes effect. The baseline display effect reflects the inherent wide color gamut and high dynamic range of the original video, while the actual display effect reflects the true output capability after the metadata participates in rendering. By directly comparing the two, it can be determined whether the metadata has actually changed the display effect. This avoids individual differences in human evaluation and allows the validity of the metadata to be objectively and repeatedly verified.

[0031] It should be noted that, for the high dynamic range metadata validity detection method provided in this embodiment, the electronic device implementing the method can be a server. In this case, the software implementing the method can be deployed on the server, receiving high dynamic range videos uploaded by users through terminals, and performing corresponding display adaptation operations on the high dynamic range videos to obtain two display effect indicators before and after the metadata takes effect, and comparing them to determine whether the metadata in the high dynamic range video is valid.

[0032] Furthermore, as an optional implementation, the electronic device can also be various video playback devices with HDR decoding and tone mapping capabilities, such as smart TVs supporting HDR10, professional color grading monitors, streaming set-top boxes, and mobile terminals or PC platforms equipped with HDR rendering engines. These devices can all parse the HDR metadata embedded in the video stream and perform corresponding display adaptation calculations to obtain two display effect indicators before and after the metadata takes effect, thereby determining whether the metadata in the high dynamic range video is valid.

[0033] To make the solution provided in this embodiment clearer, a server is used as an example below, and in conjunction with... Figure 1 Each step of the method is described in detail. However, it should be understood that the operations in the flowchart may not be implemented in sequence, and steps without logical contextual relationships may be reversed in order or implemented simultaneously. Furthermore, those skilled in the art, guided by the content of this application, may add one or more other operations to the flowchart, or remove one or more operations from the flowchart.

[0034] See also Figure 1 The following is a detailed explanation of step S1 in the diagram: S1, acquire the high dynamic range video to be tested.

[0035] High dynamic range video refers to video that carries high dynamic range metadata.

[0036] In practical applications, the high dynamic range videos to be tested can include mainstream formats such as HDR10, Dolby Vision, and HDRVivid, covering master files for film and television post-production, materials uploaded to short video platforms, broadcast signals from ultra-high-definition channels of broadcasting, and video sources distributed by streaming media platforms.

[0037] Based on the above description of the high dynamic range video to be tested, we will continue with the following... Figure 1 Step S2 will be explained in detail: S2, obtain the baseline display effect of the high dynamic range video before the high dynamic range metadata takes effect, and the actual display effect after the high dynamic range metadata takes effect.

[0038] Optionally, the benchmark display effect includes a wide color gamut benchmark frame set and the proportion of wide color gamut benchmark frames in the wide color gamut benchmark frame set, such as... Figure 2 As shown, this embodiment also provides the following optional implementation methods for step S2: S2-1, Parse the original image frame sequence from the high dynamic range video before the high dynamic range metadata takes effect.

[0039] In practical applications, servers can decode video files carrying high dynamic range metadata, separating the original image frame sequence that has not yet undergone metadata tone mapping intervention. This can be understood as the server not performing any luminance or chrominance conversion at this stage, but only reading the raw bitstream data aligned with the image frame timestamps within the encapsulation.

[0040] Based on the above embodiments regarding the original image frame sequence, step S2 further includes: S2-2, Identify wide color gamut frames from the original image frame sequence to form a wide color gamut reference frame set.

[0041] Among them, the proportion of wide color gamut pixels in the wide color gamut frame is greater than the first quantity threshold. Wide color gamut pixels are pixels whose chromaticity coordinates exceed the reference color gamut.

[0042] In practical applications, the server can perform pixel-level chromaticity analysis on each frame in the original image frame sequence to identify wide color gamut frames and construct a wide color gamut reference frame set. As an optional implementation of step S2-2, the server can, for each original image frame in the original image frame sequence, calculate the proportion of wide color gamut pixels in the original image frame based on the chromaticity coordinates of each pixel in the original image frame; if the proportion of wide color gamut pixels is greater than a first quantity threshold, then the original image frame is added to the wide color gamut reference frame set as a wide color gamut frame.

[0043] Specifically, for each frame, the pixel sample value is converted into a display light signal according to the corresponding national standard based on its HDR type. If it is a PQ type video, the electro-optical conversion function specified in Table 4 of GB / T 41808—2022 standard is used; this conversion outputs the CIE 1931 chromaticity coordinates corresponding to each pixel. Here, wide color gamut pixels refer to pixels whose chromaticity coordinates in the CIE 1931 chromaticity diagram fall within the BT.2020 color gamut triangle but exceed the boundary of the BT.709 color gamut triangle.

[0044] For example, in an HDR10 landscape video, if a pixel, after conversion, has xy coordinates outside BT.709 but within BT.2020, it belongs to the wide color gamut pixel category. When the number of such pixels in a frame reaches or exceeds a first threshold of 1% of the total number of pixels in the frame, the frame is marked as a wide color gamut frame, and its frame number is stored in the wide color gamut reference frame set, denoted as . .

[0045] Based on the above embodiments' description of wide color gamut frames and wide color gamut reference frame sets, please refer to... Figure 2 Step S2 also includes: S2-3, the ratio of the number of frames in the wide color gamut reference frame set to the total number of frames in the original image frame sequence is used as the proportion of wide color gamut reference frames.

[0046] In this embodiment, after processing all frames according to steps S2-3, the server will... The ratio of the number of frames contained within the frame to the total number of frames in the original image frame sequence is the percentage of the wide color gamut reference frame, denoted as . .

[0047] For example, assuming a 30-second HDR video with a frame rate of 25fps, the original image frame sequence contains 750 frames; if 62 of these frames are identified as wide color gamut frames, then the proportion of wide color gamut reference frames is approximately 62 / 750 ≈ 8.3%. This ratio reflects the proportion of the video that has BT.2020 level wide color gamut performance without metadata intervention.

[0048] Optionally, the benchmark display effect also includes a high dynamic range benchmark frame set and the proportion of high dynamic range benchmark frames in the high dynamic range benchmark frame set. This embodiment also provides the following optional implementation methods for step S2: S2-4 identifies high dynamic range frames from the original image frame sequence to form a high dynamic range reference frame set.

[0049] Among them, the proportion of high-brightness pixels in high dynamic range frames is greater than the second quantity threshold, and the maximum brightness contrast of high dynamic range frames is greater than the contrast threshold. High-brightness pixels are pixels whose brightness is greater than the brightness threshold.

[0050] In practical applications, the server first converts the pixel sample values ​​of each frame into display light signals according to national standards, and outputs the physical brightness value corresponding to each pixel, in units of (cd / m²); then calculates the ratio of the maximum display brightness to the minimum display brightness of all pixels in the frame, i.e., the single-frame contrast ratio; and then counts the proportion of high-brightness pixels with a brightness greater than 203cd / m².

[0051] If a frame simultaneously meets the second quantity threshold of high-brightness pixel ratio being no less than 1% and single-frame contrast ratio being no less than 10000:1, it is marked as a high dynamic range frame, and its frame number is stored in the high dynamic range reference frame set, denoted as . .

[0052] For example, in a night scene video in HDR Vivid format, if the proportion of high-brightness pixels with a brightness exceeding 203 cd / m² in the frame reaches 1.5%, and the measured contrast ratio between the brightest and darkest areas is 12000:1, then it is included in the high dynamic range reference frame set.

[0053] Based on the above embodiments regarding the high dynamic range frame and the high dynamic range reference frame set, step S2 further includes; S2-5, the ratio of the number of frames in the high dynamic range reference frame set to the total number of frames in the original image frame sequence is used as the proportion of high dynamic range reference frames.

[0054] This can be understood as the server comparing the number of frames in the high dynamic range reference frame set with the total number of frames in the original image frame sequence to obtain the proportion of high dynamic range reference frames. .

[0055] For example, in a 60-second HDR video with a frame rate of 30fps, the original image frame sequence consists of 1800 frames; if 108 of these frames are confirmed as high dynamic range reference frames based on both brightness and contrast criteria, then That is, 108 / 1800 = 6%. This reflects that the video itself has a high brightness pixel density and high contrast characteristics even without metadata enabled.

[0056] Optionally, the actual display effect includes the wide color gamut measured frame set and the proportion of wide color gamut measured frames in the wide color gamut measured frame set, see further. Figure 2 This embodiment also provides the following optional implementation methods for step S2; S2-6, parses the rendered image frame sequence after the high dynamic range metadata takes effect from the high dynamic range video.

[0057] In this embodiment, the server can perform image rendering on high dynamic range video after the metadata has taken effect, thereby obtaining a sequence of rendered image frames. For example, the metadata of an HDR video includes parameters such as maximum average frame brightness and maximum content brightness; based on these parameters and combined with the preset or user-specified peak screen brightness, the server performs pixel-by-pixel brightness remapping on each original image frame, and outputs rendered image frames adapted to the capabilities of the terminal.

[0058] Based on the above embodiments regarding the rendering of image frame sequences, step S2 further includes: S2-7: Identify wide color gamut frames from the rendered image frame sequence to form a wide color gamut measured frame set.

[0059] Among them, the proportion of wide color gamut pixels in the wide color gamut frame is greater than the first quantity threshold. Wide color gamut pixels are pixels whose chromaticity coordinates exceed the reference color gamut.

[0060] This can be understood as the server performing a wide color gamut recognition process on the rendered image frame sequence after the metadata takes effect, which is completely consistent with the original frame sequence, thereby forming a wide color gamut measured frame set. In this process, the server first converts the pixel sample values ​​of each rendered image frame into display light signals according to its HDR type. For example, PQ type video still follows the electro-optical conversion rules in Table 4 of GB / T 41808—2022.

[0061] Based on this, the server calculates the CIE 1931 chromaticity coordinates pixel by pixel and counts the percentage of pixels whose chromaticity coordinates exceed the BT.709 color gamut boundary but fall within the BT.2020 color gamut. When this percentage reaches or exceeds 1% in a frame, it is determined to be a wide color gamut frame, and its frame number is stored in the wide color gamut measured frame set, denoted as . .

[0062] For example, in a night scene video, if the light areas retain sufficient saturation and color shift after rendering, keeping the corresponding pixel chromaticity coordinates outside of BT.709, then it meets the condition of being a wide color gamut pixel. Conversely, if the metadata excessively compresses the color gamut, causing all pixels to fall back into BT.709, then it does not meet the condition of being a wide color gamut pixel. Finally, the proportion of wide color gamut pixels is counted, and frames with a proportion greater than 1% are identified as wide color gamut frames.

[0063] Based on the above description of wide color gamut frames and wide color gamut measured frame sets, step S2 also includes: S2-8: The ratio of the number of frames in the wide color gamut measured frame set to the total number of frames in the rendered image frame sequence is taken as the proportion of wide color gamut measured frames.

[0064] In this embodiment, the server can compare the number of frames in the wide color gamut measured frame set with the total number of frames in the rendered image frame sequence to obtain the proportion of wide color gamut measured frames, denoted as P2020.

[0065] For example, in an HDR video with a total of 1500 frames in its rendered image frame sequence, if 132 of these frames are identified as wide color gamut frames, then P2020 is 132 / 1500 = 8.8%. This truly reflects the proportion of frames in the video that can still maintain BT.2020 level wide color gamut performance after the metadata participates in tone mapping.

[0066] Optionally, the actual display effect also includes the high dynamic range measured frame set and the proportion of high dynamic range measured frames in the high dynamic range measured frame set, see further. Figure 2 This embodiment also provides the following optional implementation methods for step S2: S2-9: Identify high dynamic range frames from the rendered image frame sequence to form a high dynamic range test frame set.

[0067] Among them, the proportion of high-brightness pixels in high dynamic range frames is greater than the second quantity threshold, and the maximum brightness contrast of high dynamic range frames is greater than the contrast threshold. High-brightness pixels are pixels whose brightness is greater than the brightness threshold.

[0068] S2-10, the ratio of the number of frames in the high dynamic range measured frame set to the total number of frames in the rendered image frame sequence is taken as the proportion of high dynamic range measured frames.

[0069] This can be understood as the server being able to perform a high-dynamic frame recognition process on the rendered image frame sequence after the metadata takes effect, which is completely consistent with the original frame sequence, thereby forming a high-dynamic measured frame set and obtaining its proportion.

[0070] Specifically, the server can convert the pixel sample values ​​of each frame of rendered image into display light signals according to national standards. For example, PQ type video still uses the electro-optical conversion function specified in Table 4 of GB / T 41808—2022. It then calculates the brightness value pixel by pixel and obtains the ratio of the maximum to the minimum display brightness of a single frame, i.e., the maximum brightness contrast ratio. Next, it calculates the proportion of high-brightness pixels with a brightness greater than 203 cd / m². When a frame simultaneously meets two conditions—that is, the proportion is not less than 1% and the contrast ratio is not less than 10000:1—it is determined to be a high dynamic range frame, and its frame number is stored in the high dynamic range measured frame set, denoted as... Based on this, the server uses The ratio of the number of frames contained in the high dynamic range to the total number of frames in the rendered image frame sequence yields the measured frame percentage for high dynamic range. .

[0071] For example, assuming an HDR video, if after rendering there are still a large number of areas that maintain a brightness exceeding 203 cd / m², and the brightness range of the entire frame is large enough, then the corresponding video frame will be included. Conversely, if the metadata is over-compressed, resulting in a decrease in peak brightness or a reduction in contrast, the relevant frame will not meet the conditions for being a high dynamic range frame.

[0072] In the above embodiment, the reference display effect and the actual display effect are described in detail below, namely, the reference display effect includes the wide color gamut reference frame set, the proportion of wide color gamut reference frames in the wide color gamut reference frame set, the high dynamic range reference frame set, and the proportion of high dynamic range reference frames in the high dynamic range reference frame set. The actual display effect includes the wide color gamut measured frame set, the proportion of wide color gamut measured frames in the wide color gamut measured frame set, the high dynamic range measured frame set, and the proportion of high dynamic range measured frames in the high dynamic range measured frame set.

[0073] Next, we will continue with... Figure 1 Step S3 will be explained in detail: S3 compares the baseline display effect with the actual display effect to obtain the validity test results of the high dynamic range metadata.

[0074] As an optional implementation, if at least one of the following conditions is met: the proportion of wide color gamut measured frames is greater than the proportion of wide color gamut reference frames, the number of frames in the wide color gamut measured frame set is greater than the number of frames in the wide color gamut reference frame set, and the proportion of the intersection between the wide color gamut measured frame set and the wide color gamut reference frame set is greater than the first proportion threshold; Furthermore, if at least one of the following conditions is met, the high dynamic range metadata is determined to be valid: the proportion of high dynamic measured frames is greater than the proportion of high dynamic reference frames, the number of frames in the high dynamic measured frame set is greater than the number of frames in the high dynamic reference frame set, and the proportion of the intersection between the high dynamic measured frame set and the high dynamic reference frame set is greater than the second proportion threshold.

[0075] This embodiment can be understood as comparing the image quality before and after HDR metadata takes effect in both the wide color gamut and high dynamic range dimensions to determine whether the HDR metadata is effective. As an optional implementation, each of the three conditions must be met in both the wide color gamut and high dynamic range dimensions for the HDR metadata to be considered effective.

[0076] For example, for the wide color gamut dimension, it is necessary to simultaneously satisfy that the measured frame percentage of the wide color gamut P2020 is not lower than the reference frame percentage of the wide color gamut. Wide color gamut measured frame set The number of frames contained is no less than that of the wide color gamut reference frame set. The number of frames; and The sequence number of each frame can be found in Find the corresponding keyframe, or allow only a very small number of keyframes (e.g., below a preset percentage) to be missing.

[0077] Similarly, for the high dynamic range dimension, it is necessary to simultaneously satisfy the requirement of a high dynamic range measured frame ratio. No less than the proportion of high dynamic range reference frames High dynamic range measured frame set The total number of frames is no less than the high dynamic range reference frame set. ;and All frame numbers in the middle are The number of overwritten or missing frames is kept within acceptable limits.

[0078] The server only confirms the validity of the metadata if both dimensions meet all three conditions, meaning it did not cause any degradation of the native wide color gamut and high dynamic range characteristics during tone mapping. If any constraint in either dimension is not met—for example, if the percentage of wide color gamut measured frames in an HDR10 video drops from the baseline of 9.2% to 7.5% after rendering, or if the high dynamic range measured frame set is missing frames 142 and 897 from the high dynamic range baseline frame set—then the metadata is considered invalid.

[0079] Based on the same inventive concept as the high dynamic range metadata validity detection method provided in this embodiment, this embodiment also provides a high dynamic range metadata validity detection device. This device includes at least one software functional module that can be stored in memory or embedded in the operating system (OS) of an electronic device. The processor in the electronic device executes the executable module stored in memory. For example, the software functional module and computer program included in this device. Please refer to... Figure 3 Functionally, the device may include: Video acquisition module 11 is used to acquire the high dynamic range video to be tested, wherein the high dynamic range video is a video carrying high dynamic range metadata; The effect evaluation module 12 is used to obtain the baseline display effect of the high dynamic range video before the high dynamic range metadata takes effect, and the actual display effect after the high dynamic range metadata takes effect. The validity determination module 13 is used to compare the baseline display effect with the actual display effect to obtain the validity detection result of the high dynamic range metadata.

[0080] Optionally, the benchmark display effect includes a wide color gamut benchmark frame set and the proportion of wide color gamut benchmark frames in the wide color gamut benchmark frame set; The effect evaluation module 12 obtains the baseline display effect of the high dynamic range video before the high dynamic range metadata takes effect, including: Extract the original image frame sequence before the high dynamic range metadata takes effect from the high dynamic range video; Wide color gamut frames are identified from the original image frame sequence to form a wide color gamut reference frame set. The proportion of wide color gamut pixels in the wide color gamut frames is greater than the first quantity threshold. Wide color gamut pixels are pixels whose chromaticity coordinates exceed the reference color gamut. The ratio of the number of frames in the wide color gamut reference frame set to the total number of frames in the original image frame sequence is used as the proportion of wide color gamut reference frames.

[0081] Optionally, the effect evaluation module 12 identifies wide color gamut frames from the original image frame sequence to form a wide color gamut reference frame set, including: For each original image frame in the original image frame sequence, the proportion of wide color gamut pixels in the original image frame is calculated based on the chromaticity coordinates of each pixel in the original image frame. If the proportion of wide color gamut pixels is greater than the first quantity threshold, the original image frame is added as a wide color gamut frame to the wide color gamut reference frame set.

[0082] Optionally, the benchmark display effect also includes a high dynamic range benchmark frame set and the proportion of high dynamic range benchmark frames in the high dynamic range benchmark frame set; The effect evaluation module 12 also includes methods for obtaining the baseline display effect of high dynamic range video before the high dynamic range metadata takes effect, such as: High dynamic range frames are identified from the original image frame sequence to form a high dynamic range reference frame set. Among them, the proportion of high brightness pixels in the high dynamic range frame is greater than the second quantity threshold and the maximum brightness contrast of the high dynamic range frame is greater than the contrast threshold. High brightness pixels are pixels with brightness greater than the brightness threshold. The ratio of the number of frames in the high dynamic range reference frame set to the total number of frames in the original image frame sequence is used as the high dynamic range reference frame percentage.

[0083] Optionally, the actual display effect includes the wide color gamut measured frame set and the proportion of wide color gamut measured frames in the wide color gamut measured frame set; The effect evaluation module 12 obtains the actual display effect after the high dynamic range metadata takes effect, including: Extract the rendered image frame sequence after the high dynamic range metadata takes effect from the high dynamic range video; Wide color gamut frames are identified from the rendered image frame sequence to form a wide color gamut measured frame set. The proportion of wide color gamut pixels in the wide color gamut frames is greater than the first quantity threshold. Wide color gamut pixels are pixels whose chromaticity coordinates exceed the reference color gamut. The ratio of the number of frames in the wide color gamut measured frame set to the total number of frames in the rendered image frame sequence is taken as the proportion of wide color gamut measured frames.

[0084] Optionally, the actual display effect also includes the high dynamic range measured frame set and the proportion of high dynamic range measured frames in the high dynamic range measured frame set; The effect evaluation module 12 also includes methods for obtaining the actual display effect after the high dynamic range metadata takes effect, such as: High dynamic range frames are identified from the rendered image frame sequence to form a high dynamic range measured frame set. Among them, the proportion of high-brightness pixels in the high dynamic range frame is greater than the second quantity threshold and the maximum brightness contrast of the high dynamic range frame is greater than the contrast threshold. High-brightness pixels are pixels with brightness greater than the brightness threshold. The ratio of the number of frames in the high dynamic range measured frame set to the total number of frames in the rendered image frame sequence is taken as the proportion of high dynamic range measured frames.

[0085] Optionally, the benchmark display effect includes a wide color gamut benchmark frame set, the proportion of wide color gamut benchmark frames in the wide color gamut benchmark frame set, a high dynamic range benchmark frame set, and the proportion of high dynamic range benchmark frames in the high dynamic range benchmark frame set. The actual display effect includes the wide color gamut measured frame set, the proportion of wide color gamut measured frames in the wide color gamut measured frame set, the high dynamic range measured frame set, and the proportion of high dynamic range measured frames in the high dynamic range measured frame set; The validity determination module 13 compares the baseline display effect with the actual display effect to obtain the validity detection result of the high dynamic range metadata, including: If at least one of the following conditions is met: the proportion of wide color gamut measured frames is greater than the proportion of wide color gamut reference frames, the number of frames in the wide color gamut measured frame set is greater than the number of frames in the wide color gamut reference frame set, and the proportion of the intersection between the wide color gamut measured frame set and the wide color gamut reference frame set is greater than the first proportion threshold; Furthermore, if at least one of the following conditions is met, the high dynamic range metadata is determined to be valid: the proportion of high dynamic measured frames is greater than the proportion of high dynamic reference frames, the number of frames in the high dynamic measured frame set is greater than the number of frames in the high dynamic reference frame set, and the proportion of the intersection between the high dynamic measured frame set and the high dynamic reference frame set is greater than the second proportion threshold.

[0086] In addition, the functional modules in the various embodiments of this application can be integrated together to form an independent part, or each module can exist independently, or two or more modules can be integrated to form an independent part.

[0087] It should also be understood that if the above embodiments are implemented as software functional modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application.

[0088] Therefore, this embodiment also provides a storage medium, which is a computer-readable storage medium. This storage medium stores a computer program, which, when executed by a processor, implements the high dynamic range metadata validity detection method provided in this embodiment. The storage medium can be any medium capable of storing program code, such as a USB flash drive, external hard drive, read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0089] Please refer to Figure 4 The electronic device provided in this embodiment may include a processor 22 and a memory 21. The memory 21 stores a computer program, and the processor implements the high dynamic range metadata validity detection method provided in this embodiment by reading and executing the computer program in the memory 21 corresponding to the above embodiments.

[0090] See also Figure 4 The electronic device also includes a communication unit 23. The memory 21, processor 22 and communication unit 23 are electrically connected to each other directly or indirectly through system bus 24 to realize data transmission or interaction.

[0091] The memory 21 can be an information recording device based on any electronic, magnetic, optical, or other physical principles, used to record execution instructions, data, etc. In some embodiments, the memory 21 can be, but is not limited to, volatile memory, non-volatile memory, memory drive, etc.

[0092] In some embodiments, the volatile memory may be random access memory (RAM); in some embodiments, the non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, etc.; in some embodiments, the storage drive may be a disk drive, solid-state drive, any type of storage disk (such as optical disc, DVD, etc.), or similar storage media, or a combination thereof.

[0093] The communication unit 23 is used to send and receive data over a network. In some embodiments, the network may include a wired network, a wireless network, a fiber optic network, a telecommunications network, an intranet, the Internet, a local area network (LAN), a wide area network (WAN), a wireless local area network (WLAN), a metropolitan area network (MAN), a public switched telephone network (PSTN), a Bluetooth network, a ZigBee network, or a near field communication (NFC) network, or any combination thereof. In some embodiments, the network may include one or more network access points. For example, the network may include wired or wireless network access points, such as base stations and / or network switching nodes, through which one or more components of the service request processing system can connect to the network to exchange data and / or information.

[0094] The processor 22 may be an integrated circuit chip with signal processing capabilities, and may include one or more processing cores (e.g., a single-core processor or a multi-core processor). By way of example only, the processor described above may include a Central Processing Unit (CPU), an Application Specific Integrated Circuit (ASIC), an Application Specific Instruction-set Processor (ASIP), a Graphics Processing Unit (GPU), a Physics Processing Unit (PPU), a Digital Signal Processor (DSP), a Field Programmable Gate Array (FPGA), a Programmable Logic Device (PLD), a controller, a microcontroller unit, a Reduced Instruction Set Computing (RISC) computer, or a microprocessor, or any combination thereof.

[0095] Understandable. Figure 4 The structure shown is for illustrative purposes only. Electronic devices may also have more advanced features. Figure 4 Showing more or fewer components, or having with Figure 4 The different configurations shown. Figure 4 The components shown can be implemented using hardware, software, or a combination thereof.

[0096] It should be understood that the apparatus and methods disclosed in the above embodiments can also be implemented in other ways. The apparatus embodiments described above are merely illustrative. For example, the flowcharts and block diagrams in the accompanying drawings show the architecture, functionality, and operation of possible implementations of apparatus, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram and / or flowchart, and combinations of blocks in block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0097] The above descriptions are merely various embodiments of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for detecting the validity of high dynamic range metadata, characterized in that, The method includes: Obtain the high dynamic range video to be tested, wherein the high dynamic range video is a video carrying high dynamic range metadata; Obtain the baseline display effect of the high dynamic range video before the high dynamic range metadata takes effect, and the actual display effect after the high dynamic range metadata takes effect; The benchmark display effect is compared with the actual display effect to obtain the validity detection result of the high dynamic range metadata.

2. The method for detecting the validity of high dynamic range metadata according to claim 1, characterized in that, The benchmark display effect includes a wide color gamut benchmark frame set and the percentage of wide color gamut benchmark frames in the wide color gamut benchmark frame set; Obtaining the baseline display effect of the high dynamic range video before the high dynamic range metadata takes effect includes: Parse the original image frame sequence before the high dynamic range metadata takes effect from the high dynamic range video; Wide color gamut frames are identified from the original image frame sequence to form the wide color gamut reference frame set, wherein the proportion of wide color gamut pixels in the wide color gamut frames is greater than a first quantity threshold, and the wide color gamut pixels are pixels whose chromaticity coordinates exceed the reference color gamut. The ratio of the number of frames in the wide color gamut reference frame set to the total number of frames in the original image frame sequence is used as the proportion of the wide color gamut reference frames.

3. The high dynamic range metadata validity detection method according to claim 2, characterized in that, Wide color gamut frames are identified from the original image frame sequence to form the wide color gamut reference frame set, including: For each original image frame in the original image frame sequence, the proportion of wide color gamut pixels in the original image frame is calculated based on the chromaticity coordinates of each pixel in the original image frame. If the proportion of wide color gamut pixels is greater than the first quantity threshold, then the original image frame is added as the wide color gamut frame to the wide color gamut reference frame set.

4. The method for detecting the validity of high dynamic range metadata according to claim 2, characterized in that, The benchmark display effect also includes a high dynamic range benchmark frame set and the proportion of high dynamic range benchmark frames in the high dynamic range benchmark frame set; Obtaining the baseline display effect of the high dynamic range video before the high dynamic range metadata takes effect also includes: High dynamic range frames are identified from the original image frame sequence to form the high dynamic range reference frame set, wherein the proportion of high-brightness pixels in the high dynamic range frames is greater than a second quantity threshold and the maximum brightness contrast of the high dynamic range frames is greater than a contrast threshold, and the high-brightness pixels are pixels with brightness greater than a brightness threshold. The ratio of the number of frames in the high dynamic range reference frame set to the total number of frames in the original image frame sequence is taken as the proportion of the high dynamic range reference frames.

5. The method for detecting the validity of high dynamic range metadata according to claim 1, characterized in that, The actual display effect includes the wide color gamut measured frame set and the proportion of wide color gamut measured frames in the wide color gamut measured frame set; Obtaining the actual display effect after the high dynamic range metadata takes effect includes: Parse the rendered image frame sequence after the high dynamic range metadata takes effect from the high dynamic range video; Wide color gamut frames are identified from the rendered image frame sequence to form the wide color gamut measured frame set, wherein the proportion of wide color gamut pixels in the wide color gamut frames is greater than a first quantity threshold, and the wide color gamut pixels are pixels whose chromaticity coordinates exceed the reference color gamut. The ratio of the number of frames in the wide color gamut measured frame set to the total number of frames in the rendered image frame sequence is taken as the proportion of the wide color gamut measured frames.

6. The method for detecting the validity of high dynamic range metadata according to claim 5, characterized in that, The actual display effect also includes the high dynamic range measured frame set and the proportion of high dynamic range measured frames in the high dynamic range measured frame set; Obtaining the actual display effect after the high dynamic range metadata takes effect also includes: High dynamic range frames are identified from the rendered image frame sequence to form the high dynamic range measured frame set, wherein the proportion of high-brightness pixels in the high dynamic range frames is greater than a second quantity threshold and the maximum brightness contrast of the high dynamic range frames is greater than a contrast threshold, and the high-brightness pixels are pixels with brightness greater than a brightness threshold. The ratio of the number of frames in the high dynamic range measured frame set to the total number of frames in the rendered image frame sequence is taken as the proportion of the high dynamic range measured frames.

7. The method for detecting the validity of high dynamic range metadata according to claim 1, characterized in that, The benchmark display effect includes a wide color gamut benchmark frame set, the proportion of wide color gamut benchmark frames in the wide color gamut benchmark frame set, a high dynamic range benchmark frame set, and the proportion of high dynamic range benchmark frames in the high dynamic range benchmark frame set. The actual display effect includes a wide color gamut measured frame set, the proportion of wide color gamut measured frames in the wide color gamut measured frame set, a high dynamic range measured frame set, and the proportion of high dynamic range measured frames in the high dynamic range measured frame set. The benchmark display effect is compared with the actual display effect to obtain the validity detection result of the high dynamic range metadata, including: If at least one of the following conditions is met: the proportion of wide color gamut measured frames is greater than the proportion of wide color gamut reference frames, the number of frames in the wide color gamut measured frame set is greater than the number of frames in the wide color gamut reference frame set, and the proportion of the intersection between the wide color gamut measured frame set and the wide color gamut reference frame set is greater than a first proportion threshold; Furthermore, if at least one of the following conditions is met: the proportion of high dynamic range measured frames is greater than the proportion of high dynamic range reference frames, the number of frames in the high dynamic range measured frame set is greater than the number of frames in the high dynamic range reference frame set, and the proportion of the intersection between the high dynamic range measured frame set and the high dynamic range reference frame set is greater than the second proportion threshold, then the high dynamic range metadata is determined to be valid.

8. A high dynamic range metadata validity detection device, characterized in that, The device includes: The video acquisition module is used to acquire the high dynamic range video to be tested, wherein the high dynamic range video is a video carrying high dynamic range metadata; The effect evaluation module is used to obtain the baseline display effect of the high dynamic range video before the high dynamic range metadata takes effect, and the actual display effect after the high dynamic range metadata takes effect; The validity determination module is used to compare the benchmark display effect with the actual display effect to obtain the validity detection result of the high dynamic range metadata.

9. A storage medium, characterized in that, The storage medium stores a computer program, which, when executed by a processor, implements the high dynamic range metadata validity detection method according to any one of claims 1-7.

10. An electronic device, characterized in that, The electronic device includes a processor and a memory, the memory storing a computer program that, when executed by the processor, implements the high dynamic range metadata validity detection method according to any one of claims 1-7.

Images