Dynamic Tone Metadata Generation for Edited Video Frames
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Electronic devices struggle to accurately represent dynamic range and tone of video content due to the absence of dynamic tone metadata for new frames generated during editing techniques like frame rate conversion, leading to deteriorated image quality and heterogeneity in reproduction.
Innovation Solution
An electronic device is equipped with a method to generate dynamic tone metadata for new frames by utilizing existing metadata from reference images, applying weights based on time intervals and reference ratios, and updating metadata for edited frames to maintain consistent tone representation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If frame rate conversion editing is applied to video content, then the frame rate is increased to match target requirements, but dynamic tone metadata cannot be generated for new frames leading to deteriorated image quality
Solution Approach 1:
The system performs preliminary actions by generating dynamic tone metadata for reference frames before frame rate conversion. These pre-generated metadata serve as templates that are then reused or interpolated for newly generated frames during FRC, ensuring tone consistency without requiring complex real-time processing for each new frame.
Solution Approach 2:
The system copies and reuses dynamic tone metadata from reference frames to newly generated frames during frame rate conversion. By copying the tone mapping characteristics from known good frames, the system maintains image quality while achieving the desired frame rate increase, avoiding the need to recalculate tone metadata for every new frame.
2Measurement precision
If dynamic tone mapping is applied to represent HDR content on displays with different brightness, then the tone representation accuracy is improved, but the complexity of processing increases
Solution Approach 1:
The system performs tone mapping operations in advance during video encoding, pre-calculating the dynamic tone metadata for each frame. This preliminary processing shifts the computational burden from runtime playback to encoding time, reducing the complexity burden during actual video reproduction on different displays.
Solution Approach 2:
The system introduces dynamic tone metadata as an intermediary data structure that carries tone mapping information between the HDR master display and various lower brightness displays. This intermediary format enables accurate tone representation without requiring complex real-time tone mapping calculations during playback, as the metadata provides pre-computed guidance.
3Measurement precision
If scene change detection is performed by comparing pixel values between frames, then scene changes are detected accurately, but the processing time increases
Solution Approach 1:
The system performs scene change detection and generates dynamic tone metadata for reference frames in advance. By preparing this information beforehand, the system reduces the processing time required during actual playback, as the metadata can be directly retrieved and applied to new frames without re-evaluating scene changes in real-time.
Data Source
Figure 1
Figure 2
Figure 3~4
AI summary
An apparatus and method for editing an image including dynamic tone metadata in an electronic device are provided. The electronic device includes a display, and at least one processor operatively connected to the display, wherein the at least one processor may be configured to generate a third image to be inserted between a first image and a second image continuous with the first image among a plurality of images belonging to video content, generate dynamic tone metadata of the third image based on dynamic tone metadata of the first image and the second image, and update the video content by adding the third image and the dynamic tone metadata of the third image.