ML Dynamic Composer for SDR to HDR Conversion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current techniques for composing video content fail to effectively support a wide variety of display devices, particularly in transitioning Standard Dynamic Range (SDR) content to High Dynamic Range (HDR) without manual color grading, leading to suboptimal brightness and color palette reproduction.
Innovation Solution
Machine learning-based dynamic composer metadata is generated to predict operational parameter values for backward reshaping SDR images into HDR, using training image pairs and feature vectors to train models that map SDR to HDR, enabling automatic conversion and style transfer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If manual color grading is used to transition SDR content to HDR, then brightness and color palette reproduction quality is improved, but production cost and time consumption increase
Solution Approach 1:
The patent replaces manual color grading (mechanical human operation) with machine learning-based automatic composition algorithms. The system uses trained ML models to predict operational parameter values for backward reshaping mappings, automatically converting SDR content to HDR while preserving artistic intent and visual qualities without requiring manual intervention.
Solution Approach 2:
The system enables self-service by allowing the ML-based composition algorithm to automatically perform the color grading task that would otherwise require manual expert intervention. The trained models independently analyze SDR content and generate appropriate HDR transformations based on learned patterns from training image pairs, making the process autonomous and efficient.
2Manufacturing precision
If manual color grading is used for SDR to HDR transition, then artistic intent and visual qualities are preserved, but production cost increases
Solution Approach 1:
The patent substitutes expensive manual color grading processes with automated machine learning algorithms. The ML models are trained on diverse image pairs to learn how to preserve artistic intent and visual qualities during SDR to HDR transitions, eliminating the need for costly manual expert intervention while maintaining high quality results.
Solution Approach 2:
The system performs preliminary action by pre-training machine learning models on extensive datasets of image pairs before deployment. This offline training phase captures artistic intent and visual quality patterns, enabling the models to automatically preserve these qualities during actual SDR to HDR conversions without requiring expensive manual review and adjustment for each content piece.
3Adaptability or versatility
If current composition techniques are used, then compatibility with existing SDR displays is maintained, but support for diverse HDR display devices is insufficient
Solution Approach 1:
The patent implements dynamic composition by generating content-specific operational parameter values through machine learning models rather than using static, one-size-fits-all composition parameters. The system adapts the backward reshaping mappings based on the specific characteristics of each SDR input and target HDR display capabilities, enabling reliable brightness and color reproduction across diverse HDR display devices while maintaining SDR compatibility.
Data Source
AI summary
Training image pairs comprising training SDR image and corresponding training HDR images are received. Each training image pair in the training image pairs comprises a training SDR image and a corresponding training HDR image. The training SDR image and the corresponding training HDR image in the training image pair depict same visual content but with different luminance dynamic ranges. Training image feature vectors are extracted from training SDR images in the training image pairs. The training image feature vectors are used to train backward reshaping metadata prediction models for predicting operational parameter values of backward reshaping mappings used to backward reshape SDR images into mapped HDR images.


