Mobile Video Color Grading With LOG Curves and Adaptive LUTs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current mobile phone video processing methods fail to meet high color grading requirements, as they rely on filters that do not adequately address the need for diverse video styles and color adjustments.
Innovation Solution
A video processing method that utilizes a logarithmic curve and Look Up Tables (LUTs), specifically 2D and 3D LUTs, to process videos based on frame rate, enabling accurate color grading and style effects, including HSV and RGB color space conversions, and YUV denoising to enhance video quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If a filter principle is used for video capture in current mobile phones, then the video processing is simple and fast, but the color grading quality is insufficient and cannot meet high color grading requirements
Solution Approach 1:
The patent segments the video processing pipeline into distinct stages: LOG curve processing for tone mapping, LUT-based color space conversion, and style template application. Each stage handles a specific aspect of color grading independently, allowing high-quality processing while maintaining organizational clarity and processing efficiency
Solution Approach 2:
The patent applies preliminary action by pre-defining multiple style templates (such as cinema style, portrait style, landscape style) with their corresponding LUTs and parameters. These templates are prepared in advance and can be quickly applied during video capture without real-time complex calculations, thus achieving high color grading quality while controlling processing complexity
2Measurement precision
If 3D-LUT is used for video processing, then color grading accuracy is high, but processing time increases and frame rate performance deteriorates
Solution Approach 1:
The patent implements dynamic adaptation by automatically selecting between different processing modes based on capture frame rate. For high frame rates (≥60fps), it uses optimized 2D-LUT processing; for lower frame rates, it employs full 3D-LUT processing. This dynamic approach ensures color grading accuracy is maintained when possible, while preserving frame rate performance when needed
Solution Approach 2:
The patent changes processing parameters based on frame rate requirements. It adjusts the LUT dimensionality (2D vs 3D), color space conversion methods, and style template application parameters dynamically. This allows the system to optimize the balance between color grading accuracy and processing speed by modifying processing parameters rather than using a fixed approach
3Productivity
If 2D-LUT is used for high frame rate video processing, then processing speed is maintained, but color grading precision is reduced
Solution Approach 1:
The patent segments the color grading process into multiple passes when using 2D-LUT for high frame rates. It applies style templates in stages rather than attempting single-pass 3D-LUT processing, thereby maintaining frame rate performance while still achieving acceptable color grading quality through cumulative adjustments
4Adaptability or versatility
If multiple style templates with different LUTs are provided, then video style diversity is improved, but system complexity and processing overhead increase
Solution Approach 1:
The patent applies preliminary action by pre-configuring multiple style templates (cinema style, portrait style, landscape style, etc.) with their specific LUTs, color space conversion parameters, and processing settings. These templates are prepared in advance and stored in the system, allowing users to select from diverse video styles without requiring complex real-time generation or calculation, thus achieving style diversity while controlling system complexity
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
Embodiments of this application relate to the technical field of video shooting, and provide a video processing method and apparatus, an electronic device, and a storage medium, to enable, based on a characteristic of a LUT, a video shot through the electronic device to present a different style effect, meeting a higher color grading requirement. The video processing method includes: determining one video style template among a plurality of video style templates, where each video style template is corresponding to a LUT; obtaining a video shot through a camera lens; processing the video shot through the camera lens by using a logarithm LOG curve corresponding to a current photosensitivity ISO of the camera lens, to obtain a LOG video; and processing the LOG video based on a 2D-LUT corresponding to the determined video style template when a capture frame rate of the video shot through the camera lens is a first frame rate; or processing the LOG video based on a 3D-LUT corresponding to the determined video style template when a capture frame rate of the video shot through the camera lens is a second frame rate, where the first frame rate is greater than the second frame rate.