3D Color Mapping and Tone Tuning in Image Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional color and tone mapping methods in digital cameras often result in undesirable artifacts and suboptimal image quality, particularly when capturing scenes with both bright and dark features due to limited bit depth and inadequate dynamic range.

Innovation Solution

A camera system with a color and tone mapping engine that generates optimized 3D look-up tables (LUTs) and dynamic global tone mapping, converting RAW image data into a target color space with improved chroma and hue adjustments, and applying tone maps that adapt to the image content for enhanced dynamic range representation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If conventional 3D LUT color mapping is used to adjust chroma and hue, then color reproduction is achieved, but undesirable artifacts and suboptimal image quality result due to limited bit depth

Engineering Contradiction:
Improvecolor reproduction accuracyVSAvoidundesirable artifacts
Core Design Contradiction:
Manufacturing precisionVSObject-affected harmful factors

Solution Approach 1:

The patent transitions from conventional 3D LUT color mapping to a perceptually uniform color space (such as CIELAB or CIELUV) where color adjustments occur in dimensions of lightness, chroma, and hue that align with human perception. This dimensional transformation allows for smoother color transitions and reduced artifacts by operating in a color space that reflects actual perceptual relationships rather than device-dependent RGB values.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The invention changes the parameters used for color mapping from standard RGB-based chroma and hue to perceptually uniform parameters (lightness L*, chroma C*, and hue h° in CIELAB, or lightness L, chroma C, and hue h in CIELUV). This parameter transformation enables more accurate control of color attributes and produces smoother gradients that minimize banding and other artifacts caused by limited bit depth.

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If a single tone map is applied to images with both shadowed and bright features, then processing simplicity is maintained, but features on either edge of the luminance spectrum are compressed due to limited bit depth

Engineering Contradiction:
Improvetone mapping process complexityVSAvoidluminance dynamic range representation
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent divides the luminance spectrum into multiple segments or regions (such as shadow, midtone, and highlight regions) and applies different tone mapping strategies to each segment. This segmentation allows optimal bit allocation for each luminance range, preserving detail in both dark and bright areas while maintaining manageable processing complexity through localized adjustments.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The invention implements local tone mapping where different tone curves or mapping functions are applied to different regions of the image based on their luminance characteristics. Shadow regions receive one type of mapping optimized for preserving dark detail, while highlight regions receive another mapping optimized for preserving bright detail, with midtones receiving appropriate intermediate treatment. This local quality approach ensures each region is processed with the most appropriate parameters for its specific luminance level.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9961236B23D color mapping and tuning in an image processing pipeline
Publication Date: 2018.05.01 GOPRO INC
  • US9961236B2 patent drawing
  • US9961236B2 patent drawing
  • US9961236B2 patent drawing

AI summary

The processing of RGB image data can be optimized by performing optimization operations on the image data when it is converted into the YCbCr color space. First, a raw RGB color space is converted into a YCbCr color space, and raw RGB image data is converted into YCbCr image data using the YCbCr color space. For each Y-layer of the YCbCr image data, a 2D LUT is generated. The YCbCr image data is converted into optimized CbCr image data using the 2D LUTs, and optimized YCbCr image data is generated by blending CbCr image data corresponding to multiple Y-layers. The optimized YCbCr image data is converted into sRGB image data, and a tone curve is applied to the sRGB image data to produce optimized sRGB image data.