RAW Image Processing Service Camera-Specific Tone Curves

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current digital image processing systems face challenges in preserving spatial quality and color representation of RAW images, particularly in transforming them into absolute color spaces like sRGB or Adobe RGB, due to limitations in demosaicing and tone reproduction curve derivation, which affect image detail and color accuracy.

Innovation Solution

A system and method for processing RAW images that includes a software stack with a RAW image processing service leveraging CPU and GPU capabilities, performing demosaicing, black subtraction, highlight recovery, noise reduction, and tone reproduction curve derivation to convert RAW images into absolute color spaces, utilizing metadata for camera-specific processing and automatic adjustments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If demosaicing and tone reproduction curve derivation are performed using standard processing methods, then the processing speed and simplicity are maintained, but the spatial quality and color accuracy of the RAW images deteriorate

Engineering Contradiction:
Improvecolor accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent derives tone reproduction curves specific to each camera model in advance, before actual image processing occurs. These pre-derived curves are stored and automatically applied when processing RAW images from that camera model, eliminating the need to perform complex derivations during real-time processing while maintaining high color accuracy

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent changes the processing parameters by using camera-specific tone reproduction curves instead of generic curves. By identifying the camera model and selecting the corresponding pre-derived curve, the system achieves high color accuracy without the computational complexity of deriving curves during processing

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If camera-specific pre-processing is performed to preserve spatial quality and color accuracy, then the image quality is improved, but the processing time and computational resources increase

Engineering Contradiction:
Improvespatial qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs computationally intensive operations (demosaicing parameter optimization, tone reproduction curve derivation) in advance during system initialization or camera characterization phases. These pre-computed parameters are stored and quickly applied during actual image processing, significantly reducing real-time processing time while maintaining high spatial quality

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The processing is segmented into two phases: an offline preparation phase where camera-specific parameters are derived and stored, and an online processing phase where these parameters are applied. This segmentation moves heavy computational burden away from real-time processing, reducing processing time for actual images

Inventive Principle:
Principle #1Segmentation

3Quantity of substance

If standard JPEG compression is applied directly to RAW images, then the file size is reduced and processing is simplified, but the color representation and image detail are lost

Engineering Contradiction:
Improvefile sizeVSAvoidcolor information
Core Design Contradiction:
Quantity of substanceVSLoss of information

Solution Approach 1:

The patent applies camera-specific tone reproduction curves and demosaicing parameters before compression to preserve color information. By performing this color-correct preprocessing step in advance with the right parameters, the subsequent JPEG compression retains more accurate color representation compared to standard processing

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP2448242B1System and method for raw image processing
Publication Date: 2018.06.20 APPLE INC
  • EP2448242B1 patent drawingFigure 1~2
  • EP2448242B1 patent drawingFigure 3
  • EP2448242B1 patent drawingFigure 4

AI summary

An automated RAW image processing method implementable by a processing device, the method comprising: receiving a representation of a target RAW image and metadata, the target RAW image having photo-site pixels each indicative of a single color value, the metadata indicative of an imaging device or a capture condition associated with the target RAW image; obtaining, based on the metadata, predetermined information for RAW image processing, the predetermined information being derived from processing at least one subject RAW image obtained with the imaging device or the capture condition; demosaicing the target RAW image to produce a resulting image defined in a color space, wherein the demosaicing comprises automatically pre-processing the target RAW image based on the predetermined information using an operating system service of the processing device; and making the resulting image available to an application program executable on the processing device.