GPU Fragment Program Color Matching for Multi-Display Compositing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current color management systems fail to efficiently match colors across disparate devices and displays, especially when images overlap multiple displays with different color profiles, leading to inconsistent color representation and increased processing load on the CPU.

Innovation Solution

A method and apparatus for color matching during compositing, where un-color matched pixels are processed by a graphical processing unit using fragment programs generated based on source and destination color profiles, allowing dynamic color correction of pixels based on their location across multiple displays, reducing CPU load and improving color consistency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If color matching is performed pre-processing the entire image on the CPU, then color consistency across displays is improved, but processing time and CPU load increase

Engineering Contradiction:
Improvecolor consistencyVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the color matching process by applying it only to visible pixels during the compositing stage rather than pre-processing the entire image. This is achieved by dividing the image into visible and invisible regions and selectively applying color transformation only where needed, thereby reducing processing time while maintaining color consistency for displayed content.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs color matching actions in advance during the compositing stage before the final display output. By preparing color transformations ahead of time and applying them during compositing rather than during rendering, the system achieves efficient color consistency without significant processing delays.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If color matching is performed on the entire image, then color representation accuracy is improved, but system resources are consumed inefficiently

Engineering Contradiction:
Improvecolor representation accuracyVSAvoidsystem resources
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent extracts and applies color matching only to the subset of pixels that will be displayed, removing the unnecessary processing of invisible pixels. This extraction approach maintains color representation accuracy for visible content while significantly reducing system resource consumption by avoiding redundant calculations on non-displayed regions.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies different processing quality to different regions of the image. High-quality color matching is applied locally to visible pixels that need accurate color representation, while minimal or no processing is applied to invisible pixels. This local quality approach optimizes the balance between color accuracy and resource utilization.

Inventive Principle:
Principle #3Local quality

3Productivity

If color matching is performed during compositing on visible pixels only, then processing efficiency is improved, but color consistency across multiple displays may be compromised

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidcolor consistency
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent implements feedback mechanisms during the compositing process to ensure color consistency across multiple displays. By continuously monitoring and adjusting color transformations based on display characteristics and pixel visibility status, the system maintains reliable color consistency while achieving high processing efficiency through selective pixel processing.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS8749574B2Method and apparatus for improved color management
Publication Date: 2014.06.10 APPLE INC
  • US8749574B2 patent drawing
  • US8749574B2 patent drawing
  • US8749574B2 patent drawing

AI summary

A method and apparatus for color matching during compositing. In one embodiment of the invention, a set of one or more un-color matched pixels are stored and associated with a first color profile. A fragment program is generated based on the first color profile and a second color profile associated with a display. During compositing of the set of un-color matched pixels, the fragment program is applied to the set of un-color matched pixels to match colors of those pixels with the display. The color matched pixels are written to the display. Other methods and apparatuses are also described.