3D Geometry-Based Color Correction for Composite Lighting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current color correction processes in film post-production are limited to two-dimensional techniques, failing to account for three-dimensional geometry and light source conditions, leading to incompatible lighting environments in composite images.

Innovation Solution

A method and system for color correction using three-dimensional geometrical information, including light properties, surface reflectance, and scene geometry, to modify the appearance of images by altering these properties based on image formation theory.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional two-dimensional color correction techniques are used, then the color correction process is simple and familiar, but the lighting environment compatibility in composite images is poor

Engineering Contradiction:
Improvelighting environment compatibilityVSAvoidcolor correction system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent transitions from traditional two-dimensional color correction to three-dimensional color correction by incorporating depth information and spatial relationships. This dimensional expansion allows the system to account for lighting conditions, surface normals, and geometric properties in 3D space, thereby improving lighting environment compatibility in composite images while managing the increased complexity through structured computational approaches.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If three-dimensional geometrical information is incorporated into color correction, then lighting environment compatibility improves, but the complexity of the color correction process increases

Engineering Contradiction:
Improvelighting environment compatibilityVSAvoidcolor correction process complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the color correction process into distinct functional modules: geometry determination module, lighting condition analysis module, and color correction application module. This segmentation allows the complex three-dimensional color correction process to be broken down into manageable components, each handling specific aspects of the computation, thereby reducing overall process complexity while maintaining lighting environment compatibility.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces intermediate computational structures such as depth maps, normal maps, and lighting condition representations that mediate between the raw three-dimensional image data and the final color correction application. These intermediaries organize and structure the complex three-dimensional information, making it more manageable and enabling systematic color correction while preserving lighting environment compatibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If three-dimensional information is used in compositing, then the visual quality of composite images improves, but additional color correction processing is required

Engineering Contradiction:
Improvevisual quality of composite imagesVSAvoidpost-processing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent performs lighting condition analysis and geometric property determination during the compositing process itself, rather than as a separate post-processing step. By integrating the three-dimensional color correction calculations into the compositing workflow, the system achieves high visual quality composite images without requiring additional time-consuming post-processing operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent merges the color correction functionality with the compositing process by implementing a unified computational framework that simultaneously handles image blending, lighting analysis, and color adjustment. This integration eliminates the need for separate color correction processing steps, thereby maintaining high visual quality while reducing overall post-processing time.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS9508190B2Method and system for color correction using three-dimensional information
Publication Date: 2016.11.29 INTERDIGITAL MADISON PATENT HLDG
  • US9508190B2 patent drawing
  • US9508190B2 patent drawing
  • US9508190B2 patent drawing

AI summary

A system and method for the color correction of an image using three-dimensional, geometrical information of the capture environment of the image includes determining geometrical properties of at least a portion of the image and modifying a look of at least the portion of the image by altering a value of at least one of the determined geometrical properties and using image formation theory. In one embodiment of the present invention, the geometrical properties of the image include at least one of light properties, surface color, reflectance properties, and scene geometry of the at least one portion of the image. In accordance with the present invention, the geometrical properties of the image are alternatively determined by using sensing devices, by inferring the geometrical properties from the image itself, or by user input.