Film Grain Characterization via Parametric Encoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for simulating film grain in motion pictures, such as Cineon and Grain Surgery, fail to accurately represent high-speed film grain and are computationally complex, and struggle with preserving grain texture during video compression, particularly with MPEG-2 and ITU-T/ISO H.264 techniques.

Innovation Solution

A technique that characterizes film grain in video streams using parameters like spatial, aspect, and temporal correlations, intensity, and color correlations, and encodes this information for transmission, allowing for accurate simulation and restoration of film grain even in compressed video formats.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional spatial and temporal compression methods are used on film-originated images, then compression efficiency is improved, but the grain texture is completely lost

Engineering Contradiction:
Improvecompression efficiencyVSAvoidgrain texture
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent segments the grain representation into multiple independent parameters (spatial correlation, aspect ratio, temporal correlation, intensity, color correlation) that can be separately encoded and transmitted. This segmentation allows the grain characteristics to be preserved through compression while maintaining the ability to reconstruct realistic grain patterns.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms the grain representation from raw pixel data into a set of statistical parameters that describe grain characteristics. By changing the representation parameters from spatial domain to parameter domain, the grain information becomes more compression-resistant while maintaining fidelity.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If Cineon application is used to simulate film grain, then realistic grain appearance is achieved for many grain types, but diagonal stripes appear for high grain size settings

Engineering Contradiction:
Improvegrain simulation fidelityVSAvoiddiagonal stripes
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent applies different correlation parameters locally to different regions and scales of grain patterns. By adjusting spatial and temporal correlation parameters independently, the method achieves realistic grain appearance at various grain sizes without producing artificial diagonal stripe patterns.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If Grain Surgery product is used to generate synthetic grain, then grain simulation is achieved, but computational complexity becomes high

Engineering Contradiction:
Improvegrain simulation capabilityVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent creates a simplified parametric model that copies the essential statistical characteristics of film grain without requiring complex computational processes. The grain can be generated by applying the encoded parameters to standard algorithms, dramatically reducing computational complexity while maintaining visual fidelity.

Inventive Principle:
Principle #26Copying

4Measurement precision

If image resolution becomes larger, then image quality is improved, but the perception of film grain becomes higher

Engineering Contradiction:
Improveimage resolutionVSAvoidgrain visibility
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent uses dynamic temporal correlation parameters that adapt the grain characteristics based on the image resolution and display conditions. This allows the grain appearance to be controlled and optimized for different resolution levels, preventing excessive grain visibility in high-resolution images while maintaining the authentic film look.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS8150206B2Method and apparatus for representing image granularity by one or more parameters
Publication Date: 2012.04.03 DOLBY LABORATORIES LICENSING CORP
  • US8150206B2 patent drawing
  • US8150206B2 patent drawing
  • US8150206B2 patent drawing

AI summary

To characterize film grain, a Film Grain Characterizer (23) receives an incoming information stream (12) and a filtered information stream (24) from which the film grain has been removed. From these streams, the Film Grain Characterizer (23) outputs a message that contains an identity of a model for simulating grain, as well at least one of a set of several parameters, including correlation parameters, intensity-independent parameters and intensity-dependent parameters used by the identified model. An encoder (26, 13) encodes the film grain information for subsequent transmission.