GAN-Based Dust and Scratch Artifact Correction in Film Digitization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional artifact correction systems are inefficient and costly for digitizing film negatives, particularly for black-and-white images, as they often degrade image quality and require significant user interaction, making them unsuitable for large datasets like video sequences.

Innovation Solution

A training system generates synthetic digital images with dust and scratch artifacts to train a generative-adversarial neural network, which can then correct these artifacts in user-provided images by reducing their visibility without degrading image quality, suitable for both black-and-white and color film negatives.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional artifact correction systems use digital spatial filters to correct dust and scratch artifacts, then artifact correction is achieved, but image quality degrades due to blurring and reduced sharpness

Engineering Contradiction:
Improveartifact correction effectivenessVSAvoidimage sharpness
Core Design Contradiction:
ReliabilityVSManufacturing precision

Solution Approach 1:

The system applies artifact correction selectively only to regions containing dust or scratch artifacts, rather than processing the entire image. The processor identifies artifact locations and applies correction algorithms locally to those specific regions, preserving the sharpness and quality of artifact-free areas while still achieving effective artifact removal where needed.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If dedicated film scanners use infrared technologies to detect artifacts, then dust and scratch detection is achieved, but the system cannot detect artifacts on black-and-white film negatives and is prohibitively expensive

Engineering Contradiction:
Improveartifact detection accuracyVSAvoidcompatibility with black-and-white film
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system uses a digital camera, a versatile device already present in most users' possession, to perform artifact detection and correction across all film types including both color and black-and-white film negatives. This universal approach eliminates the need for specialized infrared scanners while maintaining artifact detection capability across different film formats and types.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Manufacturing precision

If conventional artifact correction systems require manual identification and correction of each artifact, then precise artifact correction is achieved, but the system becomes inefficient and requires significant user interaction

Engineering Contradiction:
Improveartifact correction precisionVSAvoidprocessing efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The system automatically identifies, segments, and corrects dust and scratch artifacts without requiring manual user intervention. The processor autonomously analyzes the image to locate artifacts, determines appropriate correction parameters, and applies corrections automatically, achieving both precise artifact removal and high processing efficiency suitable for large datasets like video sequences.

Inventive Principle:
Principle #25Self-service

4Object-affected harmful factors

If users clean film negatives before digitization to minimize artifacts, then some dust removal is achieved, but cleaning introduces scratches and debris that create new artifacts

Engineering Contradiction:
Improvedust on film negativeVSAvoidscratches from cleaning
Core Design Contradiction:
Object-affected harmful factorsVSObject-generated harmful factors

Solution Approach 1:

The system performs artifact correction after digitization rather than requiring pre-digitization cleaning. By using the digital camera to capture the image and then applying computational correction algorithms, the system eliminates the need for physical cleaning that causes scratches, achieving artifact removal without introducing new damage to the film negative.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11763430B2Correcting dust and scratch artifacts in digital images
Publication Date: 2023.09.19 ADOBE INC
  • US11763430B2 patent drawing
  • US11763430B2 patent drawing
  • US11763430B2 patent drawing

AI summary

In implementations of correcting dust and scratch artifacts in digital images, an artifact correction system receives a digital image that depicts a scene and includes a dust or scratch artifact. The artifact correction system generates, with a generator of a generative adversarial neural network (GAN), a feature map from the digital image that represents features of the dust or scratch artifact and features of the scene. A training system can train the generator adversarially to reduce visibility of dust and scratch artifacts in digital images against a discriminator, and train the discriminator to distinguish between reconstructed digital images generated by the generator and real-world digital images. The artifact correction system generates, from the feature map and with the generator, a reconstructed digital image that depicts the scene of the digital image and reduces visibility of the dust or scratch artifact of the digital image.