Data-Driven Edge-Based Image De-Blurring System

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Image blurring caused by camera movement during capture remains a significant issue in digital imaging, leading to unsatisfactory sharpness in captured images.

Innovation Solution

A data-driven edge-based image de-blurring system that iteratively generates a blur kernel and intermediate sharpened versions of images using a sharp patch library to produce a de-blurred image, leveraging edge extraction and sharp patch libraries to coerce edges into sharp, clear definitions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If traditional image de-blurring methods are used, then image sharpness can be improved, but computational complexity and processing time increase significantly

Engineering Contradiction:
Improveimage sharpnessVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent divides the image into multiple patches and processes each patch independently using a neural network. This segmentation approach reduces the computational complexity of processing the entire image at once while maintaining the ability to restore sharp edges throughout the complete image.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses a pre-trained neural network model that has learned de-blurring transformations from training data. By copying the learned patterns from the training model to process new blurred images, the system achieves effective de-blurring without requiring complex real-time computations for each new image.

Inventive Principle:
Principle #26Copying

2Manufacturing precision

If iterative de-blurring processes are applied, then image quality improves, but processing time increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent replaces traditional iterative mathematical optimization methods with a data-driven neural network approach. The neural network directly maps blurred images to sharp images in a single forward pass, eliminating the need for multiple iterative calculations while achieving comparable or superior image quality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent transforms the de-blurring process from a mathematical parameter optimization problem to a neural network parameter transformation problem. By training the network to directly output sharp images from blurred inputs, the system achieves fast single-pass processing without the time-consuming iterations required by traditional methods.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If edge-based methods are used, then sharpness of edges is improved, but noise amplification increases

Engineering Contradiction:
Improveedge sharpnessVSAvoidnoise amplification
Core Design Contradiction:
Manufacturing precisionVSObject-generated harmful factors

Solution Approach 1:

The neural network learns from training data that includes both blurred images and their corresponding sharp versions. This feedback mechanism allows the network to understand the relationship between edges and noise, enabling it to enhance edge sharpness while suppressing noise amplification through the patterns learned during training.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent changes the approach from traditional edge-based mathematical operations that amplify noise to a neural network parameter transformation. The network's learned parameters capture the statistical relationships between edges and noise in natural images, allowing it to distinguish between true edges and noise while maintaining sharpness.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS8897588B2Data-driven edge-based image de-blurring
Publication Date: 2014.11.25 ADOBE INC
  • US8897588B2 patent drawing
  • US8897588B2 patent drawing
  • US8897588B2 patent drawing

AI summary

An image de-blurring system obtains a blurred input image and generates, based on the blurred input image, a blur kernel. The blur kernel is an indication of how the image capture device was moved and/or how the subject captured in the image moved during image capture, resulting in blur. Based on the blur kernel and the blurred input image, a de-blurred image is generated. The blur kernel is generated based on sharp versions of the blurred input image predicted using a data-driven approach based on a collection of prior edges.