Image Deconvolution Using PSF Interpolation for Under-Display Blur

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Images captured by electronic devices with under-display cameras are often blurred due to interference from display structures, leading to degradation represented by varying point-spread functions (PSFs) that require costly and time-consuming empirical calibration.

Innovation Solution

A method for deblurring images using PSF interpolation, involving preprocessing, deconvolution, and cropping, combined with a simulation approach to generate PSFs without empirical measurements, utilizing wave optics simulation and spatial transformations to determine PSFs accurately.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If empirical calibration methods are used to obtain PSFs, then measurement precision is improved, but loss of time and manufacturing cost increase significantly

Engineering Contradiction:

ImprovePSF measurement accuracyVSAvoidcalibration time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The patent pre-calculates PSFs using wave optics simulation for multiple possible object positions before actual imaging occurs. This preliminary computation allows the system to have PSFs ready for interpolation during real-time operation, eliminating the need for time-consuming empirical calibration while maintaining measurement precision.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent replaces the physical empirical calibration process with a computational wave optics simulation approach. Instead of physically measuring PSFs using test charts and cameras, the system uses numerical simulations based on wave optics equations to generate accurate PSFs, thereby eliminating the time and cost associated with physical calibration procedures.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If empirical calibration methods are used to obtain PSFs, then measurement precision is improved, but manufacturing cost increases

Engineering Contradiction:

ImprovePSF measurement accuracyVSAvoidcalibration cost

Core Design Contradiction:

Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent replaces expensive physical calibration equipment and procedures with computational wave optics simulation. This substitution eliminates the need for specialized test charts, calibration cameras, and manual measurement processes, thereby reducing manufacturing costs while maintaining or improving PSF measurement accuracy.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates computational models (copies) of the optical system's PSFs through wave optics simulation. These simulated PSFs serve as accurate representations of the physical system's behavior without requiring physical measurement, thereby eliminating the need for expensive calibration hardware and procedures.

Inventive Principle:

Principle #26Copying

3Measurement precision

If PSFs are determined for each object position, then measurement precision is improved, but device complexity increases

Engineering Contradiction:

ImprovePSF accuracy at specific positionsVSAvoidPSF management complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple PSFs corresponding to different object positions into a single continuous PSF model through interpolation. This merging approach allows the system to handle variable object positions uniformly using a single mathematical framework, thereby reducing the complexity of managing discrete PSFs for each possible position while maintaining high measurement precision.

Inventive Principle:

Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Effectively restores clear images by interpolating PSFs, reducing the need for costly empirical calibration and improving image quality without the limitations of empirical methods.

Implementation Method 1

utilizing wave optics simulation and spatial transformations to determine PSFs accurately

Methodology Applied

Scientific EffectWave optics:

Implementation Method 2

describe the response of the camera's imaging system to various point sources

Methodology Applied

Scientific EffectLight propagation: Light

Implementation Method 3

A method for deblurring images using PSF interpolation, involving preprocessing, deconvolution, and cropping

Methodology Applied

Scientific EffectDeconvolution:

Data Source

PatentUS12482075B2Restoring images using deconvolution

Publication Date: 2025.11.25 SAMSUNG INFORMATION SYSTEMS AMERICA INC

AI summary

In one embodiment, a method includes generating, from an accessed image, one or more image patches, and for each image patch: (1) accessing a set of point-spread functions (PSFs), wherein each PSF in the set of PSFs corresponds to one of a plurality of points in the image patch; (2) generating a set of deconvolved image patches by deconvolving the image patch with each PSF from the set of PSFs for that patch; (3) determining, for each of one or more portions of the image patch, a set of weights, wherein each weight in the set of weights is associated with one of the deconvolved image patches; and (4) generating a restored image patch by interpolating the set of deconvolved image patches based on the set of weights.