Image Restoration Control Using Reference Frame PSF for Moving Image Continuity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing techniques for moving images with rapid changes in photographing environments suffer from discontinuity in restoration processes between frames, leading to deteriorated image quality.
Innovation Solution
An image processing device and method that employs a restoration control processing unit to perform a restoration process on moving images based on a point spread function, using imaging information from a reference frame, including frames before and after the target frame, to maintain continuity and adjust the restoration process accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a restoration process is performed for each frame independently based on its own photographing conditions, then the restoration process can be optimized for each specific frame, but the content of the restoration process changes rapidly between frames causing discontinuity and image quality deterioration in moving images
Solution Approach 1:
The patent determines the photographing conditions of a reference frame in advance (before processing the target frame) and uses these predetermined conditions to perform the restoration process on the target frame. This preliminary determination of reference frame conditions stabilizes the restoration process content across frames while still adapting to environmental changes, resolving the contradiction between restoration precision and process continuity.
2Adaptability or versatility
If the restoration process content is changed according to the photographing environment of each frame, then the restoration can adapt to rapid changes in photographing conditions, but a great difference occurs in the content of the restoration process between frames leading to discontinuity
Solution Approach 1:
The patent introduces a reference frame as an intermediary between the target frame and the restoration process. Instead of directly using the target frame's photographing conditions, the system uses the reference frame's conditions (which are temporally adjacent) as a mediator to control the restoration process. This intermediary approach allows adaptation to environmental changes while maintaining continuity, as the reference frame acts as a buffer that smooths out rapid transitions.
3Measurement precision
If a restoration process is performed for a saturated pixel or a defocus region, then image quality can be recovered in those specific regions, but image quality may be deteriorated due to noise or artifacts from the restoration process
Solution Approach 1:
The patent applies the restoration process selectively to specific regions (saturated pixels or defocus regions) rather than uniformly to the entire image. By identifying and targeting only the regions that require restoration, the system recovers image quality in those specific areas while avoiding the application of restoration filters to already-good regions, thereby minimizing the generation of noise and artifacts.
Data Source
AI summary
Disclosed are an image processing device, an imaging device, an image processing method, and a program capable of acquiring a moving image with excellent image quality while maintaining continuity of a restoration process between frames even if there is a rapid change of a photographing environment in a moving image. An image processing device includes a restoration control processing unit 36 which subjects a moving image including a plurality of frames acquired by photographing using an optical system to a restoration process based on a point spread function of the optical system to acquire recovered image data. The restoration control processing unit 36 controls the restoration process for a frame to be processed among a plurality of frames based on imaging information of a reference frame including a frame after the frame to be processed in a time series.