Image Denoising Model Training Using Photographic Sensitivity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mobile terminals suffer from image detail loss and excessive noise due to insufficient sampling rates and noise from various aspects of image acquisition, transmission, and low light conditions, particularly in smartphones with small aperture cameras, necessitating improved image resolution and noise reduction.
Innovation Solution
A training method for an image denoising model that utilizes photographic sensitivity information as input to learn noise dimensions, incorporating real noise data and multi-frame fusion techniques to enhance denoising capability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple sample images with different photographic sensitivities are used for training, then the denoising model learns more comprehensive noise information, but the training data processing complexity increases
Solution Approach 1:
The training data is segmented into multiple sample image groups, where each group contains sample images with the same photographic sensitivity. This segmentation allows the model to systematically learn noise characteristics across different sensitivity levels while organizing the complex training data into manageable, structured units.
Solution Approach 2:
Photographic sensitivity information is added as an additional dimension to the training data, transforming single-image training into multi-dimensional training. This enables the model to learn noise patterns across different sensitivity dimensions, improving noise characterization without requiring complex preprocessing of unstructured data.
2Reliability
If photographic sensitivity information is incorporated as training input, then the denoising capability is enhanced, but the input data structure becomes more complex
Solution Approach 1:
The photographic sensitivity information serves multiple functions: it characterizes noise levels, guides denoising strength, and organizes training data grouping. This multi-functionality allows a single data element to enhance denoising capability while avoiding the need for separate complex structures for each function.
Solution Approach 2:
Photographic sensitivity acts as an intermediary parameter that bridges the relationship between input images and noise characteristics. Instead of directly analyzing complex noise patterns, the model uses sensitivity as a mediator to infer noise levels, simplifying the input data structure while maintaining denoising effectiveness.
3Stability of the object's composition
If sample images with the same photographic sensitivity are grouped together, then the noise characteristics are more consistent, but the data organization complexity increases
Solution Approach 1:
The training dataset is segmented into distinct groups based on photographic sensitivity values. Each group contains only images with identical sensitivity, ensuring noise characteristic consistency within groups. This segmentation strategy organizes data systematically without requiring complex hierarchical structures.
Solution Approach 2:
Data organization is based on changes in the photographic sensitivity parameter. By grouping images according to discrete sensitivity values, the system achieves consistent noise characteristics within groups while using a simple parameter-based organization method rather than complex multi-criteria classification.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A training method for an image denoising model includes: collecting multiple sample image groups through a shooting device, each sample image group including multiple frames of sample images with a same photographic sensitivity and sample images in different sample image groups having different photographic sensitivities; acquiring a photographic sensitivity of each sample image group; determining a noise characterization image corresponding to each sample image group based on the photographic sensitivity; determining a training input image group and a target image associated with each sample image group, each training input image group including all or part of sample images in a corresponding sample image group and a corresponding noise characterization image; constructing multiple training pairs each including a training input image group and a target image; and training the image denoising model based on the multiple training pairs until the image denoising model converges.