Multi-Frame Night Scene Image Noise Reduction via Temporal-Spatial Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Digital cameras face challenges in capturing clear images in low-light environments due to noise and smear issues, which are difficult to address without upgrading hardware, leading to restricted applicability and increased costs.

Innovation Solution

An image processing method that involves obtaining multi-frame target images, performing spatial and temporal noise reduction processing to filter out noise, and generating enhanced night scene effect images through weighted calculation of intra-frame and inter-frame processing results.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If hardware upgrades (optical lens or image sensor) are performed to improve photographing effect in low-light environments, then image quality is improved, but cost and camera volume increase

Engineering Contradiction:
Improveimage qualityVSAvoidcost and volume
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent changes the parameter of image processing from single-frame to multi-frame processing. By capturing multiple frames and performing noise reduction processing across frames, the system achieves better image quality in low-light conditions without hardware upgrades. The processing parameters include temporal noise reduction coefficients and spatial noise reduction coefficients that are dynamically adjusted based on scene characteristics.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces the mechanical/optical system (hardware upgrades of lens and sensor) with a digital signal processing system. Instead of improving image quality through better optical components, the system uses multi-frame temporal and spatial noise reduction algorithms to achieve the same goal through software processing, thereby avoiding increased cost and volume.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If single-frame processing is used for noise reduction, then processing speed is maintained, but noise reduction effectiveness is insufficient

Engineering Contradiction:
Improvenoise reduction effectivenessVSAvoidprocessing speed
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent segments the noise reduction process into two distinct stages: temporal noise reduction processing and spatial noise reduction processing. The temporal stage processes multiple frames in sequence to reduce time-domain noise, while the spatial stage processes pixels within each frame to reduce space-domain noise. This segmentation allows comprehensive noise reduction while maintaining processing efficiency through optimized coefficient calculations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary temporal noise reduction processing on multiple frames before conducting spatial noise reduction processing. By first reducing temporal noise across frames and then applying spatial filtering, the system prepares the data in an optimal state for the second processing stage, improving overall noise reduction effectiveness without proportionally increasing computational burden.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12052514B2Imaging processing method and apparatus for a camera module in a night scene, an electronic device, and a storage medium
Publication Date: 2024.07.30 AUTEL ROBOTICS CO LTD
  • US12052514B2 patent drawing
  • US12052514B2 patent drawing
  • US12052514B2 patent drawing

AI summary

Embodiments of the present invention relate to an image processing method and apparatus for a camera module in a night scene, an electronic device, and a storage medium. The method includes: obtaining a multi-frame target image; performing first noise reduction processing on each frame of target image in the multi-frame target image, to obtain intra-frame processing results of the multi-frame target image; performing second noise reduction processing on any two adjacent frames of target images in the multi-frame target image, to obtain inter-frame processing results; and generating an enhanced night scene effect image of the target image according to the intra-frame processing result and the inter-frame processing result.