Video Denoising Pipeline Using NLM-NLB GPU Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image denoising algorithms, particularly the non-local Bayes (NLB) method, suffer from unstable denoising effects due to the covariance matrix becoming negative definite, leading to incomplete stability and prolonged execution duration, especially in video denoising under poor lighting conditions.

Innovation Solution

The method employs a two-step denoising process using the non-local means (NLM) algorithm for the first step to ensure accurate patch matching, followed by the NLB algorithm, optimizing both algorithms to enhance denoising efficiency and stability, leveraging the GPU's parallel processing capabilities to accelerate the process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the NLB denoising algorithm is used, then denoising stability is improved, but execution duration increases

Engineering Contradiction:
Improvedenoising stabilityVSAvoidexecution duration
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent divides the video denoising process into two distinct steps: first applying NLM denoising to obtain intermediate results, then applying NLB denoising to achieve final stable denoising. This segmentation allows each algorithm to focus on specific aspects, improving overall stability while managing execution time through optimized processing stages.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The NLM denoising is performed as a preliminary step before NLB denoising. This preliminary action prepares the input data for the NLB algorithm by removing obvious noise patterns first, which stabilizes the subsequent NLB processing and reduces the computational burden, thereby managing execution duration.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If the NLM algorithm is used for accurate patch matching, then denoising precision is improved, but execution duration increases

Engineering Contradiction:
Improvepatch matching accuracyVSAvoidexecution duration
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the denoising process into two distinct phases with different algorithmic approaches. The NLM phase focuses on accurate patch matching for initial denoising, while the NLB phase handles refinement. This segmentation allows accurate patch matching to be performed only where needed in the first step, rather than throughout the entire process.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies NLM denoising partially as a first step rather than using it for the complete denoising process. This partial action achieves the benefit of accurate patch matching where most needed while avoiding the excessive computational cost of applying NLM throughout, as the subsequent NLB step handles remaining processing more efficiently.

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If dual-step denoising is applied, then denoising effect is improved, but device complexity increases

Engineering Contradiction:
Improvedenoising effectVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the complex denoising task into two manageable steps, each using a different algorithm optimized for specific aspects of noise removal. This segmentation makes the overall complex process more controllable and implementable, as each step can be independently optimized and debugged while contributing to the improved overall denoising effect.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12354242B2Method for denoising videos and electronic device therefor
Publication Date: 2025.07.08 BIGO TECH PTE LTD
  • US12354242B2 patent drawing
  • US12354242B2 patent drawing
  • US12354242B2 patent drawing

AI summary

Embodiments of the present application provide a method for denoising videos. The method comprises: acquiring, by the CPU, video frame images by acquiring video data and decoding the video data; loading, by the GPU, the video frame images from the CPU; acquiring, by the GPU, first images by denoising the video frame images using a predetermined non-local means (NLM) denoising algorithm; acquiring, by the GPU, second images by denoising the first images using a predetermined non-local Bayes (NLB) denoising algorithm; and acquiring, by the CPU, denoised video data by acquiring the second images from the GPU and encoding the second images.