Video Denoising Pipeline Using NLM-NLB GPU Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image denoising algorithms, particularly the non-local Bayes (NLB) method, suffer from unstable denoising effects due to the covariance matrix becoming negative definite, leading to incomplete stability and prolonged execution duration, especially in video denoising under poor lighting conditions.
Innovation Solution
The method employs a two-step denoising process using the non-local means (NLM) algorithm for the first step to ensure accurate patch matching, followed by the NLB algorithm, optimizing both algorithms to enhance denoising efficiency and stability, leveraging the GPU's parallel processing capabilities to accelerate the process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the NLB denoising algorithm is used, then denoising stability is improved, but execution duration increases
Solution Approach 1:
The patent divides the video denoising process into two distinct steps: first applying NLM denoising to obtain intermediate results, then applying NLB denoising to achieve final stable denoising. This segmentation allows each algorithm to focus on specific aspects, improving overall stability while managing execution time through optimized processing stages.
Solution Approach 2:
The NLM denoising is performed as a preliminary step before NLB denoising. This preliminary action prepares the input data for the NLB algorithm by removing obvious noise patterns first, which stabilizes the subsequent NLB processing and reduces the computational burden, thereby managing execution duration.
2Measurement precision
If the NLM algorithm is used for accurate patch matching, then denoising precision is improved, but execution duration increases
Solution Approach 1:
The patent segments the denoising process into two distinct phases with different algorithmic approaches. The NLM phase focuses on accurate patch matching for initial denoising, while the NLB phase handles refinement. This segmentation allows accurate patch matching to be performed only where needed in the first step, rather than throughout the entire process.
Solution Approach 2:
The patent applies NLM denoising partially as a first step rather than using it for the complete denoising process. This partial action achieves the benefit of accurate patch matching where most needed while avoiding the excessive computational cost of applying NLM throughout, as the subsequent NLB step handles remaining processing more efficiently.
3Reliability
If dual-step denoising is applied, then denoising effect is improved, but device complexity increases
Solution Approach 1:
The patent segments the complex denoising task into two manageable steps, each using a different algorithm optimized for specific aspects of noise removal. This segmentation makes the overall complex process more controllable and implementable, as each step can be independently optimized and debugged while contributing to the improved overall denoising effect.
Data Source
AI summary
Embodiments of the present application provide a method for denoising videos. The method comprises: acquiring, by the CPU, video frame images by acquiring video data and decoding the video data; loading, by the GPU, the video frame images from the CPU; acquiring, by the GPU, first images by denoising the video frame images using a predetermined non-local means (NLM) denoising algorithm; acquiring, by the GPU, second images by denoising the first images using a predetermined non-local Bayes (NLB) denoising algorithm; and acquiring, by the CPU, denoised video data by acquiring the second images from the GPU and encoding the second images.


