Real-Time Block Match Denoising for Low-Latency Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Low-light camera systems face latency issues due to the need for time to gather light and process signals, which is unsuitable for applications requiring fast response times, and existing denoising processes like frame buffering introduce additional latency.
Innovation Solution
A low-latency system and method for denoising low-light images by processing and displaying portions of the image in real-time, using pixel averaging and block matching processes within predefined blocks, allowing for denoising as image lines are received, rather than waiting for the entire frame.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If frame buffering is used for denoising, then image quality is improved, but latency increases making it unsuitable for low-latency applications
Solution Approach 1:
The patent divides the image into multiple blocks and processes each block independently using block matching algorithms. This segmentation allows parallel processing of different regions, reducing overall processing time and latency while maintaining denoising quality through localized block comparisons
Solution Approach 2:
The patent performs denoising operations on blocks as they are received during the imaging process, rather than waiting for the complete frame to be captured. This preliminary action on partial data enables real-time denoising output with reduced latency while maintaining acceptable image quality through progressive block processing
2Measurement precision
If longer exposure time is used to gather light, then image quality is improved, but response time deteriorates
Solution Approach 1:
The patent creates multiple copies of blocks from previously received portions of the image and uses these copies for denoising operations. This allows processing to begin on partial image data before the complete frame is available, enabling faster response times while maintaining image quality through iterative block matching on available data
Solution Approach 2:
The patent performs preliminary denoising operations on blocks as they are received during the exposure period, rather than waiting for the complete exposure and frame capture. This preliminary processing enables real-time output with reduced latency while maintaining quality through progressive refinement as more blocks become available
Data Source
AI summary
A low-latency method for applying image processing steps includes processing and displaying portions of the image as they are received in real-time. In a denoising process, the portion is denoised by selecting pixels, establishing a block centered on each pixel, identifying similar blocks within the portion, and performing a filtering process such as hard thresholding before the entire image is received. Pixels within each block may also be averaged.