Multiframe Scaler Reduces Memory for Image Stabilization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The high cost and complexity of digital camera modules are increased by the need for significant memory and resources to buffer and process multiple frames for image quality enhancement functions such as video stabilization and exposure bracketing, particularly in devices with megapixel-class image sensors.
Innovation Solution
Implementing a multiframe scaler and frame buffer with image processing circuitry that scales and processes multiple frames, reducing memory requirements by processing and analyzing scaled images, which are then evaluated for quality factors and stabilization regions, allowing for efficient implementation of image quality enhancement functions without the need for large frame buffers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If memory resources are increased to buffer and process multiple frames for image quality enhancement, then image processing capability is improved, but device cost and complexity increase
Solution Approach 1:
The patent applies the copying principle by creating a scaled-down version of the image frame rather than working with the full-resolution frame directly. The multiframe scaler generates a scaled copy of each frame that is smaller in size, allowing the system to process multiple frames simultaneously without requiring proportionally large memory resources. This scaled copy is then used for quality assessment and stabilization processing, resolving the contradiction between processing capability and memory requirements.
Solution Approach 2:
The patent applies parameter changes by modifying the resolution parameter of the image frames through the multiframe scaler. The scaler transforms full-resolution frames into scaled versions with reduced pixel counts, changing the fundamental parameter of image size. This allows the system to maintain the ability to process multiple frames for quality enhancement while reducing the memory footprint and processing burden, thus resolving the technical contradiction.
2Adaptability or versatility
If multiple frames are buffered and processed for video stabilization and exposure bracketing, then image processing functions are enhanced, but the size of frame buffer and processing circuitry increases
Solution Approach 1:
The multiframe scaler creates scaled copies of frames that reduce the memory space required to store multiple frames. Instead of buffering full-resolution frames for stabilization and exposure bracketing operations, the system buffers scaled-down versions, enabling the same image processing functions to be implemented with a smaller frame buffer, thus resolving the contradiction between functional versatility and buffer size.
Solution Approach 2:
The patent segments the image processing task by separating the scaling operation from the quality assessment and stabilization processing. The multiframe scaler handles the scaling of individual frames, while the frame buffer and processing circuitry work with the scaled versions. This segmentation allows the system to maintain multiple frame processing capabilities while reducing the overall resource requirements, addressing the technical contradiction.
3Manufacturing precision
If full-resolution frames are processed directly, then image quality is maintained, but processing time and resource consumption increase
Solution Approach 1:
The multiframe scaler creates a scaled copy of the frame that preserves the essential image information while reducing the amount of data that needs to be processed. This scaled copy is then used for quality assessment and stabilization calculations, significantly reducing processing time and resource consumption compared to working with full-resolution frames directly, while still maintaining adequate image quality for the intended processing functions.
Solution Approach 2:
The patent applies partial action by processing only the scaled version of the frame rather than the full-resolution frame for quality assessment and stabilization operations. The scaled copy provides sufficient information for these processing tasks without requiring the complete original frame data, thus reducing processing time and resource consumption while achieving the necessary processing objectives.
Data Source
AI summary
An electronic device may have a camera module and a host subsystem. The camera module may include a camera sensor and associated image processing and data formatting circuitry. The image processing and data formatting circuitry may include an image processor that produces unscaled images frames using data from the camera sensor. Unscaled image frames may be processed in multiple paths between the image processor and the host subsystem such as a path that includes an image compression circuit block, a parallel path that includes a preview scaler, and a parallel path that includes a multiframe scaler and a frame buffer and multiframe image processor circuitry. The multiframe scaler may scale unscaled frames for buffering and processing by the frame buffer and multiframe image processor circuitry to produce analysis results. The analysis results may be appended to compressed unscaled image frames sent to the host subsystem.