Image Pre-Processing Apparatus Subframe Segmentation for Limited ISP Capacity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The challenge lies in processing high-resolution digital images efficiently without the need for a CPU, as current image signal processors (ISPs) with limited capabilities are unable to handle full-resolution still image frames effectively, leading to increased manufacturing costs and slower processing times.
Innovation Solution
Divide the image frame into subframes with overlapping regions, allowing sequential processing by an image signal processor with limited capacity, utilizing an image pre-processing apparatus that includes a DMA controller to manage data transfer and storage, enabling the use of pre-manufactured ISPs capable only of processing downsized preview frames to handle high-resolution still images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a CPU is used for still image processing, then image processing capability is improved, but manufacturing cost increases significantly
Solution Approach 1:
The patent divides the high-resolution image frame into multiple subframes with overlapping regions. Each subframe is processed independently by the ISP, which has limited processing capacity. This segmentation allows the ISP to handle full-resolution still images without requiring a CPU, thereby reducing manufacturing costs while maintaining processing capability.
2Speed
If an ISP with high processing capability is used, then still image processing speed is improved, but manufacturing cost increases significantly
Solution Approach 1:
The patent segments the image processing task into multiple subframes that can be processed sequentially by a low-capability ISP. The overlapping regions between subframes are processed using interpolation techniques, allowing the ISP to achieve full-resolution output without requiring high processing capability hardware, thus reducing manufacturing costs.
Solution Approach 2:
The patent processes only portions of the image (subframes) at full resolution at any given time, rather than processing the entire high-resolution frame simultaneously. This partial action approach allows a low-capability ISP to effectively handle full-resolution images by working on manageable segments, avoiding the need for expensive high-performance ISPs.
3Productivity
If the entire image frame is processed at once, then processing efficiency is improved, but the ISP becomes overwhelmed and cannot handle full-resolution frames
Solution Approach 1:
The patent divides the image frame into multiple subframes with overlapping regions, allowing the ISP to process each subframe independently within its capacity limits. This segmentation prevents the ISP from being overwhelmed by the full-resolution frame while maintaining overall processing efficiency through systematic handling of smaller units.
Solution Approach 2:
The patent performs preliminary actions by dividing the image into subframes before processing. The overlapping regions are prepared in advance, and the ISP processes each subframe sequentially. This preliminary segmentation enables the ISP to manage its processing capacity effectively while still achieving full-resolution output.
Data Source
AI summary
A method, an image pre-processing apparatus, and a camera system for processing large images are provided. The method includes receiving from an image sensor an image frame at an image pre-processing apparatus, the image frame having a frame pixel resolution substantially equal to a sensor pixel resolution of the image sensor, dividing the image frame into first and second image subframes to be sequentially processed by an image signal processor, each of the first and the second image subframes having a subframe pixel resolution smaller than the sensor pixel resolution and a region in which the first and second image subframes overlap with each other. The subframe pixel resolution is predetermined by a processing capacity of the image signal processor, and the first and the second image subframes are consecutively processed by the image signal processor.