Image Sensor Remosaicing Split Between ISP and Application Processor
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing demand for high-magnification and high-resolution image capture in electronic devices has led to a need for image sensors and processing systems that can reduce resource consumption in image processing.
Innovation Solution
An image sensor with a pixel array and an image signal processor (ISP) that generates image data with a smaller color pattern by remosaicing, combined with an external application processor to further process the data, reducing the complexity and resource requirements of the ISP.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the ISP performs complete remosaic operation internally, then image processing quality is maintained, but device complexity and resource consumption increase
Solution Approach 1:
The remosaic operation is segmented into two parts: the ISP performs partial remosaic to convert the k×l color filter array pattern to a preliminary p×q pattern, and the external application processor completes the remaining remosaic operation. This division reduces the complexity and resource requirements of the ISP while maintaining overall image processing quality through collaborative processing.
2Productivity
If the ISP performs complete remosaic operation, then processing capability is sufficient, but resource consumption increases
Solution Approach 1:
The processing workload is segmented between the ISP and external application processor. The ISP performs the initial remosaic conversion from k×l to p×q pattern, consuming fewer resources, while the application processor handles the remaining processing. This segmentation reduces resource consumption in the image sensor while maintaining overall processing capability through distributed computation.
Data Source
AI summary
An image sensor includes a pixel array including a plurality of unit pixels configured to receive light of a color filter array having a first color pattern of size k×l arranged therein, where k and l are natural numbers of 3 or more, the image sensor configured to generate first image data including the first color pattern and an image signal processor (ISP) configured to generate second image data including a second color pattern of size p×q, by remosaicing the first image data, where p and q are natural numbers of 2 or more, where a size of the second color pattern is smaller than a size of the first color pattern, and the image sensor is configured to transmit the second image data an application processor that is external to the image sensor.