Image Sensor Horizontal Downscaling for Video Processing Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Consumer camera devices face challenges in processing high-resolution video data efficiently, often resorting to binning which reduces image quality, and lack resources for effective defective pixel correction and demosaicing within the image sensor.
Innovation Solution
The image sensor employs horizontal downscaling of raw video data, identifies and corrects defective pixels, and performs one-dimensional demosaicing before sending data to the ISP, allowing for improved image quality and resource efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If binning is used to reduce the effective resolution of raw video data, then processing efficiency and bandwidth requirements are improved, but image quality deteriorates
Solution Approach 1:
The patent divides the resolution reduction process into two separate stages: horizontal downscaling in the image sensor and vertical downscaling in the ISP. This segmentation allows each stage to handle only one dimension of resolution reduction, preserving more image information compared to traditional binning that reduces both dimensions simultaneously. The horizontal scaler processes only the horizontal dimension while maintaining full vertical resolution, and the vertical scaler in the ISP handles the vertical dimension afterward.
2Manufacturing precision
If high-resolution raw video data is processed through the ISP, then image quality is maintained, but processing resources and power consumption increase significantly
Solution Approach 1:
The patent performs preliminary horizontal downscaling in the image sensor before the data reaches the ISP. This preliminary action reduces the data volume that needs to be processed by the ISP, thereby reducing power consumption and processing resource requirements while still maintaining acceptable image quality. The horizontal scaler in the sensor prepares the data in advance, so the ISP only needs to perform vertical downscaling and standard image processing on the already-reduced horizontal resolution data.
3Quantity of substance
If the effective resolution is reduced in the sensor, then bandwidth requirements are reduced, but image detail is lost
Solution Approach 1:
The patent changes the approach from two-dimensional resolution reduction (binning) to one-dimensional horizontal downscaling in the sensor, preserving the other dimension (vertical). This dimensional change allows bandwidth reduction while maintaining more image detail because the vertical resolution remains unchanged. The horizontal scaler reduces only the horizontal dimension, and the vertical scaler in the ISP later handles the vertical dimension, ensuring that image detail is preserved as much as possible throughout the process.
Data Source
AI summary
The present disclosure relates generally systems and methods for image data processing. In certain embodiments, a method for transferring the image data may include processing the image data in an image sensor by correcting one or more defective pixels in the image data based on a one-dimensional defective pixel correction algorithm; horizontally demosaicing the image data based on a one-dimensional horizontal demosaic algorithm; or a combination thereof. After processing the image data, the method may include horizontally downscaling the processed image data in the image sensor and vertically downscaling the horizontally downscaled image data in an image signal processor to be displayed for viewing on a display device.