Image Frame Rate Boost via Selective Resolution Scaling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current software-based image processing in digital cameras faces challenges in achieving high frame rates for real-time operations like video recording and viewfinder display, especially in low-cost processor systems, due to limited processing power and the need for maintaining image quality, which is difficult to achieve without degrading image quality by dropping processing operations or using downscaling/upscale methods that lose significant image information.
Innovation Solution
The method involves reducing the size and resolution of selected image frames to reduce processing time, followed by scaling them up to match unselected frames and interleaving them to maintain a targeted frame rate and desired quality level, using an image signal processor and frame synchronization controller to manage frame selection and timing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If software-based image processing is used to maintain image quality, then image quality is preserved, but processing time increases and frame rate decreases
Solution Approach 1:
The image processing pipeline is segmented into different processing paths: full processing for selected frames and reduced processing for unselected frames. This allows the system to maintain image quality for important frames while rapidly processing other frames to achieve higher overall frame rates.
Solution Approach 2:
The patent applies partial image processing to unselected frames, performing only essential operations and skipping optional enhancements. This partial processing approach maintains acceptable image quality while significantly reducing processing time compared to full processing.
2Productivity
If downscaling is applied to reduce processing time, then processing speed increases, but image information is lost and quality degrades
Solution Approach 1:
The patent applies different processing qualities to different frames based on their importance. Selected frames receive full processing with complete image quality, while unselected frames receive reduced processing. This local differentiation of quality levels optimizes the balance between processing speed and information retention.
3Productivity
If processing operations are dropped to reduce processing time, then frame rate increases, but image quality deteriorates
Solution Approach 1:
The patent implements periodic full processing for selected frames interspersed with reduced processing for unselected frames. This periodic alternation between full and reduced processing maintains image quality at critical intervals while achieving higher average frame rates through the reduced processing intervals.
Data Source
AI summary
The specification and drawings present a new method, apparatus and software product for implementing algorithms for improving a frame rate by reducing a size and resolution of selected versus unselected image frames captured by a sensor in an image processing pipeline before displaying (or before encoding) in electronic devices (e.g., cameras, wireless camera phones, etc.), according to various embodiments of the present invention.