SLR Camera Continuous Shooting Memory Buffer Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Single lens reflex digital cameras face challenges in continuous image capture due to high memory and bus bandwidth requirements, leading to bottlenecks that limit the continuous shooting rate and prevent real-time exposure and white balance control for the first frame, especially when using pipeline processing without an auxiliary sensor.
Innovation Solution
The method involves capturing leading image data, calculating exposure and white balance adjustment values based on this data, and applying these values in real-time to subsequent frames without storing intermediate data in the main memory, allowing exposure and white balance control to be performed on both leading and subsequent frames using calculated parameters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If image data is temporarily stored in main memory and processed sequentially, then exposure control and white balance control can be performed, but the memory buffer size and bus bandwidth load become excessively large
Solution Approach 1:
The patent calculates exposure adjustment values and white balance adjustment values from the first frame image data before processing subsequent frames. These pre-calculated values are then applied in real-time to subsequent frames during continuous shooting, eliminating the need to store and re-process all image data through the full processing pipeline.
Solution Approach 2:
The patent separates the image processing into two distinct stages: (1) calculating adjustment values from the first frame data, and (2) applying these values in real-time to subsequent frames. This segmentation allows the system to perform comprehensive processing on minimal data while enabling real-time processing for the remaining frames.
2Manufacturing precision
If multiple DMA transfers are performed for image processing, then complete processing can be achieved, but the bus bandwidth load increases significantly
Solution Approach 1:
The patent performs exposure control and white balance control calculations on the first frame data before continuous shooting begins. These pre-computed adjustment values are then reused for all subsequent frames, eliminating the need for repeated DMA transfers for each frame's exposure and white balance processing.
Solution Approach 2:
The patent enables continuous shooting by applying pre-calculated adjustment values in real-time to subsequent frames as they are captured, maintaining continuous processing without interrupting the shooting flow for repeated memory accesses and processing cycles.
3Device complexity
If pipeline processing is used without auxiliary sensors, then device complexity is reduced, but real-time exposure and white balance control for the first frame cannot be performed
Solution Approach 1:
The patent calculates exposure adjustment values and white balance adjustment values from the first frame image data captured by the main sensor before continuous shooting proceeds. This preliminary calculation ensures that even without auxiliary sensors, the first frame benefits from proper exposure and white balance control based on actual captured data.
Solution Approach 2:
The patent uses the first frame image data captured by the main sensor to calculate its own exposure and white balance adjustment values, eliminating the need for auxiliary sensors. The system serves itself by using the captured data to generate the control parameters needed for processing.
4Loss of information
If all frames are processed and stored in main memory, then complete image data is available, but the continuous shooting rate is limited by processing speed
Solution Approach 1:
The patent performs exposure control and white balance control calculations on the first frame data before continuous shooting begins. These pre-computed values enable real-time processing of subsequent frames without requiring them to be fully stored and re-processed in memory, significantly increasing the continuous shooting rate.
Solution Approach 2:
The patent extracts the essential processing steps (exposure control and white balance control) from the full image processing pipeline and performs them preliminarily on the first frame. This extraction allows subsequent frames to be processed more quickly with reduced memory operations, enabling higher shooting rates.
Data Source
AI summary
The first frame of captured image data is stored as raw data in a main memory, and parameters for exposure control and white balance control are calculated from the stored image data and are set in the RPU. The second and subsequent frames of captured image data are processed in real time in the RPU without being stored in the main memory after being output from a CCD. The second and subsequent frames of captured image data are subjected to exposure control, white balance control, and JPEG compression, and then, are stored in the main memory. After operations for continuously capturing images are finished, the raw data corresponding to the first frame stored in the main memory is read by the RPU, where exposure control and white balance control are performed, and then, is stored as JPEG data in the main memory.