Dual Rolling Shutter Sensor Timing Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Rolling shutter distortions occur in imaging systems using CMOS image sensors, leading to time shifts between boundary regions of images captured by multiple sensors, which complicates image processing and video composition.
Innovation Solution
An imaging apparatus employing two rolling shutter type image sensors with a timing generator and controller to synchronize the exposure periods of both sensors within duplicate regions, minimizing time shifts and allowing for image synthesis with reduced load on the controller.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If rolling shutter type image sensors are used to capture images, then the imaging apparatus can achieve compact design and lower cost, but time shifts occur between boundary regions of images from multiple sensors
Solution Approach 1:
The timing generator pre-calculates and determines the optimal timing for exposing lines in duplicate regions before actual image capture. By determining exposure timings in advance based on predetermined time relationships, the system ensures that images from multiple sensors are captured with minimal time shift, preventing the time shift problem before it occurs during the imaging process.
Solution Approach 2:
The system dynamically adjusts the timing parameters of the rolling shutter sensors by controlling which specific lines are exposed in duplicate regions and at what times. The timing generator modifies exposure timing parameters to ensure that corresponding lines in duplicate regions from different sensors are captured simultaneously or with minimal time difference, thereby resolving the time shift issue while maintaining the benefits of rolling shutter design.
2Area of stationary object
If multiple image sensors are used to expand video coverage, then the imaging apparatus can capture wider fields of view, but image processing complexity increases due to time shifts
Solution Approach 1:
The timing generator pre-establishes timing relationships for lines in duplicate regions before image capture. By determining in advance which lines should be exposed simultaneously across multiple sensors and what the predetermined time relationships should be, the system simplifies subsequent image processing. The controller can directly use the timing information provided by the timing generator to align images without complex post-processing corrections.
Solution Approach 2:
The system implements a feedback mechanism where the timing generator receives timing information from the controller and adjusts exposure timings accordingly. This closed-loop control ensures that the timing of line exposure in duplicate regions is continuously optimized to maintain minimal time shifts, thereby simplifying image processing while expanding video coverage.
3Loss of time
If timing synchronization is implemented between multiple rolling shutter sensors, then time shifts between images are minimized, but control complexity increases
Solution Approach 1:
The timing generator serves as an intermediary device between the controller and multiple rolling shutter sensors. It receives timing information from the controller and translates it into specific exposure control signals for each sensor's lines in duplicate regions. This intermediary layer simplifies the controller's task by handling the complex timing calculations and coordination, thereby minimizing time shifts without significantly increasing overall control complexity.
Solution Approach 2:
The timing control is segmented into different levels: the controller sets overall timing parameters, and the timing generator handles line-by-line exposure timing for duplicate regions. This segmentation allows each component to focus on a specific aspect of timing control, making the overall system more manageable. The timing generator deals with the detailed timing synchronization of individual lines, while the controller manages higher-level imaging parameters.
Data Source
AI summary
An imaging apparatus includes a rolling shutter type first image sensor and second image sensor, a timing generator that controls operation timings of these two image sensors, and a controller that subjects generated image data to image processing and controls the timing generator. The first image sensor captures an image of a subject to generate first image data, and the second image sensor captures an image of the subject to generate second image data. Each of the first image data and the second image data has a duplicate region in which the subject is partly duplicated. The controller controls the timing generator in such a way that a period over which the first image sensor exposes lines within the duplicate region in the first image data coincides with a period over which the second image sensor exposes lines within the duplicate region in the second image data.