Synchronized Image Capture in Multi-Orientation Camera Modules
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Camera devices with multiple optical chains experience image distortions due to rolling shutters capturing different portions of a scene at different times, especially when camera modules are oriented differently, leading to uneven capture times and distortions like streaks in motion images.
Innovation Solution
The solution involves controlling the readout direction of pixel values from sensors based on their physical orientation within the camera device, allowing sensors to read out lines either from top to bottom or bottom to top, depending on their orientation, to synchronize the capture of the same scene area across differently oriented camera modules.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If all sensors read out lines in the same direction (e.g., top to bottom), then the control mechanism is simple and uniform, but sensors with different orientations capture different portions of the scene at different times causing image distortions
Solution Approach 1:
The patent applies local quality by configuring each sensor's readout direction individually based on its specific orientation. Sensors are divided into groups (e.g., first group with first orientation, second group with second orientation) and each group is assigned a readout direction that matches its physical orientation, ensuring synchronized scene capture while maintaining simple control within each group.
Solution Approach 2:
The patent uses inversion by reversing the readout direction for sensors with opposite orientations. When a sensor is oriented in the opposite direction to another sensor, its readout direction is inverted accordingly, allowing both sensors to capture the same portion of the scene at the same time despite their different physical orientations.
2Volume of moving object
If camera modules are oriented differently to fit limited space, then the device compactness is improved, but the capture timing synchronization between modules deteriorates
Solution Approach 1:
The patent allows different camera modules to have different orientations (e.g., some facing upward, some downward, some sideways) to maximize space utilization in compact devices. Each module's readout direction is locally optimized based on its specific orientation, ensuring that despite the variety of orientations, all modules can be synchronized to capture the same scene portion at the same time.
Solution Approach 2:
The patent introduces dynamic control of readout directions based on the operational mode. The system can switch between different readout configurations depending on which camera modules are actively used, allowing flexible adaptation to different device orientations and usage scenarios while maintaining synchronization.
3Device complexity
If rolling shutter is used for image capture, then the device complexity is reduced compared to global shutter, but image distortions occur when capturing motion due to sequential line capture
Solution Approach 1:
The patent uses inversion to counteract the distortion caused by rolling shutter. When a sensor is oriented in the opposite direction, the readout direction is inverted accordingly. This inversion ensures that even though lines are captured sequentially in time, the spatial arrangement of captured lines correctly represents the scene at a single moment, eliminating streaks and distortions in motion images.
Solution Approach 2:
The patent applies preliminary anti-action by pre-configuring the readout direction based on the sensor orientation before image capture begins. This pre-configuration prevents distortion from occurring in the first place, rather than attempting to correct it afterward. The system anticipates the potential distortion and applies the appropriate readout direction configuration in advance.
Data Source
AI summary
Camera device including multiple optical chains, e.g., camera modules, some of which have different orientations relative to the base of the camera device and methods of using such a camera device are described. The orientation of the camera modules within the camera device is taken into consideration when determining the direction in which lines of the sensors of the individual camera modules are read out. Information with regard to the read out direction to be used with particular camera modules is stored in some embodiments and used to control the readout of sensors, e.g., sensors which use a rolling shutter to capture images of a scene area. The sensors may have the same field of view or overlapping fields of view.