Multi-Camera Rolling Shutter Alignment for Stitched Visual Content
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The misalignment of rolling shutter directions between multiple cameras results in misalignment of captured visuals during the stitching process, affecting the quality of panoramic images.
Innovation Solution
A system comprising a set of image sensors with synchronized rolling shutter directions, where the first image sensor captures a first portion of the capture field with a first rolling shutter direction parallel to and the same as the second image sensor's rolling shutter direction, allowing for the generation of a stitched image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If multiple cameras capture images for stitching, then the coverage area of the panoramic image is improved, but misalignment of rolling shutter directions causes visual misalignment in the stitched result
Solution Approach 1:
The patent changes the shutter direction parameter of the image sensors to be parallel and aligned. Specifically, it configures multiple image sensors to have their rolling shutter directions parallel to each other, which resolves the misalignment issue while maintaining multi-camera coverage capability
Solution Approach 2:
The patent introduces asymmetric configuration where the rolling shutter directions are deliberately set to be parallel rather than following the natural orthogonal or random orientations of multiple sensors. This asymmetric alignment strategy ensures proper stitching while maintaining the benefits of multiple sensors
2Speed
If rolling shutter capture is used in multiple cameras, then the capture speed is improved, but temporal discontinuities cause misalignment during stitching
Solution Approach 1:
The patent changes the temporal parameter by synchronizing the shutter directions in time. By ensuring that the rolling shutter directions are parallel and aligned across multiple sensors, the patent eliminates temporal discontinuities that would otherwise cause misalignment during stitching, thus maintaining both high capture speed and stitching reliability
Data Source
AI summary
A first image sensor may generate images capturing a first portion of a capture field. The capture of images by the first image sensor may be characterized by a first rolling shutter direction. A second image sensor may generate images capturing a second portion of the capture field. The capture of images by the second image sensor may be characterized by a second rolling shutter direction. The first portion may be adjacent to the second portion. The first rolling shutter direction may be parallel to and the same as the second rolling shutter direction. A first image may be obtained from the first image sensor. A second image may be obtained from the second image sensor. A stitched image may be generated based on the first image and the second image.