Omnidirectional Video Reproduction Control for Phase Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The construction of omnidirectional video faces challenges due to timing shifts in imaging, which cause inconsistencies in how subjects are seen between neighboring camera modules, especially when quickly moving subjects are imaged or the camera is moved quickly, leading to difficulties in integral processing such as stitching or stereo matching.
Innovation Solution
An image processing device with a reproduction control unit that synchronizes the imaging timing of multiple camera modules by delaying the pixel readout in one module until the other module reaches the overlapping portion, ensuring that image signals from overlapping fields of view agree in phase, thereby reducing phase shifts and enhancing the accuracy of integral processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If pixel readout is performed simultaneously in multiple camera modules, then imaging speed is improved, but phase shifts occur between overlapping fields of view causing inconsistencies in integral processing
Solution Approach 1:
The patent applies preliminary action by delaying the pixel readout timing in one camera module so that it synchronizes with the other module's readout timing. This timing adjustment is performed in advance before the images are stitched together, ensuring that overlapping fields of view capture the same moving subjects at the same moment, thereby eliminating phase shifts while maintaining high imaging speed
Solution Approach 2:
The patent changes the timing parameter of pixel readout in one camera module relative to the other. By adjusting the readout timing parameter, the system achieves synchronized capture of overlapping fields of view, resolving the phase alignment issue without compromising imaging speed
2Manufacturing precision
If global shutters are used in camera modules, then phase alignment between modules is improved, but device complexity and cost increase
Solution Approach 1:
The patent replaces the mechanical global shutter mechanism with a timing control system that adjusts pixel readout timing. Instead of using complex mechanical shutters to synchronize capture, the system uses electronic timing control to delay readout in one module, achieving the same phase alignment effect with simpler, more cost-effective components
Solution Approach 2:
The patent creates a timing relationship between two camera modules where one module's readout is delayed to match the other's timing. This timing copy ensures that both modules effectively capture the same temporal moment in overlapping regions, achieving global shutter-like synchronization without the complexity of actual global shutter hardware
Data Source
AI summary
[Object] To resolve or reduce inconvenience resulting from a shift in imaging timing that occurs during reproduction of omnidirectional video or integral processing based on a plurality of captured images captured at different timings. [Solution] Provided is an image processing device including: a reproduction control unit configured to control reproduction of omnidirectional video based on a plurality of captured images sequentially captured in a plurality of fields of view that revolve while partially overlapping one another. The omnidirectional video is covered by M fields of view from a first field of view to an M-th (M>1) field of view with a reference direction serving as a starting point. In a case where reproduction in a reproduction field of view that straddles the reference direction is requested, the reproduction control unit causes a display unit to display a reproduction image based on a first captured image corresponding to the first field of view and a second captured image corresponding to the M-th field of view captured earlier than the first captured image.