Multocular Image Pickup Apparatus Occlusion Handling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Multocular imaging apparatuses face challenges in processing high-definition images with multiple cameras, as the number of camera pairs increases processing complexity and precision requirements, leading to difficulties in detecting corresponding points with sub-pixel precision, especially in occlusion regions, which deteriorates image quality.
Innovation Solution
A multocular image pickup apparatus and method that calculates distance information from multiple image pickup units and uses a monocular video synthesizing unit to generate synthesized video by recalculating distance information and adjusting luminance or color saturation in occlusion regions, reducing processing complexity and improving image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If multiple image pickup units are used to achieve high-definition synthesized images, then image quality is improved, but processing complexity increases
Solution Approach 1:
The patent divides the image processing task by calculating distance information separately for each image pickup unit and then combining the results. The distance calculation unit processes each unit's output video independently to determine depth information, which simplifies the overall processing complexity while maintaining high-definition image quality through segmented computation.
2Manufacturing precision
If corresponding point detection is performed with sub-pixel precision for high-definition synthesis, then image quality is improved, but processing load increases significantly
Solution Approach 1:
The patent performs preliminary distance information calculation for each image pickup unit before the final synthesis step. By pre-calculating depth information and occlusion regions for each unit, the system reduces the processing load during the corresponding point detection phase, achieving sub-pixel precision without a significant increase in overall processing load.
3Device complexity
If occlusion regions are handled by omitting corresponding points, then processing is simplified, but image quality deteriorates
Solution Approach 1:
The patent introduces distance information as an intermediary to handle occlusion regions. By calculating depth information for each image pickup unit and using this as a mediator, the system can identify occlusion regions and appropriately handle them during synthesis, maintaining image quality while simplifying the processing procedure.
4Measurement precision
If distance information is calculated from all image pickup units, then synthesis accuracy is improved, but calculation time increases
Solution Approach 1:
The patent segments the distance information calculation into separate processing steps for each image pickup unit. Each unit's distance information is calculated independently and then combined, which improves synthesis accuracy by considering all units while reducing total calculation time through parallel processing of individual units.
Data Source
AI summary
A multocular image pickup apparatus includes: a distance calculation unit that calculates information regarding the distance to a captured object from an output video of a first image pickup unit, which is to be the reference unit of a plurality of image pickup units that pick up images, and from an output video of an image pickup unit that is different from the first image pickup unit; a multocular video synthesizing unit that generates synthesized video from the output video of the plurality of image pickup units based on the distance information for regions where the distance information could be calculated; and a monocular video synthesizing unit that generates synthesized video from the output video of the first image pickup unit for regions where the distance information could not be calculated. The distance calculation unit calculates a first distance information that is the distance to the captured object from the output video of the first image pickup unit and the output video of a second image pickup unit that is different from the first image pickup unit, and in case that there is a region where the first distance information could not be calculated, for the region where the first distance information could not be calculated, the distance calculation unit recalculates information regarding the distance to the captured object from the output video of an image pickup unit that was not used for calculating the distance among the plurality of image pickup units, and from the output video of the first image pickup unit.