Omnidirectional Image Alignment via Virtual Reference Position
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Omnidirectional imaging devices face issues with discontinuous images at composite borders when combining captured images from multiple optical units, as existing technologies cannot physically reduce imaging viewpoint distances to zero, leading to undesirable image discontinuities.
Innovation Solution
An image processing apparatus and method that calculates a movement amount for objects within captured images based on distance and angle from a reference position, allowing the images to appear as if taken from that reference position, thereby enhancing the natural combination of images from omnidirectional imaging devices with overlapping imaging ranges.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple optical units are used to capture images from different directions, then the imaging coverage is improved, but image discontinuities occur at composite borders
Solution Approach 1:
The patent introduces a virtual reference position as an intermediary concept. Instead of directly combining images from multiple optical units which causes discontinuities, the system calculates movement amounts based on the reference position and applies these to warp and align image regions, effectively mediating the combination process to achieve continuous images.
Solution Approach 2:
The patent changes the parameter of image alignment by calculating movement amounts based on distance and angle from the reference position. This transforms the alignment process from simple geometric overlay to a parameter-driven warp operation that accounts for the spatial relationship between optical units and the reference position, eliminating discontinuities.
2Reliability
If the distance between optical units is reduced to improve image continuity, then image discontinuities are relieved, but the imaging viewpoint cannot be physically moved to zero distance
Solution Approach 1:
The patent substitutes the mechanical approach of physically moving optical units or adjusting their positions with an image processing approach. Instead of changing the physical configuration to achieve zero distance between viewpoints, the system uses computational methods to calculate and apply movement amounts that simulate the effect of being at the reference position, thereby achieving image continuity without physical reconfiguration.
3Productivity
If captured images are directly combined without processing, then the processing time is reduced, but image discontinuities and unnatural appearance occur
Solution Approach 1:
The patent applies preliminary action by calculating movement amounts for all image regions before performing the actual warping and combination operations. The movement amount calculation is performed in advance based on the reference position and optical unit characteristics, allowing the subsequent image processing to proceed more efficiently with pre-computed alignment parameters.
Data Source
AI summary
There is provided an image processing apparatus including a movement amount deciding unit configured to decide a movement amount for moving a target object that is a movement target among objects included in a plurality of captured images imaged by an imaging device including optical units that have imaging ranges overlapping with each other in part on the basis of a distance from the imaging device to the target object and an angle from a reference line at a reference position of the imaging device to the target object in a manner that the plurality of captured images look like images imaged from the reference position, the imaging device using all directions as an imaging range, the plurality of captured images corresponding to the respective optical units.