Multi-Lens Image Fusion via Feature Point Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image fusion methods struggle with camera movement and time differences when capturing images with different focal distances, leading to artifacts and blurring in the fused image.
Innovation Solution
An image fusion method and device that take parallax images with different focal distances through multiple lenses, analyze feature points, calculate matching relationships, adjust the same image portions to a common position, and fuse the adjusted images to generate a clearer fusion image, thereby addressing camera movement and time differences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If images are taken at different times to achieve different focal distances, then the image fusion can integrate clearest portions from each image, but camera movement and time differences cause artifacts and blurring in the fused image
Solution Approach 1:
The patent applies preliminary action by performing feature point analysis and calculating matching relationships between parallax images before the actual image fusion process. This preprocessing step establishes the spatial correspondence between images taken at different times, enabling accurate alignment compensation for camera movement and temporal differences before fusion occurs.
Solution Approach 2:
The patent implements feedback by using the calculated matching relationships of feature points to adjust and align the parallax images. The system continuously refines the alignment by comparing feature point positions across multiple images and applying corrective transformations, ensuring that images are properly registered despite camera movement or temporal separation.
2Device complexity
If a single lens is used to simplify the device structure, then the device complexity is reduced, but the ability to capture parallax images with different focal distances simultaneously is lost
Solution Approach 1:
The patent applies merging by combining multiple lenses with different focal lengths into a single imaging device. This allows the system to capture parallax images with different focal distances simultaneously in one operation, eliminating the need for sequential shooting and improving capture efficiency while maintaining a unified device structure.
Solution Approach 2:
The patent implements multi-functionality by designing an imaging device that incorporates multiple lenses capable of capturing images with different focal distances through the same image sensor. This universal design allows a single device to perform multiple functions (capturing wide-angle and telephoto images) without requiring separate camera systems.
3Reliability
If multiple lenses are used to capture parallax images simultaneously, then camera movement and time difference problems are solved, but the device structure becomes more complex
Solution Approach 1:
The patent applies copying by using multiple lenses that replicate the basic imaging function simultaneously. Each lens captures a parallax image with different focal characteristics, and these copied imaging functions work together to provide synchronized multi-focal distance capture without requiring complex coordination mechanisms.
Data Source
AI summary
An image fusion method for multiple lenses and device thereof, which includes the following steps: taking parallax images with different focal distances through a plurality of lenses; analyzing feature points of the parallax images; calculating the matching relationships among the feature points of the parallax images; moving each of the parallax images according to the matching relationships to adjust the same image portion of each parallax image to the same image position; fusing the moved result of the parallax images to generate a fusion image; and removing unnecessary images configured in the edge of the fusion image to generate a corrected fusion image. Therefore, the image fusion method for multiple lenses and device thereof can make the result of the image fusion better.