Image Alignment Using Sensor and Vector Reliability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing techniques for panoramic synthesis rely on motion information from gyro sensors, which can be unreliable, leading to inaccurate alignment due to factors like camera shake and repetitive patterns, resulting in degraded alignment accuracy.
Innovation Solution
An image processing apparatus that detects motion information from multiple sources, determines the reliability of this information, and uses either the most reliable motion vector or a vector derived from both motion information and motion vectors for alignment, ensuring accurate image alignment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If motion information from gyro sensor is used for image alignment, then alignment can be performed using sensor data, but the reliability of motion information varies due to factors like camera shake and repetitive patterns, leading to degraded alignment accuracy
Solution Approach 1:
The patent combines motion information from gyro sensors with motion vectors obtained from image comparison to perform alignment. By merging these two sources of motion data, the system leverages the advantages of both sensor-based and image-based methods while compensating for their individual weaknesses, thereby improving overall alignment reliability
Solution Approach 2:
The patent dynamically changes the parameters used for alignment based on the reliability of motion information. When motion information reliability is high, the system prioritizes sensor data; when reliability is low, it transitions to relying more on motion vectors from image comparison, thus adapting to varying conditions
2Productivity
If motion vector is selected based on motion information from sensor, then alignment can be performed efficiently, but the reliability of motion vector may vary and wrong motion vector may be selected, degrading alignment accuracy
Solution Approach 1:
The patent implements a feedback mechanism where the reliability of motion information is continuously evaluated. Based on this reliability assessment, the system adjusts the selection and weighting of motion vectors in subsequent alignment operations, creating a closed-loop control system that improves both efficiency and accuracy
3Device complexity
If single source of motion information is used for alignment, then processing is simple, but alignment accuracy is degraded due to unreliability of motion information
Solution Approach 1:
The patent creates a composite alignment approach by combining motion information from gyro sensors with motion vectors from image comparison. This composite method integrates multiple data sources with different characteristics, producing a more reliable alignment result than any single source could achieve alone
Data Source
AI summary
An image processing apparatus performs a first detection that detects motion information of an image sensor during a period in which the image sensor captures a first image and a second image based on an output of a sensor different from the image sensor, a second detection that detects a plurality of motion vectors between the first image and the second image, a determination of first reliability of the motion information detected by the first detection and second reliability of the motion vectors detected by the second detection, and an alignment based on either one of the motion vectors or a vector indicated by the motion information, which has higher reliability, or a vector obtained from the motion vectors and the motion information according to the reliability.