Image Registration Using Motion Sensor Orientation Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional digital imaging techniques struggle to capture high dynamic range images due to limited contrast range, requiring significant computational resources for software-based registration of images taken with different exposure settings.
Innovation Solution
Utilizing motion sensor data, specifically rotational orientation data from gyroscopes and accelerometers, to register standard dynamic range images, reducing computational resource usage and allowing for the creation of high dynamic range images by determining whether translational motion occurred during image capture.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If software visual feature mapping techniques are used to register images, then image registration accuracy is improved, but computational resource consumption increases
Solution Approach 1:
The patent segments the image registration process into two parts: (1) use motion sensor data to obtain initial registration parameters for rough alignment, and (2) use visual feature mapping only for fine-tuning if needed. This segmentation reduces the overall computational burden by handling the majority of registration through the simpler motion sensor-based approach.
Solution Approach 2:
The patent performs preliminary image registration using motion sensor data before applying visual feature mapping techniques. By pre-aligning images using the motion sensor information, the subsequent visual feature matching operates on nearly-aligned images, significantly reducing the search space and computational resources required.
2Use of energy by moving object
If motion sensor data is used for image registration, then computational resource usage is reduced, but registration accuracy may deteriorate when translational motion occurs
Solution Approach 1:
The patent introduces visual feature mapping as an intermediary step to correct errors in motion sensor-based registration. The workflow uses motion sensor data for initial registration, then applies visual feature matching to detect and correct any misalignments, particularly those caused by translational motion that motion sensors cannot accurately capture.
Solution Approach 2:
The patent replaces the purely mechanical/sensor-based registration system with a hybrid approach that incorporates computational visual feature analysis. This substitution allows the system to compensate for the limitations of motion sensors by using visual information to detect and correct registration errors.
3Reliability
If multiple exposure settings are used to capture HDR images, then dynamic range is improved, but image registration complexity increases
Solution Approach 1:
The patent segments the registration complexity by using motion sensor data to handle the bulk of alignment work, separating this from the more complex visual feature matching process. This allows HDR image registration to be achieved with reduced computational complexity while maintaining accuracy.
Solution Approach 2:
The patent performs preliminary registration using motion sensor data before applying complex visual feature matching algorithms. This pre-alignment reduces the complexity of subsequent processing by narrowing the search space for feature matching, making the overall HDR registration process more manageable.
Data Source
AI summary
Motion sensor data may be used to register a sequence of standard dynamic range images for producing a high dynamic range (HDR) image, reducing use of computational resources over software visual feature mapping techniques. A rotational motion sensor may produce information about orientation changes in the imaging device between images in the sequence of images sufficient to allow registration of the images, instead of using registration based on analysis of visual features of the images. If the imaging device has been moved laterally, then the motion sensor data may not be useful and visual feature mapping techniques may be employed to produce the HDR image.