3D Mosaic Image Construction via Global Motion Vectors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing digital image stitching technologies primarily expand images only in the horizontal direction, limiting the creation of panoramic images and failing to efficiently stitch images in both dimensions, which restricts the generation of three-dimensional mosaic images, especially in real-time applications like mobile devices.
Innovation Solution
The method employs a global motion vector definition approach that calculates relative locations between images using differently scaled maps, allowing for the creation of three-dimensional panoramic images by determining global motion vectors between consecutive frames and combining them into a mosaic image, enabling expansion in both dimensions and real-time processing on mobile devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Length of moving object
If images are stitched only in the horizontal direction using traditional panorama methods, then the horizontal view is widened, but the vertical dimension and three-dimensional mosaic image creation are limited
Solution Approach 1:
The patent extends traditional two-dimensional panoramic stitching (horizontal only) to three-dimensional mosaic image construction by incorporating vertical dimension stitching. The system captures images at multiple vertical positions and combines them with horizontal panoramic images to create volumetric 3D mosaic representations, enabling expansion in both horizontal and vertical dimensions.
2Productivity
If real-time panoramic image creation is implemented on mobile devices, then processing speed is improved, but computational complexity and memory requirements increase
Solution Approach 1:
The patent divides the complex task of real-time 3D mosaic image creation into manageable segments: individual image capture at multiple positions, separate motion vector calculation for each image pair, incremental mosaic construction, and progressive rendering. This segmentation enables real-time processing on mobile devices by breaking down the computationally intensive task into smaller, parallelizable operations.
Solution Approach 2:
The system performs preliminary actions by pre-calculating motion vectors between consecutive frames using efficiently scaled maps before full mosaic construction. Reference images are pre-selected and pre-processed to establish transformation matrices in advance, reducing computational load during real-time mosaic assembly and enabling faster processing on mobile devices.
3Measurement precision
If global motion vectors are calculated using differently scaled maps, then relative location accuracy is improved, but processing efficiency may be affected
Solution Approach 1:
The patent changes the scaling parameter of reference maps to match the size of search areas dynamically. By adjusting the map scale parameter to be equal to the search area size, the system achieves accurate motion vector calculation without excessive processing. This parameter optimization maintains measurement precision while improving processing efficiency compared to using fixed-scale maps.
Data Source
AI summary
Digital mosaic image construction with an apparatus, method, computer program, and integrated circuit is disclosed. In the method, a first digital image and a second digital image are obtained, and a global motion vector is defined between the first digital image and the second digital image. Next, a mosaic image is combined from the first digital image and the second digital image utilizing the relative locations of the first and second digital images with each other as expressed by the global motion vector.