Augmenting Images with Real Pixel Data via 3D Model Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image augmentation methods create virtual images that lack the realism of real image data, as they rely on constructed models rather than actual image data.
Innovation Solution
A computer-implemented method that augments a first image with real image data from a second image by identifying an object in the second image, aligning a 3D model with the object, extracting pixel data from the second image, and inserting it into the first image, thereby creating a more realistic augmented image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a 3D model is used to augment an image, then the ease of manipulation and visualization is improved, but the realism of the augmented image deteriorates
Solution Approach 1:
The patent extracts actual pixel data from a reference image of the object and copies it directly into the augmented image, rather than rendering a synthetic 3D model. This copying approach preserves the authentic visual characteristics of the object while still allowing for positional manipulation, thus resolving the contradiction between ease of operation and realism.
Solution Approach 2:
The patent segments the object from its background in the reference image by identifying and extracting only the pixel data corresponding to the object boundaries. This segmentation enables the object to be isolated and inserted into the target image while maintaining its original visual appearance, thereby preserving realism while enabling manipulation.
2Measurement precision
If image data is extracted using a 3D model projection, then the precision of object extraction is improved, but the complexity of the processing increases
Solution Approach 1:
The patent introduces a 3D model as an intermediary tool to facilitate accurate object extraction. The 3D model serves as a mediator that helps identify object boundaries and extract precise pixel data without requiring complex segmentation algorithms, thus improving extraction precision while managing processing complexity through the use of this intermediate representation.
Data Source
AI summary
A computer implemented method for augmenting a first image with image data from a second image, the method comprising: receiving (S02) the first image depicting a first scene; capturing (S04) the second image depicting a second scene using an image capturing device; identifying (S06) an object in the second image; receiving (S08) a 3D model from a database, the database comprising a plurality of 3D models, the 3D model corresponding to the identified object of the second image; aligning (S10) the 3D model with the identified object in the second image; extracting (S12) pixel data from the second image using a contour of the 3D model's projection onto the second image; inserting (S14) the extracted pixel data of the second image data into the first image, thereby rendering an augmented image.