AR Object Texturing via Fragment Alignment and Coordinate Transformation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for displaying augmented reality objects struggle to effectively render wide-screen real objects that do not fit entirely within the camera's field of view, leading to technical issues with fragmenting and texturizing partial images.
Innovation Solution
The method involves receiving and combining separate fragments of the real object's image, forming a two-dimensional representation, and using a coordinate transformation matrix to color and texture the 3D model, with options for texturizing individual elements or the entire model, and employing Tile/Offset parameters to smooth transitions between fragments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If the known method is used to display augmented reality objects, then small objects that fit completely in the eyeshot can be displayed, but wide-screen real objects that do not fit entirely in the eyeshot cannot be displayed
Solution Approach 1:
The patent divides the wide-screen real object into multiple separate fragments or sections that can be individually captured within the camera's field of view. Each fragment is then processed separately through texturizing and coordinate transformation, allowing the system to handle objects larger than the camera's immediate view by working with manageable segments that are subsequently assembled into a complete augmented reality representation
Solution Approach 2:
The patent transitions from working with a single two-dimensional image to creating a three-dimensional model of the wide-screen object. By building a 3D model from multiple 2D fragments and applying texturizing in three-dimensional space, the system can represent objects that exceed the camera's field of view, utilizing the third dimension to accommodate the full extent of wide-screen objects
2Area of stationary object
If separate fragments of wide-screen objects are processed, then the objects can be displayed, but smooth transitions between fragments are difficult to achieve
Solution Approach 1:
The patent merges multiple separate image fragments into a unified coordinate system through coordinate transformation matrices. By transforming each fragment's coordinates to align with a common reference frame and seamlessly blending the texturized 3D model across fragment boundaries, the system achieves smooth transitions between previously separate sections, creating a continuous and coherent augmented reality display of the entire wide-screen object
3Area of stationary object
If the camera field of view is increased to capture wide-screen objects, then more of the object is visible, but the processing complexity and data volume increase
Solution Approach 1:
Rather than attempting to capture the entire wide-screen object in a single high-resolution image that would require extensive processing, the patent segments the object into multiple smaller fragments captured within the normal camera field of view. This segmentation reduces the processing complexity for each individual image while still enabling comprehensive coverage of the entire object through systematic assembly of the fragments
Solution Approach 2:
The patent performs preliminary coordinate transformation and establishes a unified coordinate system before final assembly of the fragments. By pre-processing each fragment to transform its coordinates and prepare it for integration, the system simplifies the subsequent merging process, reducing overall processing complexity compared to attempting to handle a single large-scale image
Data Source
AI summary
The invention relates to computer data processing, and more particularly to methods of displaying an augmented reality object based on an original image, which involves generating a 3D model of an augmented reality object; obtaining a plurality of individual fragments of an image of a real-world object, where each fragment is a partial photographic image of the real-world object, obtained using a camera; generating a two-dimensional image of the real-world object by aligning the obtained image fragments; generating a transformation matrix for transforming the coordinates of the two-dimensional image of the real-world object into intrinsic coordinates corresponding to coordinates of the 3D model; and, using the coordinate transformation matrix, coloring elements of the 3D model of the augmented reality object in accordance with the colors of the corresponding elements of the real-world object, where coloring is carried out by texturing areas of the 3D model of the augmented reality object.