Flexible-Surface AR Content From Distorted 3D Models
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) systems struggle to alter the appearance of real-world items with flexible surfaces, such as garments, as they change shape over time, due to the challenge of conforming AR content to the item's dynamic form.
Innovation Solution
A system determines the shape of a real-world item with flexible surfaces, distorts a 3D model to match the item's shape, and generates AR content based on the distorted model, which is then overlaid on the item's image to alter its appearance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If a static 3D model is used for AR content generation, then the model structure remains simple and easy to process, but the AR content cannot accurately conform to the dynamic shape changes of flexible real-world items
Solution Approach 1:
The patent applies the dynamics principle by transforming the static 3D model into a dynamic one that can adapt to shape changes. The system captures images of the real-world item at different time points, extracts shape information, and dynamically updates the 3D model to match the item's current shape. This allows the AR content to accurately conform to the flexible item's shape changes while maintaining a manageable processing complexity through automated image-based shape extraction.
2Manufacturing precision
If the AR content is updated in real-time to match shape changes, then the accuracy of appearance alteration is improved, but the processing time and computational resources increase
Solution Approach 1:
The patent applies preliminary action by pre-processing and storing shape information from multiple images captured at different time points. The system extracts shape data in advance and prepares the 3D model updates before they are needed for AR display. This allows the system to quickly retrieve and apply pre-computed shape information during real-time AR rendering, reducing the processing time required during actual use while maintaining high accuracy in appearance alteration.
3Loss of information
If multiple images are processed to capture shape changes, then the completeness of shape information is improved, but the data processing complexity and storage requirements increase
Solution Approach 1:
The patent applies the extraction principle by isolating and extracting only the essential shape information from the captured images. Rather than processing and storing all image data, the system extracts key shape parameters and geometric features that represent the item's form at different time points. This selective extraction reduces the volume of data that needs to be processed and stored while maintaining the completeness of shape information needed for accurate AR content generation.
Data Source
AI summary
Systems and methods for generating AR content to virtually alter a real-world item are provided. The real-world item may be a deformable item including one or more flexible surfaces. According to an embodiment, a method includes determining the relative positions of a plurality of points on the real-world item. Based on the relative positions of the plurality of points, a 3D model of a virtual item is distorted to produce a distorted 3D model of the virtual item. The distorted 3D model may have substantially the same shape as the real-world item. AR content is then generated based on the distorted three-dimensional model.