Augmented Reality Scene Compositing via Embedded Image Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) systems require users to download AR content from local or remote databases, limiting usability and requiring skilled content creators for 3D model creation and maintenance, with users needing to actively retrieve content using markers or barcodes, restricting interaction and modification capabilities.
Innovation Solution
A method and system for embedding AR content within images, such as sketches, allowing extraction and modification without the need for external databases, using an extraction component to capture real-world images, geometrically reconstruct virtual models, and compose AR scenes in real-time, enabling users to interact with the content by hand-sketching on the image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If AR content is stored in external databases and downloaded on demand, then content can be retrieved and displayed, but users require active retrieval using markers or barcodes and cannot easily modify content
Solution Approach 1:
The patent merges the AR content directly into the image itself, combining the trigger image and the augmented reality data into a single integrated unit. This eliminates the need for separate databases and retrieval mechanisms, allowing users to interact with content by simply sketching on the embedded image without requiring external infrastructure.
Solution Approach 2:
The embedded AR image contains all necessary content within itself, making the system self-contained and self-sufficient. The image automatically provides both the trigger for AR activation and the actual content to be displayed, eliminating dependence on external databases, servers, or additional retrieval operations.
2Reliability
If 3D models are created and maintained by skilled content creators using dedicated software, then content quality is ensured, but the process becomes complex and requires specialized skills
Solution Approach 1:
The patent uses 2D sketches and drawings as simplified copies or representations of 3D objects. Instead of requiring users to create complex 3D models with specialized software, the system accepts simple 2D images that are then processed and rendered into 3D AR content automatically, dramatically simplifying the content creation process while maintaining visual quality.
Solution Approach 2:
The patent replaces the manual mechanical process of 3D model creation with automated image processing algorithms. The system automatically converts 2D sketches into 3D AR content using computational methods, eliminating the need for users to manually manipulate complex 3D modeling tools and specialized software.
3Adaptability or versatility
If AR content is distributed through centralized databases, then content updates are simple and centralized, but network connection is required and distribution becomes dependent on external infrastructure
Solution Approach 1:
The patent segments the AR content into individual embedded images that can be distributed independently. Each image contains its own AR data, allowing content to be distributed through multiple channels (print, digital, physical objects) without requiring a centralized database or network infrastructure, greatly increasing distribution flexibility.
Solution Approach 2:
The patent transitions from centralized digital distribution to a multi-dimensional distribution model where AR content can exist in both digital and physical forms simultaneously. By embedding AR data directly into images that can be printed or displayed anywhere, the system adds physical dimension to content distribution, eliminating dependency on network infrastructure.
Data Source
AI summary
Disclosed are systems and methods for compositing an augmented reality scene, the methods including the steps of extracting, by an extraction component into a memory of a data-processing machine, at least one object from a real-world image detected by a sensing device; geometrically reconstructing at least one virtual model from at least one object; and compositing AR content from at least one virtual model in order to augment the AR content on the real-world image, thereby creating AR scene. Preferably, the method further includes; extracting at least one annotation from the real-world image into the memory of the data-processing machine for modifying at least one virtual model according to at least one annotation. Preferably, the method further includes: interacting with AR scene by modifying AR content based on modification of at least one object and/or at least one annotation in the real-world image.