Mobile AR Content Mapping via 3D Feature Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality environments on mobile devices lack the ability to effectively deploy and manage media content in a user-defined manner, limiting the interaction and accessibility of graphical content within real-world environments.
Innovation Solution
The implementation of augmented reality authoring tools on mobile devices allows users to extract three-dimensional features of real-world objects, define presentation and activation regions, and deploy media content such as images, videos, and audio within these environments, enabling users to create and share augmented reality experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If augmented reality environments are implemented on mobile devices, then users can access and interact with graphical content in real-world environments, but the ability to effectively deploy and manage media content in a user-defined manner is limited
Solution Approach 1:
The content management system is segmented into separate functional modules: feature extraction module, presentation region definition module, activation region definition module, and media content deployment module. This allows users to define and manage different aspects of AR content independently, improving adaptability while keeping each module's complexity manageable.
Solution Approach 2:
The system performs preliminary actions by extracting three-dimensional features of real-world objects and defining presentation and activation regions before deploying media content. This pre-processing enables users to organize and manage content deployment in a structured manner, enhancing user-defined control without proportionally increasing system complexity.
2Ease of operation
If presentation regions and activation regions are defined for media content, then user interaction with graphical content is enhanced, but the system requires more complex processing and management capabilities
Solution Approach 1:
The system applies local quality by defining specific presentation regions and activation regions for different media content items based on their spatial relationship with extracted three-dimensional features. Each region is customized for its specific function and content type, enhancing user interaction while maintaining manageable system complexity through localized rather than global processing.
Solution Approach 2:
The system introduces an intermediary layer of region definitions that mediates between the extracted three-dimensional features and the media content. Presentation regions and activation regions serve as intermediate structures that simplify user interaction while managing the complexity of content deployment and spatial mapping.
3Loss of information
If three-dimensional features of real-world objects are extracted and media content is attached, then the augmented reality experience becomes more rich and personalized, but the processing requirements and system resource consumption increase
Solution Approach 1:
The system extracts only the essential three-dimensional features of real-world objects that are necessary for AR content deployment, rather than processing complete object models. This selective extraction maintains information layer completeness by capturing key spatial characteristics while reducing processing requirements and energy consumption on mobile devices.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Methods, apparatuses, and systems are provided to facilitate the deployment of media content within an augmented reality environment. In at least one implementation, a method is provided that includes extracting a three-dimensional feature of a real-world object captured in a camera view of a mobile device, and attaching a presentation region for a media content item to at least a portion of the three-dimensional feature responsive to a user input received at the mobile device.