AR Content Integration via 3D Model Pre-processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality (AR) systems face challenges in delivering realistic interactions between AR content and real-world objects in live camera streams, particularly due to complex and processor-intensive operations, and the need for marker-based tracking, which can be unreliable and require significant data storage.
Innovation Solution
The system enables the delivery of augmented reality content in a camera video stream by using a mobile device to detect markers, establish a coordinate system, and integrate pre-recorded video content with AR content, allowing for automated image processing and realistic presentation of multimedia content, including 3D AR, through rules-based processing and occlusion algorithms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If marker-based tracking is used for AR content delivery, then AR features can be attached to physical objects, but the system becomes unreliable and requires significant data storage
Solution Approach 1:
The patent extracts the tracking functionality from marker-based systems to model-based systems. Instead of requiring markers to be attached to objects, the system uses pre-existing 3D models of objects for tracking, removing the unnecessary marker component while maintaining tracking capability
Solution Approach 2:
The system performs preliminary actions by pre-capturing images of objects from multiple angles and pre-processing them into 3D models before actual AR delivery. This preparation work is done in advance, so that during actual AR operations, the system can directly use these pre-prepared models for reliable tracking without needing markers
2Manufacturing precision
If 3D AR content is presented in live video stream, then realistic AR interactions can be achieved, but the system becomes very data and computation intensive
Solution Approach 1:
The system performs preliminary image processing to create 3D models from captured images before actual AR delivery. This pre-processing includes capturing images from multiple angles, processing them into 3D models, and storing them for later use. During actual AR operations, the pre-prepared 3D models are directly utilized, significantly reducing real-time computation requirements while maintaining high presentation realism
Solution Approach 2:
The system creates 3D model copies of physical objects that can be used repeatedly for AR content delivery. Instead of processing images in real-time during each AR session, the system uses pre-generated 3D model copies that accurately represent the physical objects, reducing computation intensity while preserving realism
3Ease of operation
If marker-based AR systems are implemented, then AR content can be recognized and launched, but the physical object must be in possession of the first user and then provided to the second user
Solution Approach 1:
The system uses digital 3D model copies of physical objects for AR content delivery instead of requiring physical object transfer. The 3D models can be digitally transmitted instantly, eliminating the need for physical possession and transfer of objects between users, thus reducing time loss while maintaining ease of operation
Solution Approach 2:
The patent extracts the essential tracking features from physical objects to create digital 3D models. This separation allows the AR content to be delivered digitally through the 3D models without requiring the physical object itself to be transferred, removing the time-consuming physical transfer step while preserving the AR interaction capability
Data Source
AI summary
The present disclosure relates to methods, devices, and systems for presentation of multimedia content. In an aspect of the present disclosure, a method includes receiving, at a processor of a mobile device, a plurality of images from a camera, at least one image of the plurality of images including an object. The method also includes displaying a camera video stream based on the plurality of images, displaying three dimensional (3D) augmented reality content in the camera video content, and displaying video content based on the 3D augmented reality content. The video content is associated with the object.