AR Content Placement Using Visual Feature Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality (AR) systems face challenges in delivering 3D AR content in live video streams due to data and computation intensity, and marker-based tracking requires extensive data storage and unreliable marker-less tracking, limiting their efficiency and usability.
Innovation Solution
A system and method for providing augmented reality content in a camera video stream, where a mobile device captures and modifies the stream with pre-recorded video content, using marker detection to establish a coordinate system for dynamic video content placement, allowing efficient interaction between AR and video content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If marker-based AR tracking is used to recognize markers in real-world environment, then AR content can be accurately localized and mapped, but the system requires extensive data storage for multiple markers and large amounts of AR content data for each marker
Solution Approach 1:
The patent extracts the tracking functionality from marker-based systems to object-based systems. Instead of requiring pre-programmed markers with extensive data, the system captures images of ordinary objects, extracts visual features from these images, and uses these features for tracking. This eliminates the need to store large amounts of marker data while maintaining tracking accuracy.
Solution Approach 2:
The patent creates visual feature representations (copies) of physical objects that can be used for tracking without requiring the original objects to have special markers. These visual features are extracted from regular images and serve as tracking identifiers, reducing the need for extensive marker data storage.
2Ease of operation
If marker-less tracking is used to present AR feature on physical object, then the system is easier to operate, but the tracking is often unreliable and disrupts presentation of AR feature
Solution Approach 1:
The patent performs preliminary actions by capturing images of physical objects and extracting visual features before AR content needs to be tracked. These pre-extracted visual features are stored and used as reliable tracking references, combining the ease of marker-less operation with the reliability of pre-prepared tracking data.
Solution Approach 2:
The system allows ordinary objects to serve themselves as tracking targets by using their own visual features extracted from images. No special markers need to be attached to objects, and the objects' inherent visual characteristics are used for reliable tracking, combining ease of use with reliability.
3Adaptability or versatility
If 3D AR content is presented in live video stream, then immersive AR experience is achieved, but the system becomes very data and computation intensive
Solution Approach 1:
The patent segments the AR system into distinct components: visual feature extraction from images, coordinate system establishment based on detected features, and selective rendering of AR content. This segmentation allows the system to process only necessary data for each function, reducing overall computational complexity while maintaining 3D AR immersion capability.
Data Source
AI summary
The present disclosure relates to methods, devices, and systems for presentation of multimedia content. In an aspect of the present disclosure, a method includes receiving, at a processor of a mobile device, a plurality of images from a camera, at least one image of the plurality of images including an object. The method also includes displaying a camera video stream based on the plurality of images, displaying three dimensional (3D) augmented reality content in the camera video content, and displaying video content based on the 3D augmented reality content. The video content is associated with the object.