Augmented Reality Overlay Using 3D Feature Data Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems are complex and expensive, requiring 3D cameras, complex 3D models, and advanced processing techniques, making them inaccessible for simplified applications using general cameras and devices.
Innovation Solution
A computer-implemented method and system that uses general cameras and devices to overlay virtual objects onto images of customer environments, without requiring 3D model creation or intensive processing, by determining 3D feature data and using positioning signals to position virtual objects appropriately.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional augmented reality systems use 3D cameras and complex 3D models with advanced processing techniques, then the quality and realism of virtual object display is improved, but the device complexity and cost increase significantly
Solution Approach 1:
The patent uses 2D images as simplified copies of 3D environments instead of requiring actual 3D models. The virtual objects are overlaid on 2D images captured by standard cameras, eliminating the need for complex 3D scanning and modeling equipment while maintaining the ability to display virtual objects in context.
Solution Approach 2:
The system replaces expensive, specialized AR equipment with inexpensive, readily available devices like smartphones and standard cameras. The solution uses software-based processing on consumer devices rather than requiring costly hardware infrastructure, making AR accessible to general users.
2Measurement precision
If traditional augmented reality systems use advanced processing techniques and 3D model generation, then the accuracy of virtual object positioning is improved, but the computational processing requirements increase
Solution Approach 1:
The patent extracts only the essential 3D feature data needed for positioning from images, rather than generating complete 3D models. By taking out only the necessary depth and spatial information required for virtual object placement, the system achieves accurate positioning without the computational burden of full 3D reconstruction.
Solution Approach 2:
The system performs partial 3D analysis by extracting only the depth information and spatial relationships necessary for virtual object overlay, rather than performing complete 3D model generation. This partial action provides sufficient positioning accuracy for e-commerce applications without requiring exhaustive processing.
3Ease of operation
If simplified augmented reality systems use general cameras and devices without 3D model creation, then the ease of operation and accessibility is improved, but the manufacturing precision of virtual object placement may deteriorate
Solution Approach 1:
The patent introduces 3D feature data as an intermediary between the simple 2D image capture and the virtual object placement. This intermediary layer provides the depth and spatial context needed for precise positioning, bridging the gap between simplified input and accurate output without requiring complex 3D modeling from users.
4Adaptability or versatility
If traditional augmented reality systems require specialized equipment like headsets and 3D cameras, then the immersive experience is improved, but the ease of manufacture and deployment deteriorates
Solution Approach 1:
The patent makes the AR system universal by using standard cameras and smartphones that most consumers already possess. The same device can capture images, process 3D feature data, and display virtual objects, eliminating the need for specialized equipment while maintaining functionality for e-commerce applications.
Data Source
AI summary
Disclosed are systems and methods for augmenting a customer image with at least one virtual object. One or more customer images depicting a customer environment are received from a customer computing device and 3D feature data for the customer images is determined. A virtual object is determined which corresponds to a desired merchant item. A positioning signal is received which corresponds to a desired location of virtual object in the customer environment, and a corresponding first location in each customer image at which to overlay the virtual object using the positioning signal is determined. An appropriate size and orientation of the virtual object is determined for each customer image based on corresponding 3D feature data, causing an overlay of an appropriately sized and oriented virtual object at the corresponding first location in customer images.