Mobile Photo-Based 3D Modeling with Spatial Metadata
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current three-dimensional modeling technologies do not effectively utilize location and orientation data from mobile device cameras to integrate photographic images into 3D models, making the process of constructing and navigating image-based models inefficient and time-consuming.
Innovation Solution
A computer-implemented method that captures local photographic images with a mobile device, detects camera location and orientation, requests and receives overlapping images from remote cameras, applies photogrammetry algorithms using user constraints to alter the 3D model, and allows for iterative user input to refine the model, leveraging both local and additional image data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional photogrammetry algorithms are used without location and orientation data, then the basic 3D model can be created, but the integration of photographic images into the model is inefficient and time-consuming
Solution Approach 1:
The system performs preliminary actions by capturing location and orientation data at the moment each photograph is taken using the mobile device's GPS and orientation sensors. This data is stored and associated with each image beforehand, so that when photogrammetry processing occurs, the spatial context is already available, dramatically reducing processing time and improving efficiency.
Solution Approach 2:
The mobile device serves itself by using its own integrated camera, GPS receiver, and orientation sensors to automatically capture and associate spatial metadata with photographs. This self-service capability eliminates the need for external surveying equipment or manual coordinate input, making the 3D modeling process more efficient and faster.
2Adaptability or versatility
If multiple photographs from different sources are integrated into the 3D model, then the model becomes more accurate and versatile, but the complexity of integrating and aligning these images increases
Solution Approach 1:
The system achieves universality by creating a standardized data structure that can accommodate photographs from multiple sources (mobile device camera, remote cameras, satellite imagery) using the same location and orientation metadata format. This universal approach allows diverse image sources to be integrated into a single 3D model without requiring source-specific processing procedures, thereby increasing versatility while managing complexity.
Solution Approach 2:
Location and orientation data serve as an intermediary that mediates between diverse photograph sources and the 3D model construction process. This intermediary metadata layer provides a common language for aligning and integrating images from different cameras and sources, simplifying the integration process despite the increased versatility of accepting multiple image sources.
3Measurement precision
If location and orientation data are captured and processed, then the integration of images into 3D models is improved, but the processing requirements and computational load increase
Solution Approach 1:
The system applies partial action by selectively using location and orientation data only when and where needed in the photogrammetry process. Rather than processing all possible data equally, the system focuses computational resources on the critical spatial alignment operations, achieving high precision integration while minimizing unnecessary computational energy consumption.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Facilitates the efficient integration of camera-captured images into 3D models by using location and orientation data, reducing user effort and enabling the creation of accurate, versatile 3D models through the combination of local and remote photography.
Implementation Method 1
applying a photogrammetry algorithm to alter the three-dimensional model based, at least in part on, the first and second camera models and the one or more user constraints
Data Source
AI summary
A system that runs in web browsers of mobile devices that allows mobile users to take photos of building exteriors and interiors or other real world objects, upload photos, share photos with others, and use the photo images to model the 3D models with the system's image-based modeling interface.