Photogrammetry Algorithm for User Image 3D Modeling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing three-dimensional modeling tools face challenges in accurately creating models from user-supplied photographic images due to incomplete or inaccurate camera parameters, leading to computationally intensive optimization problems that slow response times, especially when processed within web browsers.

Innovation Solution

A method that uses a photogrammetry algorithm to derive three-dimensional models from user-supplied images by initially determining camera parameters through user input on a map, with default values for missing data, and then refining these parameters using user constraints, while locking parameters to simplify the optimization process and reduce processing requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If complete camera parameters are used for photogrammetry optimization, then model accuracy is improved, but computational intensity and processing time increase significantly

Engineering Contradiction:
Improvemodel accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by automatically determining initial camera parameters from metadata before the optimization process. These pre-computed parameters serve as starting points that reduce the computational burden during optimization, allowing the system to achieve accurate models without requiring complete manual parameter input from users.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts which camera parameters are optimized based on availability and reliability. When certain parameters are missing or inaccurate, the system modifies the optimization process to focus only on essential parameters, reducing computational intensity while maintaining sufficient model accuracy for the application.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If user input is required for complete camera parameters, then parameter accuracy is improved, but ease of operation deteriorates

Engineering Contradiction:
Improveparameter accuracyVSAvoiduser interaction complexity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system performs self-service by automatically extracting and determining camera parameters from image metadata without requiring user input. The photogrammetry algorithm processes the images independently, inferring camera positions and orientations from the data itself, thereby eliminating the need for users to manually provide parameter information while maintaining high accuracy.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system introduces an intermediary layer of automated parameter determination that sits between the user's simple image upload and the complex optimization process. This intermediary automatically handles the tedious parameter extraction and initial setup, presenting users with a simplified interface while maintaining the accuracy that would otherwise require extensive manual input.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If all camera parameters are optimized simultaneously, then model precision is improved, but device complexity and processing requirements increase

Engineering Contradiction:
Improvemodel precisionVSAvoidoptimization process complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The optimization process is segmented into manageable stages: first determining initial parameters from metadata, then progressively refining them through optimization. The system divides the complex parameter space into essential and optional parameters, optimizing only those necessary for the specific application while maintaining model precision, thereby reducing overall process complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies partial optimization by focusing computational resources on the most critical parameters rather than treating all parameters equally. When certain parameters are determined to be sufficient from initial data, the system stops optimizing those particular parameters, applying excessive action only where necessary to achieve the required precision level.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9626082B1Interface for applying a photogrammetry algorithm to user-supplied photographic images
Publication Date: 2017.04.18 GOOGLE LLC
  • US9626082B1 patent drawing
  • US9626082B1 patent drawing
  • US9626082B1 patent drawing

AI summary

Embodiments relate to selecting textures for a user-supplied photographic image in image-based three-dimensional modeling. In a first embodiment, a computer-implemented method includes a method for inputting a user-supplied photographic image that uses a photogrammetry algorithm to adjust a plurality of camera parameters for the user-supplied photographic image. In the method, a user-supplied photographic image inputted by a user is received. A set of geographic characteristics inputted by the user that correspond to a geographic location of a camera that took the user-supplied photographic image is received. A plurality of camera parameters that correspond to the geographic location of the camera that took the user-supplied photographic image is determined. The user-supplied photographic image to be texture mapped to the three-dimensional model is enabled.