3D Interior Modeling from Photos Using User Constraints

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current three-dimensional modeling tools face challenges in efficiently creating accurate models from photographic images, particularly due to inaccurate camera parameters and high computational requirements, which slow response times and reduce model accuracy.

Innovation Solution

The method involves locking inaccurate camera and geometric parameters, allowing users to input constraints that simplify the photogrammetry process, reducing computational demands, and enabling intuitive interface for texture mapping, while leveraging the accuracy of user-defined geometry and camera positions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If photogrammetry algorithms are used to create three-dimensional models from photographic images, then model accuracy can be improved, but computational requirements and processing time increase significantly

Engineering Contradiction:
Improvemodel accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system segments the modeling process into distinct phases: initial rapid model generation using simplified algorithms, followed by optional refinement steps. This allows users to obtain quick results when speed is prioritized, while still enabling accurate photogrammetry processing when time permits.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements partial photogrammetry processing by applying full photogrammetry algorithms only to critical regions or selected images, rather than processing all images with maximum computational intensity. This reduces overall processing time while maintaining adequate model accuracy for most applications.

Inventive Principle:
Principle #16Partial or excessive action

2Measurement precision

If full photogrammetry processing is applied to all images, then model accuracy improves, but computational resources and complexity increase

Engineering Contradiction:
Improvecamera parameter accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system applies different processing qualities to different regions or sets of images based on their importance. Critical images that significantly impact model accuracy undergo full photogrammetry processing, while less critical images use simplified processing methods, optimizing the balance between accuracy and computational complexity.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system dynamically adjusts photogrammetry processing parameters such as resolution, iteration count, and algorithm complexity based on image characteristics, scene requirements, and available computational resources. This allows the system to maintain adequate accuracy while reducing computational complexity when resources are constrained.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If user constraints are required for accurate modeling, then model accuracy improves, but ease of operation decreases

Engineering Contradiction:
Improveconstraint accuracyVSAvoiduser interface complexity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system automatically detects and applies constraints from the photographic images themselves, such as vanishing points, horizon lines, and geometric features, without requiring manual user input. This self-constraint capability provides accurate modeling while maintaining ease of operation for users who prefer automated workflows.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system provides real-time feedback to users about the quality and accuracy of automatically detected constraints, allowing users to review and adjust constraints as needed. This feedback mechanism helps users understand the system's interpretations and make informed decisions about constraint application, balancing automation with user control.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS8818768B1Modeling three-dimensional interiors from photographic images, and applications thereof
Publication Date: 2014.08.26 GOOGLE LLC
  • US8818768B1 patent drawing
  • US8818768B1 patent drawing
  • US8818768B1 patent drawing

AI summary

Embodiments relate to modeling three-dimensional interiors from photographic images. In a first embodiment, a computer-implemented method creates a three-dimensional model of an interior of a building from a photographic image. Input data is received from a user specifying a floor plan of the interior of the building. A first constraint input by a user indicating that a position on the floor plan corresponds to a position on the three-dimensional model is received. A second constraint input by a user indicating that a position on a photographic image of the interior corresponds to a position on the three-dimensional model is received. Finally, the three-dimensional model and camera parameters representing a camera that took the photographic image of the interior are altered based on the first and second constraints.