3D Room Model Generation via Photogrammetry Paths

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The generation of virtual, mixed, and augmented reality environments that simulate real-world settings is time-consuming and costly, often requiring specialized training and skills, and often results in environments that lack connection to actual environments.

Innovation Solution

A system and method for generating three-dimensional models of rooms or spaces using photogrammetry, machine learning, and augmented reality guidance, allowing users to capture images and measurements with a mobile device, processing them to create accurate and detailed virtual representations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If traditional methods are used to generate virtual reality environments, then the environments can be highly detailed and realistic, but the process is time-consuming and costly

Engineering Contradiction:
Improveenvironmental realismVSAvoidgeneration time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent uses photogrammetry to create 3D models by capturing multiple 2D images from different viewpoints and processing them to generate accurate three-dimensional representations of real-world environments. This copying process allows high-fidelity reproduction of real spaces without requiring manual creation, significantly reducing generation time while maintaining environmental realism

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces manual measurement and modeling processes with automated computer vision and photogrammetry algorithms. The system automatically processes captured images to generate 3D models, eliminating the need for manual surveying and modeling operations, thereby reducing both time and cost while maintaining precision

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If specialized training and skills are required for VR environment generation, then the output quality can be high, but the accessibility and ease of use are reduced

Engineering Contradiction:
Improvemodel accuracyVSAvoiduser accessibility
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The patent enables users to independently capture their own environments using a mobile device and automatically generates the 3D models through automated photogrammetry processing. The system performs self-service by automatically processing captured images, generating 3D models, and creating navigation paths without requiring user expertise in photogrammetry or 3D modeling, thus maintaining accuracy while dramatically improving accessibility

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent introduces an automated processing system as an intermediary between the user and the complex photogrammetry algorithms. The mobile application serves as this intermediary, handling the complex image processing and 3D model generation automatically, so users only need to perform simple image capture operations without needing specialized training

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If manual measurement and modeling are performed, then detailed and accurate 3D models can be created, but the process is complex and time-consuming

Engineering Contradiction:
Improvedimensional accuracyVSAvoidprocess complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces manual measurement processes with automated photogrammetry and computer vision algorithms. The system automatically calculates dimensions, generates 3D models, and creates navigation paths based on processed images, eliminating complex manual measurement procedures while maintaining or improving dimensional accuracy through computational geometry

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Productivity

If photogrammetry and automated processing are used, then the generation time is reduced, but the complexity of the processing system increases

Engineering Contradiction:
Improvegeneration speedVSAvoidprocessing system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent uses a mobile device application as an intermediary that handles the complex photogrammetry processing. The complexity is encapsulated within the automated processing pipeline, allowing users to benefit from high productivity without needing to understand or manage the underlying computational complexity. The system automatically processes images and generates 3D models through integrated algorithms

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables quick and efficient creation of realistic virtual reality, mixed reality, and augmented reality environments with reduced time, cost, and specialized training, allowing users to easily navigate and interact with the models for improved decision-making and design.

Implementation Method 1

capturing images of a room or space using an imaging sensor

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

processing the captured images using a photogrammetry processor to create a three-dimensional photogrammetric mesh

Methodology Applied
Scientific EffectPhotogrammetry: Photogrammetry

Data Source

PatentUS11024079B1Three-dimensional room model generation using panorama paths and photogrammetry
Publication Date: 2021.06.01 AMAZON TECH INC
  • US11024079B1 patent drawing
  • US11024079B1 patent drawing
  • US11024079B1 patent drawing

AI summary

Systems and methods related to an image capture process using panorama paths may include traversing a user device among a plurality of image capture locations of a room, sweeping the user device at each of the image capture locations, capturing imaging data using the user device during the traversal and/or during the sweep, and processing the imaging data using photogrammetry. The imaging data may be captured using an imaging sensor associated with the user device, and the imaging data may be processed based on data received from position and orientation sensors associated with the user device. In addition, a three-dimensional model of the room may be generated based on the imaging data.