3D Room Model Generation Using Ring Paths and Photogrammetry

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The generation of virtual, mixed, and augmented reality environments that simulate real-world settings is time-consuming and costly, often requiring specialized training and skills, and often results in environments that lack connection to actual environments.

Innovation Solution

A system and method for generating three-dimensional models of rooms or spaces using photogrammetry, machine learning, and augmented reality guidance, allowing users to capture images and measurements with a user device, such as a smartphone, to create accurate and realistic virtual environments with reduced time and expertise.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If traditional methods are used to generate virtual reality environments, then the environments can be simulated with high fidelity, but the process is time-consuming and costly requiring specialized training

Engineering Contradiction:
Improveenvironment simulation fidelityVSAvoidgeneration time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system enables ordinary users to autonomously capture 3D room models using their smartphones without requiring specialized training or equipment. The automated photogrammetry processing handles the complex computational tasks, allowing users to simply point the camera and walk through the space to generate accurate virtual models

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces traditional manual surveying and measurement methods with automated image-based photogrammetry. Instead of requiring physical measurement tools and skilled operators, the system uses smartphone cameras and computational algorithms to automatically extract geometric and textural information from multiple images

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If traditional methods are used to generate virtual reality environments, then high fidelity can be achieved, but specialized training and skills are required

Engineering Contradiction:
Improveenvironment simulation fidelityVSAvoiduser expertise requirement
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The system eliminates the need for specialized training by providing an automated, user-friendly interface where users simply need to point their smartphone at the environment and walk through it. The complex photogrammetry processing is handled automatically in the background, making 3D model generation accessible to anyone with a smartphone

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent introduces automated photogrammetry software as an intermediary between the simple smartphone camera and the complex task of generating accurate 3D models. This intermediary layer handles the computational complexity, translating simple user actions into accurate virtual environment generation

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If manual measurement and modeling methods are used, then accurate measurements can be obtained, but the process is time-consuming

Engineering Contradiction:
Improvespace measurement accuracyVSAvoidmodel generation speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent replaces manual measurement techniques with automated image-based photogrammetry. The system captures multiple images as users walk through the space, then automatically processes these images to extract precise geometric measurements and generate accurate 3D models without manual intervention

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system continuously captures images throughout the user's walkthrough of the space, automatically processing each image and accumulating measurement data in real-time. This continuous automated processing eliminates the need for stop-start manual measurements and significantly accelerates the overall modeling process

Inventive Principle:
Principle #20Continuity of useful action

4Productivity

If photogrammetry with ring paths is used, then image capture efficiency is improved, but the system complexity increases

Engineering Contradiction:
Improveimage capture efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system pre-calculates and presents the user with a guided ring path trajectory before image capture begins. This preliminary action guides the user through the optimal capture sequence, ensuring efficient and complete coverage of the 3D space without requiring complex real-time computational guidance during the actual capture process

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables quick and efficient definition of space boundaries and measurements, facilitating intuitive image capture and model generation, allowing users to easily navigate and interact with three-dimensional models for improved decision-making in virtual environments.

Implementation Method 1

an imaging sensor configured to capture images within a field of view of the imaging sensor

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

a photogrammetry processor configured to process the captured images to generate a three-dimensional photogrammetric mesh of the room or space

Methodology Applied
Scientific EffectPhotogrammetry: Photogrammetry

Data Source

PatentUS10937247B1Three-dimensional room model generation using ring paths and photogrammetry
Publication Date: 2021.03.02 AMAZON TECH INC
  • US10937247B1 patent drawing
  • US10937247B1 patent drawing
  • US10937247B1 patent drawing

AI summary

Systems and methods related to an image capture process using ring paths may include traversing a user device around a ring path in a center of a room, capturing imaging data using the user device during the traversal, and processing the imaging data using photogrammetry. The imaging data may be captured using an imaging sensor associated with the user device, and the imaging data may be processed based on data received from position and orientation sensors associated with the user device. In addition, a three-dimensional model of the room may be generated based on the imaging data.