3D Model Creation Using Smartphone Lidar and Panoramic Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for creating three-dimensional models of physical spaces are expensive, time-consuming, and require specialized scanning hardware, often resulting in data gaps and inconsistencies that affect the accuracy of the model and subsequent design or construction costs.

Innovation Solution

A two-step process using a three-dimensional scan and panoramic image collection, leveraging lidar depth data and RGB sensor data, to generate a refined three-dimensional model of a space without the need for specialized scanning hardware, allowing for accurate surface reconstruction and seamless transitions between views.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If specialized scanning hardware is used to create three-dimensional models, then measurement precision and manufacturing precision are improved, but device complexity and cost increase

Engineering Contradiction:
Improveaccuracy of three-dimensional modelVSAvoidspecialized scanning hardware
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses a smartphone camera to capture multiple two-dimensional images of the physical space, which are then processed to generate a three-dimensional model. This copies the function of expensive specialized scanning hardware using a common mobile device, achieving comparable measurement precision through computational methods rather than specialized optics

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical specialized scanning hardware with a software-based processing system that analyzes smartphone camera images. The mechanical scanning process is substituted with computational algorithms that reconstruct three-dimensional geometry from two-dimensional photographs, eliminating the need for expensive hardware while maintaining accuracy

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If specialized scanning hardware is used to create three-dimensional models, then manufacturing precision is improved, but cost increases

Engineering Contradiction:
Improveaccuracy of three-dimensional modelVSAvoidcost of creating three-dimensional model
Core Design Contradiction:
Manufacturing precisionVSEase of manufacture

Solution Approach 1:

The patent copies the functionality of expensive specialized scanning equipment using a smartphone, which is a low-cost device already owned by most users. This eliminates the need to purchase or rent specialized hardware while maintaining the ability to create accurate three-dimensional models for design and construction purposes

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent uses inexpensive smartphone cameras instead of expensive specialized scanning hardware. The smartphone, being a consumer device with low cost and high availability, replaces the need for expensive equipment, making three-dimensional modeling accessible to individuals and small businesses without significant financial investment

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

3Manufacturing precision

If traditional three-dimensional modeling methods are used, then manufacturing precision is improved, but loss of time increases

Engineering Contradiction:
Improveaccuracy of three-dimensional modelVSAvoidtime to create three-dimensional model
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary actions by capturing multiple images of the physical space using the smartphone camera before processing begins. These pre-captured images serve as the foundation for rapid three-dimensional reconstruction, eliminating the need for time-consuming manual measurement and modeling processes while maintaining precision through automated algorithms

Inventive Principle:
Principle #10Preliminary action

4Measurement precision

If comprehensive data capture is performed to ensure accuracy, then measurement precision is improved, but loss of time increases

Engineering Contradiction:
Improvecompleteness of spatial dataVSAvoidtime to capture comprehensive data
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent employs continuous image capture as the user moves through the space, with the smartphone camera continuously recording images that are automatically processed to build the three-dimensional model. This continuous action ensures comprehensive data capture of the entire space without requiring separate systematic measurements, maintaining both completeness and efficiency

Inventive Principle:
Principle #20Continuity of useful action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables quick and accurate creation of three-dimensional models using handheld devices like smartphones, reducing costs and time while ensuring comprehensive data capture, facilitating precise visualization and measurement for design and construction purposes.

Implementation Method 1

scanning the physical space using a lidar sensor, or other appropriately desired sensor, to collect lidar depth data

Methodology Applied
Scientific EffectLIDAR: LIDAR

Implementation Method 2

acquiring an image of the physical space, where the image includes a panoramic image of the physical space

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS20230206549A1System and method of creating three-dimensional virtual models with a mobile device
Publication Date: 2023.06.29 PRESTON JORDAN
  • US20230206549A1 patent drawing
  • US20230206549A1 patent drawing
  • US20230206549A1 patent drawing

AI summary

A method of creating a three-dimensional model of a physical space includes at a capturing device, scanning the physical space to acquire a three-dimensional scan of the physical space. Embodiments may also include acquiring a panoramic image of the physical space, where the panoramic image includes a complete panoramic image or first person view of the physical space. Embodiments may also include processing the three-dimensional scan of the physical space to generate a three-dimensional surface reconstruction of the physical space. Embodiments may also include mapping the complete panoramic image or first person view onto the three-dimensional surface reconstruction of the physical space to create the three-dimensional model of the physical space.