Indoor 3D Modeling via Mobile Image Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for creating 3D models of indoor spaces are labor-intensive and require specialized equipment, making them inconvenient and inefficient for generating virtual interior designs.

Innovation Solution

A method using mobile devices to capture digital images and location data, processing them to generate a 3D model of indoor spaces without the need for manual measurements or specialized equipment, by following a capture protocol that includes guidance and quality checks to ensure accurate trajectory and alignment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If manual measurements and professional acquisition devices are used to create 3D CAD-quality models, then manufacturing precision and reliability are improved, but device complexity and ease of operation deteriorate

Engineering Contradiction:
Improve3D model accuracyVSAvoidequipment requirements
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent uses digital images captured by mobile devices to create a digital copy of the physical indoor space. Instead of directly measuring the space with professional equipment, the system captures multiple images from different positions and angles, then processes these images to reconstruct the 3D geometry, effectively copying the physical space into a digital representation.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces mechanical measurement systems (professional acquisition devices, manual measuring tools) with a computational imaging system. Mobile device cameras capture images, and computer vision algorithms process these images to extract geometric information, substituting mechanical measurement with optical capture and computational analysis.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If manual measurements are taken by trained personnel, then measurement precision is improved, but loss of time and productivity deteriorate

Engineering Contradiction:
Improvedimensional accuracyVSAvoidmeasurement time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system enables users to perform 3D scanning themselves using standard mobile devices without requiring trained measurement personnel. The automated image capture and processing system allows anyone to create accurate 3D models of indoor spaces, eliminating the need for specialized skills while maintaining measurement quality.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent changes the fundamental parameters of the measurement process by using digital image data instead of direct physical measurements. By capturing images at multiple positions and using computational methods to extract geometric parameters, the system achieves accurate dimensional information more quickly than traditional manual measurement methods.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If professional acquisition devices are used, then manufacturing precision is improved, but ease of operation and device complexity worsen

Engineering Contradiction:
Improvemodel qualityVSAvoiduser convenience
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The patent makes the 3D scanning capability universal by using standard mobile devices that most people already possess. Instead of requiring specialized professional equipment, the system works with common smartphones or tablets, making the technology accessible to a broad user base while maintaining the ability to produce high-quality 3D models.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system creates accurate digital copies of indoor spaces using images from consumer mobile devices. By processing multiple images taken with standard cameras, the system reconstructs 3D geometry that rivals professional scanning equipment, eliminating the need for specialized acquisition devices.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11688130B2Modeling indoor scenes using measurements captured using mobile devices
Publication Date: 2023.06.27 END TO END INC
  • US11688130B2 patent drawing
  • US11688130B2 patent drawing
  • US11688130B2 patent drawing

AI summary

In some embodiments, a method comprises receiving a plurality of digital images depicting an indoor scene of a room and captured using a capture device, and trajectory data of a trajectory that the capture device followed as the capture device was capturing the images; wherein the images and the trajectory data satisfy quality checks, including a closed loop check that requires that first images, of the plurality of digital images, and last images, of the plurality of digital images, overlap; determining a point cloud by preprocessing the digital images and the trajectory data to satisfy optimization constraints, and by identifying and labelling a plurality of feature points in data obtained by preprocessing the digital images and the trajectory data; based on the point cloud and the trajectory data, generating room geometry for the room and a 3D model of the room; and displaying a graphical representation of the 3D model.