Indoor Spatial Referencing Using Distance-Referenced Panoramas

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for spatially referencing images within indoor spaces are costly and labor-intensive, particularly due to the challenges of determining image locations without reliable GPS signals and the high expense of three-dimensional scanning systems.

Innovation Solution

A method and apparatus that utilize a distance-referencing camera system, which includes cameras, laser range finders, orientation sensors, and processors to capture and associate distance and orientation data with images, allowing for the determination of image locations within indoor spaces using relatively few and inexpensive measurements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If three-dimensional scanning systems are used to determine camera location, then location accuracy is improved, but equipment cost increases significantly

Engineering Contradiction:
Improvelocation accuracyVSAvoidequipment cost
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the essential measurement components needed for location determination, using simple distance measurements to selected features rather than comprehensive three-dimensional scanning. This selective approach achieves sufficient location accuracy without the high cost and complexity of full 3D scanning systems.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent employs inexpensive distance measurement tools and simple cameras instead of expensive three-dimensional scanning equipment. By using basic, readily available devices with sufficient measurement capability, the system achieves cost-effective spatial referencing without requiring sophisticated expensive hardware.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

2Device complexity

If manual measuring techniques are used to determine camera location, then equipment cost is reduced, but labor time and complexity increase

Engineering Contradiction:
Improveequipment costVSAvoidlabor time
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The system enables automated location determination by having the camera device itself perform distance measurements and calculate its position using onboard processors. This self-service approach eliminates the need for manual measurement and complex external processing, reducing both labor time and operational complexity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical measurement processes with automated electronic distance measurement and computational methods. The camera device automatically captures images, measures distances to features, and computes location through image processing algorithms, substituting manual labor with automated electronic systems.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If comprehensive three-dimensional scanning is performed to map all surfaces, then location determination accuracy is improved, but system complexity and cost increase

Engineering Contradiction:
Improvelocation determination accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the critical information needed for location determination by measuring distances to selected key features rather than scanning all surfaces. This selective data collection achieves sufficient accuracy for virtual touring applications while dramatically reducing system complexity and data processing requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system performs partial scanning by measuring distances to a subset of features that are sufficient for location determination, rather than conducting exhaustive three-dimensional scanning of all surfaces. This partial action approach provides adequate location accuracy without the complexity and resource requirements of complete surface mapping.

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the creation of spatially-referenced images with reduced costs and effort, allowing users to accurately navigate and view indoor spaces from different perspectives, improving the accuracy of layout and feature understanding.

Implementation Method 1

one or more laser range finders each coupled to a corresponding one of the cameras and each oriented approximately parallel to the optical axis of the corresponding one of the cameras

Methodology Applied
Scientific EffectLIDAR: LIDAR

Data Source

PatentUS10891512B2Apparatus and method for spatially referencing images
Publication Date: 2021.01.12 GOOGLE LLC
  • US10891512B2 patent drawing
  • US10891512B2 patent drawing
  • US10891512B2 patent drawing

AI summary

Provided is a method of spatially referencing a plurality of images captured from a plurality of different locations within an indoor space by determining the location from which the plurality of images was captured. The method may include obtaining a plurality of distance-referenced panoramas of an indoor space. The distance-referenced panoramas may each include a plurality of distance-referenced images each captured from one position in the indoor space and at a different azimuth from the other distance-referenced images, a plurality of distance measurements, and orientation indicators each indicative of the azimuth of the corresponding one of the distance-referenced images. The method may further include determining the location of each of the distance-referenced panoramas based on the plurality of distance measurements and the orientation indicators and associating in memory the determined locations with the plurality of distance-referenced images captured from the determined location.