Excavator Camera Rig SfM Photogrammetry for Subsurface Feature Location

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for accurately determining the locations of subsurface features in excavation work are often unreliable, expensive, and require specialized personnel, hindering efficient and safe excavation processes, especially in augmented reality applications.

Innovation Solution

A camera rig mounted on heavy construction equipment captures images of subsurface features and surrounding environmental elements, which are then processed using structure-from-motion photogrammetry to generate a 3D reality mesh, allowing for accurate location measurement and storage for use in augmented reality views.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If survey personnel are deployed to precisely determine subsurface feature locations, then measurement precision is improved, but device complexity and operational complexity increase due to requiring specialized personnel and equipment

Engineering Contradiction:
Improvelocation accuracyVSAvoidsurvey equipment complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical surveying equipment (total stations, GPS receivers, theodolites) with an uncrewed aerial vehicle equipped with optical sensors and photogrammetry software. This substitution eliminates the need for specialized survey personnel while maintaining high measurement precision through automated image capture and processing algorithms.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs self-surveying by automatically capturing images from multiple angles, processing them through structure-from-motion algorithms, and generating 3D models without human intervention. The uncrewed aerial vehicle autonomously navigates to capture positions, and the software automatically extracts feature locations, eliminating the need for specialized survey operators.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If comprehensive excavation surveys are conducted to map all subsurface features, then measurement precision is improved, but productivity decreases due to the massive amount of excavation required

Engineering Contradiction:
Improvefeature location accuracyVSAvoidexcavation efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent performs preliminary mapping by capturing images of subsurface features during routine maintenance or repair work before comprehensive excavation is needed. These preliminary surveys build a progressive database of feature locations that can be used for future excavation planning, reducing the need for massive re-excavation while maintaining accurate location data.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of requiring comprehensive excavation of entire streets to map all features, the system uses partial surveys during routine maintenance windows to progressively improve the accuracy of available location information. This partial action approach accumulates sufficient data for safe excavation planning without the excessive productivity loss of complete resurfacing.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If laser scanners are used to precisely determine subsurface feature locations during excavation, then measurement precision is improved, but device complexity and operational complexity increase due to requiring specialized personnel

Engineering Contradiction:
Improvelocation accuracyVSAvoidoperational simplicity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces complex laser scanning systems with simpler optical cameras mounted on uncrewed aerial vehicles. The camera-based photogrammetry system achieves comparable or superior precision through multi-angle imaging and 3D reconstruction algorithms, while being easier to operate and requiring no specialized training.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system creates accurate 3D digital copies of subsurface features through photogrammetry, allowing virtual measurement and analysis without physical contact or complex scanning equipment. These digital models can be repeatedly analyzed and shared without requiring the original scanning equipment or specialized operators.

Inventive Principle:
Principle #26Copying

4Ease of operation

If older maps and drawings are used to identify subsurface feature locations, then ease of operation is improved, but measurement precision deteriorates due to lack of detail and outdated information

Engineering Contradiction:
Improveplanning simplicityVSAvoidlocation accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent performs preliminary high-precision surveys to create updated digital maps and drawings that reflect current subsurface feature locations. These preliminary actions capture in-field changes and construction modifications, providing both ease of operation through digital formats and high measurement precision through accurate contemporary data.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system continuously updates location information by comparing new survey data with existing maps and drawings, identifying discrepancies and corrections. This feedback loop ensures that digital plans remain current and accurate, combining the simplicity of map-based planning with the precision of modern measurement technologies.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach provides accurate and cost-effective location data for subsurface features without the need for specialized personnel, enabling reliable augmented reality views and improving excavation workflow efficiency.

Implementation Method 1

A camera rig includes one or more cameras that capture a set of images of the subsurface features and elements of a surrounding physical environment. A structure-from-motion (SfM) photogrammetry application generates a three-dimensional (3D) reality mesh from the set of images.

Methodology Applied
Scientific EffectPhotogrammetry: Photogrammetry

Data Source

PatentUS10755484B1Estimating subsurface feature locations during excavation
Publication Date: 2020.08.25 BENTLEY SYSTEMS INC
  • US10755484B1 patent drawing
  • US10755484B1 patent drawing
  • US10755484B1 patent drawing

AI summary

In one embodiment, techniques are provided for capturing accurate information describing the location of subsurface features (e.g., subsurface utilities such as water pipes, sewer pipes, electrical conduits, etc.) usable in providing an augmented reality view. A set of images is captured with a camera rig coupled to a mobile portion (e.g., the boom) of a piece of heavy construction equipment (e.g., an excavator) being used by workers to conduct an excavation that exposes the subsurface features. The set of images is provided to a structure-from-motion (SfM) photogrammetry that generates a 3D reality mesh. Relative and/or absolute locations of the subsurface features are calculated based on the 3D reality mesh and provided to an augmented reality application executing on an augmented reality device for use in providing an augmented reality view.