Computer Aided Inspection System Using SLAM and 3D Model Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Manual inspection of large structures such as railroad tracks, bridges, and buildings is slow, labor-intensive, and costly, leading to delays and potential errors that can be costly to rectify, necessitating the need for automated fine-level inspection and comparison to 3D models.

Innovation Solution

A computer-aided inspection system (CAIS) utilizing augmented reality and localization techniques, combining global localization with mm-level precise measurements, aligning user observations to 3D computer models, and generating compliance reports on discrepancies.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual inspection methods are used, then inspection can be performed with simple equipment, but inspection speed and productivity are very slow

Engineering Contradiction:
Improveinspection speedVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent replaces manual mechanical inspection methods with an automated system using sensors (laser scanners, cameras, RFID readers), processors, and software algorithms to detect, measure, and evaluate structural features automatically, thereby dramatically increasing inspection speed while accepting increased system complexity

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system creates digital 3D models and point cloud representations as copies of the physical structure, allowing automated comparison with design models and eliminating the need for manual measurement and documentation, thus improving productivity

Inventive Principle:
Principle #26Copying

2Measurement precision

If manual inspection is performed, then labor costs are high, but measurement precision can be maintained at acceptable levels

Engineering Contradiction:
Improvefine level measurement accuracyVSAvoidinspection efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent uses laser scanners and high-resolution cameras to automatically capture geometric data with millimeter or sub-millimeter precision, replacing manual measurement tools while simultaneously improving both measurement precision and inspection efficiency through automated data processing

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system introduces a computer processing system as an intermediary between the physical structure and the inspector, using sensor data, 3D modeling, and automated comparison algorithms to achieve high measurement precision without requiring manual measurement activities, thereby improving productivity

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If automated sensor packages are used, then inspection accuracy and model alignment are improved, but device complexity increases

Engineering Contradiction:
Improvefine level inspection accuracyVSAvoidsensor package complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple sensor types (laser range finders, cameras, GPS, RFID readers, accelerometers) into an integrated sensor package that simultaneously captures various types of data, reducing the number of separate devices needed while achieving high measurement precision through multi-sensor fusion

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The sensor package is designed to perform multiple functions (geometric measurement, localization, feature recognition, material identification) using a single integrated system, thereby improving measurement precision without proportionally increasing device complexity through functional consolidation

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Reliability

If comprehensive structure scanning is performed, then complete inspection coverage is achieved, but time and resources required increase

Engineering Contradiction:
Improveinspection completenessVSAvoidinspection duration
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent divides the inspection process into segments: coarse localization using GPS/compass, fine localization using visual features and SLAM, and targeted detailed scanning of specific regions of interest, allowing complete coverage while reducing total inspection time by focusing high-resolution scanning only where needed

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary coarse scanning and localization to identify regions of interest or potential issues before conducting detailed high-resolution scanning, thereby achieving complete inspection coverage while minimizing the time spent on comprehensive high-resolution scanning of entire structures

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11270426B2Computer aided inspection system and methods
Publication Date: 2022.03.08 SRI INTERNATIONAL
  • US11270426B2 patent drawing
  • US11270426B2 patent drawing
  • US11270426B2 patent drawing

AI summary

Computer aided inspection systems (CAIS) and method for inspection, error analysis and comparison of structures are presented herein. In some embodiments, a CAIS may include a SLAM system configured to determine real-world global localization information of a user in relation to a structure being inspected using information obtained from a first sensor package, a model alignment system configured to: use the determined global localization information to index into a corresponding location in a 3D computer model of the structure being inspected; and align observations and/or information obtained from the first sensor package to the local area of the model 3D computer model of the structure extracted; a second sensor package configured to obtain fine level measurements of the structure; and a model recognition system configured to compare the fine level measurements and information obtained about the structure from the second sensor package to the 3D computer model.