LiDAR Trajectory Synchronization for Facility Inspection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing facility inspection methods face challenges in synchronizing point cloud data and image data, particularly in associating deterioration event coordinates with image data, leading to difficulties in accurately displaying and visualizing deterioration events in facilities like water conduits.

Innovation Solution

A facility inspection system that includes a trajectory display for showing the path of LiDAR data acquisition, a point cloud data display for user-designated coordinates, and a deterioration event display to show deterioration event coordinates, utilizing an inertial measurement unit (IMU) to synchronize point cloud and image data, ensuring accurate association and visualization of deterioration events.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If point cloud data and image data are displayed without synchronization, then the display system is simple, but the position accuracy and visibility of deterioration events deteriorate

Engineering Contradiction:
Improveposition accuracyVSAvoiddisplay system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces trajectory data as an intermediary element that links point cloud data and image data. The trajectory serves as a common reference framework that enables synchronization between the two data types without requiring complex direct coordination mechanisms. By using the trajectory as a mediator, the system achieves accurate position association while maintaining relatively simple data processing architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If deterioration event coordinates are not associated with image data, then the data processing is simple, but the visibility and identifiability of deterioration events deteriorate

Engineering Contradiction:
Improvevisibility of deterioration eventVSAvoiddata processing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent performs preliminary association between trajectory data, point cloud data, and image data before the actual inspection analysis. By pre-synchronizing these data types using the trajectory as a reference, the system ensures that deterioration events can be accurately identified and associated with their corresponding image data during the inspection process. This preliminary data preparation simplifies the subsequent analysis while improving visibility.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If LiDAR moves through the facility without recording trajectory, then the equipment is simple, but the ability to synchronize and locate deterioration events deteriorates

Engineering Contradiction:
Improvelocation accuracyVSAvoidequipment complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent makes the trajectory data serve multiple functions: it acts as a synchronization reference for point cloud and image data, provides location information for deterioration events, and enables temporal association between different data types. By utilizing the trajectory for these multiple purposes, the system achieves accurate location and synchronization without adding separate complex systems for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Improves the visibility and accuracy of deterioration event positions by synchronizing point cloud and image data, enabling effective display and identification of deterioration events within facilities.

Implementation Method 1

a LiDAR equipped with a device that detects three-dimensional inertial motion called an inertial measurement unit (IMU), and in this case, position information (trajectory data) at the time of point cloud data acquisition can be recorded in time series

Methodology Applied
Scientific EffectInertial measurement:

Implementation Method 2

a technique using a moving object such as a robot or a drone is known. In addition, a deterioration event inspection solution for detecting a crack or the like generated in a water conduit from point cloud data acquired by light detection and ranging (LiDAR) has also been studied

Methodology Applied
Scientific EffectLight detection and ranging (LiDAR): LIDAR

Data Source

PatentUS20240329222A1Facility inspection display device, information processing device, and non-transitory computer-readable medium
Publication Date: 2024.10.03 NEC CORP
  • US20240329222A1 patent drawing
  • US20240329222A1 patent drawing
  • US20240329222A1 patent drawing

AI summary

A facility inspection display device includes: a trajectory display unit that displays a trajectory of coordinates serving as a base point when point cloud data of a facility using LiDAR is acquired by moving the LiDAR in the facility; a point cloud data display unit that displays the point cloud data acquired with user-designated coordinates at a user-designated position on the trajectory designated by a user in the trajectory display unit as the base point; and a deterioration event display unit that causes the trajectory display unit to display, as a deterioration event position, deterioration event coordinates serving as the base point when the point cloud data including a deterioration event of the facility is acquired.