Construction Machine LiDAR-Camera Sensing for Fast Accurate 3D Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing construction machine measuring systems face challenges with slow and inaccurate environmental detection, which compromises construction site safety and autonomous operation capabilities.

Innovation Solution

A construction machine equipped with a measuring system that combines a LiDAR scanner and camera, capable of rapidly rotating measuring beams around multiple axes, generating high-frequency data for real-time 3D terrain modeling, obstacle detection, and autonomous control, with angle correction and data fusion from multiple sensors and cameras.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a LiDAR scanner rotates measuring beams around multiple axes with high rotating speed, then detection speed is improved, but measurement precision may deteriorate due to motion blur and positioning errors

Engineering Contradiction:
Improvedetection speedVSAvoidmeasurement accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system employs angle encoder units that continuously provide feedback on the actual angular positions of the rotating support and deflector. This feedback enables the computer to calculate precise spatial coordinates of detected objects despite the rapid rotation, compensating for any positioning deviations and maintaining measurement accuracy while achieving high detection speeds of at least 0.5 Hz around each axis

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces traditional mechanical scanning systems with an optical-mechanical hybrid approach where the LiDAR scanner uses rapid beam rotation combined with optical detection. The measuring beams are rotated around two non-parallel axes simultaneously, substituting slow mechanical movement with faster optical scanning while using computational methods to maintain precision

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If multiple measuring units with overlapping detection ranges are used, then measurement precision and coverage are improved, but device complexity increases

Engineering Contradiction:
Improvedetection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines data from multiple measuring units with overlapping detection ranges into a unified measurement dataset. The computer processes measurements from all units simultaneously, merging their complementary views to create a comprehensive and accurate 3D model of the environment, thereby improving detection accuracy without requiring separate processing systems for each unit

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The measuring units are designed with universal functionality where each unit can operate independently or in combination with others. The system accepts measurement data from multiple sources and processes them through a unified algorithm, allowing the same hardware configuration to serve both standalone and multi-unit operational modes, thus managing complexity while enhancing precision

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances detection speed and accuracy, improving construction site safety and enabling more efficient autonomous operation of construction machines by providing detailed 3D models and real-time obstacle identification.

Implementation Method 1

a first Light Detection and Ranging (LiDAR) scanner, the first LiDAR scanner configured for rotating a first measuring beam around a first axis and around a second axis non-parallel to the first axis with a rotating speed of at least 0.5 Hz with respect to each axis

Methodology Applied
Scientific EffectLight Detection and Ranging (LiDAR): LIDAR

Implementation Method 2

a first Light Detection and Ranging (LiDAR) scanner

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 3

comprising at least a first camera

Methodology Applied
Scientific EffectPhotography: Photography

Data Source

PatentUS12018457B2Construction machine with measuring system and construction site measuring system
Publication Date: 2024.06.25 LEICA GEOSYST TECH
  • US12018457B2 patent drawing
  • US12018457B2 patent drawing
  • US12018457B2 patent drawing

AI summary

A construction machine comprising a chassis, a steering, and a powertrain for driving the construction machine by the chassis, an earth-moving tool for working a terrain, and a measuring system having a first measuring unit configured for generating first measuring data in a first detection range and comprising at least a first camera and a first LiDAR scanner configured for rotating a first measuring beam around a first axis and around a second axis non-parallel to the first axis with a rotating speed of at least 0.5 Hz with respect to each axis, an interface connecting the first measuring unit to a computer configured for, based on the first measuring data, at least one of generating a three-dimensional model of the terrain within the first detection range, identifying an obstacle or a person within the first detection range, and controlling the steering, the powertrain, and/or the earth-moving tool.