3D Point Cloud Segmentation for Real-Time Autonomous Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional 3D point cloud segmentation algorithms face challenges in real-time processing, handling multiple sensor inputs, and wide distance ranges, with issues such as high computational complexity, noise sensitivity, and non-determinism, making them unsuitable for autonomous vehicles and other high-speed applications.

Innovation Solution

A scalable clustering algorithm that uses a spatial hash data structure and aggressive down-sampling to segment 3D point clouds in real-time, allowing for static memory usage and handling multiple inputs simultaneously, while operating over a wide range of distances, using a parameterized association criterion and efficient data structures to improve computational complexity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional 3D point cloud segmentation algorithms are used, then segmentation accuracy can be maintained, but computational complexity increases linearithmically (O(n log n)), making real-time processing impossible

Engineering Contradiction:
Improveprocessing speedVSAvoidcomputational complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent divides the 3D point cloud into multiple two-dimensional range images based on angular sectors, transforming a single complex 3D segmentation problem into multiple simpler 2D segmentation problems that can be processed in parallel, reducing overall computational complexity from O(n log n) to O(n)

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms the 3D point cloud data into 2D range images by projecting points onto angular sectors, changing the dimensional representation to enable faster processing while preserving spatial relationships necessary for segmentation

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If conventional segmentation algorithms process points at fixed distance thresholds, then local segmentation accuracy is maintained, but they fail to handle points at wide distance ranges effectively

Engineering Contradiction:
Improvedistance range handlingVSAvoidsegmentation accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent applies different processing strategies to different angular sectors based on their specific characteristics, allowing each sector to be optimized for its particular distance range and point density, thereby maintaining accuracy across varying conditions

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent dynamically adjusts processing parameters for each angular sector based on the actual distribution of points and distances, rather than using fixed thresholds, enabling adaptive handling of wide distance ranges while maintaining segmentation precision

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If multiple sensor inputs are processed simultaneously, then comprehensive environmental understanding is achieved, but conventional algorithms cannot handle multiple inputs due to memory and computational constraints

Engineering Contradiction:
Improvemultiple input handlingVSAvoidmemory requirements
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent processes each sensor input by dividing its point cloud into angular sectors independently, allowing parallel processing of multiple sensors without requiring centralized memory for all inputs simultaneously, thus enabling multiple input handling with constant memory usage

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a universal processing framework that handles multiple sensor inputs through the same angular sector division mechanism, making the system capable of processing diverse sensor data types (LIDAR, radar, camera) through a single unified algorithm

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Measurement precision

If feature-based solutions are used for 3D point cloud segmentation, then segmentation quality is improved, but processing speed becomes too slow for real-time autonomous vehicle applications

Engineering Contradiction:
Improvesegmentation qualityVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent replaces complex feature extraction and analysis mechanisms with a simpler geometric projection approach, substituting computational feature-based methods with efficient 2D range image processing that maintains segmentation quality while dramatically increasing processing speed

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10921455B2Efficient and scalable three-dimensional point cloud segmentation for navigation in autonomous vehicles
Publication Date: 2021.02.16 APEX AI INC
  • US10921455B2 patent drawing
  • US10921455B2 patent drawing
  • US10921455B2 patent drawing

AI summary

Efficient and scalable three-dimensional point cloud segmentation. In an embodiment, a three-dimensional point cloud is segmented by adding points to a spatial hash. For each unseen point, a cluster is generated, the unseen point is added to the cluster and marked as seen, and, for each point that is added to the cluster, the point is set as a reference, a reference threshold metric is computed, all unseen neighbors are identified based on the reference threshold metric, and, for each identified unseen neighbor, the unseen neighbor is marked as seen, a neighbor threshold metric is computed, and the neighbor is added or not added to the cluster based on the neighbor threshold metric. When the cluster reaches a threshold size, it may be added to a cluster list. Objects may be identified based on the cluster list and used to control autonomous system(s).