Warehouse Point Cloud Annotation for Real-Time Object Identification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current point cloud technologies in warehouse environments face challenges in accurately and efficiently annotating and identifying objects, particularly pallets and moving vehicles, due to the complexity of the environment and the need for manual processing and post-processing.

Innovation Solution

A system that uses a vehicle equipped with an image capturing device and a space scanning device to generate and annotate point clouds in real-time, allowing for automatic identification and filtering of objects, enabling the creation of accurate blueprints and improved object tracking without requiring multiple software programs for different environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual processing and post-processing are used for point cloud annotation, then annotation accuracy can be improved, but processing time and productivity are reduced

Engineering Contradiction:
Improveannotation accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system performs preliminary annotation during the point cloud generation process itself, rather than as a separate post-processing step. The annotation module operates concurrently with data acquisition, preparing annotated point clouds in real-time as data is collected, which eliminates the need for separate manual processing stages while maintaining accuracy

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system replaces manual mechanical annotation processes with automated computational algorithms. The annotation module uses computer vision and pattern recognition algorithms to automatically identify and label objects in point clouds, substituting human operators with automated systems that can process data at machine speed while maintaining consistent accuracy standards

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If multiple software programs are used for different warehouse environments, then adaptability to various environments is improved, but device complexity increases

Engineering Contradiction:
Improveenvironment adaptabilityVSAvoidsoftware complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The annotation module is designed as a universal system that can handle multiple warehouse environments and object types through a single integrated software platform. The system uses configurable parameters and adaptive algorithms that can be adjusted to work with different warehouse layouts, lighting conditions, and object characteristics without requiring separate specialized programs for each environment

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system employs dynamic configuration capabilities where annotation parameters, object classification rules, and processing thresholds can be adjusted in real-time based on the specific warehouse environment being scanned. This dynamic adaptability allows a single software program to effectively handle diverse environments by automatically or manually configuring itself to match current conditions

Inventive Principle:
Principle #15Dynamics

3Productivity

If real-time annotation is implemented, then productivity and speed are improved, but computational complexity and processing requirements increase

Engineering Contradiction:
Improveannotation speedVSAvoidcomputational complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The annotation process is divided into separate modular components that operate independently and concurrently. The system segments the point cloud processing into distinct stages such as initial object detection, classification, labeling, and validation, with each segment handled by specialized sub-modules that can process different portions of the data simultaneously, reducing overall computational complexity while maintaining real-time performance

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements a multi-pass annotation approach where a first pass performs rapid coarse annotation to identify major objects and regions, followed by optional second passes that perform more detailed analysis only on areas requiring higher precision. This partial application of full annotation processing reduces computational load while still achieving practical real-time performance for most applications

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system provides real-time annotation and filtering of point clouds, enhancing the accuracy and speed of object identification and tracking, allowing for clear identification of pallets and other objects even when partially hidden, and enabling the creation of accurate blueprints of warehouse environments.

Implementation Method 1

A vehicle can be equipped with an image capturing device (e.g., a camera) and a space scanning device (e.g., an optical scanner). As the vehicle moves around in a room, the image capturing device is configured to capture images of objects. The space scanning device is configured to measure distances to the objects and generate optical scan data (e.g., point cloud data) usable to generate a point cloud of the room.

Methodology Applied
Scientific EffectLIDAR: LIDAR

Data Source

PatentUS11995852B2Point cloud annotation for a warehouse environment
Publication Date: 2024.05.28 LINEAGE LOGISTICS LLC
  • US11995852B2 patent drawing
  • US11995852B2 patent drawing
  • US11995852B2 patent drawing

AI summary

A system is provided for automatic identification and annotation of objects in a point cloud in real time. The system can automatically annotate a point cloud that identifies coordinates of objects in three-dimensional space while data is being collected for the point cloud. The system can train models of physical objects based on training data, and apply the models to point clouds that are generated by various point cloud generating devices to annotate the points in the point clouds with object identifiers. The solution of automatically annotated point cloud can be used for various applications, such as blueprints, map navigation, and determination of robotic movement in a warehouse.