3D Shape Reconstruction for Robotic Package Loading and Unloading

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current logistics systems face challenges in accurately and efficiently loading and unloading packages of varying sizes and shapes from trucks, as existing technologies lack comprehensive three-dimensional shape recognition and manipulation capabilities, leading to inefficiencies in package arrangement and unloading processes.

Innovation Solution

A logistics management system that utilizes a combination of three-dimensional cameras and manipulators with robot arms to acquire and process point group data from multiple angles, generating composite three-dimensional maps to determine optimal loading and unloading strategies, enabling precise package placement and retrieval.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple three-dimensional cameras are used to capture packages from different angles, then measurement precision and shape recognition accuracy are improved, but device complexity increases

Engineering Contradiction:
Improveshape recognition accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system divides the observation task into multiple segments by using several three-dimensional cameras positioned at different locations around the container. Each camera captures a specific viewpoint, and the control device segments the overall shape reconstruction task into individual viewpoint processing, combining these segmented views to create complete three-dimensional maps of packages.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The control device acts as an intermediary that receives point group data from multiple cameras, processes and integrates this data, and generates composite three-dimensional maps. This intermediary processing layer manages the complexity by centralizing the integration logic, transforming multiple complex camera inputs into a unified three-dimensional representation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If comprehensive three-dimensional shape recognition is implemented, then productivity and automation level are improved, but measurement precision requirements increase

Engineering Contradiction:
Improveloading/unloading efficiencyVSAvoidthree-dimensional shape recognition accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system merges point group data from multiple three-dimensional cameras to create comprehensive composite three-dimensional maps of packages. By combining observations from different viewpoints, the system achieves accurate three-dimensional shape recognition that enables automated loading and unloading operations without requiring any single camera to have perfect precision.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system transitions from two-dimensional camera images to three-dimensional point group data and composite three-dimensional maps. This dimensional transformation allows the system to capture and process complete package geometries, enabling sophisticated manipulation and arrangement decisions that improve productivity while maintaining measurement accuracy through spatial information.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of operation

If automated manipulators with robot arms are used for package handling, then ease of operation is improved, but device complexity increases

Engineering Contradiction:
Improveautomated package handlingVSAvoidmanipulator system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The manipulator with robot arm is programmed to autonomously perform package handling operations based on the composite three-dimensional maps. The system achieves self-service capability by integrating shape recognition, manipulation planning, and execution control, allowing the manipulator to independently determine optimal handling strategies and perform operations without continuous human intervention.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The manipulator system is designed with multi-functionality to handle various package shapes, sizes, and arrangements. By integrating three-dimensional shape recognition capabilities with adaptive manipulation control, the single manipulator unit can perform multiple different handling tasks across diverse logistics scenarios, improving ease of operation while managing complexity through versatile design.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11836939B2Shape information generation apparatus, control apparatus, loading/unloading apparatus, logistics system, non-transitory computer-readable medium, and control method
Publication Date: 2023.12.05 MUJIN INC
  • US11836939B2 patent drawing
  • US11836939B2 patent drawing
  • US11836939B2 patent drawing

AI summary

A control apparatus includes a first information acquiring section that acquires three-dimensional information of a first region of surfaces of a plurality of objects, the information being obtained by imaging or scanning the plurality of objects from a first location; a second information acquiring section that acquires three-dimensional information of a second region of surfaces of the plurality of objects, the information being obtained by imaging or scanning the plurality of objects from a second location; and a combining section that generates information indicating three-dimensional shapes of at least a portion of the surfaces of the plurality of objects, based on the three-dimensional information of the first region acquired by the first information acquiring section and the three-dimensional information of the second region acquired by the second information acquiring section.