3D Package Shape Mapping for Robotic Truck Unloading

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current logistics systems face challenges in accurately and efficiently loading and unloading packages of varying sizes and shapes from trucks, as existing technologies lack comprehensive three-dimensional shape recognition and manipulation capabilities, leading to inefficiencies and potential damage during handling.

Innovation Solution

A logistics management system that employs a combination of three-dimensional cameras and manipulators with robot arms, which acquire and combine point group data from multiple angles to generate composite three-dimensional maps of package arrangements, enabling precise identification and handling of packages, and a control method that determines optimal unloading paths and orientations based on these maps.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple three-dimensional cameras are used to capture packages from different angles, then measurement precision and shape recognition accuracy are improved, but device complexity increases

Engineering Contradiction:
Improvethree-dimensional shape recognition accuracyVSAvoidcamera system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines point group data from multiple three-dimensional cameras to generate a composite three-dimensional map. This merging approach integrates information from multiple sources to achieve comprehensive shape recognition while systematically managing the complexity through data fusion rather than independent processing of each camera system.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The control apparatus serves as an intermediary that receives point group data from multiple cameras, processes and combines this data into composite three-dimensional maps, and then provides this integrated information to the manipulator. This intermediary structure manages system complexity by centralizing the complex processing tasks in a dedicated control unit.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If composite three-dimensional maps are generated from multiple point group data sets, then productivity and handling efficiency are improved, but loss of time for data processing increases

Engineering Contradiction:
Improveloading and unloading efficiencyVSAvoiddata processing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by capturing point group data from multiple cameras simultaneously or in rapid sequence before the actual loading or unloading operation begins. The composite three-dimensional maps are generated in advance, allowing the manipulator to plan and execute handling operations without real-time processing delays.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent maintains continuity of useful action by overlapping data acquisition, processing, and manipulation operations. While point group data is being captured from multiple angles, preliminary processing begins, and as maps are generated, the manipulator is already positioned or preparing for the next handling operation, minimizing idle time and maintaining continuous productive workflow.

Inventive Principle:
Principle #20Continuity of useful action

3Reliability

If precise three-dimensional mapping is implemented, then reliability of package handling is improved, but device complexity increases

Engineering Contradiction:
Improvepackage handling accuracyVSAvoidcontrol system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The control apparatus is segmented into distinct functional units: one or more three-dimensional cameras for data acquisition, a processing unit for generating composite maps from point group data, and a manipulator for execution. This segmentation allows each component to be optimized independently while maintaining overall system reliability through coordinated operation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements feedback by using the generated composite three-dimensional maps to guide the manipulator's actions, and by potentially using additional sensing during manipulation to verify accuracy. This closed-loop approach ensures reliable package handling while managing complexity through structured information flow and verification protocols.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10970866B2Shape information generation apparatus, control apparatus, loading/unloading apparatus, logistics system, non-transitory computer-readable medium, and control method
Publication Date: 2021.04.06 MUJIN INC
  • US10970866B2 patent drawing
  • US10970866B2 patent drawing
  • US10970866B2 patent drawing

AI summary

A control apparatus includes a first information acquiring section that acquires three-dimensional information of a first region of surfaces of a plurality of objects, the information being obtained by imaging or scanning the plurality of objects from a first location; a second information acquiring section that acquires three-dimensional information of a second region of surfaces of the plurality of objects, the information being obtained by imaging or scanning the plurality of objects from a second location; and a combining section that generates information indicating three-dimensional shapes of at least a portion of the surfaces of the plurality of objects, based on the three-dimensional information of the first region acquired by the first information acquiring section and the three-dimensional information of the second region acquired by the second information acquiring section.