Robotic Package Scanning and Registration for Unknown Object Picking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current robotic systems face challenges in efficiently handling and registering unknown or unrecognized objects during de-palletization, leading to potential mishandling and increased costs due to manual intervention and errors in identifying physical characteristics.

Innovation Solution

A robotic system capable of autonomously scanning and registering unrecognized objects by identifying exposed edges and corners, deriving minimum viable regions for gripping, and obtaining additional information through sensors to accurately manipulate and register these objects without operator assistance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If automated robotic de-palletization is implemented, then productivity increases and labor costs decrease, but reliability deteriorates due to failure to correctly identify physical characteristics of packages

Engineering Contradiction:
Improvede-palletization throughputVSAvoidpackage identification accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system performs preliminary imaging and registration of package physical characteristics before the robotic picking operation. The imaging device captures images of packages on the pallet, and the system processes these images to identify and register physical characteristics (dimensions, weight, center of mass) in advance, ensuring accurate handling during automated de-palletization.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

An image processing system acts as an intermediary between the robotic arm and the packages. The system compares captured images with registered images stored in a database to determine physical characteristics, serving as a mediator that enables the robotic system to handle packages it has never seen before without manual intervention.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If manual registration of packages is performed, then reliability of package identification improves, but productivity decreases due to stoppage and labor requirements

Engineering Contradiction:
Improvepackage identification accuracyVSAvoidde-palletization throughput
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The robotic system performs self-registration by automatically capturing images, processing them to identify physical characteristics, and storing this information in the registration data source without human intervention. This enables the system to handle unrecognized packages autonomously, maintaining both high reliability and productivity.

Inventive Principle:
Principle #25Self-service

3Manufacturing precision

If comprehensive imaging and registration is performed for all packages, then manufacturing precision of handling improves, but device complexity increases

Engineering Contradiction:
Improvehandling precisionVSAvoidimaging and registration system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The imaging device and processing system serve multiple functions: capturing package images, identifying physical characteristics, comparing with registered data, and enabling robotic handling. This multi-functionality reduces the need for separate specialized devices, managing complexity while maintaining high handling precision for all package types.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12002007B2Robotic system with automated package scan and registration mechanism and methods of operating the same
Publication Date: 2024.06.04 MUJIN INC
  • US12002007B2 patent drawing
  • US12002007B2 patent drawing
  • US12002007B2 patent drawing

AI summary

A system and method for operating a robotic system to scan and register unrecognized objects is disclosed. The robotic system may use an image data representative of an unrecognized object located at a start location to implement operations for transferring the unrecognized object from the start location. While implementing the operations, the robotic system may obtain additional data, including scanning results of one or more portions of the unrecognized object not included in the image data. The robotic system may use the additional data to register the unrecognized object.