Edge-Based Object Pose Refinement for De-Palletizing Robots

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Robotic systems face inaccuracies in detecting the position and orientation of objects on pallets due to errors in computer vision and manufacturing defects, leading to potential mishandling and increased risk of injury to human workers during de-palletization.

Innovation Solution

Implementing a post-detection refinement mechanism that uses pairwise edge analysis to update and verify initial object estimations based on 2D and 3D image data, comparing detected edges and corners to improve accuracy and alignment with actual object positions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If initial object estimation is performed using standard computer vision techniques, then detection speed is maintained, but measurement precision deteriorates due to errors in detecting position and orientation

Engineering Contradiction:
Improveposition and orientation detection accuracyVSAvoiddetection mechanism complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The detection process is divided into two distinct phases: initial object estimation using standard computer vision techniques, and post-detection refinement using edge-based verification. This segmentation allows each phase to specialize in its strength while maintaining overall system efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary detection using fast but less accurate methods, then applies refinement actions based on detected edges and corners. This preliminary action approach ensures that most detections are completed quickly while only requiring detailed refinement for specific cases.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If post-detection refinement using edge analysis is implemented, then measurement precision improves, but processing time increases

Engineering Contradiction:
Improveobject position and orientation accuracyVSAvoiddetection processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The refinement process applies edge-based verification selectively rather than to all detected objects. By focusing computational resources on verifying edges and corners only where needed, the system achieves high precision without uniformly increasing processing time for every detection.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system replaces purely mechanical/image-based detection with a hybrid approach that incorporates geometric reasoning through edge and corner analysis. This substitution allows for more accurate position and orientation determination without requiring additional physical sensors or complex hardware.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If accurate object detection is performed to prevent mishandling, then reliability improves, but device complexity increases due to additional verification mechanisms

Engineering Contradiction:
Improvesafe handling of packagesVSAvoidverification system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system uses detected edges and corners to provide feedback on the accuracy of initial object estimations. This feedback mechanism allows the system to verify and correct detection results, ensuring reliable handling decisions without requiring overly complex verification infrastructure.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

Edges and corners serve as intermediary geometric features that bridge the gap between raw image data and final object parameter estimation. These intermediaries provide a structured way to verify detection accuracy without directly complicating the overall system architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11389965B2Post-detection refinement based on edges and multi-dimensional corners
Publication Date: 2022.07.19 MUJIN INC
  • US11389965B2 patent drawing
  • US11389965B2 patent drawing
  • US11389965B2 patent drawing

AI summary

The present disclosure relates to verifying an initial object estimation of an object. A two-dimensional (2D) image representative of an environment including one or more objects may be obtained. The 2D image may be inspected to detect edges of an object. The edges may be processed to verify or update an initial object estimation to increase the accuracy of an object detection result.