Robotic Package Identification Using Force Sensing and Movement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing robotic systems in retail logistics struggle to accurately identify packages, especially those with similar visual characteristics or without visible labels, as they rely heavily on visual inspection and may not be able to differentiate between packages based on weight or material alone.

Innovation Solution

A robotic package identification system that uses force feedback and movement inspection techniques, combined with machine learning, to generate a data structure for identifying packages by grasping and manipulating them, employing a robotic system with a measuring device and controller to perform initial and movement-based inspections, narrowing down possible packages through a series of tests.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If visual inspection is used to identify packages, then the identification process is simple and fast, but packages with similar visual characteristics cannot be differentiated

Engineering Contradiction:
Improvepackage identification accuracyVSAvoididentification system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple sensing modalities (visual inspection, force sensing, and weight measurement) into a unified identification system. The force sensing device measures contact forces during robotic manipulation, and these force characteristics are merged with visual and weight data to create a comprehensive package identification approach that overcomes the limitations of any single sensing method.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces force sensing as an intermediary measurement method between visual inspection and physical package manipulation. By measuring contact forces during controlled movements, the system extracts intermediate characteristics that bridge the gap between external appearance and internal package identification, enabling differentiation of packages with similar visual characteristics.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If force sensing and movement inspection are used to identify packages, then identification accuracy improves, but the inspection process time increases

Engineering Contradiction:
Improvepackage identification accuracyVSAvoidinspection process time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary visual inspection and weight measurement before conducting force sensing tests. This hierarchical approach allows the system to quickly eliminate packages that can be identified through simple characteristics, reserving more time-consuming force sensing operations only for packages that require deeper differentiation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The force sensing inspection uses periodic movement patterns (oscillations, vibrations, or repeated contact sequences) to excite the package and measure its dynamic response. These periodic actions enable the system to extract identification characteristics efficiently through controlled, repetitive testing rather than continuous inspection.

Inventive Principle:
Principle #19Periodic action

3Adaptability or versatility

If packages are manipulated for identification, then identification capability improves, but handling complexity increases

Engineering Contradiction:
Improveidentification capabilityVSAvoidhandling system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The robotic manipulation system is designed to perform multiple functions: grasping packages, positioning them for inspection, applying controlled forces for sensing, and moving them to storage locations. This multi-functional approach consolidates handling operations into a single versatile system rather than requiring separate mechanisms for each operation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses dynamic manipulation strategies where the robotic manipulator applies varying forces and movements adapted to each package's characteristics. The manipulation approach is not fixed but dynamically adjusted based on real-time sensing feedback, allowing the same system to handle diverse package types effectively.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate identification of packages by utilizing force sensors and movement characteristics, overcoming limitations of visual inspection alone, and improving the efficiency of robotic package handling in retail environments.

Implementation Method 1

a force sensor structured to measure contact forces between the robotic manipulator and the package while the robotic manipulator moves the package

Methodology Applied
Scientific EffectForce sensing: Force

Data Source

PatentUS11441958B2Package identification through force sensing
Publication Date: 2022.09.13 ABB (SCHWEIZ) AG
  • US11441958B2 patent drawing
  • US11441958B2 patent drawing
  • US11441958B2 patent drawing

AI summary

Systems, methods, techniques and apparatuses of package identification are disclosed. One exemplary embodiment is a method for package identification comprising performing a set of initial inspection operations on a package; determining a portion of a plurality of possible packages based on the set of initial inspection operations and a data structure including initial inspection characteristics for the plurality of possible packages; performing a set of package movement inspection operations by moving the package using a robot; determining a set of movement characteristics based on the package movement inspection operations; and identifying which one of the portion of the plurality of possible packages corresponds to the package using the set of movement characteristics.