Multi-Camera Drop Perception for Barcode Scanning in Mixed Orientations

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing object identification systems for robotic and sortation systems are limited in their ability to automatically and reliably identify objects in various orientations and positions, requiring manual intervention or controlled barcode placement for accurate scanning.

Innovation Solution

A perception system with multiple cameras and lighting units positioned to capture images of objects from various directions, allowing for automated identification of barcodes and other visual markings on objects, even when not initially visible, and integrated with a robotic system for sorting and placement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If a fixed barcode scanner is used at point-of-sale systems, then the scanner can continuously scan barcodes, but the operator must manually position and rotate the article to make the barcode visible

Engineering Contradiction:
Improveautomated barcode scanningVSAvoidmanual positioning of article
Core Design Contradiction:
Extent of automationVSEase of operation

Solution Approach 1:

The patent transitions from a single fixed scanning position to multiple scanning positions arranged in an array, adding spatial dimensionality to the scanning system. This allows barcodes to be scanned from various angles and positions, eliminating the need for manual article repositioning while maintaining automated scanning capability.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The scanning array provides multiple scanning functions in a single system, where each scanner in the array can detect barcodes from different orientations and positions. This multi-functional approach allows the system to handle diverse barcode placements on articles without requiring manual intervention.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Extent of automation

If industrial barcode scanners are placed in fixed locations relative to a conveyor, then scanning can be automated, but the range of barcode placements is tightly controlled and limited

Engineering Contradiction:
Improveautomated scanning on conveyorVSAvoidrange of barcode placements
Core Design Contradiction:
Extent of automationVSAdaptability or versatility

Solution Approach 1:

The patent expands the scanning capability from a single fixed location to multiple locations arranged in a two-dimensional array, allowing detection of barcodes across a broader range of positions and orientations on conveyor-borne articles, thereby increasing adaptability while maintaining automation.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The scanning system is divided into multiple independent scanning units arranged in an array, each capable of detecting barcodes within its specific field of view. This segmentation allows the overall system to cover a wider range of barcode placements by distributing detection capabilities across multiple positions.

Inventive Principle:
Principle #1Segmentation

3Device complexity

If a single scanner is used to identify objects, then the system is simple, but the probability of successful scanning is reduced when objects are in various orientations and positions

Engineering Contradiction:
Improvenumber of scannersVSAvoidsuccessful barcode scanning probability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The scanning function is segmented into multiple independent scanners arranged in an array, where each scanner covers a specific angular or spatial sector. This increases the probability that at least one scanner will successfully detect a barcode regardless of the object's orientation or position.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system changes the spatial parameters of the scanning arrangement by deploying multiple scanners at different positions and angles, thereby increasing the likelihood of successful barcode detection across varied object orientations without significantly increasing overall system complexity.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the automated and efficient sorting of objects by ensuring high probability of successful barcode scanning and minimizing scan time, even in heterogeneous collections, thereby improving the efficiency of order fulfillment and inventory management processes.

Implementation Method 1

A perception system with multiple cameras and lighting units positioned to capture images of objects from various directions

Methodology Applied
Scientific EffectLight emission: Light

Implementation Method 2

A perception system with multiple cameras and lighting units positioned to capture images of objects from various directions, allowing for automated identification of barcodes and other visual markings on objects

Methodology Applied
Scientific EffectOptical detection: Photography

Data Source

PatentEP3391159B1Perception systems and methods for identifying and processing a variety of objects
Publication Date: 2023.05.31 BERKSHIRE GREY OPERATING CO INC
  • EP3391159B1 patent drawingFigure 1
  • EP3391159B1 patent drawingFigure 2
  • EP3391159B1 patent drawingFigure 3

AI summary

A drop perception system is disclosed that includes an open housing structure having an internal volume, an open top and an open bottom, and a plurality of perception units positioned to capture perception data within the internal volume at a plurality of locations between the open top and the open bottom of the open housing.