Parcel Tracking via Weighted Color-Depth Feature Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The increasing volume of parcel circulation and variety of parcel types pose challenges in effectively and precisely sorting parcels, particularly when parcels are adjacent or overlapped, leading to potential tracking accuracy issues.

Innovation Solution

A projection instruction device and system that uses a processor and memory to weight the feature amounts of parcel color images based on distance images, enabling accurate tracking and sorting by projecting relevant information onto the parcels using a label reader, image sensor, and projector.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual sorting work is used, then flexibility in handling various parcel types is maintained, but work efficiency decreases and time consumption increases

Engineering Contradiction:
Improvework efficiencyVSAvoidtime consumption
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent replaces manual mechanical sorting operations with an automated optical-mechanical system comprising image sensors, processors, and projectors. The system captures images of parcels, processes them to extract feature information, and projects guidance marks onto parcels to automate the sorting process, thereby significantly improving work efficiency while reducing time consumption.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If simple image tracking is used, then system complexity is reduced, but tracking accuracy deteriorates when parcels are adjacent or overlapped

Engineering Contradiction:
Improvetracking accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the image processing task into multiple stages: initial image capture, feature point detection, parcel boundary identification, and tracking mark projection. By dividing the complex tracking problem into manageable segments, the system achieves high tracking accuracy even for adjacent or overlapped parcels while controlling system complexity through modular processing steps.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces tracking marks as an intermediary element projected onto parcels. These marks serve as reference points that facilitate accurate identification and tracking of parcels, especially when parcels are adjacent or overlapped. The intermediary tracking marks bridge the gap between simple image capture and precise parcel identification, improving measurement precision without requiring overly complex processing systems.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If basic parcel identification is used, then processing speed is maintained, but sorting precision decreases for various parcel types

Engineering Contradiction:
Improvesorting precisionVSAvoidprocessing speed
Core Design Contradiction:
Manufacturing precisionVSSpeed

Solution Approach 1:

The patent performs preliminary image capture and feature extraction before the actual sorting decision is made. By pre-processing images to identify parcel features, boundaries, and characteristics in advance, the system prepares sorting information ahead of time, enabling both high sorting precision for various parcel types and maintained processing speed through efficient pre-computation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent changes the parameters used for parcel identification from basic features to multi-dimensional features including color, shape, size, and positional information. By adjusting and utilizing multiple parameters simultaneously, the system achieves high sorting precision for diverse parcel types while maintaining processing speed through optimized parameter analysis algorithms.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP3647236B1Projection instruction device, parcel sorting system, and projection instruction method
Publication Date: 2023.07.05 PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
  • EP3647236B1 patent drawingFigure 1
  • EP3647236B1 patent drawingFigure 2
  • EP3647236B1 patent drawingFigure 3A~3B

AI summary

There is provided a projection instruction device that generates a projection image to be projected on parcel based on sensing information of the parcel, the device including: a processor; and a memory, in which by cooperating with the memory, the processor performs weighting on a value of a feature amount of a color image of parcel included in the sensing information based on a distance image of parcel included in the sensing information, and tracks the parcel based on the weighted value of the feature amount of the color image.