Dynamic Video Overlay for Package Handling Guidance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Manual package handling in facilities often results in operator errors, leading to misrouting and damage, and poses safety risks due to the handling of hazardous materials, where existing automated systems lack responsiveness to irregular packages.

Innovation Solution

An automated package-handling support system using a video-camera interface and display interface to provide motion-video observation and dynamic informational overlays to human operators, processing package-specific attributes and properties to guide safe and efficient handling.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If automated systems are used for package handling, then operator errors and safety risks are reduced, but responsiveness to irregular packages and service level for special packages deteriorates

Engineering Contradiction:
Improveoperator errors and safety risksVSAvoidresponsiveness to irregular packages
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent introduces an intermediary system consisting of video cameras, image processing units, and display devices that mediate between automated package handling systems and human operators. This intermediary captures images of packages, processes them to identify irregularities, and presents enhanced visual information to operators, enabling humans to respond appropriately to irregular packages while the automated system handles routine tasks.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system enables self-service by having the automated system perform detection and classification of packages independently through image processing algorithms. The system automatically identifies package types, detects irregularities, and generates handling guidance without requiring constant human intervention, thereby maintaining high adaptability to irregular packages while reducing operator errors.

Inventive Principle:
Principle #25Self-service

2Adaptability or versatility

If human operators manually handle packages, then responsiveness to irregular packages and service level improve, but operator errors, misrouting, and safety risks increase

Engineering Contradiction:
Improveresponsiveness to irregular packagesVSAvoidoperator errors and safety risks
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent implements feedback mechanisms where the image processing system continuously monitors package handling operations and provides real-time visual feedback to operators through enhanced display devices. The system detects package irregularities and presents corrected or highlighted images to operators, enabling them to make informed decisions and reducing errors while maintaining responsiveness to special packages.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system replaces manual mechanical inspection with automated optical inspection using video cameras and image processing algorithms. This substitution eliminates repetitive manual checking, reduces operator fatigue and errors, while the processed visual information guides operators on how to handle irregular packages, maintaining high service levels.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If automated package handling is implemented, then service efficiency improves, but adaptability to irregular and hazardous packages deteriorates

Engineering Contradiction:
Improveservice efficiencyVSAvoidadaptability to irregular packages
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent segments the package handling function into distinct components: automated image capture, automated image processing for classification, and human operator decision-making for irregular packages. This segmentation allows the automated system to maintain high efficiency for routine handling while preserving human adaptability for irregular and hazardous packages through specialized processing and guidance.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces dynamic adaptability by having the image processing algorithms adjust their detection and classification capabilities based on the complexity of packages encountered. The system can switch between automated handling modes and human-guided modes dynamically, maintaining service efficiency while adapting to irregular packages through flexible operational modes.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10592713B1Computationally-augmented video display facilitating package handling
Publication Date: 2020.03.17 DATALOGIC USA INC
  • US10592713B1 patent drawing
  • US10592713B1 patent drawing
  • US10592713B1 patent drawing

AI summary

An automated package-handling support solution receives video observation of a target area in a package-handling facility that includes packages. A display device is configured to produce video images visible from the target area. An operator support system processes the motion-video observation to detect the packages in the target area and retrieve a package-specific routing-related attribute and a package-specific property for each of the packages. The system generates the video output to include a first portion representing the video observation of the packages, and a second portion that includes a package-specific dynamic informational overlay corresponding to each of the packages.