Robotic Baggage Inspection Using Scan-to-Vision OOI Localization

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current security screening processes at airports are inefficient as they require manual intervention by Bomb Appraisal Officers (BAOs) to handle baggage items detected with potential explosives or hazardous materials, leading to schedule and availability burdens.

Innovation Solution

A robotic system that uses a transport bin with machine-readable spatial reference frame markings, enabling robotic arms to open and inspect baggage items automatically based on electromagnetic scanning and machine vision, performing swabbing operations to detect explosive trace detection (ETD) systems.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If manual intervention by Bomb Appraisal Officers is used to handle suspect baggage, then security inspection accuracy is maintained, but screening efficiency and productivity deteriorate due to schedule burdens and availability constraints

Engineering Contradiction:

Improvesecurity inspection accuracyVSAvoidscreening efficiency

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The robotic system performs self-service by automatically executing the inspection tasks that were previously requiring human BAOs. The robot autonomously navigates to suspect baggage, opens it using its manipulator, and conducts inspection, thereby eliminating the need for human intervention while maintaining inspection quality and improving throughput

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent replaces the manual mechanical operations of BAOs with an automated robotic system. The robotic manipulator replicates and enhances the physical capabilities of human hands for opening baggage, while the automated navigation and control systems substitute for human decision-making and movement, achieving both reliability and improved productivity

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Extent of automation

If robotic arms perform extensive non-productive movements to locate and access OOIs, then automation is achieved, but time efficiency and productivity deteriorate

Engineering Contradiction:

Improveautomated baggage handlingVSAvoidnon-productive movement time

Core Design Contradiction:

Extent of automationVSLoss of time

Solution Approach 1:

The system performs preliminary action by pre-localizing OOIs using electromagnetic scanning before the robotic arm needs to physically access them. The scan data provides advance information about OOI positions, allowing the robotic system to plan efficient paths and minimize non-productive movements during the actual inspection phase

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The robotic system uses feedback from electromagnetic scanning and machine vision to continuously adjust its navigation and manipulation actions. This closed-loop control enables the robot to directly navigate to OOI locations based on real-time spatial information, significantly reducing unnecessary movements and time loss

Inventive Principle:

Principle #23Feedback

3Ease of operation

If baggage items are frequently shifted during inspection, then access to OOIs is improved, but processing time increases and productivity decreases

Engineering Contradiction:

ImproveOOI accessibilityVSAvoidbaggage shifting time

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The robotic manipulator serves as an intermediary tool that can access OOIs without requiring frequent baggage shifting. By using specialized end-effectors and manipulation techniques, the robot can reach and inspect objects in various positions within the baggage, reducing the need to physically move the baggage itself

Inventive Principle:

Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This system reduces the time wasted on non-productive movements of robotic arms and minimizes unnecessary baggage shifting, enhancing the efficiency of security screening by automating the handling of suspect baggage items.

Implementation Method 1

receiving from an electromagnetic scanning a transport bin and an object-of-interest (OOI) geometric position information

Methodology Applied

Scientific EffectElectromagnetic scanning: Electromagnetic Induction

Implementation Method 2

machine vision detecting of the spatial reference frame marking

Methodology Applied

Scientific EffectMachine vision detection: Photoelectric Effect

Data Source

PatentUS11420336B2Robotic resolution of scanning alarms

Publication Date: 2022.08.23 THE GOVERNMENT OF THE UNITED STATES OF AMERICA AS REPRESENTED BY THE SEC OF HOMELAND SECURITY

AI summary

Systems and methods are described, and an example system includes a transport bin configured to carry a baggage item and having spatial reference frame marking detectable by electromagnetic scan and by machine vision. The system includes a robotic arm apparatus at an inspection area, and includes a switched path baggage conveyor that, responsive to electromagnetic scan detection of an object-of-interest (OOI) within the baggage item, conveys the transport bin to the inspection area. The electromagnetic scan generates OOI geometric position information indicating geometric position of the OOI relative to the spatial reference frame marking. The robotic arm apparatus, responsive to receiving the transport bin, uses machine vision to detect orientation of the spatial reference frame marking, then translates OOI geometric position information to local reference frame, for robotic opening of the baggage item, and robotic accessing and contact swab testing on the OOI.