Wearable Hybrid Hyperspectral AR Device for Threat Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional hyperspectral imaging devices are large, heavy, and cumbersome, making them unsuitable for field operations, and lack the portability needed for detecting camouflaged adversaries or chemical hazards in military and civilian settings, as well as for medical emergencies.

Innovation Solution

A wearable hybrid hyperspectral augmented reality device equipped with multi-level imaging sensors, including long wave infrared, hyperspectral, and frequency modulated millimeter-wave/Terahertz imaging radar, along with a wearable computing unit for co-registering data and determining threat levels, and a portable display for augmented reality visualization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional hyperspectral imaging devices are used, then detection capability for camouflaged objects and chemical hazards is improved, but device portability and ease of operation deteriorate due to large size and heavy weight

Engineering Contradiction:
Improvedetection capabilityVSAvoiddevice weight
Core Design Contradiction:
Measurement precisionVSWeight of moving object

Solution Approach 1:

The device segments the imaging function into multiple specialized sensors (hyperspectral sensor, thermal sensor, visible light sensor, millimeter-wave sensor) that operate in parallel at different spectral bands. Each sensor captures specific information independently, and the computing unit integrates these segmented data streams to achieve comprehensive detection without requiring a single bulky hyperspectral system

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The wearable device integrates multiple imaging modalities (hyperspectral, thermal, visible light, and millimeter-wave) into a single multi-functional platform. This universal device can detect various targets (camouflaged objects, chemical hazards, thermal signatures) using different spectral bands simultaneously, replacing multiple separate specialized devices with one portable unit

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If conventional hyperspectral imaging devices are used, then detection capability is improved, but device portability deteriorates due to bulky structure

Engineering Contradiction:
Improvedetection capabilityVSAvoiddevice volume
Core Design Contradiction:
Measurement precisionVSVolume of moving object

Solution Approach 1:

The device employs a nested architecture where multiple imaging sensors and processing units are integrated within a compact wearable form factor. The sensors and computing components are nested within the head-mounted display structure, allowing the system to maintain advanced detection capabilities while minimizing external volume and achieving wearable portability

Inventive Principle:
Principle #7Nested doll (Nesting)

3Measurement precision

If conventional hyperspectral imaging devices are used, then detection capability is improved, but ease of operation deteriorates due to complex calibration and post-processing requirements

Engineering Contradiction:
Improvedetection capabilityVSAvoidoperational simplicity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The computing unit automatically performs calibration, data fusion, and threat level determination without requiring specialist intervention. The system self-calibrates by co-registering data from multiple sensors and automatically processes the integrated data to determine threat levels and geospatial locations, eliminating the need for manual post-processing steps

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The device provides real-time visual feedback through the head-mounted display, showing threat levels and geospatial locations as the user moves. The system continuously monitors environmental data and provides immediate visual feedback about detected hazards, eliminating the need for offline analysis and allowing operators to make real-time decisions

Inventive Principle:
Principle #23Feedback

4Measurement precision

If conventional hyperspectral imaging devices are used, then detection capability is improved, but adaptability to field operations deteriorates due to power consumption and operating conditions

Engineering Contradiction:
Improvedetection capabilityVSAvoidfield operation adaptability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The device dynamically adapts its operation to field conditions by integrating multiple sensor modalities that can function independently or in combination. The system can operate in various lighting conditions (visible light sensor for daytime, thermal sensor for nighttime), different atmospheric conditions (millimeter-wave for penetrating obscurants), and provides continuous real-time visualization that adapts to the user's movement and field of view

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables direct visualization of camouflaged objects and chemical hazards in real-time, providing actionable information in a compact and portable form, enhancing situational awareness and reducing the need for bulky equipment in field operations.

Implementation Method 1

a long wave infrared sensor capable of detecting an object blocked from visual line of sight thereof

Methodology Applied
Scientific EffectInfrared radiation detection: Infrared Radiation

Implementation Method 2

a hyperspectral imaging sensor capable of detecting chemical properties of the object

Methodology Applied
Scientific EffectHyperspectral imaging: Absorption Spectroscopy

Implementation Method 3

a frequency modulated millimeter-wave/Terahertz imaging radar capable of long range spot scanning of the object

Methodology Applied
Scientific EffectRadar: Radar

Data Source

PatentUS10621438B2Hybrid hyperspectral augmented reality device
Publication Date: 2020.04.14 SYSO OU
  • US10621438B2 patent drawing
  • US10621438B2 patent drawing
  • US10621438B2 patent drawing

AI summary

A hybrid hyperspectral augmented reality device is disclosed. The hybrid hyperspectral augmented reality device includes multi-level imaging sensors which at least two of a long wave infrared sensor capable of detecting an object blocked from visual line of sight thereof, a hyperspectral imaging sensor capable of detecting chemical properties of the object, and a frequency modulated millimeter-wave imaging radar capable of long range spot scanning of the object. The hyperspectral imaging augmented reality device also includes a wearable computing unit capable of co-registering data from the multi-level spectral imaging sensors and determining, based on said co-registered data, a threat level and geospatial location for the object. The hybrid hyperspectral augmented reality device further includes a portable display in electronic communication with the wearable computing unit and capable of displaying in augmented reality the determined threat levels for the object together in graphical association with the objects themselves.