AR Display Thermal Camera Segmentation for SCBA Compatibility

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional augmented reality systems for firefighters are not compatible with existing helmets and self-contained breathing apparatus (SCBA), limiting their effectiveness in low-light, smoke-filled environments where visibility is poor, and fail to aid in identifying and locating people.

Innovation Solution

An augmented reality display system that integrates thermal imaging with edge detection image processing, compatible with various protective headgear, including SCBA, to highlight human temperature objects, enhancing visibility and location of individuals in challenging environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional augmented reality goggles are designed to provide visual overlay, then the user can see augmented reality information, but the device becomes bulky and incompatible with existing headwear or facial items

Engineering Contradiction:
Improvecompatibility with headwearVSAvoiddevice size
Core Design Contradiction:
Adaptability or versatilityVSVolume of moving object

Solution Approach 1:

The system separates the augmented reality display into two independent components: a compact AR display unit that attaches to headwear, and a separate processing unit that can be worn on the body or mounted elsewhere. This segmentation allows the AR components to be small and compatible with helmets while the processing burden is distributed elsewhere.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The AR display unit is designed with universal mounting capabilities that can attach to various types of headwear including helmets, caps, and other protective gear without requiring modification to the headwear itself. This multi-functional attachment system enables compatibility across different headwear types while keeping the display unit compact.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If thermal imaging is integrated into augmented reality systems, then the ability to identify people in poor visibility improves, but the device complexity increases

Engineering Contradiction:
Improvedetection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system merges thermal imaging technology with augmented reality display in a single integrated unit that attaches to headwear. By combining these functions in one compact module rather than separate systems, the overall device complexity is managed while maintaining enhanced detection capabilities for identifying people in poor visibility conditions.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system uses an image processing algorithm as an intermediary that automatically processes thermal imaging data to detect and highlight human figures. This intermediary processing layer simplifies the complexity by automating the analysis rather than requiring manual interpretation of raw thermal data, making the system more user-friendly despite the advanced technology involved.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Illumination intensity

If the display screen is made transparent for augmented reality overlay, then the user can see through it, but the visibility of displayed information decreases

Engineering Contradiction:
Improvevisibility of displayVSAvoidtransparency function
Core Design Contradiction:
Illumination intensityVSReliability

Solution Approach 1:

The display screen utilizes electrochromic or liquid crystal technology that can dynamically change its optical properties between transparent and opaque states. By adjusting the transparency parameter based on environmental conditions and user needs, the system maintains both the ability to see through the display when needed and the visibility of displayed information when required.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system provides firefighters with an effective means to quickly identify and locate people in poor visibility conditions by overlaying thermal and virtual views, improving situational awareness and safety during rescue operations.

Implementation Method 1

a thermal camera configured to capture image frames

Methodology Applied
Scientific EffectThermal radiation: Thermal Radiation

Implementation Method 2

an image projector configured to display the processed image frames

Methodology Applied
Scientific EffectLight projection: Light

Data Source

PatentUS11665319B2Augmented reality display device, and apparatus comprising same
Publication Date: 2023.05.30 LONGAN VISION CORP
  • US11665319B2 patent drawing
  • US11665319B2 patent drawing
  • US11665319B2 patent drawing

AI summary

An augmented reality display device, includes: a display unit including a thermal camera configured to capture image frames, an image projector, and a display screen; a processing unit including processing structure in communication with the thermal camera and the image projector, the processing structure being configured to process the captured image frames and output processed image frames to the image projector, and a battery; and a strap connecting the display unit and the processing unit.