Threat Chip Display for High-Speed Imagery Triage

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current surveillance systems require excessive user interaction to analyze multiple potential targets simultaneously, leading to fatigue and decreased accuracy due to the need for constant panning and zooming, which can result in missed targets.

Innovation Solution

A graphical user interface called the Threat Chip Display (TCD) that presents potential objects of interest as tiled, full-resolution chips with confidence scores, allowing users to quickly triage and designate targets with minimal mental demand, reducing the need for manual panning and zooming.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the user interface requires constant panning and zooming to inspect multiple targets, then the user can examine each target in detail, but the user becomes fatigued and accuracy decreases

Engineering Contradiction:
Improvetarget identification accuracyVSAvoiduser fatigue
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The display is segmented into multiple panes, with each pane showing a different target of interest at full resolution. This allows the user to view multiple targets simultaneously without needing to pan or zoom, eliminating user fatigue while maintaining the ability to examine each target in detail.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of requiring the user to navigate through targets in a single view (spatial navigation), the system displays multiple targets in parallel across different panes (temporal/simultaneous dimension). This dimensional change allows simultaneous inspection of multiple targets without physical camera movement.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If the system displays multiple targets simultaneously at full resolution, then the user can quickly triage targets, but the interface complexity increases

Engineering Contradiction:
Improvetarget triage speedVSAvoiduser interface complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The interface is segmented into standardized panes, each displaying a single target chip at full resolution. This modular segmentation allows the system to handle multiple targets simultaneously while maintaining a consistent, predictable interface structure that reduces perceived complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different panes can display targets with locally optimized properties - each pane shows a specific target at full resolution with its own confidence score and metadata. This local quality approach allows simultaneous detailed viewing of multiple targets without requiring the entire interface to be maximally complex.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If the user must pan and zoom to each detection location, then the user can inspect targets, but multiple targets at opposite ends of the field of view cannot be inspected quickly

Engineering Contradiction:
Improvetarget inspection qualityVSAvoidtime to inspect multiple targets
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system transitions from sequential spatial navigation (panning to different locations) to parallel temporal display (showing multiple locations simultaneously in different panes). This allows the user to inspect multiple targets at opposite ends of the field of view at the same time, eliminating the time loss associated with moving between targets.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The field of view is segmented into multiple discrete target regions, each displayed in its own pane. This segmentation allows the user to inspect multiple geographically separated targets simultaneously without needing to physically move the camera or pan across the display.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10621461B1Graphical display and user-interface for high-speed triage of potential items of interest in imagery
Publication Date: 2020.04.14 HRL LAB
  • US10621461B1 patent drawing
  • US10621461B1 patent drawing
  • US10621461B1 patent drawing

AI summary

The present invention relates to a surveillance system and, more particularly, to a graphical display and user interface system that provides high-speed triage of potential items of interest in imagery. The system receives at least one image of a scene from a sensor. The image is pre-processed to identify a plurality of potential objects of interest (OI) in the image. The potential OI are presented to the user as a series of chips on a threat chip display (TCD), where each chip is a region extracted from the image that corresponds to a potential OI. Finally, the system allows the user to designate, via the TCD, any one of the chips as an actual OI.