MUM-T Image Orientation Stabilization for UAV Video

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In manned unmanned teaming (MUM-T) systems, the continuous rotation and changing orientation of unmanned aerial vehicle (UAV) video streams on the multi-function display (MFD) of manually operated aircraft increase aircrew workload and reduce situational awareness due to misalignment with the aircraft's heading.

Innovation Solution

An electronic image transformation module in the manually operated vehicle (MOV) transforms the UAV image data into a stable orientation matching the MOV's heading, allowing intuitive sensor control and maintaining a constant display orientation independent of the UAV's heading, using algorithms like Hough transformation and Mercator-based projection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the UAV continuously rotates to maintain coverage of the area of interest, then the sensor coverage and periphery capability are enhanced, but the video orientation on the MFD becomes unstable and misaligned with the aircraft heading

Engineering Contradiction:
Improvesensor coverageVSAvoidvideo orientation
Core Design Contradiction:
Adaptability or versatilityVSStability of the object's composition

Solution Approach 1:

An electronic image transformation module acts as an intermediary between the rotating UAV video feed and the MOV's display system. This module receives video data with first orientation metadata from the UAV, transforms the video orientation using algorithms like Hough transformation and Mercator-based projection, and outputs stabilized video with second orientation metadata aligned to the MOV's heading, thereby decoupling the rotational movement from the display stability

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system dynamically changes the orientation parameter of the video data through mathematical transformation. By applying coordinate transformation algorithms that convert video orientation from the UAV's reference frame to the MOV's reference frame, the system maintains stable display orientation while the UAV continues its rotational movement to cover the area of interest

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If the UAV flight path is offset from the area of interest at prescribed radii, then the periphery and weapons capabilities are enhanced, but the video requires continuous rotation and movement to maintain target tracking

Engineering Contradiction:
Improveweapons capabilityVSAvoidtarget tracking
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The electronic image transformation module serves as a mediator that automatically handles the complex task of video stabilization and orientation alignment. This eliminates the need for aircrew to manually compensate for UAV rotation and movement, significantly reducing the workload for target tracking while maintaining the UAV's offset flight path for enhanced weapons capability

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The video transformation system performs self-service by automatically detecting the orientation mismatch between UAV and MOV, calculating the required transformation, and applying the correction without human intervention. This autonomous operation maintains stable video display and simplifies target tracking for the aircrew

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If the video orientation continuously changes to match the UAV heading, then the UAV's sensor coverage is maximized, but the aircrew workload increases significantly to maintain target tracking

Engineering Contradiction:
Improvesensor coverageVSAvoidaircrew workload
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The electronic image transformation module acts as an intermediary that absorbs the complexity of coordinate transformations and orientation adjustments. By handling all video stabilization computations automatically, it protects the aircrew from the complexity of managing rotating video feeds, thereby maximizing sensor coverage while minimizing aircrew workload

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10147000B2Manned unmanned teaming (MUM-T) system to transform image data based on geographic orientation
Publication Date: 2018.12.04 SIKORSKY AIRCRAFT CORP
  • US10147000B2 patent drawing
  • US10147000B2 patent drawing
  • US10147000B2 patent drawing

AI summary

A manned unmanned teaming (MUM-T) image system includes an unmanned vehicle (UV) configured to travel in a first heading and includes at least one sensor configured to capture at least one image having a first visual orientation pursuant to the first heading. The MUM-T image system generates image data indicative of the at least one image. A manually operated vehicle (MOV) in signal communication with the UV is configured to travel in a second heading. The MOV comprises an electronic image transformation module configured to receive the image data and to transform the image data into a second orientation different from the first orientation based on the second heading. An electronic display unit is configured to receive the transformed image data and to display the at least one image according to the second orientation.