Parallel Image Processing Routing via Reconfigurable FPGA Array

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for processing multiple image streams in real-time, such as those from UAVs, lack the ability to dynamically and iteratively route these streams through selectable algorithms, leading to inefficiencies in processing and display, particularly in environments requiring collaborative control and flexible image processing functions.

Innovation Solution

A system and method that allows for simultaneous switching of multiple input image streams to multiple output devices, utilizing a reconfigurable array of image processing circuit cards with preprogrammed algorithms, enabling dynamic and iterative routing based on stream characteristics, source, or processing results, and supporting collaborative control through a switching matrix and image processing modules, including field programmable gate arrays.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional video switches with single-point control are used, then control is simple and centralized, but collaborative control and flexible reconfiguration are limited

Engineering Contradiction:
Improvecollaborative control capabilityVSAvoidcontrol system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The control system is segmented into multiple independent control interfaces (web-based interface, API, etc.) that can operate autonomously. Each interface provides specific control functions, allowing multiple users to control different aspects of the video switching system simultaneously without interfering with each other, thus enabling collaborative control while maintaining manageable complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The video switching system is designed with multi-functional control capabilities, supporting both traditional single-point control and modern collaborative control through web interfaces. The system can handle multiple video streams, perform image processing functions, and provide various output options all through a unified platform, increasing versatility without proportionally increasing complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Productivity

If separate resources are devoted to separate data streams, then each data stream is processed independently and reliably, but processing efficiency and resource utilization are reduced

Engineering Contradiction:
Improveimage stream processing efficiencyVSAvoiddata stream processing reliability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

Multiple image streams are merged into a unified processing pipeline where they can be handled by shared resources including image processing modules, switching matrix, and output interfaces. The system processes multiple streams simultaneously through common hardware resources, improving efficiency while maintaining stream independence through logical separation in the processing architecture.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system dynamically allocates processing resources to different image streams based on current needs and stream characteristics. The switching matrix can dynamically route streams to different processing paths, and the web interface allows real-time reconfiguration of processing parameters, enabling flexible resource utilization while ensuring each stream receives appropriate processing attention.

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If fixed algorithm processing is used, then processing is simple and fast, but flexibility and adaptability to different stream characteristics are reduced

Engineering Contradiction:
Improvealgorithm selection flexibilityVSAvoidprocessing system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system allows dynamic changing of processing parameters including algorithm selection, processing intensity, and output format through the web-based interface. Users can adjust these parameters based on stream characteristics and requirements without modifying the underlying hardware architecture, providing flexibility while keeping the system implementation relatively simple through software-based parameter control.

Inventive Principle:
Principle #35Parameter changes

4Productivity

If real-time processing of multiple image streams is implemented, then operational efficiency is improved, but system complexity and resource requirements increase

Engineering Contradiction:
Improvereal-time processing capabilityVSAvoidsystem architecture complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system adds a temporal dimension to video processing by implementing frame-by-frame real-time processing capabilities. The switching matrix and image processing modules operate on individual frames in real-time, allowing multiple streams to be processed concurrently through time-division multiplexing and parallel processing architectures, achieving real-time performance without requiring completely redundant hardware for each stream.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10999587B2Method for parallel image processing and routing
Publication Date: 2021.05.04 WADE JACK
  • US10999587B2 patent drawing
  • US10999587B2 patent drawing
  • US10999587B2 patent drawing

AI summary

Various embodiments relate to systems and methods for simultaneously switching input image streams to output devices, while providing optional image processing functions on the image streams. Certain embodiments may enable multiple users/viewers to collaboratively control such systems and methods. Additionally, some embodiments may enable control by a set of computer input devices (e.g., keyboard and mouse) to switch between multiple computer systems, possibly by following the movement of a computer input device cursor, between virtual displays, as the cursor is controlled by the set of computer input devices.