RDMA Data Aggregation for Low-Latency Camera Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional systems for collecting and analyzing sensor data from multiple terminals are inflexible and require dedicated infrastructure for each specific purpose, making it difficult to provide various services without rebuilding the entire system.
Innovation Solution
A data processing system utilizing RDMA (Remote Direct Memory Access) technology for direct memory-to-memory data transfer between local and remote nodes, enabling efficient aggregation and processing of data from multiple terminals.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional data collection systems are constructed for specific purposes with dedicated infrastructure, then the system can achieve reliable data processing for that specific purpose, but the system lacks adaptability to provide various different services
Solution Approach 1:
The patent implements a universal data collection system using RDMA technology that can serve multiple different purposes (congestion prediction, crime prevention, demand prediction, etc.) without requiring separate dedicated infrastructure for each service, thereby achieving multi-functionality and service adaptability
2Speed
If data is transferred using conventional network protocols through CPU processing, then the system can maintain compatibility with existing network infrastructure, but the CPU load increases and data transfer latency increases
Solution Approach 1:
The patent replaces the conventional CPU-based data transfer mechanism with RDMA technology that enables direct memory-to-memory data transfer between devices, eliminating the need for CPU intervention in the data transfer path, thereby reducing CPU load and increasing transfer speed
3Productivity
If conventional network interfaces are used for data aggregation from multiple terminals, then the system can maintain ease of operation with standard networking, but the data aggregation efficiency is insufficient for real-time processing
Solution Approach 1:
The patent substitutes conventional network interface card (NIC) operations with RDMA-capable network interfaces that enable direct memory access for data aggregation, bypassing the operating system kernel and CPU, thereby achieving high-speed real-time data collection from multiple terminals with minimal latency
Data Source
AI summary
A data processing system includes a local arrogation node including first processing circuitry configured to aggerate data captured by a plurality of cameras, and a first remote direct memory access network interface card (RDMA NIC) configured to transmit the data to a remote node using RDMA. The data processing system includes the remote node including a second remote direct memory access network interface card (RDMA NIC), and second processing circuitry configured to perform predetermined processing on the data through the second RDMA NIC.


