Event Information Data Hubs with RDMA for Multi-Service Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional systems require specific infrastructure and construction for each service purpose, making it difficult to provide various services using data collected from multiple terminals.
Innovation Solution
A data processing system utilizing an event information generating apparatus and a data processing apparatus that includes means for generating and transmitting event information to a broker device, and acquiring and processing data from a data hub node device, employing RDMA for efficient data communication.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional systems construct infrastructure and analysis systems for each specific service purpose, then the service can be provided with dedicated resources, but it becomes difficult to provide various services using data from multiple terminals and increases system complexity
Solution Approach 1:
The patent implements a universal data collection infrastructure that can serve multiple service purposes simultaneously. The system collects data from multiple terminals using a standardized approach, and the same infrastructure supports various analysis services (congestion prediction, crime prevention, accident prevention, etc.) without requiring separate construction for each service. This multi-functional platform enables any service to be provided by simply configuring the appropriate analysis algorithms on top of the shared data collection system.
Solution Approach 2:
The patent segments the system into independent functional modules: a standardized data collection layer that gathers data from multiple terminals, a data storage layer, and service-specific analysis layers. This segmentation allows the data collection infrastructure to be reused across different services while each service maintains its own analysis logic. The modular architecture reduces overall system complexity by separating concerns and enabling independent development and deployment of different services.
2Productivity
If data is collected and transmitted using conventional methods, then data can be processed, but CPU load increases and data transfer speed decreases
Solution Approach 1:
The patent replaces conventional CPU-intensive data transmission and processing mechanisms with RDMA (Remote Direct Memory Access) technology. RDMA enables direct memory-to-memory data transfer between devices without involving the CPU for data movement operations. This substitution dramatically reduces CPU load during data collection and transmission while achieving high-speed data transfer. The system uses RDMA to transmit collected data directly from the data collection infrastructure to storage and analysis systems, eliminating CPU bottlenecks in the data path.
Data Source
AI summary
A data processing system includes an event information generating apparatus including generation means that receives data collected from a plurality of terminals, generates event information from the data, and transmits the generated event information to a broker device. The event information generating apparatus includes transmission means that transmits, to a data hub node device corresponding to the event information generated by the generation means, among a plurality of data hub node devices that differ for each event information, data corresponding to the event information. The data processing system includes a data processing apparatus including acquisition means that acquires event information corresponding to a specific service from a broker device. The data processing apparatus includes processing means that acquires the data from a data hub node device that stores the data corresponding to the event information, to execute processing using the data.