Parallel Data Processing Segregation for Fault Recovery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face challenges in processing real-time data and accumulated data from computing devices affected by faults without impacting the processing of real-time data from other devices, leading to latency and strain on the application.
Innovation Solution
A method and apparatus for parallel processing of real-time data and accumulated data, where the data from affected devices is segregated and processed in separate units, allowing for efficient handling without impacting other devices, using ontology and normalization circuitry to associate metadata and process the data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If real-time data and accumulated data from fault-affected devices are processed together in the same processing unit, then the system can handle all data centrally, but this causes latency and strain on the application while impacting the processing of real-time data from other devices
Solution Approach 1:
The patent divides the data processing system into separate processing units: a real-time data processing unit for handling real-time data from all devices, and an accumulated data processing unit for handling accumulated data from fault-affected devices. This segmentation allows parallel processing of different data types without mutual interference, resolving the contradiction between handling all data centrally and avoiding latency for other devices.
2Reliability
If the system processes accumulated data from fault-affected devices, then data from these devices can be recovered, but this creates strain on the application and impacts real-time data processing performance
Solution Approach 1:
The patent separates accumulated data processing from real-time data processing by creating distinct processing units. The accumulated data processing unit handles fault-recovered data independently, preventing it from straining the real-time data processing unit and thus maintaining overall system performance while still achieving fault tolerance.
Solution Approach 2:
The patent introduces an intermediary mechanism that receives accumulated data from fault-affected devices and processes it through a dedicated accumulated data processing unit before integrating results. This intermediary approach prevents direct interference with real-time processing, maintaining system performance while recovering fault data.
Data Source
AI summary
Systems, apparatuses, methods, and computer program products for parallel processing of real-time data and accumulated data are provided. For example, a method provided herein may include determining that a computing device is affected by a fault during a first time period. The method may include receiving real-time data from the computing device via a network during a second time period. The method may include receiving accumulated data from the computing device via a network during the second time period. The method may include directing the real-time data to a real-time data processing unit and the accumulated data to an accumulated data processing unit. The method may include processing the real-time data with the real-time data processing unit and the accumulated data with the accumulated data processing unit. The method may include routing the real-time data and the accumulated data following the processing to one or more databases.