Data Stream Synchronization via Comparator Modules
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data mirroring and redundancy systems face challenges in maintaining precise synchronization of data streams across different locations due to latency, bandwidth requirements, and complexity, leading to delayed and incomplete data, as well as difficulties in identifying and correcting discrepancies between data streams.
Innovation Solution
A system comprising data handling systems at different locations with a comparator module that compares and measures discrepancies between data streams, generates indicators for higher quality data sections, and duplicates these sections to maintain synchronization, allowing for real-time correction and efficient data transfer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is transferred from main system to mirror system via communications network, then redundancy is provided, but latency causes delayed and incomplete data on mirror system
Solution Approach 1:
The patent segments the data transfer process by implementing independent data handling systems at multiple locations that each receive and process data streams separately from the same plurality of data providers, rather than transferring entire data sets through a network. This segmentation allows each location to maintain current, complete data independently.
Solution Approach 2:
The patent applies preliminary action by having multiple locations simultaneously receive and process data streams from data providers in advance, rather than waiting for data to be generated at one location and then transferred. This ensures all locations have current data available before any comparison or correction is needed.
2Reliability
If entire data set is transferred from one system to another, then redundancy is achieved, but large bandwidth and long transfer periods are required
Solution Approach 1:
The patent extracts only the necessary comparison function from the data transfer process. Instead of transferring entire data sets, the system uses comparator modules to identify specific discrepancies between data streams at different locations, and only transfers corrections for those specific discrepancies, dramatically reducing bandwidth requirements.
Solution Approach 2:
The patent segments the data handling approach by implementing independent parallel processing at multiple locations rather than centralized transfer. Each location processes its own data stream independently, and only minimal correction data needs to be exchanged, improving overall system productivity.
3Measurement precision
If data streams are processed independently at separate locations, then early problem detection is possible, but synchronization and discrepancy correction become difficult
Solution Approach 1:
The patent implements feedback through comparator modules that continuously compare data streams from different locations and provide feedback about discrepancies. This feedback mechanism automatically identifies synchronization issues and triggers corrective actions, simplifying the overall synchronization process while maintaining independent processing benefits.
Solution Approach 2:
The patent introduces comparator modules as intermediary components that facilitate synchronization between independently processing locations. These intermediaries automatically detect and manage discrepancies without requiring complex manual synchronization protocols, reducing system complexity.
4Manufacturing precision
If system is shut down to correct data stream problems, then data accuracy is maintained, but productivity and timely availability of data are reduced
Solution Approach 1:
The patent applies preliminary action by having multiple locations simultaneously process data streams in advance, so that when discrepancies are detected, corrected data is already available from another location. This eliminates the need to shut down the system, maintaining both accuracy and productivity.
Solution Approach 2:
The patent implements discarding and recovering by identifying problematic sections of data streams through comparison, discarding only those specific problematic sections, and recovering the correct data from another location's data stream. This minimal correction approach maintains data accuracy while keeping the system running.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Systems and methods for synchronisation of independent first (302, 304) and second (310, 312) data handling systems, where each of the first and second data handling systems receive data from the same plurality of data providers (301), the first and second data handling systems process first (302) and second (310) data streams (600) generated from the received data from the plurality of data providers, wherein the first and second data streams are near identical, and wherein the first and second data handling systems are disposed in different locations, are disclosed. A first data handling system (302, 304) at a first location comprises: a first data stream generation module (302), comprising a first compiler for combining received data from the plurality of data providers into a first data stream (600); and a first processing and storage system (304), comprising: a first data store (402) for storing the first data stream; a first duplicator module (404) for duplicating data from the first data stream; a first combiner module (406) for combining received data with the first data stream; and at least one first communications port for transmitting information and/or data to and receiving information and/or data from a communications network (308). A second data handling system (310, 312) at a second location remote from the first location, comprises: a second data stream generation module (310), comprising a second compiler for combining received data from the plurality of data providers into a second data stream (600); and a second processing and storage system (312), comprising: a second data store (402) for storing the second data stream; a second duplicator module (404) for duplicating data from the second data stream; a second combiner module (406) for combining received data with the second data stream; and at least one second communications port for transmitting information and/or data to and receiving information and/or data from a communications network (308). The system further comprises at least one comparator module (306, 314) for comparing information from the first and second data streams. The first and second processing and storage systems are configured to, via the at least one first and second communications ports, transmit information to and from the at least one comparator module, and to transmit data between the first and second processing and storage systems, via the communications network. The first and second data stream generation modules are configured to generate first and second data streams for processing and storage in the respective first and second processing and storage systems. Following receipt of the first and second data streams at the first and second processing and storage systems, the first processing and storage system is configured to transmit (502) first information from a most recent section (608) of the first data stream to the comparator module, and the second processing and storage system is configured to transmit second information from a corresponding most recent section of the second data stream to the comparator module. The comparator module is configured to: compare (504) the first and second information; measure a value for discrepancy between the first and second information; test (506) the discrepancy value against a threshold; and, where the discrepancy value exceeds the threshold, generate: from the first and second information an indicator (508) of which of said first data stream most recent section and said second data stream corresponding most recent section contains a higher quality of data; and a duplication instruction (422) for the duplicator module of the respective processing and storage system whose data stream has been indicated by the indicator to contain the higher quality of data. The duplicator module for the indicated data stream is configured to, if instructed, duplicate (422) the data from said most recent section of the indicated data stream. The processing and storage system for the indicated data stream is configured to transmit, via the communications port, the duplicated data to the combiner module of the processing and storage system for the other stream. The combiner module for the other stream is configured to replace (424, 707) said corresponding most recent section of the other stream with the duplicated data from said most recent section (710) of the indicated stream.