Bidirectional synchronous data system between double data sources
By using a bidirectional data synchronization system between two data sources, the problem of the inability to achieve bidirectional synchronization in traditional synchronization methods is solved, data consistency and real-time performance are achieved, the stability and reliability of the system are improved, and the integrity and security of the data are ensured.
Patent Information
- Application Number
- CN202410949467.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-16
- Publication Date
- 2024-11-08
AI Technical Summary
Traditional data synchronization methods only support one-way synchronization and cannot meet the needs of two-way synchronization. They suffer from synchronization delays and data conflicts, and cannot ensure data consistency and real-time performance between different data sources.
A bidirectional synchronous data system between two data sources is adopted, including a data monitoring module, a data comparison module, a data transmission module, a data verification module, a conflict resolution module, a log recording module, an access control module, and a system monitoring module, to achieve real-time monitoring, bidirectional synchronization, encrypted transmission, automatic conflict resolution, log recording, and access control.
It achieves real-time bidirectional synchronization between two data sources, ensuring data consistency and real-time performance, improving system stability and reliability, reducing unnecessary synchronization operations, ensuring data integrity and security, and preventing data leakage and illegal operations.
Smart Images

Figure CN118916340A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of computer technology, and in particular to a bidirectional synchronous data system between dual data sources. Background Art
[0002] With the development of network technology, a single data source can no longer meet the needs of many business scenarios and business systems. With the development of the Internet, the amount of user data is increasing, and software systems are developing in a distributed direction. A single data source cannot meet the needs in many occasions, so the database is also developing towards multiple data sources. Especially for e-commerce websites, the data source of the e-commerce platform system is different from the data source of the backend management system. However, although it is a dual data source, if there is a lot of data between the two data sources that needs to be shared and kept consistent in real time, such as product data, product prices, product images, product color and size, product performance, etc., if these data that need to be shared are not synchronized, it will cause differences in this part of the shared data between the two data sources, resulting in unpredictable consequences. With the rapid development of information technology, the amount of data generated by enterprises and institutions in the operation process is constantly increasing, and the data sources are becoming increasingly diversified. In this context, how to ensure the consistency and real-time performance of data between different data sources has become an urgent problem to be solved.
[0003] Traditional data synchronization methods often only support one-way synchronization and cannot meet the needs of two-way synchronization. There are problems of synchronization delay and data conflict, which cannot ensure the consistency and real-time performance of data, and cannot meet the needs of data sharing and real-time updating between multiple data sources in distributed systems.
[0004] To this end, we propose a bidirectional synchronization data system between dual data sources. Summary of the invention
[0005] The present invention mainly solves the technical problems existing in the above-mentioned prior art and provides a bidirectional synchronous data system between dual data sources.
[0006] In order to achieve the above-mentioned purpose, the present invention adopts the following technical scheme: a bidirectional data synchronization system between two data sources, including a data monitoring module, a data comparison module, a data transmission module, a data verification module, a conflict resolution module, a log recording module, a permission management module and a system monitoring module. The data monitoring module is responsible for real-time monitoring of data changes in the two data sources. Once a data change is found, a synchronization operation is immediately triggered. The data comparison module is used to compare the data in the two data sources and identify the data items that need to be synchronized. Through an efficient data comparison algorithm, the difference data can be found quickly and accurately, reducing unnecessary synchronization operations.
[0007] Preferably, the data transmission module is responsible for transmitting the data to be synchronized from one data source to another data source. The data transmission module adopts encryption transmission technology to ensure the integrity and security of the data and supports the breakpoint resume function.
[0008] Preferably, the data verification module verifies the received data after the data transmission is completed to ensure the accuracy and integrity of the data. If any data anomaly or error is found, error processing will be performed immediately and the synchronization operation will be re-performed.
[0009] Preferably, the conflict resolution module can automatically resolve conflicts when conflicts occur in data between two data sources. The conflict resolution module can automatically determine and process conflicting data based on preset timestamp and version number conflict resolution strategies to ensure data correctness and consistency.
[0010] Preferably, the log recording module is used to record the system's operation log and synchronization log, which is convenient for users to perform troubleshooting and data analysis. The log recording module also supports log export and backup functions to ensure the security and maintainability of the log.
[0011] Preferably, the authority management module is used to manage the authority of system users to ensure that only authorized users can access and operate the system. Through strict authority management, data leakage and illegal operations can be effectively prevented.
[0012] Preferably, the system monitoring module is responsible for monitoring the operating status and performance indicators of the system. Once an abnormal situation is found, an alarm and processing will be immediately issued to ensure the stability and reliability of the system.
[0013] Beneficial Effects
[0014] The present invention provides a bidirectional data synchronization system between two data sources. It has the following beneficial effects:
[0015] (1) The bidirectional data synchronization system between two data sources integrates a data monitoring module, a data comparison module, a data transmission module, a data verification module, a conflict resolution module, a log recording module, a permission management module and a system monitoring module, and has the beneficial effects of real-time bidirectional synchronization, efficient data comparison, encrypted transmission, automatic conflict resolution, log recording, permission management and system monitoring. It can meet the needs of data sharing and real-time updating between multiple data sources in a distributed system, improve the stability and reliability of the system, realize real-time bidirectional synchronization between two data sources, ensure data consistency and real-time performance, and meet the needs of data sharing and real-time updating between multiple data sources in a distributed system.
[0016] (2) The bidirectional data synchronization system between two data sources is provided with a data comparison module. The data comparison module adopts an efficient data comparison algorithm, which can quickly and accurately find the difference data that needs to be synchronized, reduce unnecessary synchronization operations, and improve the efficiency of data synchronization.
[0017] (3) A bidirectional data synchronization system between two data sources is provided with a data transmission module. The data transmission module adopts encryption transmission technology to ensure the integrity and security of the data and supports the breakpoint resume function. Even if an unexpected interruption occurs during the transmission process, the transmission can be continued from the breakpoint, thereby improving the reliability of data synchronization.
[0018] (4) The bidirectional data synchronization system between two data sources is provided with a conflict resolution module, which can automatically handle data conflicts according to a preset conflict resolution strategy, thereby ensuring the correctness and consistency of the data and avoiding the tediousness and errors caused by manual conflict handling.
[0019] (5) A bidirectional data synchronization system between two data sources is provided with a log recording module, which records the system's operation log and synchronization log, making it convenient for users to perform troubleshooting and data analysis. The log export and backup functions are also supported, ensuring the security and maintainability of the log.
[0020] (6) The bidirectional data synchronization system between the two data sources is provided with a permission management module. The permission management module ensures that only authorized users can access and operate the system through strict permission management, thereby effectively preventing data leakage and illegal operations.
[0021] (7) The bidirectional synchronous data system between the two data sources is provided with a system monitoring module. The system monitoring module monitors the operating status and performance indicators of the system in real time. Once an abnormal situation is found, an alarm is immediately issued and processed, thereby ensuring the stability and reliability of the system. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] Figure 1 It is a system module diagram of the present invention. DETAILED DESCRIPTION
[0023] In order to more clearly illustrate the implementation methods of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for the implementation methods or the description of the prior art. Obviously, the drawings described below are only exemplary, and for ordinary technicians in this field, other implementation drawings can be derived from the provided drawings without creative work.
[0024] The structures, proportions, sizes, etc. illustrated in this specification are only used to match the contents disclosed in the specification so as to facilitate understanding and reading by persons familiar with the technology. They are not used to limit the conditions under which the present invention can be implemented, and therefore have no substantial technical significance. Any structural modification, change in proportion or adjustment of size shall still fall within the scope of the technical contents disclosed in the present invention without affecting the effects and purposes that can be achieved by the present invention.
[0025] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.
[0026] In the description of the embodiments of the present invention, it should be noted that the terms "center", "upper", "lower", "inner", "outer", "side", etc. indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings, or the orientation or positional relationship in which the invented product is usually placed when in use, which is only for the convenience of describing the present invention and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first", "second", etc. are only used to distinguish the description, and cannot be understood as indicating or implying relative importance.
[0027] In the description of the embodiments of the present invention, it is also necessary to explain that, unless otherwise clearly specified and limited, the terms "set", "install", "connect", and "connect" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the embodiments of the present invention can be understood according to specific circumstances.
[0028] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0029] Embodiment 1: A bidirectional data synchronization system between two data sources, such as Figure 1As shown, it includes 10, including a data monitoring module, a data comparison module, a data transmission module, a data verification module, a conflict resolution module, a log recording module, a permission management module and a system monitoring module. The data monitoring module is responsible for real-time monitoring of data changes in the two data sources. Once a data change is found, the synchronization operation is immediately triggered. The data comparison module is used to compare the data in the two data sources and identify the data items that need to be synchronized. Through an efficient data comparison algorithm, the difference data can be quickly and accurately found to reduce unnecessary synchronization operations. The data transmission module is responsible for transmitting the data that needs to be synchronized from one data source to another. The data transmission module adopts encrypted transmission technology to ensure the integrity and security of the data and supports breakpoint resumption function. The data verification module will verify the received data after the data transmission is completed to ensure the accuracy and integrity of the data. If the data is abnormal or wrong, the error processing will be performed immediately and the synchronization operation will be re-performed. The conflict resolution module can automatically resolve the conflict when the data in the two data sources conflict. The conflict resolution module can automatically judge and process the conflicting data according to the preset timestamp and version number conflict resolution strategy to ensure the correctness and consistency of the data. The recording module is used to record the system's operation log and synchronization log, which is convenient for users to perform troubleshooting and data analysis. At the same time, the logging module also supports log export and backup functions to ensure the security and maintainability of the log. The authority management module is used to manage the authority of system users to ensure that only authorized users can access and operate the system. Through strict authority management, data leakage and illegal operations can be effectively prevented. The system monitoring module is responsible for monitoring the system's operating status and performance indicators. Once an abnormal situation is found, it will immediately alarm and process to ensure the stability and reliability of the system. By integrating the data monitoring module, data comparison module, data transmission module, data verification module, conflict resolution module, logging module, authority management module and system monitoring module, it has the beneficial effects of real-time two-way synchronization, efficient data comparison, encrypted transmission, automatic conflict resolution, logging, authority management and system monitoring. It can meet the needs of data sharing and real-time updating between multiple data sources in a distributed system, improve the stability and reliability of the system, and realize real-time two-way synchronization between dual data sources to ensure data consistency and real-time performance, meeting the needs of data sharing and real-time updating between multiple data sources in a distributed system.
[0030] Embodiment 2: Based on Embodiment 1, Figure 1As shown, the data comparison module is used to compare the data in the two data sources and identify the data items that need to be synchronized. Through the efficient data comparison algorithm, the difference data can be found quickly and accurately, reducing unnecessary synchronization operations. The data transmission module is responsible for transmitting the data that needs to be synchronized from one data source to another. The data transmission module adopts encryption transmission technology to ensure the integrity and security of the data and supports breakpoint resume function. The data verification module will verify the received data after the data transmission is completed to ensure the accuracy and integrity of the data. If the data is abnormal or wrong, the error processing will be carried out immediately and the synchronization operation will be re-performed. The conflict resolution module can automatically resolve the conflict when the data in the two data sources conflict. The conflict resolution module can automatically judge and handle the conflict data according to the preset timestamp and version number conflict resolution strategy. The logging module is used to record the system's operation log and synchronization log, which is convenient for users to troubleshoot and analyze data. At the same time, the logging module also supports log export and backup functions to ensure the security and maintainability of the log. The authority management module is used to manage the authority of system users to ensure that only authorized users can access and operate the system. Through strict authority management, data leakage and illegal operations can be effectively prevented. The system monitoring module is responsible for monitoring the system's operating status and performance indicators. Once an abnormal situation is found, it will immediately alarm and process it to ensure the stability and reliability of the system. By setting up a data comparison module, the data comparison module uses an efficient data comparison algorithm to quickly and accurately find the difference data that needs to be synchronized, reducing unnecessary synchronization operations and improving the efficiency of data synchronization.
[0031] Embodiment 3: Based on Embodiment 1 and Embodiment 2, Figure 1As shown in the figure, the data transmission module is responsible for transmitting the data that needs to be synchronized from one data source to another. The data transmission module adopts encrypted transmission technology to ensure the integrity and security of the data and supports the breakpoint resume function. The data verification module will verify the received data after the data transmission is completed to ensure the accuracy and integrity of the data. If the data is abnormal or wrong, it will immediately handle the error and re-synchronize the operation. The conflict resolution module can automatically resolve the conflict when the data in the two data sources conflict. The conflict resolution module can automatically judge and process the conflicting data according to the preset timestamp and version number conflict resolution strategy to ensure the correctness and consistency of the data. The log recording module is used to record the system's operation log and synchronization log, which is convenient for users to The system can perform troubleshooting and data analysis. At the same time, the log recording module also supports log export and backup functions to ensure the security and maintainability of the log. The authority management module is used to manage the authority of system users to ensure that only authorized users can access and operate the system. Through strict authority management, data leakage and illegal operations can be effectively prevented. The system monitoring module is responsible for monitoring the operating status and performance indicators of the system. Once an abnormal situation is found, it will immediately alarm and process it to ensure the stability and reliability of the system. By setting up a data transmission module, the data transmission module uses encrypted transmission technology to ensure the integrity and security of the data, and supports breakpoint resumption. Even if an unexpected interruption occurs during the transmission process, the transmission can continue from the breakpoint, which improves the reliability of data synchronization.
[0032] Embodiment 4: Based on Embodiment 1, Embodiment 2 and Embodiment 3, Figure 1As shown, the data verification module will verify the received data after the data transmission is completed to ensure the accuracy and integrity of the data. If the data is abnormal or wrong, the error processing will be performed immediately and the synchronization operation will be re-performed. The conflict resolution module can automatically resolve the conflict when the data in the two data sources conflict. The conflict resolution module can automatically judge and process the conflicting data according to the preset timestamp and version number conflict resolution strategy to ensure the correctness and consistency of the data. The log recording module is used to record the system's operation log and synchronization log, which is convenient for users to troubleshoot and analyze data. At the same time, the log recording module also supports log export and backup functions to ensure the security and maintainability of the log. The permission management module is used to manage the permissions of system users to ensure that only authorized users can access and operate the system. Through strict permission management, data leakage and illegal operations can be effectively prevented. The system monitoring module is responsible for monitoring the system's operating status and performance indicators. Once an abnormal situation is found, an alarm and processing will be immediately issued to ensure the stability and reliability of the system. By setting up a conflict resolution module, the conflict resolution module can automatically handle data conflicts according to the preset conflict resolution strategy to ensure the correctness and consistency of the data, avoiding the tediousness and errors caused by manual conflict processing. By setting up a log recording module, the log recording module records the system's operation log and synchronization log, which is convenient for users to perform troubleshooting and data analysis. It also supports log export and backup functions to ensure the security and maintainability of the log.
[0033] Embodiment 5: Based on Embodiment 1, Embodiment 2, Embodiment 3 and Embodiment 4, Figure 1 As shown, the conflict resolution module can automatically resolve conflicts when data in two data sources conflict. The conflict resolution module can automatically judge and process conflicting data according to the preset timestamp and version number conflict resolution strategy to ensure the correctness and consistency of the data. The log recording module is used to record the system's operation log and synchronization log, which is convenient for users to troubleshoot and analyze data. At the same time, the log recording module also supports log export and backup functions to ensure the security and maintainability of the log. The authority management module is used to manage the authority of system users to ensure that only authorized users can access and operate the system. Through strict authority management, data leakage and illegal operations can be effectively prevented. The system monitoring module is responsible for monitoring the system's operating status and performance indicators. Once an abnormal situation is found, an alarm and processing will be immediately performed to ensure the stability and reliability of the system. By setting up the authority management module, the authority management module ensures that only authorized users can access and operate the system through strict authority management, effectively preventing data leakage and illegal operations. By setting up the system monitoring module, the system monitoring module monitors the system's operating status and performance indicators in real time. Once an abnormal situation is found, an alarm and processing will be immediately performed to ensure the stability and reliability of the system.
[0034] The working principle of the present invention is as follows: first, the data comparison module is started, and an efficient data comparison algorithm is used to quickly and accurately find the difference data that needs to be synchronized. This step reduces unnecessary synchronization operations and improves the efficiency of data synchronization. Then, the data transmission module is responsible for transmitting the data that needs to be synchronized from one data source to another. The data transmission module uses encrypted transmission technology to ensure the integrity and security of the data, and supports the breakpoint resume function. Even if an unexpected interruption occurs during the transmission process, the transmission can continue from the breakpoint, further improving the reliability of data synchronization. After the data transmission is completed, the data verification module will verify the received data to ensure the accuracy and integrity of the data. If the transmission is interrupted, the data verification module will verify the received data to ensure the accuracy and integrity of the data. If data anomalies or errors are found, the data verification module will immediately handle the errors and re-synchronize to ensure the accuracy of the data. When data conflicts occur in two data sources, the conflict resolution module will automatically resolve the conflicts. The conflict resolution module automatically determines and processes the conflicting data according to the preset timestamp and version number conflict resolution strategy to ensure the correctness and consistency of the data. This step avoids the tediousness and errors caused by manual conflict handling and improves the efficiency and accuracy of data synchronization. During the entire data synchronization process, the log recording module will record the system's operation log and synchronization log in real time. These log information not only facilitates users to troubleshoot and analyze data, but also through log export and backup functions, The security and maintainability of the log are ensured. At the same time, the authority management module is responsible for managing the authority of system users to ensure that only authorized users can access and operate the system. Through strict authority management, data leakage and illegal operations are effectively prevented, and the security of the system and the confidentiality of data are protected. Next, the data monitoring module is responsible for real-time monitoring of data changes in the two data sources. When any changes occur in the data in the data source, the data monitoring module will immediately capture these changes and trigger the corresponding data synchronization process. By real-time monitoring of data changes, the data monitoring module ensures the real-time and consistency of the data. The data monitoring module uses efficient data monitoring technology to accurately identify data additions, deletions, The data comparison module will then compare the change information with another data source to find out the difference data that needs to be synchronized. Finally, the system monitoring module will monitor the operating status and performance indicators of the system in real time. Once an abnormal situation is found, the system monitoring module will immediately alarm and process it to ensure the stability and reliability of the system. This step ensures the normal operation of the system and improves the reliability and availability of data synchronization. The working principle of the present invention is to achieve efficient, accurate and secure synchronization of data through the collaborative work of multiple modules. At the same time, the stability and security of the system are ensured through functions such as log recording, permission management and system monitoring.
[0035] The above shows and describes the basic principles and main features of the present invention and the advantages of the present invention. It should be understood by those skilled in the art that the present invention is not limited to the above embodiments. The above embodiments and descriptions are only for explaining the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, which fall within the scope of the present invention to be protected. The scope of protection of the present invention is defined by the attached claims and their equivalents.
Claims
1. A bidirectional data synchronization system between two data sources, characterized in that: It includes data monitoring module, data comparison module, data transmission module, data verification module, conflict resolution module, log recording module, permission management module and system monitoring module. The data monitoring module is responsible for real-time monitoring of data changes in the two data sources. Once data changes are found, the synchronization operation is triggered immediately. The data comparison module is used to compare the data in the two data sources and identify the data items that need to be synchronized. Through efficient data comparison algorithms, it can quickly and accurately find the difference data and reduce unnecessary synchronization operations.
2. The bidirectional data synchronization system between two data sources according to claim 1, characterized in that: The data transmission module is responsible for transmitting the data that needs to be synchronized from one data source to another data source. The data transmission module adopts encryption transmission technology to ensure the integrity and security of the data and supports the breakpoint resume function.
3. The bidirectional data synchronization system between two data sources according to claim 1, characterized in that: The data verification module will verify the received data after the data transmission is completed to ensure the accuracy and integrity of the data. If any data abnormality or error is found, error processing will be performed immediately and the synchronization operation will be re-performed.
4. The bidirectional data synchronization system between two data sources according to claim 1, characterized in that: The conflict resolution module can automatically resolve conflicts when conflicts occur in data between two data sources. The conflict resolution module can automatically determine and process conflicting data based on preset timestamp and version number conflict resolution strategies to ensure the correctness and consistency of data.
5. The bidirectional data synchronization system between two data sources according to claim 1, characterized in that: The log recording module is used to record the system's operation log and synchronization log, which is convenient for users to perform troubleshooting and data analysis. At the same time, the log recording module also supports log export and backup functions to ensure the security and maintainability of the log.
6. The bidirectional data synchronization system between two data sources according to claim 1, characterized in that: The authority management module is used to manage the authority of system users to ensure that only authorized users can access and operate the system. Through strict authority management, data leakage and illegal operations can be effectively prevented.
7. The bidirectional data synchronization system between two data sources according to claim 1, characterized in that: The system monitoring module is responsible for monitoring the operating status and performance indicators of the system. Once an abnormal situation is found, it will immediately issue an alarm and handle it to ensure the stability and reliability of the system.
Citation Information
Cited By
Grouping quality management system and method based on dynamic data source
CN119624261A
