A Method for Real-Time Synchronization of Financial Information Data in a Communication System
By determining the interactive data information of distributed nodes in the financial communication system, establishing message queues and data transmission channels, performing full and incremental backups, and monitoring the fault recovery data in real time, the problem of financial information data synchronization is solved and stable and reliable real-time transmission is achieved.
Patent Information
- Application Number
- CN202510329679.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-03-20
- Publication Date
- 2025-07-29
- Estimated Expiration
- 2045-03-20
AI Technical Summary
In the financial field, real-time synchronization of financial information data between different systems is difficult to achieve, and it is prone to interruption due to network problems or system failures, affecting transaction accuracy and compliance.
By determining the interactive data information of distributed nodes based on financial communication tasks, establishing a message queue, determining the data transmission channel based on real-time load conditions, performing synchronous transmission, and performing full and incremental backups, establishing a data recovery strategy, monitoring faults in real time and data recovery.
Real-time synchronous transmission of financial information data is realized, the stability and reliability of data transmission is ensured, network delay and redundant data transmission are reduced, and data can be recovered in time in the event of a failure.
Smart Images

Figure CN119854321B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of data communication technology, and particularly relates to a method for real-time synchronization of financial information data in a communication system. Background Art
[0002] In the financial field, the consistency and accuracy of data are crucial. For example, in banks and financial institutions, information such as customer transactions, market data, risk management, and anti-fraud needs to be synchronized between different systems in real-time or near real-time to ensure the accuracy and compliance of transactions. If the data is inconsistent, it may lead to problems such as incorrect financial data and distorted customer information, which in turn affect business decisions and risk management.
[0003] During the synchronization process of financial data, it may fail due to network problems, system failures, or other technical issues, resulting in the interruption or failure of the data synchronization process. Secondly, for scenarios that require real-time data synchronization, due to factors such as network latency and system response time, real-time data synchronization is often difficult to achieve. Therefore, how to achieve real-time synchronization of financial information data in a communication system is a problem currently faced. Summary of the Invention
[0004] The present invention provides a method for real-time synchronization of financial information data in a communication system to solve the problems raised in the background art.
[0005] A method for real-time synchronization of financial information data in a communication system includes:
[0006] S1: Determine the interaction data information of the distributed nodes of the communication system based on the financial communication task, and determine the transmission data of the node database based on the interaction data information;
[0007] S2: Establish a message queue based on the transmission data of the node database, determine the data transmission channel in combination with the real-time load conditions of the distributed nodes, and synchronously transmit the transmission data based on the data transmission channel;
[0008] S3: Perform full backup and incremental backup on the financial information data in the communication system based on the data transmission log, and establish a data recovery strategy;
[0009] S4: Perform real-time fault monitoring on the synchronous transmission, and perform timely data recovery on the data transmission process in combination with the data recovery strategy to complete the synchronous transmission.
[0010] Preferably, in S1, determining the interaction data information of the distributed nodes of the communication system based on the financial communication task includes:
[0011] Based on the financial communication task, determine the sender, receiver, and data characteristics of the data communication;
[0012] Determine the positions of the sender and the receiver in the distributed nodes, and based on the data characteristics and combined with the structure of the distributed nodes, set the transmission situation of data communication in the distributed nodes;
[0013] Obtain the interaction data information based on the sender, receiver, data characteristics of the data communication, and the transmission situation in the distributed nodes.
[0014] Preferably, in S1, based on the interaction data information, determining the transmission data of the node database includes:
[0015] Determine all transmission information based on the data interaction information, and determine the current data situation of all transmission information at the sender and the receiver;
[0016] Based on the current data situation of the sender and the receiver, determine the incremental data information, and based on the incremental data information, determine the transmission data of the sender's node database.
[0017] Preferably, in S2, establishing a message queue based on the transmission data of the node database includes:
[0018] Divide the transmission data of the node database orderly according to a fixed data volume to obtain sequence data blocks;
[0019] Establish a message queue based on the sequence data blocks, and send the message queue to all distributed nodes participating in the transmission.
[0020] Preferably, in S2, determining the data transmission channel in combination with the real-time load situation of the distributed nodes includes:
[0021] Determine the available nodes based on the real-time load situation of the distributed nodes;
[0022] Based on the real-time load situation and the predicted load situation of the available nodes, determine the available time periods of the available nodes;
[0023] Based on the available time periods of the available nodes and the characteristics of the transmission data, determine the data transmission channel.
[0024] Preferably, in S2, synchronously transmitting the transmission data based on the data transmission channel includes:
[0025] Synchronously transmit the transmission data on the data transmission channel according to the message queue;
[0026] Record the transmission information during the synchronous transmission of the transmission data to generate a data transmission log.
[0027] Preferably, in S3, based on the data transmission log, perform a full backup and an incremental backup on the financial information data in the communication system, and establish a data recovery strategy, including:
[0028] Set a time period based on the data change frequency in the data transmission log, and perform a full backup on the financial information data in the communication system based on the time period;
[0029] Determine the incremental data based on the data change characteristics in the data transmission log, and perform an incremental backup on the financial information data in the communication system based on the incremental data;
[0030] Real-time monitor the status information and content information of the distributed nodes after the full backup and the incremental backup, and establish a data recovery strategy in combination with the location information of the distributed nodes.
[0031] Preferably, in S4, perform real-time fault monitoring on the synchronous transmission, and perform timely data recovery on the data transmission process in combination with the data recovery strategy, including:
[0032] Perform real-time fault monitoring on the synchronous transmission to determine the faulty node;
[0033] Based on the location characteristics of the faulty node in the data transmission channel, select an alternative node that meets the faulty node from the distributed nodes in combination with the data recovery strategy;
[0034] And obtain the replica data information from the replica record of the alternative node, and transfer the data traffic of the faulty node to the alternative node;
[0035] Perform data fusion analysis on the replica data information and the data traffic to obtain the fusion data, and determine the recovered data content and perform timely data recovery based on the fusion data.
[0036] Preferably, determine the incremental data information based on the current data conditions of the sender and the receiver, and determine the transmission data of the node database of the sender based on the incremental data information, including:
[0037] Obtain the data conditions of the sender and the receiver of the sender node database and the receiver node database after the last full change;
[0038] Obtain the transaction log, timestamp, and application layer log of the sender node database and the receiver node database after the last full change;
[0039] Obtain the first data change and the second data change of the sender node database and the receiver node database based on the transaction log, obtain the synchronization change information of the sender node database and the receiver node database based on the timestamp, and determine the first program change and the second program change of the sender node database and the receiver node database based on the application layer log;
[0040] Determine the initial change difference based on the first data change and the second data change, and perform synchronization change elimination on the initial change difference based on the synchronization change information to obtain the target change difference;
[0041] Respectively determine the database status change information of the sender node database and the receiver node database based on the first program change and the second program change, and determine the database self-difference between the sender node database and the receiver node database based on the database status change information;
[0042] Determine the initial data difference based on the sender data situation and the receiver data situation, and determine the current data difference based on the initial data difference and the target change difference;
[0043] Perform a synchronization impact analysis on the target change difference based on the synchronization impact of the database self-difference on the data attributes, obtain the changed data characteristics affected by synchronization, and obtain the data information associated with the changed data characteristics from the sender node database as supplementary data differences;
[0044] Establish a data difference table for the sender node database and the receiver node database based on the current data difference and the supplementary data difference;
[0045] Match the data interaction information with the data headers of the data difference table, and determine the transmission data of the sender's node database according to the matching result.
[0046] Preferably, based on the available time period of the available nodes and the characteristics of the transmission data, determine the data transmission channel, including:
[0047] Perform time matching on the time characteristics of the transmission data and the available time periods of the available nodes, and perform sequential ranking on the available nodes according to the time matching result to obtain multiple sequentially ranked nodes;
[0048] Based on the positional distribution of the sequentially ranked nodes with respect to the sender and the receiver, perform sequential weighting on the sequentially ranked nodes, and verify the sequential weighting based on the time matching result. If the verification passes, update the sequential weighting. If the verification fails, maintain the sequential ranking to obtain the target sequentially ranked nodes;
[0049] Obtain the data security feature, single transmission volume, and transmission speed from the characteristics of the transmitted data, and calculate the evaluation value of the target order-level node at this order level;
[0050] Select the target order-level node with the highest evaluation value at the same order level as the selected node at this order level;
[0051] Establish a data transmission channel based on the selected nodes at each order level.
[0052] Compared with the prior art, the present invention has achieved the following beneficial effects:
[0053] By determining the interactive data information of the distributed nodes of the communication system based on the financial communication task, and based on the interactive data information, determining the transmitted data of the node database, determining the accuracy and pertinence of the transmitted data, avoiding the influence of redundant data transmission on the transmission efficiency, establishing a message queue based on the transmitted data of the node database, combining the real-time load conditions of the distributed nodes, determining the data transmission channel, synchronously transmitting the transmitted data through the data transmission channel, ensuring the synchronization of data transmission by establishing a message queue, ensuring the smoothness of the transmission channel by combining the real-time load conditions of the distributed nodes, reducing network latency, performing full backup and incremental backup on the financial information data in the communication system based on the data transmission log, establishing a data recovery strategy to ensure that data can be recovered in a timely manner in case of any failure during the synchronization process, ensuring the stability and reliability of data transmission, and finally, realizing the real-time synchronous transmission of financial information data.
[0054] Other features and advantages of the present invention will be described in the following description, and, in part, will be obvious from the description, or will be understood by implementing the present invention. The objectives and other advantages of the present invention can be achieved and obtained through the structure specifically pointed out in this application document.
[0055] The technical solutions of the present invention will be further described in detail below through the drawings and embodiments. Description of the Drawings
[0056] The drawings are used to provide a further understanding of the present invention, and constitute a part of the description. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation to the present invention. In the drawings:
[0057] Figure 1 It is a flowchart of a method for real-time synchronization of financial information data in a communication system in an embodiment of the present invention;
[0058] Figure 2 It is a flowchart of determining interactive data information in an embodiment of the present invention;
[0059] Figure 3This is a flowchart for establishing a data recovery policy in an embodiment of the present invention. Detailed implementation manners
[0060] The preferred embodiments of the present invention will be described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are only for the purpose of illustrating and explaining the present invention, and are not intended to limit the present invention.
[0061] Embodiment 1
[0062] An embodiment of the present invention provides a method for real-time synchronization of financial information data in a communication system. As Figure 1 shown, it includes:
[0063] S1: Determine the interaction data information of the distributed nodes of the communication system based on the financial communication tasks, and determine the transmission data of the node database based on the interaction data information;
[0064] S2: Establish a message queue based on the transmission data of the node database, determine the data transmission channel in combination with the real-time load conditions of the distributed nodes, and synchronously transmit the transmission data based on the data transmission channel;
[0065] S3: Based on the data transmission log, perform full backup and incremental backup on the financial information data in the communication system, and establish a data recovery policy;
[0066] S4: Perform real-time fault monitoring on the synchronous transmission, and perform timely data recovery on the data transmission process in combination with the data recovery policy to complete the synchronous transmission.
[0067] In this embodiment, the interaction data information includes, for example, the data sender, the receiver, the data content, etc.
[0068] In this embodiment, the node database is set on each distributed node and is used to store the data of the node.
[0069] In this embodiment, the data transmission log is used to save the parameters during the data transmission process, such as time, size, content, etc.
[0070] In this embodiment, the full backup is a regular backup, and the incremental backup is a backup according to the transmission process.
[0071] The beneficial effects of the above design solution are as follows: By determining the interaction data information of the distributed nodes of the communication system based on the financial communication task, and based on the interaction data information, determining the transmission data of the node database, determining the accuracy and pertinence of the transmission data, avoiding the influence of redundant data transmission on the transmission efficiency, establishing a message queue based on the transmission data of the node database, combining the real-time load conditions of the distributed nodes, determining the data transmission channel, synchronously transmitting the transmission data based on the data transmission channel, ensuring the synchronization of data transmission by establishing a message queue, determining the data transmission channel by combining the real-time load conditions of the distributed nodes, ensuring the smoothness of the transmission channel, reducing network latency, performing full backup and incremental backup on the financial information data in the communication system based on the data transmission log, establishing a data recovery strategy to ensure that data can be recovered in a timely manner in case of any failure during the synchronization process, ensuring the stability and reliability of data transmission, and ultimately, achieving the real-time synchronous transmission of financial information data.
[0072] Embodiment 2
[0073] Based on Embodiment 1, an embodiment of the present invention provides a method for real-time synchronization of financial information data in a communication system, as Figure 2 shown. In S1, determining the interaction data information of the distributed nodes of the communication system based on the financial communication task includes:
[0074] Based on the financial communication task, determining the sender, receiver, and data characteristics of the data communication;
[0075] Determining the positions of the sender and receiver in the distributed nodes, and based on the data characteristics, combining the structure of the distributed nodes, setting the transmission situation of the data communication in the distributed nodes;
[0076] Obtaining the interaction data information based on the sender, receiver, data characteristics of the data communication, and the transmission situation in the distributed nodes.
[0077] The beneficial effects of the above design solution are as follows: By determining the sender, receiver, and data characteristics of the data communication based on the financial communication task; determining the positions of the sender and receiver in the distributed nodes, and based on the data characteristics, combining the structure of the distributed nodes, setting the transmission situation of the data communication in the distributed nodes, providing a basis for the determination of the transmission data.
[0078] Embodiment 3
[0079] Based on Embodiment 2, an embodiment of the present invention provides a method for real-time synchronization of financial information data in a communication system. In S1, determining the transmission data of the node database based on the interaction data information includes:
[0080] Determine all transmission information based on the data interaction information, and determine the current data status of all transmission information at the sender and the receiver;
[0081] Based on the current data status of the sender and the receiver, determine the incremental data information, and based on the incremental data information, determine the transmission data of the node database of the sender.
[0082] In this embodiment, all transmission information is all information characteristics that need to be transmitted to the receiver for this task, and the incremental data information is the data difference information of all transmission information between the sender and the receiver.
[0083] The beneficial effects of the above design scheme are: by determining all transmission information based on the data interaction information, determining the current data status of all transmission information at the sender and the receiver, determining the incremental data information based on the current data status of the sender and the receiver, and determining the transmission data of the node database of the sender based on the incremental data information, while ensuring the smooth execution of the financial communication task, reducing the data transmission volume, reducing the latency, and providing a basis for real-time data synchronization.
[0084] Embodiment 4
[0085] Based on Embodiment 1, an embodiment of the present invention provides a method for real-time synchronization of financial information data in a communication system. In S2, establishing a message queue based on the transmission data of the node database includes:
[0086] Divide the transmission data of the node database orderly according to a fixed data volume to obtain sequence data blocks;
[0087] Establish a message queue based on the sequence data blocks, and send the message queue to all distributed nodes participating in the transmission.
[0088] The beneficial effects of the above design scheme are: by dividing the transmission data of the node database orderly according to a fixed data volume to obtain sequence data blocks, establishing a message queue based on the sequence data blocks, and sending the message queue to all distributed nodes participating in the transmission for recording, ensuring the orderly transmission of the transmission data without loss.
[0089] Embodiment 5
[0090] Based on Embodiment 1, an embodiment of the present invention provides a method for real-time synchronization of financial information data in a communication system. In S2, determining the data transmission channel in combination with the real-time load conditions of the distributed nodes includes:
[0091] Based on the real-time load conditions of the distributed nodes, determine the available nodes;
[0092] Determine the available time period of the available nodes based on the real-time load condition and the predicted load condition of the available nodes;
[0093] Determine the data transmission channel based on the available time period of the available nodes and the characteristics of the transmitted data.
[0094] In this embodiment, the characteristics of the transmitted data are, for example, the time requirement for transmission, the amount of data transmitted at one time, and the security requirement, etc.
[0095] The beneficial effects of the above design solution are as follows: By determining the available nodes based on the real-time load condition of the distributed nodes, determining the available time period of the available nodes based on the real-time load condition and the predicted load condition of the available nodes, and determining the data transmission channel based on the available time period of the available nodes and the characteristics of the transmitted data, the smoothness of the transmission channel is ensured, and network latency is reduced.
[0096] Embodiment 6
[0097] Based on Embodiment 5, the embodiment of the present invention provides a method for real-time synchronization of financial information data in a communication system. In S2, synchronously transmit the transmitted data based on the data transmission channel, including:
[0098] Synchronously transmit the transmitted data on the data transmission channel according to the message queue;
[0099] Record the transmission information during the synchronous transmission of the transmitted data to generate a data transmission log.
[0100] In this embodiment, the transmission information includes transmission speed, transmission time, whether the transmission is successful, etc.
[0101] The beneficial effects of the above design solution are as follows: By synchronously transmitting the transmitted data on the data transmission channel according to the message queue, and recording the transmission information during the synchronous transmission of the transmitted data to generate a data transmission log, the synchronization of data transmission is ensured by establishing a message queue, the data transmission channel is determined, the smoothness of the transmission channel is ensured, and network latency is reduced.
[0102] Embodiment 7
[0103] Based on Embodiment 1, the embodiment of the present invention provides a method for real-time synchronization of financial information data in a communication system. As Figure 3 shown, in S3, based on the data transmission log, perform full backup and incremental backup on the financial information data in the communication system, and establish a data recovery strategy, including:
[0104] Set a time period based on the data change frequency in the data transmission log, and perform a full backup on the financial information data in the communication system based on the time period;
[0105] Determine incremental data based on the data change characteristics in the data transmission log, and perform incremental backup on the financial information data in the communication system based on the incremental data;
[0106] Real-time monitor the status information and content information of the distributed nodes after full backup and incremental backup, and establish a data recovery strategy in combination with the location information of the distributed nodes.
[0107] In this embodiment, the data recovery strategy is to determine a suitable recovery node, recovery method, recovery content, etc. based on the status information and content information of the distributed nodes and in combination with the location information of the distributed nodes.
[0108] The beneficial effects of the above design scheme are as follows: Set a time period based on the data change frequency in the data transmission log, perform full backup on the financial information data in the communication system based on the time period, determine incremental data based on the data change characteristics in the data transmission log, perform incremental backup on the financial information data in the communication system based on the incremental data, real-time monitor the status information and content information of the distributed nodes after full backup and incremental backup, and establish a data recovery strategy in combination with the location information of the distributed nodes, providing a basis for quickly recovering data in case of a failure, ensuring that data can be recovered in a timely manner in case of any failure during the synchronization process, guaranteeing the stability and reliability of data transmission, and ultimately realizing the real-time synchronous transmission of financial information data.
[0109] Embodiment 8
[0110] Based on Embodiment 1, the embodiment of the present invention provides a method for real-time synchronization of financial information data in a communication system. In S4, real-time fault monitoring is performed on the synchronous transmission, and timely data recovery is performed on the data transmission process in combination with the data recovery strategy, including:
[0111] Perform real-time fault monitoring on the synchronous transmission to determine the faulty node;
[0112] Based on the position characteristics of the faulty node in the data transmission channel, in combination with the data recovery strategy, select an alternative node from the distributed nodes that meets the faulty node;
[0113] And obtain replica data information from the replica record of the alternative node, and transfer the data traffic of the faulty node to the alternative node;
[0114] Perform data fusion analysis on the replica data information and data traffic to obtain fusion data, and determine the recovery data content based on the fusion data and perform timely data recovery.
[0115] In this embodiment, in combination with the data recovery strategy, the alternative node that meets the failed node is specifically selected from the distributed nodes according to the node characteristics and node conditions in the data recovery strategy to select the optimal alternative node.
[0116] The beneficial effects of the above design are as follows: Based on the position characteristics of the failed node in the data transmission channel, in combination with the data recovery strategy, an alternative node that meets the failed node is selected from the distributed nodes, and the replica data information is obtained from the replica record of the alternative node, and the data traffic of the failed node is transferred to the alternative node. The replica data information and the data traffic are subjected to data fusion analysis to obtain the fusion data. Based on the fusion data, the restored data content is determined and data recovery is performed in a timely manner, ensuring that data can be recovered in a timely manner in case of any failure during the synchronization process, guaranteeing the stability and reliability of data transmission. Finally, real-time synchronous transmission of financial information data is achieved.
[0117] Embodiment 9
[0118] Based on Embodiment 3, an embodiment of the present invention provides a method for real-time synchronization of financial information data in a communication system. Based on the current data conditions of the sender and the receiver, the incremental data information is determined, and based on the incremental data information, the transmission data of the node database of the sender is determined, including:
[0119] Obtain the data conditions of the sender and the receiver of the sender node database and the receiver node database after the last full change;
[0120] Obtain the transaction log, timestamp, and application layer log of the sender node database and the receiver node database after the last full change;
[0121] Based on the transaction log, obtain the first data change and the second data change of the sender node database and the receiver node database. Based on the timestamp, obtain the synchronization change information of the sender node database and the receiver node database. Based on the application layer log, determine the first program change and the second program change of the sender node database and the receiver node database;
[0122] Based on the first data change and the second data change, determine the initial change difference, and based on the synchronization change information, eliminate the synchronization change of the initial change difference to obtain the target change difference;
[0123] Based on the first program change and the second program change, respectively determine the database status change information of the sender node database and the receiver node database, and based on the database status change information, determine the database self-difference of the sender node database and the receiver node database;
[0124] Determine the initial data difference based on the data conditions of the sender and the receiver, and determine the current data difference based on the initial data difference and the target change difference;
[0125] Perform a synchronization impact analysis on the target change difference based on the impact of the database's own difference on the synchronization of data attributes, obtain the characteristics of the changed data affected by synchronization, and obtain the data information associated with the characteristics of the changed data from the sender node database as supplementary data differences;
[0126] Establish a data difference table for the sender node database and the receiver node database based on the current data difference and the supplementary data difference;
[0127] Match the data interaction information with the data headers of the data difference table, and determine the transmission data of the sender's node database according to the matching result.
[0128] In this embodiment, the synchronization change information is that the sender node database and the receiver node database change the same content at the same time.
[0129] In this embodiment, the database's own differences include differences in database program operation, user operations on the database, etc.
[0130] In this embodiment, the supplementary data difference is the difference in data between databases caused by the differences in the databases themselves.
[0131] The beneficial effects of the above design scheme are: by determining the incremental data information based on the current data conditions of the sender and the receiver, and based on the incremental data information, determining the transmission data of the sender's node database, analyzing from three aspects of transaction logs, timestamps, and application layer logs, obtaining the differences in the data in the database, and finally determining the transmission data of the sender's node database, realizing the indirectness of determining the transmission data, reducing the data transmission volume, and better realizing the synchronous transmission of data.
[0132] Perform a synchronous change elimination on the initial change difference based on the synchronous change information to obtain the target change difference, including:
[0133] Obtain the change differences in the initial change difference that are the same as the synchronous change information;
[0134] Eliminate the change differences in the initial change difference to obtain the target change difference.
[0135] The beneficial effects of the above design solution are as follows: By obtaining the change differences in the initial change differences that are the same as the synchronous change information, eliminating the change differences in the initial change differences, and obtaining the target change differences, the initial change differences are further simplified, thereby reducing the data volume of the obtained transmission data and being more conducive to the synchronous transmission of data.
[0136] Embodiment 10:
[0137] Based on Embodiment 5, an embodiment of the present invention provides a method for real-time synchronization of financial information data in a communication system. Based on the available time periods of the available nodes and the characteristics of the transmission data, a data transmission channel is determined, including:
[0138] Perform time matching on the time characteristics of the transmission data and the available time periods of the available nodes, and perform sequential ranking on the available nodes according to the time matching result to obtain multiple sequentially ranked nodes;
[0139] Based on the positional distribution of the sequentially ranked nodes with respect to the sender and the receiver, perform sequential weighting on the sequentially ranked nodes, and verify the sequential weighting based on the time matching result. If the verification passes, update the sequential weighting; if the verification fails, maintain the sequential ranking to obtain the target sequentially ranked nodes;
[0140] Obtain the data security characteristics, single transmission volume, and transmission speed from the characteristics of the transmission data, and calculate the evaluation value of the target sequentially ranked nodes at this sequential ranking ;
[0141]
[0142] Wherein, represents the transmission volume weight, represents the speed weight, represents the security weight, represents the maximum single transmission volume of the target sequentially ranked nodes, represents the single transmission volume of the transmission data, represents the maximum transmission speed of the target sequentially ranked nodes, represents the transmission speed of the transmission data, represents the transmission security level of the target sequentially ranked nodes, represents the security characteristic level of the transmission data;
[0143] Select the target sequentially ranked node with the highest evaluation value at the same sequential ranking as the selected node at this sequential ranking;
[0144] Establish a data transmission channel based on the selected nodes at each sequential ranking.
[0145] In this embodiment, the number of levels of the sequential level is determined according to the transmission distance.
[0146] In this embodiment, by obtaining the data security feature, the single transmission volume, and the transmission speed from the features of the transmitted data, the evaluation value of the target sequential level node at this sequential level is calculated, so as to achieve a comprehensive and effective evaluation of the target sequential level node.
[0147] The beneficial effects of the above design solution are as follows: By determining the data transmission channel based on the available time period of the available nodes and the features of the transmitted data, considering the adaptability between the nodes and the requirements of the transmitted data, a data transmission channel is finally established to ensure the smoothness of the transmission channel and reduce network latency.
[0148] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of this application document and its equivalent technologies, the present invention is also intended to include these changes and modifications.
Claims
1. A method for real-time synchronization of financial information data in a communication system, characterized in that, Including: S1: Determine the interaction data information of the distributed nodes of the communication system based on the financial communication task, and determine the transmission data of the node database based on the interaction data information, including: Based on the financial communication task, determine the sender, receiver, and data characteristics of the data communication; Determine the positions of the sender and receiver in the distributed nodes, and based on the data characteristics and combined with the structure of the distributed nodes, set the transmission situation of the data communication in the distributed nodes; Obtain the interaction data information based on the sender, receiver, data characteristics of the data communication, and the transmission situation in the distributed nodes; Determine all transmission information based on the interaction data information, and determine the current data situation of all transmission information at the sender and receiver; Based on the current data situation of the sender and receiver, determine the incremental data information, and based on the incremental data information, determine the transmission data of the sender's node database; Among them, based on the current data situation of the sender and receiver, determine the incremental data information, and based on the incremental data information, determine the transmission data of the sender's node database, including: Obtain the sender data situation and receiver data situation of the sender node database and the receiver node database after the last full-scale change; Obtain the transaction log, timestamp, and application layer log of the sender node database and the receiver node database after the last full-scale change; Obtain the first data change and the second data change of the sender node database and the receiver node database based on the transaction log, obtain the synchronization change information of the sender node database and the receiver node database based on the timestamp, and determine the first program change and the second program change of the sender node database and the receiver node database based on the application layer log; Determine the initial change difference based on the first data change and the second data change, and perform synchronization change elimination on the initial change difference based on the synchronization change information to obtain the target change difference; Respectively determine the database status change information of the sender node database and the receiver node database based on the first program change and the second program change, and determine the database self-difference of the sender node database and the receiver node database based on the database status change information; Determine the initial data difference based on the sender data situation and the receiver data situation, and determine the current data difference based on the initial data difference and the target change difference; Perform a synchronization impact analysis on the target change difference based on the synchronization impact of the database self-difference on the data attributes, obtain the changed data characteristics affected by synchronization, and obtain the data information associated with the changed data characteristics from the sender node database as supplementary data differences; Establish a data difference table for the sender node database and the receiver node database based on the current data difference and the supplementary data difference; Match the interaction data information with the data headers of the data difference table, and determine the transmission data of the sender's node database according to the matching result; S2: Establish a message queue based on the transmission data of the node database, combine the real-time load situation of the distributed nodes, determine the data transmission channel, and perform synchronous transmission on the transmission data based on the data transmission channel; S3: Based on the data transmission log, perform full backup and incremental backup on the financial information data in the communication system, and establish a data recovery strategy; S4: Perform real-time fault monitoring on the synchronous transmission, and perform timely data recovery on the data transmission process in combination with the data recovery strategy to complete the synchronous transmission.
2. A method for real-time synchronization of financial information data in a communication system according to claim 1, characterized in that, In S2, establishing a message queue based on the transmission data of the node database includes: Dividing the transmission data of the node database orderly according to a fixed data volume to obtain sequence data blocks; Establishing a message queue based on the sequence data blocks and sending the message queue to all distributed nodes participating in the transmission.
3. A method for real-time synchronization of financial information data in a communication system according to claim 1, characterized in that, In S2, determining the data transmission channel in combination with the real-time load conditions of the distributed nodes includes: Determining available nodes based on the real-time load conditions of the distributed nodes; Determining the available time period of the available nodes based on the real-time load conditions and predicted load conditions of the available nodes; Determining the data transmission channel based on the available time period of the available nodes and the characteristics of the transmission data.
4. A method for real-time synchronization of financial information data in a communication system according to claim 3, characterized in that, In S2, performing synchronous transmission on the transmission data based on the data transmission channel includes: Synchronously transmitting the transmission data on the data transmission channel according to the message queue; Recording the transmission information during the synchronous transmission of the transmission data to generate a data transmission log.
5. A method for real-time synchronization of financial information data in a communication system according to claim 1, characterized in that, In S3, based on the data transmission log, performing full backup and incremental backup on the financial information data in the communication system, and establishing a data recovery strategy includes: Setting a time period based on the data change frequency in the data transmission log, and performing full backup on the financial information data in the communication system based on the time period; Determining incremental data based on the data change characteristics in the data transmission log, and performing incremental backup on the financial information data in the communication system based on the incremental data; Real-time monitoring the status information and content information of the distributed nodes after full backup and incremental backup, and establishing a data recovery strategy in combination with the location information of the distributed nodes.
6. A method for real-time synchronization of financial information data in a communication system according to claim 1, characterized in that, In S4, performing real-time fault monitoring on the synchronous transmission, and performing timely data recovery on the data transmission process in combination with the data recovery strategy includes: Performing real-time fault monitoring on the synchronous transmission to determine the faulty nodes; Based on the location characteristics of the faulty nodes in the data transmission channel, in combination with the data recovery strategy, selecting alternative nodes from the distributed nodes that meet the faulty nodes; And obtaining replica data information from the replica records of the alternative nodes, and transferring the data traffic of the faulty nodes to the alternative nodes; Performing data fusion analysis on the replica data information and data traffic to obtain fusion data, and determining the recovered data content based on the fusion data and performing timely data recovery.
7. A method for real-time synchronization of financial information data in a communication system according to claim 3, characterized in that Based on the available time period of the available nodes and the characteristics of the transmission data, determining the data transmission channel includes: Performing time matching between the time characteristics of the transmission data and the available time period of the available nodes, and dividing the available nodes into sequential rank levels according to the time matching result to obtain multiple sequential rank nodes; Based on the positional distribution of the sequential rank nodes, the sender, and the receiver, sequential weighting is performed on the sequential rank nodes, and the sequential weighting is verified based on the time matching result. If the verification passes, the sequential weighting is updated. If the verification fails, the sequential rank is maintained to obtain the target sequential rank nodes; Obtain the data security feature, the single transmission volume, and the transmission speed from the features of the transmitted data, and calculate the evaluation value of the target sequential rank nodes at this sequential rank; Select the target sequential rank node with the highest evaluation value at the same sequential rank as the selected node at this sequential rank; Establish a data transmission channel based on the selected nodes at each sequential rank.
Citation Information
Patent Citations
Data transmission method, cloud center, edge node and storage medium
CN116233057A
Session migration method and device, electronic equipment and nonvolatile storage medium
CN118869782A