Multi-node CMDB block refined data synchronization method and system

By introducing a synchronization channel mechanism and incremental update and event-driven model in a multi-node CMDB environment, the problems of data consistency and management risks are solved, efficient and reliable data synchronization is achieved, and the operation process is simplified and flexible expansion is supported.

CN120030086AActive Publication Date: 2025-05-23TONGFANG YOUYUN (BEIJING) TECH CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202510078911.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-01-17
Publication Date
2025-05-23
Estimated Expiration
2045-01-17

AI Technical Summary

Technical Problem

In a multi-node CMDB environment, maintaining data consistency between each node is a huge challenge. The existing data synchronization method has problems such as high API call complexity and complex cross-domain network configuration, resulting in high management risks, complex operation processes and low system reliability.

Method used

The synchronization channel mechanism is introduced, and by configuring synchronization channels and timing tasks, incremental updates and event-driven models are realized, data consistency is ensured, and functions such as network accessibility and pre-synchronization correction and judgment are added.

Benefits of technology

Improve data consistency, reduce management risks, simplify operational processes, improve system reliability and synchronization efficiency, optimize resource utilization, and support flexible expansion.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120030086A_ABST
    Figure CN120030086A_ABST
Patent Text Reader

Abstract

The invention provides a multi-node CMDB block refined data synchronization method and system, and the method comprises the steps: configuring a synchronization channel by a CMDB, and setting a synchronization timing task; performing network accessibility detection, and judging whether the port of the T1 region is connected or not; obtaining T1 region synchronization channel configuration information; creating a synchronization channel in the T2 area; setting a timed task in the T2 area; and timing task correction judgment. A synchronization channel mechanism is introduced, the data consistency is enhanced, and the management risk caused by data asynchronization is reduced; the operation process is simplified, the difficulty of understanding and using complex technical tools by a user is greatly reduced, and the working efficiency is improved; the network accessibility and the correction judgment function before synchronization are added, the problem of data synchronization failure caused by network faults or configuration errors is effectively prevented, and the overall stability of the system is enhanced; according to the method, resource utilization is optimized, event driving and incremental updating are adopted, only a necessary data change part is transmitted, bandwidth and computing resources are saved, and synchronization efficiency is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of data synchronization, and in particular to a multi-node CMDB block-based refined data synchronization method and system. Background Art

[0002] The Configuration Management Database (CMDB) is a logical database that contains information about the entire life cycle of configuration items and the relationships between configuration items (including physical relationships, real-time communication relationships, non-real-time communication relationships, and dependency relationships).

[0003] Multi-node CMDB refers to an architectural design that distributes storage and processing of CMDB data through multiple physical or logical nodes. This design can improve the availability, scalability and performance of the system. Each node can be responsible for a specific data shard or area, thereby achieving more sophisticated data management and faster data access speed.

[0004] However, in a multi-node environment, maintaining data consistency between nodes is a huge challenge. Since different nodes may read and write the same data at the same time, an efficient data synchronization mechanism is required to ensure that the data on all nodes remains up-to-date and consistent. There are two main types of data synchronization mechanisms: full synchronization and incremental synchronization:

[0005] 1. Full synchronization: This is the simplest and most direct way, that is, to regularly copy all data from the master node to other nodes. Although this method is easy to implement, it is inefficient, especially when the amount of data is large, it will occupy a lot of bandwidth and may cause a long period of data unavailability.

[0006] 2. Incremental synchronization: Compared with full synchronization, incremental synchronization only transmits data that has changed since the last synchronization. This greatly reduces the amount of data transmitted and improves synchronization efficiency. However, it requires a reliable change detection mechanism, and in some cases (such as retrying after partial failure), additional logic may be required to ensure eventual consistency.

[0007] The current existing data synchronization method mainly includes the following steps and processes:

[0008] 1. A CMDB (such as platform A) exposes a specific port (such as port 60010) and defines the corresponding API path, so that other systems can access the services provided by platform A;

[0009] 2. Another CMDB (such as Platform B) sets up synchronization configuration, configures how to connect to Platform A, and saves this configuration information in its own database;

[0010] 3. Platform B initiates HTTP requests or uses other protocols to pull all data from Platform A synchronously and store the data in the local database;

[0011] 4. Platform B regularly performs incremental synchronization, pulling only the data that has changed since the last synchronization, and incremental synchronization is pulled to the database at a fixed time.

[0012] However, existing data synchronization methods, especially the above-mentioned process of setting up a CMDB (such as platform A) to expose a specific port (such as port 60010) and allowing another CMDB (such as platform B) to obtain data through the specific port, do have some obvious limitations and challenges. The existing data synchronization methods mentioned above mainly have the following shortcomings:

[0013] 1. High complexity of API calls:

[0014] Users must have an in-depth understanding of the specific details of the API interface, including parameter configuration, error handling mechanism, etc. This increases development and maintenance costs, especially for non-technical personnel, it may be very difficult to understand and correctly use these APIs.

[0015] 2. Cross-domain network configuration is complex:

[0016] When it comes to cross-domain operations, network configuration becomes extremely complex. Not only does it need to ensure network connectivity between the two platforms, but it also needs to consider factors such as firewall rules and security policies. In addition, traffic control in different network environments is also a major challenge, which may lead to performance bottlenecks or security risks. Summary of the invention

[0017] In view of this, the purpose of the present invention is to propose a multi-node CMDB block-based refined data synchronization method and system, introduce a synchronization channel mechanism, enhance data consistency, ensure that CMDB data between different areas is always up-to-date and consistent, and reduce management risks caused by data asynchrony; simplify the operating process, reduce the difficulty for users to understand and use complex technical tools, and improve work efficiency; improve system reliability, increase network accessibility and pre-synchronization correction judgment and other functions, effectively prevent data synchronization failures caused by network failures or configuration errors, and enhance the overall stability of the system; optimize resource utilization, adopt an event-driven model and incremental update strategy, and only transmit necessary data changes, thereby saving bandwidth and computing resources and improving synchronization efficiency.

[0018] The present invention provides a multi-node CMDB block-by-block refined data synchronization method, comprising the following steps:

[0019] S1. CMDB configures a synchronization channel and sets a synchronization timer task; the synchronization channel configuration includes: specifying the source area T1 and the target area T2, configuring a new synchronization channel in the CMDB of the T2 area, selecting an appropriate synchronization type, and opening the synchronization channel to ensure that the synchronization channel can normally monitor data changes from the T1 area;

[0020] The setting of the synchronization timing task includes: setting one or more timing tasks in the T2 area according to business requirements, and the timing tasks will regularly trigger the data synchronization process associated with the configured synchronization channel; configuring the time interval and execution strategy parameters of the timing tasks to meet specific synchronization frequency requirements;

[0021] S2. Before each synchronization starts, determine whether the service port of the T1 area is connected and whether the service port of the T1 area is accessible to ensure stable network connection; if the detection fails, record the error log and send an alarm to the administrator; if the detection succeeds, enter step S3;

[0022] S3, obtain the latest synchronization channel configuration information from the T1 area through API calls to guide subsequent data conversion and processing;

[0023] S4. According to the synchronization channel configuration information obtained from the T1 area, a synchronization channel is formally established in the T2 area, and the synchronization channel is opened to receive data; once the synchronization channel is opened, it immediately enters the ready state, waiting for the scheduled task to trigger the actual data synchronization operation;

[0024] S5. In the T2 area, associate the scheduled task set in step S1 with the synchronization channel created in step S4, and start scheduled synchronization;

[0025] Specifically, the previously set scheduled tasks need to be associated with the created synchronization channel in order to enable scheduled synchronization;

[0026] Scheduled tasks can be triggered manually or automatically started according to a preset schedule without manual intervention;

[0027] S6. Each time a scheduled task is triggered, a series of correction judgments are first performed. If all correction items are verified to be successful, the synchronization process officially begins; if any correction item fails to be verified, the synchronization attempt is stopped and a detailed explanation of the reasons is recorded for subsequent analysis.

[0028] The present invention sets a correction judgment function before synchronization. When the user modifies the model field, the user can first perform correction after the modification is completed, and then manually pull the data and set the scheduled task.

[0029] Further, the synchronization type in the selection of the appropriate synchronization type in step S1 includes: full synchronization, incremental synchronization, and event-driven;

[0030] The full synchronization is to synchronize all the model instances in the T1 area to the corresponding model instances in the T2 area;

[0031] The incremental synchronization is to synchronize the model instance in the T1 area to the corresponding model instance in the T2 area according to the time period change;

[0032] The event-driven method is to synchronize the mirror instances of the model in the T1 area and the corresponding model in the T2 area. Changes in the model instance in the T1 area or the model instance in the T2 area will cause changes in the mirror instance, which will be synchronized to the other end area to maintain consistency.

[0033] The present invention introduces an incremental update mechanism to transmit only the changed data. At the same time, it combines an event-driven model to ensure rapid response to configuration changes, which can not only reduce bandwidth usage and synchronization time, but also achieve near real-time data synchronization, which is more efficient than the full synchronization method.

[0034] Furthermore, the method of associating the scheduled task set in step S1 with the synchronization channel created in step S4 in step S5 includes:

[0035] The ID number of the created synchronization channel and the configuration information of the synchronization channel are associated with the set scheduled tasks to ensure that each scheduled task can accurately act on the correct synchronization channel.

[0036] Furthermore, the synchronization channel configuration information in the step S3 of acquiring the latest synchronization channel configuration information from the T1 area includes: data mapping rules and filtering conditions.

[0037] Furthermore, the execution of a series of correction judgments in step S6 includes: verifying the validity of the source data, and the method of verifying the validity of the source data includes: obtaining corresponding data by calling the API path corresponding to the service port of the T1 area during each synchronization, parsing the data, and determining whether the data is valid.

[0038] The present invention also provides a multi-node CMDB block-based refined data synchronization system, which is used to implement the multi-node CMDB block-based refined data synchronization method as described above, including:

[0039] Configuration of synchronization channel and scheduled task module: used for CMDB configuration of synchronization channel and setting of synchronization scheduled tasks; the configuration of synchronization channel includes: specifying source area T1 and target area T2, configuring a new synchronization channel in the CMDB of area T2, selecting an appropriate synchronization type, opening the synchronization channel, and ensuring that the synchronization channel can normally monitor data changes from area T1; the setting of synchronization scheduled tasks includes: setting one or more scheduled tasks in area T2 according to business needs, and the scheduled tasks will regularly trigger the data synchronization process associated with the configured synchronization channel; configuring the time interval and execution strategy parameters of the scheduled tasks to meet specific synchronization frequency requirements;

[0040] Network reachability detection module: used to determine whether the service port of the T1 area is connected before each synchronization starts, check whether the service port of the T1 area is accessible, and ensure the stability of the network connection; if the detection fails, the error log is recorded and an alarm is sent to the administrator; if the detection is successful, the S3 step is entered;

[0041] Synchronous configuration pull module: used to obtain the latest synchronous channel configuration information from the T1 area through API calls to guide subsequent data conversion and processing;

[0042] Creating a synchronization channel module: used to formally establish a synchronization channel in the T2 area according to the synchronization channel configuration information obtained from the T1 area, and open the synchronization channel to receive data; once the synchronization channel is opened, it immediately enters the ready state, waiting for the scheduled task to trigger the actual data synchronization operation;

[0043] Configure the associated scheduled task module: used to associate the scheduled task set in step S1 with the synchronization channel created in step S4 in the T2 area, and start scheduled synchronization;

[0044] Scheduled task correction judgment module: It is used to perform a series of correction judgments each time a scheduled task is triggered. If all correction items are verified, the synchronization process will officially start; if any correction item fails to be verified, the synchronization attempt will be stopped and a detailed explanation of the reason will be recorded for subsequent analysis.

[0045] The present invention can bring the following significant beneficial effects in practical applications by introducing a synchronous channel mechanism:

[0046] 1. Enhance data consistency:

[0047] Through the intelligent mapping engine and incremental update mechanism, the CMDB data between different regions is ensured to always remain up-to-date and consistent, reducing the management risks caused by data asynchrony.

[0048] 2. Simplify the operation process:

[0049] The use of visual workflow editors and advanced API encapsulation greatly reduces the difficulty for users to understand and use complex technical tools, thereby improving work efficiency.

[0050] 3. Improve system reliability:

[0051] The added functions of network reachability and pre-synchronization correction judgment can effectively prevent data synchronization failures caused by network failures or configuration errors, and enhance the overall stability of the system.

[0052] 4. Optimize resource utilization:

[0053] By adopting an event-driven model and incremental update strategy, only the necessary data changes are transmitted, which greatly saves bandwidth and computing resources and improves synchronization efficiency.

[0054] 5.Support flexible expansion:

[0055] Flexible mapping rules and synchronization strategies that support dynamic adjustment have been designed to quickly adapt to changes in business needs and technical environment, providing a good foundation for future system upgrades.

[0056] The present invention also provides a computer-readable storage medium having a computer program stored thereon, and when the program is executed by a processor, the steps of the multi-node CMDB block-based refined data synchronization method as described above are implemented.

[0057] The present invention also provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the steps of the multi-node CMDB block-based refined data synchronization method as described above are implemented.

[0058] Compared with the prior art, the present invention has the following beneficial effects:

[0059] The multi-node CMDB block-based refined data synchronization method and system provided by the present invention enhances data consistency by introducing a synchronization channel mechanism, ensures that CMDB data between different regions is always up-to-date and consistent, and reduces management risks caused by data asynchrony; simplifies the operation process, greatly reduces the difficulty for users to understand and use complex technical tools, and improves work efficiency; improves system reliability, adds functions such as network accessibility and pre-synchronization correction judgment, effectively prevents data synchronization failures caused by network failures or configuration errors, and enhances the overall stability of the system; optimizes resource utilization, adopts an event-driven model and incremental update strategy, and only transmits necessary data changes, which greatly saves bandwidth and computing resources and effectively improves synchronization efficiency; and supports flexible expansion, can quickly adapt to changes in business needs and technical environment, and provides a good foundation for future system upgrades. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the following detailed description of the preferred embodiment.The drawings are only for the purpose of illustrating the preferred embodiments and are not to be construed as limiting the invention.

[0061] In the attached picture:

[0062] Figure 1 It is a flow chart of the multi-node CMDB block-by-block refined data synchronization method of the present invention;

[0063] Figure 2 The figure is a schematic diagram of the structure of a computer device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0064] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and products consistent with some aspects of the present disclosure as detailed in the appended claims.

[0065] The terms used in this disclosure are for the purpose of describing specific embodiments only and are not intended to limit the disclosure. The singular forms of "a", "said" and "the" used in this disclosure and the appended claims are also intended to include plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0066] It should be understood that although the terms first, second, third, etc. may be used in the present disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present disclosure, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0067] The embodiments of the present invention are described in further detail below.

[0068] The embodiment of the present invention provides a multi-node CMDB block-by-block refined data synchronization method, such as Figure 1 As shown, the following steps are included:

[0069] S1. CMDB configures a synchronization channel and sets a synchronization timer task; the synchronization channel configuration includes: specifying the source area T1 and the target area T2, configuring a new synchronization channel in the CMDB of the T2 area, selecting an appropriate synchronization type, and opening the synchronization channel to ensure that the synchronization channel can normally monitor data changes from the T1 area;

[0070] The setting of the synchronization timing task includes: setting one or more timing tasks in the T2 area according to business requirements, and the timing tasks will regularly trigger the data synchronization process associated with the configured synchronization channel; configuring the time interval and execution strategy parameters of the timing tasks to meet specific synchronization frequency requirements;

[0071] Selecting an appropriate synchronization type, wherein the synchronization type includes: full synchronization, incremental synchronization, and event-driven;

[0072] Among them, full synchronization is to synchronize all model instances in the T1 area to the corresponding model instances in the T2 area;

[0073] Incremental synchronization is to synchronize the model instances in the T1 area to the corresponding model instances in the T2 area according to the time period changes;

[0074] Event-driven is to synchronize the mirror instances of the model in the T1 area and the corresponding model in the T2 area. Changes in the model instance in the T1 area or the model instance in the T2 area will cause changes to the mirror instance, which will be synchronized to the other end area to maintain consistency.

[0075] This embodiment introduces an incremental update mechanism to transmit only the changed data. At the same time, it combines an event-driven model to ensure rapid response to configuration changes, which can not only reduce bandwidth usage and synchronization time, but also achieve near real-time data synchronization, which is more efficient than the full synchronization method.

[0076] S2. Before each synchronization starts, determine whether the service port of the T1 area is connected and whether the service port of the T1 area is accessible to ensure stable network connection; if the detection fails, record the error log and send an alarm to the administrator; if the detection succeeds, enter step S3;

[0077] S3, obtain the latest synchronization channel configuration information from the T1 area through API calls to guide subsequent data conversion and processing;

[0078] The synchronization channel configuration information in which the latest synchronization channel configuration information is obtained from the T1 area includes: data mapping rules and filtering conditions.

[0079] S4. According to the synchronization channel configuration information obtained from the T1 area, a synchronization channel is formally established in the T2 area, and the synchronization channel is opened to receive data; once the synchronization channel is opened, it immediately enters the ready state, waiting for the scheduled task to trigger the actual data synchronization operation;

[0080] S5. In the T2 area, associate the scheduled task set in step S1 with the synchronization channel created in step S4, and start scheduled synchronization;

[0081] Specifically, the previously set scheduled tasks need to be associated with the created synchronization channel in order to enable scheduled synchronization;

[0082] Scheduled tasks can be triggered manually or automatically started according to a preset schedule without manual intervention;

[0083] The method of associating the scheduled task set in step S1 with the synchronization channel created in step S4 includes:

[0084] The ID number of the created synchronization channel and the configuration information of the synchronization channel are associated with the set scheduled tasks to ensure that each scheduled task can accurately act on the correct synchronization channel.

[0085] S6. Each time a scheduled task is triggered, a series of correction judgments are first performed. If all correction items are verified to be successful, the synchronization process officially begins; if any correction item fails to be verified, the synchronization attempt is stopped and a detailed explanation of the reasons is recorded for subsequent analysis.

[0086] Executing a series of correction judgments includes: verifying the validity of the source data, and the method of verifying the validity of the source data includes: obtaining corresponding data by calling the API path corresponding to the service port of the T1 area during each synchronization, parsing the data, and determining whether the data is valid.

[0087] The embodiment of the present invention further provides a multi-node CMDB block-based refined data synchronization system, which is used to implement the multi-node CMDB block-based refined data synchronization method as described above, including:

[0088] Configuration of synchronization channel and scheduled task module: used for CMDB configuration of synchronization channel and setting of synchronization scheduled tasks; the configuration of synchronization channel includes: specifying source area T1 and target area T2, configuring a new synchronization channel in the CMDB of area T2, selecting an appropriate synchronization type, opening the synchronization channel, and ensuring that the synchronization channel can normally monitor data changes from area T1; the setting of synchronization scheduled tasks includes: setting one or more scheduled tasks in area T2 according to business needs, and the scheduled tasks will regularly trigger the data synchronization process associated with the configured synchronization channel; configuring the time interval and execution strategy parameters of the scheduled tasks to meet specific synchronization frequency requirements;

[0089] Network reachability detection module: used to determine whether the service port of the T1 area is connected before each synchronization starts, check whether the service port of the T1 area is accessible, and ensure the stability of the network connection; if the detection fails, the error log is recorded and an alarm is sent to the administrator; if the detection is successful, the S3 step is entered;

[0090] Synchronous configuration pull module: used to obtain the latest synchronous channel configuration information from the T1 area through API calls to guide subsequent data conversion and processing;

[0091] Creating a synchronization channel module: used to formally establish a synchronization channel in the T2 area according to the synchronization channel configuration information obtained from the T1 area, and open the synchronization channel to receive data; once the synchronization channel is opened, it immediately enters the ready state, waiting for the scheduled task to trigger the actual data synchronization operation;

[0092] Configure the associated scheduled task module: used to associate the scheduled task set in step S1 with the synchronization channel created in step S4 in the T2 area, and start scheduled synchronization;

[0093] Scheduled task correction judgment module: It is used to perform a series of correction judgments each time a scheduled task is triggered. If all correction items are verified, the synchronization process will officially start; if any correction item fails to be verified, the synchronization attempt will be stopped and a detailed explanation of the reason will be recorded for subsequent analysis.

[0094] The multi-node CMDB block-based refined data synchronization method and system of this embodiment enhances data consistency by introducing a synchronization channel mechanism, thereby ensuring that CMDB data between different regions is always up-to-date and consistent, and reducing management risks caused by data asynchrony; simplifies the operating process, greatly reduces the difficulty for users to understand and use complex technical tools, and improves work efficiency; improves system reliability, adds functions such as network accessibility and pre-synchronization correction judgment, effectively prevents data synchronization failures caused by network failures or configuration errors, and enhances the overall stability of the system; optimizes resource utilization, adopts an event-driven model and incremental update strategy, and only transmits necessary data changes, which greatly saves bandwidth and computing resources and effectively improves synchronization efficiency.

[0095] An embodiment of the present invention further provides a computer device, Figure 2 is a schematic diagram of the structure of a computer device provided by an embodiment of the present invention; see the accompanying drawings Figure 2 As shown, the computer device includes: an input system 23, an output system 24, a memory 22 and a processor 21; the memory 22 is used to store one or more programs; when the one or more programs are executed by the one or more processors 21, the one or more processors 21 implement the multi-node CMDB block-based refined data synchronization method provided in the above embodiment; wherein the input system 23, the output system 24, the memory 22 and the processor 21 can be connected by a bus or other means, Figure 2 The example of connecting through bus is taken in the following.

[0096] The memory 22 is a readable and writable storage medium of a computing device, which can be used to store software programs and computer executable programs, such as the corresponding program instructions of the multi-node CMDB block-based refined data synchronization method described in the embodiment of the present invention; the memory 22 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system and at least one application required for a function; the data storage area can store data created according to the use of the device, etc.; in addition, the memory 22 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device; in some instances, the memory 22 can further include a memory remotely arranged relative to the processor 21, and these remote memories can be connected to the device via a network. Examples of the above-mentioned network include the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof.

[0097] The input system 23 may be used to receive input digital or character information, and to generate key signal input related to user settings and function control of the device; the output system 24 may include display devices such as display screens.

[0098] The processor 21 executes various functional applications and data processing of the device by running the software programs, instructions and modules stored in the memory 22, that is, realizes the above-mentioned multi-node CMDB block-based refined data synchronization method.

[0099] The computer device provided above can be used to execute the multi-node CMDB block-based refined data synchronization method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0100] The embodiment of the present invention also provides a storage medium containing computer executable instructions, which are used to execute the multi-node CMDB block refinement data synchronization method provided in the above embodiment when executed by a computer processor. The storage medium is any of various types of memory devices or storage devices, and the storage medium includes: installation media, such as CD-ROM, floppy disk or tape system; computer system memory or random access memory, such as DRAM, DDRRAM, SRAM, EDO RAM, Rambus RAM, etc.; non-volatile memory, such as flash memory, magnetic media (such as hard disk or optical storage); registers or other similar types of memory elements, etc.; the storage medium may also include other types of memory or combinations thereof; in addition, the storage medium may be located in a first computer system in which the program is executed, or may be located in a different second computer system, which is connected to the first computer system via a network (such as the Internet); the second computer system may provide program instructions to the first computer for execution. The storage medium includes two or more storage media that can reside in different locations (for example, in different computer systems connected via a network). The storage medium can store program instructions (for example, specifically implemented as a computer program) that can be executed by one or more processors.

[0101] Of course, the storage medium containing computer executable instructions provided by an embodiment of the present invention is not limited to the multi-node CMDB block refined data synchronization method described in the above embodiment, and can also execute related operations in the multi-node CMDB block refined data synchronization method provided by any embodiment of the present invention.

[0102] So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments, but it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.

[0103] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A multi-node CMDB block-based refined data synchronization method, characterized in that: The following steps are involved: S1. CMDB configures the synchronization channel and sets the synchronization timing task; The configuration of the synchronization channel includes: specifying the source area T1 and the target area T2, configuring a new synchronization channel in the CMDB of the T2 area, selecting an appropriate synchronization type, opening the synchronization channel, and ensuring that the synchronization channel can normally monitor data changes from the T1 area; The setting of the synchronization timing task includes: setting one or more timing tasks in the T2 area according to business requirements, and the timing tasks will regularly trigger the data synchronization process associated with the configured synchronization channel; configuring the time interval and execution strategy parameters of the timing tasks to meet specific synchronization frequency requirements; S2. Before each synchronization starts, determine whether the service port of the T1 area is connected and whether the service port of the T1 area is accessible to ensure stable network connection; if the detection fails, record the error log and send an alarm to the administrator; if the detection succeeds, enter step S3; S3, obtain the latest synchronization channel configuration information from the T1 area through API calls to guide subsequent data conversion and processing; S4. According to the synchronization channel configuration information obtained from the T1 area, a synchronization channel is formally established in the T2 area, and the synchronization channel is opened to receive data; once the synchronization channel is opened, it immediately enters the ready state, waiting for the scheduled task to trigger the actual data synchronization operation; S5. In the T2 area, associate the scheduled task set in step S1 with the synchronization channel created in step S4, and start scheduled synchronization; S6. Each time a scheduled task is triggered, a series of correction judgments are first performed. If all correction items are verified to be successful, the synchronization process officially begins; if any correction item fails to be verified, the synchronization attempt is stopped and a detailed explanation of the reasons is recorded for subsequent analysis.

2. The multi-node CMDB block-by-block refined data synchronization method according to claim 1 is characterized in that: The synchronization type in the step S1 of selecting an appropriate synchronization type includes: full synchronization, incremental synchronization, and event-driven; The full synchronization is to synchronize all the model instances in the T1 area to the corresponding model instances in the T2 area; The incremental synchronization is to synchronize the model instance in the T1 area to the corresponding model instance in the T2 area according to the time period change; The event-driven method is to synchronize the mirror instances of the model in the T1 area and the corresponding model in the T2 area. Changes in the model instance in the T1 area or the model instance in the T2 area will cause changes in the mirror instance, which will be synchronized to the other end area to maintain consistency.

3. The multi-node CMDB block-by-block refined data synchronization method according to claim 1, characterized in that: The method of associating the scheduled task set in step S1 with the synchronization channel created in step S4 in step S5 includes: The ID number of the created synchronization channel and the configuration information of the synchronization channel are associated with the set scheduled tasks to ensure that each scheduled task can accurately act on the correct synchronization channel.

4. The multi-node CMDB block-by-block refined data synchronization method according to claim 1, characterized in that: The synchronization channel configuration information in the step S3 in which the latest synchronization channel configuration information is obtained from the T1 area includes: data mapping rules and filtering conditions.

5. The multi-node CMDB block-by-block refined data synchronization method according to claim 1, characterized in that: The execution of a series of correction judgments in step S6 includes: verifying the validity of the source data, and the method for verifying the validity of the source data includes: obtaining corresponding data by calling the API path corresponding to the service port of the T1 area during each synchronization, parsing the data, and determining whether the data is valid.

6. A multi-node CMDB block-based refined data synchronization system, used to implement the multi-node CMDB block-based refined data synchronization method as described in any one of claims 1 to 5, characterized in that: include: Configure synchronization channel and scheduled task module: used for CMDB configuration synchronization channel and setting synchronization scheduled tasks; The configuration of the synchronization channel includes: specifying the source area T1 and the target area T2, configuring a new synchronization channel in the CMDB of the T2 area, selecting an appropriate synchronization type, opening the synchronization channel, and ensuring that the synchronization channel can normally monitor data changes from the T1 area; the setting of the synchronization scheduled task includes: according to business needs, setting one or more scheduled tasks in the T2 area, and the scheduled tasks will regularly trigger the data synchronization process associated with the configured synchronization channel; configuring the time interval and execution strategy parameters of the scheduled task to meet the specific synchronization frequency requirements; Network reachability detection module: used to determine whether the service port of the T1 area is connected before each synchronization starts, check whether the service port of the T1 area is accessible, and ensure the stability of the network connection; if the detection fails, the error log is recorded and an alarm is sent to the administrator; if the detection is successful, the S3 step is entered; Synchronous configuration pull module: used to obtain the latest synchronous channel configuration information from the T1 area through API calls to guide subsequent data conversion and processing; Creating a synchronization channel module: used to formally establish a synchronization channel in the T2 area according to the synchronization channel configuration information obtained from the T1 area, and open the synchronization channel to receive data; once the synchronization channel is opened, it immediately enters the ready state, waiting for the scheduled task to trigger the actual data synchronization operation; Configure the associated scheduled task module: used to associate the scheduled task set in step S1 with the synchronization channel created in step S4 in the T2 area, and start scheduled synchronization; Scheduled task correction judgment module: It is used to perform a series of correction judgments each time a scheduled task is triggered. If all correction items are verified, the synchronization process will officially start; if any correction item fails to be verified, the synchronization attempt will be stopped and a detailed explanation of the reason will be recorded for subsequent analysis.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the multi-node CMDB block-based refined data synchronization method described in any one of claims 1 to 5 are implemented.

8. A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the steps of the multi-node CMDB block-based refined data synchronization method as described in any one of claims 1 to 5 are implemented.

Citation Information

Patent Citations

  • Timing task execution method and device

    CN108958915A

  • Integrated intelligent operation and maintenance control method, system and operation and maintenance platform

    CN114548833A

  • Database synchronization system in high security region using blockchain

    CN115769547A

  • Data synchronization and update optimization method and system for universal card types

    CN118885538A

  • CMDB cloud resource synchronization method and system

    CN119088528A