Method and system for constructing active-active architecture of nucleic acid detection system based on multiple open source components

Abstract

The present invention discloses a method and system for constructing a dual-active architecture of a nucleic acid detection system based on a variety of open source components, and belongs to the field of nucleic acid detection system development technology. The method adjusts all middleware components involved in the system, and database components are respectively deployed by local clusters to form a cross-data center cluster deployment architecture, through the three-center deployment mode of the main data center, the standby data center, and the election data center, and distributes each of its nodes to the three centers for each component, forming a distributed cluster architecture across the three centers; middleware components are deployed across data center clusters, including zookeeper clusters, kafka clusters, and three-center dual-active architecture designs; database components are deployed across data center clusters, including mongo clusters, solr clusters, and redis clusters. The three-center dual-active architecture design. The present invention can realize the dual-active construction of nucleic acid detection systems, improve system robustness, and save additional software and hardware procurement costs.

Description

Technical Field

[0001] The present invention relates to the technical field of nucleic acid detection system development, and specifically to a method and system for constructing a dual-active architecture of a nucleic acid detection system based on multiple open source components. Background Art

[0002] In the traditional system active-active architecture, applications, databases, and middleware are deployed in two sets in the primary and standby data centers respectively. Real-time data synchronization is achieved between the primary and standby databases through database synchronization software (database synchronization software is generally purchased commercial software or self-developed synchronization software). If a problem occurs in the primary environment, switch to the standby environment. After the primary environment is repaired, incremental recovery is performed from the standby database to the primary database. After the primary and standby data are consistent, find a time to switch the application service.

[0003] The traditional method has high requirements for the real-time performance of data synchronization, otherwise the data will be inconsistent when switching between the primary and secondary environments. This requires high requirements for the selection and operation and maintenance of synchronization components. Generally, nucleic acid detection systems use more open source database components, and it is necessary to study the implementation of the active-active architecture of nucleic acid detection systems built on multiple open source components. Summary of the invention

[0004] The technical task of the present invention is to address the above shortcomings and provide a method and system for constructing an active-active architecture of a nucleic acid detection system based on multiple open source components, which can realize the active-active construction of the nucleic acid detection system, improve the robustness of the system, and save additional software and hardware procurement costs.

[0005] The technical solution adopted by the present invention to solve its technical problem is:

[0006] A method for constructing an active-active architecture for a nucleic acid detection system based on multiple open source components, in which all middleware components and database components involved in the system are respectively adjusted from local cluster deployment to a cross-data center cluster deployment architecture, and through a three-center deployment mode of a primary data center, a backup data center, and an election data center, each component has its nodes distributed to the three centers, forming a distributed cluster architecture across the three centers;

[0007] The cross-data center cluster deployment of middleware components includes the three-center active-active architecture design of the Zookeeper cluster and the three-center active-active architecture design of the Kafka cluster;

[0008] The cross-data center cluster deployment of database components includes the three-center active-active architecture design of the Mongo cluster, the three-center active-active architecture design of the Solr cluster, and the three-center active-active architecture design of the Redis cluster.

[0009] This method uses multiple open source components across data center clusters for the nucleic acid detection system to jointly build a three-center active-active architecture. It does not require third-party procurement tools or additional development. It only uses the cross-data center cluster capabilities of each open source component to achieve system active-active, improving the stability and robustness of the active-active architecture system.

[0010] Preferably, the zookeeper cluster has a three-center dual-active architecture design.

[0011] Zookeeper adopts a 5-node cluster architecture, including 2 nodes in the main data center computer room, 2 nodes in the backup data center, and 1 node in the election data center. The normal leader node is in the main data center computer room.

[0012] Preferably, the three-center dual-active architecture design of the Kafka cluster is

[0013] Two Kafka clusters are deployed in the main data center and the backup data center. Mirror Maker is used to synchronize data between Kafka clusters. When a problem occurs in the main data center, the data is switched to the backup data center. After the main data center is restored, the data is synchronized to the main data center through Mirror Maker.

[0014] Preferably, the mongo cluster three-center dual-active architecture design,

[0015] Mongo uses a 9-node shard replica set architecture, in which the primary data center has 3 master nodes for shards, the backup data center has 3 slave nodes for shards, and the election data center has 3 election nodes for shards.

[0016] Preferably, the Solr cluster has a three-center dual-active architecture design.

[0017] Solr adopts a 9-node sharded cluster architecture, including 3 shards, each with two replicas. The main data center computer room, backup data center, and election data center are allocated as primary, replica, and replica.

[0018] Preferably, the redis cluster three-center dual-active architecture design,

[0019] Redis adopts a 6-node cluster architecture, in which the main data center computer room, the backup data center computer room, and the election data center computer room are respectively the master and slave of each other. The main data center computer room includes redis1-master and redis2-slave; the backup data center computer room includes redis2-master and redis3-slave; the election data center computer room includes redis3-master and redis1-slave.

[0020] The present invention also claims to protect a dual-active architecture system of a nucleic acid detection system built on multiple open source components. All middleware components and database components involved in the system are respectively adjusted from local cluster deployment to a cross-data center cluster deployment architecture. Through the three-center deployment mode of the main data center, the backup data center, and the election data center, each component distributes each node to the three centers to form a distributed cluster architecture across the three centers; including a middleware cross-data center cluster deployment module and a database cross-data center cluster deployment module;

[0021] The middleware cross-data center cluster deployment module includes the three-center dual-active architecture design of the Zookeeper cluster and the three-center dual-active architecture design of the Kafka cluster;

[0022] The database cross-data center cluster deployment module includes the three-center dual-active architecture design of the mongo cluster, the three-center dual-active architecture design of the solr cluster, and the three-center dual-active architecture design of the redis cluster.

[0023] Preferably, the zookeeper cluster has a three-center dual-active architecture design.

[0024] Zookeeper adopts a 5-node cluster architecture, including 2 nodes in the main data center computer room, 2 nodes in the backup data center, and 1 node in the election data center. The normal leader node is in the main data center computer room.

[0025] Further, the three-center dual-active architecture design of the Kafka cluster,

[0026] Two Kafka clusters are deployed in the main data center and the backup data center. Mirror Maker is used to synchronize data between Kafka clusters. When a problem occurs in the main data center, the data is switched to the backup data center. After the main data center is restored, the data is synchronized to the main data center through Mirror Maker.

[0027] Preferably, the mongo cluster three-center dual-active architecture design,

[0028] Mongo uses a 9-node shard replica set architecture, where the primary data center has 3 shard master nodes, the backup data center has 3 shard slave nodes, and the election data center has 3 shard election nodes.

[0029] The three-center dual-active architecture design of the Solr cluster,

[0030] Solr adopts a 9-node sharded cluster architecture, including 3 shards, each with two replicas. The main data center computer room, backup data center, and election data center are allocated as primary, replica, and replica.

[0031] The redis cluster three-center dual-active architecture design,

[0032] Redis adopts a 6-node cluster architecture, in which the main data center computer room, the backup data center computer room, and the election data center computer room are respectively the master and slave of each other. The main data center computer room includes redis1-master and redis2-slave; the backup data center computer room includes redis2-master and redis3-slave; the election data center computer room includes redis3-master and redis1-slave.

[0033] Compared with the prior art, the method and system of the present invention for constructing a dual-active architecture of a nucleic acid detection system based on multiple open source components have the following beneficial effects:

[0034] This method or system applies a variety of open source middleware and database components to the same project, forming their own high-availability cluster architectures. With the help of each component's own high-availability cluster characteristics and election mechanism, the architecture has good fit and maturity, and a system with active-active deployment architecture is built, which saves the procurement cost of data bidirectional synchronization components required for the construction of traditional active-active centers, and also saves the labor cost of maintaining two environments. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 This is a diagram of an architecture for implementing a method for constructing a dual-active architecture of a nucleic acid detection system based on multiple open source components provided by an embodiment of the present invention;

[0036] Figure 2 It is a design diagram of a three-center dual-active architecture of a zookeeper cluster provided by an embodiment of the present invention;

[0037] Figure 3 It is a design diagram of a three-center dual-active architecture of a Kafka cluster provided by an embodiment of the present invention;

[0038] Figure 4 It is a design diagram of a three-center dual-active architecture of a mongo cluster provided by an embodiment of the present invention;

[0039] Figure 5 It is a schematic diagram of the design of a three-center dual-active architecture of a Solr cluster provided by an embodiment of the present invention;

[0040] Figure 6 It is a design diagram of a three-center dual-active architecture of a redis cluster provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0041] The embodiment of the present invention provides a method for constructing an active-active architecture of a nucleic acid detection system based on multiple open source components, wherein all middleware components and database components involved in the system are respectively adjusted from local cluster deployment to a cross-data center cluster deployment architecture, and through a three-center deployment mode of a primary data center, a backup data center, and an election data center, each component has its nodes distributed to the three centers, forming a distributed cluster architecture across the three centers;

[0042] The cross-data center cluster deployment of middleware components includes the three-center active-active architecture design of the zookeeper cluster and the three-center active-active architecture design of the kafka cluster; the cross-data center cluster deployment of database components includes the three-center active-active architecture design of the mongo cluster, the three-center active-active architecture design of the solr cluster, and the three-center active-active architecture design of the redis cluster.

[0043] Combined with the current status of a nucleic acid testing information system, this method uses the A data center computer room as the production center of this project, the B government service center computer room as the disaster recovery center of this project, and the C computer room as the election center of this project. The production center, disaster recovery center, and election center realize active-active business through the cross-data center deployment of applications, middleware, and database distributed clusters. This method is mainly aimed at the cluster transformation of all databases and middleware involved in the project.

[0044] The three-center dual-active architecture design of the Zookeeper cluster,

[0045] Zookeeper uses a 5-node cluster architecture, with 2 nodes in Room A (the main data center), 2 nodes in Room B (the backup data center), and 1 node in Room C (the election data center). The normal leader node is in Room A. Figure 2 shown.

[0046] The three-center dual-active architecture design of the Kafka cluster,

[0047] Two sets of Kafka clusters are deployed in Computer Room A (the main data center) and Computer Room B (the backup data center). Mirror Maker is used to synchronize data between Kafka clusters. When a problem occurs in Computer Room A (the main data center), the data is switched to Computer Room B (the backup data center). After Computer Room A (the main data center) is restored, the data is synchronized to Computer Room A (the main data center) through Mirror Maker. Figure 3 shown.

[0048] The three-center dual-active architecture design of the mongo cluster,

[0049] Mongo uses a 9-node shard replica set architecture, where the A computer room (primary data center computer room) has 3 shard master nodes, the B computer room (backup data center computer room) has 3 shard slave nodes, and the C computer room (election data center computer room) has 3 shard election nodes. Figure 4 shown.

[0050] The three-center dual-active architecture design of the Solr cluster,

[0051] Solr uses a 9-node shard cluster architecture, with 3 shards and two replicas for each shard. The A computer room (primary data center computer room), B computer room (backup data center computer room), and C computer room (election data center computer room) are allocated as primary, replica, and replica. Figure 5 shown.

[0052] The redis cluster three-center dual-active architecture design,

[0053] Redis uses a 6-node cluster architecture, in which computer room A (primary data center computer room), computer room B (backup data center computer room), and computer room C (election data center computer room) are respectively master and slave. Computer room A (primary data center computer room) includes redis1-master and redis2-slave; computer room B (backup data center computer room) includes redis2-master and redis3-slave; computer room C (election data center computer room) includes redis3-master and redis1-slave. Figure 6 shown.

[0054] Through this architecture design, any component in any computer room will not affect the normal use of the cluster component; any problem in all cluster components in any computer room will not affect the normal use of business, truly realizing the active-active architecture of active-standby dual centers that can provide business support capabilities at the same time. At the same time, if any cluster node fails, after recovery, the entire cluster can recover by itself and automatically synchronize data without users noticing.

[0055] The present invention also claims to protect a dual-active architecture system of a nucleic acid detection system built on multiple open source components. All middleware components and database components involved in the system are respectively adjusted from local cluster deployment to a cross-data center cluster deployment architecture. Through the three-center deployment mode of the main data center, the backup data center, and the election data center, each component distributes each node to the three centers to form a distributed cluster architecture across the three centers; including a middleware cross-data center cluster deployment module and a database cross-data center cluster deployment module;

[0056] The middleware cross-data center cluster deployment module includes the three-center dual-active architecture design of the Zookeeper cluster and the three-center dual-active architecture design of the Kafka cluster;

[0057] The three-center dual-active architecture design of the Zookeeper cluster,

[0058] Zookeeper adopts a 5-node cluster architecture, including 2 nodes in the main data center computer room, 2 nodes in the backup data center, and 1 node in the election data center. The normal leader node is in the main data center computer room.

[0059] The three-center dual-active architecture design of the Kafka cluster,

[0060] Two Kafka clusters are deployed in the main data center and the backup data center. Mirror Maker is used to synchronize data between Kafka clusters. When a problem occurs in the main data center, the data is switched to the backup data center. After the main data center is restored, the data is synchronized to the main data center through Mirror Maker.

[0061] The database cross-data center cluster deployment module includes the three-center dual-active architecture design of the mongo cluster, the three-center dual-active architecture design of the solr cluster, and the three-center dual-active architecture design of the redis cluster.

[0062] The three-center dual-active architecture design of the mongo cluster,

[0063] Mongo uses a 9-node shard replica set architecture, where the primary data center has 3 shard master nodes, the backup data center has 3 shard slave nodes, and the election data center has 3 shard election nodes.

[0064] The three-center dual-active architecture design of the Solr cluster,

[0065] Solr adopts a 9-node sharded cluster architecture, including 3 shards, each with two replicas. The main data center computer room, backup data center, and election data center are allocated as primary, replica, and replica.

[0066] The redis cluster three-center dual-active architecture design,

[0067] Redis adopts a 6-node cluster architecture, in which the main data center computer room, the backup data center computer room, and the election data center computer room are respectively the master and slave of each other. The main data center computer room includes redis1-master and redis2-slave; the backup data center computer room includes redis2-master and redis3-slave; the election data center computer room includes redis3-master and redis1-slave.

[0068] Through the above specific implementations, those skilled in the art can easily implement the present invention. However, it should be understood that the present invention is not limited to the above specific implementations. On the basis of the disclosed implementations, those skilled in the art can arbitrarily combine different technical features to achieve different technical solutions.

[0069] Except for the technical features described in the specification, all other technical features are known technologies to those skilled in the art.

Claims

1. A method for constructing a dual-active architecture of a nucleic acid detection system based on multiple open source components, characterized in that: All middleware components and database components involved in the system are respectively adjusted from local cluster deployment to a cross-data center cluster deployment architecture. Through the three-center deployment mode of the primary data center, the backup data center, and the election data center, each component has its nodes distributed in the three centers to form a distributed cluster architecture across the three centers; The cross-data center cluster deployment of middleware components includes the three-center active-active architecture design of the Zookeeper cluster and the three-center active-active architecture design of the Kafka cluster; The three-center dual-active architecture design of the Zookeeper cluster, Zookeeper uses a 5-node cluster architecture, including 2 nodes in the main data center, 2 nodes in the backup data center, and 1 node in the election data center. The normal leader node is in the main data center. The three-center dual-active architecture design of the Kafka cluster, Two Kafka clusters are deployed in the main data center and the backup data center. Mirror Maker is used to synchronize data between the Kafka clusters. When a problem occurs in the main data center, the data is switched to the backup data center. After the main data center is restored, the data is synchronized to the main data center through Mirror Maker. The cross-data center cluster deployment of database components includes the three-center active-active architecture design of the Mongo cluster, the three-center active-active architecture design of the Solr cluster, and the three-center active-active architecture design of the Redis cluster; The three-center dual-active architecture design of the mongo cluster, Mongo uses a 9-node shard replica set architecture, where the primary data center has 3 shard master nodes, the backup data center has 3 shard slave nodes, and the election data center has 3 shard election nodes. The three-center dual-active architecture design of the Solr cluster, Solr uses a 9-node shard cluster architecture, with 3 shards and two replicas for each shard. The main data center computer room, backup data center, and election data center are allocated as primary, replica, and replica. The redis cluster three-center dual-active architecture design, Redis adopts a 6-node cluster architecture, in which the main data center computer room, the backup data center computer room, and the election data center computer room are respectively the master and slave of each other. The main data center computer room includes redis1-master and redis2-slave; the backup data center computer room includes redis2-master and redis3-slave; the election data center computer room includes redis3-master and redis1-slave.

2. A nucleic acid detection system dual-active architecture system built based on multiple open source components, characterized in that: All middleware components and database components involved in the system are adjusted from local cluster deployment to a cross-data center cluster deployment architecture. Through the three-center deployment mode of the primary data center, the backup data center, and the election data center, each component distributes each node to the three centers to form a distributed cluster architecture across the three centers; including the middleware cross-data center cluster deployment module and the database cross-data center cluster deployment module; The middleware cross-data center cluster deployment module includes the three-center dual-active architecture design of the Zookeeper cluster and the three-center dual-active architecture design of the Kafka cluster; The three-center dual-active architecture design of the Zookeeper cluster, Zookeeper uses a 5-node cluster architecture, including 2 nodes in the main data center, 2 nodes in the backup data center, and 1 node in the election data center. The normal leader node is in the main data center. The three-center dual-active architecture design of the Kafka cluster, Two sets of Kafka clusters are deployed in the main data center and the backup data center. Mirror Maker is used to synchronize data between Kafka clusters. When a problem occurs in the main data center, the data is switched to the backup data center. After the main data center is restored, the data is synchronized to the main data center through Mirror Maker. The database cross-data center cluster deployment module includes the three-center active-active architecture design of the Mongo cluster, the three-center active-active architecture design of the Solr cluster, and the three-center active-active architecture design of the Redis cluster. The three-center dual-active architecture design of the mongo cluster, Mongo uses a 9-node shard replica set architecture, where the primary data center has 3 shard master nodes, the backup data center has 3 shard slave nodes, and the election data center has 3 shard election nodes. The three-center dual-active architecture design of the Solr cluster, Solr uses a 9-node shard cluster architecture, with 3 shards and two replicas for each shard. The main data center computer room, backup data center, and election data center are allocated as primary, replica, and replica. The redis cluster three-center dual-active architecture design, Redis adopts a 6-node cluster architecture, in which the main data center computer room, the backup data center computer room, and the election data center computer room are respectively the master and slave of each other. The main data center computer room includes redis1-master and redis2-slave; the backup data center computer room includes redis2-master and redis3-slave; the election data center computer room includes redis3-master and redis1-slave.

Images