47 results about "Database clustering" patented technology

This application relates to a database cluster recovery method and related equipment. The method includes: obtaining metadata information for each node in the cluster to be recovered by extracting cluster configuration information and node status information; acquiring backup set data of the cluster to be recovered that matches the cluster recovery requirements; determining the node role layout of the target cluster based on its overall operating status; using the target cluster to recover a failed cluster in a cross-environment environment; reconstructing the cluster structure according to the node role layout and the metadata information of each node in the cluster to be recovered, distributing the backup set data to each node in the target cluster, and performing physical recovery in parallel; and using a cluster management tool to associate cluster relationships and perform cluster registration operations based on the nodes in the recovered target cluster to obtain the new recovered cluster corresponding to the cluster to be recovered. This method enables rapid equivalent recovery of database clusters across environments, improving cluster recovery efficiency.

This invention discloses a conflict resolution method, apparatus, and system for distributed databases, belonging to the field of distributed databases. The method comprises: acquiring consumer update information fed back by a consumer database cluster, wherein the consumer database cluster extracts information from change unit information when cross-datacenter replication is triggered based on change unit information sent by a producer database cluster; generating a replicable MP transaction based on the consumer update information, and determining whether a transaction conflict exists based on the primary key version snapshot corresponding to the replicable MP transaction and the consumer update information; if a conflicting transaction is determined to exist, adjusting the conflicting transaction based on its timestamp or priority to eliminate the conflict. This invention can both prevent data discrepancies between two database clusters due to conflicts, ensuring data consistency between the two clusters, and prevent data loss due to conflicts in one cluster.

The application discloses a data library distribution method and device, equipment, a storage medium and a program product. The method comprises the following steps: extracting a target field value from a target message to be processed based on a preconfigured target field, and converting the target field value into a first hash code with a specified length; determining a target hash algorithm corresponding to the target field; combining the high-order element and the low-order element of the first hash code by using the target hash algorithm to generate a second hash code; and determining a target database to be distributed based on the second hash code. The second hash code integrates high-order features and low-order features, which can fully reflect the randomness of the overall hash result, improve the hash dispersion, balance the overall access pressure of the database cluster, reduce the situation that a single machine is shut down due to overload, and reduce resource waste caused by the fact that some machines receive less access.

The application provides a database cluster management method, device, equipment, storage medium and product, which are applied to a database cluster. The database cluster includes an initial master library node and at least one standby library node. The method includes the following steps: detecting state information of the initial master library node; when detecting that the initial master library node fails, promoting one standby library node to a new master library node to take over the initial master library node; during the period when the new master library node takes over the initial master library node, detecting the state information of the initial master library node, and when detecting that the initial master library node resumes operation, identifying the initial master library node as a fault recovery node; performing role isolation control on the fault recovery node; the role isolation control includes modifying role configuration information of the fault recovery node. By detecting the initial master library node when it is unavailable to when it resumes operation, performing role isolation control on the initial master library node, and prohibiting the initial master library node from operating as a master library node, data conflicts and automatic isolation caused by double master operation are avoided.

The present disclosure relates to a method and a system for monitoring a health status of database clusters [202] The disclosure encompasses retrieving performance parameters of database [208] based on execution of monitoring task; categorizing the performance parameters based on at least one of configuration attributes, component attributes, temporal attributes, and aggregation attributes; compiling set of the performance parameters based on the monitoring task; generating a report comprising at least the compiled set of performance parameters; and transmitting the generated report to a user interface (UI) [212].

The application discloses a database cluster upgrading method and device, electronic equipment and storage medium, and relates to the technical field of database information. In the application, version update data set of a database cluster to be upgraded is obtained from a database cluster upgrading request and saved to an initial master node in the database cluster to be upgraded. Then, when it is determined that the initial master node and each slave node meet a preset initial node steady state condition, version upgrade is performed on each slave node based on the version update data set. Further, when it is determined that the slave node characteristics of each upgraded slave node and the initial characteristics of the initial master node meet a preset feature similarity condition, a target slave node meeting a preset update data set acquisition time length condition is selected from the upgraded slave nodes. Finally, version upgrade is performed on the initial master node based on the version update data set obtained by the target slave node, so as to ensure the upgrading accuracy of the database cluster.

This application discloses a performance optimization method, apparatus, electronic device, and storage medium for clustered databases, relating to the field of computer technology. Through this application, by determining the node affiliation of database record access requests and forwarding them hierarchically according to the logical master node and the current data master node, and by queuing and delaying concurrent access requests for the same record during record migration according to timestamps, the request forwarding path and concurrent request processing order are standardized. This fundamentally avoids timing conflicts during master node migration, effectively controlling the number of hops in access requests, improving the access processing efficiency of the CTDB database cluster, enhancing the throughput and operational stability of the distributed system, and adapting to the technical requirements of cross-node data synchronization scenarios such as Samba clusters.

The present disclosure relates to a method and a system for performing predictive analysis of database cluster within a plurality of database clusters The method comprises collecting, by a collecting unit [302], data associated with a set of historical performance metrics from a plurality of database clusters. The method comprises detecting, by a detecting unit [304] using a trained model, one or more anomalies in the set of historical performance metrics data. Furthermore, the method comprises performing, by a processing unit [306], a root cause analysis for the detected one or more anomalies. The method comprises generating, by a generating unit [308], a report based on the root cause analysis. The method comprises rendering, by a display unit [310], the generated report.

This invention provides a method, apparatus, and device for primary / standby failover based on a database cluster, applicable to the field of database technology. The method includes: responding to a target standby component among multiple standby components identifying an anomaly in the primary standby component, and the number of candidate standby components with healthy operating status among the multiple standby components being less than a first threshold, sending a voting request to each candidate standby component and sending a network connectivity test command to the target network address; performing a primary upgrade judgment based on the response result and the voting results of each candidate standby component, and executing the primary upgrade configuration if the judgment result indicates successful upgrade; responding to the completion of the primary upgrade configuration, performing an aggregated analysis of the operating status of multiple databases belonging to the same database center according to the center identifier assigned to each database, and determining the database primary / standby failover method for the database cluster based on the analysis results and switchover parameters of each database center.

The application provides an automatic detection method for database cluster automatic deployment, a storage medium and equipment, the automatic detection method comprises: an arbitrator, a master library and a plurality of backup libraries, the arbitrator is used for observing the running state of the master library and the backup library. The automatic failover method comprises: acquiring a failure signal of the master library; sending a failover command to a target backup library in the plurality of backup libraries; attempting to acquire feedback information sent by the target backup library, the feedback information comprising an execution result of the target backup library on the failover command; if the attempt result is failure, attempting to connect other backup libraries in the plurality of backup libraries except the target backup library; in the case that the attempt to connect the other backup libraries fails, stopping the running of the arbitrator. The automatic failover method of the database cluster of the application avoids the unavailability of automatic failover caused by the impulsive 'death' of the arbitrator, and greatly improves the availability of the cluster and the automatic failover system.

Disclosed in embodiments of the present application are a method, system and device for scaling up / down a database cluster, a storage medium, and a computer program product. The method comprises: acquiring response time information of a database cluster to be scaled up / down for different types of data access requests; determining a scale-up / down strategy for the database cluster on the basis of the response time information and the types of the data access requests; and scaling up / down the database cluster on the basis of the scale-up / down strategy. In this way, the scale-up / down strategy for the database cluster is determined on the basis of the response time information of the database cluster for different types of data access requests and the types of the data access requests, thereby implementing a mechanism for automatically triggering scale-up / down of the database cluster on the basis of service requirements for the database cluster and needs of a database for processing services, and improving the intelligence level of triggering scale-up / down of the database cluster and improving the efficiency of scale-up / down of the database cluster.

The embodiment of the application discloses a guide type database cluster deployment method, equipment and medium, belongs to the technical field of database, solves the problems of low operation efficiency and easy deployment failure caused by human negligence in the script-based database cluster deployment mode. Including, obtaining the cluster basic configuration information input by the user through the graphical guide interface; adding the to-be-deployed nodes, setting the deployment parameters for each to-be-deployed node, and generating a to-be-deployed node list; pre-detecting the deployment environment of each to-be-deployed node, and when the pre-detection result meets the preset detection condition, starting the deployment task on each to-be-deployed node in parallel, and executing component installation on each to-be-deployed node according to the preset component dependency order; during the deployment process, obtaining the deployment progress information and the deployment log, and performing a rollback operation on the node with deployment failure based on the deployment progress information and the deployment log, so as to reset the state of the node with deployment failure.

This application discloses a database switching method, apparatus, terminal, and storage medium. The method includes: actively probing the databases in a database cluster to obtain a first probing result; based on the first probing result, performing bypass probing on the databases to obtain a second probing result; and based on the second probing result, performing a stop-loss operation on the databases. This application uses a combination of active and bypass probing to determine database anomalies, and then performs stop-loss operations on the abnormal databases by judging instance roles and weights. This approach is applicable not only to master-slave and distributed database scenarios but also to relational database failure scenarios with multiple business entry points based on role-based judgment.

The embodiment of the application provides a kind of database cluster in standby machine temporary table processing method, equipment, storage medium and program product, it is related to distributed field.The method comprises: receiving data definition language (DDL) operation request;In response to determining that the DDL operation request is the request of creating standby machine local temporary table, the pre-write log (WAL) level of DDL operation is set to the log level specially used for the creation of standby machine local temporary table;Local temporary table is allocated identifier, and the identifier includes object identifier and the cluster node identifier of backup node;The metadata of local temporary table is stored in the memory storage area locally of backup node, and the memory storage area is independent of the physical system table synchronized with master node.The method of the application increases the ability of standby machine to independently process local temporary data operation, and improves the utilization efficiency of overall resources of database cluster.

This application discloses a database object processing method, system, device, and medium, applied in the field of database technology. In the mapping phase, the hierarchical identifiers (after removing hierarchical separators) of the original identifier key are concatenated into a hierarchical identifier string, generating a first digital fingerprint. A mapping identifier key is generated based on the target start character, the target digital fingerprint algorithm identifier, the first digital fingerprint, the target hierarchical identifier length, and the hierarchical identifier string. In the inverse mapping phase, after determining that the mapping identifier key starts with the target start character, the hierarchical identifier string is segmented based on the target hierarchical identifier length to obtain each hierarchical identifier, generating a second digital fingerprint. When the second digital fingerprint matches the first digital fingerprint, the hierarchical separator is used to restore each hierarchical identifier to the original identifier key. By constructing a unified bidirectional mapping mechanism, the database cluster can be compatible with different metadata services, significantly improving system scalability.

The application provides a database cluster architecture processing method and device, equipment and a storage medium, and relates to the technical field of databases. The method comprises the following steps: loading a dynamic library corresponding to a first database cluster architecture according to a first processing request for the first database cluster architecture, wherein the first processing request comprises creating the first database cluster architecture or deleting the first database cluster architecture; in the case where the first processing request is to create the first database cluster architecture, calling an interface for initialization and node registration in an architecture interface from the dynamic library to obtain the first database cluster architecture for providing data read-write services; and in the case where the first processing request is to delete the first database cluster architecture, calling an interface for counter-initialization and node logout in the architecture interface from the dynamic library to delete the first database cluster architecture and release the resources of the first database cluster architecture. The method provided by the application can realize high availability of the database cluster architecture.

The application relates to a cluster type safety computer platform, which is centrally deployed, can realize centralized maintenance and is favorable for improving system availability. The safety computer platform is deployed on a track side and does not need to bear the severe working environment of a vehicle-mounted device, is high in reliability and can adopt high-performance hardware, thus being favorable for realizing more intelligent functions. The safety computer units in the safety computer platform communicate based on a wired network, and compared with the wireless communication between a vehicle-mounted safety computer platform and a track-side safety computer platform in a traditional train control system, the wired communication is better in reliability. A master and standby database cluster is introduced, the statelessness of safety applications can be realized, data synchronization during master and standby switching of the safety applications is avoided, the switching speed is accelerated, and the consistency of data during the master and standby switching process is ensured. The large-scale safety computer cluster platform is realized, and the problems existing in real-time performance and determination of virtualization on the safety computer platform do not need to be faced.

This invention discloses a data processing system, method, apparatus, electronic device, and storage medium. The system includes a business server, an application server, and a database server. The business server sends an accounting interface call request to the application server corresponding to the current business. Upon receiving the accounting interface call request, the application server determines the corresponding database server from the database cluster, reads the corresponding configuration data from the database server, performs verification processing, and updates the account data for multiple accounting nodes. This allows the accounting operation to be performed by an independently deployed application server, completely decoupled from the business server, thereby alleviating the pressure on the business server. Furthermore, the business server can complete the accounting operations for each level of nodes with a single interface call, eliminating the need to call multiple services for separate accounting, thus improving the processing efficiency and resource utilization of transaction accounting.

This invention provides a database cluster streaming replication method and related products based on shared storage. The method includes: monitoring the continuous idle time of the master database node; in response to the continuous idle time exceeding a first threshold, the master database node generates auxiliary write-ahead log data at a preset period and sends it to the slave database; in response to the continuous idle time exceeding a second threshold, the master database node stops generating auxiliary write-ahead log data and sends a state transition log to the slave database. The solution of this invention, by periodically generating auxiliary write-ahead log data and filling the leaf nodes of the paired heap within the first threshold, ensures that the leaf nodes of the slave database are always active, avoiding the problem of slave database replay blocking due to a node having no business logs for a long time. By stopping the generation of auxiliary write-ahead log data after the continuous idle time exceeds the second threshold and removing the corresponding leaf node from the paired heap, the waste of storage space and I / O resources is eliminated.

The embodiment of the application provides a database cluster switching method, an electronic device, a storage medium and a program product. The method comprises the following steps: determining a fault identifier to determine the fault state of a master database cluster (a first database cluster); obtaining a first service running parameter; and using a preset switching state evaluation model to distinguish and evaluate the running state of a core service and a non-core service to obtain a switching state score. The switching request is generated and the switching to a standby database cluster (a second database cluster) is performed only when the fault identifier indicates a fault and the switching state score is greater than a first threshold. The beneficial effect is that the fault identifier is used to accurately determine the fault state of the master cluster, and the invalid switching in the fault-free scenario is avoided. The switching state evaluation model is used to evaluate the core service and the non-core service, the key state of the service running is accurately captured, and the accuracy of the database cluster switching decision is effectively improved.

This disclosure presents a database deployment method, apparatus, electronic device, and storage medium, relating to the field of data processing technology. The database deployment method includes: receiving database information of at least one database to be deployed; determining the database type and business load requirements based on the database information; generating a deployment strategy corresponding to the database based on the database type and business load requirements; encapsulating the database into a container image; and distributing the container image to corresponding target servers based on the deployment strategy to obtain a database cluster. By employing containerization technology to encapsulate different types of domestically produced databases and combining differentiated deployment of different database types, it achieves compatible operation of multiple databases within the same resource pool, solving the problem of poor compatibility in existing technologies.

This invention discloses a distributed database metadata replication method and system, belonging to the field of distributed database technology. The method includes a source-side sending module (KVSender), a target-side rewriting module (KVRewriter), and a target-side execution and disk persistence module (Executor). The source-side sending module (KVSender) sends the data to be synchronized from the source database to the target. The target-side rewriting module (KVRewriter) rewrites the sent keys and values ​​to the correct keys and values. The target-side execution and disk persistence module (Executor) resolves transaction dependencies and performs data disk persistence. This invention can replicate metadata between different database clusters while meeting the requirements for real-time replication of business data. It supports metadata synchronization between the primary and standby databases (source and target) while ensuring real-time performance, without affecting the replication of normal data.

The application provides a log regulation method, medium, product and equipment of a database cluster. The method comprises: in a plurality of backup databases of the database cluster, each backup database receives pre-written logs of a corresponding master database through leaf nodes of a self-paired heap; a backup database with the fastest playback progress is determined as a feedback backup database in the plurality of backup databases; in the case that all the pre-written logs received by the leaf nodes of the feedback backup database are special logs and the duration reaches a preset time threshold, idle control information is sent from the feedback backup database to the master database; the master database enters a business idle state in response to the idle control information and stops the generation and transmission of special logs. Through this method, a unified and coordinated idle feedback mechanism can be established in the multi-backup database cluster, the problems of signal redundancy, conflict and master misjudgment caused by independent feedback of multiple backup databases are solved from the root, the real-time response capability of the system is enhanced, and more efficient log transmission and application processes are realized.

The application provides a log regulation method, medium, product and equipment of a database cluster. The method comprises: sampling leaf nodes of a pairing heap in a backup database of the database cluster, the pairing heap being used to receive prewrite logs sent by a master database in the database cluster to the backup database, the prewrite logs comprising business logs and special logs, the special logs being used to advance a playback version number of the backup database; in the case that all the prewrite logs received by the leaf nodes are special logs and the duration reaches a preset time threshold, controlling the backup database to send idle control information to the master database; and the master database, in response to the idle control information, entering a business idle state and stopping generation and transmission of the special logs. This method can effectively prevent continuous generation of meaningless special logs in the master database idle stage, greatly improve the resource utilization rate of the database cluster, and reduce the operation and maintenance cost of the cluster on the premise of guaranteeing the consistency of the cluster data and the basic function of log playback.

The application provides a sequence value processing method in a database cluster, a medium and a computer device. The method comprises the following steps: establishing a target cache according to a sequence value in a host of the database cluster; receiving a sequence value application request from a backup host in the database cluster through the host; and returning a corresponding sequence segment in the target cache according to the sequence value application request, wherein the sequence segment comprises sequence values in a set range. Through the method, the work of the host and the backup host in the database cluster can be more clearly defined, the update work is completed by the host with better performance, the backup host is only responsible for query, all backup hosts dynamically apply for sequence segments from the host, the uniqueness and integrity of the sequence value can be ensured through the host, and thus the performance of the database is improved.

The application discloses a database cluster deployment system and method, electronic equipment and storage medium, and is used for solving the technical problems of poor database cluster deployment effect and easy occurrence of "resource island" in related technologies. The database cluster deployment system provided by the application is located in a K8s cluster and at least comprises a cluster topology controller and a storage management controller in communication connection with the cluster topology controller. The cluster topology controller is used for detecting a to-be-deployed database cluster created by a user, and a first cloud native resource and a second cloud native resource are associated with the to-be-deployed database cluster. The storage management controller is used for binding a local storage resource object and a write service to the first cloud native resource, and binding a shared storage resource object and a read service to the second cloud native resource, so that the data can be directly synchronized from a physical log layer, the write amplification problem is reduced, and the "resource island" phenomenon is further reduced.

The application discloses a database residual SQL statement processing method, device and equipment and a storage medium. The method comprises the following steps: periodically collecting running information of current running statements on each instance in a database cluster; based on the running information, comprehensively analyzing the current running statements from multiple preset dimensions, and identifying residual SQL statements in the current running statements according to an analysis result; determining a corresponding target cleaning strategy according to the distribution of the residual SQL statements in the database cluster; and performing a cleaning operation on the residual SQL statements according to the target cleaning strategy, and recording a cleaning result. The application periodically collects the running information of the current running statements on each instance in the database cluster, then comprehensively analyzes the current running statements from multiple preset dimensions, and finally determines the corresponding target cleaning strategy according to the distribution of the residual SQL statements in the database cluster, so that automatic and accurate identification and efficient cleaning of the residual SQL statements are realized.

The application provides a database cluster state detection method and system, and relates to the technical field of databases. The method applied to a cloud control platform comprises the following steps: receiving first state information sent by a first detection agent to obtain state information of each database instance in a database cluster that meets a first condition and generating labels of corresponding Pods by using the state information of each database instance in the database cluster that meets the first condition; receiving first global state information sent by the first detection agent to obtain global state information corresponding to each detection agent in the database cluster and performing arbitration processing based on the global state information corresponding to each detection agent in the database cluster to obtain final state information of each database instance in the database cluster; and updating the labels of the corresponding Pods by using the final state information of each database instance in the database cluster. The method provided by the application can improve the database cluster state detection efficiency.