75 results about "Database backup" patented technology

The invention relates to the technical field of database backup, and particularly provides a MySQL database incremental encryption backup method and device based on MySQLdump, and the device comprises a total backup module, an incremental backup module, an encryption module and a backup management module; the full backup module adopts a MySQL official tool mysqldump to realize complete backup of the database; the incremental backup module is realized on the basis of a MySQL binary log binlog, and data changes are captured by analyzing event records in the binlog; the encryption module is constructed based on an OpenSSL library and provides enterprise-level data protection capability; and the backup management module realizes backup full-life-cycle management. Compared with the prior art, the method has the advantages that the problem of high consumption of traditional total backup resources and the safety problem can be solved, and meanwhile, the complexity and extra cost of a third-party backup tool are avoided.

In one embodiment, a method comprises generating a backup of a table of a relational database by partitioning a plurality of records of the table among a plurality of Parquet files; and extracting metadata of the table into one or more metadata files; and requesting access of at least one of the plurality of Parquet files of the backup of the relational database responsive to an SQL query entered by a user into a user interface.

A system and method for querying multiple database tables in a database backup are provided. The method includes receiving identification of database tables to query, wherein the database tables in a column-based format, and the database backup includes for each database table classification data for at least classifying its respective column names; generating a prompt for a first language model that provides a set of queries targeting the database tables, wherein the generated prompt is based on at least a received input query and the classification data for the database tables; executing the set of queries on the database tables, wherein each query of the set of queries is executed on a respective database table; and aggregating and displaying results returned in response to the execution of the set of queries.

The invention discloses a distributed database backup method and device and a medium, and relates to the field of databases, the method comprises the following steps: receiving a backup instruction of a target database, analyzing the backup instruction, extracting a backup type and a backup target range in the backup instruction, and generating a corresponding backup task; when the full backup task is executed, an initial logic clock is generated, and an initial blood relationship topological graph is constructed; creating a full-amount atomic snapshot, partitioning the full-amount atomic snapshot and storing the full-amount atomic snapshot into a corresponding physical backup medium to generate full-amount metadata; when the incremental backup task is executed, historical backup metadata is obtained, a change log in the target database is scanned according to a historical logic clock, and the historical blood relationship topological graph is updated based on a change record; determining a newly-added storage unit, creating a newly-added atomic snapshot, and storing the newly-added atomic snapshot in a physical backup medium; incremental metadata is generated. The integrity and accuracy of incremental data are ensured, and the risk of data omission or wrong backup is reduced.

This disclosure describes a database backup method and apparatus, and a computing device cluster. In embodiments, a first corrupted-page inspection operation is performed on a first page in a data table of a database, to determine a first inspection result, where the first is used to record metadata of the data table; the first page is backed up when the first inspection result indicates that the first page is a normal page; a second corrupted-page inspection operation is performed on a second page in the data table based on the first page, to determine a second inspection result, where the second is used to record data in the data table; and the second page is backed up when the second inspection result indicates that the second page is a corrupted page.

Embodiments of the present application provide a database backup method and device, electronic equipment and storage medium, the method comprising: in the case of reaching a preset time node, triggering the database to refresh the data page in the shared cache area to the disk, and locking the file operation of the database switching pre-write log; after creating the basic snapshot data of the database and storing the basic snapshot data, unlocking the file operation, and listening to a plurality of pre-write logs output by the database after the file operation recovers, generating incremental log data based on the plurality of pre-write logs and storing the incremental log data; determining the starting file identifier corresponding to the earliest pre-write log in the incremental log data, and sequentially marking other pre-write logs in the incremental log data based on the starting file identifier; creating metadata information corresponding to the basic snapshot data. The present scheme realizes the non-interrupted backup of the database, guarantees the data consistency and integrity, reduces the backup data volume, and improves the backup efficiency.

This application relates to the field of database backup technology, specifically disclosing a method, apparatus, computer device, and storage medium for backup of a distributed database. This application pre-builds a Citus cluster to be written to on the backup end during database backup, solving the problem of missing metadata when performing logical backups of CN and DN nodes separately. Incremental data synchronization is performed through the starting point of incremental data synchronization, enabling eventual consistency of data from multiple nodes on the source end, thus improving the reliability of database backup. Synchronization relationships and sharding instructions can achieve backups between instances of unequal specifications, improving the flexibility of distributed database backup.

One or more embodiments of the invention provide a method and device for adjusting backup capacity, and the method comprises the steps: firstly obtaining historical data, related to the backup capacity, of a database in a target historical time period, and then generating time sequence features arranged according to a time sequence according to the historical data; model input data is generated through the time sequence features and serves as input of a hybrid model. After model input data are produced, the model input data are input into a hybrid model for capacity prediction, so that the predicted capacity of the database in the future time period is obtained, and the hybrid model comprises a first model for processing nonlinear short-term features and a second model for processing linear long-term features; each model outputs a prediction result according to the model input data, and the output results of all the models are comprehensively calculated to obtain the prediction capacity of the database output by the final hybrid model in the future time period, so that the backup capacity of the database in the future time period is dynamically adjusted according to the prediction capacity.

A system and method for the device may include reading a plurality of rows of a database. In addition, the device may include generating a secondary hash value for each row of the plurality of rows. The device may include generating a plurality of row groups, each including a group of unique rows of the plurality of rows, based at least on the secondary hash value. Moreover, the device may include generating a primary hash value for each row group of the plurality of row groups. Also, the device may include updating a backup of the database based on a first-row group of the plurality of row groups, in response to determining that a primary hash value of the first-row group does not match any primary hash value associated with the backup of the database.

The invention discloses a database backup method and device, equipment, a storage medium and a product, and the method comprises the steps: recognizing external storage media corresponding to each database node in a distributed database, and recording a mapping relation between each external storage media and the corresponding database node; according to the mapping relationship, mounting the path of each external storage medium to a storage directory of a corresponding database node to obtain a backup directory corresponding to each database node; and in response to the data backup request, backing up the target data corresponding to each database node to the corresponding backup directory. According to the technical scheme, the data backup and recovery efficiency in the distributed database can be improved, and the reliability of a data backup result and a data recovery result is ensured.

The web-based EMR backup system empowers Healthcare facility administrators by building cyber resilience to ransomware threats, data breaches, power outages, or planned downtimes. A web-based EMR backup process is provided in embodiments of the invention, enabling administrators to activate a web-based EMR system in the event of a debilitating cyber-attack, power outage, or planned downtime, that allows healthcare professionals to maintain their daily workflow using the web-based EMR backup system in order to maintain business continuity and clinical resiliency. The web-based EMR system minimizes the risks that would arise due to errors generated because of traditional record keeping methods, such as manual record keeping, while also maintaining the workflow efficiencies modern EMR systems provide. The web-based EMR backup system synchronizes any changes made during the cyber-threat, power outage, or planned downtime once the main EMR is restored to ensure data consistency and provide significant financial savings by preventing the need to reconcile the two databases by hand.

The present disclosure provides a directory quota information acquisition method and device based on database backup recovery (BR), relates to the technical field of data processing, and particularly relates to the fields of cloud computing and big data. The specific implementation scheme is as follows: performing a BR operation on a database to export a backup file containing metadata from the database; in the execution process of the BR operation, synchronously analyzing the exported backup file to acquire directory attribute information; generating a directory full path according to the directory attribute information, and acquiring quota information of each directory according to the directory full path.

The application discloses an archiving log processing method and system, when a database backup task is started, the number of backup channels is increased or the number of archiving processes is reduced according to the importance of the database system, so that the speed of generating the archiving log is slowed down, the archiving log is timely backed up to the tape library during the time of the archiving log generation peak, the archiving space of the database is released, and the risk of long-time non-response of the database caused by the full archiving space of the database is avoided. In addition, during the time of the archiving log generation peak, the archiving log is timely backed up to the tape library, the archiving log backup operation does not need to be frequently performed, the performance of executing the database business can be avoided from being affected by the frequent backup operation, and thus the efficiency of executing the database business is improved.

The invention relates to a backup management method, system and device for a distributed computing cluster, a storage medium and a program product. Comprising the steps that a background management server selects a backup main node, and backup sub-jobs are respectively issued to the backup main node and a sub-cluster main node; the backup main node obtains cluster lock information and sends the cluster lock information to the cluster management server; the sub-cluster main node performs backup configuration and sends configuration information to the cluster management server; the cluster management server makes a backup decision according to the cluster lock information and the configuration information, and notifies the backup node of a decision result; if the cluster state meets the preset condition, the backup main node sends a backup command to the sub-cluster main node; and the sub-cluster main node is connected with the storage server and executes database backup operation according to the parameters carried in the backup command and the parameters carried in the backup sub-job. By means of the mode, the DPC cluster backup task can be completed through cooperative work of the service access node, the metadata node and the data node.

Embodiments of the present disclosure provide a database recovery method and device, electronic equipment and storage medium, relating to the field of databases, which can be used in the field of distributed databases, for example. The method comprises: determining a target time to be recovered and an upstream database; obtaining at least one target log record related to the target time from a plurality of log files backed up by the upstream database; determining a downstream storage node corresponding to the target log record; sending each target log record to the corresponding downstream storage node through multiple threads; and storing, by the downstream storage node, a target log record with the largest transaction identifier among a plurality of target log records received for the same row index, based on the transaction identifier in each target log record among the plurality of target log records, so as to restore the downstream database to the upstream database at the target time. The embodiments of the present disclosure improve the efficiency of data recovery.

A method and system for updating backup data for a database is presented. The method includes initiating a merging operation for a defined time interval; obtaining change data capture (CDC) data generated during the defined time interval; aggregating and ordering the CDC data by a key value; identifying backup data associated with the ordered CDC data; generating a candidate data object that represents data modified during the defined time interval; deduplicating the candidate data object by comparing a hash identifier of the candidate data object with a plurality of hash identifiers stored in a repository; storing the candidate data object when the comparison determines that no matching hash identifier exists in the repository; and updating backup metadata to associate the key value with the candidate data object.

The application discloses a database physical backup verification method and device, a storage medium and electronic equipment, and relates to the technical field of database backup and recovery. The method comprises the following steps: performing slice correctness verification on a physical backup file; if the slice correctness verification is passed, performing logical integrity verification on the physical backup file; if the logical integrity verification is passed, performing recovery preview verification on the physical backup file, which comprises the following steps: simulating a database recovery process, temporarily storing data blocks inconsistent with existing data on a disk in memory during the recovery process, and attempting to start a database instance after simulating the recovery; and judging whether to perform an actual database recovery operation according to the result of the recovery preview verification. Through active and layer-by-layer verification of the integrity and recoverability of the backup file before recovery, the problem of'secondary damage' caused by the use of damaged backup is eliminated, and the problems of additional storage overhead and prolonged recovery time caused by the traditional full copy scheme are avoided.

The invention relates to the technical field of data processing, in particular to a credential database backup recovery method and system.The credential database backup recovery method comprises the steps that feature abstraction is conducted on each row of data of a credential database to be backed up, a data vector of each row of data is obtained, and each row of data comprises at least one information attribute; determining the spatial popularity of each data point according to the distance between adjacent data points of each data point and each data point and a data vector formed by the adjacent data points and each data point; based on the spatial popularity and the data vector of each data point, determining termination evaluation of each data point to obtain a termination evaluation sequence, and partitioning data in the credential database based on the termination evaluation sequence to obtain a plurality of districts; and exporting the data of each area as a target file so as to back up the data of the credential database, and recovering the data of each area in the target file to the corresponding partition of the credential database. According to the method, the efficiency, accuracy and reliability of backup and recovery of the credential database are improved.

The application relates to the technical field of database backup and synchronization, in particular to a database master-slave file adaptive fast synchronization method, which comprises the following steps: performing difference evaluation based on the meta information of the database master-slave files, directly adopting a record-by-record synchronization mode if the overall difference is too large, or entering an incremental synchronization mode; the incremental synchronization identifies inconsistent blocks by comparing the check values of the data blocks and counts the number of the inconsistent blocks; the system respectively estimates the total time consumption of the two synchronization modes according to performance parameters, the total block number, the inconsistent block number and the total record number; a secondary decision is made by comparing the estimated time consumption, and the scheme with shorter time consumption is selected for execution; and the final consistency verification is performed on the master database file and the backup database file. Through the multi-layer threshold value judgment and the dynamic time consumption estimation model, the application intelligently selects the record-by-record synchronization or the block incremental synchronization strategy, guarantees the data consistency, and significantly improves the efficiency of the database master-slave file synchronization.

The application discloses a method, device and equipment for realizing quick synchronization of DDL of a database backup machine and a storage medium, and relates to the technical field of databases, which comprises the following steps: setting a DDL synchronization thread on a host and setting a DDL playback thread on a backup machine; the host executes DDL through a DDL execution thread on the host, synchronizes the executed DDL to the DDL synchronization thread through the DDL execution thread, and synchronizes the executed DDL to the DDL playback thread on the backup machine through the DDL synchronization thread; the backup machine sends the received DDL to the DDL execution thread on the backup machine through the DDL playback thread, and executes the DDL through the DDL execution thread. The application executes ddl on the host and the backup machine simultaneously, effectively improves the playback speed of the DDL of the database backup machine, reduces the playback delay, and effectively guarantees the RTO and RPO of the database.

This application provides a method, device, storage medium, and program product for parallel merging of database backup sets, relating to the field of distributed systems. The method includes: obtaining the dependency chain of the backup sets to be merged; obtaining data block penetration markers based on the backup set dependency chain; processing data blocks in the full backup set in parallel to a temporary directory through multiple first sub-processes; processing at least one file dependent on an incremental backup set in parallel to a temporary directory through multiple second sub-processes; merging incremental data blocks from at least one incremental backup set in parallel to a temporary directory through multiple third sub-processes; and organizing and generating a merged full backup set based on the contents of the temporary directory. This method adds parallel scheduling capabilities based on data block penetration markers, improving the execution efficiency of merging backup sets.

A method and system for reducing deduplication in database backup are provided. The method includes selecting a first primary key of a database; extracting a plurality of row groups from the database based on the selected first primary key; storing the plurality of row groups arranged according to the first primary key in a file having a column-oriented data storage format as a database backup at a first time; reading at least a portion of the database backup at a second time to detect a plurality of changes; determining a position of each row corresponding to a change of the plurality of changes; selecting a second primary key of the database as a primary key; and generating a database backup of the database at the second time based on the selected second primary key.

The invention discloses a MySQL database backup and monitoring method and device and a medium, belongs to the technical field of cloud native database operation and maintenance, and is used for solving the technical problems that a traditional backup scheme needs manual intervention, is complex in operation, is difficult to be independently operated and completed by a common user, is high in time cost and low in efficiency, and also has the lack of a monitoring mechanism. The method comprises the following steps: carrying out resource configuration processing under a related custom resource mechanism on a Kubernetes cluster, and generating and deploying a resource definition module; state change monitoring is carried out on self-defined resources in the resource definition module, backup scheduling and backup recovery processing in a related self-defined resource state is carried out on a MySQL database needing to be backed up in a kubernetes cluster, and a backup and recovery logic control strategy based on an Operator controller is generated; and carrying out monitoring processing on the MySQL database and the backup and recovery logic control strategy under related database abnormal states and backup and recovery task abnormal indexes, and determining early warning information.

The invention relates to the technical field of database synchronization, and provides a data synchronization method and device based on database restoration, and the method comprises the steps that a source end synchronization tool obtains a backup file generated by a source end database; sending the backup file to a destination synchronization tool to enable the destination synchronization tool to obtain a reference database; obtaining a minimum log serial number corresponding to an active transaction in a source end database at the backup starting moment and a maximum log serial number corresponding to the backup finishing moment; reading an operation log of which the log serial number is greater than the minimum log serial number in a log file of the source end database, and modifying a submission operation of which the log serial number is less than or equal to the maximum log serial number into a rollback operation to obtain a target operation log, the target end synchronization tool carries out data synchronization on the target end database according to the reference database and the target operation log. According to the method, the consistency of the data is effectively maintained on the premise that the active transaction is automatically rolled back after the backup of the destination end database is restored.

The application provides a database backup method and device, the method comprising: obtaining database configuration information, wherein the database configuration information comprises an asynchronous backup database IP address and a backup script IP address; judging whether the backup script IP address and the asynchronous backup database IP address are the same according to the database configuration information; replacing the backup script IP address with the asynchronous backup database IP address in the case that the backup script IP address and the asynchronous backup database IP address are different; and running the backup script to perform database backup. Through the database type judgment on the database corresponding to the execution script before the database backup on the database after the completion of the master-slave database switching, the database backup is performed in the case that the database is determined to be an asynchronous backup database. The database backup on the master database is effectively avoided, the business jam caused by the database backup on the master database is avoided, the safe operation of the master database business is ensured, and the security of the database is improved.

The embodiment of the invention provides a database backup method and device, electronic equipment and a storage medium, and the method comprises the steps: triggering a database to refresh a data page in a shared cache region to a disk under the condition that a preset time node is reached, and locking the file operation of switching a pre-write log by the database; after basic snapshot data of the database is created and stored, the file operation is unlocked, multiple pre-write logs output by the database after the file operation is recovered are monitored, incremental log data are generated based on the multiple pre-write logs, and the incremental log data are stored; determining an initial file identifier corresponding to the earliest pre-written log in the incremental log data, and marking other pre-written logs in the incremental log data in sequence based on the initial file identifier; and creating metadata information corresponding to the basic snapshot data. According to the scheme, the non-interruption backup of the database is realized, the data consistency and integrity are guaranteed, the backup data volume is reduced, and the backup efficiency is improved.

A method and system for reducing deduplication in database backup are provided. The method includes selecting a first primary key of a database; extracting a plurality of row groups from the database based on the selected first primary key; storing the plurality of row groups arranged according to the first primary key in a file having a column-oriented data storage format as a database backup at a first time; reading at least a portion of the database backup at a second time to detect a plurality of changes; determining a position of each row corresponding to a change of the plurality of changes; selecting a second primary key of the database as a primary key; and generating a database backup of the database at the second time based on the selected second primary key.

The present invention provides a database backup method and apparatus, and a computing device cluster. In embodiments, a first corrupted-page inspection operation is performed on a first page in a data table of a database, to determine a first inspection result, where the first is used to record metadata of the data table; the first page is backed up when the first inspection result indicates that the first page is a normal page; a second corrupted-page inspection operation is performed on a second page in the data table based on the first page, to determine a second inspection result, where the second is used to record data in the data table; and the second page is backed up when the second inspection result indicates that the second page is a corrupted page. In this way, a backup process of the data table has a check and failure tolerance capability.

The web-based EMR backup system empowers Healthcare facility administrators by building cyber resilience to ransomware threats, data breaches, power outages, or planned downtimes. A web-based EMR backup process is provided in embodiments of the invention, enabling administrators to activate a web-based EMR system in the event of a debilitating cyber-attack, power outage, or planned downtime, that allows healthcare professionals to maintain their daily workflow using the web-based EMR backup system in order to maintain business continuity and clinical resiliency. The web-based EMR system minimizes the risks that would arise due to errors generated because of traditional record keeping methods, such as manual record keeping, while also maintaining the workflow efficiencies modern EMR systems provide. The web-based EMR backup system synchronizes any changes made during the cyber-threat, power outage, or planned downtime once the main EMR is restored to ensure data consistency and provide significant financial savings by preventing the need to reconcile the two databases by hand.

This invention relates to the field of database backup and recovery technology, and more particularly to a rapid backup and recovery system for user databases in SaaS website building systems. The system includes a message queue module for maintaining data integrity; an encryption algorithm for generating hash values ​​to verify data integrity; a real-time communication module for updating the data backup status in real time; and an anomaly detection module for detecting and troubleshooting problems in the system. By combining the message queue module with the real-time communication module, this invention effectively improves the efficiency of the user backup and recovery process, enabling real-time monitoring during backup and recovery. Furthermore, the encryption algorithm, by generating hash values, ensures database consistency, which helps prevent errors that may occur during data recovery. Additionally, the encryption algorithm enhances system security, ensuring database security and mitigating potential security risks.