98 results about "Database backup" patented technology

The invention relates to the technical field of database backup, and particularly provides a MySQL database incremental encryption backup method and device based on MySQLdump, and the device comprises a total backup module, an incremental backup module, an encryption module and a backup management module; the full backup module adopts a MySQL official tool mysqldump to realize complete backup of the database; the incremental backup module is realized on the basis of a MySQL binary log binlog, and data changes are captured by analyzing event records in the binlog; the encryption module is constructed based on an OpenSSL library and provides enterprise-level data protection capability; and the backup management module realizes backup full-life-cycle management. Compared with the prior art, the method has the advantages that the problem of high consumption of traditional total backup resources and the safety problem can be solved, and meanwhile, the complexity and extra cost of a third-party backup tool are avoided.

In one embodiment, a method comprises generating a backup of a table of a relational database by partitioning a plurality of records of the table among a plurality of Parquet files; and extracting metadata of the table into one or more metadata files; and requesting access of at least one of the plurality of Parquet files of the backup of the relational database responsive to an SQL query entered by a user into a user interface.

A system and method for querying multiple database tables in a database backup are provided. The method includes receiving identification of database tables to query, wherein the database tables in a column-based format, and the database backup includes for each database table classification data for at least classifying its respective column names; generating a prompt for a first language model that provides a set of queries targeting the database tables, wherein the generated prompt is based on at least a received input query and the classification data for the database tables; executing the set of queries on the database tables, wherein each query of the set of queries is executed on a respective database table; and aggregating and displaying results returned in response to the execution of the set of queries.

The invention discloses a distributed database backup method and device and a medium, and relates to the field of databases, the method comprises the following steps: receiving a backup instruction of a target database, analyzing the backup instruction, extracting a backup type and a backup target range in the backup instruction, and generating a corresponding backup task; when the full backup task is executed, an initial logic clock is generated, and an initial blood relationship topological graph is constructed; creating a full-amount atomic snapshot, partitioning the full-amount atomic snapshot and storing the full-amount atomic snapshot into a corresponding physical backup medium to generate full-amount metadata; when the incremental backup task is executed, historical backup metadata is obtained, a change log in the target database is scanned according to a historical logic clock, and the historical blood relationship topological graph is updated based on a change record; determining a newly-added storage unit, creating a newly-added atomic snapshot, and storing the newly-added atomic snapshot in a physical backup medium; incremental metadata is generated. The integrity and accuracy of incremental data are ensured, and the risk of data omission or wrong backup is reduced.

This disclosure describes a database backup method and apparatus, and a computing device cluster. In embodiments, a first corrupted-page inspection operation is performed on a first page in a data table of a database, to determine a first inspection result, where the first is used to record metadata of the data table; the first page is backed up when the first inspection result indicates that the first page is a normal page; a second corrupted-page inspection operation is performed on a second page in the data table based on the first page, to determine a second inspection result, where the second is used to record data in the data table; and the second page is backed up when the second inspection result indicates that the second page is a corrupted page.

Embodiments of the present application provide a database backup method and device, electronic equipment and storage medium, the method comprising: in the case of reaching a preset time node, triggering the database to refresh the data page in the shared cache area to the disk, and locking the file operation of the database switching pre-write log; after creating the basic snapshot data of the database and storing the basic snapshot data, unlocking the file operation, and listening to a plurality of pre-write logs output by the database after the file operation recovers, generating incremental log data based on the plurality of pre-write logs and storing the incremental log data; determining the starting file identifier corresponding to the earliest pre-write log in the incremental log data, and sequentially marking other pre-write logs in the incremental log data based on the starting file identifier; creating metadata information corresponding to the basic snapshot data. The present scheme realizes the non-interrupted backup of the database, guarantees the data consistency and integrity, reduces the backup data volume, and improves the backup efficiency.

This application relates to the field of database backup technology, specifically disclosing a method, apparatus, computer device, and storage medium for backup of a distributed database. This application pre-builds a Citus cluster to be written to on the backup end during database backup, solving the problem of missing metadata when performing logical backups of CN and DN nodes separately. Incremental data synchronization is performed through the starting point of incremental data synchronization, enabling eventual consistency of data from multiple nodes on the source end, thus improving the reliability of database backup. Synchronization relationships and sharding instructions can achieve backups between instances of unequal specifications, improving the flexibility of distributed database backup.

One or more embodiments of the invention provide a method and device for adjusting backup capacity, and the method comprises the steps: firstly obtaining historical data, related to the backup capacity, of a database in a target historical time period, and then generating time sequence features arranged according to a time sequence according to the historical data; model input data is generated through the time sequence features and serves as input of a hybrid model. After model input data are produced, the model input data are input into a hybrid model for capacity prediction, so that the predicted capacity of the database in the future time period is obtained, and the hybrid model comprises a first model for processing nonlinear short-term features and a second model for processing linear long-term features; each model outputs a prediction result according to the model input data, and the output results of all the models are comprehensively calculated to obtain the prediction capacity of the database output by the final hybrid model in the future time period, so that the backup capacity of the database in the future time period is dynamically adjusted according to the prediction capacity.

A system and method for the device may include reading a plurality of rows of a database. In addition, the device may include generating a secondary hash value for each row of the plurality of rows. The device may include generating a plurality of row groups, each including a group of unique rows of the plurality of rows, based at least on the secondary hash value. Moreover, the device may include generating a primary hash value for each row group of the plurality of row groups. Also, the device may include updating a backup of the database based on a first-row group of the plurality of row groups, in response to determining that a primary hash value of the first-row group does not match any primary hash value associated with the backup of the database.

The invention discloses a database backup method and device, equipment, a storage medium and a product, and the method comprises the steps: recognizing external storage media corresponding to each database node in a distributed database, and recording a mapping relation between each external storage media and the corresponding database node; according to the mapping relationship, mounting the path of each external storage medium to a storage directory of a corresponding database node to obtain a backup directory corresponding to each database node; and in response to the data backup request, backing up the target data corresponding to each database node to the corresponding backup directory. According to the technical scheme, the data backup and recovery efficiency in the distributed database can be improved, and the reliability of a data backup result and a data recovery result is ensured.

The invention relates to an upgrade verification method and device, equipment, a medium and a program product. The upgrade verification method comprises the following steps: calling an automatic deployment script to enable the automatic deployment script to perform service deployment operation on a control node and a gateway server corresponding to a to-be-upgraded machine room based on a first installation package, a configuration file and a database backup file before upgrade, and generating a test verification environment; based on a gateway agent type corresponding to the target operation, determining a target gateway corresponding to the gateway agent type, and obtaining first gateway data before upgrading corresponding to the target gateway; obtaining an upgraded second installation package, carrying out environment building after upgrading based on the second installation package, and generating upgraded second gateway data; and the upgrade verification operation is performed based on the first gateway data and the second gateway data to obtain the upgrade verification result, so that upgrade verification can be performed in an automatic manner, and the efficiency and accuracy of upgrade verification are improved.

The invention discloses a TB-level database rapid backup method based on a B / S architecture, and relates to the technical field of data processing. Comprising the following steps: S1, designing a B / S architecture; s2, a scheduling and backup strategy; s3, optimizing data transmission; s4, data segmentation; s5, performing parallel processing; s6, managing and optimizing a backup file; and S7, performing backup verification and recovery. A B / S framework is adopted, the core function of the database migration system is deployed on the server, a user conducts migration operation through a browser, the user can achieve remote migration without installing complex software locally, the backup efficiency of the TB-level database is improved, the backup time is shortened, the backup process is simplified, the operation complexity is reduced, and the backup efficiency of the TB-level database is improved. According to the method, the user experience is improved, the security and reliability of data management are enhanced, the comprehensive coverage and rapid recovery of data are ensured, the advantages of the B / S architecture are fully utilized, and the expandability and flexibility of the system are improved.

The web-based EMR backup system empowers Healthcare facility administrators by building cyber resilience to ransomware threats, data breaches, power outages, or planned downtimes. A web-based EMR backup process is provided in embodiments of the invention, enabling administrators to activate a web-based EMR system in the event of a debilitating cyber-attack, power outage, or planned downtime, that allows healthcare professionals to maintain their daily workflow using the web-based EMR backup system in order to maintain business continuity and clinical resiliency. The web-based EMR system minimizes the risks that would arise due to errors generated because of traditional record keeping methods, such as manual record keeping, while also maintaining the workflow efficiencies modern EMR systems provide. The web-based EMR backup system synchronizes any changes made during the cyber-threat, power outage, or planned downtime once the main EMR is restored to ensure data consistency and provide significant financial savings by preventing the need to reconcile the two databases by hand.

The present disclosure provides a directory quota information acquisition method and device based on database backup recovery (BR), relates to the technical field of data processing, and particularly relates to the fields of cloud computing and big data. The specific implementation scheme is as follows: performing a BR operation on a database to export a backup file containing metadata from the database; in the execution process of the BR operation, synchronously analyzing the exported backup file to acquire directory attribute information; generating a directory full path according to the directory attribute information, and acquiring quota information of each directory according to the directory full path.

In some examples, a method of performing a backup of a group of relational databases comprises identifying database files to be fetched in the group of relational databases; grouping the identified database files into batches; based on configuration parameters of the identified database files, identifying, among the batches, a sub-set of batches of database files that are eligible to be fetched in parallel for the backup; configuring a single fetch call to a call stack to fetch the sub-set of eligible batches; and determining a push or pull model for the configured single fetch call based at least in part on feedback from a most resource-constrained element in the call stack.

Computer-implemented methods for optimizing a backup and recovery strategy of a database are provided. Aspects include obtaining service level agreements for the database, identifying an initial recommended database backup and recovery strategy for the database based on the service level agreements, and configuring a database backup of the database based on the initial recommended database backup and recovery strategy. Aspects also include monitoring a usage of one or more of the database and the database backup, identifying a recommended change to the configuration of the database backup based on the usage of one or more of the database and the database backup, and updating the configuration of the primary database based on the recommended change.

The application discloses an archiving log processing method and system, when a database backup task is started, the number of backup channels is increased or the number of archiving processes is reduced according to the importance of the database system, so that the speed of generating the archiving log is slowed down, the archiving log is timely backed up to the tape library during the time of the archiving log generation peak, the archiving space of the database is released, and the risk of long-time non-response of the database caused by the full archiving space of the database is avoided. In addition, during the time of the archiving log generation peak, the archiving log is timely backed up to the tape library, the archiving log backup operation does not need to be frequently performed, the performance of executing the database business can be avoided from being affected by the frequent backup operation, and thus the efficiency of executing the database business is improved.

The invention relates to a backup management method, system and device for a distributed computing cluster, a storage medium and a program product. Comprising the steps that a background management server selects a backup main node, and backup sub-jobs are respectively issued to the backup main node and a sub-cluster main node; the backup main node obtains cluster lock information and sends the cluster lock information to the cluster management server; the sub-cluster main node performs backup configuration and sends configuration information to the cluster management server; the cluster management server makes a backup decision according to the cluster lock information and the configuration information, and notifies the backup node of a decision result; if the cluster state meets the preset condition, the backup main node sends a backup command to the sub-cluster main node; and the sub-cluster main node is connected with the storage server and executes database backup operation according to the parameters carried in the backup command and the parameters carried in the backup sub-job. By means of the mode, the DPC cluster backup task can be completed through cooperative work of the service access node, the metadata node and the data node.

Disclosed are some implementations of systems, apparatus, methods and computer program products for implementing a database backup system.

Embodiments of the present disclosure provide a database recovery method and device, electronic equipment and storage medium, relating to the field of databases, which can be used in the field of distributed databases, for example. The method comprises: determining a target time to be recovered and an upstream database; obtaining at least one target log record related to the target time from a plurality of log files backed up by the upstream database; determining a downstream storage node corresponding to the target log record; sending each target log record to the corresponding downstream storage node through multiple threads; and storing, by the downstream storage node, a target log record with the largest transaction identifier among a plurality of target log records received for the same row index, based on the transaction identifier in each target log record among the plurality of target log records, so as to restore the downstream database to the upstream database at the target time. The embodiments of the present disclosure improve the efficiency of data recovery.

A method and system for updating backup data for a database is presented. The method includes initiating a merging operation for a defined time interval; obtaining change data capture (CDC) data generated during the defined time interval; aggregating and ordering the CDC data by a key value; identifying backup data associated with the ordered CDC data; generating a candidate data object that represents data modified during the defined time interval; deduplicating the candidate data object by comparing a hash identifier of the candidate data object with a plurality of hash identifiers stored in a repository; storing the candidate data object when the comparison determines that no matching hash identifier exists in the repository; and updating backup metadata to associate the key value with the candidate data object.

The application discloses a database physical backup verification method and device, a storage medium and electronic equipment, and relates to the technical field of database backup and recovery. The method comprises the following steps: performing slice correctness verification on a physical backup file; if the slice correctness verification is passed, performing logical integrity verification on the physical backup file; if the logical integrity verification is passed, performing recovery preview verification on the physical backup file, which comprises the following steps: simulating a database recovery process, temporarily storing data blocks inconsistent with existing data on a disk in memory during the recovery process, and attempting to start a database instance after simulating the recovery; and judging whether to perform an actual database recovery operation according to the result of the recovery preview verification. Through active and layer-by-layer verification of the integrity and recoverability of the backup file before recovery, the problem of'secondary damage' caused by the use of damaged backup is eliminated, and the problems of additional storage overhead and prolonged recovery time caused by the traditional full copy scheme are avoided.

The invention relates to the technical field of data processing, in particular to a credential database backup recovery method and system.The credential database backup recovery method comprises the steps that feature abstraction is conducted on each row of data of a credential database to be backed up, a data vector of each row of data is obtained, and each row of data comprises at least one information attribute; determining the spatial popularity of each data point according to the distance between adjacent data points of each data point and each data point and a data vector formed by the adjacent data points and each data point; based on the spatial popularity and the data vector of each data point, determining termination evaluation of each data point to obtain a termination evaluation sequence, and partitioning data in the credential database based on the termination evaluation sequence to obtain a plurality of districts; and exporting the data of each area as a target file so as to back up the data of the credential database, and recovering the data of each area in the target file to the corresponding partition of the credential database. According to the method, the efficiency, accuracy and reliability of backup and recovery of the credential database are improved.

The application relates to the technical field of database backup and synchronization, in particular to a database master-slave file adaptive fast synchronization method, which comprises the following steps: performing difference evaluation based on the meta information of the database master-slave files, directly adopting a record-by-record synchronization mode if the overall difference is too large, or entering an incremental synchronization mode; the incremental synchronization identifies inconsistent blocks by comparing the check values of the data blocks and counts the number of the inconsistent blocks; the system respectively estimates the total time consumption of the two synchronization modes according to performance parameters, the total block number, the inconsistent block number and the total record number; a secondary decision is made by comparing the estimated time consumption, and the scheme with shorter time consumption is selected for execution; and the final consistency verification is performed on the master database file and the backup database file. Through the multi-layer threshold value judgment and the dynamic time consumption estimation model, the application intelligently selects the record-by-record synchronization or the block incremental synchronization strategy, guarantees the data consistency, and significantly improves the efficiency of the database master-slave file synchronization.

The application discloses a method, device and equipment for realizing quick synchronization of DDL of a database backup machine and a storage medium, and relates to the technical field of databases, which comprises the following steps: setting a DDL synchronization thread on a host and setting a DDL playback thread on a backup machine; the host executes DDL through a DDL execution thread on the host, synchronizes the executed DDL to the DDL synchronization thread through the DDL execution thread, and synchronizes the executed DDL to the DDL playback thread on the backup machine through the DDL synchronization thread; the backup machine sends the received DDL to the DDL execution thread on the backup machine through the DDL playback thread, and executes the DDL through the DDL execution thread. The application executes ddl on the host and the backup machine simultaneously, effectively improves the playback speed of the DDL of the database backup machine, reduces the playback delay, and effectively guarantees the RTO and RPO of the database.

This application provides a method, device, storage medium, and program product for parallel merging of database backup sets, relating to the field of distributed systems. The method includes: obtaining the dependency chain of the backup sets to be merged; obtaining data block penetration markers based on the backup set dependency chain; processing data blocks in the full backup set in parallel to a temporary directory through multiple first sub-processes; processing at least one file dependent on an incremental backup set in parallel to a temporary directory through multiple second sub-processes; merging incremental data blocks from at least one incremental backup set in parallel to a temporary directory through multiple third sub-processes; and organizing and generating a merged full backup set based on the contents of the temporary directory. This method adds parallel scheduling capabilities based on data block penetration markers, improving the execution efficiency of merging backup sets.

A method and system for reducing deduplication in database backup are provided. The method includes selecting a first primary key of a database; extracting a plurality of row groups from the database based on the selected first primary key; storing the plurality of row groups arranged according to the first primary key in a file having a column-oriented data storage format as a database backup at a first time; reading at least a portion of the database backup at a second time to detect a plurality of changes; determining a position of each row corresponding to a change of the plurality of changes; selecting a second primary key of the database as a primary key; and generating a database backup of the database at the second time based on the selected second primary key.

The invention discloses a MySQL database backup and monitoring method and device and a medium, belongs to the technical field of cloud native database operation and maintenance, and is used for solving the technical problems that a traditional backup scheme needs manual intervention, is complex in operation, is difficult to be independently operated and completed by a common user, is high in time cost and low in efficiency, and also has the lack of a monitoring mechanism. The method comprises the following steps: carrying out resource configuration processing under a related custom resource mechanism on a Kubernetes cluster, and generating and deploying a resource definition module; state change monitoring is carried out on self-defined resources in the resource definition module, backup scheduling and backup recovery processing in a related self-defined resource state is carried out on a MySQL database needing to be backed up in a kubernetes cluster, and a backup and recovery logic control strategy based on an Operator controller is generated; and carrying out monitoring processing on the MySQL database and the backup and recovery logic control strategy under related database abnormal states and backup and recovery task abnormal indexes, and determining early warning information.

The invention discloses a database backup method and device, a database system and electronic equipment. The database backup method executed by a source database server comprises the following steps: when a target database needs to be reconstructed, sending a backup request to a target database server; when a request response sent by the target database server is received, backup data are obtained, and the backup data comprise full backup files of a source database; and transmitting the uncompressed full backup file to the target database server in a data stream mode. The database backup method executed by a target database server comprises the following steps: when a backup request of a source database server is received, deleting useless data of the target database server, and sending a request response to the source database server; receiving a total backup file transmitted by the source database server in a data stream mode; and reconstructing a target database according to the received full backup file.

The invention relates to the technical field of database synchronization, and provides a data synchronization method and device based on database restoration, and the method comprises the steps that a source end synchronization tool obtains a backup file generated by a source end database; sending the backup file to a destination synchronization tool to enable the destination synchronization tool to obtain a reference database; obtaining a minimum log serial number corresponding to an active transaction in a source end database at the backup starting moment and a maximum log serial number corresponding to the backup finishing moment; reading an operation log of which the log serial number is greater than the minimum log serial number in a log file of the source end database, and modifying a submission operation of which the log serial number is less than or equal to the maximum log serial number into a rollback operation to obtain a target operation log, the target end synchronization tool carries out data synchronization on the target end database according to the reference database and the target operation log. According to the method, the consistency of the data is effectively maintained on the premise that the active transaction is automatically rolled back after the backup of the destination end database is restored.