6results about How to "Improve backup efficiency" patented technology

The application discloses a kind of data disaster recovery methods of supporting multiple backup path switching, comprising, based on the sensitivity of input data and the generation of dynamic granularity data slice of storage medium characteristics, and generate the metadata label containing data slice identification, storage preference and recovery priority;Path quality atlas is generated for each data slice by constructing heterogeneous transmission path performance model through metadata label, and optimal transmission path is allocated, and path performance is monitored;Abnormality is detected and migrated slice by the standard deviation of cumulative transmission delay;Incremental integrity verification and Merkle proof of blockchain storage are used for parallel checking, and retransmission is preferentially checked failed slice;The application ensures the reliability and stability of data disaster recovery through the synergistic cooperation of dynamic data slicing, backup path optimization and recovery verification, to meet the real business needs.

The invention discloses a data lake table tape backup method and device, computer equipment and a storage medium. The method comprises the following steps: scanning a table list to be backed up to judge whether a table needing to be backed up exists or not; when the table needing to be backed up exists, the table to be backed up is determined; performing backup according to the type of the table to be backed up; and if the table cannot be obtained, writing all records from the last snapshot backup into a new Iceberg table for all tables involved in the backup, copying related data to a specified tape directory, and inserting the corresponding records into a metadata table. By implementing the method disclosed by the invention, economical and reliable long-term data backup can be realized, and the method is particularly suitable for application scenes with strict requirements on data persistence and integrity so as to solve the problems of efficiency and management of backup of a big data system.

This application relates to a file backup method, apparatus, computer device, and readable storage medium. The method includes: obtaining a directory to be backed up; generating multiple backup tasks for each file in the directory; the backup tasks back up each file to a server according to file identifier order and directory identifier order, and generating backup set fragments corresponding to the backup tasks; each backup task is associated with context information; the context information includes backup progress information and backup set fragment information; the backup set fragment information includes the amount of data already written to files in the backup set fragments; running multiple backup tasks in parallel, periodically generating corresponding backup set checkpoint files at checkpoint times based on the context information of the backup tasks, and uploading the backup set checkpoint files to the server; the backup set checkpoint files are used to restore the backup progress of backup tasks in the event of interruption. This method can improve the efficiency of file backup.

The embodiment of the invention provides a database backup method and device, electronic equipment and a storage medium, and the method comprises the steps: triggering a database to refresh a data page in a shared cache region to a disk under the condition that a preset time node is reached, and locking the file operation of switching a pre-write log by the database; after basic snapshot data of the database is created and stored, the file operation is unlocked, multiple pre-write logs output by the database after the file operation is recovered are monitored, incremental log data are generated based on the multiple pre-write logs, and the incremental log data are stored; determining an initial file identifier corresponding to the earliest pre-written log in the incremental log data, and marking other pre-written logs in the incremental log data in sequence based on the initial file identifier; and creating metadata information corresponding to the basic snapshot data. According to the scheme, the non-interruption backup of the database is realized, the data consistency and integrity are guaranteed, the backup data volume is reduced, and the backup efficiency is improved.

The present specification provides a storage method and device of configuration information, the method comprises: reading the to-be-stored rule entry configuration information recorded in the to-be-stored rule management structure, the to-be-stored rule management structure maintains the existing and not stored rule entry configuration information, the to-be-stored rule entry configuration information is the to-be-stored rule entry configuration information in the global rule management structure, and the global rule management structure maintains the existing rule entry configuration information;Iterate the to-be-stored rule entry configuration information recorded in the to-be-stored rule management structure, and persist the iterated to-be-stored rule entry configuration information.

This disclosure relates to the field of data backup technology, providing a method, apparatus, device, medium, and product for online partition backup. The method includes: in response to receiving a backup instruction for a target partition in an online state during operating system operation, associating the backup endpoint with a mirror mapping layer mapped to the target partition; and using the mirror mapping layer, performing block-level backup operations on blocks in the target partition to back up the target partition to the backup endpoint. The block-level backup operation includes: in response to receiving a real-time read / write operation for the target block, using the mirror mapping layer, updating the data content of the real-time read / write operation to the target block according to the current backup status of the target block and backing it up to the backup endpoint. This disclosure solves the problems of offline partition backup causing system service interruptions and being unable to cope with scenarios of dynamic changes in partition data, achieving online partition backup, allowing dynamic data writing, and avoiding business losses during the backup process.