28results about How to "Improve backup efficiency" patented technology

The invention relates to the field of hard disk data protection, in particular to a hard disk data protection method and device based on artificial intelligence. The method comprises the following steps: acquiring a hard disk history monitoring log; performing multi-period hard disk load analysis on the historical hard disk monitoring log, and performing load peak fluctuation fitting so as to construct a hard disk load peak fluctuation curve; carrying out peak value trend evolution analysis on the hard disk load peak value fluctuation curve, and carrying out abnormal load peak value detection to obtain a time period where an abnormal peak value point is located; carrying out current time period redundant data calculation on the hard disk according to the time period of the abnormal peak point, and carrying out dynamic global data backup decision, so as to generate an abnormal peak global backup strategy; and performing abnormal write behavior detection and attack node tracing positioning on the hard disk historical monitoring log, and marking a hostile attack tracing positioning point. According to the invention, safe and reliable hard disk data protection is realized.

The invention discloses a data backup recovery method and device based on data merging, and the method comprises the steps: obtaining a first data snapshot of initial full backup data; the first data snapshot is mounted to a local database, so that the initial full-amount backup data is backed up in the local database in a full-amount mode; when incremental backup data is obtained, merging the incremental backup data to the first data snapshot to obtain a second data snapshot; uninstalling a mounting point of the local database, and backing up the synthesized total backup data corresponding to the second data snapshot in the local database; and when a data recovery instruction is obtained, recovering data from the local database based on the data recovery instruction to obtain target recovery data. According to the method and the device, relatively high backup efficiency and relatively low recovery complexity can be realized at the same time.

The embodiment of the invention provides a disk data backup method, device and equipment. The method can be used in the cloud computing field. The method comprises the steps of determining a current moment as an updating moment according to preset updating cycle setting, and obtaining a directory list recording file and a file list recording file; obtaining a plurality of catalogs needing to be synchronized from the source data disk, determining a target catalog needing to be synchronized currently by using the catalog list record file, and backing up the target catalog in the target data disk; obtaining respective second file information of a plurality of second files from a directory needing to be synchronized in the source data disk, for each second file, determining backup information of the second file to a target data disk by utilizing a file list recording file, and if the second file needs to be backed up, backing up the second file to the target data disk; and updating the directory list recording file and the file list recording file. The method is used for achieving the effect of efficiently backing up the disk data while fully utilizing the disk space.

The invention belongs to the field of artificial intelligence and financial science and technology, and relates to a data backup recovery method which comprises the following steps: monitoring through a monitoring mechanism of a key value database, packaging a backup request into a backup request event, and writing the backup request event into a backup key value pair of the key value database; when a backup request event is monitored, calling a data writing instruction to write a data file into a preset storage position, and meanwhile, pausing a message of the consumption message middleware; after writing of the data file is completed, an index file is constructed according to metadata of the data file, and when construction of the index file is completed, snapshot backup operation is executed for backup; and after backup is completed, normal data processing is recovered. The invention further provides a data backup recovery device, computer equipment and a storage medium. In addition, the invention also relates to a block chain technology, and the data file can be stored in a block chain. According to the method, the data backup and recovery time can be greatly shortened, and the data backup and recovery timeliness is improved.

The embodiment of the invention discloses a data backup method and device, equipment and a storage medium, which are applied to a data backup system comprising a plurality of source ends and a backup end, and comprise the following steps: segmenting a target data stream into a plurality of target data blocks, and determining a target hash index value corresponding to each target data block; querying each target hash index value in a target source end hash index database matched with the target data stream in the target source end; if the first type of target Hash index values are stored in the target source end Hash index database, only sending the first type of target Hash index values to a standby end; if the second type of target Hash index values are not stored in the target source end Hash index database, querying each second type of target Hash index value in a standby end Hash index database in a standby end, and selecting only the second type of target Hash index values according to a query result; or the second type of target hash index values and the matched target data blocks are sent to the standby end, so that the data backup efficiency is improved.

The application discloses a kind of data disaster recovery methods of supporting multiple backup path switching, comprising, based on the sensitivity of input data and the generation of dynamic granularity data slice of storage medium characteristics, and generate the metadata label containing data slice identification, storage preference and recovery priority;Path quality atlas is generated for each data slice by constructing heterogeneous transmission path performance model through metadata label, and optimal transmission path is allocated, and path performance is monitored;Abnormality is detected and migrated slice by the standard deviation of cumulative transmission delay;Incremental integrity verification and Merkle proof of blockchain storage are used for parallel checking, and retransmission is preferentially checked failed slice;The application ensures the reliability and stability of data disaster recovery through the synergistic cooperation of dynamic data slicing, backup path optimization and recovery verification, to meet the real business needs.

The invention discloses a data lake table tape backup method and device, computer equipment and a storage medium. The method comprises the following steps: scanning a table list to be backed up to judge whether a table needing to be backed up exists or not; when the table needing to be backed up exists, the table to be backed up is determined; performing backup according to the type of the table to be backed up; and if the table cannot be obtained, writing all records from the last snapshot backup into a new Iceberg table for all tables involved in the backup, copying related data to a specified tape directory, and inserting the corresponding records into a metadata table. By implementing the method disclosed by the invention, economical and reliable long-term data backup can be realized, and the method is particularly suitable for application scenes with strict requirements on data persistence and integrity so as to solve the problems of efficiency and management of backup of a big data system.

The invention provides a block-level incremental backup method and device for a database, equipment and a medium. The method comprises the steps that data files in the database are traversed; for any traversed data file, whether the data file is a small file or not is determined according to a preset size, and the small file is a data file with the file size smaller than the preset size; under the condition that at least two data files which are small files are determined, merging the at least two data files which are small files to obtain at least one merged file; and partitioning the at least one combined file to obtain at least one data block, and performing block-level incremental backup according to the at least one data block. On the basis, the number of the data blocks can be reduced, the backup time consumption is reduced, and the database incremental backup efficiency is improved.

The invention discloses an application log backup method based on code slicing and pipeline compression. The method comprises the following steps of: pre-defining and storing a universal code template at a client, and pre-defining and storing a backup code template corresponding to an application service type at a server; when executing a log backup task, the client sends backup request information to the server; after receiving backup request information sent by the client, the server returns a corresponding backup code to the client; and the client generates a current complete log backup code according to the stored universal code template and the backup code sent by the server, and then executes a backup action according to the current complete log backup code. According to the method, centralized management of the configuration can be realized, unified maintenance and updating are facilitated, management cost and errors caused by dispersed configuration are reduced, the flexibility and response speed of the system are improved, duplicate codes are reduced, and the reusability and maintainability of the codes are improved.

The invention provides a data backup and recovery system based on high-performance erasure code optimization, and aims to solve the problems of data loss, low storage efficiency, slow data recovery speed and the like. The system realizes efficient data fragmentation and redundant information addition through the steps of data verification and slicing, twiddle factor pre-calculation, Fourier transform coding and the like. A set of complete data backup and recovery system is designed, the coding blocks are checked and stored, and data are backed up regularly; when the data is lost, the data is recovered through decoding calculation. Meanwhile, the system has monitoring and management functions, monitors states of storage nodes and coding blocks in real time, records backup and recovery logs, triggers alarm and performs data protection.

The invention provides a micro-service cloud backup method based on a cloud platform, which belongs to the technical field of data backup, and comprises the steps of micro-service identification and classification, data incremental backup, automatic recovery process and backup data storage and management. According to the micro-service identification and classification technology, services needing to be backed up can be identified, and classification is carried out according to the characteristics and importance of the services so as to ensure that data of key services are protected preferentially. The data incremental backup technology focuses on only backing up the data which changes since the last backup, so that the volume of the backup data and the time required by the backup are reduced. The automatic recovery process ensures that the recovery operation can be quickly executed under the condition that the data is lost or damaged, and the service interruption time is shortened. The storage and management technology of the backup data relates to the guarantee of the security, consistency and availability of the data, and the long-term storage and compliance management of the backup data.

The invention discloses a VMware virtual machine backup method. The method comprises the following steps: step S1, starting source virtual machine block tracking; s2, creating a snapshot by the source virtual machine; s3, storing complete configuration information of the source virtual machine; s4, judging whether the backup is locally carried out or not; s5, judging whether backup is carried out to the NFS or not; S6, creating an MKlink from a complete backup directory to a temporary directory of the NFS; step S7, starting an NFS service; step S8, mounting the NFS to the EsXi; step S9, creating a backup disk in the data; and S10, calling the SDK to read and write disk data, and completing backup. According to the method and the device, the complete configuration information of the source virtual machine is stored in the backup process, so that the integrity and the consistency of the backup file are ensured, and the state of the virtual machine can be seamlessly recovered during recovery. By creating the NFS temporary directory and starting the NFS service, the backup management process is simplified. And the state of the virtual machine can be quickly and reliably recovered during disaster recovery.

This application relates to a file backup method, apparatus, computer device, and readable storage medium. The method includes: obtaining a directory to be backed up; generating multiple backup tasks for each file in the directory; the backup tasks back up each file to a server according to file identifier order and directory identifier order, and generating backup set fragments corresponding to the backup tasks; each backup task is associated with context information; the context information includes backup progress information and backup set fragment information; the backup set fragment information includes the amount of data already written to files in the backup set fragments; running multiple backup tasks in parallel, periodically generating corresponding backup set checkpoint files at checkpoint times based on the context information of the backup tasks, and uploading the backup set checkpoint files to the server; the backup set checkpoint files are used to restore the backup progress of backup tasks in the event of interruption. This method can improve the efficiency of file backup.

The embodiment of the invention provides a database backup method and device, electronic equipment and a storage medium, and the method comprises the steps: triggering a database to refresh a data page in a shared cache region to a disk under the condition that a preset time node is reached, and locking the file operation of switching a pre-write log by the database; after basic snapshot data of the database is created and stored, the file operation is unlocked, multiple pre-write logs output by the database after the file operation is recovered are monitored, incremental log data are generated based on the multiple pre-write logs, and the incremental log data are stored; determining an initial file identifier corresponding to the earliest pre-written log in the incremental log data, and marking other pre-written logs in the incremental log data in sequence based on the initial file identifier; and creating metadata information corresponding to the basic snapshot data. According to the scheme, the non-interruption backup of the database is realized, the data consistency and integrity are guaranteed, the backup data volume is reduced, and the backup efficiency is improved.

The invention relates to a virtual machine migration method and device, computer equipment, a computer readable storage medium and a computer program product, relates to the technical field of virtualization, and can improve the virtual machine migration efficiency. The method comprises the following steps: acquiring a resource data block of a current virtual machine, and generating a virtual machine backup file according to the resource data block; obtaining configuration information of the current virtual machine, and based on the configuration information, creating a target virtual machine disk matched with the configuration information of the current virtual machine; writing the virtual machine backup file into a target virtual machine disk, obtaining driving information and a management script of a to-be-created target virtual machine, and writing the driving information and the management script into the target virtual machine disk; and based on the target virtual machine disk containing the driving information and the management script, creating a target virtual machine carrying the virtual machine backup file.

The invention discloses a transformer substation and multi-master station cloud edge collaborative automatic point alignment method and device, computer equipment and a storage medium, and relates to the technical field of transformer substations, and the method comprises the steps: configuring a special communication network between a transformer substation total scheduling control station and a subordinate sub-scheduling control master station, and distributing a unique number for each sub-scheduling control master station; classifying instant data and non-instant data of the electrical data collected by the sub-scheduling control master station; and selecting the sub-scheduling control master station with the highest electrical data repetition degree as an adjacent sub-scheduling control master station, carrying out information communication with the sub-scheduling control master station, and carrying out non-instant data backup. According to the method, a unique number is distributed to each sub-scheduling control master station by adopting the linear growth function, systematic management of the numbers is realized, then the uniqueness of each sub-scheduling control master station is ensured by using the numbers in a three-digit form, understanding and management are facilitated, and the effects of simplifying the operation process and improving the management efficiency are achieved.

The embodiment of the application provides a data backup method and a computing device, the method comprises the following steps: in response to a backup request for target data, acquiring bitmap information of the target data; according to the bitmap information, pre-reading at least part of data blocks in the target data from a storage medium to a cache; in response to a read request for a target data block in the target data, querying whether the target data block exists in the cache; if the target data block exists in the cache, reading the target data block from the cache. The data backup method and the computing device provided by the embodiment of the application can convert a data read request into a memory access. Since the storage medium has a high access delay, compared with a mode of reading a data block from the storage medium, the mode of reading a data block from the cache improves the data read speed, thereby improving the data backup efficiency.

The invention relates to a data backup method and device, computer equipment, a storage medium and a computer program product. The method comprises the following steps: acquiring a plurality of data slices, determining respective slice fingerprints of the data slices and respective reference fingerprints of a plurality of backed-up slices, determining a target slice of which the slice fingerprint is matched with any reference fingerprint and non-target slices except the target slice from the data slices, and under the condition that the data volume of the non-target slice is greater than a data volume threshold value, segmenting the non-target slice to obtain a plurality of sub-slices, and determining a target sub-slice matched with any reference fingerprint and non-target sub-slices except the target sub-slice from the sub-slices. According to the data backup method and device, the data content and the metadata of the non-target sub-slices are backed up, the metadata of the target sub-slices and the metadata of the target slices are backed up, the data volume of data backup is reduced, the data transmission duration is shortened, and the data backup efficiency is improved.

The present specification provides a storage method and device of configuration information, the method comprises: reading the to-be-stored rule entry configuration information recorded in the to-be-stored rule management structure, the to-be-stored rule management structure maintains the existing and not stored rule entry configuration information, the to-be-stored rule entry configuration information is the to-be-stored rule entry configuration information in the global rule management structure, and the global rule management structure maintains the existing rule entry configuration information;Iterate the to-be-stored rule entry configuration information recorded in the to-be-stored rule management structure, and persist the iterated to-be-stored rule entry configuration information.

The invention discloses a factory backup method and device of an operating system, equipment and a medium, and relates to the technical field of computers. The method comprises the following steps: acquiring a one-key backup tool, and adding a software installation package of the one-key backup tool into an installation mirror image of an operating system to obtain a target mirror image file; installing the operating system through the target mirror image file, and when the operating system is started for the first time, taking a target starting item used for representing that the operating system is started by using the one-key backup tool as a startup guide item of the operating system; and when the operating system is restarted, performing a backup operation of the operating system based on the boot entry, and transmitting backup data corresponding to the backup operation to a remote storage device after the backup is completed, so as to perform backup management on the backup data. By means of the technical scheme, factory backup can be automatically completed in the installation process of the operating system, and system safety and data integrity are ensured.

The present invention discloses a method, device, electronic device and storage medium for processing virtual machine data, which are applied to a server, and the server is respectively connected to a front end and an agent. The method includes receiving login information of a cloud platform sent by the front end, sending the login information to the agent, so that the agent establishes a communication connection with the cloud platform, and returning the virtual machine information under the cloud platform to the server. The server sends the virtual machine information to the front end so that the front end can display it to the user, and in response to the backup request sent by the front end, determines the target backup strategy and the target transmission strategy and sends them to the agent, so that the agent performs backup processing on the target virtual machine according to the target backup strategy and the target transmission strategy. The use of the present invention enables users to perform backup processing on the target virtual machine through the cloud platform at any time point and device, which not only simplifies the backup processing flow, facilitates the use of non-professionals, but also improves the backup efficiency of the backup processing.

The present invention discloses a data backup performance optimization method based on machine learning, which specifically relates to the field of data backup technology, and comprises the following steps: step one, collecting backupable information of a target backup system; step two, arranging the collected backupable information and establishing a neural network model; step three, collecting data information to be backed up; step four, analyzing the data information to be backed up and the backupable information, and determining whether the data information to be backed up is backed up in its entirety or separately according to the analysis result; the present invention can collect the backupable information of a target backup system, and according to the analysis result of the data information to be backed up and the backupable information, determine whether the data to be backed up is backed up in its entirety or separately, thereby avoiding unnecessary data transmission, reducing backup time, and excluding paths that may cause data backup loss during path selection according to the established neural network model, thereby optimizing data backup performance.

This disclosure relates to the field of data backup technology, providing a method, apparatus, device, medium, and product for online partition backup. The method includes: in response to receiving a backup instruction for a target partition in an online state during operating system operation, associating the backup endpoint with a mirror mapping layer mapped to the target partition; and using the mirror mapping layer, performing block-level backup operations on blocks in the target partition to back up the target partition to the backup endpoint. The block-level backup operation includes: in response to receiving a real-time read / write operation for the target block, using the mirror mapping layer, updating the data content of the real-time read / write operation to the target block according to the current backup status of the target block and backing it up to the backup endpoint. This disclosure solves the problems of offline partition backup causing system service interruptions and being unable to cope with scenarios of dynamic changes in partition data, achieving online partition backup, allowing dynamic data writing, and avoiding business losses during the backup process.

The present invention relates to the field of data backup technology, and in particular, to a data backup and rapid recovery processing method and system. It includes a data acquisition module, an evaluation matrix establishment module, a predefined recovery module and a data verification module. The present invention collects data change frequency, remaining storage space and business cycle information through the data acquisition module, and establishes a backup strategy evaluation matrix, and selects a corresponding backup strategy based on the information of the corresponding dimension transmitted by the data acquisition module, so as to achieve the most suitable backup type under different data conditions, improve the backup efficiency, and use the backup index to quickly locate the storage location of the corresponding backup type. At the same time, the parallel recovery technology is adopted, and the data of different parts are restored simultaneously by multi-threading or multi-process, so as to improve the recovery speed and significantly shorten the recovery time.

The embodiment of the invention discloses a data backup method, device and equipment, a computer readable medium and a program product. A specific embodiment of the method comprises the steps of determining whether data of a local database is backed up to a cloud disk database for the first time or not in response to the fact that first time is data backup regular time for the local database; in response to the determination that the data of the local database is not backed up to the cloud disk database for the first time, determining change data in the local database between the first time and the last data backup regular time; and sending the change data and the data backup regular time to the cloud disk database, so that the cloud disk database generates a corresponding first incremental snapshot. The implementation mode is related to data backup, the change data corresponding to the local database can be synchronized to the cloud disk database with the master-slave synchronization relation in time and efficiently, the change data are stored in a snapshot mode, and the backup efficiency is improved.

The invention discloses a data backup method, device and equipment, a storage medium and a product, and relates to the technical field of computers. The method comprises the steps of obtaining a business application operation environment, a data change condition and data feature information corresponding to data to be backed up; determining a target data backup strategy corresponding to the to-be-backed-up data according to the business application operation environment and the data change condition; determining a data backup frequency corresponding to the to-be-backed-up data according to the data feature information; and performing data backup on the to-be-backed-up data by adopting the target data backup strategy according to the data backup frequency. By determining the reasonable target data backup strategy, the problem that the data transmission amount is large due to the fact that a full-amount backup mode is adopted every time is avoided, and time and resources needed by backup are reduced; and the corresponding data backup frequency is automatically adjusted based on the data feature information, so that the utilization rate of the computing resources and the storage resources for backup is improved on the basis of ensuring effective backup of the data.

The invention discloses a data mirroring persistent backup system of a power grid, which relates to the technical field of power systems and comprises a data acquisition module, a data preprocessing module, a differential data synchronization module, a data integrity verification module, a data mirroring module, a data storage module and a control and management module. The data acquisition module is used for acquiring operation data of a power grid in real time; the data preprocessing module is used for cleaning, formatting and compressing the acquired data to prepare for subsequent data synchronization; and the differential data synchronization module calculates and identifies the change part of the data since the last synchronization through a differential algorithm, and only synchronizes the data of the change part. According to the method, only changing data needs to be synchronized, the data transmission amount during real-time topology reconstruction is greatly reduced, meanwhile, the backup time is shortened, the power grid data backup efficiency is improved, the data synchronization process is optimized, storage space waste caused by full backup is reduced, and it is guaranteed that backup data is accurate through a hash value comparison mode.

The embodiment of the invention provides a data backup method and device, a storage medium and electronic equipment. The method comprises the steps that in the process of backing up first data in a first storage area to a second storage area, a current sub-area is determined from a plurality of second sub-areas in the second storage area, and the current sub-area is a storage sub-area which is not completed in the last backup operation; a current bitmap matched with the current sub-region and a target bitmap matched with the target sub-region are obtained, the target sub-region is a storage sub-region corresponding to the current sub-region in the first storage region, the current bitmap and the target bitmap comprise a plurality of bits, and the bits are used for indicating updating states of data pieces in the storage sub-region; according to a comparison result of the current bitmap and the target bitmap, determining at least one target data piece from a plurality of data pieces stored in the target sub-region; and backing up the target data piece to a target storage position in the current sub-region.