Unlock instant, AI-driven research and patent intelligence for your innovation.

Method for carrying out remote full backup and recovery on HDFS file

A full-volume backup and off-site technology, which is applied to the generation of response errors, error detection of redundant data in calculations, instruments, etc., can solve problems such as loss and inaccessibility of HDFS files, and achieve the effect of convenient operation

Pending Publication Date: 2021-01-29
SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
View PDF3 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Based on this, a method for full backup and recovery of HDFS files in different places is designed and developed to avoid the problem of inaccessibility or loss of HDFS files when encountering irresistible factors

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for carrying out remote full backup and recovery on HDFS file

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0044] This embodiment proposes a method for performing full backup and recovery of HDFS files in different places, integrating the HDFS distributed file system and the relational database mysql, storing the operation records of full backup of files in the table of mysql, and storing the files of full backup in In the remote Linux host, the storage, update, deletion and query functions of the backup operation records are provided through the java API, and the full backup and recovery functions of the backup files are provided through the java API.

[0045] Reference attached figure 1 , a kind of HDFS file of the present embodiment is carried out the method for off-site full backup and recovery, and its specific implementation process comprises:

[0046] Step 1. Copy the client directory of the HDFS cluster to a remote linux host outside the cluster, and configure the remote linux to communicate with the HDFS cluster host. Execute the environment initialization script in the c...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for carrying out remote total backup and recovery on an HDFS file, and relates to the technical field of file backup and recovery. Aiming at the problem that an HDFS file cannot be accessed or lost when encountering irresistible factors, the adopted scheme is as follows: copying a client directory of an HDFS cluster to a remote linux host outside the cluster, and configuring intercommunication between the remote linux and an HDFS cluster host; designing a data structure of full backup operation, and designing a storage structure of a database table; selecting afile needing to be backed up in the HDFS file system, writing a backup operation record of the file into the relational database mysql, executing a command in the client by the remote linux host, andbacking up the file to a specified storage directory; selecting a to-be-recovered file in the HDFS file system, writing a recovery operation record of the file into the relational database mysql, andcalling the client of the HDFS cluster to recover the file to a specified storage directory by the remote linux host. The HDFS file remote backup and recovery method can provide remote backup and recovery functions for the HDFS file.

Description

technical field [0001] The invention relates to the technical field of file backup and recovery, in particular to a method for full backup and recovery of HDFS files in different places. Background technique [0002] With the advent of the big data era, data information is becoming more and more important, data protection issues are becoming more and more prominent, and various catastrophic events have awakened many alarm bells for users. Data protection and data disaster recovery are very important topics. [0003] HDFS (Hadoop distributed file system, Hadoop, distributed file system) is designed as a distributed file system suitable for running on general-purpose hardware. It has a lot in common with existing distributed file systems. But at the same time, the difference between it and other distributed file systems is also obvious. HDFS is a highly fault-tolerant system suitable for deployment on cheap machines. HDFS can provide high-throughput data access and is very...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F11/14
CPCG06F11/1448G06F11/1464
Inventor 赵圣杰徐伟涛高传集胡清
Owner SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com