Unlock instant, AI-driven research and patent intelligence for your innovation.

Data duplication method, device, electronic device and storage medium

A data replication and source data technology, which is applied in the field of big data, can solve the problems of long copying time and low disk space utilization, and achieve the effect of improving replication efficiency, increasing utilization, and reducing occupancy

Active Publication Date: 2021-01-15
GOLDEN PANDA LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to provide a data replication method, data replication device, electronic equipment and computer-readable storage medium, and then at least to a certain extent overcome the problem of long copying time due to limitations of hardware disks, network cards, concurrent processes and disk The problem of low space utilization

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data duplication method, device, electronic device and storage medium
  • Data duplication method, device, electronic device and storage medium
  • Data duplication method, device, electronic device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The same reference numerals denote the same or similar parts in the drawings, and thus their repeated descriptions will be omitted.

[0026] Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of embodiments of the invention. However, those skilled in the art will appreciate that the technical solutions of the present invention may be practiced without one or more of the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a data replication method and device, electronic equipment and a storage medium, and relates to the technical field of big data. The method comprises the stepsthat the position of a source data node where a source file block is located and the position of a target data node where a target file block is located are acquired; Judging whether the position ofthe source data node and the position of the target data node belong to the same data node or not; W; when it is judged that the source file blocks belong to the same data node, the source file blocksare copied in a hard chain mode; W; when it is judged that the source file blocks do not belong to the same data node, the source file blocks are copied to the target file blocks in a data copying mode. According to the technical scheme of the embodiment of the invention, the copying efficiency can be remarkably improved, and the actual hard disk storage space occupation is reduced.

Description

technical field [0001] The present invention relates to the technical field of big data, and in particular, relates to a data replication method, a data replication device, electronic equipment, and a computer-readable storage medium. Background technique [0002] With the development of Internet technologies, distributed file systems such as HDFS (Hadoop Distributed File System, distributed file system) are more and more widely used. In a distributed file system such as HDFS, it is often necessary to replicate or copy files stored in data nodes. [0003] In one technical solution, when performing file copying in a distributed system such as HDFS, file copying may be performed by means of a Cp command, or may be performed by means of a Distcp command. The way of Cp is to obtain the list of all files in the directory to be copied, and then copy the file metadata and file blocks. The Distcp method also first obtains the list of all files in the directory to be copied, and th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/182
Inventor 费伟
Owner GOLDEN PANDA LTD