Distributed file migration method and system based on object storage

A distributed file and object storage technology, applied in the direction of file system, file system management, non-redundancy-based fault handling, etc., to achieve the effect of reducing data volume, speed, and improving experience

Pending Publication Date: 2021-08-17
SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
View PDF9 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] With the development of Internet technology, the production volume and speed of data are getting faster and faster. Traditional ordinary hard disks can no longer meet the needs of these big data, so cloud hard disks have appeared, and users no longer need to buy actual hard disks that can store data. As the data storage disk, there are many disadvantages in the application of cloud hard disk, which leads to file storage and object storage; therefore, a distributed file migration method and system based on object storage is invented to solve the problem of users' data storage The problem of good speed and access method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed file migration method and system based on object storage
  • Distributed file migration method and system based on object storage
  • Distributed file migration method and system based on object storage

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] A distributed file migration method based on object storage, the specific steps of the method include:

[0043] S1 checks whether the migration result is safe;

[0044] S2 uses the RabbitMq message queue to publish messages;

[0045] S3 obtains the consumption messages in the message queue;

[0046] S4 uses heartbeat detection to detect the server of the distributed file migration system;

[0047] First check whether the migration result is safe according to S1, and post the objects or object lists that need to be migrated in the process of S1, and post each object that needs to be migrated to the RabbitMq message queue in the form of a task according to S2, and wait for the migration function of the system Area to consume; the consumption function of the distributed file system will automatically obtain the messages in the message queue according to S3, and finally use the heartbeat detection according to S4 to check whether the server of the distributed file migrati...

Embodiment 2

[0071] A distributed file migration system based on object storage, the system specifically includes a security check module, a release module, an acquisition module and a detection module:

[0072] Security check module: check whether the migration result is safe;

[0073] Publishing module: use RabbitMq message queue to publish messages;

[0074] Acquisition module: obtain consumption messages in the message queue;

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed file migration method and system based on object storage, and belongs to the field of cloud computing object storage. The method comprises the following specific steps: S1, checking whether a migration result is safe or not; s2, using a RabbitMq message queue to issue a message; s3, acquiring consumption messages in the message queue; and s4, detecting a server of the distributed file migration system by using heartbeat detection. According to the method, by optimizing the uploading and downloading process and through distributed downloading and uploading, the higher migration speed is achieved, only the task being executed is recorded through the database, the data volume of the database is reduced, the failed task is processed in time through timing heartbeat detection, task information in the database is reissued to the message queue, and automatic re-execution after failure is achieved. According to the method and system, the fault tolerance in the migration process can be increased, the risk of user migration is reduced, and the experience of a user for migrating a large number of files can be effectively improved on the basis of ensuring high speed and equal risk.

Description

technical field [0001] The invention discloses a distributed file migration method and system based on object storage, and relates to the technical field of cloud computing object storage. Background technique [0002] With the development of Internet technology, the production volume and speed of data are getting faster and faster. Traditional ordinary hard disks can no longer meet the needs of these big data, so cloud hard disks have appeared, and users no longer need to buy actual hard disks that can store data. As the data storage disk, there are many disadvantages in the application of cloud hard disk, which leads to file storage and object storage; therefore, a distributed file migration method and system based on object storage is invented to solve the problem of users' data storage The problem of good speed and access method. Contents of the invention [0003] Aiming at the problems of the prior art, the present invention provides a distributed file migration meth...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/11G06F16/182G06F9/54G06F11/07G06F11/32
CPCG06F16/119G06F16/182G06F9/546G06F11/0793G06F11/327G06F2209/548
Inventor 闵瑞江燕李超
Owner SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap