Data storage method and device based on distributed objects

A technology for data storage and object storage, applied in database indexing, structured data retrieval, database distribution/replication, etc., can solve problems such as file transmission failure, reduce file transmission failure rate, ensure reliability, ensure consistency and reliability effect

Active Publication Date: 2021-10-01
北京星辰天合科技股份有限公司
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The embodiment of the present invention provides a data storage method and device based on distributed objects, to at least solve the technical problem in the related art that when data is stored and migrated through an independently deployed migration tool, it is easy to cause file transfer failure

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method and device based on distributed objects
  • Data storage method and device based on distributed objects

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0046] According to an embodiment of the present invention, an embodiment of a data storage method based on a distributed object is provided. It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions , and, although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that shown or described herein.

[0047] The distributed object-based data storage method in the following embodiments of the present invention can be applied to a server / server or the like. Realize the innovation of bucket cloning technology in the field of object storage, fully utilize the resource advantages of the object storage cluster itself, and directly use the object storage gateway as a client for uploading objects, so that objects can be copied across clusters without real downloading , storage, migration.

[0...

Embodiment 2

[0085] figure 2 is a schematic diagram of an optional distributed object-based data storage device according to an embodiment of the present invention, such as figure 2 As shown, the data storage device may include: a receiving unit 21, a cloning unit 23, and a storage unit 25, wherein,

[0086] The receiving unit 21 is configured to receive multiple data cloning tasks for distributed transmission, wherein the data cloning tasks carry object information of source data bucket objects to be cloned;

[0087] The cloning unit 23 is configured to use the bucket snapshot cloning function to perform object cloning on the source data bucket object according to the data cloning task to obtain the target clone object, wherein the bucket snapshot cloning function is used to clone all or part of the data bucket object at the target moment Data generation usable clone objects;

[0088] The storage unit 25 is configured to control the object storage gateway to store the target clone obj...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data storage method and device based on distributed objects. Wherein, the method includes: receiving multiple data cloning tasks of distributed transmission, wherein, the data cloning tasks carry the object information of the source data bucket objects to be cloned; according to the data cloning tasks, use the bucket snapshot cloning function to clone the source data bucket objects Perform object cloning to obtain the target clone object, wherein the bucket snapshot clone function is used to generate a usable clone object for all or part of the data of the data bucket object at the target time; control the object storage gateway to store the target clone object in the data persistence layer. The invention solves the technical problem in the related art that when data is stored and migrated through an independently deployed migration tool, file transmission failure is easily caused.

Description

technical field [0001] The present invention relates to the technical field of data storage, in particular to a distributed object-based data storage method and device. Background technique [0002] In related technologies, when data storage and migration are performed, migration tools are generally used for data transfer, for example, U disks, optical discs, etc. are used for data migration. This data storage and migration method is cumbersome and error-prone, and it takes time to start preparations. Long (independent deployment, independent dual-end configuration file), requires additional migration cluster or computing resource support. The main principle is that the migration tool first lists the object list of the source data, and then performs data migration according to the object list. If some files on the source end are deleted after the List is completed, the source end files do not exist. Such files are skipped, usually outputting the file in the error list. [...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/22G06F16/21G06F16/27
CPCG06F16/214G06F16/22G06F16/27
Inventor 张天旭鲁加福杨瑞峰王豪迈胥昕
Owner 北京星辰天合科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap