Data acquisition method and system for distributed object storage system

A data acquisition and object storage technology, applied in the field of data processing, can solve the problem of low resource utilization and achieve the effect of improving data acquisition efficiency and resource utilization

Active Publication Date: 2017-08-18
深圳爱捷云科技有限公司
View PDF3 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Embodiments of the present invention provide a data acquisition method and system for a distributed object storage system, to at least solve the technical problem of low resource utilization when acquiring a large amount of data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data acquisition method and system for distributed object storage system
  • Data acquisition method and system for distributed object storage system
  • Data acquisition method and system for distributed object storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] In order to enable those skilled in the art to better understand the solutions of the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only It is an embodiment of a part of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

[0023] It should be noted that the terms "first" and "second" in the description and claims of the present invention and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data acquisition method and system for a distributed object storage system. The method comprises the following steps: sending a first request to a server according to a preset rule, wherein the first request requests to obtain data of a first metadata sub-table in the distributed object storage system; receiving the data of the first metadata sub-table returned by the server; and sequentially sending a second request for requesting the data of other metadata sub-tables, and receiving the data returned by the server until the server returns an end mark. According to the data acquisition method and system disclosed by the invention, the technical problem of low resource utilization rate during the acquisition of a large amount of data can be solved.

Description

technical field [0001] The present invention relates to the field of data processing, in particular to a data acquisition method and system for a distributed object storage system. Background technique [0002] Distributed object storage is currently the main solution to the problem of massive data storage. In order to meet the needs of data management, distributed object storage systems generally provide users with a traversal function. Through this traversal function, the files or objects stored in the system can be obtained. metadata. A typical implementation method is to establish a large number of metadata sub-tables in advance, and these metadata sub-tables are stored on different nodes (such as storage devices) in the system, so as to prevent the amount of data stored on a single node from exceeding that of a single storage device in the system. The upper limit; the metadata is scattered into different metadata sub-tables according to specific rules, where the data i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
CPCH04L67/1097H04L67/60
Inventor 朱志伟
Owner 深圳爱捷云科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap