Distributed object storage system and method

An object storage and distributed technology, applied in the direction of file system, database distribution/replication, inter-program communication, etc., can solve the problems of wasting storage space of distributed file system, unable to read data, poor disaster recovery ability, etc., and achieve improvement The effects of system flexibility and scalability, high concurrency, and high disaster tolerance

Pending Publication Date: 2020-10-02
INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, distributed object storage has inherent deficiencies
If the object is stored as a separate file in the distributed file system (HDFS), due to the memory limitation of the NameNode (NameNode), the number of stored files has an upper limit. A single object is usually small, and storing a large numbe

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed object storage system and method
  • Distributed object storage system and method
  • Distributed object storage system and method

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0029] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only It is a part of the embodiments of the present invention, not all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

[0030] Those skilled in the art should understand that the embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed object storage system and method. The system comprises a main park system, at least one standby park system, a message queue and a data copying module, wherein the main park data service module is used for packaging a plurality of to-be-stored objects into files, storing the files into a distributed file system of a main park system, generating index information of the objects, and adding the index information into a distributed database and a message queue of the main park system; the data copying module is used for acquiring the index information from the message queue; and adding index information to a distributed database of the standby park system, searching the file stored in the distributed file system of the main park system according to the index information, and adding the file to the distributed file system of the standby park system. The technical problem that an existing distributed object storage system is not suitable for storing a large number of small objects is solved.

Description

technical field [0001] The present invention relates to the technical field of object storage, in particular to a distributed object storage system and method. Background technique [0002] Object storage is a technology often used in the Internet. Object storage is different from file storage in that objects are not organized in a hierarchical directory structure. Each object is located at the same level of a flat space called a storage pool, and each element of each level has a unique identifier in the storage system, and users access the container or object through this identifier. In object storage, a flat data organization structure is generally adopted and nested folders are discarded, so as to avoid maintaining a huge directory tree. [0003] Currently, object storage usually adopts a distributed storage method. However, distributed object storage has inherent shortcomings. If the object is stored as a separate file in the distributed file system (HDFS), due to the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F11/14G06F16/13G06F16/172G06F16/182G06F16/27G06F9/54
CPCG06F11/1464G06F11/1456G06F16/13G06F16/172G06F16/182G06F16/27G06F9/546G06F2209/548Y02D10/00
Inventor 张艺韩霜李俊谦林丹
Owner INDUSTRIAL AND COMMERCIAL BANK OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products