Online capacity expansion method for mass object storage

An object storage and massive technology, applied in the field of online expansion of massive object storage, can solve problems such as high cost and difficult maintenance of storage solutions, achieve enhanced anti-interference ability, reduce the number of routes and addressing efficiency, and improve overall resource utilization rate effect

Pending Publication Date: 2021-01-05
SHANGHAI DATATOM INFORMATION TECH CO LTD
View PDF0 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to provide an online capacity expansion method for massive object storage to solve the problems in the application scenarios of big data, log data, database backup, data collection in the Internet of Things industry, audio and video file

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Online capacity expansion method for mass object storage
  • Online capacity expansion method for mass object storage
  • Online capacity expansion method for mass object storage

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0033] An embodiment of the present invention provides an online capacity expansion method for massive object storage. The above method is described in detail below:

[0034] S1. The user creates a (bucket) bucket through the restful API, and the backend will synchronously create one or more index (index) objects to save the object list under the bucket;

[0035] S11. When the user queries the bucket object list through the restful API, the backend will use me...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an online capacity expansion method for massive object storage, which comprises the following steps that: S1, a user creates a bucket through a resetful API, a rear end synchronously creates one or more index objects for storing the object list under the bucket; and S11, when the user inquires the bucket object list through the resetful API, the rear end outputs the objectsin the bucket by using merging sorting, the sorting algorithm increases the calculated amount and the memory along with the increase of the object scale, and the data IO performance is seriously influenced. According to the on-line capacity expansion method for mass object storage, after capacity expansion, an original user S3 interface is kept unchanged, the user can realize elastic expansion ofa storage pool without perception, and after capacity expansion, traversal search of an original S3 interface query storage bucket object mode is changed into hash calculation, so that the routing number and addressing efficiency are greatly reduced, and the loads of multiple clusters are flexibly adjusted.

Description

technical field [0001] The invention relates to the technical field of storage, in particular to an online expansion method for massive object storage. Background technique [0002] With the development of new technologies such as cloud native, big data, cloud computing, Internet of Things, and 5G, and the rapid development of applications in industries such as telecommunications, the Internet, government and enterprise, and medical care, the explosive growth of massive data has caused many challenges to traditional storage systems. , the current main usage scenarios include massive data archiving and backup, content distribution and data sharing, cloud-native applications and multi-cloud application scenarios. [0003] Compared with the traditional file system storage, object storage abandons the complex semantics and directory design of the file system, and stores data through the flat Key-Value method, which greatly simplifies the complexity of metadata management, and th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06G06F9/50
CPCG06F3/0623G06F3/0644G06F3/067G06F9/505
Inventor 南坤谢赟韩欣孙卓峰
Owner SHANGHAI DATATOM INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap