Log-based object storage additional writing implementation method

A technology for object storage and implementation methods, applied in electrical components, database distribution/replication, transmission systems, etc., can solve problems such as not supporting additional write operations, achieve flexible writing, save storage system resources, and improve user experience Effect

Pending Publication Date: 2020-06-05
SHANGHAI DATATOM INFORMATION TECH CO LTD
View PDF13 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the limitations of the current object storage IO (input and output) characteristics, it does not support additional write operations and only allows overwrite write operations. Therefore, ob

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log-based object storage additional writing implementation method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] The present invention will be further described below in conjunction with accompanying drawing.

[0024] see figure 1 , the log-based object storage append writing implementation method of the present invention comprises the following steps:

[0025] S1. The client sends an additional write request to the object storage system through the RESTful API interface provided by the object storage system. The request parameters for an append write request include the target object name and the actual size of the target object.

[0026] S2. The object storage web-side processing layer of the object storage system checks the legitimacy of the additional write request parameters (ie: whether the input of the object size field is empty or whether the content is all numbers; whether the value of the key field of the additional request is append), if If the check fails, an error is returned; if the check passes, the additional write request is forwarded to the object storage proce...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an object storage additional writing implementation method based on logs. The method comprises the steps that a client sends an additional writing request; an object storage Web end processing layer checks the legality of the request parameters; an object storage processing layer performs object legality check, and judges whether a target object exists or not if the check is passed; if the target object exists, the metadata of the target object is analyzed, and to-be-added data is written in a corresponding mode according to the type of the target object; if the targetobject does not exist, the strip information of the target object is initialized, and to-be-added data is written by taking a new strip as a starting position; the metadata is written into a head object of the target object; after metadata updating is completed, the object storage system returns response information to the client. On the premise that the original object file does not need to be uploaded repeatedly, the data additional synthesis is achieved, and meanwhile, logs are recorded during data uploading to avoid data loss caused by accidental interruption.

Description

technical field [0001] The present invention relates to the field of distributed object storage systems, in particular to a log-based Ceph (a unified, distributed file system designed for excellent performance, reliability and scalability) object storage appending and writing implementation method. Background technique [0002] With the development of Internet of Things, cloud computing, big data, and 5G technologies. The rapid development of medical, telecommunications, Internet, government and enterprise, and other industries has led to the rapid growth of massive data, which poses great challenges to traditional storage systems. As an emerging storage technology, object storage is widely used in more and more industries. . Compared with the traditional file system, object storage abandons the complex directory and semantic design of the file system, stores data in a flat key-value manner, greatly simplifies the complexity of metadata management, and has almost no limit o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08G06F16/27G06F16/25
CPCH04L67/1097H04L67/06G06F16/27G06F16/25
Inventor 王鑫谢赟吴新野黄海清孙卓峰
Owner SHANGHAI DATATOM INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap