Unlock instant, AI-driven research and patent intelligence for your innovation.

Distributed object storage system and data read-write method

A technology for object storage and data storage, which is applied in the direction of electrical digital data processing, input/output process of data processing, instruments, etc., and can solve the problem of waste of Cache storage resources, etc.

Pending Publication Date: 2020-12-25
BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD +1
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, with the above method, when multiple different API clients access the same data file, each API client needs to cache the data file in its own Cache, resulting in a waste of Cache storage resources.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed object storage system and data read-write method
  • Distributed object storage system and data read-write method
  • Distributed object storage system and data read-write method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0070]The technical solutions in the embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of this application.

[0071]First, explain the technical terms in the embodiments of this application:

[0072]Object storage: A storage method for unstructured data.

[0073]Access hotspot: Highly concurrent access to the same resource in a short time.

[0074]Strong consistency: After the update operation is completed, any multiple subsequent visits will return the latest updated value.

[0075]LRU: Least Recently Used Cache, the least recently used replacement algorithm.

[0076]Consistent Has...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a distributed object storage system and a data read-write method, and the distributed object storage system comprises a storage server cluster, a Cache clustercomposed of a plurality of Caches, and a plurality of API clients. Each API client side can access any Cache in the Cache cluster. Each API client can access any Cache in the Cache cluster, so that for the same data file, the Cache cluster only needs to cache one copy, and the storage resources of the Cache can be saved. And meanwhile, the consistency problem of accessing the same data by a plurality of clients can be solved, the same resources are used as the Cache, and the hit rate of the whole Cache cache data is higher than that of a single node. The Cache is deployed in a cluster mode, the scale of the Cache cluster can be adjusted according to needs, and good fault tolerance and expandability are achieved.

Description

Technical field[0001]This application relates to the field of data storage technology, in particular to a distributed object storage system and data reading and writing methods.Background technique[0002]A distributed object storage system can store any object in a durable and highly available system, and users and applications can use API (Application Programming Interface) to access data in the object storage. Most of the distributed object storage systems ensure data security by storing multiple copies on multiple disks, and the data is kept consistent between multiple copies. For a strongly consistent distributed object system, it is equivalent to read any copy. Therefore, when the hotspot is accessed, the client will randomly access multiple copies to balance the pressure of different copies. In order to improve throughput and performance, the client usually uses Cache (Cache memory) to cache the read data.[0003]Distributed object storage systems in related technologies such asf...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0656G06F3/0689G06F3/061G06F3/0608
Inventor 甘红星
Owner BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD