Method and device for read-writing data in object storage system

A technology for object storage and data, which is applied in the direction of program control devices, electrical digital data processing, special data processing applications, etc.

Inactive Publication Date: 2016-11-23
北京百迈客云科技有限公司
View PDF4 Cites 32 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, when dealing with a large amount of biological information data, how to simplify the information calculation program to perform frequent read and write operations on a large number of intermediate files is a very challenging problem.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for read-writing data in object storage system
  • Method and device for read-writing data in object storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0034] figure 1 It is a flowchart of a method for reading and writing data in an object storage system provided by an embodiment of the present invention. Such as figure 1 As shown, the method for reading and writing data in an object storage system provided by an embodiment of the present invention includes:

[0035] In step S101, the object storage system is mounted to the user space file system created by the kernel fuse module in the user space, and the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and device for read-writing data in an object storage system. The method comprises the steps that the object storage system is mounted in a user space file system established by a kernel fuse module in user space, and route information from each client to storage space in the object storage system is configured; if the clients read storage objects, the data is firstly read from cache of the user space file system, if no data to be read exists in the cache, a rest service interface is packaged according to metadata information of the storage objects in a user space file system database, the storage objects in the object storage system are operated through a rest service, and the data in the object storage system is read; if files are written in the clients, the files are segmented into one or more blocked files through the user space file system according to the sizes of the files and the sizes of blocks and written in local cache, file attribute information and block information are stored, the rest service is called to write the blocks in the cache in the object storage system, and the metadata information of the storage objects is recorded.

Description

technical field [0001] The invention relates to the field of data reading and writing, in particular to a method and device for reading and writing data in an object storage system. Background technique [0002] With the continuous development of high-throughput sequencing technology, bioinformatics data is growing at an explosive rate. Biological big data includes a lot of information, great value, and has the characteristics of "4V" such as large data volume (Volume), diversity (Variety), high value (Value), and fast processing speed (Velocity). Agriculture, medicine, health, sanitation and other aspects will have a profound impact. With the explosive growth of data, how to store and effectively utilize these data is also a very challenging issue. The traditional infrastructure has been helpless with these large-scale data, and the expansion and maintenance of the infrastructure also require a large cost. Fortunately, the continuous development of object storage cloud s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F9/44
CPCG06F8/22G06F16/172
Inventor 郑洪坤李明华杨峻张增金
Owner 北京百迈客云科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products