Data storage method and apparatus

A data storage and data block technology, applied in the communication field, can solve problems such as occupying reading resources and occupying large storage resources, and achieve the effects of improving access performance, reducing processing pressure, and improving acquisition efficiency

Active Publication Date: 2018-03-16
NEW H3C TECH CO LTD
View PDF6 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, due to the need to store metadata for each data object, when the number of data objects is large, the metadata of all data objects will occupy a large amount of storage resources, and it is necessary to frequently access the management nodes of the distributed file system to manage Nodes read metadata, which takes up a lot of reading resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method and apparatus
  • Data storage method and apparatus
  • Data storage method and apparatus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, rather than limiting the present application. As used in this application and the claims, the singular forms "a", "the" and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It should also be understood that the term "and / or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.

[0027] It should be understood that although the embodiments of the present application may use terms such as first, second, and third to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of the present application, first information may also be called second information, and similarly, second ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data storage method and apparatus. The method comprises the steps of obtaining a to-be-stored first data file and a first LUN identifier corresponding to the first data file;according to first cluster view information, determining multiple first OSDs corresponding to the first LUN identifier, wherein the first cluster view information comprises a corresponding relationship between the first LUN identifier and the first OSDs; splitting the first data file into multiple data blocks, determining the first OSDs corresponding to the data blocks, and sending the data blocksto the corresponding first OSDs, thereby enabling the first OSDs to store the data blocks; and storing metadata corresponding to the first data file in a monitoring server. Through the technical scheme, the metadata quantity is greatly reduced; the metadata access frequency and quantity are reduced; the cluster access performance is improved; and storage resources occupied by the metadata are saved. Meanwhile, an expansion scheme based on zero data migration of a cluster view version is provided, so that the influence of the cluster expansion process on the system performance is reduced.

Description

technical field [0001] The present application relates to the technical field of communications, and in particular to a data storage method and device. Background technique [0002] With the massive application of mobile networks, big data, and cloud computing, higher and higher requirements are put forward for storage capacity and storage performance. Ceph (distributed file system based on Linux PB), GFS (Google File System, Linux-based Proprietary distributed file system), Gluster, HDFS (Hadoop Distributed File System, distributed file system) and other distributed file systems have been developed rapidly. [0003] Wherein, the distributed file system may include multiple OSDs (Object Storage Devices, object storage devices), the OSD is a data storage service unit, and one OSD may correspond to one physical disk. [0004] In order to realize the storage of the data file, the data file is split into multiple data objects, the metadata (metadata) of each data object is obta...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0608G06F3/061G06F3/0626G06F3/0638G06F3/064G06F3/067
Inventor 李航
Owner NEW H3C TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap