Fault processing method and device, distributed storage system and storage medium

A fault handling method and fault technology, applied in the direction of electrical digital data processing, generation of response errors, instruments, etc., to achieve the effect of reducing the amount of data migration

Active Publication Date: 2019-04-12
PING AN TECH (SHENZHEN) CO LTD
View PDF6 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The main purpose of the present invention is to provide a fault handling method, device, distributed storage system and computer-readable storage medium, aiming to solve the problem of how to reduce the amount of data migration between OSDs during the OSD fault handling process

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Fault processing method and device, distributed storage system and storage medium
  • Fault processing method and device, distributed storage system and storage medium
  • Fault processing method and device, distributed storage system and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] The principles and features of the present invention will be described below with reference to the accompanying drawings. The examples cited are only used to explain the present invention, and are not used to limit the scope of the present invention.

[0053] Refer to figure 1 What is shown is a schematic diagram of the system architecture of the first embodiment of the distributed storage system of the present invention.

[0054] In this embodiment, the distributed storage system includes a plurality of active OSDs 31 and at least one backup OSD group. The backup OSD group includes a plurality of backup OSDs 32, wherein each active OSD 31 and backup OSD 32 can be set in each host 3. For example, at least one main OSD 31 and at least one backup OSD 32 are provided in one host 3, and each of the main OSD 31 and the backup OSD 32 is in communication connection (for example, communication connection through the network 2).

[0055] In some application scenarios, an electronic dev...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a distributed storage technology, and discloses a fault processing method and device, a distributed storage system and a computer readable storage medium. The method comprisesthe following steps: detecting a main OSD of a fault in real time or at regular time; when a faulty main OSD is detected, determining PG corresponding to each piece of object data stored in the faulty main OSD according to a predetermined mapping relation between the object data and the PG, and taking each determined PG as a faulty PG; reducing the copy configuration quantity of all the object data corresponding to all the fault PGs from a first preset quantity to a second preset quantity; and selecting one standby OSD from the standby OSD group as a new main OSD, replacing the faulted main OSD with the new main OSD, and increasing the copy configuration quantity of all the object data corresponding to all the faulted PGs from a second preset quantity to a first preset quantity. Comparedwith the prior art, in the OSD fault processing process, the data migration amount between OSDs is reduced.

Description

Technical field [0001] The present invention relates to the field of distributed storage technology, in particular to a fault processing method, device, distributed storage system and computer-readable storage medium. Background technique [0002] CEPH distributed file system is a distributed storage system with large capacity, high performance and strong reliability. The core component of CEPH is OSD (Object Storage Device). OSD manages an independent hard disk and provides read and write access interfaces for Object-based Storage. The CEPH cluster is composed of many independent OSDs, and the number of OSDs can be dynamically added or deleted. The CEPH client distributes object data (Object) to different OSDs for storage through the CRUSH algorithm. Among them, CRUSH is a pseudo-random distribution algorithm. The algorithm first assigns the object data to a Placement Group (PG) through a hash value (HASH), and then calculates the OSD stored by the PG. Therefore, the attributi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/20G06F11/14
CPCG06F11/1464G06F11/2094
Inventor 宋小兵姜文峰
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap