Physical hard disk management method and device under distributed storage system

A distributed storage and management method technology, applied in the field of distributed storage hard disk management, can solve the problems of upper layer business impact, business interruption, and impact on business stability of the distributed storage system, so as to avoid system DM information confusion and reduce impact , to avoid the effect of drive letter drift

Active Publication Date: 2020-10-30
FENGHUO COMM SCI & TECH CO LTD
View PDF9 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When using DM devices such as LVM or FLCD to create an OSD, if the physical hard disk fails, the upper-layer business using the distributed storage system will be greatly affected, and even business interruption will occur, seriously affecting business stability.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Physical hard disk management method and device under distributed storage system
  • Physical hard disk management method and device under distributed storage system
  • Physical hard disk management method and device under distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0091] Such as figure 1 As shown, the present invention provides a management method of a physical hard disk under a distributed storage system, comprising:

[0092] S1. Create an OSD through the distributed storage management platform, and write the location information such as the OSDID and OSD cluster identifier of the OSD device in the distributed storage system and the logical information of the logical volume group and the physical volume group of the LVM into the physical storage through the log of the LVM in the hard disk;

[0093] S2. By monitoring the UDEV event of the hardware device in the kernel, the ESN, the hard disk WWN and the hard disk drive letter of the unplugged and inserted physical hard disk are obtained, and the OSD ID and OSD cluster identifier of the OSD device in the corresponding distributed storage system are found, and then Use the OSD ID and OSD cluster ID of the OSD device to modify the operating status of the OSD device in the distributed stor...

Embodiment 2

[0095] Such as figure 2 Shown is a schematic diagram of the creation principle of an OSD device in the embodiment of the present invention. When creating an OSD device in a distributed storage system, different device types can be selected, such as mechanical hard disks, solid-state hard disks, and mechanical hard disks and solid-state hard disks. Various combined equipment DM, FLCD, etc. Such as image 3Shown is a schematic flow chart of creating an OSD device in an embodiment of the present invention, combined with figure 2 and image 3 , the process of creating an OSD device includes:

[0096] S11. Different device combinations can be created as a Device-mapper according to business requirements. When creating a Device-mapper device, the WWN and ESN of the physical hard disk can be written into the corresponding device configuration, such as FLCD configuration;

[0097] S12, adding the created Device-mapper device or the physical hard disk to the physical volume group...

Embodiment 3

[0103] Such as Figure 4 Shown is the mapping relationship between the DM device and the physical hard disk in the embodiment of the present invention. The Device-mapper device is a Linux system that filters or redirects business read and write requests through modular Target Driver plug-ins in the kernel. The currently implemented Target Driver plug-ins include soft RAID, logical volume striping, and multipathing. , cache, mirror, snapshot, etc. Device-mapper consists of one or more block devices. Block devices can be physical hard disks or hard disk partitions, or Device-mapper devices. That is to say, Device-mapper can be continuously iterated. Such as Figure 4 As shown, in order to obtain all related physical hard disks of Device-mapper device 1, the following method can be used:

[0104] (1) Find the major device number and the minor device number of Device-mapper 1 in the Linux system;

[0105] (2) Through the major device number and minor device number, the sub-dev...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a physical hard disk management method under a distributed storage system. An OSD is created through a distributed storage management platform, and positioning information suchas OSD ID and OSD cluster identification of OSD equipment in a distributed storage system and logic information of a logic volume group and a physical volume group of an LVM are written into a physical hard disk through logs of the LVM; the method further comprises the following steps: monitoring a UDEV event of hardware equipment in a kernel; obtaining a disk pulling event or a disk inserting event; obtaining an ESN, a hard disk WWN and a hard disk drive character for pulling out or inserting the physical hard disk; and finding the OSD ID and the OSD cluster identifier of the OSD equipment in the corresponding distributed storage system, and then modifying the operation state of the OSD equipment in the distributed storage cluster through the OSD ID and the OSD cluster identifier of theOSD equipment. According to the invention, the state update of the OSD equipment of the distributed storage system can be triggered in real time by utilizing the monitoring of the kernel UDEV event ofLinux, and the automatic isolation and recovery of the faulted hard disk are realized. The invention further provides a corresponding physical hard disk management device under the distributed storage system.

Description

technical field [0001] The invention belongs to the technical field of distributed storage hard disk management, and more specifically relates to a method and device for managing physical hard disks in a distributed storage system. Background technique [0002] With the continuous development of social informatization, huge amounts of data have been generated in many application fields, especially in the video industry, and the amount of data is still growing rapidly. In order to improve the speed of data access and the scalability of storage, massive data is generally distributed and stored on multiple nodes in different data centers to support parallel access. In the cloud computing environment, the organization and management of massive data storage show higher requirements in terms of scalability, fault tolerance and cost control, and the ease of use and scalability of storage are becoming more and more important. Therefore, distributed storage is becoming more and more...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06F11/14G06F11/20
CPCG06F3/0614G06F3/0619G06F3/0631G06F3/0644G06F3/0665G06F3/067G06F3/0685G06F11/1458G06F11/2094
Inventor 李玉冰李庆林蓝海张书东
Owner FENGHUO COMM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap