Method and device for managing physical hard disks in a distributed storage system

A distributed storage and management method technology, applied in the field of distributed storage hard disk management, can solve problems such as business interruption, upper-layer business impact of distributed storage system, and business stability, so as to reduce impact and avoid system DM information confusion , to avoid the effect of drive letter drift

Active Publication Date: 2022-04-26
FENGHUO COMM SCI & TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When using DM devices such as LVM or FLCD to create an OSD, if the physical hard disk fails, the upper-layer business using the distributed storage system will be greatly affected, and even business interruption will occur, seriously affecting business stability.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for managing physical hard disks in a distributed storage system
  • Method and device for managing physical hard disks in a distributed storage system
  • Method and device for managing physical hard disks in a distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0091] Such as figure 1 As shown, the present invention provides a management method of a physical hard disk under a distributed storage system, comprising:

[0092] S1. Create an OSD through the distributed storage management platform, and write the location information such as the OSDID and OSD cluster identifier of the OSD device in the distributed storage system and the logical information of the logical volume group and the physical volume group of the LVM into the physical storage through the log of the LVM in the hard disk;

[0093] S2. By monitoring the UDEV event of the hardware device in the kernel, the ESN, the hard disk WWN and the hard disk drive letter of the unplugged and inserted physical hard disk are obtained, and the OSD ID and OSD cluster identifier of the OSD device in the corresponding distributed storage system are found, and then Use the OSD ID and OSD cluster ID of the OSD device to modify the operating status of the OSD device in the distributed stor...

Embodiment 2

[0095] Such as figure 2 Shown is a schematic diagram of the creation principle of an OSD device in the embodiment of the present invention. When creating an OSD device in a distributed storage system, different device types can be selected, such as mechanical hard disks, solid-state hard disks, and mechanical hard disks and solid-state hard disks. Various combined equipment DM, FLCD, etc. Such as image 3Shown is a schematic flow chart of creating an OSD device in an embodiment of the present invention, combined with figure 2 and image 3 , the process of creating an OSD device includes:

[0096] S11. Different device combinations can be created as a Device-mapper according to business requirements. When creating a Device-mapper device, the WWN and ESN of the physical hard disk can be written into the corresponding device configuration, such as FLCD configuration;

[0097] S12, adding the created Device-mapper device or the physical hard disk to the physical volume group...

Embodiment 3

[0103] Such as Figure 4 Shown is the mapping relationship between the DM device and the physical hard disk in the embodiment of the present invention. The Device-mapper device is a Linux system that filters or redirects business read and write requests through modular Target Driver plug-ins in the kernel. The currently implemented Target Driver plug-ins include soft RAID, logical volume striping, and multipathing. , cache, mirror, snapshot, etc. Device-mapper consists of one or more block devices. Block devices can be physical hard disks or hard disk partitions, or Device-mapper devices. That is to say, Device-mapper can be continuously iterated. Such as Figure 4 As shown, in order to obtain all related physical hard disks of Device-mapper device 1, the following method can be used:

[0104] (1) Find the major device number and the minor device number of Device-mapper 1 in the Linux system;

[0105] (2) Through the major device number and minor device number, the sub-dev...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for managing physical hard disks in a distributed storage system: create an OSD through a distributed storage management platform, and store positioning information such as OSD IDs and OSD cluster identifications of OSD devices in the distributed storage system and logical volumes of LVM The logical information of the group and the physical volume group is written to the physical hard disk through the log of LVM; by monitoring the UDEV event of the hardware device in the kernel, the disk removal event or disk insertion event is known, and the ESN and hard disk Find the OSD ID and OSD cluster ID of the OSD device in the corresponding distributed storage system by WWN and hard disk drive letter, and then modify the operating status of the OSD device in the distributed storage cluster through the OSD ID and OSD cluster ID of the OSD device. The invention utilizes the monitoring of the UDEV event of the kernel of Linux to trigger the state update of the OSD device of the distributed storage system in real time, and realize automatic isolation and recovery of the faulty hard disk. The invention also provides a management device for the physical hard disk in the corresponding distributed storage system.

Description

technical field [0001] The invention belongs to the technical field of distributed storage hard disk management, and more specifically relates to a method and device for managing physical hard disks in a distributed storage system. Background technique [0002] With the continuous development of social informatization, huge amounts of data have been generated in many application fields, especially in the video industry, and the amount of data is still growing rapidly. In order to improve the speed of data access and the scalability of storage, massive data is generally distributed and stored on multiple nodes in different data centers to support parallel access. In the cloud computing environment, the organization and management of massive data storage show higher requirements in terms of scalability, fault tolerance and cost control, and the ease of use and scalability of storage are becoming more and more important. Therefore, distributed storage is becoming more and more...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06G06F11/14G06F11/20
CPCG06F3/0614G06F3/0619G06F3/0631G06F3/0644G06F3/0665G06F3/067G06F3/0685G06F11/1458G06F11/2094
Inventor 李玉冰李庆林蓝海张书东
Owner FENGHUO COMM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap