Supercharge Your Innovation With Domain-Expert AI Agents!

Automatic balancing method for disk writing of distributed file system and storage medium

A distributed file, automatic equalization technology, applied in the direction of input/output to record carrier, data processing input/output process, instruments, etc., can solve the problem that the disk equalization logic cannot achieve automatic equalization and relies on human operation.

Inactive Publication Date: 2021-01-26
INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to provide an automatic balancing method for disk writing in a distributed file system. Without manually executing commands, the system automatically triggers disk load balancing according to the current disk usage after each disk writing, which solves the current problem. There is a problem that the disk balance logic in the technology cannot realize automatic balance and relies on manual operation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic balancing method for disk writing of distributed file system and storage medium
  • Automatic balancing method for disk writing of distributed file system and storage medium
  • Automatic balancing method for disk writing of distributed file system and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The present invention proposes an automatic balancing method for disk writing in a distributed file system, which completes disk writing load balancing by adding real-time detection and triggering balancing, such as figure 1 As shown, the method includes:

[0032] Step S110: Detect the disk usage in real time after each data writing is completed; the distributed file system client sends the data to be written and the command to detect the disk usage to the disk, and after the data is written to a certain disk, Detect the disk usage and obtain the disk usage after each data writing is completed;

[0033] Step S120: Trigger the disk balancer to generate a balance plan and execute to complete the disk balance; send the disk usage to the rule module to determine whether to trigger; judge whether to trigger the balance process according to the obtained disk usage and the preset disk balance rule; configure in advance Some rules for triggering disk balance: for example, when...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an automatic balancing method for disk writing of a distributed file system and a storage medium, and the method comprises the steps of detecting the usage amount of a disk after data is written into a certain disk, and obtaining the usage amount of the disk after the data is written each time; judging whether an equalization process is triggered or not according to the obtained disk usage amount and a preset disk equalization rule; and when the disk usage amount satisfies the preset disk equalization rule, performing disk equalization operation, thereby realizing the automatic completion of a disk equalization process, and automatically performing disk load equalization after each disk writing without manual intervention.

Description

technical field [0001] The invention relates to the technical field of computer data storage, in particular to an automatic equalization method and a storage medium for disk writing in a distributed file system. Background technique [0002] In the distributed file system, the data node stores data blocks in the local file system directory. The specific directory can be configured by configuring the dfs.datanode.data.dir parameter in the distributed file system-site.xml. In a typical installation configuration, multiple directories are generally configured, and these directories are configured on different devices, such as different HDD (the full name of HDD is Hard Disk Drive) and SSD (full name Solid State Drives, SSD). When we write a new data block to the distributed file system, the data node will use the volume selection strategy to choose a storage place for this block. [0003] Currently Hadoop supports two volume selection strategies: round-robin and available spa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0604G06F3/0614G06F3/064G06F3/067
Inventor 武鹏
Owner INSPUR SUZHOU INTELLIGENT TECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com