Supercharge Your Innovation With Domain-Expert AI Agents!

Data storage method and device in distributed file system

A distributed file and data storage technology, applied in transmission systems, electrical components, etc., can solve problems such as waste of resources, server downtime, heavy server load, etc., and achieve the effect of avoiding downtime and saving system resources

Active Publication Date: 2014-08-13
NAT UNIV OF DEFENSE TECH
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, none of these data storage methods can guarantee that data is evenly distributed on each server in the distributed file system
Especially when the distributed file system is composed of homogeneous server clusters, the so-called homogeneous servers are servers with the same physical configuration. Since all homogeneous servers have the same performance and processing capabilities, at this time, if a large number of files And file copies are distributed unevenly on the homogeneous server cluster, which will cause some servers to be overloaded and even cause server downtime; at the same time, another part of the servers will not be fully utilized, resulting in waste of resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method and device in distributed file system
  • Data storage method and device in distributed file system
  • Data storage method and device in distributed file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0031] The embodiment of the present application does not limit the network topology that constitutes the distributed file system, that is, in a network of any topology, such as any one of a ring structure, a star structure, a bus structure, and a number The structure or any combination of multiple structures can be stored according to the data storage method in the embodiment of the present application. In this embodiment, in order to describe the data storage method in the distributed file system more conveniently, a simple network topology structure is used to further illustrate the data storage method in the distributed file system formed by the network. see figure 1 , which is a schematic diagram of a network topology that constitutes a distributed file system. like figure 1 As shown, the network is a mixed network topology composed of bus and star, in which the backbone network is a bus structure, and other subnets are a star structure.

[0032] Combine below figure ...

Embodiment 2

[0052] A specific implementation process capable of realizing data storage in a distributed file system is described below. see image 3 , which is a specific implementation flowchart of data storage in a distributed file system of the present application. Include the following steps:

[0053] Step 301: Point the current node to the root node of the distributed file system;

[0054] Step 302: Judging whether all the sub-nodes of the current node include routing device nodes, if yes, go to step 303, otherwise, go to step 304;

[0055] Step 303: Calculate the data storage capacity of the next-level routing device node of the current node, and enter step 304;

[0056] Step 304: judge whether all the sub-nodes of the current node contain server nodes, if yes, go to step 305, otherwise, go to step 306;

[0057] Step 305: Obtain the data storage capacity of the next-level server node of the current node;

[0058] Step 306: comparing the data storage capacity of the next-level s...

Embodiment 3

[0082] Corresponding to the above data storage method of the distributed file system, the embodiment of the present application further provides a data storage device in the distributed file system. see Figure 5 , which is a structural diagram of an embodiment of a data storage device in a distributed file system of the present application. The device includes: a search unit 501 , a first storage unit 502 and a second storage unit 503 .

[0083] A search unit 501, configured to search for a child node with the smallest amount of data storage among all child nodes of the root node of the distributed file system, wherein the child node of the next level includes a routing device node and / or a server node ;

[0084] The first storage unit 502 is configured to store the data currently to be stored in the found server node when the next-level child node with the smallest amount of data storage is a server node;

[0085] The second storage unit 503 is configured to, when the nex...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a data storage method and a data storage device in a distributed file system. The method comprises the following steps of: searching a child node with lowest data storage capacity in all next-stage child nodes of a root node in the distributed file system, wherein the next-stage child nodes comprise a routing equipment node and / or a server node; when the next-stage child node with the lowest data storage capacity is the server node, storing the data to be stored currently into the searched server node; and when the next-stage child node with the lowest data storage capacity is the routing equipment node, continuing searching the child node with the lowest data storage capacity in all next-stage child nodes of the searched routing equipment node until the searched child node with the lowest data storage capacity is the server node, and storing the data to be stored currently into the searched server node. By using the method and the device, server downtime can be avoided and simultaneously system resource is saved.

Description

technical field [0001] The present application relates to the technical field of distributed file systems, in particular to a data storage method and device in a distributed file system. Background technique [0002] With the continuous development of the Internet, the data on the Internet has grown explosively, forming massive data. In order to meet the storage requirements of massive data, the distributed file system came into being. The so-called distributed file system means that the physical storage resources managed by the file system are not necessarily directly connected to the local node, but are connected to the local node through a computer network. Distributed file systems usually adopt an out-of-band mode, that is, file metadata information and file content data are not stored together, but file content data is divided into blocks and stored on multiple servers. For example, the file A to be stored has 10MB, if the data block division standard is 2MB, then the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08
Inventor 舒琦杨树强贾焰滕猛周斌韩伟红赵辉陈志坤金松昌罗荣凌王凯
Owner NAT UNIV OF DEFENSE TECH
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com