Unlock instant, AI-driven research and patent intelligence for your innovation.

Unstable network-oriented distributed file storage method based on quality perception

A technology for distributed files and stable networks, applied in the field of distributed file storage, can solve problems such as network fraud and forged information, and achieve the effects of improving service speed and quality, fast file storage, and targeted storage services.

Inactive Publication Date: 2011-06-01
ZHEJIANG UNIV
View PDF4 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] (3) Nodes may even cheat and forge information on the network for some reasons

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unstable network-oriented distributed file storage method based on quality perception
  • Unstable network-oriented distributed file storage method based on quality perception
  • Unstable network-oriented distributed file storage method based on quality perception

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0092] 1. The recovery volume generation algorithm is:

[0093] setting file A , the file A into 5 equal rolls (excluding the last roll), respectively A1,A2,A3,A4,A5 .

[0094] According to the recovery volume generation algorithm, use the above 5 data volumes to generate 3 recovery volumes R1, R2, R3 . in:

[0095]

[0096] 2. The recovery volume synthesis algorithm is:

[0097] If a client node in the system is offline, resulting in a file A data volume A2,A3,A4 lost. At this point, there are still 2 original data volumes in the system A1,A5 , three recovery volumes R1, R2, R3 , the total number of volumes is not less than the constituent files A The total number of raw data volumes. Thus lost data volumes can be recovered.

[0098] Lost data recovery process: According to the recovery volume recovery formula, a matrix is ​​established.

[0099]

[0100] Solving the matrix equation gives:

[0101]

[0102] Lost data volumes can be obtained from t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a distributed file storage method based on quality perception. In the method, a node contribution weight calculation formula and a node redundancy backup policy based on recovery volume generation and synthesis are introduced, and a stable cluster storage mode-oriented distributed file system Hadoop is improved to adapt to a large-scale unstable network. The method has theadvantages that: the traditional distributed storage mode mirroring redundancy backup policy is improved, and the storage efficiency of the traditional distributed file storage system is improved; checkout and recovery calculation is introduced, and the novel file storage service system processes various redundancy blocks equally, so the parallel transmission rate is improved and the file macro transmission rate is greatly improved; and the network stability tolerance is improved and scattered idle storage and network bandwidth resources on the internet are fully utilized.

Description

technical field [0001] The invention relates to the problem of distributed file storage, in particular to a distributed file storage method based on quality perception for unstable networks. Background technique [0002] Hadoop[1] is a distributed computing open source software launched by the Apache Foundation. The main sub-projects include: MapReduce[2-3] - a computing cluster of a large-scale distributed data processing file system [4]. Hadoop is mainly developed with the support of Yahoo, and its reliable operation in a stable network environment has been confirmed by about 200 stable node running tests of Yahoo [5]. Many well-known international companies, such as Facebook, Amazon, and Last.fm, are using Hadoop for storage, computing, and data mining. Hadoop has become one of the preferred support software for enterprises to build data centers [6-7]. [0003] Hadoop was designed to run on commodity hardware in the early stages of its development, and its distributed ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L29/08G06F17/30
Inventor 宋广华杨波威潘海斌郑耀
Owner ZHEJIANG UNIV
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com