Gridding data transcription generation method based on storage alliance subset partition

A copy and subset technology, applied in the field of data management in a distributed environment, can solve the problems of inability to apply P2P topology, distributed storage of source data, low-end data grid system, poor system performance, etc., to reduce storage overhead, network Small delay, reduced number of effects

Active Publication Date: 2010-08-11
NANJING UNIV OF POSTS & TELECOMM
View PDF0 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0010] Currently existing replica creation strategies, such as waterfall replica creation strategy, caching plus waterfall replica creation strategy, and fast propagation replica creation strategy are mainly developed for data grid systems where data is stored at the top node and based on hierarchical topology, so they cannot Applied to low-end data grid systems with P2P topology and source data distributed and stored in different grid nodes; while th...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Gridding data transcription generation method based on storage alliance subset partition
  • Gridding data transcription generation method based on storage alliance subset partition
  • Gridding data transcription generation method based on storage alliance subset partition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The module functions of the entire replica creation strategy are as follows figure 1 As shown, it mainly includes the following main sub-processes:

[0034] 1. Grid node subset division based on storage alliance

[0035] Set N is the set of all nodes in the grid system, v is the preset network transmission rate threshold, and k is the preset size value of the subset that meets the requirements of the present invention (the size of the node subset cannot exceed k). If for a subset Ap of N, satisfy: any node n i , n j∈Ap, if for any n i ≠n j have n i , n j The network transmission rate Tv(n i , n j )>v, then this subset is called a grid node subset meeting the requirements of the present invention.

[0036] A low-end data grid system can be divided into multiple node subsets. The subsets can be set in advance by the grid system administrator according to the rules of subset division, and can also be dynamically generated according to the network status at runtime...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a gridding data transcription generation method based on storage alliance subset partition, in particular to a gridding data transcription creating and distributing method on a gridding node and according to the gridding user data access behavioral characteristics; the basic thought of the method is that the data gridding node is divided into a plurality of subsets which have good network transmission speed, by utilizing the characteristic that network delay is less in each subset, the transcription creating number is reduced, so as to reduce the gridding system storage expense; meanwhile, caching strategy is utilized, the transcription can be rapidly generated in each gridding node subset; finally, the optimal client strategy is utilized, the position of the data transcription in the gridding node subset is regulated, so as to form a good data transcription layout.

Description

technical field [0001] The invention is a solution to the problem of creating a data copy in a grid, which is mainly used to solve the problem of creating a data copy in a low-end grid, and belongs to the field of data management in a distributed environment. Background technique [0002] Since the 1990s, with the rapid development of Internet technology, in order to solve the problem of high-performance resource sharing and collaborative solution in the network virtual environment, Grid (Grid) technology came into being and has been widely used. At present, various countries have established many grids for various applications. In China alone, multiple grids such as China National Grid, 973 Semantic Grid, 863 Grid, Shanghai Grid, and Vega Grid have been established. . Grid, a new type of distributed computing infrastructure, has been widely used in a variety of major applied research issues, and has become a national strategic infrastructure for high-performance computing ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08H04L12/24
Inventor 王汝传施晓烨付雄任勋益蒋凌云邓松易侃杨明慧邓勇
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products