A great magnitude of data hierarchical storage method

A hierarchical storage and mass data technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of not considering the difference in equipment performance, unfavorable system scalability, etc.

Inactive Publication Date: 2007-11-28
TSINGHUA UNIV
View PDF0 Cites 77 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In addition, the traditional tiered storage system does not take into account the performance differences of devices. Devices with large performa...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A great magnitude of data hierarchical storage method
  • A great magnitude of data hierarchical storage method
  • A great magnitude of data hierarchical storage method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0073] The mass data hierarchical storage method is mainly composed of a metadata server, a data server and a parallel file system client agent software on a front-end host. The method is implemented based on a parallel file system. In the parallel file system, in order to improve the access throughput, the data of each file is stored on each data server in a fragmented manner, and the fragments of the file on the data server are called data files. The way of file fragmentation is shown in Figure 1. The metadata server is mainly responsible for constructing a unified file view of data files on different data servers, and updating the file access table by periodically scanning data servers to be responsible for decision-making and management of file migration. The main functions of the parallel file system client agent module on the application server include searching the file inode value from the metadata server according to the file name, obtaining metadata from the metadat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

This invention relates to a graded storing method for mass data characterizing that the customer proxy software of parallel file systems on front hosts realizes support to VFS access by system interface sub-modules and sub-modules of the VFS layer, a metadata server is responsible for organizing data files on different data servers to a unified parallel file system view, and a metadata management module provides operations of accessing metadata, a file migration deciding module gets file access information from the data server periodically and makes decision to file migration according to file system load and grade situation of equipment and an executing module of the data server executes migration.

Description

technical field [0001] The hierarchical storage method of massive data belongs to the field of data migration, and especially relates to the fields of data classification, data management and migration decision-making. Background technique [0002] Hierarchical storage technology for massive data refers to: a multi-level storage system composed of storage devices with different performance, availability, and price per bit; Level changes migrate data between storage devices of different levels. The goal of dynamically migrating the right data to the right place at the right time is to have a statistically high quality of service and a low total cost of ownership for that storage system. The traditional tiered storage system consists of two levels: online devices (disks) and offline devices (tapes). Data is placed on the online devices when they are created, and unimportant files are migrated to the offline devices when the capacity of the online devices is almost full. Howe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08G06F17/30
Inventor 舒继武薛巍于得水张广艳
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap