Filing system and implement method of distributed configured massive data

A technology for data archiving and massive data, applied in transmission systems, electrical digital data processing, special data processing applications, etc., can solve the problems of limited use scenarios and low scalability, and achieve the effect of improving the speed of archiving

Active Publication Date: 2013-04-10
SPACE STAR TECH CO LTD
View PDF3 Cites 35 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, these methods are often aimed at a specific type of data, the usage scenarios are relatively limited, and the scalability is not high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Filing system and implement method of distributed configured massive data
  • Filing system and implement method of distributed configured massive data
  • Filing system and implement method of distributed configured massive data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0112] The experimental conditions of this embodiment are:

[0113] (1) The input is an archiving request including the archiving data type, archiving data and metadata storage path;

[0114] (2) HDFS distributed file system and MySQL database;

[0115] (3) A configuration file with complete information. The configuration file needs to specify the information required by HDFS and MySQL in the access condition (2) and other archiving parameters.

[0116] In conjunction with the test conditions described above, the technical solution of the present invention is described in detail:

[0117] 1. Automatic filing

[0118] (1) Edit the configuration file corresponding to the archiving instance, each configuration module specifies the archiving parameters of a certain type of archiving data. In a certain application scenario, it is necessary to archive HY2 type data, where the archive file types are TIF and JPEG image files, and the number is 100. The metadata file is of XML type...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Disclosed are a filing system and an implement method of distributed configured massive data. The filing system comprises a multiple filing case management module, a filing requirement receiving module, a filing requirement distributing module, a filing process information persistent module, a configuration file analysis module, a filing requirement processing module, a scanning module, a metadata analysis module, a catalogue analysis module, a filing module, a filing data extracting module, a transaction processing module and the like. Hot plug can be achieved through a configuration file according to requirements so that setting of personalized filing service is facilitated and the purpose that software can be reused highly is achieved.

Description

technical field [0001] The invention relates to the field of data archiving, in particular to a distributed and configurable massive data archiving business system and an implementation method. Background technique [0002] Effective and complete archiving of massive data is a very important task. In today's society, with the rapid development of information technology and communication technology, the data capacity of the whole world is showing explosive growth. In the field of satellite applications, in particular, massive data such as remote sensing data and meteorological data will be generated in terabytes or even exabytes. It is an urgent problem to study and use optimization methods to efficiently manage these data. [0003] The main purpose of the data archiving system is to store and back up data, and in the process of storing and backing up, follow certain strategies to facilitate the extraction and retrieval of data after archiving. How to perform rapid archivi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08G06F9/50G06F11/14G06F17/30
Inventor 王海涛王守信李明泉陈佼王智尧刘华
Owner SPACE STAR TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap