Method for grouping space metadata based on cluster storage

A technology of cluster storage and grouping method, applied in the field of spatial metadata grouping based on cluster storage, can solve the problems of limited number of indexable data records, frequent update of data objects, affecting the performance of read operations, etc., to meet storage and access requirements , the effect of efficient access

Active Publication Date: 2012-06-27
TSINGHUA UNIV
View PDF2 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method has three problems. The first problem is that the cluster storage architecture is based on a centralized object storage device. Although it can manage terabytes of data, the number of indexable data records is limited; the second problem is the storage Data objects are frequently updated, which affects the performanc

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for grouping space metadata based on cluster storage
  • Method for grouping space metadata based on cluster storage
  • Method for grouping space metadata based on cluster storage

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The specific implementation manners of the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. The following examples are used to illustrate the present invention, but are not intended to limit the scope of the present invention.

[0034] In view of the shortcomings of the metadata distribution algorithm of the existing cluster storage system, the method of the present invention proposes a multi-path coverage method of a hierarchical pyramid, and distributes the relevant metadata records on the corresponding servers according to the regional attributes of the metadata, so that Efficient query load distribution of data can be achieved. The file system architecture applied by the present invention is as follows: figure 1 As shown, on the server node, this method proposes an application-oriented data approximation clustering method, that is, a multi-path coverage method based on the hierarchical pyrami...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for grouping space metadata based on cluster storage, which includes: S1, obtaining metadata records with property items to be divided from metadata tables of geographic data files; S2, dividing the selected metadata records into different data sets according to the property items to be divided, and distributing the data sets on metadata server cluster nodes, wherein the property items to be divided of the metadata records on the same server cluster node are the same in value; S3, clustering the metadata records on each server cluster node step by step to obtain a plurality of metadata record groups; S4, classifying the metadata records of the geographic data file on each server cluster node, separating the metadata records into different metadata record groups and establishing a metadata directory tree of each node; and S5, sequencing the grouped data files and storing the sequenced indexed files on the corresponding nodes. The method is used for grouping space metadata based on cluster storage, so that retrieval efficiency is improved.

Description

technical field [0001] The invention relates to the technical field of storage systems, in particular to a method for grouping spatial metadata based on cluster storage. Background technique [0002] Traditional spatial data management is based on a relational database system, and data records are stored in database tables. This method is very suitable for relational query and transaction processing, and meets the application scenarios with frequent short transactions. The disadvantages are that indexable data items are limited, complex queries are slow, indexing overhead is high, system maintenance is complex, and continuous system optimization is required. At present, the application environment of WebGIS is a distributed file system based on cluster storage, which has a large number of large and small file types, and there are various degrees of correlation between files such as space and attributes. The distributed file system based on network storage (referred to as fi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 崔纪锋张勇李超邢春晓
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap