Vector space big data storage method based on HBase

A technology of big data storage and vector space, applied in the direction of electric digital data processing, special data processing applications, instruments, etc., can solve the problems that cannot adapt to the huge data volume of geographical data, and achieve high data processing performance and high scalability , the effect of high practical value

Inactive Publication Date: 2013-05-22
ZHEJIANG UNIV
View PDF2 Cites 32 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] The present invention aims at the disadvantage that the existing technology cannot adapt to the huge data volume of geographical data, and provides a new type of HBase-based data processing system that can adapt to large-capacity geographical data and maintain stable data processing performance as the data volume increases significantly. Vector Space Big Data Storage Method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Vector space big data storage method based on HBase
  • Vector space big data storage method based on HBase
  • Vector space big data storage method based on HBase

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0032] The HBase-based vector space big data storage method includes the following specific steps, such as figure 1 Shown:

[0033] 1) The computer collects and obtains vector data records, the vector data records include a data field and multiple attribute fields, and the vector data records are produced and obtained from geographic data or parsed from vector data files.

[0034] 2) The computer converts the vector data records obtained above into the standard WKB format.

[0035] 3) Calculate the spatial range number of each vector data record. Firstly, according to the latitude and longitude coordinates on a global scale, the earth’s surface is divided into grids of different levels according to different grid sizes, such as figure 2 , 3 as shown, figure 2 , image 3 Represent the grid obtained by dividing the earth's surface area with 1 and 0.1 as the unit, respectively. Under a certain level of division, the surface of the earth can be divided into grids. The grid...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of big data storage of computers and discloses a vector space big data storage method based on the HBase. The vector space big data storage method based on the HBase includes the following steps: 1) a vector data record is collected; 2) spacial scale numbers of the vector data record are computed; 3) an ID of the vector data record is taken as a row key, a data field and an attribute field except for the ID of the vector data record are taken as a row, and a data record is created; 4) the spacial scale numbers of the vector data record is taken as the row key, IDs of all vector space data in the spacial scale numbers are taken as the row, and an index is created. The vector space big data storage method based on the HBase has the advantages of being capable of supporting distributed storage and management of vector space data of a super-large scale and supporting quick query of a geographic position range. Compared with the existing vector space data storage method, the vector space big data storage method based on the HBase has a high visit concurrent amount and supports expansion of a data scale.

Description

technical field [0001] The invention relates to the field of computer big data storage, in particular to an HBase-based vector space big data storage method. Background technique [0002] As an important type of spatial data, vector data has been widely used in the field of spatial information. However, due to its characteristics of large data volume and long data records, the scalable storage and management of a large amount of vector data and the efficient access to spatial data have become a topic of concern. [0003] Geographical data is spatial data and its attribute information with the earth's surface as the basic frame of reference. In order to facilitate the acquisition, storage, analysis and management of geographic data, a geographic information system, referred to as GIS system (geographic information system), has been established. The GIS system represents various objects in the real world, such as roads, land, elevation, and so on. In the vector data structu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 陈华钧黄梅龙胡磊郑国轴吴朝晖
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap