Spatial distributed storage optimization method based on geographic hash

A technology of distributed storage and optimization method is applied in the field of spatially distributed storage optimization based on geo-hashing to achieve the effect of improving throughput efficiency and storage query performance.

Inactive Publication Date: 2021-07-09
亿景智联(苏州)科技有限公司
View PDF2 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a spatial distributed storage optimization method based on geographic hashing, which can effectively solve the problem of distributed storage through geographic hashing area grid division proposed in the above background technology. In the field of distributed storage of large spatial data, how Improving the mass throughput efficiency of spatial data has always been a difficult problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Spatial distributed storage optimization method based on geographic hash
  • Spatial distributed storage optimization method based on geographic hash
  • Spatial distributed storage optimization method based on geographic hash

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0017] Example: such as Figure 1-3 As shown, the present invention provides a technical scheme of a spatial distributed storage optimization method based on geographic hashing, using the construction of unordered geographic hashing to construct rowkey, that is, it can make full use of its special spatial region mapping relationship, that is, optimize geographic space The accuracy and confidence of the query, and through the hash disorder structure, solve the distributed storage problem of the hot region, greatly improve the query efficiency of the data, and build a reliable physical distribution of the spatial relationship.

[0018] According to the above technical solution, the method of dividing the region is constructed as shown in the figure above. Through the idea of ​​geographical hashing, the more times of division, the smaller the area, and then encode the latitude and longitude, and divide the geographical location to make the region more accurate;

[0019] According...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a spatial distributed storage optimization method based on a geographic hash. The method comprises the following steps: S1, constructing a rowkey by using a constructed disordered geographic hash; S2, performing attribution association construction according to the hash relationship and original data, performing geographic mapping on the original spatial data, segmenting by using a geographic region of mapping hash, and constructing region pre-partition by using a segmented geographic hash region, so that node loads in the hbase are uniform. According to the method, a big data space storage technology and a geocoding technology are integrated, a space big data storage scheme is perfectly constructed through combination of geographic hashing and an hbase pre-partitioning scheme, the throughput efficiency of an hbase number bin is improved according to pre-generated regions, and written data can uniformly hit the pre-constructed regions according to planned geographic intervals in cooperation with the geographic hashing, so the defects are avoided to a great extent, and the storage query performance is greatly improved.

Description

technical field [0001] The invention relates to the technical field of spatial big data, in particular to a geographical hash-based spatial distributed storage optimization method. Background technique [0002] Geographical hashing, also known as spatial coding, is to divide space into regions, and then construct regular coding maps through regions, and control the geographical zoom area level range through the length of coded hash characters. Geographical hashing mapping is also GIS spatial data storage management An important encoding method of , which is of great significance for improving the efficiency of computer space calculation; [0003] In the field of spatial big data distributed storage, how to improve the efficiency of mass throughput of spatial data has always been a difficult problem to solve through the grid division of geographic hashing areas. Contents of the invention [0004] The present invention provides a spatial distributed storage optimization met...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06F16/13G06F16/14G06F16/182
CPCG06F3/0613G06F3/067G06F16/137G06F16/152G06F16/182
Inventor 冯文涛朱与墨孙伟吴丹田鹏飞
Owner 亿景智联(苏州)科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap