Supercharge Your Innovation With Domain-Expert AI Agents!

Grid-based spatial data distributed storage and retrieval method and system

A distributed storage and spatial data technology, applied in the field of storage and retrieval methods and systems, can solve the problems of frequent access of multiple physical storage nodes, lower access efficiency, etc., achieve rapid disaster recovery, reduce redundant communication, and avoid disk I/O /O bottleneck effect

Active Publication Date: 2017-12-01
吉奥时空信息技术股份有限公司
View PDF8 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When the application needs to access the data corresponding to this part of the space, it may cause frequent access to multiple physical storage nodes, thereby reducing access efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Grid-based spatial data distributed storage and retrieval method and system
  • Grid-based spatial data distributed storage and retrieval method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0046] The core idea of ​​the present invention is to disperse and store the spatial data in the memory of each node of the cluster, and construct a cross-node spatial index, avoiding the data storage method based on disk I / O and data block-based and unrelated to the location relationship of spatial data. How the data is distributed.

[0047] 1. Data storage method: Data is stored in each memory of each node in the form of data blocks, and each data block contains ID, GeoHash value, spatial data content (WKT / WKB / GeoJSON, etc.) and timestamp. Multiple data blocks can be stored on each node.

[0048] 2. Data indexing and retrieval: Data indexing is implemented in the form of grid + GeoHash. The spatial coordinates to be retrieved first calculate the GeoHash value through the retrieval function and judge the grid number of the grid to which it belongs, and query the metadata table to know the node number where it is located, and then perform the process in the storage cluster ac...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a storage and retrieval method and system, belongs to the field of spatial data processing and particularly relates to a grid-based spatial data distributed storage and retrieval method and system. The method comprises the steps of segmenting data, to be specific, dividing data into data blocks in grid form, and storing the data blocks in a node memory, wherein each data block includes data block ID (identifier), Hash value, and timestamp; querying data, to be specific, calculating corresponding Hash values to coordinates of a space to be retrieved, judging grid number of a grid that the Hash values belong to, querying a metadata table according to the grid number to obtain a node number, and retrieving in a storage cluster according to the node number, the grid number and the Hash values. Novel data storage, structure and index modes are provided herein, and geographic information retrieval information in distributed cluster environment can be effectively improved.

Description

technical field [0001] The invention relates to a storage and retrieval method and system, belonging to the field of spatial data processing, in particular to a grid-based distributed storage and retrieval method and system for spatial data. Background technique [0002] With the development of surveying and mapping remote sensing technology, spatial data not only increases in data scale, but also in data accuracy, and the real-time performance of data has also been greatly improved. Especially in recent years, driven by the demand for spatial data-related applications centered on LBS / SNS in the Internet / mobile Internet industry, distributed storage and computing technologies for spatial big data have been widely used. Spatial big data has the characteristics of large data volume, strong data correlation, and difficult decoupling between data blocks. These characteristics put forward special requirements for its storage, indexing and retrieval. [0003] Existing spatial dat...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 窦明罡付智能廖磊贺楷锴杨曦官磊
Owner 吉奥时空信息技术股份有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More