Spatio-temporal data storage and indexing method based on HBase

A spatio-temporal data and indexing technology, applied in database indexing, structured data retrieval, geographic information database, etc., can solve the problems of large GeoHash string span, storage and retrieval performance, unfavorable storage, etc., to achieve efficient and fast retrieval, The effect of speeding up query speed and reducing performance

Pending Publication Date: 2020-05-08
GEOVIS CO LTD
View PDF8 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] 2. The GeoHash string after Base32 encoding has a large span
[0006] 3. The index is long, which is not conducive to storage
The spatial index

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Spatio-temporal data storage and indexing method based on HBase
  • Spatio-temporal data storage and indexing method based on HBase
  • Spatio-temporal data storage and indexing method based on HBase

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0048] The present invention is designed for the RowKey of HBase to meet the requirements of storage and indexing as fast as possible.

[0049] According to an embodiment of the present invention, a method for storing and indexing spatiotemporal data of HBase is provided.

[0050] Among them, spatio-temporal data refers to data with time and space information, in which time and space are key information, and may carry other relatively unimportant i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a spatio-temporal data storage and indexing method based on HBase, which comprises the following steps of: 1, designing a row key RowKey rule in an HBase, including definition and format of each byte of a RowKey; 2, extracting RowKey from the spatio-temporal data according to the RowKey rule designed in the step 1; 3, writing spatiotemporal data into the HBase according to the designed row key RowKey rule; and step 4, retrieving spatio-temporal data from the HBase according to the RowKey rule. According to the method, the retrieval and aggregation speeds are increased; the HBase is used as a database, GeoHash and time are ingeniously combined in RowKey, and a proper query method is used, so that the speed of space-time query is increased. The HBase is used as a database of spatio-temporal information, the advantages of high reliability, high performance and the like are achieved, horizontal capacity expansion can also be achieved when the clustering capacity is insufficient, scenes under mass data are facilitated, and the advantages of the HBase are brought into full play.

Description

technical field [0001] The invention relates to the field of data storage, in particular to an HBase-based spatio-temporal data storage and indexing method. Background technique [0002] Driven by the rapid development of the Internet, the development momentum of the Internet of Things is also very rapid, and as 5G technology gradually matures, the Internet of Things will also usher in a new wave of development. With the continuous expansion of the scale of the Internet of Things, the resulting data volume is also increasing In rapid growth, spatio-temporal data is an important part of it. [0003] For the traditional spatio-temporal data storage and retrieval scheme, it takes a lot of time to match the longitude, latitude and time fields, and it can be used when the amount of data is small, but it is already powerless to deal with a large amount of spatio-temporal data. IoT devices with high security requirements and IoT systems with real-time spatio-temporal data are undo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/22G06F16/27G06F16/29
CPCG06F16/2255G06F16/221G06F16/27G06F16/29
Inventor 赵普阳杨光辉曹梓琦王焰辉
Owner GEOVIS CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap