Check patentability & draft patents in minutes with Patsnap Eureka AI!

Distribution method of spatial data

A technology of spatial data and distribution methods, applied in the field of Internet information, to achieve the effect of improving efficiency and balancing load

Active Publication Date: 2019-05-10
MIGU CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In order to solve the existing technical problems, the embodiment of the present invention mainly provides a method and device for spatial data distribution, which can solve the problem of query hotspots caused by the storage of adjacent spatial data together

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distribution method of spatial data
  • Distribution method of spatial data
  • Distribution method of spatial data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] In the Hadoop environment, spatial data storage technology can be roughly divided into three steps:

[0055] First, the spatial data is divided by tree index structure, and the spatial area where the spatial data is generated is divided into multiple sub-space areas. Then the index structure is transformed in parallel, that is, the data nodes in the tree index structure are set, and then the spatial data in the data nodes are stored in the Hadoop cluster according to the storage mechanism of HDFS. When querying spatiotemporal data, locate the leaf nodes of the tree according to the tree index structure, and then Hadoop will store the corresponding leaf nodes on the storage device, resulting in internal access hotspots on the leaf nodes.

[0056] The embodiment of the present invention provides a kind of Hadoop data index structure, can be as figure 1 As shown, when parallelizing the index structure, the data is stored on each machine in the cluster according to Hadoop'...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention discloses a spatial data distribution method. The method comprises: determining a data block associated with a leaf node where the spatial data is located according to a spatialregion that generates spatial data, wherein the spatial data in the data block is generated in the same spatial region; according to an index parameter of the leaf node and the number of computing nodes corresponding to the leaf nodes, determining a node identifier of a computing node that stores the spatial data in the data block; and according to the node identifier, storing the spatial data inthe data block into the determined computing node, so that the spatial data in the different data blocks generated in the same spatial region is stored in the different computing nodes. The present invention also discloses a spatial data distribution apparatus.

Description

technical field [0001] The invention relates to Hadoop technology in the field of Internet information, in particular to a method and device for distributing spatial data. Background technique [0002] Hadoop is a framework capable of distributed processing of large amounts of data, and is an efficient tool for big data processing. With the development of the mobile Internet, more and more data contain spatial location information, thus becoming spatial data. Hadoop has also become a mainstream tool for processing massive spatial data. Massive data will be stored with the help of the distributed file system (Hadoop Distributed File System, HDFS) in Hadoop. [0003] Utilizing Hadoop's distributed computing capability, indexes can be queried in parallel, and data is distributed and stored according to HDFS's own strategy. However, when using Hadoop for data query, it is easy to generate query hotspots, thereby reducing the efficiency of query. In addition, it will also trig...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/22G06F16/245
Inventor 李宗祥
Owner MIGU CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com