Unlock instant, AI-driven research and patent intelligence for your innovation.

Distributed space object organization method for space-time big data calculation

A technology of spatial objects and big data, applied in the field of geographic information systems, to achieve good interoperability

Active Publication Date: 2021-03-12
WUHAN UNIV
View PDF7 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the magnitude of spatiotemporal big data has reached PB level or even EB level, which has brought enormous pressure to storage and processing.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed space object organization method for space-time big data calculation
  • Distributed space object organization method for space-time big data calculation
  • Distributed space object organization method for space-time big data calculation

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment approach

[0106] Combine below figure 1 , figure 2 Introduce the specific embodiment of the present invention, embodiment comprises the following steps:

[0107] Step 1, build an elastic distributed dataset model;

[0108] Step 1 describes building a spatially elastic distributed dataset as follows:

[0109] GeometryRDD = {SpatialGeometryPartition p},p∈{1,2,…,P}

[0110] SpatialGeometryPartition p ={np, Geometry np >},np∈{1,2,…,N p}

[0111] Among them, the spatially elastic distributed dataset consists of P spatiotemporal big data partitions, SpatialGeometryPartition p Indicates the pth spatiotemporal big data partition;

[0112] Each space-time big data partition is managed separately in the memory of different computer nodes in the SPARK distributed system, SpatialGeometryPartition p by N p two-tuple composition;

[0113] np , Geometry np > represents the p-th two-tuple;

[0114] Geometry np It is the basic spatial object in the p-th tuple, which can be any spatial po...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a distributed space object organization method for space-time big data calculation. According to the method, a spatial elastic distributed data set model and a spatial observation elastic distributed data set are constructed on the basis of an SPARK elastic distributed data set structure RDD, an open geographic space information alliance simple element spatial data model anda sensor network observation data model; and further the spatial elastic distributed data set is converted into a spatial point elastic distributed data set, a spatial line elastic distributed data set and a spatial plane elastic distributed data set so as to support distributed processing of spatial-temporal points, lines, planes and observation big data. According to the method, efficient organization and processing of massive spatial data can be supported, efficient organization and processing of sensor network observation data are compatible, and an advanced distributed processing architecture is applied to bring characteristics of high performance and high availability to organization and calculation of the spatial data.

Description

technical field [0001] The invention belongs to the field of geographic information systems, and relates to a distributed spatial object organization method oriented to space-time big data calculation. Background technique [0002] In recent years, with the rapid development of urban informatization, sensor networks, mobile Internet, global positioning systems and other technologies have been widely used, the spatial resolution and temporal resolution of data have been significantly improved, and the data with time and space dimensions are exponentially Explosive growth. At present, the magnitude of spatiotemporal big data has reached PB level or even EB level, which has brought enormous pressure to storage and processing. With the failure of Moore's Law, computing technology has begun to develop in the direction of multi-core multi-CPU, general-purpose GPU computing, cluster environment, and distributed processing architecture. The distributed organization and management o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/29G06F16/27G06F16/21G06F16/25
CPCG06F16/29G06F16/27G06F16/212G06F16/258Y02A90/10
Inventor 乐鹏上官博屹龚健雅姜良存张明达胡磊
Owner WUHAN UNIV