Spark-based high-performance calculation method for result flow of massive second-third dispatch data

A high-performance computing and data technology, applied in the field of geographic information systems, can solve the problems of limited policy influence and authority control, and cannot see the logic of underlying data computing, and achieve the effect of improving algorithm efficiency

Active Publication Date: 2021-03-26
HANGZHOU ZHONGFANG INFORMATION TECH +1
View PDF3 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, most land flow analysis models on the market are built based on ArcGIS applications. However, as ArcGIS is a commercial software, users are limited by the policy influence and authority control of the development company, and at the same time cannot see the underlying implementation data. calculation logic

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Spark-based high-performance calculation method for result flow of massive second-third dispatch data
  • Spark-based high-performance calculation method for result flow of massive second-third dispatch data
  • Spark-based high-performance calculation method for result flow of massive second-third dispatch data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0103] In this embodiment, based on the open source Postgresql database, the distributed storage of the second and third adjustment data is realized, the spatial data processing is performed based on the Java GIS toolkit GeoTools, and the distributed calculation engine Spark is used to ensure the efficiency and accuracy of massive vector data calculations sex.

[0104] 1. Data description

[0105] Second tone data: mdb format file; contains three layers of point, line, and surface, representing sporadic ground objects, linear ground objects and land-type map spots respectively, and the elements of each layer have their own identification codes Only sure.

[0106] Three-tone data: shp format file; it consists of only one surface layer.

[0107] Layer classification is described as follows:

[0108] Land-type plots: plots of a single land type, and single-type plots divided by survey boundaries such as administrative regions, towns and villages, or land ownership bounda...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a Spark-based high-performance calculation method for result flow of massive second-third investigation data, and belongs to the field of geographic information systems. The method comprises the following steps: S1, carrying out intersection processing on a second-investigation land pattern spot and a third-investigation land pattern spot; S2, processing the second-investigation fragmentary ground object; S3, processing the second-investigation linear ground object; and S4, carrying out second-investigation and third-investigation data result flow analysis. According tothe method, a completely open source technology stack is adopted, distributed storage of second-investigation and third-investigation data is realized based on a Postgresql database, spatial data processing is performed based on a Java GIS toolkit GeoTools, and high efficiency and accuracy of massive vector data calculation are ensured based on a distributed calculation engine Spark.

Description

technical field [0001] The invention belongs to the field of geographic information systems, and in particular relates to a high-performance calculation method for massive secondary and tertiary adjustment data achievement flow based on Spark. Background technique [0002] Land is the key to production, the foundation of survival, the source of ecology, and the foundation of nature. Land survey is an important legal system in our country, and it is an important means to comprehensively check and ascertain land resources. The purpose of carrying out the flow analysis of the data results of the third national land survey is to accurately grasp the overall trend of land use changes in the country, to directly grasp the detailed and accurate national land use status and changes in land resources for the country, to further improve the land survey, monitoring and statistical systems, and to achieve results Information management and sharing can provide important data support for...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T11/20G06T11/60G06F16/27G06F16/29
CPCG06T11/206G06T11/60G06F16/27G06F16/29
Inventor 姚勇徐志红宋林刚王善华蒋晓敏方涯盼钟朝阳李翔
Owner HANGZHOU ZHONGFANG INFORMATION TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap