A spark-based high-performance computing method for mass secondary and tertiary adjustment data results flow

A high-performance computing and data technology, applied in the field of geographic information systems, can solve the problems of not being able to see the underlying data calculation logic, limited policy influence, and authority control, so as to ensure high efficiency and accuracy, and have a large space for independent development , low cost effect

Active Publication Date: 2022-02-01
HANGZHOU ZHONGFANG INFORMATION TECH +1
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, most land flow analysis models on the market are built based on ArcGIS applications. However, as ArcGIS is a commercial software, users are limited by the policy influence and authority control of the development company, and at the same time cannot see the underlying implementation data. calculation logic

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A spark-based high-performance computing method for mass secondary and tertiary adjustment data results flow
  • A spark-based high-performance computing method for mass secondary and tertiary adjustment data results flow
  • A spark-based high-performance computing method for mass secondary and tertiary adjustment data results flow

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0103] In this embodiment, the open source-based POSTGRESQL database implements distributed storage of two-wire and trimmed data, and spatial data processing based on Java GIS toolkit geotools, distributed computing engine Spark to ensure the efficiency and accuracy of massive vector data calculations. sex.

[0104] First, data description

[0105] Two-tone data: MDB format file; including three layers of points, lines, faces, representing sporadic objects, linear objects, and geosciences, each layers are made of their respective identification codes The only determined.

[0106] Three-dimensional data: SHP format file; consist of only one surface layer layer.

[0107] The layers are classified as follows:

[0108] Class category: a single type of plot, and a single type of plot divided by the administrative area, urban villages and other investigations or land ownership lines.

[0109] Sporadic object: means that in the survey of land use, it is too small in accordance with the s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a Spark-based high-performance calculation method for massive secondary and tertiary adjustment data result flow, and belongs to the field of geographic information systems. The method steps of the present invention include: S1, intersecting the second-adjustment map spot and the third-adjustment map spot; S2, processing the second-adjustment sporadic feature; S3, processing the second-adjustment linear feature; S4. Carry out the flow analysis of the data results of the second adjustment and the third adjustment. The present invention adopts a completely open-source technology stack, realizes the distributed storage of the second and third adjustment data based on the Postgresql database, performs spatial data processing based on the Java GIS toolkit GeoTools, and ensures the efficient calculation of massive vector data based on the distributed computing engine Spark. sex and accuracy.

Description

Technical field [0001] The present invention belongs to the field of geographic information systems, and specifically, the present invention relates to a high performance calculation method based on spark-based massive secondary adjustment data. Background technique [0002] The land is the need to produce, the foundation of survival, the source of ecology, and the natural foundation. The land survey is an important system of my country's legal agreement, which is an important means of comprehensively identifying land resources. The third analysis of the third homeland survey data is to accurately grasp the overall trend of national land use changes. Information management and sharing, meet space planning, supply-side structural reform, land space use control, etc. provide important data support. [0003] At present, most of the city traffic analysis models are based on ArcGIS applications, but ArcGIS is a commercial software, and the user is limited by the development company's ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06T11/20G06T11/60G06F16/27G06F16/29
CPCG06T11/206G06T11/60G06F16/27G06F16/29
Inventor 姚勇徐志红宋林刚王善华蒋晓敏方涯盼钟朝阳李翔
Owner HANGZHOU ZHONGFANG INFORMATION TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap