Spatial data storage processing middleware framework realization method based on big data technology

A big data technology and spatial data technology, applied in the field of spatial data storage and processing middleware framework implementation based on big data technology, can solve the problem of spending too much time and money, reduce I/O overhead, and improve distributed storage. Efficiency and storage space saving effect

Active Publication Date: 2017-05-24
武汉中地数码科技有限公司 +1
View PDF6 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Big data (Bigdata) is generally used to describe the large amount of unstructured and semi-structured data created by a company, which takes too much time and money to download to a relational database for analysis

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Spatial data storage processing middleware framework realization method based on big data technology
  • Spatial data storage processing middleware framework realization method based on big data technology
  • Spatial data storage processing middleware framework realization method based on big data technology

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] Attached below Figure 1-Figure 6 The present invention will be further described with reference to specific examples, so that those skilled in the art can better understand the present invention and implement it, but the given examples are not intended to limit the present invention.

[0056] The present invention provides a method for storing and processing spatial data based on big data technology, comprising the following steps:

[0057] Step A) For the multi-source heterogeneous spatial data and system data with a large amount of data, use the ETL tool data extraction conversion tool to extract these data and convert them into data in a common format;

[0058] Step B) Store these data virtualized in the spatial big data distributed storage framework for unified management.

[0059] Furthermore, multi-source heterogeneous data sources include local file systems, relational databases, data import and export between spatial data management platforms and big data syst...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a spatial data storage processing middleware framework realization method based on a big data technology. The method enables a user to quickly acquire blended data content of existing multi-source heterogeneous structured data and unstructured data, and a mainstream big data storage tool is adopted to improve distributed storage efficiency. The spatial data storage processing middleware framework realization method based on the big data technology comprises a data extraction and conversion step and a data distributed storage step; multi-source heterogeneous spatial data is extracted, converted and loaded to construct a diversified fragmented unstructured data distributed virtual storage framework, and the data content capable of being read directly is provided for subsequent spatial big data analysis and mining.

Description

technical field [0001] The present invention relates to a method for implementing a middleware framework for spatial data storage and processing based on big data technology. The method can provide users with a method for quickly performing data content mixed with existing multi-source heterogeneous structured data and unstructured data. Acquisition methods, and use mainstream big data access tools to improve distributed storage efficiency. Background technique [0002] Spatial data refers to the data used to represent the position, shape, size and distribution characteristics of spatial entities. It can be used to describe objects from the real world. It has characteristics such as positioning, qualitative, temporal and spatial relationships. Spatial data is a kind of data that uses basic spatial data structures such as points, lines, surfaces, and entities to represent the natural world on which people live. [0003] Big data refers to the collection of data captured, man...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/254
Inventor 吴信才万波吴亮周顺平胡茂胜杨林陈波
Owner 武汉中地数码科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap