Supercharge Your Innovation With Domain-Expert AI Agents!

A storage method and reading method of massive tile data

A data storage and data technology, applied in the field of data processing, can solve the problems of large storage space, difficulty in attribute data organization, long response time for mass data transfer, etc., achieve high-speed migration, reduce storage and reading time, and improve Effect of I/O Processing Efficiency

Inactive Publication Date: 2016-09-07
SATELLITE SURVEYING & MAPPING APPL CENTSASMAC NAT ADMINISTATION OF SURVEYING MAPPING & GEOINFORMATION OF CHINANASG
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This results in defects such as large data storage, difficult query and retrieval, long response time for massive data transfer, and difficult attribute data organization.
The management method of the spatial database adopts the pyramid data organization form, and stores massive satellite images and topographical data in large spatial databases such as SQLServer and Oracle, which makes the scientific data organization, data retrieval and transfer speed, etc. improved to a certain extent. , but due to the shortcomings of the above-mentioned large-scale spatial databases such as data redundancy, large storage space, and difficult data migration, it still cannot meet the requirements for massive data storage and reading.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A storage method and reading method of massive tile data
  • A storage method and reading method of massive tile data
  • A storage method and reading method of massive tile data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0033] see figure 1 , Embodiment 1 of the present invention provides a method for storing massive tile data (that is, a data modeling method), including the following steps:

[0034] Step S100, according to the attribute information of the tile data to be stored, obtain the hierarchical information of the tile data; generate the data blocks of the primary index file according to the hierarchical information of the tile data;

[0035] Step S200, further divide the data block of the first-level index file into data grids to obtain the position coordinates of each cell in the data block; generate the corresponding tile data according to the position coordinates and block information secondary index file;

[0036] Step S300, storing tile data in a preset file in a first-come, first-served manner;

[0037] Step S400: Store the corresponding generated primary index file and secondary index file each time the target tile data is stored and written.

[0038] Wherein, the preset fil...

Embodiment 2

[0067] see Figure 5 , Embodiment 2 of the present invention also provides a method for reading massive tile data, including the following steps:

[0068] Step S600, receiving the reading request information of the target tile data;

[0069] Step S700, according to the read request information of the target tile data, determine the primary index value of the primary index file corresponding to the target tile data; find the data block to which the target tile data belongs according to the primary index file storage location;

[0070] Step S800, determine the secondary index value of the secondary index file according to the primary index value; determine the initial storage location and data length of the target tile data in the preset file according to the secondary index value of the secondary index file;

[0071] Step S900, performing a read operation on the target tile data according to the storage location of the target tile data.

[0072] In the second implementation ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a storage method and a reading method for mass tile data. The storage method comprises the following steps: generating a data block of a primary index file according to hierarchy information of acquired tile data; further partitioning the data block of the primary index file into data grids to obtain the position coordinate of each unit grid in the data block; generating a secondary index file which corresponds to the tile data according to the position coordinate and blocking information; storing the tile data according to a first-in-first-storage way; storing the primary index file and the secondary index file which are generated correspondingly every time target tile data are stored and written in. According to the storage method and the reading method for mass tile data provided by the invention, a hierarchy and blocking access strategy is adopted, so that the storage position of tile data can be described accurately, scientific organization of data structures and data storage space are guaranteed, storage, reading and writing of super large volume of data are supported, the I / O (Input / Output) processing efficiency of data files is increased, and the data retrieval time is reduced greatly.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a method for storing and reading massive tile data. Background technique [0002] Digital Earth is a proposal related to geographic information system ( Geographic Information System, GIS), network, virtual reality and other high-tech closely related concepts. The technical problems to be solved by Digital Earth include computer science, massive data storage, satellite remote sensing technology, broadband network, interoperability, metadata, etc. The proposal of digital earth has led to mass data becoming a commonly used term widely accepted by the GIS community. With the research of digital earth, the expansion of geographic information system application fields, the dynamics of research on various issues, and the increase of the scale of digital map data, the amount of spatial data continues to increase, and the amount of data that people need to process is also incre...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
Inventor 雷兵甘宇航胡轶之徐畅张晓田林刘克
Owner SATELLITE SURVEYING & MAPPING APPL CENTSASMAC NAT ADMINISTATION OF SURVEYING MAPPING & GEOINFORMATION OF CHINANASG
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More