Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Mass remote sensing image data distributed storage method and system suitable for quick browsing

A distributed storage and remote sensing image technology, applied in the field of data management, can solve the problems of increased cost of upgrading the system, limited number of hardware equipment deployment, unsuitable for single relational database management, etc., to solve hardware limitations and break through fast reading and browsing , to ensure the effect of scalability

Pending Publication Date: 2022-06-24
CHINA ELECTRONIC TECH GRP CORP NO 38 RES INST
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This puts forward higher requirements for storage medium capacity and data retrieval speed. The current hard disk storage method can no longer meet the needs of users, and it is also not suitable for the management of a single relational database.
[0003] However, the traditional SAN (Storage Arew Network) or NAS (Network Attached Storage) storage technology has bottlenecks in storage capacity and scalability, and there are also certain restrictions on the number of hardware devices deployed, which makes the cost of upgrading the system for users greatly increase

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mass remote sensing image data distributed storage method and system suitable for quick browsing
  • Mass remote sensing image data distributed storage method and system suitable for quick browsing
  • Mass remote sensing image data distributed storage method and system suitable for quick browsing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] like figure 1 , 4 As shown, a distributed storage method for massive remote sensing image data suitable for quick browsing, the method includes the steps in the following sequence:

[0042] (1) Remote sensing image data storage: receive the original remote sensing image data and parameter files to be stored;

[0043] (2) Metadata extraction: extract the metadata information of the original remote sensing image data;

[0044] (3) Metadata extraction result storage: The metadata information extraction results of the original remote sensing image data are stored in the non-relational database MongoDB; MongoDB is an open source non-relational database, which has faster reading than other databases. search ability.

[0045] (4) Storage of original remote sensing image data: Store the original remote sensing image data and parameter files in the Hadoop distributed file system HDFS; HDFS is suitable for storing very large data that is written once and read many times.

[0...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a mass remote sensing image data distributed storage method suitable for quick browsing. The method comprises the following steps: storing remote sensing image data into a database; metadata extraction: extracting metadata information of the original remote sensing image data; storing a metadata extraction result; storing original remote sensing image data; layering and blocking the data: carrying out layering processing on the original remote sensing image data, carrying out blocking processing on the layered image, and obtaining the layered and blocked data; and layered and partitioned data storage. The invention further discloses a mass remote sensing image data distributed storage system suitable for quick browsing. A management mode of combining a distributed file system and a database management mode is adopted, so that the normalization of data management is ensured, the expandability of the capacity during mass data storage is also ensured, and the limitation of hardware is solved; according to the method, time-consuming waiting of large-data-volume real-time sampling is avoided, and the problems of storage and quick reading and browsing of massive remote sensing image data are solved.

Description

technical field [0001] The invention relates to the technical field of data management, in particular to a distributed storage method and system for mass remote sensing image data suitable for quick browsing. Background technique [0002] Data storage technology is an important component and branch in the field of data processing. Data storage technology has gone through three stages: manual management, file management, and database management. At present, more and more remote sensing image data are generated in various projects, and a single file of remote sensing image data is relatively large, which can easily reach the scale of GB. This puts forward higher requirements for storage medium capacity and data retrieval speed. Currently, the hard disk storage method can no longer meet the needs of users, and is also not suitable for the management of a single relational database. [0003] However, the traditional SAN (Storage Arew Network) or NAS (Network Attached Storage) s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/182G06F16/16G06F16/54G06F16/58G06T5/20G06T7/11
CPCG06F16/182G06F16/164G06T5/20G06T7/11G06F16/54G06F16/58G06T2207/20016G06T2207/10032
Inventor 李玉景张玉营王蒙吴涛常沛张程高晶晶伍云辉盛佳佳袁秀迎童列树
Owner CHINA ELECTRONIC TECH GRP CORP NO 38 RES INST
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products