Multi-dimensional query method of satellite remote sensing data on heterogeneous computing platform

A satellite remote sensing data and computing platform technology, applied in the field of remote sensing satellites, can solve the problems that restrict the real-time OLAP query processing performance of large data volume, long computing time, consumption, etc., to improve query processing performance, reduce hardware costs, and reduce demand. Effect

A satellite remote sensing data and computing platform technology, applied in the field of remote sensing satellites, can solve the problems that restrict the real-time OLAP query processing performance of large data volume, long computing time, consumption, etc., to improve query processing performance, reduce hardware costs, and reduce demand. Effect

CN112269797APending Publication Date: 2021-01-26NAT SATELLITE METEOROLOGICAL CENT

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-dimensional query method of satellite remote sensing data on heterogeneous computing platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. All other embodiments obtained by persons of ordinary skill in the art based on the embodiments of the present invention belong to the protection scope of the present invention.

[0030] Such as figure 1 As shown, a multi-dimensional query method for satellite remote sensing data on a heterogeneous computing platform according to an embodiment of the present invention includes:

[0031] S1: Distribute the remote sensing satellite multi-dimensional data set to the CPU-side database platform, GPU high-performance computing platform and distributed processing platform, configure the data set, divide the data set, and formulate the data set storage strategy;

[0032] Ste...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a multi-dimensional query method of satellite remote sensing data on a heterogeneous computing platform. The method comprises the following steps: carrying out data distribution on a remote sensing satellite multi-dimensional data set; optimizing a multi-dimensional index structure, standardizing original main keys, replacing the original main keys with continuous numericalvalue main keys, shielding semantic information of the main keys in the original dimensional data, updating foreign keys on an original fact table, and eliminating semantic information of multi-dimensional indexes of the fact data; carrying out distributed storage on the OLAP multi-dimensional data set oriented to the heterogeneous computing platform; discomposing an OLAP multi-dimensional data set query processing task for remote sensing data into three sub-tasks on three different computing platforms. By means of the method, the requirement for GPU memory capacity is reduced; the design issimple; the collaborative computing of the heterogeneous computing platform is realized, the hardware processing capability is fully utilized, the overall hardware cost is reduced, and the comprehensive OLAP query processing performance is improved.

Description

technical field [0001] The invention relates to the technical field of remote sensing satellites, in particular to a multi-dimensional query method for satellite remote sensing data on a heterogeneous computing platform. Background technique [0002] Satellite remote sensing data has multidimensional attributes, corresponding to remote sensing observation values ​​in multiple dimensions such as time, orbit number, payload, channel, and position, and constitutes a typical multidimensional data set. In the process of data processing and data service, it is necessary to complete multi-dimensional query for remote sensing datasets to obtain relevant data subsets. Satellite remote sensing data corresponds to a large-scale data cube. The OLAP query process requires a large amount of storage and computing resources, and consumes a long computing time. [0003] Traditionally, database operations rely on general-purpose CPUs to perform OLAP query processing tasks. The number of CPU ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
26 Jan 2021
Publication
CN112269797A
IPC
G06F16/242; G06F16/2453; G06F16/2455; G06F16/28
CPC
G06F16/2433; G06F16/2455; G06F16/2453; G06F16/283
Inventors
张宇; 张延松