Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Satellite data distributed processing system and method based on big data storage platform

A big data storage and distributed processing technology, applied in the field of satellite data processing, can solve problems such as affecting real-time partial data processing, exceeding optimization limits, affecting index calculation, etc., achieving good scalability and flexibility, convenient implementation, and low cost Effect

Active Publication Date: 2022-04-29
NAT TIME SERVICE CENT CHINESE ACAD OF SCI
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, with the geometric growth of satellite data, ever-rich algorithms and ever-complex logic, its calculation and processing time is constantly increasing, and the resources to be consumed are constantly increasing , seriously exceeded the optimization limit of the software and data processing computer, which affected the overall indicator calculation, especially the data processing of the real-time part

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Satellite data distributed processing system and method based on big data storage platform
  • Satellite data distributed processing system and method based on big data storage platform
  • Satellite data distributed processing system and method based on big data storage platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0044] See figure 1 , figure 1It is a schematic structural diagram of a satellite data distributed processing system based on a big data platform provided by an embodiment of the present invention. The satellite data distributed processing system includes a big data storage platform 1 , multiple non-real-time data processing application modules 2 , multiple real-time data processing application modules 3 and a monitoring module 4 .

[0045] The big data storage platform 1 is used to receive and store various raw data for satellite data processing. In this embodiment, the big data storage platform 1 is connected to each observation station through a communication module (such as a dedicated line network or the Internet), and is used to receive and store the original observation data from each observation station. The big data storage platform 1 can simultaneously receive Data from different observation stations are saved as data files, and different data files will not confli...

Embodiment 2

[0067] On the basis of the above embodiments, this embodiment provides a method for distributed processing of satellite data based on a big data storage platform. Such as Figure 6 As shown, the satellite data distributed processing method includes:

[0068] S1: Use the big data storage platform to receive and store all kinds of raw data from various observation stations for satellite data processing.

[0069] Specifically, the big data storage platform is connected to each observation station, and can receive and store raw observation data from each observation station, and the big data storage platform can simultaneously receive data from different observation stations and save them as data files. Different data files No conflicts will occur.

[0070] S2: According to the non-real-time indicators to be calculated and the set calculation time interval, use different data processing computers to receive the corresponding raw data from the big data storage platform and use th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a satellite data distributed processing system and method based on a big data storage platform, and the system comprises the big data storage platform, a plurality of non-real-time data processing application modules, a plurality of real-time data processing application modules, and a monitoring module. The big data storage platform is used for receiving and storing various types of original data for satellite data processing from each observation station; each non-real-time data processing application module is at least integrated with one piece of satellite index non-real-time algorithm software, and the plurality of non-real-time data processing application modules are respectively arranged on a plurality of computers; each real-time data processing application module is at least integrated with one piece of satellite index real-time algorithm software, and the plurality of real-time data processing application modules are respectively arranged on a plurality of computers; the monitoring module is connected to each computer. Based on the big data storage platform, data processing calculation is carried out in a distributed mode, and the performance requirements for computers and application software are lowered.

Description

technical field [0001] The invention belongs to the technical field of satellite data processing, and in particular relates to a satellite data distributed processing system and method based on a big data storage platform. Background technique [0002] As the application of satellites becomes more and more extensive, the data is more and more, the data processing is more and more complex, and the amount of calculation is also increasing, which puts forward higher and higher requirements for the performance of data processing software and software operating platform . The original processing method is to concentrate all the algorithms involved in one application according to the processing target (project / assessment type), and perform overall processing on a data processing computer; when computing performance problems occur, it is often used to improve data processing Computer performance and optimized software programming skills are used as processing means. [0003] Howe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/2458G06F16/27
CPCG06F16/2471G06F16/27
Inventor 成芳沈朋礼肖厦卢晓春李艳红刘东亮李晓婉
Owner NAT TIME SERVICE CENT CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com