GNSS-R satellite constellation remote sensing data processing method and device based on multi-thread technology
Through multi-threading technology, the GNSS-R satellite constellation data processing process is refined, and the problem of low data processing efficiency of multi-GNSS systems in the existing technology is solved, and efficient and flexible data processing capabilities are achieved to adapt to changes in new and old satellites.
Patent Information
- Application Number
- CN202411046686.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-31
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2044-07-31
AI Technical Summary
The existing single-star GNSS-R data processing mode of single-GNSS system cannot effectively coordinate and optimize computing resources when facing large-scale networking data of multi-GNSS systems, resulting in low processing efficiency and difficult to meet the timeliness of high-precision services. It is required that, especially when data scale changes caused by new satellite network access and old satellite retirement, processing capabilities are difficult to respond flexibly.
Using multi-threading technology, the data processing process is refined into four stages. Each stage has a corresponding multi-threading strategy. The number of multi-threads required for each stage is adjusted by configuring parameter files, and the computer threads are dispatched to sort and remove the original data. Heavy, subcontract and unpack, calibration, track product inversion and grid-based fusion processing to generate target data files.
It improves the timeliness and overall efficiency of data processing, realizes flexible configuration and optimization of processing capabilities, can easily deal with changes in data scale and meets data processing needs in different application scenarios.
Smart Images

Figure CN119010989A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of GNSS reflection signal remote sensing technology, and in particular to a GNSS-R satellite constellation remote sensing data processing method based on multi-threading technology, a GNSS-R satellite constellation remote sensing data processing device based on multi-threading technology, an electronic device and a computer-readable storage medium. Background Art
[0002] GNSS-R technology, namely the global satellite navigation system reflection signal technology, has emerged since the 1990s and has become an important tool for detecting multiple physical parameters such as sea surface, land surface, and ice surface. This technology uses existing GNSS signal sources for detection, without the need for additional transmitters. The receiver is light in weight, low in power consumption, and low in cost. It is very suitable for building a constellation network detection system through the last-stage cluster of orbiters and micro-nano satellite platforms. In addition, the signal sources of GNSS-R technology are rich and free, including my country's Beidou system, the United States' GPS (Global Positioning System) system, Europe's Galileo system, Russia's GLONASS (GLOBAL NAVIGATION SATELLITE SYSTEM) system, Japan's QZSS (Quasi-Zenith Satellite System) and India's IRNSS (Indian Regional Navigation Satellite System), etc., with a total of more than 150 navigation satellites that can be used as signal transmission sources. Therefore, GNSS-R technology provides a new system for earth observation with high temporal and spatial resolution.
[0003] In recent years, with the gradual maturity of GNSS-R receiver technology and product inversion algorithms, a large-scale GNSS-R networking constellation compatible with multiple GNSS systems based on micro-nano satellite platforms has been formed, and related technologies of GNSS-R detection networks based on the last-stage clusters in orbit are developing rapidly.
[0004] With the rapid development of large-scale satellite constellations of multi-GNSS systems, the amount of data generated has also increased dramatically. The existing single-GNSS system single-star GNSS-R data processing mode processes data from a single GNSS system single satellite. When faced with large-scale networking data across multiple GNSS systems, this mode lacks a system-level global vision and cannot effectively coordinate and optimize the use of computing resources. Therefore, it is incapable of processing efficiency and is difficult to meet the stringent requirements of high-precision services such as numerical weather forecasting on data processing timeliness. In order to overcome this limitation, it is necessary to explore more advanced data processing architectures and methods to improve processing efficiency and meet the high timeliness standards of the business. In particular, considering the entry of new satellites and the retirement of old satellites, the scale of the GNSS-R satellite constellation and the number of available GNSS satellite signal sources are being dynamically adjusted. Therefore, how to quickly and efficiently integrate and process these large-scale GNSS-R networking data compatible with multiple GNSS systems while adapting to the flexible changes in the scale of satellite constellation data has become a major challenge that needs to be solved urgently. Summary of the invention
[0005] In view of the above problems, embodiments of the present invention are proposed to provide a GNSS-R satellite constellation remote sensing data processing method based on multi-threading technology, a GNSS-R satellite constellation remote sensing data processing device based on multi-threading technology, an electronic device and a computer-readable storage medium that overcome the above problems or at least partially solve the above problems.
[0006] The embodiment of the present invention discloses a GNSS-R satellite constellation remote sensing data processing method based on multi-threading technology, the method comprising:
[0007] Get the raw data files of all satellites in the GNSS-R satellite constellation;
[0008] Determine a first number of threads to be scheduled based on the number of all satellites, and schedule the first number of computer threads to sort, deduplicate, and perform other processing on the original data files to obtain a first data file corresponding to each satellite;
[0009] Determine a second number of threads that need to be scheduled for each satellite based on the total number of available threads and the number of reflection channels of each satellite, and schedule the second number of computer threads for each satellite to perform subpackaging, unpacking, calibration, observation information calculation and other processing on the corresponding first data file to obtain a second data file corresponding to each satellite;
[0010] Scheduling the first number of computer threads to perform orbit product inversion processing on each second data file to obtain a third data file corresponding to each satellite;
[0011] The third number of threads to be scheduled for each satellite is determined based on the total number of available threads and the number of third data files, and the third number of computer threads is scheduled for each satellite to perform grid fusion processing on each third data file to obtain a target data file.
[0012] In one or more embodiments, the obtaining of raw data files of all satellites in the GNSS-R satellite constellation includes:
[0013] The original data files of all satellites in the satellite constellation within a target time period are obtained from each satellite ground station; each of the satellite ground stations includes the original data file of at least one satellite.
[0014] In one or more embodiments, the scheduling of the first number of computer threads to sort, remove duplicates, and other processes on the original data files to obtain a first data file corresponding to each satellite includes:
[0015] Allocating the second data files corresponding to the respective satellites to the first number of computer threads, so that the computer thread corresponding to each satellite sorts the original data files corresponding to each satellite according to the system week, the second of the week and the packet sequence number of the global navigation satellite system GNSS to obtain the sorted original data files corresponding to each satellite;
[0016] The computer thread corresponding to each satellite deduplicates the sorted original data file corresponding to each satellite to obtain a first data file corresponding to each satellite.
[0017] In one or more embodiments, the second number is determined by:
[0018] Among them, M 1 is the number of computer threads that need to be allocated for a single satellite, N is the total number of available threads, n c is the total number of reflection channels of all satellites, To round down, k c is the number of reflection channels of a single satellite.
[0019] The thread corresponding to each satellite performs processing such as subpackaging, unpacking, calibration, and observation information calculation on the sorted first data file corresponding to each satellite to obtain a second data file corresponding to each satellite. In one or more embodiments, the scheduling of the first number of computer threads to perform orbit product inversion processing on each second data file to obtain a third data file corresponding to each satellite includes:
[0020] Allocating the second data files corresponding to each satellite to the first number of computer threads, so that the computer thread corresponding to each satellite performs orbit product inversion on the second data file corresponding to each satellite to obtain an inversion result corresponding to each satellite;
[0021] The computer thread corresponding to each satellite classifies and groups the inversion results corresponding to each satellite according to the GNSS system type and then fuses them to obtain a third data file corresponding to each satellite.
[0022] In one or more embodiments, the third quantity is determined as follows:
[0023] Among them, M 2 is the number of threads that need to be allocated for a single satellite, N is the total number of available threads, n f is the total number of third data files, To round down, k f The number of the third data file for a single satellite.
[0024] In one or more embodiments, the step of scheduling the third number of computer threads for each satellite to perform grid fusion processing on each third data file to obtain a target data file includes:
[0025] scheduling the third number of computer threads for each satellite to read a third data file for each satellite;
[0026] Integrate the third data files of all satellites to obtain an integrated data file;
[0027] The integrated data files are subjected to grid fusion processing to obtain target data files.
[0028] Accordingly, an embodiment of the present invention discloses a GNSS-R satellite constellation remote sensing data processing device based on multi-threading technology, the device comprising:
[0029] The acquisition module is used to obtain the raw data files of all satellites in the GNSS-R satellite constellation;
[0030] A configuration module, configured to configure a first number of threads to be scheduled based on the number of all satellites;
[0031] A scheduling module, used for scheduling the first number of computer threads to process the original data files to obtain first data files corresponding to each satellite;
[0032] The configuration module is further used to configure a second number of threads that need to be scheduled for each satellite based on the total number of available threads and the number of reflection channels of each satellite;
[0033] The scheduling module is further used to schedule the second number of computer threads for each satellite to perform processing such as subpackaging and unpacking, calibration, and observation information calculation on the corresponding first data file to obtain a second data file corresponding to each satellite;
[0034] The scheduling module is further used to schedule the first number of computer threads to perform orbit product inversion processing on each second data file to obtain a third data file corresponding to each satellite;
[0035] The configuration module is further used to configure a third number of threads that need to be scheduled for each satellite based on the total number of available threads and the number of third data files;
[0036] The scheduling module is further used to schedule the third number of computer threads for each satellite to perform grid fusion processing on each third data file to obtain a target data file.
[0037] In one or more embodiments, the acquisition module is specifically used to:
[0038] The original data files of all satellites in the GNSS-R satellite constellation within a target time period are obtained from each satellite ground station; each of the satellite ground stations includes the original data file of at least one satellite.
[0039] In one or more embodiments, the scheduling module is specifically used to:
[0040] Allocating the second data files corresponding to the respective satellites to the first number of computer threads, so that the computer thread corresponding to each satellite sorts the original data files corresponding to each satellite according to the system week, the second of the week and the packet sequence number of the global navigation satellite system GNSS to obtain the sorted original data files corresponding to each satellite;
[0041] The computer thread corresponding to each satellite deduplicates the sorted original data file corresponding to each satellite to obtain a first data file corresponding to each satellite.
[0042] In one or more embodiments, the configuration module is specifically used to:
[0043] Among them, M 1 is the number of computer threads that need to be allocated for a single satellite, N is the total number of available threads, n c is the total number of reflection channels of all satellites, To round down, k c is the number of reflection channels of a single satellite.
[0044] The thread corresponding to each satellite performs processing such as subpackaging and unpacking, calibration, and observation information calculation on the sorted first data file corresponding to each satellite to obtain a second data file corresponding to each satellite.
[0045] In one or more embodiments, the scheduling module is further configured to:
[0046] Allocating the second data files corresponding to each satellite to the first number of computer threads, so that the computer thread corresponding to each satellite performs orbit product inversion on the second data file corresponding to each satellite to obtain an inversion result corresponding to each satellite;
[0047] The computer thread corresponding to each satellite classifies and groups the inversion results corresponding to each satellite according to the GNSS system type and then fuses them to obtain a third data file corresponding to each satellite.
[0048] In one or more embodiments, the configuration module is further configured to:
[0049] Among them, M 2 is the number of computer threads that need to be allocated for a single satellite, N is the total number of available threads, n f is the total number of third data files, To round down, k f The number of the third data file for a single satellite.
[0050] In one or more embodiments, the scheduling module is further configured to:
[0051] scheduling the third number of computer threads for each satellite to read a third data file for each satellite;
[0052] Integrate the third data files of all satellites to obtain an integrated data file;
[0053] The integrated data files are subjected to grid fusion processing to obtain target data files.
[0054] Correspondingly, an embodiment of the present invention discloses an electronic device, including: a processor, a memory, and a computer program stored in the memory and capable of running on the processor. When the computer program is executed by the processor, the various steps of the above-mentioned GNSS-R satellite constellation remote sensing data processing method embodiment based on multi-threading technology are implemented.
[0055] Correspondingly, an embodiment of the present invention discloses a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various steps of the above-mentioned GNSS-R satellite constellation remote sensing data processing method embodiment based on multi-threading technology are implemented.
[0056] The embodiments of the present invention include the following advantages:
[0057] The data processing system obtains the original data files of all satellites in the GNSS-R satellite constellation; determines the first number of threads that need to be scheduled based on the number of all satellites, and schedules the first number of computer threads to sort, deduplicate, and other processes on the original data files to obtain the first data files corresponding to each satellite; determines the second number of threads that need to be scheduled for each satellite based on the total number of available threads and the number of reflection channels of each satellite, and schedules the second number of computer threads for each satellite to perform subpackaging, unpacking, calibration, observation information calculation, and other processes on the corresponding first data files to obtain the second data files corresponding to each satellite; schedules the first number of computer threads to perform orbit product inversion processing on each second data file to obtain the third data file corresponding to each satellite; determines the third number of threads that need to be scheduled for each satellite based on the total number of available threads and the number of third data files, and schedules the third number of computer threads for each satellite to perform grid fusion processing on each third data file to obtain the target data file. Through the above method, the entire data processing process is refined into four stages, each stage has a corresponding multi-threaded processing strategy, and the number of multi-threads required for each stage is flexibly adjusted by configuring parameter files. This not only improves the timeliness of data processing and significantly improves the overall efficiency of data processing, but also enables flexible configuration and optimization of processing capabilities through parameter adjustment of configuration files, allowing the system to easily cope with changes in data processing scale caused by the addition of new satellites and the retirement of old satellites, thereby ensuring the flexibility and scalability of processing capabilities, thereby better meeting data processing needs in different application scenarios. BRIEF DESCRIPTION OF THE DRAWINGS
[0058] Figure 1 It is a flowchart of a method for processing GNSS-R satellite constellation remote sensing data based on multi-threading technology according to an embodiment of the present invention;
[0059] Figure 2 It is a structural block diagram of an embodiment of a GNSS-R satellite constellation remote sensing data processing device based on multi-threading technology of the present invention. DETAILED DESCRIPTION
[0060] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.
[0061] One of the core concepts of the embodiment of the present invention is to refine the entire data processing flow into four stages, each stage has a corresponding multi-threaded processing strategy, and flexibly adjust the number of multi-threads required for each stage by configuring parameter files. This not only improves the timeliness of data processing and greatly improves the overall efficiency of data processing, but also realizes flexible configuration and optimization of processing capabilities through parameter adjustment of configuration files, so that the system can easily cope with changes in data processing scale caused by the addition of new satellites and the retirement of old satellites, thereby ensuring the flexibility and scalability of processing capabilities, so as to better meet the data processing needs in different application scenarios.
[0062] Reference Figure 1 , shows a flowchart of the steps of a first embodiment of a GNSS-R satellite constellation remote sensing data processing method based on multi-threading technology of the present invention, which may specifically include the following steps:
[0063] Step 101: Obtain raw data files of all satellites in the GNSS-R satellite constellation.
[0064] The embodiment of the present invention can be applied in a data processing system, and the data processing system can obtain the raw data files of all satellites in the GNSS-R satellite constellation, wherein the file format of the raw data files can be a RAW format. Of course, the file format can be other formats besides the RAW format, and in practical applications, it can be set according to actual needs, and the embodiment of the present invention does not limit this.
[0065] In an embodiment of the present invention, the step of obtaining raw data files of all satellites in the GNSS-R satellite constellation includes:
[0066] The original data files of all satellites in the GNSS-R satellite constellation within a target time period are obtained from each satellite ground station; each of the satellite ground stations includes the original data file of at least one satellite.
[0067] Specifically, the data processing system can obtain the original data files of all satellites in the target time period from multiple satellite ground stations, where one original data file corresponds to one track of data. A satellite may have multiple tracks of data in the target time period, which corresponds to multiple original data files.
[0068] The target time period may be 1 hour, 1 day, 3 days, 1 week, 1 month, etc. In practical applications, the specific value of the target time period may be set according to actual needs, and the embodiment of the present invention does not limit this.
[0069] For example, the satellite constellation includes 10 satellites, the target time period is 1 day, and 1 satellite has 28 tracks of data in 1 day, that is, 28 original data files. Then, 280 original data files of 10 satellites can be obtained simultaneously through a satellite ground station, or 140 original data files of 10 satellites can be obtained through satellite ground station A, and 140 original data files of the remaining 10 satellites can be obtained through satellite ground station B. The original data files can also be obtained through other methods. In actual applications, they can be set according to actual needs, and the embodiments of the present invention do not limit this.
[0070] Step 102: determine a first number of threads to be scheduled based on the number of all satellites, and schedule the first number of computer threads to sort, deduplicate, and perform other processing on the original data files to obtain a first data file corresponding to each satellite.
[0071] After obtaining the original data files of all satellites, the number of threads that need to be scheduled can be determined according to the number of all satellites in the satellite constellation (referred to as the "first number" for easy distinction). For example, if the satellite constellation contains 10 satellites, then 10 threads need to be scheduled, that is, one thread for each satellite.
[0072] Then, a first number of threads are dispatched from the thread pool to process the original data files, thereby obtaining a data file corresponding to each satellite (referred to as a "first data file"). For example, thread 1 processes the original data file of satellite 1 to obtain the first data file of satellite 1, thread 2 processes the original data file of satellite 2 to obtain the first data file of satellite 2, and so on.
[0073] In an embodiment of the present invention, the scheduling of the first number of computer threads to sort, remove duplicates, and other processes on the original data files to obtain a first data file corresponding to each satellite includes:
[0074] Allocating the second data files corresponding to the respective satellites to the first number of computer threads, so that the computer thread corresponding to each satellite sorts the original data files corresponding to each satellite according to the system week, the second of the week and the packet sequence number of the global navigation satellite system GNSS to obtain the sorted original data files corresponding to each satellite;
[0075] The computer thread corresponding to each satellite deduplicates the sorted original data file corresponding to each satellite to obtain a first data file corresponding to each satellite.
[0076] Specifically, after determining the first number of threads, the original data files corresponding to each satellite can be allocated to each thread. Since the orbital data of a satellite exist in a time sequence, for the thread corresponding to any satellite, the thread can sort the original data files of the satellite according to the system week, second in week and packet number of GNSS to obtain the sorted original data file of the satellite, and then the thread deduplicates the sorted original data file to obtain the first data file corresponding to the satellite. And so on, the first data file corresponding to each satellite can be obtained. By sorting and deduplication, the orderliness of the data structure in the original data file, the accuracy and integrity of the data are ensured.
[0077] It should be noted that a plurality of available threads are pre-set in the thread pool, and when processing the original data file, available threads can be dispatched from the thread pool according to demand. The total number of available threads can be set according to actual demand, and the embodiment of the present invention does not limit this.
[0078] Furthermore, each time a thread is scheduled to process data, the scheduled thread can be released after the data processing is completed. For example, there are a total of 150 available threads in the thread pool, and 10 threads are scheduled when step 102 is executed. After step 102 is completed and each first data file is obtained, the 10 scheduled threads can be released. At this time, the total number of available threads is 150. The subsequent processing is also the same, which will not be described in detail later.
[0079] Furthermore, since step 102 focuses on integrating multiple raw data files of the same satellite, when processing data, one satellite corresponds to one thread to ensure that the data of each satellite can be processed efficiently and independently.
[0080] Step 103: Determine the second number of threads that need to be scheduled for each satellite based on the total number of available threads and the number of reflection channels of each satellite, and schedule the second number of computer threads for each satellite to perform processing such as packetization and unpacking, calibration, and observation information calculation on the corresponding first data file to obtain a second data file corresponding to each satellite.
[0081] Since each satellite includes multiple GNSS-R reflection channels, after obtaining the first data file corresponding to each satellite, the number of threads that need to be scheduled for each satellite (recorded as the "second number") can be determined based on the total number of available threads in the thread pool and the number of reflection channels of each satellite, and then the second number of threads are scheduled for each satellite to process the corresponding first data file, thereby obtaining the data file corresponding to each satellite (recorded as the "second data file"). For example, the satellite constellation includes 10 satellites, and it is determined that 15 threads need to be scheduled for each satellite, that is, satellite 1 corresponds to threads 1 to 15, satellite 2 corresponds to threads 16 to 30, and so on. Threads 1 to 15 process the first data file of satellite 1, threads 16 to 30 process the first data file of satellite 2, and so on.
[0082] The second quantity can be determined by the following formula:
[0083]
[0084] Among them, M 1 is the number of computer threads that need to be allocated for a single satellite, N is the total number of available threads, n c is the total number of reflection channels of all satellites, To round down, k c is the number of reflection channels of a single satellite.
[0085] Furthermore, since step 103 focuses on preprocessing and information extraction such as packet unpacking and calibration of the GNSS-R observation waveform, this stage takes a long time. Therefore, when processing data, one satellite can correspond to multiple threads, ensuring that data in different time periods of the same reflection channel can be processed efficiently and independently, thereby greatly improving data processing efficiency.
[0086] Step 104: Schedule the first number of computer threads to perform orbit product inversion processing on each second data file to obtain a third data file corresponding to each satellite.
[0087] After obtaining each second data file, the number of threads to be scheduled (referred to as the "third number") can be determined according to the number of all satellites in the satellite constellation. For example, if the satellite constellation includes 10 satellites, then 10 threads need to be scheduled, that is, one thread for each satellite.
[0088] Then, a first number of threads are dispatched from the thread pool to perform orbit product inversion processing on each second data file, thereby obtaining a data file corresponding to each satellite (recorded as a "third data file"). For example, thread 1 performs orbit product inversion processing on the second data file of satellite 1 to obtain the third data file of satellite 1, thread 2 performs orbit product inversion processing on the second data file of satellite 2 to obtain the third data file of satellite 2, and so on.
[0089] In the embodiment of the present invention, the scheduling of the first number of computer threads to perform orbit product inversion processing on each second data file to obtain a third data file corresponding to each satellite includes:
[0090] Allocating the second data files corresponding to each satellite to the first number of computer threads, so that the computer thread corresponding to each satellite performs inversion of geophysical parameters on the second data file corresponding to each satellite to obtain an inversion result corresponding to each satellite;
[0091] The computer thread corresponding to each satellite classifies and groups the inversion results corresponding to each satellite according to the GNSS system type and then fuses them to obtain a third data file corresponding to each satellite. The classification and grouping of the GNSS system type is based on the data of other satellites from the same GNSS system obtained by the same satellite.
[0092] Specifically, each thread can be assigned a second data file corresponding to each satellite. For any thread corresponding to a satellite, the thread can perform orbit product inversion on the second data file corresponding to the satellite, obtain the inversion result corresponding to the satellite, classify and group them according to the GNSS system type, and then merge them to obtain the third data file corresponding to each satellite. And so on, the third data file corresponding to each satellite can be obtained. Among them, the basis for classifying and grouping the GNSS system type is the data from other satellites of the same GNSS system type obtained by the same satellite. For example, satellite data of the same GNSS system type can be satellite data of DBS (Beidou Navigation Satellite System), satellite data of GPS, and satellite data of GAL (Galileo satellite navigation system).
[0093] Since step 104 does not involve time-consuming data processing, when performing data processing, one satellite corresponds to one thread to ensure that the data of each satellite can be processed efficiently and independently.
[0094] Step 105: determine the third number of threads that need to be scheduled for each satellite based on the total number of available threads and the number of third data files, and schedule the third number of computer threads for each satellite to perform grid fusion processing on each third data file to obtain a target data file.
[0095] As mentioned above, each satellite may have multiple original data files, and each original data file obtains a third data file after being processed through steps 102 to 104. Therefore, the number of third data files is the same as the number of original data files. Therefore, after obtaining the third data files corresponding to each satellite, the number of threads that need to be scheduled for each satellite (referred to as "third number") can be determined based on the total number of available threads in the thread pool and the number of third data files. Then, the third number of threads is scheduled for each satellite to process the corresponding third data file, thereby obtaining the final data file (referred to as "target data file").
[0096] The third quantity is determined by the following formula:
[0097]
[0098] Among them, M 2 is the number of threads that need to be allocated for a single satellite, N is the total number of available threads, n f is the total number of third data files, To round down, k f is the number of the third data file.
[0099] In the embodiment of the present invention, the step of scheduling the third number of computer threads for each satellite to perform grid fusion processing on each third data file to obtain a target data file includes:
[0100] scheduling the third number of computer threads for each satellite to read a third data file for each satellite;
[0101] Integrate the third data files of all satellites to obtain an integrated data file;
[0102] The integrated data files are subjected to grid fusion processing to obtain target data files.
[0103] Specifically, when processing each third data file, a large number of file readings may be involved, so each satellite may correspond to multiple threads, and multiple threads simultaneously read multiple third data files corresponding to the satellite to ensure the efficiency of data processing and the scalability of processing capabilities.
[0104] After the third data files corresponding to each satellite are read, the third data files can be integrated through a single thread to obtain an integrated data file, and then the integrated data file is subjected to grid fusion processing to obtain the final target data file.
[0105] For ease of understanding, the embodiments of the present invention are described below by way of example.
[0106] Assume that a GNSS-R satellite constellation contains 10 satellites, which are compatible with the three navigation systems of BDS, GPS, and GAL. Each satellite can simultaneously receive reflected signals from 12 different GNSS satellites, that is, each satellite has 12 reflection channels, the target time period is 1 day, and a single satellite has 28 raw data files within 1 day, and 150 threads are available in the data processing system.
[0107] The specific process is:
[0108] 1) The data processing system obtains 280 raw data files of 10 satellites from various satellite ground stations.
[0109] 2) Since there are 10 satellites in total, 10 threads need to be scheduled. 10 threads are scheduled from the thread pool, and each thread processes the original data file of the corresponding satellite to obtain the first data file corresponding to each satellite, and finally generates 280 GNSS-R first data files, and then releases all threads.
[0110] 3) Since each satellite has 12 reflection channels, the total number of reflection channels for all satellites is 120. Through calculation, it is determined that 15 threads need to be allocated to each satellite, and 150 threads are scheduled from the thread pool. Every 15 threads process the first data file of the corresponding satellite to obtain the second data file corresponding to each satellite, and finally generate 280 GNSS-R second data files, and then release all threads.
[0111] 4) Since there are 10 satellites in total, 10 threads need to be scheduled. 10 threads are scheduled from the thread pool, and each thread inverts the geophysical parameters of the corresponding satellite's second data file, and then fuses the inversion results with the satellite data from the same GNSS system (BDS, GPS, GAL) received by the same satellite, and finally generates 280 GNSS-R third data files, and then releases all threads.
[0112] 5) It is determined through calculation that 15 threads need to be allocated to each satellite, and 150 threads are scheduled from the thread pool. Every 15 threads read the third data file of the corresponding satellite. After the reading is completed, each third data file is aggregated and gridded by a single thread to obtain the final target data file, and then all threads are released.
[0113] In an embodiment of the present invention, a data processing system obtains the original data files of all satellites in the GNSS-R satellite constellation; determines the first number of threads that need to be scheduled based on the number of all satellites, and schedules the first number of computer threads to sort, deduplicate, and perform other processing on the original data files to obtain the first data files corresponding to each satellite; determines the second number of threads that need to be scheduled for each satellite based on the total number of available threads and the number of reflection channels of each satellite, and schedules the second number of computer threads for each satellite to perform subpackaging, unpacking, calibration, observation information calculation, and other processing on the corresponding first data files to obtain the second data files corresponding to each satellite; schedules the first number of computer threads to process each second data file to obtain the third data file corresponding to each satellite; determines the third number of threads that need to be scheduled for each satellite based on the total number of available threads and the number of third data files, and schedules the third number of computer threads for each satellite to perform grid fusion processing on each third data file to obtain the target data file. In the above manner, the entire data processing flow is refined into four stages, each stage has a corresponding multi-threaded processing strategy, and the number of multi-threads required for each stage is flexibly adjusted by configuring parameter files. This not only improves the timeliness of data processing and significantly improves the overall efficiency of data processing, but also enables flexible configuration and optimization of processing capabilities through parameter adjustment of configuration files, allowing the system to easily cope with changes in data processing scale caused by the addition of new satellites and the retirement of old satellites, thereby ensuring the flexibility and scalability of processing capabilities, thereby better meeting data processing needs in different application scenarios.
[0114] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.
[0115] Reference Figure 2 , shows a structural block diagram of an embodiment of a GNSS-R remote sensing data processing device based on computer multi-threading technology of the present invention, which may specifically include the following modules:
[0116] An acquisition module 201 is used to acquire raw data files of all satellites in the GNSS-R satellite constellation;
[0117] A configuration module 202, configured to configure a first number of threads to be scheduled based on the number of all satellites;
[0118] The scheduling module 203 is used to schedule the first number of computer threads to process the original data files to obtain first data files corresponding to each satellite;
[0119] The configuration module 202 is further used to configure a second number of threads that need to be scheduled for each satellite based on the total number of available threads and the number of reflection channels of each satellite;
[0120] The scheduling module 203 is further used to schedule the second number of computer threads for each satellite to perform processing such as subpackaging and unpacking, calibration, and observation information calculation on the corresponding first data file to obtain a second data file corresponding to each satellite;
[0121] The scheduling module 203 is further used to schedule the first number of computer threads to perform orbit product inversion processing on each second data file to obtain a third data file corresponding to each satellite;
[0122] The configuration module 202 is further configured to configure a third number of threads that need to be scheduled for each satellite based on the total number of available threads and the number of third data files;
[0123] The scheduling module 203 is further used to schedule the third number of computer threads for each satellite to perform grid fusion processing on each third data file to obtain a target data file.
[0124] In the embodiment of the present invention, the acquisition module is specifically used to:
[0125] The original data files of all satellites in the GNSS-R satellite constellation within a target time period are obtained from each satellite ground station; each of the satellite ground stations includes the original data file of at least one satellite.
[0126] In the embodiment of the present invention, the scheduling module is specifically used to:
[0127] Allocating the second data files corresponding to the respective satellites to the first number of computer threads, so that the computer thread corresponding to each satellite sorts the original data files corresponding to each satellite according to the system week, the second of the week and the packet sequence number of the global navigation satellite system GNSS to obtain the sorted original data files corresponding to each satellite;
[0128] The computer thread corresponding to each satellite deduplicates the sorted original data file corresponding to each satellite to obtain a first data file corresponding to each satellite.
[0129] In the embodiment of the present invention, the configuration module is specifically used to:
[0130] Among them, M 1 is the number of threads that need to be allocated for a single satellite, N is the total number of available threads, n c is the total number of reflection channels of all satellites, To round down, k c is the number of reflection channels of a single satellite.
[0131] The thread corresponding to each satellite performs processing such as subpackaging, unpacking, calibration, and observation information calculation on the sorted first data file corresponding to each satellite to obtain a second data file corresponding to each satellite. In an embodiment of the present invention, the scheduling module is further used to:
[0132] Allocating the second data files corresponding to each satellite to the first number of computer threads, so that the computer thread corresponding to each satellite performs orbit product inversion on the second data file corresponding to each satellite to obtain an inversion result corresponding to each satellite;
[0133] The computer thread corresponding to each satellite classifies and groups the inversion results corresponding to each satellite according to the GNSS system type and then merges them to obtain a third data file corresponding to each satellite; wherein the classification and grouping by GNSS system type is based on the data from other satellites of the same GNSS system type obtained by the same satellite based on other satellite data.
[0134] In the embodiment of the present invention, the configuration module is further used to:
[0135] Among them, M 2 is the number of computer threads that need to be allocated for a single satellite, N is the total number of available threads, n f is the number of the third data file, To round down, k f The number of the third data file for a single satellite.
[0136] In the embodiment of the present invention, the scheduling module is further used for:
[0137] scheduling the third number of computer threads for each satellite to read a third data file for each satellite;
[0138] Integrate the third data files of all satellites to obtain an integrated data file;
[0139] The integrated data files are subjected to grid fusion processing to obtain target data files.
[0140] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.
[0141] An embodiment of the present invention further provides an electronic device, including:
[0142] It includes a processor, a memory, and a computer program stored in the memory and capable of running on the processor. When the computer program is executed by the processor, the various processes of the above-mentioned GNSS-R satellite constellation remote sensing data processing method embodiment based on multi-threading technology are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0143] An embodiment of the present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the above-mentioned GNSS-R satellite constellation remote sensing data processing method embodiment based on multi-threading technology are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0144] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.
[0145] It will be appreciated by those skilled in the art that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
[0146] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0147] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0148] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0149] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.
[0150] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.
[0151] The above is a detailed introduction to a GNSS-R satellite constellation remote sensing data processing method based on multi-threading technology and a GNSS-R satellite constellation remote sensing data processing device based on multi-threading technology provided by the present invention. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.
Claims
1. A GNSS-R satellite constellation remote sensing data processing method based on multi-threading technology, characterized in that: The method comprises: Get the raw data files of all satellites in the GNSS-R satellite constellation; Determine a first number of threads to be scheduled based on the number of all satellites, and schedule the first number of computer threads to sort, deduplicate, and perform other processing on the original data files to obtain a first data file corresponding to each satellite; Determine a second number of threads that need to be scheduled for each satellite based on the total number of available threads and the number of reflection channels of each satellite, and schedule the second number of computer threads for each satellite to perform subpackaging, unpacking, calibration, observation information calculation and other processing on the corresponding first data file to obtain a second data file corresponding to each satellite; Scheduling the first number of computer threads to perform orbit product inversion processing on each second data file to obtain a third data file corresponding to each satellite; The third number of threads to be scheduled for each satellite is determined based on the total number of available threads and the number of third data files, and the third number of computer threads is scheduled for each satellite to perform grid fusion processing on each third data file to obtain a target data file.
2. The GNSS-R satellite constellation remote sensing data processing method based on multi-threading technology according to claim 1 is characterized in that: The method of obtaining the raw data files of all satellites in the GNSS-R satellite constellation includes: The original data files of all satellites in the GNSS-R satellite constellation within a target time period are obtained from each satellite ground station; each of the satellite ground stations includes the original data file of at least one satellite.
3. The GNSS-R satellite constellation remote sensing data processing method based on multi-threading technology according to claim 1 is characterized in that: The step of scheduling the first number of computer threads to sort, remove duplicates, and perform other processing on the original data files to obtain a first data file corresponding to each satellite includes: Allocating the second data files corresponding to the respective satellites to the first number of computer threads, so that the computer thread corresponding to each satellite sorts the original data files corresponding to each satellite according to the system week, the second of the week and the packet sequence number of the global navigation satellite system GNSS to obtain the sorted original data files corresponding to each satellite; The computer thread corresponding to each satellite deduplicates the sorted original data file corresponding to each satellite to obtain a first data file corresponding to each satellite.
4. The GNSS-R satellite constellation remote sensing data processing method based on multi-threading technology according to claim 1 is characterized in that: The second amount is determined by: Among them, M1 is the number of computer threads that need to be allocated for a single satellite, N is the total number of available threads, and n c is the total number of reflection channels of all satellites, To round down, k c is the number of reflection channels of a single satellite.
5. The GNSS-R remote sensing data processing method based on computer multi-threading technology according to claim 1 is characterized in that: The step of scheduling the first number of computer threads to perform orbit product inversion processing on each second data file to obtain a third data file corresponding to each satellite includes: Allocating the second data files corresponding to each satellite to the first number of computer threads, so that the computer thread corresponding to each satellite performs orbit product inversion on the second data file corresponding to each satellite to obtain an inversion result corresponding to each satellite; The computer thread corresponding to each satellite classifies and groups the inversion results corresponding to each satellite according to the GNSS system type and then fuses them to obtain a third data file corresponding to each satellite.
6. The GNSS-R satellite constellation remote sensing data processing method based on multi-threading technology according to claim 1 is characterized in that: The third quantity is determined as follows: Among them, M2 is the number of computer threads that need to be allocated for a single satellite, N is the total number of available threads, and n f is the total number of third data files, To round down, k f The number of the third data file for a single satellite.
7. The GNSS-R satellite constellation remote sensing data processing method based on multi-threading technology according to claim 1 is characterized in that: The step of scheduling the third number of computer threads for each satellite to perform grid fusion processing on each third data file to obtain a target data file includes: scheduling the third number of computer threads for each satellite to read a third data file for each satellite; Integrate the third data files of all satellites to obtain an integrated data file; The integrated data files are subjected to grid fusion processing to obtain target data files.
8. A GNSS-R satellite constellation remote sensing data processing device based on multi-threading technology, characterized in that: The device comprises: The acquisition module is used to obtain the raw data files of all satellites in the GNSS-R satellite constellation; A configuration module, configured to configure a first number of threads to be scheduled based on the number of all satellites; A scheduling module, used for scheduling the first number of computer threads to process the original data files to obtain first data files corresponding to each satellite; The configuration module is further used to configure a second number of threads that need to be scheduled for each satellite based on the total number of available threads and the number of reflection channels of each satellite; The scheduling module is further used to schedule the second number of computer threads for each satellite to perform processing such as subpackaging and unpacking, calibration, and observation information calculation on the corresponding first data file to obtain a second data file corresponding to each satellite; The scheduling module is further used to schedule the first number of computer threads to perform orbit product inversion processing on each second data file to obtain a third data file corresponding to each satellite; The configuration module is further used to configure a third number of threads that need to be scheduled for each satellite based on the total number of available threads and the number of third data files; The scheduling module is further used to schedule the third number of computer threads for each satellite to perform grid fusion processing on each third data file to obtain a target data file.
9. The GNSS-R satellite constellation remote sensing data processing device based on multi-threading technology according to claim 8, characterized in that: The acquisition module is specifically used for: The original data files of all satellites in the GNSS-R satellite constellation within a target time period are obtained from each satellite ground station; each of the satellite ground stations includes the original data file of at least one satellite.
10. According to the GNSS-R satellite constellation remote sensing data processing device based on multi-threading technology as claimed in claim 8, the scheduling module is specifically used for: Allocating the second data files corresponding to the respective satellites to the first number of computer threads, so that the computer thread corresponding to each satellite sorts the original data files corresponding to each satellite according to the system week, the second of the week and the packet sequence number of the global navigation satellite system GNSS to obtain the sorted original data files corresponding to each satellite; The computer thread corresponding to each satellite deduplicates the sorted original data file corresponding to each satellite to obtain a first data file corresponding to each satellite.
11. According to the GNSS-R satellite constellation remote sensing data processing device based on multi-threading technology as claimed in claim 8, the configuration module is specifically used for: in, M1 is the number of computer threads that need to be allocated for a single satellite, N is the total number of available threads, n c is the total number of reflection channels of all satellites, To round down, k c is the number of reflection channels of a single satellite.
12. According to the GNSS-R satellite constellation remote sensing data processing device based on multi-threading technology as claimed in claim 8, the scheduling module is further used for: Allocating the second data files corresponding to each satellite to the first number of computer threads, so that the computer thread corresponding to each satellite performs orbit product inversion on the second data file corresponding to each satellite to obtain an inversion result corresponding to each satellite; The computer thread corresponding to each satellite classifies and groups the inversion results corresponding to each satellite according to the GNSS system type and then fuses them to obtain a third data file corresponding to each satellite.
13. According to the GNSS-R satellite constellation remote sensing data processing device based on multi-threading technology as claimed in claim 8, the configuration module is further used to: in, M2 is the number of computer threads that need to be allocated for a single satellite, N is the total number of available threads, n f is the total number of third data files, To round down, k f The number of the third data file for a single satellite.
14. According to the GNSS-R satellite constellation remote sensing data processing device based on multi-threading technology as claimed in claim 8, the scheduling module is further used to: scheduling the third number of computer threads for each satellite to read a third data file for each satellite; Integrate the third data files of all satellites to obtain an integrated data file; The integrated data files are subjected to grid fusion processing to obtain target data files.
15. An electronic device, characterized in that: include: A processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein when the computer program is executed by the processor, the steps of the GNSS-R satellite constellation remote sensing data processing method based on multi-threading technology as described in any one of claims 1 to 7 are implemented.
16. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the GNSS-R satellite constellation remote sensing data processing method based on multi-threading technology as claimed in any one of claims 1 to 7 are implemented.
Citation Information
Patent Citations
Relevant processing device of satellite-bone phased array GNSS-R ocean remote sensing
CN103558585A
Method and device of multi-target detection and differentiation, and readable storage medium
CN110286354A
Method for increasing number of sea surface reflection signals received by GNSS-R height measurement satellites
CN110824510A
Method and device for optimizing selection of reflection signals of multimode GNSS-R (Global Navigation Satellite System-Receiver) receiver
CN117348045A
Multiple navigation signal receiving method and receiver for GNSS
KR1020100034628A
