Data processing system, method, medium, and device based on dual storage modules

Abstract

The application provides a data processing system, method, medium and equipment based on a double storage module, relates to the technical field of data processing, and comprises a data processing module, a first data storage module and a second data storage module. The data processing module is used for generating a target query instruction. The first data storage module is used for storing original flight data and key flight data updated according to the second data storage module. The second data storage module is used for storing a target modification instruction sent by the data processing module. The application is more accurate in data corresponding to the target query instruction, so that the subsequent flight execution rate calculation result is also more accurate. Batch modification processing is performed on the data, calculation resources are saved, and processing time is shortened.

Description

Technical Field

[0001] This application relates to the field of data processing technology, and in particular to a data processing system, method, medium and device based on dual storage modules. Background Technology

[0002] In calculating the flight operation rate in civil aviation, the actual flight data needs to be modified according to adjustment documents before the calculation to obtain a more accurate rate. However, since the original actual flight data is stored in a corresponding database, the data processing, whether retrieving data from the database or storing the processed data back to the database, often involves processing data line by line. This approach has little impact on system performance when the data volume is small. However, when the volume of data to be processed is large, the number of interactions between the data processing module and the database increases dramatically.

[0003] Therefore, there is an urgent need for a reasonable method for batch data processing that can both ensure the accuracy of data processing and improve the speed of data processing. Summary of the Invention

[0004] To address the aforementioned technical problems, this application provides a data processing system, method, medium, and device based on dual storage modules, which at least partially solves the problems existing in the prior art.

[0005] In a first aspect of this application, a data processing system based on dual storage modules is provided, the system comprising: a data processing module, a first data storage module, and a second data storage module; wherein:

[0006] The data processing module is used to generate target query instructions. Each target query instruction has a corresponding unique target identifier sequence, a target origin identifier, a target destination identifier, a target query time period, and a target modification instruction. The target modification instruction is used to modify the original flight data and / or key flight data corresponding to the target query instruction in the first data storage module. The key flight data is obtained by modifying the original flight data using the target modification instruction.

[0007] The first data storage module is used to store raw flight data and key flight data updated according to the second data storage module;

[0008] The second data storage module is used to store target modification instructions sent by the data processing module. The storage space of the second data storage module is smaller than that of the first data storage module, and the read / write speed of the second data storage module is greater than that of the first data storage module. The number of target modification instructions stored in the second data storage module is less than a preset instruction number threshold. When the data processing module executes a target query instruction, it modifies the original flight data and / or key flight data corresponding to the target query instruction in the first data storage module. When the number of target modification instructions stored in the second data storage module equals the preset instruction number threshold, it updates the original flight data corresponding to each target modification instruction stored in the first data storage module according to each target modification instruction stored in the second data storage module.

[0009] In a second aspect of this application, a data processing method based on dual storage modules is provided, the method comprising:

[0010] S001, Obtain target query instruction; wherein, the target query instruction has a corresponding target unique identifier sequence, target origin identifier, target destination identifier, and target query time period;

[0011] S002, according to the target query instruction, retrieve several raw flight data and / or key flight data from the first data storage module to obtain the first data list Y = (Y1, Y2, ..., Y...). i , ..., Y n ); i = 1, 2, ..., n; where n is the number of original flight data and / or key flight data in the first data storage module whose execution time is within the target query time period and whose unique identifier sequence, departure point identifier, and destination identifier are all the same as the target unique identifier sequence, target departure point identifier, and target destination identifier; Y i The query command for the target is the i-th original flight data or key flight data corresponding to the first data storage module;

[0012] S003, if the second data storage module is not empty, then obtain the target modification instruction list X = (X1, X2, ..., X...). d , ..., X e ); d = 1, 2, ..., e; where e is the number of target modification instructions contained in the second data storage module; X d Modify the d-th target contained in the second data storage module;

[0013] S004, Update Y according to the target modification instruction to obtain the third data list Y' = (Y1', Y2', ..., Y... i ',…,Y n '); where Yi 'For Y i Updated raw flight data or key flight data; if Y i The corresponding unique identifier sequence, origin identifier, and destination identifier are related to X. d The corresponding unique identifier sequence, origin identifier, and destination identifier are the same, and Y i 'The corresponding execution time is in X' d Within the corresponding modification time period; then according to X d Update Y i Get Y i '; If Y i 'The corresponding unique identifier sequence, origin identifier, destination identifier, and execution time are related to X' d If the corresponding unique identifier sequence, origin identifier, destination identifier, and execution time are all different, then Y is determined. i '=Y i .

[0014] In a third aspect of this application, a non-transitory computer-readable storage medium is provided, wherein at least one instruction or at least one program is stored in the storage medium, and the at least one instruction or at least one program is loaded and executed by a processor to implement the aforementioned data processing method based on dual storage modules.

[0015] In a fourth aspect of this application, an electronic device is provided, including a processor and the aforementioned non-transitory computer-readable storage medium.

[0016] This application has at least the following beneficial effects:

[0017] The data processing system based on dual storage modules provided in this application includes a data processing module, a first data storage module, and a second data storage module. The first data storage module can be a database, typically used for persistent storage of large amounts of data stored on non-volatile storage media such as hard drives. Data is not lost even when the computer is powered off. It has a large storage capacity, easily accommodating massive amounts of data, but its data read / write speed is relatively slow. The second data storage module can be RAM, serving as a temporary storage area for the computer, used to temporarily store data and program instructions currently being processed by the CPU. It has extremely fast data read / write speeds and can interact with the CPU at high speed, but its capacity is relatively small. The second data storage module stores the target modification instructions corresponding to the target query instructions. When the data processing module executes the corresponding target query instruction, it first filters and selects matching raw flight data or critical flight data from the first data storage module. (This refers to original flight data and / or key flight data whose execution time is within the target query time period, and whose unique identifier sequence, departure point identifier, and destination identifier are all identical to the target unique identifier sequence, target departure point identifier, and target destination identifier). If the second data storage module is not empty, it indicates that some data in the first data storage module may need modification. In this case, the target modification instruction in the second data storage module is used to modify some data in the first data storage module to obtain a third data list. Finally, the target query instruction is executed based on the third data list, resulting in more accurate data corresponding to the target query instruction, thus leading to more accurate calculations of the flight execution rate. Batch modification of the data saves computational resources and shortens processing time. Attached Figure Description

[0018] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 This is a structural block diagram of a data processing system based on dual storage modules provided in an embodiment of this application;

[0020] Figure 2 A flowchart of a data processing method based on dual storage modules provided in an embodiment of this application. Detailed Implementation

[0021] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0022] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, system, method, product, or server that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or devices.

[0023] It should be noted that the following description covers various aspects of embodiments within the scope of the appended claims. It will be apparent that the aspects described herein can be embodied in a wide variety of forms, and any particular structure and / or function described herein is merely illustrative. Based on this application, those skilled in the art will understand that one aspect described herein can be implemented independently of any other aspect, and two or more of these aspects can be combined in various ways. For example, any number of aspects set forth herein can be used to implement the device and / or practice the method. Additionally, this device and / or method can be implemented using structures and / or functionalities other than one or more of the aspects set forth herein.

[0024] Please refer to Figure 1 As shown, an embodiment of this application provides a data processing system 100 based on dual storage modules. The system includes: a data processing module 110, a first data storage module 120, and a second data storage module 130; wherein:

[0025] Data processing module 110 is used to generate target query instructions; wherein, the target query instruction has a corresponding target unique identifier sequence, target departure point identifier, target destination identifier, target query time period, and target modification instruction; the target modification instruction is used to modify the original flight data and / or key flight data corresponding to the target query instruction in the first data storage module; the key flight data is obtained after the original flight data has been modified by the target modification instruction;

[0026] The first data storage module 120 is used to store raw flight data and key flight data updated according to the second data storage module;

[0027] The second data storage module 130 is used to store target modification instructions sent by the data processing module. The storage space of the second data storage module is smaller than that of the first data storage module, and the read / write speed of the second data storage module is greater than that of the first data storage module. The number of target modification instructions stored in the second data storage module is less than the preset instruction quantity threshold. When the data processing module executes a target query instruction, it modifies the original flight data and / or key flight data corresponding to the target query instruction in the first data storage module. When the number of target modification instructions stored in the second data storage module equals the preset instruction quantity threshold, it updates the original flight data corresponding to each target modification instruction stored in the first data storage module according to each target modification instruction stored in the second data storage module.

[0028] Specifically, the data processing system provided in this application includes a data processing module, a first data storage module, and a second data storage module. The data processing module can calculate the flight operation rate according to user needs. For example, it can calculate the flight operation rate of a specific flight in a specific flight season. The flight operation rate of a specific flight in a specific flight season is the sum of the actual number of flights operated by the flight in that flight season and the planned number of flights operated by the flight in that flight season. The actual number of flights operated by the flight in that flight season refers to the number of times the flight actually takes off and completes its scheduled flight within that specific flight season. The planned number of flights operated by the flight in that flight season refers to the number of flights planned for the flight to be operated within that flight season by the airline before the start of that specific flight season, based on factors such as market demand, route planning, and resource allocation. However, due to various factors during actual operation, flights may be rescheduled or have increased flight frequency. Therefore, there is a corresponding adjustment document for the flight within that flight season, which records the time periods during which the flight was rescheduled or increased.

[0029] Furthermore, to improve the accuracy of flight operation rate calculations, it is necessary to modify some relevant original flight data according to the adjustment document. For example, Flight A is scheduled to fly every Monday, Wednesday, and Friday during the flight season from March to September 2024. However, due to certain reasons, during a certain week between March and September 2024, Flight A is adjusted to fly on Tuesdays, Thursdays, and Saturdays (as recorded in the adjustment document). Flight A also operates normally on Tuesdays, Thursdays, and Saturdays during that week. In this case, when calculating the flight operation rate of Flight A during the flight season from March to September 2024, if the actual flight data for the adjusted week is not modified back to Monday, Wednesday, and Friday, these three flight operation data points will be missed. Therefore, it is necessary to adjust the actual flight data for the adjusted week back to Tuesdays, Thursdays, and Saturdays. Thus, the modification of some relevant original flight data according to the adjustment document in this embodiment is as described in the example above.

[0030] When generating a target query instruction, the data processing module can, based on each original flight data corresponding to the target query instruction, if there is matching adjustment data in the adjustment file, retrieve the corresponding original flight data from the first data storage module and generate the corresponding target modification instruction. That is, each target query instruction has a corresponding target modification instruction. After the corresponding target modification instruction is executed, the data correction is completed. At this time, the data query results obtained based on the corrected data are more accurate, and the final flight execution rate calculation results are also more accurate.

[0031] Furthermore, the first data storage module in this embodiment can be a database. Databases are typically used for persistent storage of large amounts of data, stored on non-volatile storage media such as hard drives. Data is not lost even if the computer loses power. They have a large storage capacity, easily accommodating massive amounts of data, but their data read / write speed is relatively slow. The first data storage module is used to store raw flight data, planned flight data, and adjustment files for multiple flights. The raw flight data is the actual flight data. Each piece of flight data can include multiple fields, for example: flight number, airport identifier of the departure airport, airport identifier of the arrival airport, actual flight date, and corresponding actual flight time.

[0032] The second data storage module is memory, which serves as a temporary storage area for the computer, used to temporarily store the data and program instructions currently being processed by the CPU. It boasts extremely fast data read / write speeds and can interact with the CPU at high speed, but its capacity is relatively small. In this embodiment, the second data storage module stores the target modification instructions corresponding to the target query instructions. When the data processing module executes the corresponding target query instructions, it first filters the first data storage module for matching original flight data or key flight data (i.e., original flight data and / or key flight data whose execution time is within the target query time period and whose unique identifier sequence, departure point identifier, and destination identifier are all the same as the target unique identifier sequence, target departure point identifier, and target destination identifier). If the second data storage module is not empty, it indicates that some data in Y may need to be modified. In this case, the target modification instructions in the second data storage module are used to modify some data in the first data storage module to obtain a third data list. Finally, the target query instructions are executed according to the third data list, resulting in more accurate data corresponding to the target query instructions, thus leading to more accurate calculations of the flight execution rate.

[0033] In one exemplary embodiment of this application, each piece of raw flight data and each piece of key flight data has a corresponding unique identifier sequence, origin identifier, destination identifier, and execution time; each target modification instruction has a corresponding unique identifier sequence, origin identifier, destination identifier, and modification time period; the data processing module is used to perform the following steps:

[0034] S110, Obtain target query instruction; wherein, the target query instruction has a corresponding target unique identifier sequence, target origin identifier, target destination identifier and target query time period.

[0035] Each piece of raw flight data and each piece of key flight data has a corresponding unique identifier sequence, departure identifier, destination identifier, and execution time. The unique identifier sequence can be the flight number, the departure identifier can be the airport identifier of the departure airport, the destination identifier can be the airport identifier of the landing airport, and the execution time can be the execution time of the flight.

[0036] Here, the target query instruction is the query instruction determined by the data processing module based on the user's needs. For example, a target query instruction could be to retrieve the actual flight data of flight A from airport A to airport B from March 2024 to September 2024. This target query instruction has a corresponding unique target identifier sequence, a target departure point identifier, a target destination identifier, and a target query time period.

[0037] S120, according to the target query instruction, retrieve several raw flight data and / or key flight data from the first data storage module to obtain the first data list Y = (Y1, Y2, ..., Y...). i , ..., Y n ); i = 1, 2, ..., n; where n is the number of original flight data and / or key flight data in the first data storage module whose execution time is within the target query time period and whose unique identifier sequence, departure point identifier, and destination identifier are all the same as the target unique identifier sequence, target departure point identifier, and target destination identifier; Y i The query command for the target corresponds to the i-th raw flight data or key flight data in the first data storage module.

[0038] Specifically, each piece of original flight data and / or key flight data in the first data list is the original flight data and / or key flight data in the first data list whose execution time is within the target query time period and whose unique identifier sequence, departure point identifier, and destination identifier are all the same as the target unique identifier sequence, target departure point identifier, and target destination identifier.

[0039] S130, If the second data storage module is not empty, then obtain the target modification instruction list X = (X1, X2, ..., X...). d , ..., X e ); d = 1, 2, ..., e; where e is the number of target modification instructions contained in the second data storage module; X d This is the modification instruction for the d-th target contained in the second data storage module.

[0040] S140, Update Y according to the target modification instruction to obtain the third data list Y' = (Y1', Y2', ..., Y... i ',…,Y n '); where Y i 'For Y i Updated raw flight data or key flight data; if Y i The corresponding unique identifier sequence, origin identifier, and destination identifier are related to X. d The corresponding unique identifier sequence, origin identifier, and destination identifier are the same, and Y i 'The corresponding execution time is in X' d Within the corresponding modification time period; then according to X d Update Y i Get Y i '; If Y i 'The corresponding unique identifier sequence, origin identifier, destination identifier, and execution time are related to X' d If the corresponding unique identifier sequence, origin identifier, destination identifier, and execution time are all different, then Y is determined.i '=Y i .

[0041] S150, Execute the target query instruction according to Y'.

[0042] In this embodiment, the second data storage module stores the target modification instruction corresponding to the target query instruction. When the data processing module executes the corresponding target query instruction, it first filters the matching original flight data or key flight data in the first data storage module (i.e., original flight data and / or key flight data whose execution time is within the target query time period and whose unique identifier sequence, departure point identifier, and destination identifier are all the same as the target unique identifier sequence, target departure point identifier, and target destination identifier). If the second data storage module is not empty, it means that some data in Y may need to be modified. In this case, the data in the first data storage module is modified according to the target modification instruction in the second data storage module to obtain the third data list. Finally, the target query instruction is executed according to the third data list, resulting in more accurate data corresponding to the target query instruction, and therefore more accurate results for subsequent flight execution rate calculations.

[0043] In one exemplary embodiment of this application, the second data storage module 130 is further configured to store key flight data obtained by the data processing module 110; wherein, the storage space of the second data storage module 130 is smaller than the storage space of the first data storage module 120, and the read / write speed of the second data storage module 130 is greater than the read / write speed of the first data storage module 120; the second data storage module 130 has a corresponding preset data quantity threshold; each key flight data in the second data storage module 130 has a corresponding original flight data or key flight data in the first data storage module 120; if the number of key flight data stored in the second data storage module 130 is equal to the preset data quantity threshold, then the original flight data stored in the first data storage module 120 corresponding to each key flight data is updated according to each key flight data stored in the second data storage module 130.

[0044] In this embodiment, the second data storage module stores key flight data obtained from the data processing module. Here, key flight data refers to the flight data obtained after modifying the original flight data according to the adjustment file. Therefore, each key flight data in the second data storage module has a corresponding original flight data in the first data storage module. Furthermore, the memory storage space is smaller than the database storage space. The second data storage module also has a corresponding preset data quantity threshold; for example, the preset data quantity threshold is 1000. That is, whenever the number of key flight data entries stored in the second data storage module equals 1000, the key flight data stored in the second data storage module is transferred back to the first data storage module. In other words, the original flight data corresponding to each key flight data is updated.

[0045] It should be noted that, as summarized above, the first data storage module stores not only raw flight data but also critical flight data, which comes from the second data storage module.

[0046] In summary, this embodiment sets up a second data storage module compared to the prior art. That is, by using a temporarily set memory space, the number of interactions between the data processing module and the database is reduced. Since memory has a much faster data read and write speed than the database, the overall data processing time is reduced and the data processing speed is improved.

[0047] In one exemplary embodiment of this application, each piece of raw flight data and each piece of key flight data has a corresponding unique identifier sequence, departure point identifier, destination identifier, and execution time; the data processing module is used to perform the following steps after step S120:

[0048] S160, based on the target query command, retrieve several key flight data from the second data storage module to obtain the second data list E = (E1, E2, ..., E...). j , ..., E m ); j = 1, 2, ..., m; m is the number of key flight data in the second data storage module whose execution time is within the target query time period and whose unique identifier sequence, origin identifier, and destination identifier are all the same as the target unique identifier sequence, target origin identifier, and target destination identifier; E j The query command for the target corresponds to the j-th key flight data in the second data storage module; m≤n.

[0049] S170, if E is not empty, then update Y according to E to obtain the third data list Y' = (Y1', Y2', ..., Y... i ',…,Y n '); where Y i ' represents the i-th raw flight data and / or key flight data; if Yi The corresponding unique identifier sequence, origin identifier, destination identifier, and execution time are related to E. j If the corresponding unique identifier sequence, origin identifier, destination identifier, and execution time are the same, then Y is determined. i '=E j If Y i If the corresponding unique identifier sequence, origin identifier, destination identifier, and execution time are all different from each key flight data in E, then Y i '=Y i The third data list is used to process the target query command.

[0050] Specifically, since the critical flight data is first stored in the second data storage module after each modification by the data processing module, the data in the second data storage module is more accurate than the data in the first data storage module. For example, the original flight data for Flight A from Airport A to Airport B on May 18, 2024, is stored in the first data storage module. However, due to file adjustments, May 18, 2024, should be changed to May 17, 2024. The critical flight data obtained after this modification may be stored in the second data storage module. Furthermore, the ID corresponding to this data remains unchanged (unique identifier sequence, departure point identifier, destination identifier, and execution time). Therefore, if data with the same ID exists in both the first and second data storage modules, the data in the resulting third data list will be based on the data from the second data storage module. Therefore, an updated third data list is obtained. This third data list may contain some original flight data from the first data storage module, which has not been modified. It may also contain some critical flight data from the first data storage module, which has been modified by the data processing module and returned to the first data storage module after reaching its storage limit. At this point, the second data storage module does not contain this data. Additionally, it may contain some critical flight data from the second data storage module, which has been modified by the data processing module and is temporarily stored in the second data storage module, not yet returned to the first data storage module. However, the first data storage module contains its corresponding original flight data or critical flight data (modified multiple times). Therefore, for this portion of data, the data from the second data storage module should be accepted.

[0051] The method provided in this embodiment makes the obtained query results, i.e., the third data list, more accurate, and can accurately identify the modified data, making the final returned query results more accurate, and the subsequent calculation results more accurate as well.

[0052] In one exemplary embodiment of this application, the second data storage module is further configured to store the calculation result data obtained by the data processing module in performing the flight rate calculation.

[0053] In one exemplary embodiment of this application, each piece of raw flight data or key flight data includes several fields; the second data storage module is further configured to perform the following steps:

[0054] S210, in response to detecting that the number of key flight data stored in the second data storage module is equal to the preset data quantity threshold, each key flight data in the second data storage module is acquired to obtain a key flight data list G = (G1, G2, ..., G...). x , ..., G y ); x = 1, 2, ..., y; where y is the preset data quantity threshold corresponding to the second data storage module; G x The xth critical flight data stored within the second data storage module.

[0055] Specifically, each piece of raw flight data or key flight data contains several fields; if the number of key flight data stored in the second data storage module is equal to the preset data quantity threshold, it means that the space of the second data storage space has been fully occupied, and the key flight data stored in the second data storage module needs to be returned to the first data storage module with a larger storage space.

[0056] S220, according to G, several first key clusters are obtained to obtain a list of first clusters YJ = (YJ1, YJ2, ..., YJ...). a , ..., YJ b ); a = 1, 2, ..., b; where b is the number of the first key cluster; YJ a YJ is the cluster identifier for the a-th first key cluster; a All modified fields of the included critical flight data have the same field identifier.

[0057] Specifically, the second data storage module stores the updated data obtained after modification according to the target modification instruction. This data can be the entire dataset, meaning the entire data record is replaced, or it can only store the modified fields. Furthermore, clustering is performed based on the field identifiers of the modified fields. First, key flight data with modifications to the same field are grouped together. Data with modified departure airports are grouped into one category, and data with modified execution dates are grouped into another.

[0058] S230, based on YJ, obtain the second key cluster list set EJ = (EJ1, EJ2, ..., EJ...). a , ..., EJ b ); among which, EJa This is a list of second key clusters obtained by clustering all key flight data within the a-th first key cluster; EJ a =(EJ) a，1 EJ a，2 , ..., EJ a，c , ..., EJ a，f(a) ); c = 1, 2, ..., f(a); f(a) is EJ a The number of corresponding second key clusters; EJ a，c This is the cluster identifier for the c-th second key cluster, obtained by clustering all key flight data within the a-th first key cluster; EJ a，c The modified fields of all the key flight data contained herein have the same value.

[0059] Furthermore, after the first clustering, a second clustering is performed within each first key cluster. The second clustering group consists of groups that have modified the same field and whose modified field values ​​are the same.

[0060] S240, according to EJ, obtain the data update instruction list set ZG = (ZG1, ZG2, ..., ZG...). a ..., ZG b ); among them, ZG a For EJ a The corresponding data update command list; ZG a =(ZG a，1 ZG a，2 ..., ZG a，c ..., ZG a，f(a) ZG a，c For EJ a，c The corresponding data update instructions; the data update instructions for any two second key clusters are different.

[0061] Here, each second key cluster has a corresponding data update instruction, which is used to control the modification of each data in the first data storage module corresponding to the aforementioned key flight data.

[0062] S250, according to ZG, updates the raw flight data and / or critical flight data stored in the first data storage module.

[0063] In this embodiment, for a class of key flight data where the same field is modified and the modified field value is the same, a modification instruction is generated, which reduces the consumption of computing resources and improves the efficiency of data update.

[0064] In one exemplary embodiment of this application, the second data storage module is further configured to perform the following steps:

[0065] S260, if the number of key flight data stored in the second data storage module is less than the preset data quantity threshold, and the second data storage module receives a target modification instruction from the data processing module; wherein, the target modification instruction has a corresponding unique identifier sequence, departure identifier, destination identifier, and modification time period; and the target modification instruction has a corresponding field to be modified and a modification value corresponding to the field to be modified; each key flight data has a corresponding unique identifier sequence, departure identifier, destination identifier, and execution time.

[0066] S270, Obtain the target key flight data list MG = (MG1, MG2, ..., MG2) corresponding to the target modification instruction. x , ..., MG y ); x = 1, 2, ..., y; where y is the number of target key flight data corresponding to the target modification instruction in the second data module; MG x The target modification instruction corresponds to the xth target key flight data in the second data module; the unique identifier sequence, origin identifier, and destination identifier of the target key flight data are all the same as the unique identifier sequence, origin identifier, and destination identifier corresponding to the target modification instruction; and the execution time of the target key flight data is within the modification time period corresponding to the target modification instruction, and the modification value of the field to be modified corresponding to the target modification instruction is different from the value of the key field corresponding to the target key flight data; the key field is the same as the field to be modified corresponding to the target modification instruction.

[0067] S280, modify the value of the key field corresponding to each target key flight data in MG according to the modification value of the field to be modified corresponding to the target modification instruction, so that the value of the key field corresponding to each target key flight data is the same as the modification value of the field to be modified corresponding to the target modification instruction.

[0068] In this embodiment, under certain special circumstances, when critical flight data is still stored in the second data storage module and has not yet been transferred to the first data storage module, the modified critical flight data may be modified a second time. In this case, the critical flight data in the cache is modified, so that when the critical flight data in the second data storage module is transferred back to the first data storage module, a corresponding modification instruction is generated to modify the original flight data or critical flight data in the first data storage module. This saves resources and avoids frequent interaction between the data processing module and the database (first data storage module), thus saving data processing time.

[0069] In one exemplary embodiment of this application, the second data storage module is provided with a first storage unit and a second storage unit; wherein, the first storage unit is used to store calculation result data and raw flight data not included in the first data storage module; the second storage unit is used to store key flight data obtained by the data processing module.

[0070] Specifically, the calculated data and the original flight data not included in the first data storage module are considered new data for the first data storage module, while the key flight data obtained from the data processing module are considered modified data for the first data storage module. In the second data storage module of this embodiment, new data and modified data are stored separately, and all new data in the first storage unit corresponds to one instruction when it is added to the first data storage module. In one embodiment, new data is processed first.

[0071] Please refer to Figure 2 As shown, an embodiment of this application provides a data processing method based on dual storage modules, the method comprising:

[0072] S001, Obtain target query instruction; wherein, the target query instruction has a corresponding target unique identifier sequence, target origin identifier, target destination identifier, and target query time period.

[0073] S002, according to the target query instruction, retrieve several raw flight data and / or key flight data from the first data storage module to obtain the first data list Y = (Y1, Y2, ..., Y...). i , ..., Y n ); i = 1, 2, ..., n; where n is the number of original flight data and / or key flight data in the first data storage module whose execution time is within the target query time period and whose unique identifier sequence, departure point identifier, and destination identifier are all the same as the target unique identifier sequence, target departure point identifier, and target destination identifier; Y i The query command for the target corresponds to the i-th raw flight data or key flight data in the first data storage module.

[0074] S003, if the second data storage module is not empty, then obtain the target modification instruction list X = (X1, X2, ..., X...). d , ..., X e ); d = 1, 2, ..., e; where e is the number of target modification instructions contained in the second data storage module; X d This is the modification instruction for the d-th target contained in the second data storage module.

[0075] S004, Update Y according to the target modification instruction to obtain the third data list Y' = (Y1', Y2', ..., Y... i ',…,Y n '); where Y i 'For Y i Updated raw flight data or key flight data; if Y i The corresponding unique identifier sequence, origin identifier, and destination identifier are related to X. d The corresponding unique identifier sequence, origin identifier, and destination identifier are the same, and Y i 'The corresponding execution time is in X' d Within the corresponding modification time period; then according to X d Update Y i Get Y i '; If Y i 'The corresponding unique identifier sequence, origin identifier, destination identifier, and execution time are related to X' d If the corresponding unique identifier sequence, origin identifier, destination identifier, and execution time are all different, then Y is determined. i '=Y i .

[0076] S005, Execute the target query instruction according to Y'.

[0077] In an exemplary embodiment of this application, an electronic device capable of implementing the above-described method is also provided.

[0078] Those skilled in the art will understand that various aspects of this application can be implemented as a system, method, or program product. Therefore, various aspects of this application can be specifically implemented in the following forms: a completely hardware implementation, a completely software implementation (including firmware, microcode, etc.), or a combination of hardware and software implementations, collectively referred to herein as a "circuit," "module," or "system."

[0079] An electronic device according to this embodiment of the present application. The electronic device is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments of this application.

[0080] Electronic devices are manifested in the form of general-purpose computing devices. Components of an electronic device may include, but are not limited to: at least one processor, at least one memory, and buses connecting different system components (including memory and processor).

[0081] The memory stores program code that can be executed by a processor, causing the processor to perform the steps described in the "Exemplary Methods" section above, according to various exemplary embodiments of this application.

[0082] The storage may include readable media in the form of volatile storage, such as random access memory (RAM) and / or cache memory, and may further include read-only memory (ROM).

[0083] The storage may also include programs / utilities having a set (at least one) of program modules, including but not limited to: an operating system, one or more applications, other program modules, and program data, each or some combination of these examples may include an implementation of a network environment.

[0084] A bus can represent one or more of several bus architectures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus that uses any of the various bus architectures.

[0085] The electronic device can also communicate with one or more external devices (e.g., keyboards, pointing devices, Bluetooth devices, etc.), one or more devices that enable a user to interact with the electronic device, and / or any device that enables the electronic device to communicate with one or more other computing devices (e.g., routers, modems, etc.). This communication can be achieved through input / output (I / O) interfaces. Furthermore, the electronic device can communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) via a network adapter. As shown in the figure, the network adapter communicates with other modules of the electronic device via a bus. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in conjunction with the electronic device, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0086] Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, terminal device, or network device, etc.) to execute the method according to the embodiments of this application.

[0087] In exemplary embodiments of this application, a computer-readable storage medium is also provided, on which a program product capable of implementing the methods described above is stored. In some possible implementations, various aspects of this application may also be implemented as a program product including program code, which, when the program product is run on a terminal device, causes the terminal device to perform the steps of the various exemplary embodiments of this application described in the "Exemplary Methods" section above.

[0088] The program product may employ any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of readable storage media include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0089] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A readable signal medium may also be any readable medium other than a readable storage medium, capable of sending, propagating, or transmitting programs for use by or in conjunction with an instruction execution system, apparatus, or device.

[0090] The program code contained on the readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination thereof.

[0091] Program code for performing the operations of this application can be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java and C++, and conventional procedural programming languages ​​such as C or similar languages. The program code can execute entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0092] Furthermore, the above figures are merely illustrative of the processes included in the method according to exemplary embodiments of this application, and are not intended to be limiting. It is readily understood that the processes shown in the above figures do not indicate or limit the temporal order of these processes. Additionally, it is readily understood that these processes may be executed synchronously or asynchronously, for example, in multiple modules.

[0093] It should be noted that although several modules or units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to the embodiments of this application, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0094] The above are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A data processing system based on dual storage modules, characterized in that, include: The data processing module is used to generate target query instructions. Each target query instruction has a corresponding unique target identifier sequence, a target origin identifier, a target destination identifier, a target query time period, and a target modification instruction. The target modification instruction is used to modify the original flight data and / or key flight data corresponding to the target query instruction in the first data storage module. The key flight data is obtained by modifying the original flight data using the target modification instruction. The first data storage module is used to store raw flight data and key flight data updated according to the second data storage module; The second data storage module is used to store target modification instructions sent by the data processing module. The storage space of the second data storage module is smaller than that of the first data storage module, and the read / write speed of the second data storage module is greater than that of the first data storage module. The number of target modification instructions stored in the second data storage module is less than a preset instruction quantity threshold. When the data processing module executes a target query instruction, it modifies the original flight data and / or key flight data corresponding to the target query instruction in the first data storage module. When the number of target modification instructions stored in the second data storage module equals the preset instruction quantity threshold, the original flight data corresponding to each target modification instruction stored in the first data storage module is updated according to each target modification instruction stored in the second data storage module.

2. The data processing system based on dual storage modules according to claim 1, characterized in that, Each piece of raw flight data and each piece of critical flight data has a corresponding unique identifier sequence, origin identifier, destination identifier, and execution time; each target modification instruction has a corresponding unique identifier sequence, origin identifier, destination identifier, and modification time period; the data processing module is used to execute the following steps: S110, Obtain the target query instruction; wherein, the target query instruction has a corresponding target unique identifier sequence, target origin identifier, target destination identifier, and target query time period; S120: Based on the target query instruction, retrieve several raw flight data and / or key flight data from the first data storage module to obtain a first data list Y=(Y1, Y2, ..., Y...). i , ..., Y n ); i = 1, 2, ..., n; where n is the number of original flight data and / or key flight data in the first data storage module whose execution time is within the target query time period and whose unique identifier sequence, departure point identifier, and destination identifier are all the same as the target unique identifier sequence, target departure point identifier, and target destination identifier; Y i The query command for the target is the i-th original flight data or key flight data corresponding to the first data storage module; S130, if the second data storage module is not empty, then obtain the target modification instruction list X=(X1, X2, ..., X...). d , ..., X e ); d = 1, 2, ..., e; where e is the number of target modification instructions contained in the second data storage module; X d Modify the d-th target contained in the second data storage module; S140, Update Y according to the target modification instruction to obtain the third data list Y'=(Y1', Y2', ..., Y... i ',…,Y n '); where Y i 'For Y i Updated raw flight data or key flight data; if Y i The corresponding unique identifier sequence, origin identifier, and destination identifier are related to X. d The corresponding unique identifier sequence, origin identifier, and destination identifier are the same, and Y i The corresponding execution time is X d Within the corresponding modification time period; then according to X d Update Y i Get Y i '; If Y i The corresponding unique identifier sequence, origin identifier, destination identifier, and execution time are related to X. d If the corresponding unique identifier sequence, origin identifier, destination identifier, and execution time are all different, then Y is determined. i '=Y i ; S150, Execute the target query instruction according to Y'.

3. The data processing system based on dual storage modules according to claim 2, characterized in that, The second data storage module is also used to store key flight data sent by the data processing module; wherein, the second data storage module has a corresponding preset data quantity threshold; each key flight data in the second data storage module has corresponding original flight data or key flight data in the first data storage module; if the number of key flight data stored in the second data storage module is equal to the preset data quantity threshold, then the original flight data stored in the first data storage module corresponding to each key flight data is updated according to each key flight data stored in the second data storage module.

4. The data processing system based on dual storage modules according to claim 3, characterized in that, After step S120, the data processing module is further configured to perform the following steps: S160, based on the target query command, retrieves several key flight data from the second data storage module, resulting in a second data list E=(E1, E2, ..., E...). j , ..., E m j = 1, 2, ..., m; m represents the number of key flight data points within the second data storage module whose execution time falls within the target query time period and whose unique identifier sequence, origin identifier, and destination identifier are all identical to the target unique identifier sequence, origin identifier, and destination identifier; E j The query command for the target corresponds to the j-th key flight data in the second data storage module; m≤n; S170, if E is not empty, then update Y according to E to obtain the third data list Y'=(Y1', Y2', ..., Y... i ',…,Y n '); where Y i ' represents the i-th raw flight data and / or key flight data; if Y i The corresponding unique identifier sequence, origin identifier, destination identifier, and execution time are related to E. j If the corresponding unique identifier sequence, origin identifier, destination identifier, and execution time are the same, then Y is determined. i '=E j If Y i If the corresponding unique identifier sequence, departure point identifier, destination identifier, and execution time are all different from each key flight data in E, then Y... i '=Y i The third data list is used to process the target query command.

5. The data processing system based on dual storage modules according to claim 4, characterized in that, The first data storage module is also used to store planning data, adjustment file data, and calculation result data; wherein, the planning data is used to calculate the flight execution rate, and the adjustment file data is used to generate target modification instructions to modify the original flight data and / or key flight data.

6. The data processing system based on dual storage modules according to claim 5, characterized in that, The second data storage module is also used to store the calculation result data obtained by the data processing module from the flight rate calculation process.

7. A data processing method based on dual storage modules, characterized in that, The data processing method based on dual storage modules is applied to the data processing system based on dual storage modules according to any one of claims 1-2, and the method includes: S001, Obtain target query instruction; wherein, the target query instruction has a corresponding target unique identifier sequence, target origin identifier, target destination identifier, and target query time period; S002, according to the target query instruction, retrieve several raw flight data and / or key flight data from the first data storage module to obtain the first data list Y=(Y1, Y2, ..., Y...). i , ..., Y n ); i = 1, 2, ..., n; where n is the number of original flight data and / or key flight data in the first data storage module whose execution time is within the target query time period and whose unique identifier sequence, departure point identifier, and destination identifier are all the same as the target unique identifier sequence, target departure point identifier, and target destination identifier; Y i The query command for the target is the i-th original flight data or key flight data corresponding to the first data storage module; S003, if the second data storage module is not empty, then obtain the target modification instruction list X=(X1, X2, ..., X...). d , ..., X e ); d = 1, 2, ..., e; where e is the number of target modification instructions contained in the second data storage module; X d Modify the d-th target contained in the second data storage module; S004, Update Y according to the target modification instruction to obtain the third data list Y'=(Y1', Y2', ..., Y... i ',…,Y n '); where Y i 'For Y i Updated raw flight data or key flight data; if Y i The corresponding unique identifier sequence, origin identifier, and destination identifier are related to X. d The corresponding unique identifier sequence, origin identifier, and destination identifier are the same, and Y i The corresponding execution time is X d Within the corresponding modification time period; then according to X d Update Y i Get Y i '; If Y i The corresponding unique identifier sequence, origin identifier, destination identifier, and execution time are related to X. d If the corresponding unique identifier sequence, origin identifier, destination identifier, and execution time are all different, then Y is determined. i '=Y i ; S005, Execute the target query instruction according to Y'.

8. A non-transitory computer-readable storage medium, characterized in that, The storage medium stores at least one instruction or at least one program segment, which is loaded and executed by a processor to implement the method as described in claim 7.

9. An electronic device, characterized in that, Includes a processor and the non-transitory computer-readable storage medium as described in claim 8.

Images