Data Update Method, System, Medium and Device

By clustering and generating a data update instruction list in the second data storage module, the problem of excessive interactions during large-scale actual flight data processing in the prior art is solved, and more efficient data processing and lower system response time are achieved.

CN119961277BActive Publication Date: 2025-06-20MOBILE TECH COMPANY CHINA TRAVELSKY HLDG
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202510438552.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2025-04-09
Publication Date
2025-06-20
Estimated Expiration
2045-04-09

AI Technical Summary

Technical Problem

When the prior art processes large-scale actual flight data, the process method by piece leads to a sharp increase in the number of interactions between the data processing module and the database, resulting in an extended system response time, a degradation of database performance, and may even cause system instability.

Method used

By clustering in the second data storage module, a data update instruction list is generated, and frequent update operations to the first data storage module are reduced, thereby reducing the number of interactions between the data processing module and the database.

Benefits of technology

It effectively reduces the number of interactions between the data processing module and the database, improves the data processing speed, reduces the system response time, and reduces the database load, avoiding the risk of system instability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119961277B_ABST
    Figure CN119961277B_ABST
Patent Text Reader

Abstract

The present application provides a data update method, system, medium and device, which relates to the technical field of data processing, and includes: in response to detecting that the number of key flight data stored in the second data storage module is equal to a preset data quantity threshold, controlling the second data storage module to perform clustering to obtain b first key clustering clusters; controlling the second data storage module to perform clustering on each first key clustering cluster to obtain a number of second key clustering cluster lists; controlling the second data storage module to obtain a data update instruction list set ZG according to each second key clustering cluster list; controlling the second data storage module to update the original flight data and / or key flight data stored in the first data storage module according to ZG. In the present application, for a type of key flight data that modifies the same field and the modified field values are the same, a modification instruction is generated, which reduces the occupation of computing resources and improves the efficiency of data update.
Need to check novelty before this filing date? Find Prior Art

Description

Background Art

[0002] At present, with the booming development of the global civil aviation industry, accurately calculating the flight execution rate is of crucial significance for the operation management, resource allocation, and service quality improvement of airlines. As a key indicator for measuring the flight execution efficiency of airlines, the accurate calculation of the flight execution rate depends on the scientific processing and analysis of actual flight data.

[0003] With the continuous expansion of the scale of civil aviation business, the amount of actual flight data generated by airlines every day has increased explosively. In order to obtain a more accurate flight execution rate, the industry generally adopts the method of correcting actual flight data according to adjustment files and then calculating the flight execution rate. The adjustment files contain various factors affecting flight execution, such as flight delays caused by weather, temporary route changes, etc. By making targeted modifications to the original flight data, the calculation results of the flight execution rate can be made more in line with the actual operating conditions.

[0004] However, the existing technology has significant drawbacks in dealing with this process. Since in actual operation, the same data may need to be modified multiple times due to multiple factors, the current related technologies mostly adopt a one-by-one processing method. That is, after obtaining the actual flight data, according to the instructions in the adjustment file, each piece of data is modified in turn, and after the modification is completed, the flight execution rate is calculated. When the data volume is small, the impact of this one-by-one processing method on system performance is not prominent, and the calculation task of the flight execution rate can be completed relatively smoothly.

[0005] But when faced with a large amount of actual flight data, problems follow one after another. Take a large airline as an example. The number of daily flight takeoffs and landings may be in the thousands, and the corresponding actual flight data volume is huge and complex. Using the one-by-one processing method, the data processing module needs to frequently read data from the database. After modifying each piece of data, it needs to interact with the database again to store the modification results, and so on. This makes the number of interactions between the data processing module and the database increase geometrically. Frequent data interactions not only greatly increase the system response time, prolong the duration required for calculating the flight execution rate, but also have a serious impact on the performance of the database, resulting in too high a load on the database, and may even cause system instability, affecting the normal operation of other database-related services. Summary of the Invention

[0006] In view of the above technical problems, the present application provides a data update method, system, medium, and device, which at least partially solve the problems existing in the prior art.

[0007] In the first aspect of the present application, a data update method is provided, and the method includes:

[0008] S110. In response to detecting that the number of critical flight data stored in the second data storage module is equal to a preset data quantity threshold, control the second data storage module to perform clustering based on each piece of critical flight data in the second data storage module to obtain b first critical clustering clusters;

[0009] S120. Control the second data storage module to perform clustering on the critical flight data within each first critical clustering cluster to obtain b lists of second critical clustering clusters; the values of the modified fields of all the critical flight data included in each second critical clustering cluster are the same;

[0010] S130. Control the second data storage module to obtain a set ZG of data update instruction lists according to each list of second critical clustering clusters; each second critical clustering cluster has a corresponding data update instruction; the data update instructions corresponding to any two second critical clustering clusters are different;

[0011] S140. Control the second data storage module to update the original flight data and / or critical flight data stored in the first data storage module according to ZG; wherein, the first data storage module is used to store the original flight data and the critical flight data updated according to the second data storage module; the critical flight data is obtained by modifying the original flight data or critical flight data; the second data storage module is used to store the critical flight data obtained according to the data processing module; the storage space of the second data storage module is smaller than that of the first data storage module; each original flight data or critical flight data includes several fields.

[0012] In a second aspect of the present application, a data update system is provided, and the system includes:

[0013] A first clustering unit, configured to, in response to detecting that the number of critical flight data stored in the second data storage module is equal to a preset data quantity threshold, control the second data storage module to perform clustering based on each piece of critical flight data in the second data storage module to obtain b first critical clustering clusters;

[0014] A second clustering unit, configured to control the second data storage module to perform clustering on the critical flight data within each first critical clustering cluster to obtain b lists of second critical clustering clusters; the values of the modified fields of all the critical flight data included in each second critical clustering cluster are the same;

[0015] An instruction update unit, configured to control the second data storage module to obtain a set ZG of data update instruction lists according to each list of second critical clustering clusters; each second critical clustering cluster has a corresponding data update instruction; the data update instructions corresponding to any two second critical clustering clusters are different;

[0016] A data update unit is configured to control a second data storage module to update the original flight data and / or critical flight data stored in a first data storage module according to ZG. The first data storage module is used to store the original flight data and the critical flight data updated according to the second data storage module. The critical flight data is obtained by modifying the original flight data or the critical flight data. The second data storage module is used to store the critical flight data obtained according to a data processing module. The storage space of the second data storage module is smaller than that of the first data storage module. Each piece of original flight data or critical flight data includes several fields.

[0017] In a third aspect of the present application, a non-transitory computer-readable storage medium is provided. At least one instruction or at least one program segment is stored in the storage medium, and is loaded and executed by a processor to implement the foregoing data update method.

[0018] In a fourth aspect of the present application, an electronic device is provided, including a processor and the foregoing non-transitory computer-readable storage medium.

[0019] The present application has at least the following beneficial effects:

[0020] In the data update method provided by the present application, each piece of original flight data or critical flight data includes several fields. If it is detected that the number of critical flight data stored in the second data storage module is equal to the preset data quantity threshold, it indicates that the space of the second data storage space has been fully occupied at this time, and it is necessary to return the critical flight data stored in the second data storage module to the first data storage module with a larger storage space. The critical flight data stored in the second data storage module is the updated data obtained after modification according to the target modification instruction. Here, the data can be full-scale data, that is, the whole data is replaced, or only the modified fields are stored. Furthermore, clustering is performed according to the field identifiers of the modified fields, that is, first, the critical flight data that has modified the same field is clustered into one category. For example, the critical flight data that has modified the departure airport is grouped into one category, and the critical flight data that has modified the execution date is grouped into one category. Further, after the first clustering, secondary clustering is performed within each first critical clustering cluster. The secondary clustering is to cluster again those that have modified the same field and have the same field value after modification into one category. Here, each second critical clustering cluster has a corresponding data update instruction, and the data update instruction is used to control the modification of each data corresponding to the above critical flight data in the first data storage module. In the present application, for a category of critical flight data that has modified the same field and has the same field value after modification, a modification instruction is generated, which reduces the occupation of computing resources and improves the data update efficiency. Description of the Drawings

[0021] To more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the accompanying drawings required for the description of the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained based on these drawings.

[0022] Figure 1 It is a flowchart of the data update method provided by the embodiment of the present application;

[0023] Figure 2 It is a structural block diagram of the data update system provided by the embodiment of the present application. Detailed implementation manners

[0024] The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments of the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the scope of protection of the present application.

[0025] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above accompanying drawings are used to distinguish similar objects, and do not necessarily need to be used to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so that the embodiments of the present application described here can be implemented in an order other than those illustrated or described here. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or server including a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0026] It should be noted that the following describes various aspects of the embodiments within the scope of the appended claims. It should be obvious that the aspects described herein can be embodied in a wide variety of forms, and any specific structure and / or function described herein is illustrative only. Based on the present application, those skilled in the art should understand that one aspect described herein can be implemented independently of any other aspect, and two or more of these aspects can be combined in various ways. For example, any number of aspects described herein can be used to implement a device and / or practice a method. In addition, this device and / or practice this method can be implemented using other structures and / or functions in addition to one or more of the aspects described herein.

[0027] Please refer to Figure 1As shown in the figure, an embodiment of the present application provides a data update method. The method is applied to a data update system, which includes a data processing module, a first data storage module, and a second data storage module. Among them, the first data storage module is used to store original flight data and key flight data updated according to the second data storage module; the key flight data is obtained by the data processing module after modifying the original flight data or the key flight data; the second data storage module is used to store the key flight data obtained according to the data processing module; among them, the storage space of the second data storage module is smaller than that of the first data storage module; the second data storage module has a corresponding preset data quantity threshold; each key flight data in the second data storage module has a corresponding original flight data or key flight data in the first data storage module; if the number of key flight data stored in the second data storage module is equal to the preset data quantity threshold, then update the original flight data corresponding to each key flight data stored in the first data storage module according to each key flight data stored in the second data storage module; each original flight data or key flight data includes several fields.

[0028] Specifically, the data processing device provided by the present application includes a data processing module, a first data storage module, and a second data storage module. Among them, the data processing module can calculate the flight execution rate according to the user's needs. As an example, the flight execution rate of a certain flight in a certain flight season can be calculated. The flight execution rate of a certain flight in a certain flight season is the ratio of the actual number of flights of this flight in this flight season to the planned number of flights of this flight in this flight season. Among them, the actual number of flights of this flight in this flight season refers to the number of times this flight actually takes off and completes the voyage according to the flight plan in this specific flight season. And the planned number of flights of this flight in this flight season refers to the number of flights planned to be executed by the airline for this flight in this flight season before the start of this specific flight season, based on factors such as market demand, route planning, and resource allocation. However, during the actual execution process, the flight may be rescheduled or the number of flights may increase due to various factors. Therefore, for this flight in this flight season, there is a corresponding adjustment file, which records the time periods during which this flight has been rescheduled or the number of flights has increased in this flight season.

[0029] In addition, to improve the accuracy of the flight execution rate calculation, it is necessary to modify some relevant original flight data according to the adjustment file. As an example: Flight A is scheduled to fly on Mondays, Wednesdays, and Fridays every week during the flight season from March 2024 to September 2024. However, due to certain reasons, during a certain week between March 2024 and September 2024, Flight A was adjusted to fly on Tuesdays, Thursdays, and Saturdays (as recorded in the adjustment file), and Flight A also flew normally on Tuesdays, Thursdays, and Saturdays during that week. At this time, when calculating the flight execution rate of Flight A during the flight season from March 2024 to September 2024, if the actual flight data was not modified to Mondays, Wednesdays, and Fridays during the adjusted week, these three flight execution data would be omitted. Therefore, it is necessary to adjust the actual flight data of the adjusted week back to Tuesdays, Thursdays, and Saturdays. Therefore, the modification of some relevant original flight data according to the adjustment file in this embodiment is as described in the above example.

[0030] When generating the target query instruction, the data processing module can, according to each original flight data corresponding to the target query instruction, if there is matching adjustment data in the adjustment file, obtain the corresponding original flight data in the first data storage module and generate the corresponding target modification instruction. That is, each target query instruction has a corresponding target modification instruction. After the corresponding target modification instruction is executed, the data correction is completed. At this time, the data query result obtained according to the corrected data is more accurate, and the final flight execution rate calculation result is also more accurate.

[0031] Furthermore, the first data storage module in this embodiment can be a database. A database is usually used to persistently store a large amount of data, and the data is stored on non-volatile storage media such as hard disks. Even if the computer is powered off, the data will not be lost. It has a large storage capacity and can easily accommodate a large amount of data, but the data reading and writing speed is relatively slow. The first data storage module is used to store the original flight data, planned flight data, and adjustment files corresponding to multiple flights. Among them, the original flight data is the actual flight data. And each flight data can include multiple fields. As an example: it includes information such as flight number, airport identifier of the departure airport, airport identifier of the arrival airport, actual flight date, and corresponding actual flight time.

[0032] The second data storage module is the memory. As the temporary storage area of the computer, the memory is used to temporarily store the data and program instructions currently being processed by the CPU. It has an extremely fast data reading and writing speed and can interact with the CPU at high speed, but its capacity is relatively small. In this embodiment, the second data storage module is used to store the critical flight data obtained according to the data processing module. Here, the critical flight data is the flight data obtained by modifying the original flight data according to the adjustment file mentioned above. Therefore, each piece of critical flight data in the second data storage module has a corresponding original flight data in the first data storage module. Moreover, the storage space of the memory is smaller than that of the database. The second data storage module also has a corresponding preset data quantity threshold. As an example, the preset data quantity threshold is 1000. That is, whenever the number of pieces of critical flight data stored in the second data storage module is equal to 1000, the critical flight data stored in the second data storage module is written back to the first data storage module. That is, the original flight data corresponding to each piece of critical flight data is updated.

[0033] It should be noted that, as can be seen from the above, the first data storage module stores not only the original flight data but also the critical flight data, and the critical flight data here comes from the second data storage module.

[0034] In summary, compared with the prior art, this embodiment sets up a second data storage module, that is, by using the temporarily set memory space, the number of interactions between the data processing module and the database is reduced. Since the data reading and writing speed of the memory is extremely fast compared with the database, the overall data processing time is reduced and the data processing speed is improved.

[0035] The method includes:

[0036] S110, in response to detecting that the number of critical flight data stored in the second data storage module is equal to the preset data quantity threshold, control the second data storage module to perform clustering according to each piece of critical flight data in the second data storage module to obtain b first critical clustering clusters.

[0037] Specifically, step S110 includes:

[0038] S111, in response to detecting that the number of critical flight data stored in the second data storage module is equal to the preset data quantity threshold, obtain each piece of critical flight data in the second data storage module to obtain a critical flight data list G=(G1, G2,..., G x ,..., G y ); x = 1, 2,..., y; where y is the preset data quantity threshold corresponding to the second data storage module; G x is the x-th piece of critical flight data stored in the second data storage module.

[0039] Here, each piece of original flight data or critical flight data contains several fields; if it is detected that the number of critical flight data stored in the second data storage module is equal to the preset data quantity threshold, it indicates that the space in the second data storage space has been fully occupied at this time. At this time, it is necessary to transfer the critical flight data stored in the second data storage module back to the first data storage module with a larger storage space.

[0040] S112, control the second data storage module to obtain several first critical clustering clusters according to G, so as to obtain the first clustering cluster list YJ = (YJ1, YJ2,..., YJ a ,..., YJ b ); a = 1, 2,..., b; where b is the number of first critical clustering clusters; YJ a is the cluster identifier of the a-th first critical clustering cluster; all the field identifiers of the modified fields of the critical flight data included in YJ a are the same.

[0041] Specifically, the data stored in the second data storage module is the updated data obtained after being modified according to the target modification instruction. Here, the data can be full-scale data, that is, the entire data is replaced, or only the modified fields are stored. Furthermore, clustering is performed according to the field identifiers of the modified fields, that is, first, the critical flight data that has modified the same field is clustered into one category. Those that have modified the departure airport are in one category, and those that have modified the execution date are clustered into one category.

[0042] S120, control the second data storage module to cluster the critical flight data within each first critical clustering cluster to obtain b second critical clustering cluster lists; all the values of the modified fields of the critical flight data included in each second critical clustering cluster are the same.

[0043] Here, control the second data storage module to obtain the second critical clustering cluster list set EJ = (EJ1, EJ2,..., EJ a ,..., EJ b ); where EJ a is the second critical clustering cluster list obtained by clustering all the critical flight data within the a-th first critical clustering cluster; EJ a = (EJ a,1 , EJ a,2 ,..., EJ a,c ,..., EJ a,f(a) ); c = 1, 2,..., f(a); f(a) is the number of second critical clustering clusters corresponding to EJ a ; EJ a,c is the cluster identifier of the c-th second critical clustering cluster obtained by clustering all the critical flight data within the a-th first critical clustering cluster; EJ a,cThe values of the modified fields of all the key flight data included herein are the same. Here, after the first clustering, secondary clustering is performed within each first key clustering cluster. The secondary clustering clusters those that have modified the same field and have the same field value after modification into one category.

[0044] S130, control the second data storage module to obtain a set of data update instruction lists ZG according to each second key clustering cluster list; each second key clustering cluster has a corresponding data update instruction; the data update instructions corresponding to any two second key clustering clusters are different.

[0045] Here, control the second data storage module to obtain the set of data update instruction lists ZG = (ZG1, ZG2,..., ZG a ,..., ZG b ); where ZG a is the data update instruction list corresponding to EJ a ; ZG a =(ZG a,1 , ZG a,2 ,..., ZG a,c ,..., ZG a,f(a) ); ZG a,c is the data update instruction corresponding to EJ a,c ; the data update instructions corresponding to any two second key clustering clusters are different.

[0046] Each second key clustering cluster has a corresponding data update instruction, and this data update instruction is used to control the modification of each data corresponding to the above key flight data in the first data storage module.

[0047] S140, control the second data storage module to update the original flight data and / or key flight data stored in the first data storage module according to ZG; where the first data storage module is used to store the original flight data and the key flight data obtained by updating according to the second data storage module; the key flight data is obtained by modifying the original flight data or key flight data; the second data storage module is used to store the key flight data obtained according to the data processing module; the storage space of the second data storage module is smaller than that of the first data storage module; each original flight data or key flight data contains several fields.

[0048] In this embodiment, for a category of key flight data that modifies the same field and has the same field value after modification, a modification instruction is generated, which reduces the occupation of computing resources and improves the efficiency of data update.

[0049] In an exemplary embodiment of the present application, the second data storage module is used to store the target modification instructions sent by the data processing module; the target modification instructions are used to modify the original flight data and / or critical flight data corresponding to the target query instruction in the first data storage module when the number of target modification instructions stored in the second data storage module is less than the preset instruction quantity threshold and the data processing module executes the target query instruction; and when the number of target modification instructions stored in the second data storage module is equal to the preset instruction quantity threshold, update the original flight data corresponding to each target modification instruction stored in the first data storage module according to each target modification instruction stored in the second data storage module.

[0050] In an exemplary embodiment of the present application, the first data storage module is further used to store schedule data, adjustment file data, and calculation result data; wherein, the schedule data is used to calculate the flight execution rate, and the adjustment file data is used to generate target modification instructions to modify the original flight data and / or critical flight data.

[0051] In an exemplary embodiment of the present application, the data processing module is further used to perform flight execution rate calculation processing according to the target query instruction; and send the calculation result data obtained from the flight execution rate calculation processing to the second data storage module for storage.

[0052] In an exemplary embodiment of the present application, the second data storage module is further used to store the calculation result data obtained by the data processing module from the flight execution rate calculation processing.

[0053] In an exemplary embodiment of the present application, the method further includes:

[0054] S160, if the number of critical flight data stored in the second data storage module is less than the preset data quantity threshold and the second data storage module receives the target modification instruction sent by the data processing module, then obtain the target critical flight data list MG=(MG1, MG2,..., MG x ,..., MG y ); x = 1, 2,..., y; where y is the number of target critical flight data corresponding to the target modification instruction in the second data storage module; MG xModify the x-th target critical flight data corresponding to the target modification instruction in the second data storage module; the unique identification sequence, departure location identification, and destination location identification of the target critical flight data are respectively the same as those of the target modification instruction; and the execution time of the target critical flight data is within the modification time period corresponding to the target modification instruction, and the modification value corresponding to the field to be modified in the target modification instruction is different from the value of the keyword field corresponding to the target critical flight data; the keyword field is the same field as the field to be modified corresponding to the target modification instruction; the target modification instruction has a corresponding unique identification sequence, departure location identification, destination location identification, and modification time period; and the target modification instruction has a corresponding field to be modified and the modification value corresponding to the field to be modified; each critical flight data has a corresponding unique identification sequence, departure location identification, destination location identification, and execution time;

[0055] S170. Modify the value of the keyword field corresponding to each target critical flight data in MG according to the modification value of the field to be modified corresponding to the target modification instruction, so that the value of the keyword field corresponding to each target critical flight data is the same as the modification value of the field to be modified corresponding to the target modification instruction.

[0056] In this embodiment, in some special cases, when the critical flight data is still stored in the second data storage module and has not fallen into the first data storage module, the already modified critical flight data may be modified a second time. At this time, modify the critical flight data in the modification cache, so that when the critical flight data in the second data storage module falls back to the first data storage module, a corresponding modification instruction is generated to modify the original flight data or critical flight data in the first data storage module, so as to save resource occupancy and avoid frequent interaction between the data processing module and the database (the first data storage module). Save data processing time.

[0057] In an exemplary embodiment of the present application, the second data storage module is provided with a first storage unit and a second storage unit; wherein, the first storage unit is used to store calculation result data and original flight data not included in the first data storage module; the second storage unit is used to store critical flight data obtained according to the data processing module.

[0058] Specifically, the calculation result data and the original flight data not included in the first data storage module are new data for the first data storage module, while the critical flight data obtained according to the data processing module is modified data for the first data storage module. In the second data storage module of this embodiment, the new data and the modified data are stored separately, and all the new data in the first storage unit corresponds to one instruction when falling into the first data storage module. And in one embodiment, the new data is preferentially processed.

[0059] In an exemplary embodiment of the present application, the data processing module is used to perform the following steps:

[0060] S210. Obtain a target query instruction; wherein, the target query instruction has a corresponding target unique identification sequence, a target departure location identification, a target destination location identification, and a target query time period.

[0061] Wherein, each piece of original flight data and each piece of key flight data have a corresponding unique identification sequence, a departure location identification, a destination location identification, and an executed time. The unique identification sequence can be a flight number, the departure location identification can be the airport identification of the departure airport, the destination location identification can be the airport identification of the landing airport, and the executed time can be the execution time of the flight.

[0062] Here, the target query instruction is the query instruction determined by the data processing module according to the user's needs. As an example: the target query instruction can be to obtain the actual flight data of flight A from airport A to airport B from March 2024 to September 2024. Here, the target query instruction has a corresponding target unique identification sequence, a target departure location identification, a target destination location identification, and a target query time period.

[0063] S220. Obtain a number of pieces of original flight data and / or key flight data from the first data storage module according to the target query instruction, and obtain the first data list Y = (Y1, Y2,..., Y i ,..., Y n ); i = 1, 2,..., n; wherein, n is the number of pieces of original flight data and / or key flight data in the first data storage module whose corresponding executed time is within the target query time period, and the unique identification sequence, the departure location identification, and the destination location identification are all correspondingly the same as the target unique identification sequence, the target departure location identification, and the target destination location identification; Y i is the i-th piece of original flight data or key flight data corresponding to the target query instruction in the first data storage module.

[0064] Specifically, each piece of original flight data and / or key flight data in the first data list is the piece of original flight data and / or key flight data in the first data list whose corresponding executed time is within the target query time period, and the unique identification sequence, the departure location identification, and the destination location identification are all correspondingly the same as the target unique identification sequence, the target departure location identification, and the target destination location identification.

[0065] S230. Obtain a number of pieces of key flight data from the second data storage module according to the target query instruction, and obtain the second data list E = (E1, E2,..., E j ,..., E m); j = 1, 2, …, m; m is the number of key flight data in the second data storage module whose corresponding executed time is within the target query time period, and the unique identification sequence, origin identification, and destination identification are all correspondingly the same as the target unique identification sequence, target origin identification, and target destination identification; E j is the j-th key flight data corresponding to the target query instruction in the second data storage module; m ≤ n.

[0066] S240, if E is not empty, then update Y according to E to obtain the third data list Y’ = (Y1’, Y2’, …, Y i ’, …, Y n ’); where Y i ’ is the i-th original flight data and / or key flight data; if the unique identification sequence, origin identification, destination identification, and executed time corresponding to Y i ’ are the same as those of the unique identification sequence, origin identification, destination identification, and executed time corresponding to E j , then determine Y i ’ = E j ; if the unique identification sequence, origin identification, destination identification, and executed time corresponding to Y i ’ are all different from each key flight data in E, then Y i ’ = Y i ; the third data list is used to process the target query instruction.

[0067] Specifically, since each time the data processing module modifies the data, it first stores the obtained key flight data in the second data storage module. Therefore, the data in the second data storage module is more accurate than the data in the second data storage module. As an example: The original flight data of Flight A from Airport A to Airport B on May 18, 2024, is stored in the first data storage module. However, due to the adjustment of the file record, May 18, 2024, should be modified to May 17, 2024. The key flight data obtained after modifying this original flight data may be stored in the second data storage module. And the ID corresponding to this data remains unchanged (unique identification sequence, departure location identification, destination location identification, and executed time). Therefore, if there are data with the same ID in both the second data storage module and the first data storage module, the data corresponding to the unique win in the obtained third data list will adopt the data in the second data storage module. Thus, an updated third data list is obtained. Among them, there may be some original flight data from the first data storage module in the third data list, and this part of the data has not been modified. There may also be some key flight data from the first data storage module, and this part of the data has been modified by the data processing module and has fallen back to the first data storage module after the storage capacity of the second data storage module has reached the upper limit. At this time, this data does not exist in the second data storage module. In addition, there may also be some key flight data from the second data storage module, and this part of the data has been modified by the data processing module and is temporarily stored in the second data storage module and has not fallen back to the first data storage module yet. However, in the first data storage module, there is its corresponding original flight data or key flight data (modified once and then modified again). Therefore, for this part of the data, the data in the second data storage module should be adopted.

[0068] The method provided in this embodiment makes the obtained query result, that is, the third data list, more accurate, can accurately identify the modified data, makes the finally returned query result more accurate, and the subsequent obtained calculation result is also more accurate.

[0069] In an exemplary embodiment of the present application, the second data storage module is further configured to store the calculation result data obtained by the data processing module for the execution rate calculation process.

[0070] In an exemplary embodiment of the present application, the second data storage module is used to store the target modification instructions sent by the data processing module; the target modification instructions are used to modify the original flight data and / or critical flight data corresponding to the target query instruction in the first data storage module when the number of target modification instructions stored in the second data storage module is less than the preset instruction number threshold and the data processing module executes the target query instruction; and when the number of target modification instructions stored in the second data storage module is equal to the preset instruction number threshold, update the original flight data corresponding to each target modification instruction stored in the first data storage module according to each target modification instruction stored in the second data storage module.

[0071] Specifically, after step S220, the data processing module is used to execute the following steps:

[0072] S250, if the second data storage module is not empty, obtain the target modification instruction list X = (X1, X2,..., X d ,..., X e ); d = 1, 2,..., e; where e is the number of target modification instructions included in the second data storage module; X d is the d-th target modification instruction included in the second data storage module.

[0073] S260, update Y according to the target modification instruction to obtain the third data list Y' = (Y1', Y2',..., Y i ',..., Y n '); where Y i ' is the updated original flight data or critical flight data of Y i ; if the unique identification sequence, departure place identification, and destination identification corresponding to Y i ' are the same as those corresponding to X d , and the executed time corresponding to Y i ' is within the modification time period corresponding to X d ; then update Y d according to X i to obtain Y i '; if the unique identification sequence, departure place identification, destination identification, and executed time corresponding to Y i ' are all different from those corresponding to X d , then determine that Y i ' = Y i .

[0074] S270, execute the target query instruction according to Y'.

[0075] In this embodiment, the second data storage module stores the target modification instruction corresponding to the target query instruction. At this time, when the data processing module executes the corresponding target query instruction, it first filters and matches the original flight data or key flight data in the first data storage module. (That is, the original flight data and / or key flight data whose execution time is within the target query time period and whose unique identification sequence, departure place identification, and destination place identification all correspond and are the same as the target unique identification sequence, target departure place identification, and target destination place identification). At this time, if the second data storage module is not empty, it indicates that some data in Y may need to be modified. At this time, part of the data in the first data storage module is modified according to the target modification instruction in the second data storage module to obtain the third data list. Finally, the target query instruction is executed according to the third data list, and the data corresponding to the target query instruction is more accurate, so the result of the subsequent flight execution rate calculation is also more accurate.

[0076] Please refer to Figure 2 As shown, an embodiment of the present application provides a data update system 100, and the system includes:

[0077] The first clustering unit 110 is configured to control the second data storage module to perform clustering according to each key flight data in the second data storage module to obtain b first key clustering clusters in response to detecting that the number of key flight data stored in the second data storage module is equal to the preset data quantity threshold;

[0078] The second clustering unit 120 is configured to control the second data storage module to perform clustering on the key flight data in each first key clustering cluster to obtain b second key clustering cluster lists; the values of the modified fields of all key flight data included in each second key clustering cluster are the same;

[0079] The instruction update unit 130 is configured to control the second data storage module to obtain a data update instruction list set ZG according to each second key clustering cluster list; each second key clustering cluster has a corresponding data update instruction; the data update instructions corresponding to any two second key clustering clusters are different;

[0080] The data update unit 140 is configured to control the second data storage module to update the original flight data and / or key flight data stored in the first data storage module according to ZG; wherein, the first data storage module is used to store the original flight data and the key flight data updated according to the second data storage module; the key flight data is obtained by modifying the original flight data or key flight data; the second data storage module is used to store the key flight data obtained according to the data processing module; the storage space of the second data storage module is smaller than the storage space of the first data storage module; each original flight data or key flight data includes several fields.

[0081] In an exemplary embodiment of the present application, an electronic device capable of implementing the above method is further provided.

[0082] Those skilled in the art can understand that various aspects of the present application can be implemented as a system, a method, or a program product. Therefore, various aspects of the present application can be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or an implementation combining hardware and software aspects, which can be collectively referred to as "circuitry", "module", or "system" here.

[0083] An electronic device according to this embodiment of the present application. The electronic device is only an example and should not impose any limitations on the functions and usage scope of the embodiments of the present application.

[0084] The electronic device is presented in the form of a general-purpose computing device. The components of the electronic device may include, but are not limited to: at least one of the above-mentioned processors, at least one of the above-mentioned memories, and a bus connecting different system components (including the memory and the processor).

[0085] Among them, the memory stores program code, and the program code can be executed by the processor, so that the processor executes the steps according to various exemplary embodiments of the present application described in the above "Exemplary Method" section of this specification.

[0086] The memory may include a readable medium in the form of a volatile memory, such as a random access memory (RAM) and / or a cache memory, and may further include a read-only memory (ROM).

[0087] The memory may also include a program / utility having a set (at least one) of program modules. Such program modules include, but are not limited to: an operating system, one or more application programs, other program modules, and program data. The implementation of a network environment may be included in each or some combination of these examples.

[0088] The bus may represent one or more of several types of bus structures, including a memory bus or a memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any bus structure in a variety of bus structures.

[0089] The electronic device can also communicate with one or more external devices (such as a keyboard, a pointing device, a Bluetooth device, etc.), and can also communicate with one or more devices that enable a user to interact with the electronic device, and / or communicate with any device that enables the electronic device to communicate with one or more other computing devices (such as a router, a modem, etc.). Such communication can be carried out through an input / output (I / O) interface. Moreover, the electronic device can also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through a network adapter. As shown in the figure, the network adapter communicates with other modules of the electronic device through a bus. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in combination with the electronic device, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0090] Through the description of the above embodiments, those skilled in the art can easily understand that the exemplary embodiments described herein can be implemented by software, or can be implemented by a combination of software and necessary hardware. Therefore, the technical solutions according to the embodiments of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiments of the present application.

[0091] In an exemplary embodiment of the present application, there is also provided a computer-readable storage medium, on which a program product capable of implementing the above method of this specification is stored. In some possible implementation manners, various aspects of the present application can also be implemented in the form of a program product, which includes program code. When the program product runs on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary embodiments of the present application described in the above "Exemplary Method" section of this specification.

[0092] The program product can adopt any combination of one or more readable media. The readable media can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0093] A computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which readable program code is carried. Such a propagated data signal may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The readable signal medium may also be any readable medium other than a readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0094] The program code contained on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0095] The program code for performing the operations of the present application may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and also including conventional procedural programming languages such as the "C" language or similar programming languages. The program code may be executed entirely on the user's computing device, partially on the user's device, executed as a stand-alone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user's computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or, alternatively, may be connected to an external computing device (e.g., by connecting through the Internet using an Internet service provider).

[0096] In addition, the above-mentioned drawings are only schematic illustrations of the processes included in the method according to the exemplary embodiments of the present application, rather than for limiting purposes. It is easy to understand that the processes shown in the above-mentioned drawings do not indicate or limit the time sequence of these processes. Additionally, it is also easy to understand that these processes may be executed synchronously or asynchronously, for example, in multiple modules.

[0097] It should be noted that although several modules or units of a device for performing actions are mentioned in the above detailed description, such a division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more of the above-mentioned modules or units may be embodied in one module or unit. Conversely, the features and functions of one module or unit described above may be further divided and embodied by multiple modules or units.

[0098] The above is only the specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by those skilled in the art within the technical scope disclosed in the present application should be covered within the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A data updating method, characterized in that: The method comprises: S110, in response to detecting that the amount of key flight data stored in the second data storage module is equal to a preset data amount threshold, controlling the second data storage module to cluster each key flight data in the second data storage module to obtain b first key clustering clusters; S120, controlling the second data storage module to cluster the key flight data in each first key clustering cluster to obtain b second key clustering cluster lists; the values ​​of the modified fields of all the key flight data included in each second key clustering cluster are the same; S130, controlling the second data storage module to obtain a data update instruction list set ZG according to each second key cluster list; each second key cluster has a corresponding data update instruction; and the data update instructions corresponding to any two second key clusters are different; S140, control the second data storage module to update the original flight data and / or key flight data stored in the first data storage module according to ZG; wherein the first data storage module is used to store the original flight data and the key flight data updated according to the second data storage module; the key flight data is obtained after the original flight data or the key flight data is modified and processed; the second data storage module is used to store the key flight data obtained according to the data processing module; the storage space of the second data storage module is smaller than the storage space of the first data storage module; each original flight data or key flight data includes a number of fields.

2. The data updating method according to claim 1, characterized in that: The first data storage module is also used to store planning data, adjustment file data and calculation result data; wherein the planning data is used to calculate the flight execution rate, and the adjustment file data is used to generate target modification instructions to modify the original flight data and / or key flight data.

3. The data updating method according to claim 2, characterized in that: The data processing module is also used to perform flight rate calculation processing according to the target query instruction; and send the calculation result data obtained by the flight rate calculation processing to the second data storage module for storage.

4. The data updating method according to claim 3, characterized in that: The second data storage module is also used to store the calculation result data obtained by the data processing module through the flight rate calculation processing.

5. The data updating method according to any one of claims 1 to 4, characterized in that: The method further comprises: S160, if the amount of key flight data stored in the second data storage module is less than the preset data amount threshold, and the second data storage module receives a target modification instruction from the data processing module, then obtain a target key flight data list MG corresponding to the target modification instruction = (MG1, MG2, ..., MG x , …, MG y ); x=1, 2, ..., y; wherein y is the number of target critical flight data corresponding to the target modification instruction in the second data storage module; MG x The target modification instruction is the xth target key flight data corresponding to the target modification instruction in the second data storage module; the unique identification sequence, departure place identification and destination identification of the target key flight data are all the same as the unique identification sequence, departure place identification and destination identification corresponding to the target modification instruction; and the executed time of the target key flight data is within the modification time period corresponding to the target modification instruction, and the modification value corresponding to the field to be modified corresponding to the target modification instruction is different from the value of the key field corresponding to the target key flight data; the key field is the same field as the field to be modified corresponding to the target modification instruction; the target modification instruction has a corresponding unique identification sequence, departure place identification, destination identification and modification time period; and the target modification instruction has a corresponding field to be modified and a modification value corresponding to the field to be modified; each key flight data has a corresponding unique identification sequence, departure place identification, destination identification and executed time; S170, modify the value of the key field corresponding to each target key flight data in the MG according to the modification value of the field to be modified corresponding to the target modification instruction, so that the value of the key field corresponding to each target key flight data is the same as the modification value of the field to be modified corresponding to the target modification instruction.

6. The data updating method according to claim 4, characterized in that: The second data storage module is provided with a first storage unit and a second storage unit; wherein the first storage unit is used to store calculation result data and original flight data not included in the first data storage module; and the second storage unit is used to store key flight data obtained according to the data processing module.

7. A data updating system, characterized in that: The system comprises: a first clustering unit, configured to control the second data storage module to cluster each key flight data in the second data storage module in response to detecting that the amount of key flight data stored in the second data storage module is equal to a preset data amount threshold, so as to obtain b first key clustering clusters; A second clustering unit is used to control the second data storage module to cluster the key flight data in each first key clustering cluster to obtain b second key clustering cluster lists; the values ​​of the modified fields of all the key flight data included in each second key clustering cluster are the same; The instruction update unit is used to control the second data storage module to obtain a data update instruction list set ZG according to each second key cluster list; each second key cluster has a corresponding data update instruction; and any two second key clusters have different corresponding data update instructions; A data updating unit is used to control the second data storage module to update the original flight data and / or key flight data stored in the first data storage module according to ZG; wherein the first data storage module is used to store the original flight data and the key flight data updated according to the second data storage module; the key flight data is obtained after the original flight data or the key flight data is modified and processed; the second data storage module is used to store the key flight data obtained according to the data processing module; the storage space of the second data storage module is smaller than the storage space of the first data storage module; each original flight data or key flight data includes a number of fields.

8. A non-transitory computer-readable storage medium, characterized in that: The storage medium stores at least one instruction or at least one program, and the at least one instruction or the at least one program is loaded and executed by the processor to implement the method according to any one of claims 1 to 6.

9. An electronic device, characterized in that: The invention comprises a processor and the non-transitory computer-readable storage medium as claimed in claim 8.

Citation Information

Patent Citations

  • Generating real-time aggregates at scale for inclusion in one or more modified fields in a produced subset of data

    CN112868000A

  • Heterogeneous data source synchronization method and system, electronic equipment and storage medium

    CN117435670A