Data updating method, system, medium and equipment

By clustering and generating a data update instruction list in the second data storage module, the problem of excessive interactions during large-scale actual flight data processing is solved, and data processing efficiency and system performance are improved.

CN119961277AActive Publication Date: 2025-05-09MOBILE TECH COMPANY CHINA TRAVELSKY HLDG
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202510438552.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-04-09
Publication Date
2025-05-09
Estimated Expiration
2045-04-09

AI Technical Summary

Technical Problem

When the prior art processes large-scale actual flight data, the process method by piece leads to a sharp increase in the number of interactions between the data processing module and the database, resulting in an extended system response time, a degradation of database performance, and may even cause system instability.

Method used

By clustering in the second data storage module, a data update instruction list is generated, the number of interactions with the first data storage module during data update is reduced, and data processing efficiency is improved.

Benefits of technology

It effectively reduces the number of interactions between the data processing module and the database, improves the data processing speed, and reduces the system response time and database load.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119961277A_ABST
    Figure CN119961277A_ABST
Patent Text Reader

Abstract

The invention provides a data updating method and system, a medium and equipment, and relates to the technical field of data processing, and the method comprises the steps: controlling a second data storage module to carry out clustering in response to the detection that the number of key flight data stored in the second data storage module is equal to a preset data number threshold value, so as to obtain b first key clusters; controlling a second data storage module to cluster each first key cluster to obtain a plurality of second key cluster lists; controlling a second data storage module to obtain a data updating instruction list set ZG according to each second key cluster list; and controlling the second data storage module to update the original flight data and / or the key flight data stored in the first data storage module according to the ZG. According to the method and the device, the modification instruction is generated for the type of key flight data which modifies the same field and has the same field value after modification, so that the occupation of computing resources is reduced, and the data updating efficiency is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Background Art

[0002] At a time when the global civil aviation industry is booming, accurately calculating the flight rate is of vital importance to airlines' operational management, resource allocation, and service quality improvement. As a key indicator to measure the efficiency of airline flight execution, the accurate calculation of the flight rate depends on the scientific processing and analysis of actual flight data.

[0003] With the continuous expansion of civil aviation business, the amount of actual flight data generated by airlines every day has exploded. In order to obtain a more accurate flight rate, the industry generally adopts the method of correcting the actual flight data based on the adjustment file and then calculating the flight rate. The adjustment file contains various factors that affect the flight operation, such as flight delays caused by weather, temporary route changes and other information. Through targeted modifications to the original flight data, the calculation results of the flight rate can be made more in line with the actual operating conditions.

[0004] However, the existing technology has significant drawbacks when handling this process. Since in actual operation, the same data may need to be modified multiple times due to various factors, the current related technologies mostly adopt a one-by-one processing method. That is, after obtaining the actual flight data, each piece of data is modified in turn according to the instructions in the adjustment file, and the flight rate is calculated after the modification is completed. When the amount of data is small, the impact of this one-by-one processing method on system performance is not prominent, and the flight rate calculation task can be completed relatively smoothly.

[0005] But when faced with large-scale actual flight data, problems arise one after another. Taking a large airline as an example, the number of flights taking off and landing every day may be thousands, and the corresponding amount of actual flight data is huge and complex. Using a one-by-one processing method, the data processing module needs to frequently read data from the database, and each time a piece of data is modified, it needs to interact with the database to store the modification results, and so on. This causes the number of interactions between the data processing module and the database to grow exponentially. Frequent data interactions not only greatly increase the response time of the system and extend the time required for flight rate calculation, but also have a serious impact on the performance of the database, resulting in excessive database load, and may even cause system instability, affecting the normal operation of other database-related businesses. Summary of the invention

[0006] In response to the above technical problems, the present application provides a data updating method, system, medium and device, which at least partially solve the problems existing in the prior art.

[0007] In a first aspect of the present application, a data updating method is provided, the method comprising: S110, in response to detecting that the amount of key flight data stored in the second data storage module is equal to a preset data amount threshold, controlling the second data storage module to cluster each key flight data in the second data storage module to obtain b first key clustering clusters; S120, controlling the second data storage module to cluster the key flight data in each first key clustering cluster to obtain b second key clustering cluster lists; the values ​​of the modified fields of all the key flight data included in each second key clustering cluster are the same; S130, controlling the second data storage module to obtain a data update instruction list set ZG according to each second key cluster list; each second key cluster has a corresponding data update instruction; and the data update instructions corresponding to any two second key clusters are different; S140, control the second data storage module to update the original flight data and / or key flight data stored in the first data storage module according to ZG; wherein the first data storage module is used to store the original flight data and the key flight data updated according to the second data storage module; the key flight data is obtained after the original flight data or the key flight data is modified and processed; the second data storage module is used to store the key flight data obtained according to the data processing module; the storage space of the second data storage module is smaller than the storage space of the first data storage module; each original flight data or key flight data includes a number of fields.

[0008] In a second aspect of the present application, a data updating system is provided, the system comprising: a first clustering unit, configured to control the second data storage module to cluster each key flight data in the second data storage module in response to detecting that the amount of key flight data stored in the second data storage module is equal to a preset data amount threshold, so as to obtain b first key clustering clusters; A second clustering unit is used to control the second data storage module to cluster the key flight data in each first key clustering cluster to obtain b second key clustering cluster lists; the values ​​of the modified fields of all the key flight data included in each second key clustering cluster are the same; The instruction update unit is used to control the second data storage module to obtain a data update instruction list set ZG according to each second key cluster list; each second key cluster has a corresponding data update instruction; and any two second key clusters have different corresponding data update instructions; A data updating unit is used to control the second data storage module to update the original flight data and / or key flight data stored in the first data storage module according to ZG; wherein the first data storage module is used to store the original flight data and the key flight data updated according to the second data storage module; the key flight data is obtained after the original flight data or the key flight data is modified and processed; the second data storage module is used to store the key flight data obtained according to the data processing module; the storage space of the second data storage module is smaller than the storage space of the first data storage module; each original flight data or key flight data includes a number of fields.

[0009] In a third aspect of the present application, a non-transitory computer-readable storage medium is provided, in which at least one instruction or at least one program is stored, and the at least one instruction or at least one program is loaded and executed by a processor to implement the aforementioned data updating method.

[0010] In a fourth aspect of the present application, an electronic device is provided, comprising a processor and the above-mentioned non-transitory computer-readable storage medium.

[0011] This application has at least the following beneficial effects: The data updating method provided by the present application, each original flight data or key flight data includes several fields; if it is detected that the number of key flight data stored in the second data storage module is equal to the preset data quantity threshold, then it means that the space of the second data storage space has been fully occupied, and at this time, the key flight data stored in the second data storage module needs to be returned to the first data storage module with a larger storage space. The second data storage module stores the updated data obtained after modification according to the target modification instruction, and the data here can be the full amount of data, that is, the data itself is replaced as a whole, or only the modified fields can be stored. Then, clustering is performed according to the field identifier of the modified field, that is, the key flight data with the same field modified are first clustered into one category. For example: the modified departure airport is grouped into one category, and the modified execution date is grouped into one category. Further, after the first clustering, a secondary clustering is performed in each first key clustering cluster, and the secondary clustering is to cluster the same field modified and the modified field values ​​into one category again. Here, each second key clustering cluster has a corresponding data update instruction, and the data update instruction is used to control the modification of each data corresponding to the above-mentioned key flight data in the first data storage module. The present application generates a modification instruction for a class of critical flight data in which the same field is modified and the modified field value is the same, thereby reducing the usage of computing resources and improving the efficiency of data updating. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0013] Figure 1 A flowchart of a data updating method provided in an embodiment of the present application; Figure 2 This is a structural block diagram of the data update system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0014] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0015] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0016] It should be noted that various aspects of the embodiments within the scope of the appended claims are described below. It should be apparent that the aspects described herein may be embodied in a wide variety of forms, and any specific structure and / or function described herein is merely illustrative. Based on the present application, it should be understood by those skilled in the art that an aspect described herein may be implemented independently of any other aspect, and two or more of these aspects may be combined in various ways. For example, any number of aspects described herein may be used to implement the device and / or practice the method. In addition, other structures and / or functionalities other than one or more of the aspects described herein may be used to implement this device and / or practice this method.

[0017] Please refer to Figure 1As shown, an embodiment of the present application provides a data updating method. The method is applied to a data updating system, which includes: a data processing module, a first data storage module, and a second data storage module, wherein the first data storage module is used to store original flight data and key flight data updated according to the second data storage module; the key flight data is obtained by the data processing module after modifying the original flight data or the key flight data; the second data storage module is used to store the key flight data obtained according to the data processing module; wherein the storage space of the second data storage module is smaller than the storage space of the first data storage module; the second data storage module has a corresponding preset data quantity threshold; each key flight data in the second data storage module has corresponding original flight data or key flight data in the first data storage module; if the number of key flight data stored in the second data storage module is equal to the preset data quantity threshold, the original flight data corresponding to each key flight data stored in the first data storage module is updated according to each key flight data stored in the second data storage module; each original flight data or key flight data includes a number of fields.

[0018] Specifically, the data processing device provided by the present application includes a data processing module, a first data storage module and a second data storage module, wherein the data processing module can calculate the flight rate according to the needs of the user, as an example: the flight rate of a certain flight in a certain season can be calculated. The flight rate of a certain flight in a certain season is the actual number of flights of the flight in the season and the number of planned flights of the flight in the season. Among them, the actual number of flights of the flight in the season refers to the number of times the flight actually takes off and completes the voyage according to the flight plan in this particular season. The number of planned flights of the flight in the season refers to the number of flights planned to be executed in this season that the airline has formulated for the flight before the start of this particular season based on market demand, route planning, resource allocation and other factors. However, due to various factors in the actual execution process, the flight will be rescheduled, the number of flights will be increased, etc. Therefore, there is a corresponding adjustment file for the flight in the season, and the adjustment file records the time periods in which the flight has been rescheduled, increased, etc. in the season.

[0019] In addition, in order to improve the accuracy of the calculation of the flight rate, it is necessary to modify some of the relevant original flight data according to the adjustment file. For example, flight A is scheduled to fly on Mondays, Wednesdays, and Fridays during the flight season from March 2024 to September 2024. However, due to some reasons, during a week between March 2024 and September 2024, flight A is adjusted to fly on Tuesdays, Thursdays, and Saturdays (the content recorded in the adjustment file), and flight A also flies normally on Tuesdays, Thursdays, and Saturdays during that week. At this time, when calculating the flight rate of flight A during the flight season from March 2024 to September 2024, if the actual flight data is not modified to Mondays, Wednesdays, and Fridays during the adjusted week, these three flight data will be omitted, so the actual flight data of the adjusted week needs to be adjusted back to Tuesdays, Thursdays, and Saturdays. Therefore, the modification of some of the relevant original flight data according to the adjustment file in this embodiment is described in the above example.

[0020] When generating a target query instruction, the data processing module can obtain the corresponding original flight data in the first data storage module and generate a corresponding target modification instruction based on each original flight data corresponding to the target query instruction if there is adjustment data that can match the original flight data in the adjustment file. That is, each target query instruction has a corresponding target modification instruction. After the corresponding target modification instruction is executed, the data correction is completed. At this time, the data query result obtained based on the corrected data is more accurate, and the final flight rate calculation result is also more accurate.

[0021] Furthermore, the first data storage module in this embodiment can be a database, which is usually used to persistently store a large amount of data, and the data is stored on a non-volatile storage medium such as a hard disk. Even if the computer is powered off, the data will not be lost. It has a large storage capacity and can easily accommodate massive amounts of data, but the data reading and writing speed is relatively slow. The first data storage module is used to store original flight data, planned flight data, and adjustment files corresponding to multiple flights, wherein the original flight data is actual flight data. Each piece of flight data may include multiple fields, as an example: including information such as the flight number, the airport identification of the departure airport, the airport identification of the landing airport, the actual flight date, and the corresponding actual flight time.

[0022] The second data storage module is a memory, which is a temporary storage area of ​​the computer and is used to temporarily store the data and program instructions currently being processed by the CPU. Its data reading and writing speed is extremely fast and can interact with the CPU at high speed, but its capacity is relatively small. In this embodiment, the second data storage module is used to store the key flight data obtained according to the data processing module. Here, the key flight data is the flight data obtained after modifying the original flight data according to the adjustment file. Therefore, each key flight data in the second data storage module has corresponding original flight data in the first data storage module. And the storage space of the memory is smaller than the storage space of the database. The second data storage module also has a corresponding preset data quantity threshold. As an example: the preset data quantity threshold is 1000. That is, whenever the number of key flight data stored in the second data storage module is equal to 1000, the key flight data stored in the second data storage module will fall back to the first data storage module. That is, the original flight data corresponding to each key flight data is updated.

[0023] It should be noted that, from the above, it can be seen that the first data storage module stores not only original flight data but also key flight data, and the key flight data here comes from the second data storage module.

[0024] In summary, compared with the prior art, this embodiment sets up a second data storage module, that is, utilizes the temporarily set up memory space to reduce the number of interactions between the data processing module and the database. Since the data reading and writing speed of the memory is extremely fast compared to the database, the overall data processing time is reduced and the data processing speed is improved.

[0025] The method comprises: S110, in response to detecting that the amount of key flight data stored in the second data storage module is equal to a preset data amount threshold, controlling the second data storage module to cluster each key flight data in the second data storage module to obtain b first key clustering clusters.

[0026] Specifically, step S110 includes: S111, in response to detecting that the amount of key flight data stored in the second data storage module is equal to the preset data amount threshold, acquiring each key flight data in the second data storage module to obtain a key flight data list G=(G1, G2, ..., G x , …, G y ); x=1, 2, ..., y; wherein y is the preset data quantity threshold corresponding to the second data storage module; G x It is the xth key flight data stored in the second data storage module.

[0027] Here, each original flight data or key flight data contains several fields; if it is detected that the number of key flight data stored in the second data storage module is equal to the preset data quantity threshold, it means that the space in the second data storage module has been fully occupied, and the key flight data stored in the second data storage module needs to be returned to the first data storage module with larger storage space.

[0028] S112, control the second data storage module to obtain a number of first key clusters according to G, so as to obtain a first cluster list YJ=(YJ1, YJ2, ..., YJ a , …, YJ b ); a=1, 2, ..., b; where b is the number of the first key clustering clusters; YJ a is the cluster identifier of the ath first key cluster; YJ a The modified fields of all critical flight data contained within the same field have the same field identifier.

[0029] Specifically, the second data storage module stores updated data obtained after modification according to the target modification instruction. The data here can be full data, that is, the data itself is replaced as a whole, or only the modified fields can be stored. Then, clustering is performed according to the field identifier of the modified field, that is, first, the key flight data with the same field modified are clustered into one category. The modified departure airport is clustered into one category, and the modified execution date is clustered into another category.

[0030] S120, controlling the second data storage module to cluster the key flight data in each first key clustering cluster to obtain b second key clustering cluster lists; the values ​​of the modified fields of all the key flight data included in each second key clustering cluster are the same.

[0031] Here, the second data storage module is controlled to obtain the second key cluster list set EJ=(EJ1, EJ2, ..., EJ a , …, E. J. b ); among them, EJ a is a list of second key clusters obtained by clustering all key flight data in the ath first key cluster; EJ a =(EJ a,1 , E.J. a,2 , …, E. J. a,c , …, E. J. a,f(a) ); c = 1, 2, ..., f(a); f(a) is EJ a The number of corresponding second key clusters; EJ a,c is the cluster identifier of the cth second key cluster obtained by clustering all the key flight data in the ath first key cluster; EJ a,cHere, after the first clustering, a second clustering is performed in each first key clustering cluster. The second clustering is to cluster the modified fields of the same field and the modified fields with the same values ​​into one category.

[0032] S130, controlling the second data storage module to obtain a data update instruction list set ZG according to each second key cluster list; each second key cluster has a corresponding data update instruction; and the data update instructions corresponding to any two second key clusters are different.

[0033] Here, the second data storage module is controlled according to EJ to obtain a data update instruction list set ZG=(ZG1, ZG2, ..., ZG a ,…,ZG b );Among them, ZG a For EJ a Corresponding data update instruction list; ZG a =(ZG a,1 , ZG a,2 ,…,ZG a,c ,…,ZG a,f(a) );ZG a,c For EJ a,c Corresponding data update instructions; the data update instructions corresponding to any two second key clusters are different.

[0034] Each second key cluster has a corresponding data update instruction, and the data update instruction is used to control the modification of each data corresponding to the above-mentioned key flight data in the first data storage module.

[0035] S140, control the second data storage module to update the original flight data and / or key flight data stored in the first data storage module according to ZG; wherein the first data storage module is used to store the original flight data and the key flight data updated according to the second data storage module; the key flight data is obtained after the original flight data or the key flight data is modified and processed; the second data storage module is used to store the key flight data obtained according to the data processing module; the storage space of the second data storage module is smaller than the storage space of the first data storage module; each original flight data or key flight data includes a number of fields.

[0036] In this embodiment, for a type of critical flight data in which the same field is modified and the modified field value is the same, one modification instruction is generated, which reduces the usage of computing resources and improves the efficiency of data updating.

[0037] In an exemplary embodiment of the present application, the second data storage module is used to store target modification instructions sent by the data processing module; the target modification instructions are used when the number of target modification instructions stored in the second data storage module is less than the preset instruction number threshold, and when the data processing module executes the target query instruction, the original flight data and / or key flight data corresponding to the target query instruction in the first data storage module are modified; and when the number of target modification instructions stored in the second data storage module is equal to the preset instruction number threshold, the original flight data corresponding to each target modification instruction stored in the first data storage module is updated according to each target modification instruction stored in the second data storage module.

[0038] In an exemplary embodiment of the present application, the first data storage module is also used to store planning data, adjustment file data and calculation result data; wherein the planning data is used to calculate the flight execution rate, and the adjustment file data is used to generate target modification instructions to modify the original flight data and / or key flight data.

[0039] In an exemplary embodiment of the present application, the data processing module is also used to perform flight rate calculation processing according to the target query instruction; and send the calculation result data obtained by the flight rate calculation processing to the second data storage module for storage.

[0040] In an exemplary embodiment of the present application, the second data storage module is also used to store the calculation result data obtained by the data processing module performing flight rate calculation processing.

[0041] In an exemplary embodiment of the present application, the method further includes: S160, if the amount of key flight data stored in the second data storage module is less than the preset data amount threshold, and the second data storage module receives a target modification instruction from the data processing module, then obtain a target key flight data list MG corresponding to the target modification instruction = (MG1, MG2, ..., MG x , …, MG y ); x=1, 2, ..., y; wherein y is the number of target critical flight data corresponding to the target modification instruction in the second data storage module; MG xThe target modification instruction is the xth target key flight data corresponding to the target modification instruction in the second data storage module; the unique identification sequence, departure place identification and destination identification of the target key flight data are all the same as the unique identification sequence, departure place identification and destination identification corresponding to the target modification instruction; and the executed time of the target key flight data is within the modification time period corresponding to the target modification instruction, and the modification value corresponding to the field to be modified corresponding to the target modification instruction is different from the value of the key field corresponding to the target key flight data; the key field is the same field as the field to be modified corresponding to the target modification instruction; the target modification instruction has a corresponding unique identification sequence, departure place identification, destination identification and modification time period; and the target modification instruction has a corresponding field to be modified and a modification value corresponding to the field to be modified; each key flight data has a corresponding unique identification sequence, departure place identification, destination identification and executed time; S170, modify the value of the key field corresponding to each target key flight data in the MG according to the modification value of the field to be modified corresponding to the target modification instruction, so that the value of the key field corresponding to each target key flight data is the same as the modification value of the field to be modified corresponding to the target modification instruction.

[0042] In this embodiment, in some special cases, when the critical flight data is still stored in the second data storage module and has not yet fallen into the first data storage module, the modified critical flight data may be modified for the second time. At this time, the critical flight data in the cache is modified, so that when the critical flight data in the second data storage module falls back to the first data storage module, a corresponding modification instruction is generated to modify the original flight data or critical flight data in the first data storage module, so as to save resource usage and avoid frequent interaction between the data processing module and the database (first data storage module). Save data processing time.

[0043] In an exemplary embodiment of the present application, the second data storage module is provided with a first storage unit and a second storage unit; wherein the first storage unit is used to store calculation result data and original flight data not included in the first data storage module; and the second storage unit is used to store key flight data obtained according to the data processing module.

[0044] Specifically, the calculation result data and the original flight data not included in the first data storage module are newly added data for the first data storage module, while the key flight data obtained according to the data processing module is modified data for the first data storage module. In the second data storage module of this embodiment, the newly added data and the modified data are stored separately, and all the newly added data in the first storage unit correspond to one instruction when they fall into the first data storage module. In one embodiment, the newly added data is processed first.

[0045] In an exemplary embodiment of the present application, the data processing module is used to perform the following steps: S210, obtaining a target query instruction; wherein the target query instruction has a corresponding target unique identification sequence, a target departure place identification, a target destination identification and a target query time period.

[0046] Among them, each original flight data and each key flight data has a corresponding unique identification sequence, departure identifier, destination identifier and execution time, wherein the unique identification sequence can be the flight number, the departure identifier can be the airport identifier of the departure airport, the destination identifier can be the airport identifier of the landing airport, and the execution time can be the execution time of the flight.

[0047] Here, the target query instruction is a query instruction determined by the data processing module according to the needs of the user. For example, the target query instruction may be to obtain the actual flight data of flight A from Airport A to Airport B from March 2024 to September 2024. Here, the target query instruction has a corresponding target unique identification sequence, a target departure place identification, a target destination identification, and a target query time period.

[0048] S220, acquiring some original flight data and / or key flight data from the first data storage module according to the target query instruction, and obtaining a first data list Y=(Y1, Y2, ..., Y i , …, Y n ); i=1, 2, ..., n; wherein n is the number of original flight data and / or key flight data in the first data storage module whose corresponding executed time is within the target query time period and whose unique identification sequence, departure place identification and destination identification are the same as the target unique identification sequence, target departure place identification and target destination identification; Y i The target query instruction corresponds to the i-th original flight data or key flight data in the first data storage module.

[0049] Specifically, each original flight data and / or key flight data in the first data list is the original flight data and / or key flight data in the first data list whose corresponding execution time is within the target query time period, and whose unique identification sequence, departure place identification and destination identification are the same as the target unique identification sequence, target departure place identification and target destination identification.

[0050] S230, acquiring some key flight data from the second data storage module according to the target query instruction, and obtaining a second data list E=(E1, E2, ..., E j ,…,E m); j=1, 2, ..., m; m is the number of key flight data in the second data storage module whose corresponding executed time is within the target query time period and whose unique identification sequence, departure place identification and destination identification are the same as the target unique identification sequence, target departure place identification and target destination identification; E j The j-th key flight data corresponding to the target query instruction in the second data storage module; m≤n.

[0051] S240, if E is not empty, update Y according to E to obtain a third data list Y'=(Y1', Y2', ..., Y i ', ..., Y n '); where Y i ' is the i-th original flight data and / or key flight data; if Y i 'The corresponding unique identification sequence, departure location identification, destination identification and elapsed time are the same as E j If the corresponding unique identification sequence, departure location identification, destination identification and elapsed time are the same, then determine Y i '=E j If Y i 'The corresponding unique identification sequence, departure location identification, destination identification and execution time are different from each key flight data in E, then Y i '=Y i ; The third data list is used to process the target query instruction.

[0052] Specifically, since each time the data processing module modifies the data, the key flight data obtained is first stored in the second data storage module, the data in the second data storage module is more accurate than the data in the second data storage module. For example, the original flight data of flight A from Airport A to Airport B on May 18, 2024 is stored in the first data storage module, but due to the record of the adjustment file, May 18, 2024 should be modified to May 17, 2024. The key flight data obtained after the modification of this original flight data may be stored in the second data storage module. And the ID corresponding to this data has not been changed (unique identification sequence, departure place identification, destination identification and execution time), therefore, if there is data with the same ID in the second data storage module and the first data storage module at the same time, the winning data in the obtained third data list adopts the corresponding data in the second data storage module. Thus, an updated third data list is obtained, wherein the third data list may contain some original flight data from the first data storage module, which has not been modified; and there may also be some key flight data from the first data storage module, which has been modified by the data processing module and falls back to the first data storage module after the storage in the second data storage module reaches the upper limit. At this time, the data does not exist in the second data storage module; in addition, there may also be some key flight data from the second data storage module, which has been modified by the data processing module and temporarily stored in the second data storage module, which has not yet fallen back to the first data storage module, but in the first data storage module, there are corresponding original flight data or key flight data (modified once and again). Therefore, for this part of the data, the data in the second data storage module should be trusted.

[0053] The method provided in this embodiment makes the query result, that is, the third data list, more accurate and can accurately identify the modified data, so that the query result finally returned is more accurate and the subsequent calculation results are also more accurate.

[0054] In an exemplary embodiment of the present application, the second data storage module is also used to store the calculation result data obtained by the data processing module performing the flight rate calculation processing.

[0055] In an exemplary embodiment of the present application, the second data storage module is used to store target modification instructions sent by the data processing module; the target modification instructions are used when the number of target modification instructions stored in the second data storage module is less than the preset instruction number threshold, and when the data processing module executes the target query instruction, the original flight data and / or key flight data corresponding to the target query instruction in the first data storage module are modified; and when the number of target modification instructions stored in the second data storage module is equal to the preset instruction number threshold, the original flight data corresponding to each target modification instruction stored in the first data storage module is updated according to each target modification instruction stored in the second data storage module.

[0056] Specifically, after step S220, the data processing module is used to perform the following steps: S250, if the second data storage module is not empty, obtain a target modification instruction list X=(X1, X2, . . . , X d , …, X e );d=1,2,…,e;wherein, e is the number of target modification instructions contained in the second data storage module; X d The dth target modification instruction contained in the second data storage module.

[0057] S260, update Y according to the target modification instruction to obtain a third data list Y'=(Y1', Y2', ..., Y i ', ..., Y n '); where Y i 'For Y i Updated original flight data or key flight data; if Y i 'The corresponding unique identification sequence, departure location identification and destination identification are d The corresponding unique identification sequence, departure location identification and destination identification are the same, and Y i 'The corresponding execution time is in X d Corresponding modification time period; then according to X d Update Y i Get Y i '; If Y i 'The corresponding unique identification sequence, departure location identification, destination identification and execution time are the same as X d If the corresponding unique identification sequence, departure location identification, destination identification and elapsed time are all different, then determine Y i '=Y i .

[0058] S270, executing the target query instruction according to Y'.

[0059] In this embodiment, the second data storage module stores the target modification instruction corresponding to the target query instruction. At this time, when the data processing module executes the corresponding target query instruction, the matching original flight data or key flight data is first screened in the first data storage module. (That is, the original flight data and / or key flight data whose execution time is within the target query time period and whose unique identification sequence, departure place identification and destination identification correspond to the target unique identification sequence, target departure place identification and target destination identification) At this time, if the second data storage module is not empty, it means that some data in Y may need to be modified. At this time, some data in the first data storage module is modified according to the target modification instruction in the second data storage module to obtain a third data list. Finally, the target query instruction is executed according to the third data list to obtain more accurate data corresponding to the target query instruction, so the result of the subsequent flight rate calculation is also more accurate.

[0060] Please refer to Figure 2 As shown, an embodiment of the present application provides a data updating system 100, the system comprising: The first clustering unit 110 is used for controlling the second data storage module to cluster each key flight data in the second data storage module in response to detecting that the amount of key flight data stored in the second data storage module is equal to a preset data amount threshold, so as to obtain b first key clustering clusters; The second clustering unit 120 is used to control the second data storage module to cluster the key flight data in each first key clustering cluster to obtain b second key clustering cluster lists; the values ​​of the modified fields of all the key flight data contained in each second key clustering cluster are the same; The instruction updating unit 130 is used to control the second data storage module to obtain a data updating instruction list set ZG according to each second key cluster list; each second key cluster has a corresponding data updating instruction; and the data updating instructions corresponding to any two second key clusters are different; The data updating unit 140 is used to control the second data storage module to update the original flight data and / or key flight data stored in the first data storage module according to ZG; wherein the first data storage module is used to store the original flight data and the key flight data updated according to the second data storage module; the key flight data is obtained after the original flight data or the key flight data is modified and processed; the second data storage module is used to store the key flight data obtained according to the data processing module; the storage space of the second data storage module is smaller than the storage space of the first data storage module; each original flight data or key flight data includes a number of fields.

[0061] In an exemplary embodiment of the present application, an electronic device capable of implementing the above method is also provided.

[0062] Those skilled in the art will appreciate that various aspects of the present application may be implemented as a system, method or program product. Therefore, various aspects of the present application may be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to as "circuit", "module" or "system" herein.

[0063] The electronic device according to this embodiment of the present application is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0064] The electronic device is presented in the form of a general-purpose computing device. The components of the electronic device may include, but are not limited to: the at least one processor mentioned above, the at least one storage device mentioned above, and a bus connecting different system components (including storage devices and processors).

[0065] The storage stores program codes, which can be executed by the processor, so that the processor executes the steps described in the above “Exemplary Method” section of this specification according to various exemplary embodiments of the present application.

[0066] The memory may include readable media in the form of volatile memory, such as random access memory (RAM) and / or cache memory, and may further include read only memory (ROM).

[0067] The storage may also include a program / utility having a set (at least one) of program modules, such program modules including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0068] The bus may represent one or more of several types of bus structures including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures.

[0069] The electronic device may also communicate with one or more external devices (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may communicate with one or more devices that enable a user to interact with the electronic device, and / or may communicate with any device (e.g., routers, modems, etc.) that enables the electronic device to communicate with one or more other computing devices. This communication may be performed through an input / output (I / O) interface. In addition, the electronic device may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) through a network adapter. As shown in the figure, the network adapter communicates with other modules of the electronic device through a bus. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0070] Through the description of the above implementation methods, it is easy for those skilled in the art to understand that the example implementation methods described here can be implemented by software, or by combining software with necessary hardware. Therefore, the technical solution according to the implementation method of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the implementation method of the present application.

[0071] In an exemplary embodiment of the present application, a computer-readable storage medium is also provided, on which a program product capable of implementing the above method of the present specification is stored. In some possible implementations, various aspects of the present application can also be implemented in the form of a program product, which includes a program code. When the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary implementations of the present application described in the above "Exemplary Method" section of the present specification.

[0072] The program product may adopt any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, a system, device or component of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination thereof. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0073] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0074] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.

[0075] Program code for performing the operations of the present application may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., using an Internet service provider to connect through the Internet).

[0076] In addition, the above-mentioned figures are only schematic illustrations of the processes included in the method according to the exemplary embodiments of the present application, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0077] It should be noted that, although several modules or units of the equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.

[0078] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A data updating method, characterized in that: The method comprises: S110, in response to detecting that the amount of key flight data stored in the second data storage module is equal to a preset data amount threshold, controlling the second data storage module to cluster each key flight data in the second data storage module to obtain b first key clustering clusters; S120, controlling the second data storage module to cluster the key flight data in each first key clustering cluster to obtain b second key clustering cluster lists; the values ​​of the modified fields of all the key flight data included in each second key clustering cluster are the same; S130, controlling the second data storage module to obtain a data update instruction list set ZG according to each second key cluster list; each second key cluster has a corresponding data update instruction; and the data update instructions corresponding to any two second key clusters are different; S140, control the second data storage module to update the original flight data and / or key flight data stored in the first data storage module according to ZG; wherein the first data storage module is used to store the original flight data and the key flight data updated according to the second data storage module; the key flight data is obtained after the original flight data or the key flight data is modified and processed; the second data storage module is used to store the key flight data obtained according to the data processing module; the storage space of the second data storage module is smaller than the storage space of the first data storage module; each original flight data or key flight data includes a number of fields.

2. The data updating method according to claim 1, characterized in that: The first data storage module is also used to store planning data, adjustment file data and calculation result data; wherein the planning data is used to calculate the flight execution rate, and the adjustment file data is used to generate target modification instructions to modify the original flight data and / or key flight data.

3. The data updating method according to claim 2, characterized in that: The data processing module is also used to perform flight rate calculation processing according to the target query instruction; and send the calculation result data obtained by the flight rate calculation processing to the second data storage module for storage.

4. The data updating method according to claim 3, characterized in that: The second data storage module is also used to store the calculation result data obtained by the data processing module through the flight rate calculation processing.

5. The data updating method according to any one of claims 1 to 4, characterized in that: The method further comprises: S160, if the amount of key flight data stored in the second data storage module is less than the preset data amount threshold, and the second data storage module receives a target modification instruction from the data processing module, then obtain a target key flight data list MG corresponding to the target modification instruction = (MG1, MG2, ..., MG x , …, MG y ); x=1, 2, ..., y; wherein y is the number of target critical flight data corresponding to the target modification instruction in the second data storage module; MG x The target modification instruction is the xth target key flight data corresponding to the target modification instruction in the second data storage module; the unique identification sequence, departure place identification and destination identification of the target key flight data are all the same as the unique identification sequence, departure place identification and destination identification corresponding to the target modification instruction; and the executed time of the target key flight data is within the modification time period corresponding to the target modification instruction, and the modification value corresponding to the field to be modified corresponding to the target modification instruction is different from the value of the key field corresponding to the target key flight data; the key field is the same field as the field to be modified corresponding to the target modification instruction; the target modification instruction has a corresponding unique identification sequence, departure place identification, destination identification and modification time period; and the target modification instruction has a corresponding field to be modified and a modification value corresponding to the field to be modified; each key flight data has a corresponding unique identification sequence, departure place identification, destination identification and executed time; S170, modify the value of the key field corresponding to each target key flight data in the MG according to the modification value of the field to be modified corresponding to the target modification instruction, so that the value of the key field corresponding to each target key flight data is the same as the modification value of the field to be modified corresponding to the target modification instruction.

6. The data updating method according to claim 4, characterized in that: The second data storage module is provided with a first storage unit and a second storage unit; wherein the first storage unit is used to store calculation result data and original flight data not included in the first data storage module; and the second storage unit is used to store key flight data obtained according to the data processing module.

7. A data updating system, characterized in that: The system comprises: a first clustering unit, configured to control the second data storage module to cluster each key flight data in the second data storage module in response to detecting that the amount of key flight data stored in the second data storage module is equal to a preset data amount threshold, so as to obtain b first key clustering clusters; A second clustering unit is used to control the second data storage module to cluster the key flight data in each first key clustering cluster to obtain b second key clustering cluster lists; the values ​​of the modified fields of all the key flight data included in each second key clustering cluster are the same; The instruction update unit is used to control the second data storage module to obtain a data update instruction list set ZG according to each second key cluster list; each second key cluster has a corresponding data update instruction; and any two second key clusters have different corresponding data update instructions; A data updating unit is used to control the second data storage module to update the original flight data and / or key flight data stored in the first data storage module according to ZG; wherein the first data storage module is used to store the original flight data and the key flight data updated according to the second data storage module; the key flight data is obtained after the original flight data or the key flight data is modified and processed; the second data storage module is used to store the key flight data obtained according to the data processing module; the storage space of the second data storage module is smaller than the storage space of the first data storage module; each original flight data or key flight data includes a number of fields.

8. A non-transitory computer-readable storage medium, characterized in that: The storage medium stores at least one instruction or at least one program, and the at least one instruction or the at least one program is loaded and executed by the processor to implement the method according to any one of claims 1 to 6.

9. An electronic device, characterized in that: The invention comprises a processor and the non-transitory computer-readable storage medium as claimed in claim 8.

Citation Information

Patent Citations

  • Generating real-time aggregates at scale for inclusion in one or more modified fields in a produced subset of data

    CN112868000A

  • Heterogeneous data source synchronization method and system, electronic equipment and storage medium

    CN117435670A

  • Data warehouse data synchronization method, device and equipment, storage medium and product

    CN117668112A

  • Industrial control system log-oriented high-compression-ratio compression algorithm

    CN118295980A

  • Generating real-time aggregates at scale for inclusion in one or more modified fields in a produced subset of data

    WO2020033314A1