Aviation freight rate data processing method, electronic equipment with aviation freight rate data processing method and storage medium

The freight data pushed by ATPCO is analyzed through user-defined configuration template information, which solves the problem that airlines find it difficult to efficiently import freight data, and realizes the automation and accuracy of data processing.

CN119829612APending Publication Date: 2025-04-15TRAVELSKY TECHNOLOGY LIMITED
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411929072.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-25
Publication Date
2025-04-15

AI Technical Summary

Technical Problem

Because the freight data files pushed by ATPCO have a huge amount of data and a complex structure, it is difficult for airlines to import these data into their own freight management system efficiently and accurately.

Method used

By obtaining and applying user-defined configuration template information, one-to-one analysis rules are set for multiple data types to achieve efficient and accurate analysis of air freight information.

Benefits of technology

It realizes automated processing of air freight data, improves the efficiency and accuracy of data import, and solves the problems of data complexity and resource consumption.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119829612A_ABST
    Figure CN119829612A_ABST
Patent Text Reader

Abstract

The invention discloses an aviation freight rate data processing method, electronic equipment with the aviation freight rate data processing method and a storage medium. The method comprises the steps that aviation freight rate information is acquired, and the aviation freight rate information comprises a plurality of freight rate data of different data types; configuration template information is obtained, the configuration template information is obtained by configuration of the target user, the configuration template information comprises a plurality of configuration templates, the plurality of configuration templates are arranged in one-to-one correspondence with the plurality of data types of the freight rate data, and the configuration templates comprise format processing rules for the freight rate data with the corresponding data types; and analyzing the aviation freight rate information based on the configuration template information to obtain analyzed freight rate information. The technical problem that an airline company is difficult to efficiently and accurately import the data into an own freight rate management system due to the fact that the freight rate data file pushed by ATPCO has a huge data volume and a complex structure is solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and in particular to a method for processing air freight rate data and an electronic device and a storage medium having the same. Background Art

[0002] The freight rate management system provides airlines with business functions such as freight rates, rules, FareClass, Footnote, etc. It helps airlines manage relevant data of international freight rates and provides convenient interface operation and fast operation process.

[0003] ATPCO is an organization that collects and publishes airline fares and rules, as well as fare-related data. If airlines want to sell their air tickets in the international market, they must push their fare data to ATPCO.

[0004] In order to facilitate the management of relevant data on international freight rates and form a closed-loop management of the entire international freight rate data, airlines need to import the freight rate data on ATPCO into the freight rate management system to facilitate the airline's business personnel to adjust the relevant freight rate rules in real time according to the market's ticket sales situation.

[0005] In the prior art, since ATPCO data files contain nearly 200 data types, each type of data structure and field meaning is different, the difficulty and complexity of data parsing are very high. Manual processing of these data files by airlines can easily lead to excessive consumption of system resources and affect the overall operating efficiency.

[0006] To address the above-mentioned problems, no effective solution has been proposed yet. Summary of the invention

[0007] The embodiment of the present invention provides a method for processing airline fare data and an electronic device and a storage medium having the same, so as to at least solve the technical problem that the fare data files pushed by ATPCO have a huge amount of data and a complex structure, which makes it difficult for airlines to efficiently and accurately import these data into their own fare management systems.

[0008] According to one aspect of an embodiment of the present invention, there is provided a method for processing airline fare data, comprising: obtaining airline fare information, wherein the airline fare information includes fare data of different data types; obtaining configuration template information, wherein the configuration template information is configured by a target user, the configuration template information includes a plurality of configuration templates, the plurality of configuration templates are arranged in a one-to-one correspondence with a plurality of data types of fare data, the configuration template includes a parsing rule, the parsing rule is used to format parse the fare data corresponding to the data type; parsing the airline fare information based on the configuration template information to obtain parsed fare information, wherein the parsed fare information at least includes the parsed airline fare and transportation rules.

[0009] Furthermore, obtaining airline fare information includes: obtaining task information, the task information is used to determine the data import range set by the target user in a single task; pulling a target data set from a first target database based on the task information, wherein the target data set is within the data import range; and determining that the target data set is airline fare information.

[0010] Furthermore, the airline fare information is parsed based on the configuration template information to obtain parsed fare information, including: reading the airline fare information row by row to obtain the fare data of the current row; determining the configuration template corresponding to the data type of the fare data of the current row from the configuration template information; and parsing the fare data of the current row based on the configuration template to obtain parsed fare information.

[0011] Further, the freight rate data of the current row is parsed based on the configuration template to obtain parsed freight rate information, including: configuring and intercepting fields of text included in the freight rate data based on the configuration template to obtain multiple field information; and determining the parsed freight rate information based on the multiple field information.

[0012] Furthermore, after parsing the air fare information based on the configuration template information to obtain the parsed fare information, the processing method also includes: deduplicating the parsed fare information to obtain deduplicated fare information; and storing the deduplicated fare information into the second target database.

[0013] Furthermore, the parsed freight information is deduplicated to obtain the deduplicated freight information, including: obtaining a duplication checking rule, the duplication checking rule including a unique judgment expression and a unique judgment value for the parsed freight information; querying in a second target database based on the duplication checking rule; in response to querying in the second target database a data value identical to at least part of the parsed freight information, filtering the identical part queried in the parsed freight information to obtain the deduplicated freight information.

[0014] Furthermore, after parsing the air fare information based on the configuration template information to obtain the parsed fare information, the method further includes: backing up at least one of the parsed fare information and the air fare information.

[0015] According to another aspect of an embodiment of the present invention, there is further provided an electronic device, comprising: a memory storing an executable program; and a processor for running the program, wherein the method in each embodiment of the present invention is executed when the program is running.

[0016] According to another aspect of an embodiment of the present invention, a computer-readable storage medium is provided. The computer-readable storage medium includes a stored executable program, wherein when the executable program is running, the device where the computer-readable storage medium is located is controlled to execute the methods in various embodiments of the present invention.

[0017] According to another aspect of an embodiment of the present invention, a computer program product is provided, including a computer program. When the computer program is executed by a processor, the method in each embodiment of the present invention is implemented.

[0018] In the embodiment of the present invention, a user-defined configuration template is adopted to obtain and apply configuration template information corresponding to multiple data types one by one, so as to achieve the purpose of efficiently and accurately parsing airline fare information, thereby realizing the technical effect of automatically processing airline fare data and improving data import efficiency and accuracy, thereby solving the technical problem that the fare data files pushed by ATPCO have a huge amount of data and a complex structure, which makes it difficult for airlines to efficiently and accurately import these data into their own fare management systems. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0020] Figure 1 is a flow chart of an optional method for processing air fare data according to an embodiment of the present invention;

[0021] Figure 2 is a flow chart of an optional method for processing air fare data according to an embodiment of the present invention;

[0022] Figure 3 The present invention is a flowchart of an optional method for processing air fare data according to an embodiment of the present invention. DETAILED DESCRIPTION

[0023] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0024] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0025] According to an embodiment of the present invention, an embodiment of a method for processing airline fare data is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0026] Figure 1 is a method according to an embodiment of the present invention, such as Figure 1 As shown, the method comprises the following steps:

[0027] Step S102, obtaining air freight rate information;

[0028] Among them, the air fare information includes fare data of different types.

[0029] Optionally, the air freight rate information includes but is not limited to the following data:

[0030] Basic fare data (such as INTALLFARE): This type of data describes the basic fare from a specific departure point to a destination. It usually includes information such as the fare amount, currency type, applicable routes, seasonal adjustments, and passenger types (such as adults and children). This data is the basis for any airfare and an important part of an airline's competitive strategy.

[0031] Rule data (such as R3C003): The fare rule data defines the effective conditions of the fare, including but not limited to the refund and change policy, the minimum stay time, the maximum stay time, the advance booking requirements, the space restrictions, the applicable date range, etc. These rules ensure the rationality and compliance of the fare, and also provide airlines with the flexibility to adjust their pricing strategies.

[0032] Footnotes: Footnotes are explanatory information attached to fares and rules, which may contain special provisions, exceptions, descriptions of additional charges, etc. Footnotes are essential to understanding the complete fare policy and can help airlines and sales agents correctly interpret and apply fares.

[0033] Fare Classes: Fare classes describe different levels or cabins of fares, such as business class, economy class, special fares, etc. Different fare classes usually correspond to different service levels and price policies.

[0034] Specific market data: fare information for specific markets or specific routes, which may include promotional prices, holiday price adjustments, group fares, etc. This type of data reflects the airline's pricing strategy for different markets and customer groups.

[0035] Additional service fee data: including baggage fees, seat selection fees, meal fees, etc. They appear as additional fee items in the total fare, but are also subject to fare rules.

[0036] Special fare data: such as student fares, military fares, senior fares, etc. These fare data provide discounts or specific services for specific groups of people.

[0037] Historical freight rate data: record past freight rate information for analysis and comparison to adjust future pricing strategies.

[0038] Because these freight rate data types are different, each data type has its own specific format and processing rules. As the freight rate data set of the aviation industry, ATPCO contains standardized representations of all the above data types. When receiving these data, airlines need to be able to identify and parse these data types so that they can be correctly imported into their own freight rate management system for subsequent business operations and market analysis.

[0039] Step S104, obtaining configuration template information;

[0040] The configuration template information is obtained by configuring the target user. The configuration template information includes multiple configuration templates. The multiple configuration templates are set in one-to-one correspondence with multiple data types of freight rate data. The configuration template includes parsing rules. The parsing rules are used to perform format parsing on freight rate data corresponding to the data type.

[0041] Alternatively, if Figure 3 As shown in the figure, the configuration template information usually includes the following elements:

[0042] Table name: Mainly responsible for the table in the freight rate management system database that needs to be stored after the data is parsed.

[0043] Text length: The text length here refers specifically to the number of characters in the text line for each field read from the ATPCO data file. When the system reads the data line, it can determine the start and end position of each field based on this length information, thereby accurately extracting the field value.

[0044] Template configuration fields: Field information defined in the configuration template, including the field name, data type, text length, and position in the data row.

[0045] Derived configuration fields: In addition to the fields obtained directly from the data file, the template may also contain the configuration of derived fields. These fields are derived from the original data through logical operations or rules. The processing of derived configuration fields may include data conversion, format adjustment, calculation (such as tax calculation) or obtaining related data by querying the database.

[0046] SQL statement configuration: SQL statements configured for each data type are used to insert the parsed data objects into the corresponding tables in the freight rate management system database.

[0047] Step S106, parsing the airline fare information based on the configuration template information to obtain parsed fare information, where the parsed fare information at least includes the parsed airline fare and transportation rules.

[0048] Optionally, the freight rate management system will read the data line by line from the running file. When a line of data is read, the system will check the characteristics of the line, such as the first few characters, to determine which data type it belongs to (such as INTALLFARE, R3C003, etc.). Subsequently, the system will load the configuration template corresponding to the data type from the configuration template. Based on the configuration template information, the freight rate management system can accurately extract key information such as airline freight rates and transportation rules from the line data.

[0049] In the embodiment of the present invention, a user-defined configuration template is adopted to obtain and apply configuration template information corresponding to multiple data types one by one, so as to achieve the purpose of efficiently and accurately parsing airline fare information, thereby realizing the technical effect of automatically processing airline fare data and improving data import efficiency and accuracy, thereby solving the technical problem that the fare data files pushed by ATPCO have a huge amount of data and a complex structure, which makes it difficult for airlines to efficiently and accurately import these data into their own fare management systems.

[0050] It needs to be further explained that Figure 2 This is a data flow diagram between ATPCO and the freight rate management system, which describes the entire process of airline freight rate data being transmitted from ATPCO to the freight rate management system and finally stored in the database. The airline provides data to ATPCO, which is organized into a series of formatted data files after being standardized by the organization. These files will be uploaded to the FTP server of ATPCO. Once new freight rate files are detected, these files will be automatically downloaded to the FTP file server inside the freight rate management system, and the data format will be parsed, and the original data provided by ATPCO will be converted into structured data rows. After the data is parsed and processed, it will eventually be stored in the database of the freight rate management system.

[0051] In this embodiment, the FTP file service is used as a platform for receiving and storing the original data files pushed by the ATPCO organization. The freight rate management system includes a data pull module, which can periodically obtain data files from this FTP service, and then perform subsequent parsing and storage operations. The FTP server provides a stable, reliable and standardized file transfer method to ensure the secure transmission and timely processing of data.

[0052] As an optional implementation, obtaining airline fare information includes: obtaining task information, the task information is used to determine the data import range set by the target user in a single task; pulling a target data set from a first target database based on the task information, wherein the target data set is within the data import range; and determining that the target data set is airline fare information.

[0053] Optionally, task information is set by the airline or target user of the tariff management system to determine the scope of a single data import operation. This information may include the name of the data file, the file ID, the date range of the data, the airline code, the destination code, etc., depending on the type and range of tariff data that the airline currently needs to update or import. The system obtains these task details by reading the information in the task queue.

[0054] Optionally, after determining the scope of the task, the data pulling module of the freight rate management system will pull the corresponding data files from the first target database (usually ATPCO's FTP server or database) according to the specific conditions in the task information. This process may involve downloading files from the server using the FTP protocol, or directly querying data from ATPCO's database, depending on the storage location and access method of the data.

[0055] Optionally, after the data is pulled, the freight rate management system needs to verify whether the pulled data set meets the format and requirements of the air freight rate data. This is done by checking the header information, field structure or data type identification of the data set. Only after confirming that the data set does contain air freight rate information will it be further processed and imported into the freight rate management system.

[0056] In this embodiment, the fare management system can accurately pull the required air fare data from ATPCO according to the task scope set by the target user, and perform preliminary verification to ensure that subsequent parsing and import operations are based on the correct data set, thereby improving the accuracy and efficiency of data processing.

[0057] As an optional implementation, the airline fare information is parsed based on the configuration template information to obtain parsed fare information, including: reading the airline fare information row by row to obtain the fare data of the current row; determining the configuration template corresponding to the data type of the fare data of the current row from the configuration template information; and parsing the fare data of the current row based on the configuration template to obtain parsed fare information.

[0058] Optionally, the freight data system also includes a data parsing and warehousing module and an import template configuration module. The import template configuration module is mainly responsible for reading the template configuration of all data types into the memory for use by the data parsing and warehousing module. The data parsing and warehousing module is mainly responsible for reading the acquired data file line by line, parsing the read data line into the corresponding data object according to the configuration information in the template configuration, and performing the warehousing operation. The freight data file is usually composed of multiple lines of text, each line represents an independent freight record or data object. The data parsing and warehousing module will first open the data file and then read the data line by line. For each line, the reading operation will obtain the freight data of the current line. After reading a line of freight data, the system will find a matching configuration template from the import template configuration module based on the characteristics of the data line (such as the first few characters, which are usually data type identifiers). Based on the configuration template, the data parsing and warehousing module begins to parse the freight data of the current line, and different configuration templates have different parsing rules.

[0059] Optionally, the INTALLFARE and R3C003 template configurations are defined in Table 1 and Table 2, respectively, which include field names, start and end positions of file reading, and data types corresponding to the fields.

[0060] Table 1. Partial configuration of the INTALLFARE template:

[0061] Field Name File value starting position File value end position Field Type area 1 3 String Airline Name 4 6 String Departure Airport 7 9 String Departure city 12 13 String Arrival at the Airport 14 16 String Departure city 19 20 String Freight rate basis 21 28 String Rule Number 41 44 String One-way round trip sign 45 48 String

[0062] Table 2 R3C003 template partial configuration:

[0063] Field Name File value starting position File value end position Field Type Record 1 1 String action 2 2 String Data Identification 3 5 String Data table number 6 13 String type 14 14 String Data start time 15 20 String Data end time 21 26 String

[0064] In this embodiment, the accuracy and efficiency of data processing can be ensured by analyzing line by line.

[0065] As an optional implementation, the freight rate data of the current row is parsed based on the configuration template to obtain parsed freight rate information, including: configuring and intercepting fields of text included in the freight rate data based on the configuration template to obtain multiple field information; and determining the parsed freight rate information based on the multiple field information.

[0066] Optionally, in a specific embodiment, according to the length of each row of such data, the identifier at the beginning of the row is used to match the configuration of the template configuration library, and the template configuration corresponding to INTALLFARE is configured according to the data row information. According to the template configuration, the 1st to 3rd digits of the row are set to the area field, the 4th to 6th digits are set to the airline field, the 7th to 9th digits are set to the departure airport, the 12th to 13th digits are set to the departure city, the 14th to 16th digits are set to the arrival airport, the 19th to 20th digits are set to the departure city, the 21st to 28th digits are set to the fare basis, the 41st to 44th digits are set to the rule number, and the 45th to 48th digits are set to the one-way round-trip identifier. Assume that in the INTALLFARE data file received from ATPCO, there is a row of data as follows: 980XX TYO JPKSY TRY3XGV00000099JPIT2 0022ATP 00000032500JPY. Based on the configuration template, the system extracts the field values ​​from the data row: region: 980; airline code: XX; departure airport: TYO arrival airport: SY; rate basis: 32500JPY (convert TRY3XGV to the actual currency value of 32500JPY); rule number: 00000099JPIT2; one-way round-trip identifier: 0022ATP; after reading and converting the above data, the system combines all parsed field values, including basic fields and derived fields, into a structured INTALLFARE data object, which contains all necessary freight rate information. Finally, according to the SQL statement in the configuration template, the above parsed information object is converted into a database operation statement, which can be used for subsequent data warehousing and business operations.

[0067] Optionally, in a specific embodiment, according to the length of each row of such data and the identifier at the beginning of the row, the configuration of the template configuration library is matched, and the template configuration corresponding to R3C003 is configured according to the data row information. According to the template configuration, the first bit of the row is set to the record field, the second bit is set to the action field, the 3-5 bits are set to the data identification field, the 6-13 bits are set to the data table number field, the 14th bit is set to the type field, the 15-20 bits are set to the data start time field, and the 21-26 bits are set to the data end field. Assume that there is a row of data in the R3C003 data file received from ATPCO as follows 320030085924X 0331 0412, and the data parsing and warehousing module reads the above R3C003 data row. The system recognizes that the data row type is R3C003, and then loads the configuration template of R3C003 from the import template configuration module. According to the configuration template, extract the field values ​​from the data row: record type: 3; action identifier: 2; data identifier: 003; data table number: 0085924X; type identifier: 0; data start time: 0331; data end time: 0412; process the derived fields and convert the data start time and end time to the actual date format. Assuming the year is 2023, 0331 becomes 2023-03-31, and 0412 becomes 2023-04-12. After the above row data is read and converted, a R3C003 data object in memory will be obtained.

[0068] Through the above embodiments, in the face of a complex ATPCO data file, by configuring a parsing mechanism guided by a template, through field configuration and interception, the key information in the freight rate data can be accurately extracted, and the data can be effectively converted into information that can be operated by the freight rate management system, thereby simplifying the data import process and improving the efficiency and accuracy of data processing.

[0069] As an optional implementation, after parsing the air fare information based on the configuration template information to obtain the parsed fare information, the processing method also includes: deduplicating the parsed fare information to obtain deduplicated fare information; and storing the deduplicated fare information into the second target database.

[0070] Optionally, after parsing the air fare information based on the configuration template information, the parsed fare information may contain duplicate data. According to the deduplication fields defined in the configuration template, the values ​​of the corresponding fields are extracted from the parsed fare information. These fields are usually those that can uniquely identify a fare record, such as airline code, departure airport, arrival airport, and fare basis. The deduplication fare information is stored in a second target database, which is usually a database of a fare management system. This process includes generating database insert statements and may also include further adjustments to the data format to meet the storage requirements of the database.

[0071] In this embodiment, deduplication is used to ensure that no duplicate records are left in the database for each data import operation, which not only saves storage space, but also improves data query efficiency and business processing accuracy. In addition, deduplication is also an important part of maintaining data quality in the entire data import process, avoiding decision-making errors caused by duplicate data.

[0072] As an optional implementation, deduplication processing is performed on the parsed freight rate information to obtain deduplicated freight rate information, including: obtaining a duplication checking rule, the duplication checking rule including a unique judgment expression and a unique judgment value for the parsed freight rate information; querying in a second target database based on the duplication checking rule; in response to querying in the second target database a data value identical to at least part of the parsed freight rate information, filtering the identical part queried in the parsed freight rate information to obtain the deduplicated freight rate information.

[0073] Optionally, duplicate checking rules are defined in the configuration template information to determine which fields can be combined to form a unique identifier for a record. This usually includes some key fields, such as airline code, departure airport, arrival airport, tariff basis, etc. For each data type, such as INTALLFARE or R3C003, the duplicate checking rules may be different, and the corresponding rules need to be read from the import template configuration module.

[0074] Optionally, the unique judgment expression is an SQL query statement, which is used to query in the second target database according to the duplicate checking rules. The unique judgment value is a composite value calculated based on the key fields in the parsed freight information, and is used to match in the query statement to determine whether there are duplicate records. The freight management system uses the unique judgment expression and the unique judgment value to perform a query in its database to determine whether there are records that match the current parsed freight information. If the query result returns at least one record, it means that the same or similar freight information already exists in the database. At this time, the system will not store the parsed freight information in the database, thereby avoiding the storage of duplicate data. If the query result is empty, it means that the current parsed freight information is unique and can be stored in the database.

[0075] Specifically, Figure 3As shown, the constructed deduplication identifier is used to compare the parsed freight information. In ImportDataMaps, the characteristics of the Map data structure, that is, the uniqueness of the key, can be used to store the deduplication identifier as the key and the parsed freight information as the value in the Map. Because Map does not allow the same key to exist, this process will naturally remove all duplicate freight information. After the data processing is completed, all values ​​(that is, the parsed freight information) are extracted from ImportDataMaps, and the extraction result at this time is the deduplication freight information set.

[0076] In this embodiment, through the duplicate checking rules and the query operation in the second target database, it can be ensured that only new and unique fare information will be stored in the database, avoiding the waste of resources and data inconsistency caused by duplicate data. This mechanism improves the data accuracy of the fare management system and improves the management efficiency of the airline's fare rules.

[0077] As an optional implementation, after parsing the air fare information based on the configuration template information to obtain the parsed fare information, the method further includes: backing up at least one of the parsed fare information and the air fare information.

[0078] In this embodiment, the backup mechanism ensures data security and prevents data loss, is applicable to the secure management of airline fare data, provides data security for airlines, and ensures data integrity and availability.

[0079] It should be further explained that the freight rate management system also includes an import task queue management module. The import task queue management module is mainly responsible for obtaining the corresponding data file information that needs to be parsed through the queue information after the upstream pushes the task to the task queue, pulling the data file from the project FTP file server, and calling the data parsing and warehousing module to perform the parsing and warehousing operations.

[0080] Optionally, in a specific embodiment, if Figure 3 As shown, the method for processing the air freight rate data includes the following steps:

[0081] (1) Application startup: Initialize the configuration template library. By parsing the user-defined template configuration information, a configuration template import object is generated and saved in memory for use in subsequent import task execution.

[0082] (2) Data Pulling: The data pulling module of the freight rate management system regularly checks the directory of files to be imported on the freight rate management system file server, and if it finds new data files to be processed, it will then store the file name and related metadata into the import task queue management module.

[0083] (3) Data parsing: The data parsing and warehousing module reads the file line by line, performs data parsing according to the template configuration of INTALLFARE, extracts field values ​​such as region, airline name, departure airport, and fare basis, and constructs corresponding data objects. The data parsing and warehousing module reads and parses the file, and the parsed data objects are stored in ImportDataMaps, which serves as a container to manage the data sets to be stored. When the number of data objects accumulated in ImportDataMaps is greater than the preset threshold, the data parsing and warehousing module starts the batch import task.

[0084] (4) Deduplication: When performing deduplication in ImportDataMaps, the module will query the second target database using a unique judgment expression and a unique judgment value according to the duplicate checking rules in the configuration template to determine whether there are duplicate data records. Based on the query results, the module filters out records that already exist in the second target database to ensure the uniqueness of the incoming data.

[0085] (5) Data storage: The deduplicated data is stored in batches.

[0086] (6) Backup operation: Execute the backup task to back up the deduplicated data and the original files.

[0087] An embodiment of the present application further provides an electronic device, comprising: a memory storing an executable program; and a processor for running the program, wherein the program executes the methods in various embodiments of the present invention when running.

[0088] An embodiment of the present application further provides a computer-readable storage medium, which includes a stored executable program, wherein when the executable program is running, the device where the computer-readable storage medium is located is controlled to execute the methods in various embodiments of the present invention.

[0089] An embodiment of the present application further provides a computer program product, including a computer program, which implements the methods in various embodiments of the present invention when executed by a processor.

[0090] In the above embodiments of the present invention, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0091] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0092] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0093] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0094] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.

[0095] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. A method for processing air freight rate data, characterized in that: include: Acquire air fare information, wherein the air fare information includes fare data of different data types; Acquire configuration template information, the configuration template information is obtained by configuring the target user, the configuration template information includes multiple configuration templates, the multiple configuration templates are set in one-to-one correspondence with multiple data types of the freight rate data, the configuration template includes parsing rules, and the parsing rules are used to perform format parsing on the freight rate data corresponding to the data type; The airline fare information is parsed based on the configuration template information to obtain parsed fare information, wherein the parsed fare information at least includes the parsed airline fare and transportation rules.

2. The method for processing air freight rate data according to claim 1, characterized in that: Obtaining air freight information includes: Acquire task information, where the task information is used to determine the data import scope set by the target user in a single task; Pulling a target data set from a first target database based on the task information, wherein the target data set is within the data import range; The target data set is determined to be the air fare information.

3. The method for processing air freight rate data according to claim 1, characterized in that: Parsing the air freight rate information based on the configuration template information to obtain parsed freight rate information includes: Read the air freight rate information row by row to obtain the freight rate data of the current row; Determine a configuration template corresponding to the data type of the freight rate data in the current row from the configuration template information; The freight rate data of the current row is parsed based on the configuration template to obtain the parsed freight rate information.

4. The method for processing air freight rate data according to claim 3, characterized in that: Parsing the freight rate data of the current row based on the configuration template to obtain the parsed freight rate information includes: Based on the configuration template, field configuration and interception are performed on the text included in the freight rate data to obtain multiple field information; The parsed freight rate information is determined based on the plurality of field information.

5. The method for processing air freight rate data according to claim 1, characterized in that: After parsing the air fare information based on the configuration template information to obtain the parsed fare information, the processing method further includes: Deduplication processing is performed on the parsed freight rate information to obtain deduplication freight rate information; The deduplicated freight rate information is stored in the second target database.

6. The method for processing air freight rate data according to claim 5, characterized in that: Deduplication processing is performed on the parsed freight rate information to obtain deduplication freight rate information, including: Obtaining a duplicate checking rule, wherein the duplicate checking rule includes a unique judgment expression and a unique judgment value for the parsed freight rate information; Performing a query in the second target database based on the duplicate checking rule; In response to finding the same data value as at least part of the parsed freight rate information in the second target database, filtering the same part in the parsed freight rate information to obtain the deduplicated freight rate information.

7. The method for processing air freight rate data according to claim 1, characterized in that: After parsing the air fare information based on the configuration template information to obtain the parsed fare information, the method further includes: Back up at least one of the parsed fare information and the air fare information.

8. An electronic device, characterized in that: include: A memory storing an executable program; A processor, configured to run the program, wherein the program executes the method according to any one of claims 1 to 7 when running.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored executable program, wherein when the executable program is run, the device where the storage medium is located is controlled to execute the method according to any one of claims 1 to 7.

10. A computer program product, characterized in that The invention comprises a computer program which, when executed by a processor, implements the method according to any one of claims 1 to 7.

Citation Information

Cited By

  • Freight rate search data analysis method, system and equipment and storage medium

    CN121542300A