Passenger data flow efficient integration method and system based on aviation information data standard

Abstract

The invention discloses a passenger data flow efficient integration method and system based on an aviation information data standard. The method comprises the steps that a to-be-integrated passenger order data flow and a to-be-integrated passenger check-in data flow are acquired, and the data format, the data structure and the data source of the passenger order data flow are different from those of the passenger check-in data flow; performing targeted format conversion on the passenger order data stream and the passenger check-in data stream to obtain a target passenger order data stream and a target passenger check-in data stream corresponding to the passenger order data stream and the passenger check-in data stream respectively; target fields are extracted from the target passenger order data flow and the target passenger check-in data flow; and based on the target field, integrating the target passenger order data stream and the target passenger check-in data stream to obtain a data integration result, and mapping the data integration result into a target data structure which conforms to the aviation information data standard. According to the invention, the technical problem of low accuracy of passenger data flow integration is solved.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a method and system for efficiently integrating passenger data streams based on air traffic information data standards. Background Art

[0002] At present, in the airline business, batch processing and data warehouse methods are usually relied on to integrate data streams. For example, passenger order data streams and passenger check-in data streams are captured regularly from different data sources. However, the above-mentioned regular processing method leads to obvious delays in the integration of passenger order data streams and passenger check-in data streams, and cannot meet the immediate needs for passenger order data streams and passenger check-in data streams. In addition, there are differences in the format and structure of passenger order data streams and passenger check-in data streams from different data sources, which makes it difficult to maintain format consistency in the integration of passenger order data streams and passenger check-in data streams, thereby affecting the accuracy of the integration of passenger order data streams and passenger check-in data streams. Therefore, there is still a technical problem of low accuracy in passenger data stream integration. Summary of the invention

[0003] The embodiment of the present invention provides a method and system for efficiently integrating passenger data streams based on air traffic information data standards, so as to at least solve the technical problem of low accuracy in integrating passenger data streams.

[0004] According to one aspect of an embodiment of the present invention, a method for efficiently integrating passenger data streams based on air traffic information data standards is provided, and the method may include: obtaining a passenger order data stream and a passenger check-in data stream to be integrated, wherein the data format, data structure, and data source of the passenger order data stream are different from the data format, data structure, and data source of the passenger check-in data stream; performing targeted format conversion on the passenger order data stream and the passenger check-in data stream to obtain target passenger order data streams and target passenger check-in data streams corresponding to the two, wherein the data format of the target passenger order data stream is the same as the data format of the target passenger check-in data stream; extracting target fields from the target passenger order data stream and the target passenger check-in data stream, respectively, wherein the target field is used to represent the association relationship between the target passenger order data stream and the target passenger check-in data stream; based on the target field, integrating the target passenger order data stream and the target passenger check-in data stream to obtain a data integration result, and mapping the data integration result to a target data structure, wherein the target data structure complies with air traffic information data standards.

[0005] Optionally, the passenger data stream efficient integration method based on the air traffic data standard is applied to the passenger data stream efficient integration system based on the air traffic data standard, and the passenger data stream efficient integration system based on the air traffic data standard includes a connector, and the connector is respectively connected to the first data source of the passenger order data stream and the second data source of the passenger check-in data stream, wherein obtaining the passenger order data stream and the passenger check-in data stream to be integrated includes: controlling the connector to collect the passenger order data stream from the first data source, and collecting the passenger check-in data stream from the second data source.

[0006] Optionally, before performing targeted format conversion on the passenger order data stream and the passenger check-in data stream to obtain the target passenger order data stream and the target passenger check-in data stream, the method further includes: in response to the passenger data stream efficient integration system based on the air traffic information data standard receiving the passenger order data stream, controlling the passenger data stream efficient integration system based on the air traffic information data standard to perform targeted deduplication and filtering processing on the passenger order data stream to obtain a processed passenger order data stream, wherein the processed passenger order data stream at least does not contain duplicate data and empty data; in response to the passenger data stream efficient integration system based on the air traffic information data standard receiving the passenger check-in data stream, controlling the passenger data stream efficient integration system based on the air traffic information data standard to perform targeted deduplication and filtering processing on the passenger check-in data stream to obtain a processed passenger check-in data stream, wherein the processed passenger check-in data stream at least does not contain duplicate data and empty data.

[0007] Optionally, targeted format conversion is performed on the passenger order data stream and the passenger check-in data stream to obtain target passenger order data stream and target passenger check-in data stream corresponding to the two, including: in response to completing deduplication and filtering processing on the passenger order data stream and the passenger check-in data stream, controlling the passenger data stream efficient integration system based on the air traffic information data standard to perform targeted format conversion on the passenger order data stream and the passenger check-in data stream respectively to obtain the target passenger order data stream and the target passenger check-in data stream.

[0008] Optionally, target fields are extracted from the target passenger order data stream and the target passenger check-in data stream respectively, including: controlling an efficient passenger data stream integration system based on air traffic information data standards, and extracting data fields corresponding to preset associated items from the target passenger order data stream and the target passenger check-in data stream respectively as target fields.

[0009] Optionally, based on the target field, the target passenger order data stream and the target passenger check-in data stream are integrated to obtain a data integration structure, including: adding a time watermark mark to the target passenger order data stream and the target passenger check-in data stream, wherein the time watermark mark is used to indicate the acquisition time of the target passenger order data stream and the target passenger check-in data stream; configuring an operation window for the target passenger order data stream and the target passenger check-in data stream according to the time watermark mark; and performing an integration operation on the target passenger order data stream and the target passenger check-in data stream in the operation window according to the target field.

[0010] Optionally, the target data structure includes at least an order layer, a passenger layer and a flight segment layer, and the target fields include at least an order data field, a passenger data field and a flight segment data field, wherein mapping the data integration result to the target data structure includes: controlling an efficient passenger data flow integration system based on the air traffic information data standard to extract the order data field corresponding to the order layer from the data integration result, and mapping the order data field to the order layer; controlling an efficient passenger data flow integration system based on the air traffic information data standard to extract the passenger data field corresponding to the passenger layer from the data integration result, and mapping the passenger data field to the passenger layer; controlling an efficient passenger data flow integration system based on the air traffic information data standard to extract the flight segment data field corresponding to the flight segment layer from the data integration result, and mapping the flight segment data field to the flight segment layer.

[0011] Optionally, after mapping the data integration results to the target data structure, the method further includes: controlling an efficient passenger data flow integration system based on the air traffic information data standard, storing the mapped target data structure to a target storage location in a target storage medium, and setting an indexing strategy for indexing the target storage location, wherein the indexing strategy is used to query data fields in the target data structure from the target storage location.

[0012] According to another aspect of an embodiment of the present invention, there is also provided a passenger data stream efficient integration system based on the air traffic information data standard, including: an acquisition unit, used to acquire a passenger order data stream and a passenger check-in data stream to be integrated, wherein the data format, data structure, and data source of the passenger order data stream are different from the data format, data structure, and data source of the passenger check-in data stream; a processing unit, used to perform targeted format conversion on the passenger order data stream and the passenger check-in data stream to obtain target passenger order data streams and target passenger check-in data streams corresponding to the two, wherein the data format of the target passenger order data stream is the same as the data format of the target passenger check-in data stream; an extraction unit, used to extract target fields from the target passenger order data stream and the target passenger check-in data stream, respectively, wherein the target field is used to represent the association relationship between the target passenger order data stream and the target passenger check-in data stream; an integration unit, used to integrate the target passenger order data stream and the target passenger check-in data stream based on the target field, obtain a data integration result, and map the data integration result to a target data structure, wherein the target data structure complies with the air traffic information data standard.

[0013] According to another aspect of an embodiment of the present invention, a processor is further provided, and the processor is used to run a program, wherein when the program is run by the processor, any one of the above-mentioned passenger data flow efficient integration methods based on the air traffic information data standard is executed.

[0014] According to another aspect of an embodiment of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing any one of the above-mentioned passenger data stream efficient integration methods based on the air traffic information data standard.

[0015] According to another aspect of an embodiment of the present invention, there is also provided an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute any one of the above-mentioned methods for efficiently integrating passenger data streams based on air traffic information data standards.

[0016] According to another aspect of the embodiment of the present application, a computer program product is provided, which includes a computer program, and when the computer program is executed by a processor, the method for efficiently integrating passenger data streams based on the air traffic information data standard of the embodiment of the present application is implemented.

[0017] In an embodiment of the present invention, if data integration is required, the passenger order data stream and the passenger check-in data stream to be integrated can be obtained, and the passenger order data stream and the passenger check-in data stream can be converted into targeted formats respectively to obtain the target passenger order data stream and the target passenger check-in data stream, and the target fields can be extracted from the target passenger order data stream and the target passenger check-in data stream respectively. The target passenger order data stream and the target passenger check-in data stream can be integrated based on the target fields to obtain the data integration result, and the data integration result is mapped to the target data structure. In an embodiment of the present invention, the above data streams can be integrated by precise target field matching, and the above data stream processing and analysis can be performed efficiently, accurately and in real time in combination with a standardized data structure (target data structure), overcoming the problem that it is difficult to maintain the consistency of the data stream in the data stream integration due to the differences in the data stream formats and structures of different data sources, and the poor accuracy of the existing data stream integration, thereby achieving the technical effect of improving the accuracy of the passenger data stream integration and solving the technical problem of low accuracy of the passenger data stream integration. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0019] Figure 1 is a flow chart of a method for efficiently integrating passenger data streams based on air traffic information data standards according to an embodiment of the present invention;

[0020] Figure 2 is a flow chart of a method for real-time integration of civil aviation passenger order data and civil aviation passenger check-in data based on a unified recording standard according to an embodiment of the present invention;

[0021] Figure 3 It is a structural schematic diagram of a passenger data stream efficient integration system based on the air traffic information data standard according to an embodiment of the present invention;

[0022] Figure 4 2 is a schematic diagram of an electronic device for an efficient integration method of passenger data streams based on air traffic information data standards according to an embodiment of the present invention. DETAILED DESCRIPTION

[0023] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0024] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0025] Example 1

[0026] According to an embodiment of the present invention, an embodiment of a method for efficiently integrating passenger data streams based on air traffic information data standards is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0027] Figure 1 is a flow chart of a method for efficiently integrating passenger data streams based on air traffic information data standards according to an embodiment of the present invention. Figure 1 As shown, the method comprises the following steps:

[0028] Step S102, obtaining the passenger order data stream and passenger check-in data stream to be integrated.

[0029] In the technical solution provided in step S102 of the embodiment of the present invention, the passenger order data stream and the passenger check-in data stream can be collected. The data format, data structure, and data source of the passenger order data stream are different from those of the passenger check-in data stream.

[0030] In this embodiment, the passenger order (Passenger Name Record, referred to as PNR) data stream can be a civil aviation passenger order data stream, which can also be called a PNR original data stream, which is a data record generated by an airline or travel agency when booking a travel for a passenger, and can ensure the integrity and consistency of passenger information. The passenger check-in (CKI) data stream can be a civil aviation passenger check-in data stream, which can also be called a CKI original data stream, which is generated when a passenger checks in and can provide a type of flow data with specific boarding information for the passenger flight, which is crucial for real-time adjustment of flight load, baggage management, and improvement of passenger boarding efficiency.

[0031] Optionally, the passenger order data stream and the passenger check-in data stream can be collected by using stream data processing technology, and the above data streams can be stored in different structures and formats, for example, PNR data can be stored in Extensible Markup Language (XML) format, and CKI data can be stored in different XML formats. It should be noted that the collection method and storage format of the above passenger order data stream and passenger check-in data stream are only for illustration and are not specifically limited here.

[0032] Optionally, the passenger order data stream may include passenger information, itinerary information, service reservation, payment information, etc. The passenger check-in data stream may include flight details, passenger boarding information, electronic ticket information, security check information, etc.

[0033] It should be noted that the information contained in the above passenger order data stream and passenger check-in data stream is only for illustration and is not specifically limited here. As long as it can be used to reflect the relevant information of passenger orders and passenger check-ins, it is within the protection scope of the embodiments of the present invention.

[0034] In an embodiment of the present invention, if it is necessary to integrate the PNR data stream and the CKI data stream, the PNR data stream and the CKI data stream to be integrated can be obtained in real time. Compared with the traditional technology of periodically capturing the PNR data stream and the CKI data stream from different data sources, due to the intervals between the capture of the PNR data stream and the CKI data stream, the PNR data stream and the CKI data stream captured at different time points may reflect different states of the passenger information, resulting in inconsistency problems when the PNR data stream and the CKI data stream are integrated. In addition, if the passenger information is updated but not captured, the PNR data stream and the CKI data stream may be lost or incomplete. Real-time acquisition of the PNR data stream and the CKI data stream to be integrated can immediately respond to any changes in the passenger's order and check-in status without waiting for the regular capture cycle, thereby improving the real-time performance of obtaining the PNR data stream and the CKI data stream. Due to real-time updates, the integrated PNR data stream and CKI data stream always reflect the latest passenger information, avoiding the inconsistency problem when integrating the PNR data stream and the CKI data stream, improving the quality of the PNR stream data and the CKI data stream, and thus achieving the technical effect of real-time data stream collection.

[0035] Step S104, performing targeted format conversion on the passenger order data stream and the passenger check-in data stream respectively to obtain a target passenger order data stream and a target passenger check-in data stream.

[0036] In the technical solution provided in the above step S104 of the embodiment of the present invention, after obtaining the passenger order data stream and the passenger check-in data stream to be integrated, the passenger order data stream and the passenger check-in data stream can be respectively converted into a targeted format to obtain a target passenger order data stream and a target passenger check-in data stream. The data format of the target passenger order data stream is the same as the data format of the target passenger check-in data stream.

[0037] In this embodiment, since the formats of the acquired passenger order data stream and passenger check-in data stream are not unified, the heterogeneity of the data streams will hinder the effective integration of the data streams. Through targeted format conversion, the PNR data stream and the CKI data stream can be converted into the same data stream format, which can reduce the occurrence of data stream processing errors or inefficiencies caused by format inconsistencies.

[0038] Optionally, the passenger order data stream and the passenger check-in data stream can be converted to a specific format through data mapping tools, data conversion provided by the stream processing framework, data conversion libraries, etc. It should be noted that the above-mentioned format conversion methods and tools are only for illustrative purposes and are not specifically limited here. As long as the format conversion method can unify the formats of the passenger order data stream and the passenger check-in data stream, it is within the protection scope of the embodiments of the present invention.

[0039] Step S106, extracting target fields from the target passenger order data stream and the target passenger check-in data stream respectively.

[0040] In the technical solution provided in the above step S106 of the embodiment of the present invention, after the passenger order data stream and the passenger check-in data stream are respectively converted in a targeted manner to obtain the target passenger order data stream and the target passenger check-in data stream, the target field can be extracted from the target passenger order data stream and the target passenger check-in data stream. The target field can be used to represent the association between the target passenger order data stream and the target passenger check-in data stream, and can be a certificate number, ticket number, flight number, etc.

[0041] In this embodiment, association rules and conditions between the target passenger order data stream and the target passenger check-in data stream may be defined, such as key fields such as passenger ID number, ticket number, flight number, etc., to determine the association relationship between the passenger order data stream and the passenger check-in data stream.

[0042] For example, when the passenger ID number exists in both the target passenger order data stream and the target passenger check-in data stream, it can be used as the primary key for association; when the ticket number exists, it can be used as a secondary key to verify the passenger's ticket purchase status; the flight number can be used to confirm the specific flight the passenger is taking to ensure the accuracy of the information.

[0043] Step S108, based on the target field, the target passenger order data stream and the target passenger check-in data stream are integrated to obtain a data integration result, and the data integration result is mapped to the target data structure.

[0044] In the technical solution provided in the above step S108 of the embodiment of the present invention, after extracting the target field from the target passenger order data stream and the target passenger check-in data stream respectively, the target passenger order data stream and the target passenger check-in data stream can be integrated based on the target field to obtain a data integration result, and the data integration result is mapped to a target data structure. The target data structure complies with the air traffic information data standard.

[0045] In this embodiment, the data integration result is a collection of integrated passenger information, which may include but is not limited to passenger itinerary information, complete itinerary information and integrated data fields. Passenger itinerary information may include flight number, departure time and arrival time, seat number, check-in status, etc. Complete itinerary information may include all historical records from passenger booking to check-in, providing data support for the passenger's full service. The integrated data fields can ensure that all necessary passenger information is included to meet the needs of subsequent data processing and analysis.

[0046] Optionally, after obtaining the data integration results, the above integrated information can be mapped to the One Record Standard (ORS) data structure. ORS is a data standard used in the civil aviation industry. It can integrate and manage passengers' order information, personal information and itinerary details through a unified data model and format, solve the problem of data flow heterogeneity, and improve the efficiency and consistency of data flow processing. By adopting the ORS standard data structure and its unique structured design, a standardized push format specification is established for the integrated target passenger order data flow and target passenger check-in data flow, which can ensure that airlines can more easily exchange and share passenger information, effectively reduce error rates, and improve data quality, thereby providing airlines with more efficient and intelligent data flow processing and analysis capabilities.

[0047] Optionally, the mapping process may include reorganizing and formatting the information in the data integration result to conform to the requirements of the ORS data structure.

[0048] In an embodiment of the present invention, considering the timeliness requirement of the integration of the target passenger order data stream and the target passenger check-in data stream, the target passenger order data stream and the target passenger check-in data stream can be integrated in real time. Real-time integration can reduce the processing delay from the hours level of the traditional batch processing mode to the seconds level, or even the millisecond level, and can ensure the timeliness and freshness of the target passenger order data stream and the target passenger check-in data stream, thereby achieving the purpose of reducing the high latency of data stream integration. In addition, by integrating the target passenger order data stream and the target passenger check-in data stream in real time, there is no need to wait for the batch processing results, which is particularly important when facing emergencies or when immediate decisions are required, and the purpose of real-time integration of data streams is achieved, thereby achieving the technical effect of meeting the real-time integration of data streams, and solving the technical problem of not being able to meet the real-time integration of data streams.

[0049] In step S102 to step S108 of the embodiment of the present invention, if data integration is required, the passenger order data stream and the passenger check-in data stream to be integrated can be obtained, and the passenger order data stream and the passenger check-in data stream can be converted into targeted formats respectively to obtain the target passenger order data stream and the target passenger check-in data stream, and the target fields can be extracted from the target passenger order data stream and the target passenger check-in data stream respectively. The target passenger order data stream and the target passenger check-in data stream can be integrated based on the target fields to obtain the data integration result, and the data integration result is mapped to the target data structure. In the embodiment of the present invention, the above data streams can be integrated by precise target field matching, and the above data stream processing and analysis can be performed efficiently, accurately and in real time in combination with the standardized data structure (target data structure), overcoming the problem that it is difficult to maintain the consistency of the data stream in the data stream integration due to the differences in the data stream formats and structures of different data sources, and the existing data stream integration has poor accuracy, thereby achieving the technical effect of improving the accuracy of the passenger data stream integration and solving the technical problem of low accuracy of the passenger data stream integration.

[0050] The embodiment of the present invention is described in detail below in combination with the above steps.

[0051] As an optional embodiment, the method is applied to a passenger data stream efficient integration system based on the air traffic data standard. The passenger data stream efficient integration system based on the air traffic data standard includes a connector, which is respectively connected to a first data source of a passenger order data stream and a second data source of a passenger check-in data stream. Step S102, obtaining the passenger order data stream and the passenger check-in data stream to be integrated, includes: controlling the connector to collect the passenger order data stream from the first data source, and collecting the passenger check-in data stream from the second data source.

[0052] In this embodiment, in the process of obtaining the passenger order data stream and the passenger check-in data stream to be integrated, the connector can be controlled to collect the passenger order data stream from the first data source and collect the passenger check-in data stream from the second data source. The method is applied to the efficient integration system of passenger data streams based on the air traffic information data standard. The efficient integration system of passenger data streams based on the air traffic information data standard includes a connector, and the connector can be connected to the first data source of the passenger order data stream and the second data source of the passenger check-in data stream respectively. The efficient integration system of passenger data streams based on the air traffic information data standard can be a unified civil aviation passenger data system. The first data source can be a PNR data source. The second data source can be a CKI data source.

[0053] Optionally, by controlling connectors (such as Kafka, Kinesis, file systems, etc.), passenger order data streams and passenger check-in data streams are collected from the first data source and the second data source. The efficient passenger data stream integration system based on the air traffic information data standard can ensure real-time and complete acquisition of the passenger order data streams and passenger check-in data streams to be integrated.

[0054] Optionally, the connector plays the role of data entry in the efficient integration system of passenger data streams based on the air traffic data standard, and can read data from different data sources in real time, and can be configured according to the characteristics and requirements of different data sources. For example, the Kafka connector can handle high-throughput streaming data, while the Kinesis connector is more suitable for processing large amounts of concurrent streaming data.

[0055] As an optional embodiment, before performing targeted format conversion on the passenger order data stream and the passenger check-in data stream to obtain the target passenger order data stream and the target passenger check-in data stream, the method also includes: in response to the passenger data stream efficient integration system based on the air traffic data standard receiving the passenger order data stream, controlling the passenger data stream efficient integration system based on the air traffic data standard to perform targeted deduplication and filtering processing on the passenger order data stream to obtain a processed passenger order data stream, wherein the processed passenger order data stream at least does not contain duplicate data and empty data; in response to the passenger data stream efficient integration system based on the air traffic data standard receiving the passenger check-in data stream, controlling the passenger data stream efficient integration system based on the air traffic data standard to perform targeted deduplication and filtering processing on the passenger check-in data stream to obtain a processed passenger check-in data stream, wherein the processed passenger check-in data stream at least does not contain duplicate data and empty data.

[0056] In this embodiment, before the format conversion of the passenger order data stream and the passenger check-in data stream is performed to obtain the target passenger order data stream and the target passenger check-in data stream, when the passenger data stream efficient integration system based on the air traffic information data standard receives the passenger order data stream, the passenger data stream efficient integration system based on the air traffic information data standard can be controlled to perform targeted deduplication and filtering processing on the passenger order data stream to obtain the processed passenger order data stream; when the passenger data stream efficient integration system based on the air traffic information data standard receives the passenger check-in data stream, the passenger data stream efficient integration system based on the air traffic information data standard can be controlled to perform targeted deduplication and filtering processing on the passenger check-in data stream to obtain the processed passenger check-in data stream. The processed passenger order data stream at least does not have duplicate data and empty data, and the processed passenger check-in data stream at least does not have duplicate data and empty data.

[0057] Optionally, deduplication can be achieved by identifying and excluding duplicate data records. In the real-time stream of civil aviation data, duplicate data records may appear due to network delays, system failures, or the update frequency of the data source. Duplicate data is identified by comparing key fields (such as passenger identification (ID), order number, flight number, etc.), thereby avoiding data redundancy and processing errors. Filtering can exclude data records that are incomplete or do not comply with business rules. For example, empty data that does not contain key information such as passenger ID or flight number, as well as dirty data containing incorrect formats or logical errors can be filtered out. Through filtering operations, it can be ensured that the processed passenger order data stream and passenger check-in data stream meet business logic and data quality requirements.

[0058] In this embodiment, the passenger order data stream and passenger check-in data stream that have been deduplicated and filtered will be marked as processed passenger order data stream and processed passenger check-in data stream, at least there will be no duplicate data and empty data, which greatly improves the availability and integrity of the data. The processed data is the basis for format conversion and subsequent data integration operations, and is also a high-quality data source provided to airlines for real-time analysis and decision support.

[0059] As an optional embodiment, step S104, performs targeted format conversion on the passenger order data stream and the passenger check-in data stream to obtain the target passenger order data stream and the target passenger check-in data stream corresponding to the two, including: in response to completing the deduplication and filtering processing of the passenger order data stream and the passenger check-in data stream, controlling the passenger data stream efficient integration system based on the air traffic information data standard to perform targeted format conversion on the passenger order data stream and the passenger check-in data stream respectively to obtain the target passenger order data stream and the target passenger check-in data stream.

[0060] In this embodiment, in the process of performing targeted format conversion on the passenger order data stream and the passenger check-in data stream to obtain the target passenger order data stream and the target passenger check-in data stream, after completing the deduplication and filtering processing of the passenger order data stream and the passenger check-in data stream, the passenger data stream efficient integration system based on the air traffic information data standard can be controlled to perform targeted format conversion on the passenger order data stream and the passenger check-in data stream respectively, so as to obtain the target passenger order data stream and the target passenger check-in data stream corresponding to the two respectively.

[0061] Optionally, targeted format conversion can convert the XML data of the original data stream into a unified data format. For example, JavaScript Object Notation (JSON) or Plain Old Java Object (POJO). JSON is a lightweight data exchange format. Tools such as Fastjson can be used to convert XML format data into JSON format, and then further mapped to Java POJO objects for subsequent processing and storage.

[0062] As an optional embodiment, step S106, respectively extracting target fields from the target passenger order data stream and the target passenger check-in data stream, includes: controlling the passenger data stream efficient integration system based on the air traffic information data standard, respectively extracting data fields corresponding to preset associated items from the target passenger order data stream and the target passenger check-in data stream as target fields.

[0063] In this embodiment, in the process of extracting target fields from the target passenger order data stream and the target passenger check-in data stream respectively, the passenger data stream efficient integration system based on the air traffic information data standard can be controlled to extract data fields corresponding to preset associated items from the target passenger order data stream and the target passenger check-in data stream respectively as target fields.

[0064] Optionally, preset association items can be used to associate fields of the passenger order data stream and the passenger check-in data stream, which may include but are not limited to passenger ID number, ticket number, flight number, passenger name, etc. The preset association items are a bridge connecting passenger orders and check-in records, which can ensure the correct matching and integration of passenger order data stream and passenger check-in data stream.

[0065] Optionally, a target field corresponding to a preset association item is extracted from the target passenger order data stream and the target passenger check-in data stream. The target field is the basis for realizing data stream integration and can be used for subsequent association operations to ensure that the integrated data stream can reflect the complete itinerary information of each passenger.

[0066] As an optional embodiment, based on the target field, the target passenger order data stream and the target passenger check-in data stream are integrated to obtain a data integration structure, including: adding a time watermark mark to the target passenger order data stream and the target passenger check-in data stream, wherein the time watermark mark is used to indicate the acquisition time of the target passenger order data stream and the target passenger check-in data stream; according to the time watermark mark, configuring an operation window for the target passenger order data stream and the target passenger check-in data stream; in the operation window, performing an integration operation on the target passenger order data stream and the target passenger check-in data stream according to the target field.

[0067] In this embodiment, in the process of integrating the target passenger order data stream and the target passenger check-in data stream based on the target field to obtain the data integration structure, a time watermark mark can be added to the target passenger order data stream and the target passenger check-in data stream; an operation window can be configured for the target passenger order data stream and the target passenger check-in data stream according to the time watermark mark; and an integration operation can be performed on the target passenger order data stream and the target passenger check-in data stream according to the target field in the operation window. The time watermark mark is used to indicate the acquisition time of the target passenger order data stream and the target passenger check-in data stream. The integration operation can be a Join operation / Join association.

[0068] Optionally, time watermark is a key mechanism in the stream processing framework for handling time offset and out-of-order data. By adding time watermarks to the target passenger order data stream and the target passenger check-in data stream, a mark indicating the time when each data record was generated or obtained can be added. This mark is based on the concept of event time, rather than processing time or ingestion time, thereby ensuring the temporal order of the target passenger order data stream and the target passenger check-in data stream.

[0069] Optionally, the operation window can define the time range of data processing, allowing operations such as aggregation and association of stream data within a specific time window. For example, configuring a 10-minute sliding window allows the target passenger order data stream and the target check-in data to be integrated within any 10-minute time period.

[0070] Optionally, in the configured operation window, a Join operation / Join association can be performed, that is, the target passenger order data stream and the target passenger check-in data stream are associated in real time based on the preset target field (such as passenger ID number, ticket number, flight number, etc.). This association operation can be implemented through the Join function provided by the open source distributed stream processing engine Flink or other stream processing frameworks, which can accurately match the two stream data and generate a record containing complete passenger itinerary information. The Join operation is performed within the operation window to ensure that the target passenger order data stream and the target passenger check-in data stream collected within a specific time range can be correctly associated and integrated. For example, when the window operation detects that the passenger ID numbers of two data (one from the PNR data source and the other from the CKI data source) match, the above two data will be integrated to generate a complete passenger itinerary record containing PNR and CKI information.

[0071] As an optional embodiment, the target data structure includes at least an order layer, a passenger layer and a flight segment layer, and the target fields include at least an order data field, a passenger data field and a flight segment data field, wherein step S108, mapping the data integration result to the target data structure, includes: controlling an efficient passenger data flow integration system based on the air traffic information data standard to extract the order data field corresponding to the order layer from the data integration result, and mapping the order data field to the order layer; controlling an efficient passenger data flow integration system based on the air traffic information data standard to extract the passenger data field corresponding to the passenger layer from the data integration result, and mapping the passenger data field to the passenger layer; controlling an efficient passenger data flow integration system based on the air traffic information data standard to extract the flight segment data field corresponding to the flight segment layer from the data integration result, and mapping the flight segment data field to the flight segment layer.

[0072] In this embodiment, in the process of mapping the data integration result to the target data structure, the efficient integration system of passenger data flow based on the air traffic information data standard can be controlled to extract the order data field corresponding to the order layer from the data integration result, and map the order data field to the order layer; the efficient integration system of passenger data flow based on the air traffic information data standard can be controlled to extract the passenger data field corresponding to the passenger layer from the data integration result, and map the passenger data field to the passenger layer; the efficient integration system of passenger data flow based on the air traffic information data standard can be controlled to extract the segment data field corresponding to the segment layer from the data integration result, and map the segment data field to the segment layer. The target data structure can be an ORS data structure, which can include an order layer, a passenger layer, and a segment layer. The target fields can include at least an order data field, a passenger data field, and a segment data field.

[0073] Optionally, the passenger data flow efficient integration system based on the air traffic data standard can organize the processed data according to a specific hierarchical structure to form a structured target data structure. This structured approach not only improves the readability and comprehensibility of the data, but also makes subsequent data processing and analysis more efficient. Airlines can quickly query passengers' order details, check-in status, and flight segment information based on these structured data, thereby providing more personalized and timely services. The passenger data flow efficient integration system based on the air traffic data standard maps the corresponding data fields to the target data structure, which can ensure the consistency and standardization of the data and better respond to real-time changes in passenger needs.

[0074] As an optional embodiment, after mapping the data integration results to the target data structure, the method also includes: controlling an efficient passenger data flow integration system based on the air traffic information data standard, storing the mapped target data structure to a target storage location in a target storage medium, and setting an index strategy for indexing the target storage location, wherein the index strategy is used to query data fields in the target data structure from the target storage location.

[0075] In this embodiment, after the data integration result is mapped to the target data structure, the passenger data flow efficient integration system based on the air traffic information data standard can be controlled to store the mapped target data structure to the target storage location in the target storage medium, and set an index strategy for indexing to the target storage location. The index strategy can be used to query the data fields in the target data structure from the target storage location.

[0076] Optionally, select a suitable storage system according to actual needs, and design the corresponding storage structure and index strategy to meet the subsequent data query and analysis needs. For example, if the data query needs are frequent and complex, a relational database such as a structured query language (MySQL) database may be selected; if a large amount of unstructured data needs to be processed or there is a high concurrent writing requirement, a non-relational database (NotOnly SQL, referred to as NoSQL) can be selected; if the amount of data is extremely large and distributed storage is required, a distributed file system can be selected. The passenger data flow based on the air traffic data standard can be controlled to efficiently integrate the system, and the data integration results can be output and stored in the target storage location through Flink's sink function or other data writing mechanisms. The index strategy can be set to quickly query the data fields in the target data structure from the target storage location. For example, through the index, a quick query based on the passenger ID can be realized to obtain the latest itinerary status of the passenger; or a query based on the flight number can be used to obtain the booking and check-in status of a certain flight.

[0077] In an embodiment of the present invention, if data integration is required, the passenger order data stream and the passenger check-in data stream to be integrated can be obtained, and the passenger order data stream and the passenger check-in data stream can be converted into targeted formats respectively to obtain the target passenger order data stream and the target passenger check-in data stream, and the target fields can be extracted from the target passenger order data stream and the target passenger check-in data stream respectively. The target passenger order data stream and the target passenger check-in data stream can be integrated based on the target fields to obtain the data integration result, and the data integration result is mapped to the target data structure. In an embodiment of the present invention, the above data streams can be integrated by precise target field matching, and the above data stream processing and analysis can be performed efficiently, accurately and in real time in combination with a standardized data structure (target data structure), overcoming the problem that it is difficult to maintain the consistency of the data stream in the data stream integration due to the differences in the data stream formats and structures of different data sources, and the poor accuracy of the existing data stream integration, thereby achieving the technical effect of improving the accuracy of the passenger data stream integration and solving the technical problem of low accuracy of the passenger data stream integration.

[0078] Example 2

[0079] Another optional specific implementation is described in detail below.

[0080] At present, with the rapid development of information technology and the continuous expansion of civil aviation business, airlines are facing increasing challenges in operation management and service. In order to improve operational efficiency and service quality, airlines need to integrate and analyze civil aviation passenger order data streams and civil aviation passenger check-in data streams in real time. However, compared with the use of traditional data stream integration technology, there are problems such as low efficiency, poor data stream consistency, and inability to meet real-time needs.

[0081] The civil aviation passenger order data stream and the civil aviation passenger check-in data stream come from different systems, and the formats and structures of the data sources are different, making it difficult to integrate them uniformly. Most of the related data stream processing methods use batch processing, which has a high latency in processing data and is difficult to update and respond in real time. At the same time, with the increase in the number of air passengers, the scale of civil aviation passenger order data stream and check-in data stream has also expanded rapidly. Tens of millions of passenger order data and check-in records are generated every day, which poses a huge challenge to the data processing system and scalability. The related data processing system is difficult to process such a large-scale data stream in a short period of time and cannot meet the real-time processing needs of airlines. In addition, the civil aviation passenger order data stream and check-in data stream are stored in different systems, and the above systems may use different data formats and storage structures. To achieve real-time integration of data streams, it is necessary to solve a series of complex problems such as data stream format conversion, field mapping, and data stream association, which increase the difficulty of system design and implementation.

[0082] In view of the above-mentioned technical problems, the present invention provides a method and system for real-time integration of civil aviation passenger order data stream and civil aviation passenger check-in data stream based on ORS. The ORS data structure is a new standard that aims to uniformly represent and manage civil aviation passenger orders, passengers and passenger flight segment information. The real-time integrated data stream based on the ORS data standard can provide a unified data representation method, so that data from different sources can be stored and processed in a consistent format. Through standardization, the problem of data stream heterogeneity is solved. Combined with the Flink streaming computing engine, real-time collection, conversion, cleaning and integration of civil aviation passenger order data stream and civil aviation passenger check-in data stream can be achieved. Flink is a distributed stream processing framework that supports high-throughput and low-latency data processing and can meet the needs of airlines for real-time data processing. In addition, the integrated data stream must comply with the ORS standard data structure, which can ensure the consistency, reliability and interoperability of the data stream, so as to obtain the latest status of passengers in real time and optimize service and operation management. The integration solution based on the ORS standard can significantly improve the efficiency of data stream processing, the processing delay can reach the second level effect, and the throughput of data stream integration can reach the data scale of processing tens of thousands of records per second. In addition, data flow consistency and accuracy are significantly improved, and the data flow error rate is reduced to below 0.01%.

[0083] The method is further described below.

[0084] Figure 2 is a flow chart of a method for real-time integration of civil aviation passenger order data and civil aviation passenger check-in data based on a unified recording standard according to an embodiment of the present invention. Figure 2 As shown, the following steps are included:

[0085] Step S201, collecting PNR original data stream.

[0086] In this embodiment, the PNR original data stream in Kafka can be obtained in real time through Flink.

[0087] Step S202: collect CKI original data stream.

[0088] In this embodiment, the CKI original data stream in Kafka can be obtained in real time through Flink.

[0089] In step S201 to step S202 of the embodiment of the present invention, the data sources of civil aviation passenger order data and civil aviation passenger check-in data can be connected through Flink connectors (such as Kafka, Kinesis, file systems, etc.) to collect PNR data streams and CKI original data streams in real time. Specifically, Flink's Kafka connector can be used to connect to the data source to obtain the original XML data stream in real time. The order data source provides information such as order number, passenger ID, flight number, etc., while the check-in data provides information such as flight information, seat information, passenger ID, etc. By setting up a Flink job to extract data streams from two data sources in real time, the timeliness and accuracy of the data can be ensured.

[0090] Step S203, performing PNR data cleaning and preprocessing.

[0091] In this embodiment, the collected PNR raw data stream may be cleaned and preprocessed.

[0092] Step S204, performing CKI data cleaning and preprocessing.

[0093] In this embodiment, the collected raw data stream may be cleaned and preprocessed.

[0094] In step S203 to step S204 of the embodiment of the present invention, the collected stream data can be deduplicated and filtered to exclude empty data, dirty data and duplicate data to ensure the availability and integrity of the data. The original stream XML data can be converted into a unified data format and key fields can be extracted to facilitate subsequent association processing operations.

[0095] Optionally, real-time data collected using the Flink stream computing engine can be cleaned and preprocessed. This includes operations such as deduplication, filtering, and format conversion to ensure data quality and consistency. Passenger order data and passenger check-in data that contain cancellation marks or incomplete information (for example, numbers with empty order numbers or missing passenger ID information) can be filtered. Duplicate passenger order data that is repeated over a period of time can be deduplicated to exclude duplicate data. The Fastjson tool can be used to convert the data format and convert XML raw data into recognizable POJO class objects. Through these data cleaning and preprocessing steps, it can be ensured that the collected data is of high quality and usable.

[0096] Step S205: perform data integration and association.

[0097] In this embodiment, the association between stream data and dimension tables can utilize the stream data and dimension table association function provided by Flink to associate civil aviation passenger order data with civil aviation passenger check-in data to obtain more complete and accurate passenger itinerary information.

[0098] Optionally, after data cleaning and preprocessing, Flink's asynchronous input / output can be used to associate stream data with dimension tables, and passenger order data with passenger check-in data. Passenger order data and passenger check-in data can be associated with items, including: passenger ID, ticket number, passenger name, flight number, starting and arriving airports, and departure time. Passenger order data and passenger check-in data can be joined based on the associated items to obtain the complete itinerary information of each passenger. The timing and consistency of data can be ensured by configuring window operations and watermark mechanisms.

[0099] Step S206, mapping the integrated data to the ORS data standard structure.

[0100] In this embodiment, data field mapping is to map the integrated data fields to the ORS data standard structure to ensure the consistency and standardization of the pushed data. Data standardization processing can standardize the mapped data, unify the naming specifications, data format, data units, etc., to improve the comprehensibility and maintainability of the data.

[0101] Optionally, after the data integration and association phase is completed, the ORS data structure can be mapped to the integrated data. You can choose to use the JSON data format to build the ORS data structure. JSON is a lightweight data exchange format that supports nested structures and arrays and can identify complex data relationships. The ORS data structure is mainly divided into three layers of nested structures: order layer, passenger layer, and flight segment layer.

[0102] Optionally, the first order layer can organize the integrated data into the form of orders. The JSON result of the order layer can include order number, order creation time and passenger information, etc. The second layer is the passenger layer. Each order can include itinerary information of multiple passengers. The JSON structure of each passenger layer contains passenger ID, name, ticket number, age, gender and flight segment information, etc. The third layer is the flight segment layer, which can split the itinerary information of each passenger into multiple flight segments. The JSON structure of the flight segment layer includes flight information such as flight number, starting and arrival airports, departure time, seat number, etc. By mapping the ORS data structure to the integrated data, the components of each order can be more clearly displayed, including order information, passenger information and flight segment information. The ORS data structure not only helps to understand and manage the data, but also facilitates subsequent data storage and analysis.

[0103] Step S207: performing data query service.

[0104] In this embodiment, the integrated data that complies with the ORS standard can be persistently stored in a suitable storage medium, such as a relational database, a NoSQL database, or a distributed file system, so that data query services can be performed.

[0105] Optionally, the storage system can be selected according to actual needs, and the corresponding storage structure and index method can be designed to meet the subsequent data query and analysis needs. Flink's sink function can be used to write data to the target system for subsequent query and analysis. In this way, airlines can query and analyze passenger itinerary information at any time, which is convenient for providing personalized service support. By persistently storing data, the long-term availability and security of data can be ensured, providing continuous data support for airlines.

[0106] In an embodiment of the present invention, real-time integration of civil aviation passenger order data and civil aviation passenger check-in data based on ORS standard data can provide airlines with efficient, accurate and real-time data integration and analysis capabilities, thereby achieving the technical effect of improving the accuracy of passenger data flow integration and solving the technical problem of low accuracy of passenger data flow integration.

[0107] Example 3

[0108] The embodiment of the present invention provides a system for efficiently integrating passenger data streams based on the air traffic data standard. It should be noted that the system for efficiently integrating passenger data streams based on the air traffic data standard of the embodiment of the present invention can be used to execute Figure 1 The following is an introduction to the efficient integration method of passenger data stream based on the air traffic information data standard provided by the embodiment of the present invention.

[0109] Figure 3 is a schematic diagram of a passenger data flow efficient integration system based on air traffic information data standards according to an embodiment of the present invention. Figure 3 As shown, the passenger data stream efficient integration system 300 based on the air traffic information data standard may include: an acquisition unit 302 , a processing unit 304 , an extraction unit 306 and an integration unit 308 .

[0110] The acquisition unit 302 is used to acquire the passenger order data stream and the passenger check-in data stream to be integrated, wherein the data format, data structure, and data source of the passenger order data are different from those of the passenger check-in data.

[0111] The processing unit 304 is used to perform targeted format conversion on the passenger order data stream and the passenger check-in data stream to obtain the target passenger order data stream and the target passenger check-in data stream corresponding to the two respectively, wherein the data format of the target passenger order data stream is the same as the data format of the target passenger check-in data stream.

[0112] The extraction unit 306 is used to extract target fields from the target passenger order data stream and the target passenger check-in data stream respectively, wherein the target field is used to represent the association relationship between the target passenger order data stream and the target passenger check-in data stream.

[0113] The integration unit 308 is used to integrate the target passenger order data stream and the target passenger check-in data stream based on the target field to obtain a data integration result, and map the data integration result to a target data structure, wherein the target data structure complies with the air traffic information data standard.

[0114] The efficient passenger data stream integration system based on the air traffic information data standard provided by the embodiment of the present invention obtains the passenger order data stream and the passenger check-in data stream to be integrated through the acquisition unit 302, wherein the data format of the passenger order data stream is different from the data format, data structure and data source of the passenger check-in data stream; the passenger order data stream and the passenger check-in data stream are targetedly format-converted through the processing unit 304 to obtain the target passenger order data stream and the target passenger check-in data stream corresponding to the two, wherein the data format of the target passenger order data stream is the same as the data format of the target passenger check-in data stream; the target field is extracted from the target passenger order data stream and the target passenger check-in data stream respectively through the extraction unit 306, wherein the target field is used to represent the association relationship between the target passenger order data stream and the target passenger check-in data stream; the target passenger order data stream and the target passenger check-in data stream are integrated based on the target field through the integration 308 to obtain a data integration result, and the data integration result is mapped to the target data structure, wherein the target data structure complies with the air traffic information data standard, thereby achieving the technical effect of improving the accuracy of passenger data stream integration and solving the technical problem of low accuracy of passenger data stream integration.

[0115] The above-mentioned passenger data flow efficient integration system based on the air traffic information data standard may also include a processor and a memory. The above-mentioned units are all stored in the memory as program units, and the processor executes the above-mentioned program units stored in the memory to realize the corresponding functions.

[0116] The processor includes a kernel, and the kernel retrieves the corresponding program unit from the memory. One or more kernels can be set to control the same device type of devices to be shut down to perform graceful shutdown by adjusting kernel parameters.

[0117] The above-mentioned memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM, and the memory includes at least one storage chip.

[0118] The processor contains a kernel, which retrieves the corresponding program unit from the memory. One or more kernels can be set, and the work efficiency of traders can be improved by adjusting the kernel parameters.

[0119] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM, and the memory includes at least one memory chip.

[0120] Example 4

[0121] According to an embodiment of the present invention, a computer-readable storage medium is further provided, on which a program is stored. When the program is executed by a processor, a method for efficiently integrating passenger data streams based on air traffic information data standards is implemented.

[0122] Example 5

[0123] According to an embodiment of the present invention, a processor is further provided, and the processor is used to run a program, wherein when the program is running, a method for efficiently integrating passenger data streams based on air traffic information data standards is executed.

[0124] Example 6

[0125] Figure 4 is a schematic diagram of an electronic device according to an embodiment of the present invention, a method for efficiently integrating passenger data streams based on air traffic information data standards, such as Figure 4 As shown, an embodiment of the present invention further provides an electronic device 400, which includes a processor 401, a memory 402, and a program stored in the memory and executable on the processor 401, and the processor 401 executes the above steps of the embodiment of the present invention.

[0126] Example 7

[0127] The embodiment of the present application also provides a computer program product. Optionally, in this embodiment, the computer program product may include a computer program, and when the computer program is executed by a processor, the efficient integration method of passenger data stream based on the air traffic information data standard of the embodiment of the present application is implemented.

[0128] The devices in this article can be servers, PCs, PADs, mobile phones, etc.

[0129] The present invention also provides a computer program product, which, when executed on a data processing device, is suitable for the program of the above steps in the embodiment of the present invention.

[0130] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0131] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0132] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0133] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0134] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0135] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0136] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0137] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0138] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0139] The above are only embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included within the scope of the claims of the present application.

Claims

1. A method for efficiently integrating passenger data streams based on air traffic information data standards, characterized in that: include: Acquire a passenger order data stream and a passenger check-in data stream to be integrated, wherein the data format, data structure, and data source of the passenger order data stream are different from the data format, data structure, and data source of the passenger check-in data stream; Performing targeted format conversion on the passenger order data stream and the passenger check-in data stream to obtain target passenger order data stream and target passenger check-in data stream corresponding to the two, wherein the data format of the target passenger order data stream is the same as the data format of the target passenger check-in data stream; Extracting target fields from the target passenger order data stream and the target passenger check-in data stream respectively, wherein the target fields are used to represent the association relationship between the target passenger order data stream and the target passenger check-in data stream; Based on the target field, the target passenger order data stream and the target passenger check-in data stream are integrated to obtain a data integration result, and the data integration result is mapped to a target data structure, wherein the target data structure complies with the air traffic information data standard.

2. The efficient integration method of passenger data stream based on air traffic information data standard according to claim 1 is characterized in that: The method is applied to a passenger data stream efficient integration system based on the air traffic information data standard, the passenger data stream efficient integration system based on the air traffic information data standard comprises a connector, the connector is respectively connected to a first data source of the passenger order data stream and a second data source of the passenger check-in data stream, wherein obtaining the passenger order data stream and the passenger check-in data stream to be integrated comprises: The connector is controlled to collect the passenger order data from the first data source flow, and to collect the passenger check-in data from the second data source flow.

3. The efficient integration method of passenger data stream based on air traffic information data standard according to claim 2 is characterized in that: Before performing targeted format conversion on the passenger order data stream and the passenger check-in data stream to obtain a target passenger order data stream and a target passenger check-in data stream, the method further includes: In response to the passenger data stream efficient integration system based on the air traffic information data standard receiving the passenger order data stream, controlling the passenger data stream efficient integration system based on the air traffic information data standard to perform targeted deduplication and filtering processing on the passenger order data stream to obtain a processed passenger order data stream, wherein the processed passenger order data stream at least does not contain duplicate data and empty data; In response to the passenger data stream efficient integration system based on the air traffic information data standard receiving the passenger check-in data stream, the passenger data stream efficient integration system based on the air traffic information data standard is controlled to perform targeted deduplication and filtering processing on the passenger check-in data stream to obtain a processed passenger check-in data stream, wherein the processed passenger check-in data stream does not contain at least duplicate data and empty data.

4. The method for efficiently integrating passenger data streams based on air traffic information data standards according to claim 3 is characterized in that: The passenger order data stream and the passenger check-in data stream are converted into targeted formats to obtain the target passenger order data stream and the target passenger check-in data stream corresponding to the two, including: In response to completing the deduplication and filtering processing of the passenger order data stream and the passenger check-in data stream, the passenger data stream efficient integration system based on the air traffic information data standard is controlled to perform targeted format conversion on the passenger order data stream and the passenger check-in data stream respectively to obtain the target passenger order data stream and the target passenger check-in data stream.

5. The method for efficiently integrating passenger data streams based on air traffic information data standards according to claim 2 is characterized in that: Extracting target fields from the target passenger order data stream and the target passenger check-in data stream respectively includes: The efficient passenger data stream integration system based on the air traffic information data standard is controlled to extract data fields corresponding to preset associated items from the target passenger order data stream and the target passenger check-in data stream respectively as the target fields.

6. The method for efficiently integrating passenger data streams based on air traffic information data standards according to claim 5 is characterized in that: Based on the target field, the target passenger order data stream and the target passenger check-in data stream are integrated to obtain a data integration structure, including: Adding a time watermark to the target passenger order data stream and the target passenger check-in data stream, wherein the time watermark is used to indicate the acquisition time of the target passenger order data stream and the target passenger check-in data stream; According to the time watermark, configuring an operation window for the target passenger order data stream and the target passenger check-in data stream; In the operation window, an integration operation is performed on the target passenger order data stream and the target passenger check-in data stream according to the target field.

7. The method for efficiently integrating passenger data streams based on air traffic information data standards according to claim 2 is characterized in that: The target data structure includes at least an order layer, a passenger layer and a flight segment layer, and the target field includes at least an order data field, a passenger data field and a flight segment data field, wherein mapping the data integration result to the target data structure includes: Controlling the passenger data flow efficient integration system based on the air traffic information data standard, extracting the order data field corresponding to the order layer from the data integration result, and mapping the order data field to the order layer; Controlling the passenger data flow efficient integration system based on the air traffic information data standard to extract the passenger data field corresponding to the passenger layer from the data integration result, and mapping the passenger data field to the passenger layer; The efficient passenger data flow integration system based on the air traffic information data standard is controlled to extract the flight segment data field corresponding to the flight segment layer from the data integration result, and map the flight segment data field to the flight segment layer.

8. The method for efficiently integrating passenger data streams based on air traffic information data standards according to claim 2 is characterized in that: After mapping the data integration result into the target data structure, the method further includes: Control the efficient passenger data flow integration system based on the air traffic information data standard, store the mapped target data structure to a target storage location in a target storage medium, and set an indexing strategy for indexing to the target storage location, wherein the indexing strategy is used to query data fields in the target data structure from the target storage location.

9. An efficient passenger data flow integration system based on air traffic information data standards, characterized in that: include: an acquisition unit, configured to acquire a passenger order data stream and a passenger check-in data stream to be integrated, wherein the data format, data structure, and data source of the passenger order data stream are different from the data format, data structure, and data source of the passenger check-in data stream; a processing unit, configured to perform targeted format conversion on the passenger order data stream and the passenger check-in data stream to obtain a target passenger order data stream and a target passenger check-in data stream corresponding to the two respectively, wherein the data format of the target passenger order data stream is the same as the data format of the target passenger check-in data stream; an extraction unit, configured to extract target fields from the target passenger order data stream and the target passenger check-in data stream respectively, wherein the target fields are used to represent the association relationship between the target passenger order data stream and the target passenger check-in data stream; The integration unit is used to integrate the target passenger order data stream and the target passenger check-in data stream based on the target field to obtain a data integration result, and map the data integration result to a target data structure, wherein the target data structure complies with the air traffic information data standard.

10. A processor, characterized in that: The processor is used to run a program, wherein the program, when run by the processor, executes the method for efficiently integrating passenger data streams based on the air traffic information data standard as described in any one of claims 1 to 8.

Images