Airport security check data processing method and related device
By analyzing and counting airport security inspection data and building query services, the problem of lack of unified data processing standards in the existing technology is solved, and the effective data processing and user query functions are realized.
Patent Information
- Application Number
- CN202411639545.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-15
- Publication Date
- 2025-03-11
AI Technical Summary
The existing technology lacks unified passenger security data processing standards, resulting in limitations in the application of airport security data and cannot be directly provided to users.
By obtaining airport security inspection data, data analysis is performed to obtain record tables and dimension tables, indicator statistics are carried out for each airport security inspection scenario, airport security inspection summary table is constructed, and data statistics are conducted based on topic indicators, and finally query services are built to respond to user query requests.
It realizes effective processing and query of airport security inspection data, avoids the limitations of data application, can be provided to users for direct query and use, and improves the efficiency of security inspection data utilization.
Smart Images

Figure CN119597816A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of data processing technology, and in particular to a method for processing airport security inspection data and related devices. Background Art
[0002] With the rapid development of the aviation transportation industry, the importance of civil aviation security inspection has become increasingly prominent. In this context, the goal of security inspection has changed from simply pursuing "safety" to "high safety + high efficiency". However, data processing in the airport security inspection process has become an important part of achieving this goal.
[0003] However, there is currently no unified standard for processing passenger security data, which leads to certain limitations in the application of airport security data.
[0004] Therefore, there is an urgent need for a solution that can process airport security data so that the airport security data can be provided to users for direct use. Summary of the invention
[0005] In view of this, the present application provides a method and related device for processing airport security data to solve the technical problem that airport security data cannot be directly provided to users. As follows:
[0006] A method for processing airport security inspection data, comprising:
[0007] Obtain airport security data;
[0008] Performing data parsing on the airport security inspection data to obtain multiple record tables and multiple dimension tables;
[0009] According to the record table and the dimension table, indicator statistics are performed for the scene indicators corresponding to each airport security inspection scene to obtain indicator data corresponding to the scene indicators;
[0010] Obtaining an airport security inspection summary table according to the indicator data corresponding to the scenario indicator corresponding to each of the airport security inspection scenarios;
[0011] According to the airport security summary table, data statistics are performed for the subject indicators corresponding to each airport security subject to obtain statistical data corresponding to the subject indicators;
[0012] A query service is constructed according to the statistical data, so that the query service can provide corresponding query results according to the statistical data in response to a received query request.
[0013] In the above method, preferably, the step of obtaining airport security inspection data comprises:
[0014] Obtain airport security data transmitted by the airport business system;
[0015] Or, obtain airport security data transmitted by the security data source through the message queue middleware.
[0016] In the above method, preferably, the step of obtaining airport security inspection data comprises:
[0017] Receive passenger security inspection messages;
[0018] Parsing the passenger security inspection message to obtain airport security inspection data;
[0019] The airport security inspection data at least includes: a plurality of field contents, each of which at least corresponds to a field code and a field name.
[0020] The above method preferably performs data parsing on the airport security inspection data to obtain multiple record tables and multiple dimension tables, including:
[0021] At least filtering, deduplication, and encoding conversion are performed on the airport security inspection data in sequence to obtain a plurality of record tables;
[0022] According to the record table, feature fields are extracted according to dimension attributes corresponding to the target dimension to obtain multiple dimension tables.
[0023] In the above method, preferably, each of the record tables includes a plurality of fact fields corresponding to airport security inspection events, and each of the dimension tables includes a plurality of dimension fields corresponding to airport security inspection dimensions;
[0024] Each of the dimension tables is associated with at least one of the record tables, and each of the record tables is associated with at least one dimension table.
[0025] The above method preferably performs indicator statistics for the scene indicators corresponding to each airport security inspection scene according to the record table and the dimension table to obtain indicator data corresponding to the scene indicators, including:
[0026] For each airport security inspection scenario, filter the record table and dimension table corresponding to the airport security inspection scenario;
[0027] According to the scenario indicators corresponding to the airport security inspection scenario, the target fields are filtered in the filtered record table and dimension table;
[0028] According to the target field, the indicator data corresponding to the scene indicator corresponding to the airport security scene is obtained.
[0029] The above method preferably obtains an airport security summary table according to the indicator data corresponding to the scene indicator corresponding to each of the airport security scene, including:
[0030] The indicator data corresponding to the scene indicators corresponding to each of the airport security inspection scenes are spliced according to the scene indicators to obtain an airport security inspection summary table.
[0031] A device for processing airport security inspection data, comprising:
[0032] A data acquisition unit, used to obtain airport security data;
[0033] A data analysis unit, used for analyzing the airport security inspection data to obtain a plurality of record tables and a plurality of dimension tables;
[0034] An indicator statistics unit, used to perform indicator statistics on the scene indicators corresponding to each airport security inspection scene according to the record table and the dimension table, so as to obtain indicator data corresponding to the scene indicators;
[0035] A data summary unit, used to obtain an airport security summary table according to the indicator data corresponding to the scenario indicator corresponding to each of the airport security scenarios;
[0036] A subject statistics unit, used to perform data statistics on the subject indicators corresponding to each airport security inspection subject according to the airport security inspection summary table, so as to obtain statistical data corresponding to the subject indicators;
[0037] The service construction unit is used to construct a query service according to the statistical data, so that the query service can provide corresponding query results according to the statistical data in response to the received query request.
[0038] An electronic device, comprising:
[0039] A memory, used to store a computer program and data generated by the execution of the computer program;
[0040] A processor is used to execute the computer program to implement the method for processing airport security data as described in any one of the above.
[0041] A computer storage medium is used to store a computer program, and when the computer program is executed, it implements the airport security data processing method as described in any one of the above.
[0042] It can be seen from the above technical scheme that in a method for processing airport security data and related devices disclosed in the present application, after obtaining the airport security data, data analysis is performed on the airport security data to obtain multiple record tables and multiple dimension tables, and then according to the record tables and dimension tables, indicator statistics are performed for the scene indicators corresponding to each airport security scene respectively to obtain the indicator data corresponding to the scene indicators, and an airport security summary table is obtained accordingly. After data statistics are performed for the subject indicators corresponding to each airport security subject according to the airport security summary table to obtain the corresponding statistical data, a query service can be constructed according to the statistical data corresponding to the subject indicators, thereby responding to the received query request through the constructed query service to provide corresponding query results according to the statistical data, avoiding the application limitations of the airport security data, and providing it to users for direct query and use. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] The above and other features, advantages and aspects of the embodiments of the present application will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.
[0044] Figure 1 A flowchart of a method for processing airport security data provided in Example 1 of the present application;
[0045] Figure 2 This is an example diagram of the data warehouse ODS layer-passenger security verification data field in the embodiment of the present application;
[0046] Figure 3 A schematic diagram of the structure of a device for processing airport security inspection data provided in Embodiment 2 of the present application;
[0047] Figure 4 This is an example diagram of the overall layering of the airport passenger security inspection data model in the embodiment of the present application;
[0048] Figure 5 This is an example diagram of the original data planning of airport passenger security inspection in the embodiment of the present application;
[0049] Figure 6 This is an example diagram of a wide table summarizing airport passenger security inspection data in an embodiment of the present application;
[0050] Figure 7 This is an example diagram of DWD layer data cleaning-encoding mapping of the data model in the embodiment of the present application;
[0051] Figure 8 This is an example diagram of DWD layer data cleaning-encoding conversion of the data model in the embodiment of the present application;
[0052] Fig. 9 This is an example diagram of DWD layer data cleaning-passenger security verification data dimension extraction of the data model in the embodiment of the present application;
[0053] Fig.10 This is a network example diagram of the partial relationship of the DWD layer of the airport passenger security inspection data model in the embodiment of the present application;
[0054] Fig.11 This is an example diagram of the DWS layer data summary statistics - passenger inspection number statistics of the data model in the embodiment of the present application;
[0055] Fig.12 It is the overall construction diagram of the ADS layer subject domain of the data model in the embodiment of the present application;
[0056] Fig.13 It is a schematic diagram of the structure of an electronic device suitable for implementing the embodiments of the present application. DETAILED DESCRIPTION
[0057] The embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be construed as being limited to the embodiments described herein. Instead, these embodiments are provided to provide a more thorough and complete understanding of the present application. It should be understood that the drawings and embodiments of the present application are only for exemplary purposes and are not intended to limit the scope of protection of the present application.
[0058] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.
[0059] It should be noted that the concepts such as "first" and "second" mentioned in this application are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.
[0060] It should be noted that the modifications of "one" and "plurality" mentioned in the present application are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".
[0061] refer to Figure 1As shown, it is a flowchart of a method for processing airport security data provided in the first embodiment of the present application, which can be applied to electronic devices, such as computers or servers equipped with data warehouses, etc. The technical solution in this embodiment is mainly used to process airport security data to provide it to users.
[0062] Specifically, the method in this embodiment may include the following steps:
[0063] Step 101: Obtain airport security data.
[0064] Among them, the airport security data is the data provided by the airport business system, and the airport business system can be the airport transfer system, airport security system, airport boarding review system, etc.
[0065] In one case, in step 101, the airport security inspection data transmitted by the airport business system may be obtained through a direct connection interface with the airport business system;
[0066] In another case, the airport security data transmitted by the security data source may be obtained through the message queue middleware in step 101. The security data source here may be an airport business system or other data sources.
[0067] Specifically, in step 101, a passenger security message, such as a passenger security verification data message, may be received first, and then the passenger security message may be parsed to obtain airport security data. The obtained airport security data may include at least: a plurality of field contents, each field content at least corresponding to a field code and a field name.
[0068] Taking passenger security verification data as an example, the airport business system sends the corresponding message through the message queue middleware. After receiving the message, this embodiment stores it in the original data layer ODS (Operation Data Store) of the data warehouse, which can also be called the data introduction layer. This process does not change the data, but only performs simple data parsing for storage. Figure 2 As shown in , it is the passenger security verification data field in the ODS layer of the data warehouse. Figure 2 The figure shows the original fields of the passenger security verification data message. The original field has a field code and a field name. Taking the field of the verification terminal as an example, it has a field code "SCT_DPSC_Device" and a field name "Verification Terminal". After parsing, it is stored in the ODS layer with the same field name and field value to prepare for subsequent data cleaning.
[0069] Step 102: Parse the airport security data to obtain multiple record tables and multiple dimension tables.
[0070] Each record table includes a plurality of fact fields corresponding to airport security inspection events, and each dimension table includes a plurality of dimension fields corresponding to airport security inspection dimensions.
[0071] Specifically, in step 102, the airport security data may first be filtered, deduplicated, and encoded in sequence to obtain a plurality of record tables, and then, based on these record tables, feature fields may be extracted according to dimensional attributes corresponding to the target dimensions to obtain a plurality of dimensional tables.
[0072] Each dimension table is associated with at least one record table, and each record table is associated with at least one dimension table.
[0073] For example, in step 102, the null value data and dirty data in the airport security data are filtered, the duplicate data is deduplicated, and the specific fields such as the verification type field and the boarding pass type field are converted to obtain a record table; then, according to the record table, the characteristic fields on the dimension attributes corresponding to the target dimension are extracted to obtain the dimension table on the target dimension, such as the passenger dimension table, flight dimension table, equipment terminal dimension table, date dimension table, etc. The record table and dimension table can be stored in the detailed data layer DWD (Data Warehouse Details) layer in the data warehouse, which can also be called the data detail layer.
[0074] Step 103: According to the record table and the dimension table, the scenario indicators corresponding to each airport security inspection scenario are respectively counted to obtain the indicator data corresponding to the scenario indicators.
[0075] Specifically, in this embodiment, for each airport security scene, the record table and dimension table corresponding to the airport security scene can be screened, wherein the record tables and dimension tables corresponding to different airport security scenes may be the same or different; then, according to the scene indicators corresponding to the airport security scene, the target fields are screened in the screened record tables and dimension tables, wherein the scene indicators corresponding to different airport security scenes are different; finally, according to the target field, the indicator data corresponding to the scene indicators corresponding to the airport security scene is obtained.
[0076] Taking the passenger inspection scenario as an example, in this embodiment, the record table and dimension table corresponding to the passenger inspection scenario are screened, such as the passenger security verification record table and the device terminal dimension table, and then according to the scenario indicators corresponding to the passenger inspection scenario, such as the number of passengers inspected per day at each terminal, the corresponding target fields are screened in the passenger security verification record table and the device terminal dimension table. Finally, the number of passengers inspected per day at each terminal is counted according to the target fields, that is, the indicator data corresponding to the scenario indicators corresponding to the passenger inspection scenario.
[0077] Step 104: Obtain an airport security summary table according to the indicator data corresponding to the scenario indicator corresponding to each airport security scenario.
[0078] Specifically, in this embodiment, the indicator data corresponding to the scene indicator corresponding to each airport security scene can be spliced according to the scene indicator to obtain an airport security summary table.
[0079] For example, in step 104, the number of passengers and the number of passengers who pass through each terminal every day are joined to obtain an airport security summary table. The airport security summary table can be stored in the summary data layer DWS (Data Warehouse Service) layer in the data warehouse, which can also be called the data service layer.
[0080] Step 105: According to the airport security summary table, data statistics are performed for the theme indicators corresponding to each airport security theme to obtain statistical data corresponding to the theme indicators.
[0081] For example, the airport security inspection theme can include airport theme, passenger theme, equipment terminal theme, contraband theme, employee theme, etc. Taking the employee theme as an example, it corresponds to theme indicators: employee attendance rate, employee item seizure rate, employee performance ranking. In this embodiment, according to the airport security inspection summary table, data statistics are performed on these theme indicators for the employee theme to obtain corresponding statistical data, that is, the theme table. The theme table can be stored in the application data layer ADS (Application Data Service) layer in the data warehouse, which can also be called the data application layer.
[0082] Step 106: construct a query service based on the statistical data, so that the query service can provide corresponding query results based on the statistical data in response to the received query request.
[0083] Specifically, in this embodiment, the query service can be registered in the service to provide it to the user for invocation. For example, the user invokes the query service corresponding to the employee attendance rate, and the query service receives the query request and provides corresponding query results based on the statistical data of the employee attendance rate.
[0084] It can be seen from the above technical scheme that in a method for processing airport security data provided in Example 1 of the present application, after obtaining the airport security data, data analysis is performed on the airport security data to obtain multiple record tables and multiple dimension tables, and then, based on the record tables and dimension tables, indicator statistics are performed for the scene indicators corresponding to each airport security scene to obtain indicator data corresponding to the scene indicators, and an airport security summary table is obtained accordingly. After data statistics are performed for the subject indicators corresponding to each airport security subject according to the airport security summary table to obtain corresponding statistical data, a query service can be constructed according to the statistical data corresponding to the subject indicators. As a result, the constructed query service can respond to the received query request and provide corresponding query results according to the statistical data, thereby avoiding the application limitations of the airport security data and providing it to users for direct query and use.
[0085] It should be noted that the flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or the flowchart, and the combination of the boxes in the block diagram and / or the flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0086] The names of the messages or information exchanged between multiple devices in the embodiments of the present application are only used for illustrative purposes and are not used to limit the scope of these messages or information.
[0087] Although operations are depicted in a particular order, this should not be understood as requiring that the operations be performed in the particular order shown or in a sequential order.Multitasking and parallel processing may be advantageous under certain circumstances.
[0088] It should be understood that the various steps described in the method implementation of the present application can be performed in different orders and / or performed in parallel. In addition, the method implementation may include additional steps and / or omit the steps shown. The scope of the present application is not limited in this respect.
[0089] Computer program code for performing the operations of the present application may be written in one or more programming languages or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0090] refer to Figure 3 , is a schematic diagram of the structure of a device for processing airport security data provided in Embodiment 2 of the present application, which can be applied to electronic devices, such as computers or servers equipped with data warehouses. The technical solution in this embodiment is mainly used to process airport security data to provide it to users.
[0091] Specifically, the device in this embodiment may include the following units:
[0092] The data acquisition unit 301 is used to obtain airport security inspection data;
[0093] A data analysis unit 302 is used to analyze the airport security data to obtain multiple record tables and multiple dimension tables;
[0094] An indicator statistics unit 303, used to perform indicator statistics on the scene indicators corresponding to each airport security inspection scene according to the record table and the dimension table, so as to obtain indicator data corresponding to the scene indicators;
[0095] A data summary unit 304, configured to obtain an airport security summary table according to the indicator data corresponding to the scenario indicator corresponding to each of the airport security scenarios;
[0096] The subject statistics unit 305 is used to perform data statistics on the subject indicators corresponding to each airport security subject according to the airport security summary table, so as to obtain statistical data corresponding to the subject indicators;
[0097] The service construction unit 306 is used to construct a query service according to the statistical data, so that the query service can provide corresponding query results according to the statistical data in response to the received query request.
[0098] It can be seen that in an airport security data processing device provided in Example 2 of the present application, after obtaining the airport security data, data analysis is performed on the airport security data to obtain multiple record tables and multiple dimension tables, and then, based on the record tables and dimension tables, indicator statistics are performed for the scene indicators corresponding to each airport security scene to obtain indicator data corresponding to the scene indicators, and an airport security summary table is obtained accordingly. After data statistics are performed for the subject indicators corresponding to each airport security subject according to the airport security summary table to obtain corresponding statistical data, a query service can be constructed according to the statistical data corresponding to the subject indicators. As a result, the constructed query service can respond to the received query request and provide corresponding query results according to the statistical data, thereby avoiding the application limitations of the airport security data and providing it to users for direct query and use.
[0099] In one implementation, the data acquisition unit 301 is specifically used to: obtain airport security data transmitted by an airport business system; or obtain airport security data transmitted by a security data source through a message queue middleware.
[0100] In one implementation, the data acquisition unit 301 is specifically used to: receive a passenger security message; parse the passenger security message to obtain airport security data; wherein the airport security data at least includes: multiple field contents, each of the field contents at least corresponding to a field code and a field name.
[0101] In one implementation, the data parsing unit 302 is specifically used to: at least filter, deduplicate, and encode the airport security data in sequence to obtain multiple record tables; based on the record tables, extract feature fields according to the dimensional attributes corresponding to the target dimension to obtain multiple dimensional tables.
[0102] Each of the record tables includes multiple fact fields corresponding to airport security events, and each of the dimension tables includes multiple dimension fields corresponding to airport security dimensions; each of the dimension tables is associated with at least one of the record tables, and each of the record tables is associated with at least one dimension table.
[0103] In one implementation, the indicator statistics unit 303 is specifically used to: for each airport security scene, filter the record table and dimension table corresponding to the airport security scene; filter the target field in the filtered record table and dimension table according to the scene indicator corresponding to the airport security scene; and obtain the indicator data corresponding to the scene indicator corresponding to the airport security scene according to the target field.
[0104] In one implementation, the data summary unit 304 is specifically used to: splice the indicator data corresponding to the scene indicator corresponding to each of the airport security inspection scenes according to the scene indicator to obtain an airport security inspection summary table.
[0105] It should be noted that the specific implementation of each unit in this embodiment can refer to the corresponding description in the previous text and will not be described in detail here.
[0106] The modules involved in the embodiments described in this application may be implemented by software or hardware. The name of the module does not limit the unit itself in some cases. For example, the analysis module may also be described as a "statistical analysis module".
[0107] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.
[0108] Taking a civil aviation airport as an example, the processing scheme of airport security inspection data implemented by the technical scheme of this application is illustrated as follows:
[0109] With the rapid development of the aviation transportation industry, the importance of civil aviation security inspection has become increasingly prominent. In this context, the goal of security inspection has changed from simply pursuing "safety" to "high safety + high efficiency". However, data generation and processing in the airport security inspection process has become an important part of achieving this goal.
[0110] The existing security inspection work mainly has the following two problems: first, there is no unified passenger security inspection data standard, which leads to certain limitations in the application of data; second, there is a lack of passenger security inspection scene output capabilities, which cannot meet the needs of passenger security inspection business in various scenarios at airports.
[0111] Therefore, by building a global digital model and business model for airport security scenarios, a complete airport security data governance solution can be formed to achieve the sinking of security system data, business, and capabilities. This will help promote the mining and connection of the entire chain of airport security business, the entire process of passenger and baggage security inspection, and the precipitation of scenario data. By establishing the above model, the airport can create a smooth information exchange channel between internal and external systems, so that various business systems can exchange data and collaborate in a unified and standard manner. This will strongly support various new business function requirements and processes, and improve the airport's operating efficiency and service quality.
[0112] Accordingly, the technical solution of this application is described in detail below:
[0113] First, model construction (i.e., building a data warehouse) mainly includes the standard definition of dimensions and attributes. The data level of model construction needs to be divided according to different business scenarios, and multiple data tables need to be established, including dimension tables, detailed fact tables, and summary fact tables. The establishment of these tables needs to be carried out in accordance with certain specifications. When modeling data, different modeling methods should be used according to business characteristics.
[0114] This data model (i.e., data warehouse) is divided into four layers: ODS raw data layer, DWD detailed data layer, DWS summary data layer, and ADS application data layer. These layers correspond to different data processing processes, from the aggregation and extraction of raw data, to the conversion and aggregation of detailed data, and then to the processing and provision of application data. The overall stratification is as follows: Figure 4 As shown in , the ODS layer stores the original data related to passenger security inspection obtained from MQ and business library, the DWD layer stores the fact table and dimension table related to passenger security inspection, the DWS layer stores the summary table related to passenger security inspection, and the ADS layer stores the application subject table related to passenger security inspection to provide query services and query reports.
[0115] When building a data warehouse, you need to follow the method of fact tables and dimension tables. Fact tables mainly record the elements of specific events and what happened, while dimension tables contain the attributes and characteristics related to these facts, which are descriptive information of these elements. Modeling (i.e. building tables) is completed according to business process → declaration granularity → confirmation of dimensions → confirmation of facts. This modeling method can effectively organize and manage data and provide support for subsequent data analysis and decision-making.
[0116] According to the airport passenger security inspection business scenario, we can roughly plan the following Figure 5 The raw data shown in the figure include fact tables and dimension tables. The passenger security inspection data fact table is a record table, such as passenger security inspection verification record table, passenger pre-security inspection record table, passenger carry-on baggage unpacking record table, passenger checked baggage unpacking record table, passenger personal inspection information (millimeter wave imaging) record table, passenger carry-on baggage explosive detection record table, passenger off-board verification record table, equipment and facility (terminal) opening and closing record table, employee security inspection verification record table, employee on-and-off record table, etc. Dimension tables can include: passenger dimension table, employee dimension table, flight dimension table, airport dimension table, contraband dimension table, date dimension table, equipment terminal dimension table, etc.
[0117] (1) The main process of airport passenger security screening includes security verification, unpacking of carry-on and checked baggage, personal inspection, explosive detection records, off-board verification and other factual records, as well as auxiliary services such as equipment terminal status, employee security verification, and employee on-duty and off-duty.
[0118] (2) Determine the minimum granularity of the data, taking the passenger security check operation record as a fact, such as a passenger passing a security check, unpacking a passenger's checked baggage, and conducting an off-board inspection.
[0119] (3) Extract corresponding attributes and features based on business facts to form relevant dimensional information, such as passenger dimension, flight dimension, prohibited items dimension, airport dimension, etc.
[0120] The original business data needs to be extracted to ODS through data aggregation. In ODS, the table structure is highly similar to the source system table structure, and data mapping, field screening, enumeration value conversion and encoding unification are completed. Data conversion and aggregation are performed through data extraction tools, such as Figure 6 The airport passenger security inspection data summary wide table shown in the figure, such as daily passenger inspection behavior wide table, daily passenger contraband behavior wide table, daily terminal channel behavior, daily employee behavior wide table, etc., and organize modeling according to the theme, explore the data value, rely on the scene to perform statistics, establish a data warehouse, and provide external data access. This process completes the process of operational data entering the analysis environment from the operating environment.
[0121] The passenger security data modeling process is as follows:
[0122] 1) Extract data from the message queue MQ or business library (airport business system) to the ODS layer:
[0123] Taking passenger security verification data as an example, the airport business system sends a message through the message queue middleware. After the data warehouse receives the message, it is stored in the data warehouse ODS layer. This process does not change the data, but only performs a simple data analysis for storage. Figure 4 As shown in , it is the original field of the passenger security verification data message. After parsing, it is stored in the ODS layer with the same field name and field value to prepare for subsequent data cleaning.
[0124] 2) Clean the data in the ODS layer to the DWD layer:
[0125] The ODS layer usually contains data from multiple source systems (airport business systems), and the original data may be duplicated, inconsistent or erroneous. By cleaning and processing the data to the DWD layer, operations such as data correction, standardization and conversion can be performed to ensure data quality and consistency. The data cleaned and loaded into the DWD layer also includes historical data, which can be used for tasks such as trend analysis, pattern recognition and predictive modeling. By retaining historical data in the DWD layer (i.e., data stored historically in the DWD layer), past business trends can be traced and analyzed to support more accurate decision making and planning.
[0126] ① First, filter out the null value data and dirty data in the ODS layer and remove duplicate data. Then perform encoding conversion on certain fields to ensure data standardization and consistency, such as Figure 7 as shown in .
[0127] For example, the passenger security verification data message contains fields that need to be escaped, such as verification type dpsc type, boarding pass type ckcdtptype, barcode type barcode type, and security channel attribute type channel type. Through the established encoding mapping relationship, the field values are encoded and cleaned to form a unified standard that meets the specifications. For example, the field code "0000" in the verification type field needs to be converted to value "1". Some of the transcoded content is as follows Figure 8 As shown in, for example, for a field code of "SCT_DPSC_TYPE" and a field value of "0000" whose field name is "verification type", the field code is converted to "DPSC_TYPE" and the field value is converted to "1".
[0128] ②According to the business facts (i.e. the record table obtained in ①), extract the corresponding attributes and features to form relevant dimensional information, i.e. the dimension table. For example, the passenger dimension table contains passenger document information, etc.; the flight dimension table contains flight information, flight status, take-off time, etc.; the prohibited items dimension table contains prohibited items codes, prohibited items category levels, etc.; the equipment terminal dimension table contains terminal information, terminal attributes, etc.; the date (time) dimension table contains year, month, and day information; the airport dimension table contains airport information, etc.; the employee dimension table includes employee information, etc. These attribute characteristics can reflect the elements of the fact record. Taking passenger security verification data as an example, the fact record is extracted in dimensions, such as Fig. 9 as shown in .
[0129] It mainly includes device terminal dimension information extracted by verifying the terminal and terminal name; employee dimension information extracted by verifying the employee ID, employee work number and name; flight dimension information extracted by the associated passenger flight and flight date; airport dimension information extracted by the departure station, destination station code and Chinese name; passenger dimension information extracted by the passenger's Chinese and English name, certificate type, and certificate number, etc.
[0130] According to the above data cleaning rules, the construction of the DWD layer in the airport passenger security data model can be output as follows: Fig.10The partial relationship network diagram shown, taking the passenger security verification record table as an example, is associated with: passenger dimension table, flight dimension table, airport dimension table, equipment terminal dimension table, and employee dimension table; taking the employee dimension table as an example, it is associated with: passenger security verification record table, passenger personal inspection information (millimeter wave) record table, passenger carry-on baggage security inspection unpacking record table, passenger checked baggage unpacking record table, passenger carry-on baggage explosive detection record table, equipment and facility (terminal) opening and closing record table, employee security verification record table, and employee on and off duty record table.
[0131] Since the DWD layer has been cleaned and transformed, the data structure and query performance are usually optimized. This makes it more efficient to perform complex data analysis queries in the DWD layer and can meet the needs of large amounts of data and complex calculations.
[0132] 3) Summarize and collect statistics on the data in the DWD layer to the DWS layer:
[0133] After the DWD layer cleaning and conversion, this embodiment can dig as deep as possible into the required data value according to different business scenarios, so as to count the effective data generated by the daily passenger security inspection behavior. These data involve multiple aspects, including but not limited to passenger inspection scenarios, carry-on and checked baggage unpacking scenarios, and employee on-duty and off-duty scenarios.
[0134] In the passenger inspection scenario, the number of passengers and the number of people inspected at each terminal every day can be counted from the dimension of the device terminal (device terminal dimension table). These data can reflect the passenger flow and security inspection efficiency, help users better understand the security inspection needs and habits of passengers, and thus optimize the security inspection process and resource allocation; in the carry-on baggage and checked baggage unpacking scenario, the number of unpacking and handling methods of related items can be counted from the dimension of prohibited items. These data can reflect the problems and prohibited items found during the security inspection process, help users to promptly discover potential safety hazards, and improve the quality and effectiveness of security inspections; in the employee on and off-duty scenario, the daily employee working hours and their corresponding performance can be counted from the dimension of employees. These data can reflect the work efficiency and performance of employees, help users formulate reasonable employee management and incentive mechanisms, and thus improve the work enthusiasm and satisfaction of employees.
[0135] By forming a DWS layer wide table with these data, the present embodiment can more comprehensively understand the business situation and provide key support for the construction of subsequent model themes. These data can provide a strong basis for business decision-making and help users better grasp market opportunities and business development directions.
[0136] Taking the daily passenger inspection behavior as an example, combining the date dimension, device terminal dimension and passenger security inspection verification fact record, the following is obtained: Fig.11The statistical results of the relevant number of people who have passed inspection and the number of people who have passed inspection are shown, such as the number of people who have passed inspection (total), the number of people who have passed inspection (passed), the number of people who have passed inspection (prohibited), the number of people who have passed inspection (total), the number of people who have passed inspection (passed), the number of people who have passed inspection (prohibited), etc.
[0137] 4) Output to the subject domain of the ADS layer through business drivers and generate services (i.e. query access):
[0138] Through the ADS layer, this embodiment can obtain more sophisticated and diversified data processing capabilities. For business data, this layer can perform in-depth analysis and provide effective data based on different subject domains, giving a multi-dimensional perspective to help users better understand business situations.
[0139] In the airport theme domain, data such as airport passenger flow ranking and airport safety rate can be analyzed. In the passenger theme domain, the activity of passengers can be analyzed, including statistics of active passengers and their behavior patterns. In addition, by counting the number of people who have passed inspection and the number of people who have passed inspection, it is also possible to evaluate passengers' travel habits and preferences, such as statistics on illegal passengers in the past three years and rankings of the number of passengers on flights. In the device terminal theme domain, the ADS layer can analyze the channel flow statistics and channel inspection efficiency statistics to help users optimize security inspection processes and improve operational efficiency. For example, in the prohibited items theme domain, based on the behavior of passengers unpacking their luggage for prohibited items, statistics can be obtained on the ranking of prohibited items carried, the normal distribution of the number of prohibited items, etc., to help solve airport safety issues. In the employee theme domain, employee attendance rate, employee item seizure rate, employee performance ranking, etc. can also be analyzed. Fig.12 as shown in .
[0140] In terms of data analysis and processing, the ADS layer also provides a variety of functions. In addition to conventional data aggregation and statistics, it can also perform advanced data analysis operations such as data mining and model training. At the same time, for complex data processing tasks, this layer can also provide efficient and stable data processing capabilities to ensure the accuracy and integrity of the data.
[0141] Therefore, the ADS layer, as an important link provided to users for application-oriented purposes, can provide airports with all-round and multi-dimensional data analysis services, helping them to better understand their business situations, improve operational efficiency and service quality.
[0142] In summary, in this application, by constructing a full-domain digital model and business model of airport security scenarios, a complete set of airport security data governance solutions can be formed to achieve the sinking of security system data, business, and capabilities. This will help promote the mining and connection of the entire chain of airport security business, the entire process of passenger and baggage security inspections, and the precipitation of scenario data. By establishing the above model, the airport can create a smooth information exchange channel between internal and external systems, so that various different business systems can exchange data and collaborate in a unified and standard manner. This will strongly support various new business function requirements and processes, and improve the airport's operating efficiency and service quality.
[0143] Reference below Fig.13 , which shows a schematic diagram of the structure of an electronic device suitable for implementing an embodiment of the present application. Fig.13 The electronic device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.
[0144] like Fig.13 As shown, the electronic device may include a processor (e.g., a central processing unit, a graphics processor, etc.) 1301, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1302 or a program loaded from a storage device 1308 into a random access memory (RAM) 1303. In RAM 1303, various programs and data required for the operation of the electronic device are also stored. The processor 1301, ROM 1302, and RAM 1303 are connected to each other via a bus 1304. An input / output (I / O) interface 1305 is also connected to the bus 1304.
[0145] Typically, the following devices may be connected to the I / O interface 1305: an input device 1306 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 1307 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 1308 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1309. The communication device 1309 may allow the electronic device to communicate with other devices wirelessly or by wire to exchange data. Although Fig.13 An electronic device having various devices is shown, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.
[0146] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a non-transitory computer storage medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 1309, or installed from the storage device 1308, or installed from the ROM 1302. When the computer program is executed by the processor 1301, the above functions defined in the method of the embodiment of the present application are executed:
[0147] Obtain airport security data;
[0148] Performing data parsing on the airport security inspection data to obtain multiple record tables and multiple dimension tables;
[0149] According to the record table and the dimension table, indicator statistics are performed for the scene indicators corresponding to each airport security inspection scene to obtain indicator data corresponding to the scene indicators;
[0150] Obtaining an airport security inspection summary table according to the indicator data corresponding to the scenario indicator corresponding to each of the airport security inspection scenarios;
[0151] According to the airport security summary table, data statistics are performed for the subject indicators corresponding to each airport security subject to obtain statistical data corresponding to the subject indicators;
[0152] A query service is constructed according to the statistical data, so that the query service can provide corresponding query results according to the statistical data in response to a received query request.
[0153] The embodiments of the present application also claim to protect a computer storage medium for storing computer software instructions used for the above-mentioned electronic device, which includes a program designed for executing the above-mentioned aspects.
[0154] The computer storage medium carries one or more computer programs. When the one or more computer programs are executed by an electronic device, the electronic device:
[0155] Obtain airport security data;
[0156] Performing data parsing on the airport security inspection data to obtain multiple record tables and multiple dimension tables;
[0157] According to the record table and the dimension table, indicator statistics are performed for the scene indicators corresponding to each airport security inspection scene to obtain indicator data corresponding to the scene indicators;
[0158] Obtaining an airport security inspection summary table according to the indicator data corresponding to the scenario indicator corresponding to each of the airport security inspection scenarios;
[0159] According to the airport security summary table, data statistics are performed for the subject indicators corresponding to each airport security subject to obtain statistical data corresponding to the subject indicators;
[0160] A query service is constructed according to the statistical data, so that the query service can provide corresponding query results according to the statistical data in response to a received query request.
[0161] In the context of the present application, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any suitable combination of the above. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. It should be noted that the computer-readable medium described above in the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above. A computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to, an electrical connection with one or more conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code embodied on the computer readable medium may be transmitted using any appropriate medium, including but not limited to: wire, optical cable, RF (radio frequency), etc., or any suitable combination of the foregoing.
[0162] The computer storage medium may be included in the electronic device, or may exist independently without being installed in the electronic device.
[0163] According to one or more embodiments of the present application, Figure 1The illustrated embodiment provides a method for processing airport security inspection data, the method comprising:
[0164] Obtain airport security data;
[0165] Performing data parsing on the airport security inspection data to obtain multiple record tables and multiple dimension tables;
[0166] According to the record table and the dimension table, indicator statistics are performed for the scene indicators corresponding to each airport security inspection scene to obtain indicator data corresponding to the scene indicators;
[0167] Obtaining an airport security inspection summary table according to the indicator data corresponding to the scenario indicator corresponding to each of the airport security inspection scenarios;
[0168] According to the airport security summary table, data statistics are performed for the subject indicators corresponding to each airport security subject to obtain statistical data corresponding to the subject indicators;
[0169] A query service is constructed according to the statistical data, so that the query service can provide corresponding query results according to the statistical data in response to a received query request.
[0170] According to one or more embodiments of the present application, Figure 3 A device for processing airport security inspection data is provided, the device comprising:
[0171] A data acquisition unit, used to obtain airport security data;
[0172] A data analysis unit, used for analyzing the airport security inspection data to obtain a plurality of record tables and a plurality of dimension tables;
[0173] An indicator statistics unit, used to perform indicator statistics on the scene indicators corresponding to each airport security inspection scene according to the record table and the dimension table, so as to obtain indicator data corresponding to the scene indicators;
[0174] A data summary unit, used to obtain an airport security summary table according to the indicator data corresponding to the scenario indicator corresponding to each of the airport security scenarios;
[0175] A subject statistics unit, used to perform data statistics on the subject indicators corresponding to each airport security inspection subject according to the airport security inspection summary table, so as to obtain statistical data corresponding to the subject indicators;
[0176] The service construction unit is used to construct a query service according to the statistical data, so that the query service can provide corresponding query results according to the statistical data in response to the received query request.
[0177] According to one or more embodiments of the present application, Fig.13 An electronic device is provided, comprising:
[0178] Memory, such as ROM 1302, RAM 1303 and storage device 1308, is used to store computer programs and data generated by the operation of the computer programs;
[0179] A processor is used to execute the computer program to achieve: obtaining airport security data; performing data analysis on the airport security data to obtain multiple record tables and multiple dimension tables; performing indicator statistics for the scene indicators corresponding to each airport security scene according to the record tables and the dimension tables to obtain indicator data corresponding to the scene indicators; obtaining an airport security summary table according to the indicator data corresponding to the scene indicators corresponding to each airport security scene; performing data statistics for the subject indicators corresponding to each airport security subject according to the airport security summary table to obtain statistical data corresponding to the subject indicators; and constructing a query service according to the statistical data so that the query service can provide corresponding query results according to the statistical data in response to a received query request.
[0180] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.
[0181] Although several specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present application. Certain features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination.
[0182] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in this application (but not limited to) by each other to form a technical solution.
Claims
1. A method for processing airport security data, characterized in that: include: Obtain airport security data; Performing data parsing on the airport security inspection data to obtain multiple record tables and multiple dimension tables; According to the record table and the dimension table, indicator statistics are performed for the scene indicators corresponding to each airport security inspection scene to obtain indicator data corresponding to the scene indicators; Obtaining an airport security inspection summary table according to the indicator data corresponding to the scenario indicator corresponding to each of the airport security inspection scenarios; According to the airport security summary table, data statistics are performed for the subject indicators corresponding to each airport security subject to obtain statistical data corresponding to the subject indicators; A query service is constructed according to the statistical data, so that the query service can provide corresponding query results according to the statistical data in response to a received query request.
2. The method according to claim 1, characterized in that The obtaining of airport security data includes: Obtain airport security data transmitted by the airport business system; Or, obtain airport security data transmitted by the security data source through the message queue middleware.
3. The method according to claim 1 or 2, characterized in that: The obtaining of airport security data includes: Receive passenger security inspection messages; Parsing the passenger security inspection message to obtain airport security inspection data; The airport security inspection data at least includes: a plurality of field contents, each of which at least corresponds to a field code and a field name.
4. The method according to claim 1, characterized in that: The airport security inspection data is parsed to obtain multiple record tables and multiple dimension tables, including: At least filtering, deduplication, and encoding conversion are performed on the airport security inspection data in sequence to obtain a plurality of record tables; According to the record table, feature fields are extracted according to dimension attributes corresponding to the target dimension to obtain multiple dimension tables.
5. The method according to claim 4, characterized in that Each of the record tables includes a plurality of fact fields corresponding to airport security inspection events, and each of the dimension tables includes a plurality of dimension fields corresponding to airport security inspection dimensions; Each of the dimension tables is associated with at least one of the record tables, and each of the record tables is associated with at least one dimension table.
6. The method according to claim 1, characterized in that According to the record table and the dimension table, the scenario indicators corresponding to each airport security inspection scenario are respectively statistically analyzed to obtain the indicator data corresponding to the scenario indicators, including: For each airport security inspection scenario, filter the record table and dimension table corresponding to the airport security inspection scenario; According to the scenario indicators corresponding to the airport security inspection scenario, the target fields are filtered in the filtered record table and dimension table; According to the target field, the indicator data corresponding to the scene indicator corresponding to the airport security scene is obtained.
7. The method according to claim 1, characterized in that According to the indicator data corresponding to the scenario indicator corresponding to each of the airport security inspection scenarios, an airport security inspection summary table is obtained, including: The indicator data corresponding to the scene indicators corresponding to each of the airport security inspection scenes are spliced according to the scene indicators to obtain an airport security inspection summary table.
8. A device for processing airport security inspection data, characterized in that: include: A data acquisition unit, used to obtain airport security data; A data analysis unit, used for analyzing the airport security inspection data to obtain a plurality of record tables and a plurality of dimension tables; An indicator statistics unit, used to perform indicator statistics on the scene indicators corresponding to each airport security inspection scene according to the record table and the dimension table, so as to obtain indicator data corresponding to the scene indicators; A data summary unit, used to obtain an airport security summary table according to the indicator data corresponding to the scenario indicator corresponding to each of the airport security scenarios; A subject statistics unit, used to perform data statistics on the subject indicators corresponding to each airport security inspection subject according to the airport security inspection summary table, so as to obtain statistical data corresponding to the subject indicators; The service construction unit is used to construct a query service according to the statistical data, so that the query service can provide corresponding query results according to the statistical data in response to the received query request.
9. An electronic device, characterized in that: include: A memory, used to store a computer program and data generated by the execution of the computer program; A processor is used to execute the computer program to implement the method for processing airport security data as described in any one of claims 1 to 7.
10. A computer storage medium, characterized in that: Used to store a computer program, which, when executed, implements the method for processing airport security data as described in any one of claims 1 to 7.