A data link quality monitoring and evaluation method and device based on PBCS operation

Abstract

A data link quality monitoring and evaluation method based on PBCS operation, data link quality analysis based on PBCS specification, PBCS operation unit performance analysis, performance unqualified subsystem problem analysis, stage performance comparison analysis, comprehensive analysis of data link quality monitoring results, so as to realize multi-dimensional analysis of data link operation quality, auxiliary perfect PBCS operation quality monitoring and evaluation mechanism, based on PBCS operation quality standard, realize the systematic analysis and research of CPDLC, ADS-C message based on RCP and RSP specification, aiming at control unit and aviation operation person, carry out operation quality evaluation analysis based on PBCS standard, carry out performance comparison analysis based on different base stations, different aviation operators, different time periods and other multi-dimensional performance comparison analysis.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of civil aviation data processing, and in particular to a data link quality monitoring and evaluation method based on PBCS operation and a data link quality monitoring and evaluation device based on PBCS operation. BACKGROUND

[0002] According to the global unified deployment of the International Civil Aviation Organization (ICAO), China Civil Aviation began to implement performance-based communication and surveillance (PBCS) operation in the airspace / route providing contract automatic dependent surveillance (ADS-C) / controller-pilot data link communication (CPDLC) data link services at 0:00 (UTC) on March 29, 2018. At present, China mainly provides PBCS data link services in L888, Y1, and Y2 routes in Lanzhou and Urumqi flight data areas.

[0003] The PBCS concept evaluates different communication / surveillance technology applications with objective indicators, including required communication performance (RCP) specifications applicable to evaluating communication technology and required surveillance performance (RSP) specifications applicable to evaluating surveillance technology. At present, the PBCS evaluation method is mainly applied in data link operations of contract automatic dependent surveillance (ADS-C), controller-pilot data link communication (CPDLC), and satellite voice (SATVOICE) and the like.

[0004] The PBCS concept mainly includes RCP240 and RSP180 specifications, which evaluate whether ground equipment, transmission networks, airborne equipment, controllers, and crews and the like meet the corresponding performance requirements by specifying the business processing time of each communication / surveillance subsystem. At the same time, ICAO specifies corresponding specifications and requirements for each contracting state, air navigation service provider, and air operator participating in PBCS operation through documents such as Air Traffic Management (Doc. 4444), Performance-Based Communication and Surveillance Manual (Doc. 9868), and Global Operation Data Link Manual (Doc. 10037). Contracting states implementing PBCS operation should establish long-term data link quality monitoring and evaluation procedures, and monitor and evaluate the quality of data link operation by carrying out the following work:

[0005] 1. Based on RCP and RSP specifications, carry out PBCS operation data link quality monitoring;

[0006] 2. Collect and verify PBCS operation approval information of aircraft implementing PBCS operation;

[0007] 3. Collect data link operation abnormal event reports (PR reports) from PBCS operation units;

[0008] 4. Supervise relevant units to improve problems.

[0009] At present, China has basically mastered the data link quality monitoring and evaluation method based on RCP240 and RSP180 specifications, and has initially mastered the data link operation quality monitoring capability of providing ADS-C and CPDLC application area, and can carry out data link quality monitoring and PR report collection in the area where ADS-C and CPDLC are operated. With the improvement of the PBCS operation quality monitoring and evaluation mechanism, the existing data link quality monitoring and evaluation method cannot meet the requirements of the long-term monitoring mechanism, which is specifically reflected in the following aspects:

[0010] 1. Lack of system evaluation method based on RCP240 and RSP180 specifications, which cannot efficiently analyze and evaluate the performance of the specified subsystem.

[0011] 2. Lack of multi-dimensional research and analysis of ADS-C and CPDLC data link operation quality based on base stations, operators and aircraft types.

[0012] 3. Lack of targeted research and analysis of the data link operation quality of each PBCS operation unit. SUMMARY

[0013] In order to overcome the defects of the prior art, the technical problem to be solved by the present application is to provide a data link quality monitoring and evaluation method based on PBCS operation, which can realize multi-dimensional analysis of data link operation quality, assist in improving the PBCS operation quality monitoring and evaluation mechanism, realize systematic analysis and research of CPDLC and ADS-C messages based on RCP and RSP specifications based on PBCS operation quality standards, carry out operation quality evaluation analysis based on PBCS standards for control units and aviation operators, and carry out multi-dimensional performance comparison analysis based on different base stations, different aviation operators and different time periods.

[0014] The technical scheme of the present application is as follows:

[0015] (1) Data link quality analysis based on PBCS specification: preprocessing the message data, and giving different dimensional analysis of CPDLC and ADS-C message data;

[0016] (2) PBCS operation unit performance analysis: based on time, data type, base station, operator and aircraft type, the CPDLC / ADS-C message of the specified PBCS operation unit is analyzed based on RCP / RSP specification, and the data link quality monitoring and evaluation is carried out and displayed in the form of chart.

[0017] (3) Performance unqualified subsystem problem analysis: extracting the performance unqualified message obtained in the performance analysis result, further researching and analyzing the performance unqualified subsystem;

[0018] (4) Stage performance comparative analysis: performing stage comparative analysis on the data link message performance, and displaying in the form of a chart, so as to find the performance change or trend of the specified subsystem of each operating unit of the PBCS in different time periods; on the basis of comparative analysis in different time periods, comparative analysis is also performed on different subsystems or operating units of the same dimension;

[0019] (5) Comprehensive analysis of data link quality monitoring result: through multiple filtering of data source type, time range, regulatory unit, air operator, base station, data type and flight number, the specified data link message set is analyzed based on the RCP / RSP specification, and the customized analysis of different operating units, different subsystems of the specified PBCS operating unit is realized according to the filtering result, and the analysis result is displayed in the form of a chart through three dimensions of overall performance, base station performance and air operator performance.

[0020] The data link quality analysis based on the PBCS specification, the PBCS operating unit performance analysis, the performance unqualified subsystem problem analysis, the stage performance comparative analysis and the comprehensive analysis of the data link quality monitoring result can realize multi-dimensional analysis of the data link operation quality, assist in perfecting the PBCS operation quality monitoring and evaluation mechanism, realize systematic analysis and research of the CPDLC and ADS-C message based on the RCP and RSP specification based on the PBCS operation quality standard, carry out operation quality evaluation analysis based on the PBCS standard for the regulatory unit and the air operator, and carry out performance comparative analysis based on different base stations, different air operators and different time periods.

[0021] Also provided is a data link quality monitoring and evaluation device based on PBCS operation, which comprises:

[0022] The data link quality analysis module based on the PBCS specification is configured to pre-process the message data, and give analysis of the CPDLC and ADS-C message data based on different dimensions;

[0023] The PBCS operating unit performance analysis module is configured to analyze the CPDLC / ADS-C message of the specified PBCS operating unit based on time, data type, base station, operator and model, carry out data link quality monitoring and evaluation based on the RCP / RSP specification, and display in the form of a chart;

[0024] a performance unqualified subsystem problem analysis module configured to extract performance unqualified messages obtained in the performance analysis result, and to further research and analyze the performance unqualified subsystems;

[0025] a stage performance comparison analysis module configured to perform stage comparison analysis on data link message performance, and to display in the form of a chart, so as to find out performance changes or trends of specified subsystems of the PBCS in different time periods in different running units; on the basis of comparison analysis in different time periods, comparison analysis is simultaneously performed on different subsystems or running units of the same dimension;

[0026] a data link quality monitoring result comprehensive analysis module configured to perform data link quality performance analysis based on RCP / RSP specifications on a specified data link message set through multiple filtering of data source types, time ranges, regulatory units, air operators, base stations, data types, and flight numbers, to realize customized analysis of different running units, different subsystems of a single aircraft, aircraft models, air operators, specified base stations, and specified PBCS running units according to the filtering result, and to display the analysis result through chart display in three dimensions of overall performance, base station performance, and air operator performance. BRIEF DESCRIPTION OF DRAWINGS

[0027] Figure 1 Assign values to each subsystem of the RCP240 specification.

[0028] Figure 2 Assign values to each subsystem of the RSP180 specification.

[0029] Figure 3 Preprocess CPDLC message data.

[0030] Figure 4 Preprocess ADS-C message data.

[0031] Figure 5 Generate FIT reports-RCP240 reports.

[0032] Figure 6 Generate FIT reports-RSP180 reports.

[0033] Figure 7 Generate FIT reports-communication medium performance analysis.

[0034] Figure 8 Generate FIT reports-air operator performance analysis.

[0035] Figure 9 Overall performance analysis of regulatory units.

[0036] Figure 10 Performance analysis of each base station of a regulatory unit.

[0037] Figure 11 Performance analysis for each operator of the regulatory unit.

[0038] Figure 12 Overall performance analysis for the air operator.

[0039] Figure 13 Performance analysis for each base station of the air operator.

[0040] Figure 14 Performance analysis for each aircraft model of the air operator.

[0041] Figure 15 Histogram statistics for transmission duration of non-compliant subsystems.

[0042] Figure 16 Scatter plot statistics for transmission duration of non-compliant subsystems.

[0043] Figure 17 Monthly comparative analysis for non-compliant subsystems.

[0044] Figure 18 Cross-latitude performance analysis for non-compliant subsystems.

[0045] Figure 19 Stage performance comparative analysis.

[0046] Figure 20 Comprehensive analysis of monitoring performance.

[0047] Figure 21 Flowchart of the method according to the present invention. DETAILED DESCRIPTION

[0048] In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the drawings and specific embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and do not limit the present application.

[0049] In order to make the description of the present disclosure more detailed and complete, the following describes the embodiments of the present application and specific examples; but this is not the only form of implementing or using the specific embodiments of the present application. The embodiments include the features of the specific embodiments and the method steps and their order for constructing and operating these specific embodiments. However, other specific embodiments can also be used to achieve the same or equivalent functions and step sequences.

[0050] (1) As Figure 21As shown, the data link quality monitoring and evaluation method based on PBCS operation includes PBCS specification-based data link quality analysis: preprocessing of message data, and giving different dimension-based analysis of CPDLC and ADS-C message data;

[0051] (2) PBCS operating unit performance analysis: based on time, data type, base station, operator, and aircraft type, the CPDLC / ADS-C message of the specified PBCS operating unit is analyzed based on RCP / RSP specification, and the data link quality monitoring and evaluation is displayed in the form of a chart;

[0052] (3) Performance unqualified subsystem problem analysis: the performance unqualified message obtained in the performance analysis result is extracted, and further research and analysis are carried out on the performance unqualified subsystem;

[0053] (4) Stage performance comparison analysis: the data link message performance is compared and analyzed in stages, and the performance change or trend of the specified subsystem of the PBCS operating unit in different time periods is found through chart display; on the basis of comparison and analysis in different time periods, different subsystems or operating units in the same dimension are compared and analyzed;

[0054] (5) Data link quality monitoring result comprehensive analysis: based on RCP / RSP specification, the data link quality performance of the specified data link message set is analyzed through data source type, time range, regulatory unit, air operator, base station, data type, and flight number multiple filtering, and the customized analysis of single aircraft, aircraft type, air operator, specified base station, different operating units of the specified PBCS operating unit, and different subsystems is realized according to the filtering result, and the analysis result is displayed in the form of a chart through three dimensions of overall performance, base station performance, and air operator performance.

[0055] The data link quality analysis based on PBCS specification, PBCS operating unit performance analysis, performance unqualified subsystem problem analysis, stage performance comparison analysis, and data link quality monitoring result comprehensive analysis can realize multi-dimensional analysis of data link operation quality, assist in improving the PBCS operation quality monitoring and evaluation mechanism, realize systematic analysis and research of CPDLC and ADS-C message based on RCP and RSP specification based on PBCS operation quality standard, carry out operation quality evaluation analysis based on PBCS standard for regulatory units and air operators, and carry out performance comparison analysis based on different base stations, different air operators, and different time periods.

[0056] Preferably, the step (1) comprises the following sub-steps:

[0057] (1.1) CPDLC message data preprocessing: the collected CPDLC message is filtered by three preprocessing procedures of interruption time period, repeated data and timeout data to obtain data meeting the quality requirements of data analysis; the interruption time period filtering is to remove the message in the interruption period according to the interruption time of the system or link reported by the operating unit; the repeated data filtering is to remove the redundant uplink or downlink message to ensure that each uplink message corresponds to a downlink message and avoid repeated calculation errors; the timeout data filtering is to remove the error data whose transmission time exceeds the logical maximum value by setting the upper limit of the total transmission time through the threshold value to ensure the accuracy of the analysis results;

[0058] (1.2) ADS-C message data preprocessing: the collected ADS-C message is filtered by interruption time period and timeout data to obtain the message meeting the quality requirements of data analysis;

[0059] The interruption time period filtering removes the ADS-C message data in the interruption period; the timeout data filtering removes the error data whose transmission time exceeds the logical maximum value by setting the upper limit of the total transmission time through the threshold value to ensure the accuracy of the analysis results.

[0060] Preferably, in the step (1), the analysis of the CPDLC and ADS-C message data based on different dimensions is given, including: PBCS operating area ADS-C communication quality overall performance monitoring analysis, PBCS operating area CPDLC communication quality overall performance monitoring analysis, ADS-C operation analysis of each PBCS operating area based on different communication media and communication base stations, CPDLC operation analysis of each PBCS operating area based on different communication media and communication base stations, ADS-C operation analysis of each PBCS operating area based on different aviation operators and aircraft types, and CPDLC operation analysis of each PBCS operating area based on different aviation operators and aircraft types.

[0061] Preferably, in the step (2), the CPDLC / ADS-C message of the specified PBCS operating unit is evaluated based on the time, data type, base station, operator and aircraft type dimensions based on the RCP / RSP specification, and the evaluation is displayed in the form of a chart, and the analysis content includes: CPDLC overall performance analysis, ADS-C overall performance analysis, CPDLC overall performance analysis of each base station, ADS-C overall performance analysis of each base station, CPDLC overall performance analysis of each aviation operator and aircraft type, and ADS-C overall performance analysis of each aviation operator and aircraft type.

[0062] Preferably, the step (3) includes:

[0063] Transmission duration distribution statistics: for the performance unqualified subsystems found based on the specified analysis criteria, the histogram statistics of the actual transmission duration of the subsystem under this standard are given, so as to show the centralized distribution of the actual transmission duration of the specified subsystem;

[0064] Transmission duration scatter plot analysis: the horizontal coordinate is time, and the vertical coordinate is the actual transmission duration of the specified analysis standard unqualified subsystem. The scatter plot of the actual transmission duration of all unqualified subsystems is drawn, and the change of the transmission performance of the unqualified subsystem with time is directly observed;

[0065] Monthly comparison analysis: for the performance unqualified subsystems found in the analysis, the monthly actual operation performance is compared and analyzed, so as to observe whether there is a change rule or performance deterioration trend problem with time;

[0066] Multi-dimensional performance analysis: for the base station performance unqualified conditions found in the analysis, the message data used for analysis is extracted, and the performance of the air operator and the aircraft type of the message is analyzed again. For the air operator or aircraft type performance unqualified conditions found in the analysis, the message data used for analysis is extracted, and the base station performance of the message is analyzed again. Through this cross-dimension analysis, the performance change in different dimensions is found, which assists in locating the cause of the performance unqualified problem.

[0067] A data link quality monitoring and evaluation device based on PBCS operation is also provided, which comprises:

[0068] A data link quality analysis module based on PBCS specification, which is configured to preprocess message data and give different dimension-based analysis of CPDLC and ADS-C message data;

[0069] A PBCS operation unit performance analysis module, which is configured to analyze the CPDLC / ADS-C message of a specified PBCS operation unit based on time, data type, base station, operator and aircraft type, carry out data link quality monitoring and evaluation based on RCP / RSP specification, and display the results in the form of charts;

[0070] A performance unqualified subsystem problem analysis module, which is configured to extract the performance unqualified message obtained in the performance analysis result, and further research and analyze the performance unqualified subsystem;

[0071] A stage performance comparison analysis module, which is configured to compare and analyze the data link message performance in stages, and display the results in the form of charts, so as to find the performance change or trend of the specified subsystem of each PBCS operation unit in different time periods. Based on the comparison analysis in different time periods, different subsystems or operation units in the same dimension are also compared and analyzed;

[0072] a data link quality monitoring result comprehensive analysis module configured to carry out data link quality performance analysis based on RCP / RSP specifications on a specified data link message set through multiple filtering of data source type, time range, regulatory unit, air operator, base station, data type, and flight number, and realize customized analysis of different operating units, different subsystems for a single aircraft, aircraft model, air operator, specified base station, specified PBCS operating unit according to the filtering results, and the analysis results are displayed in charts through three dimensions of overall performance, base station performance, and air operator performance.

[0073] Preferably, the PBCS specification-based data link quality analysis module performs:

[0074] CPDLC message data preprocessing: the collected CPDLC messages are filtered through three preprocessing procedures of interruption time period, repeated data, and timeout data to obtain data meeting the quality requirements of data analysis; the interruption time period filtering removes messages during the interruption period according to the system or link interruption time reported by the operating unit; the repeated data filtering removes redundant uplink or downlink messages to ensure that each uplink message corresponds to a downlink message and avoid repeated calculation errors; the timeout data filtering removes error data with transmission time longer than the logical maximum value by setting an upper limit for the total transmission time to ensure the accuracy of the analysis results;

[0075] ADS-C message data preprocessing: the collected ADS-C messages are filtered through interruption time period and timeout data to obtain messages meeting the quality requirements of data analysis; the interruption time period filtering removes ADS-C message data during the interruption period; the timeout data filtering removes error data with transmission time longer than the logical maximum value by setting an upper limit for the total transmission time to ensure the accuracy of the analysis results.

[0076] Preferably, in the PBCS specification-based data link quality analysis module, different dimension-based analysis of CPDLC and ADS-C message data is given, including: PBCS operating area ADS-C communication quality overall performance monitoring analysis, PBCS operating area CPDLC communication quality overall performance monitoring analysis, ADS-C operation analysis based on different communication media and communication base stations in each PBCS operating area, CPDLC operation analysis based on different communication media and communication base stations in each PBCS operating area, ADS-C operation analysis based on different air operators and aircraft models in each PBCS operating area, and CPDLC operation analysis based on different air operators and aircraft models in each PBCS operating area.

[0077] Preferably, in the PBCS running unit performance analysis module, the CPDLC / ADS-C message of the specified PBCS running unit is monitored and evaluated based on RCP / RSP specifications in terms of time, data type, base station, operator and aircraft type, and the analysis results are displayed in the form of charts. The analysis contents include CPDLC overall performance analysis, ADS-C overall performance analysis, CPDLC overall performance analysis of each base station, ADS-C overall performance analysis of each base station, CPDLC overall performance analysis of each aviation operator and aircraft type, and ADS-C overall performance analysis of each aviation operator and aircraft type.

[0078] Preferably, in the performance unqualified subsystem problem analysis module,

[0079] Transmission duration distribution statistics: For the performance unqualified subsystem found based on the specified analysis standard, the histogram statistics of the actual transmission duration of the subsystem under this standard are given, so as to show the centralized distribution of the actual transmission duration of the specified subsystem;

[0080] Transmission duration scatter plot analysis: The horizontal coordinate is time, and the vertical coordinate is the actual transmission duration of the unqualified subsystem under the specified analysis standard. The scatter plot of the actual transmission duration of all unqualified subsystems is drawn, so that the change of the transmission performance of the unqualified subsystem with time can be intuitively observed;

[0081] Monthly comparison analysis: The actual running performance of the performance unqualified subsystem found in the analysis is compared and analyzed, so as to observe whether there is a change rule or performance deterioration trend with time;

[0082] Multi-dimensional performance analysis: For the base station performance unqualified condition found in the analysis, the message data used for analysis is extracted, and the performance of the aviation operator and aircraft type of this part of message is analyzed again. For the aviation operator or aircraft type performance unqualified condition found in the analysis, the message data used for analysis is extracted, and the performance of the base station based on this part of message is analyzed again. Through this cross-dimension analysis, the performance change in different dimensions is found, which assists in locating the cause of the performance unqualified problem.

[0083] The content of the application will be described in more detail below.

[0084] 1. Data link quality analysis based on PBCS specification

[0085] (1) Message data preprocessing

[0086] 1) CPDLC message data preprocessing

[0087] For example, Figure 3As shown in the figure, the collected CPDLC messages need to go through three preprocessing processes: interruption period filtering, duplicate data filtering, and timeout data filtering, in order to obtain data that meets the requirements of data analysis quality. Interruption period filtering is to remove the messages during the interruption period according to the system or link interruption time reported by the operating unit; duplicate data filtering is to remove redundant upstream or downstream messages, ensuring that each upstream message corresponds to one downstream message to avoid duplicate calculation errors; timeout data filtering is to set an upper limit for the total transmission duration by artificially setting a threshold, and remove the error data with a transmission duration exceeding the logical maximum value to ensure the accuracy of the analysis results.

[0088] 2) ADS-C Message Data Preprocessing

[0089] As Figure 4 shown in the figure, the collected ADS-C messages need to go through interruption period filtering and timeout data filtering to obtain messages that meet the requirements of data analysis quality. Interruption period filtering is mainly used to remove the ADS-C message data during the interruption period; timeout data filtering is to set an upper limit for the total transmission duration by artificially setting a threshold, and remove the error data with a transmission duration exceeding the logical maximum value to ensure the accuracy of the analysis results. Since ADS-C data only has downstream data, duplicate data filtering is not required. [[ID=[]]

[0090] (2) Submission of ICAO Report Generation

[0091] This patent analyzes the PBCS operation performance required in the ICAO report according to the RCP240 / RSP180 specifications and ICAO requirements, as Figures 5-8 shown in the figure. The analysis period is in whole years. In the chart, the message data for the first and second half of the year are analyzed separately to compare the data volume and related performance changes in the first and second half of the year.

[0092] Figure 5 It is the overall operation performance analysis of CPDLC for each control unit based on the RCP240 specification. Above the table are the various standards involved in the RCP240 standard, including the actual communication performance (ACP) and the actual communication technology performance (ACTP) and their compliance indicators of 99.9% and 95%; on the left side of the table are the names of each control unit. In the analysis, the table marks the analysis result percentages with different colors. Under the 99.9% performance indicator requirement, the part of the analysis result not lower than 99.9% is qualified in performance; the part of the analysis result between 99.9% and 99.84% indicates that the performance is poor and further attention needs to be paid to the relevant operation systems; the part of the analysis result lower than 99.84% is unqualified in performance. [[ID=[]]

[0093] The colors in the charts of this patent are marked according to this rule. Through this analysis, the overall compliance of the CPDLC communication of each regulatory unit in China under the RCP240 specification can be intuitively seen.

[0094] Figure 6 The ADS-C overall operation performance analysis of each regulatory unit based on the RSP180 specification. The compliance indicators of the required monitoring performance in the RSP180 specification are marked on the top of the table; the names of each regulatory unit are marked on the left side of the table. Through this analysis, the overall compliance of the ADS-C communication of each regulatory unit in a year can be intuitively seen.

[0095] Figure 7 The CPDLC operation performance analysis of each communication medium and base station based on the RCP240 specification. The first column on the left side of the table is each communication medium involved in the CPDLC communication, including very high frequency (VHF), satellite (SAT), high frequency (HF), and other communication media. The second column on the left side is the identification of the base station using each communication medium. The analysis results in the chart show the data link operation performance of each communication medium and base station. Through this analysis, the base stations with non-compliant performance can be found, so that the PBCS operating unit can optimize its operation performance in a timely manner.

[0096] Figure 8 The CPDLC operation performance analysis of each airline operator and aircraft model based on the RCP240 specification. The first column on the left side of the table is each airline operator involved in the CPDLC communication, and the second column is each aircraft model under the jurisdiction of the operator. The analysis results give the data link operation performance of each operator and its aircraft model. Through analysis, the performance of the aircraft model that does not meet the requirements can be found in a timely manner, so that the operator can check and rectify it in a timely manner.

[0097] In addition to the above analysis, this patent also analyzes the performance of each base station based on the RSP180 specification, as well as the performance of the airline operator and the aircraft model. The chart form is similar to Figure 7 、 8 Through analysis, the performance of unqualified base stations, operators, and aircraft models in ADS-C applications can be found in a timely manner, so that the relevant operating units can check and optimize.

[0098] 2. Performance analysis of domestic operating units

[0099] (1) Performance analysis of regulatory units

[0100] To gain a more comprehensive understanding of the data link operational performance of PBCS (Public Data Link Control System) operators in my country, including regulatory authorities and air operators, and to provide timely and efficient analytical data to these operators, this patent studies and analyzes the CPDLC (Concurrent Data Link Control) and ADC-C (Advanced Data Link Control) operations of regulatory authorities and air operators. The following example demonstrates CPDLC performance analysis based on the RCP240 standard. Figures 9-14 As shown.

[0101] Figure 9 This patent provides an overall performance analysis of the CPDLC for regulatory authorities based on the RCP240 standard. In this section, in addition to the ACP and ACTP analyses required in the ICAO report, this patent also analyzes the crew operational performance (PORT), ground station transmission performance (ATSU), network transmission performance, and aircraft system transmission performance according to the standard requirements, thereby enabling more accurate identification of subsystems experiencing transmission timeout issues.

[0102] Figure 10 The performance of communication media and base stations contained in CPDLC messages within the designated control area was analyzed. Similar to the overall performance analysis of the control unit, this section focuses on communication base stations and media, providing a detailed analysis of the performance of each subsystem in message transmission within the designated control area. This allows for the timely identification of performance issues in base stations and transmission subsystems.

[0103] (2) Performance analysis of air operators

[0104] Figure 11 Performance analysis was conducted on various subsystems of CPDLC message transmission in designated control areas, using air operators and aircraft types as analytical dimensions. This analysis revealed relevant issues encountered by air operators or aircraft types during operation within designated control units, and identified which transmission subsystems failed to meet performance requirements.

[0105] Figure 12 This patent provides an overall performance analysis of CPDLC based on the RCP240 specification for aviation operators. It offers a comprehensive performance analysis of the transmission performance of the crew and onboard systems, which is of concern to aviation operators, enabling them to promptly identify relevant equipment and operational issues.

[0106] Figure 13 Performance analysis was conducted on CPDLC messages of designated air operators, focusing on transmission media and base stations. This analysis revealed the transmission performance and related issues associated with each communication medium and base station in CPDLC communication for designated air operators.

[0107] Figure 14The CPDLC transmission performance of the designated airline operator and its aircraft models is analyzed. Through the analysis, the performance of each transmission subsystem of each aircraft model of the airline operator in CPDLC communication and related problems can be found.

[0108] 3. Detailed performance analysis of unqualified subsystems

[0109] As shown in Figures 15-18 , for the unqualified problems found in the data link quality evaluation analysis, the patent analyzes the transmission performance of the designated unqualified subsystem as follows to find the distribution and characteristics of unqualified performance:

[0110] Figure 15 Histogram statistics of unqualified subsystem transmission time. The horizontal coordinate in the figure is the time length of the transmission, and the starting point is the maximum transmission time required by the specified performance indicator. For example, under the 95% standard of ACP performance, the total CPDLC transmission time should not exceed 180 seconds, so 180 seconds is taken as the starting point. In histogram analysis, the qualified transmission time is taken as the starting point, and each 30 seconds is taken as a statistical interval to count the number of messages of actual transmission time. From the histogram analysis, the distribution of unqualified performance transmission time can be directly observed. For unqualified performance, if most of the unqualified performance is distributed in a shorter time interval, its performance will be relatively poor compared to the performance distributed in a longer time interval, so as to understand the performance deterioration. Figure 16 Scatter plot statistics of unqualified subsystem transmission time. The horizontal coordinate in the figure is the time, and the vertical coordinate is the actual transmission time of the unqualified subsystem. Through this analysis, the law of unqualified performance changing with time or the trend of performance deterioration with time can be found.

[0111] Figure 17 Monthly comparative analysis of unqualified subsystem performance. The vertical axis in the figure is the month, and the horizontal axis uses different colors to represent the number of qualified and unqualified transmission messages, and gives a percentage statistical analysis to observe the performance in different months.

[0112] In the analysis, when the performance of a base station based on a certain performance specification is found to be unqualified, the patent performs comparative analysis on the model performance of the transmission messages of the unqualified base station, as shown in Figure 18 . The horizontal coordinate in the figure is the model, the vertical coordinate is the number of qualified and unqualified transmission time messages, and different colors are used to represent them, and the percentage statistics are also given. Through cross-dimension performance analysis, the correlation between different dimensions of performance is tried to be found, and the PBCS operating unit is assisted to locate the transmission performance problem from multiple angles.

[0113] 4. Stage performance comparison

[0114] As shown in Figure 19As shown, the performance of ACP in Lanzhou and Urumqi in January to April 2017 based on RCP240 standard is given. The horizontal coordinate in the figure is the actual transmission time, and the number of qualified and unqualified messages and the percentage performance of qualified messages are marked with different colors. Through comparative analysis in multiple dimensions, the performance evaluation of different time, different PBCS running unit, or different running subsystem under the specified analysis standard can be compared at the same time.

[0115] 5、Data link quality monitoring result comprehensive analysis

[0116] The present application is based on the PBCS operation standard, and the performance of multiple running subsystems of specified aircraft, specified PBCS running unit, specified base station or communication medium is analyzed and displayed. Figure 20 The performance of each subsystem of each operator and aircraft type of CPDLC communication in the specified time period in Lanzhou data area is given.

[0117] The above is only a preferred embodiment of the present application, and does not limit the present application in any form. Any simple modification, equivalent change and modification of the above embodiment according to the technical essence of the present application still belongs to the protection scope of the technical scheme of the present application.

Claims

1. A data link quality monitoring and evaluation method based on PBCS operation, characterized in that: It includes the following steps: (1) Data link quality analysis based on PBCS specification: Preprocess the message data and provide analysis of CPDLC and ADS-C message data based on different dimensions, including time, data type, base station, operator, and model; (2) Performance analysis of PBCS operating units: For CPDLC / ADS-C messages of a specified PBCS operating unit, data link quality monitoring and evaluation based on RCP / RSP specifications are carried out based on multiple dimensions such as time, data type, base station, operator, and model, and the results are presented in the form of charts; (3) Analysis of subsystems with unqualified performance: Extract the unqualified performance messages obtained from the performance analysis results and conduct further research and analysis on the subsystems with unqualified performance; (4) Stage performance comparison analysis: The performance of data link messages is compared and analyzed in stages and displayed in the form of charts to discover the performance changes or trends of the specified subsystems of each PBCS operating unit in different time periods; on the basis of the comparison analysis in different time periods, the same dimension of different subsystems or operating units is also compared and analyzed. (5) Comprehensive analysis of data link quality monitoring results: Through multiple filtering by data source type, time range, regulatory unit, air operator, base station, data type, and flight number, data link quality performance analysis based on RCP / RSP specifications is carried out on a specified data link message set. Based on the filtering results, customized analysis is achieved for different operating units and different subsystems of a single aircraft, aircraft type, air operator, designated base station, and designated PBCS operating unit. The analysis results are displayed in charts and graphs in three dimensions: overall performance, performance of each base station, and performance of the air operator.

2. The data link quality monitoring and evaluation method based on PBCS operation according to claim 1, characterized in that: Step (1) includes the following sub-steps: (1.1) CPDLC message data preprocessing: The collected CPDLC messages undergo three preprocessing processes: interruption period filtering, duplicate data filtering, and timeout data filtering, in order to obtain data that meets the data analysis quality requirements; Interruption period filtering removes packets within the interruption period based on the system or link interruption time reported by the operating unit. Duplicate data filtering removes redundant uplink or downlink messages, ensuring that each uplink message corresponds to one downlink message and avoiding duplicate calculation errors. Timeout data filtering removes erroneous data whose transmission time exceeds the logical maximum value by manually setting a threshold to set an upper limit for the total transmission time, thus ensuring the accuracy of the analysis results. (1.2) ADS-C message data preprocessing: The collected ADS-C messages are filtered by interruption period and timeout data to obtain messages that meet the data analysis quality requirements; interruption period filtering removes ADS-C message data during the interruption period; Timeout data filtering removes erroneous data whose transmission time exceeds the logical maximum value by manually setting a threshold, thus ensuring the accuracy of the analysis results.

3. The data link quality monitoring and evaluation method based on PBCS operation according to claim 2, characterized in that: In step (1), the analysis of CPDLC and ADS-C message data based on different dimensions is given, including: overall performance monitoring and analysis of ADS-C communication quality in PBCS operating area, overall performance monitoring and analysis of CPDLC communication quality in PBCS operating area, ADS-C operation analysis of each PBCS operating area based on different communication media and communication base stations, CPDLC operation analysis of each PBCS operating area based on different communication media and communication base stations, ADS-C operation analysis of each PBCS operating area based on different airline operators and aircraft types, and CPDLC operation analysis of each PBCS operating area based on different airline operators and aircraft types.

4. The data link quality monitoring and evaluation method based on PBCS operation according to claim 3, characterized in that: In step (2), the specified PBCS operating unit is... CPDLC / ADS-C messages are evaluated based on multiple dimensions, including time, data type, base station, operator, and aircraft type, using the RCP / RSP specification. The results are presented in charts and graphs. The analysis includes: overall CPDLC performance analysis, overall ADS-C performance analysis, overall CPDLC performance analysis for each base station, overall ADS-C performance analysis for each base station, overall CPDLC performance analysis for each airline operator and aircraft type, and overall ADS-C performance analysis for each airline operator and aircraft type.

5. The data link quality monitoring and evaluation method based on PBCS operation according to claim 4, characterized in that: Step (3) includes: Transmission duration distribution statistics: For subsystems with substandard performance identified based on specified analysis standards, a histogram of the actual transmission duration of the subsystem under this standard is provided, thereby showing the concentrated distribution of the actual transmission duration of the specified subsystem; Transmission Duration Scatter Plot Analysis: The horizontal axis represents time, and the vertical axis represents the actual transmission duration of the non-compliant subsystems according to the specified analysis standard. A scatter plot of the actual transmission duration of all non-compliant subsystems is drawn to visually show how the transmission performance of the non-compliant subsystems changes over time. Monthly Comparative Analysis: For the sub-compliant subsystems found in the analysis, their actual monthly operating performance is compared and analyzed to observe whether there are any patterns of change over time or performance degradation trends. Multi-dimensional performance analysis: For base station performance deficiencies discovered during the analysis, the message data used for analysis is extracted, and the performance of the airline operator and aircraft type in that part of the message is re-analyzed; for airline operator or aircraft type performance deficiencies discovered during the analysis, the message data used for analysis is extracted, and that part of the message is re-analyzed based on base station performance; through this cross-dimensional analysis, performance changes under different dimensions are discovered, assisting in identifying the causes of performance deficiencies.

6. A data link quality monitoring and evaluation device based on PBCS, which executes the data link quality monitoring and evaluation method based on PBCS according to claim 1, characterized in that: It includes: The data link quality analysis module based on the PBCS specification is configured to preprocess message data and provide analysis of CPDLC and ADS-C message data based on different dimensions. The PBCS operating unit performance analysis module is configured to conduct data link quality monitoring and evaluation based on the RCP / RSP specification for CPDLC / ADS-C messages of a specified PBCS operating unit, based on multiple dimensions such as time, data type, base station, operator, and model, and display the results in the form of charts. The subsystem performance failure analysis module is configured to extract performance failure messages from the performance analysis results and conduct further research and analysis on the subsystem performance failure. The phased performance comparison and analysis module is configured to perform phased comparative analysis of data link message performance and display it in the form of charts, thereby discovering the performance changes or trends of specified subsystems of each PBCS operating unit in different time periods; based on the comparative analysis of different time periods, it also performs comparative analysis of different subsystems or operating units in the same dimension. The data link quality monitoring result comprehensive analysis module is configured to perform data link quality performance analysis based on RCP / RSP specifications on a specified data link message set through multiple filtering by data source type, time range, regulatory authority, air operator, base station, data type, and flight number. Based on the filtering results, it can perform customized analysis on different operating units and different subsystems for individual aircraft, aircraft type, air operator, designated base station, and designated PBCS operating unit. The analysis results are displayed in charts and graphs across three dimensions: overall performance, performance of each base station, and performance of the air operator.

7. The data link quality monitoring and evaluation device based on PBCS operation according to claim 6, Its features are: The data link quality analysis module based on the PBCS specification performs the following: CPDLC message data preprocessing: The collected CPDLC messages undergo three preprocessing processes: interruption period filtering, duplicate data filtering, and timeout data filtering, in order to obtain data that meets the data analysis quality requirements; Interruption period filtering removes packets within the interruption period based on the system or link interruption time reported by the operating unit. Duplicate data filtering removes redundant uplink or downlink messages, ensuring that each uplink message corresponds to one downlink message and avoiding duplicate calculation errors. Timeout data filtering removes erroneous data whose transmission time exceeds the logical maximum value by manually setting a threshold to set an upper limit for the total transmission time, thus ensuring the accuracy of the analysis results. ADS-C message data preprocessing: The collected ADS-C messages are filtered by interruption period and timeout data to obtain messages that meet the data analysis quality requirements; interruption period filtering removes ADS-C message data within the interruption period; Timeout data filtering removes erroneous data whose transmission time exceeds the logical maximum value by manually setting a threshold, thus ensuring the accuracy of the analysis results.

8. The data link quality monitoring and evaluation device based on PBCS operation according to claim 7, characterized in that: The data link quality analysis module based on the PBCS specification provides analyses of CPDLC and ADS-C message data from different dimensions, including: overall performance monitoring and analysis of ADS-C communication quality in the PBCS operating area; overall performance monitoring and analysis of CPDLC communication quality in the PBCS operating area; ADS-C operation analysis in each PBCS operating area based on different communication media and base stations; CPDLC operation analysis in each PBCS operating area based on different communication media and base stations; ADS-C operation analysis in each PBCS operating area based on different airline operators and aircraft types; and CPDLC operation analysis in each PBCS operating area based on different airline operators and aircraft types.

9. The data link quality monitoring and evaluation device based on PBCS operation according to claim 8, characterized in that: The PBCS operating unit performance analysis module performs data link quality monitoring and evaluation based on the RCP / RSP specification for CPDLC / ADS-C messages of a specified PBCS operating unit, based on multiple dimensions such as time, data type, base station, operator, and aircraft type. The results are displayed in the form of charts. The analysis content includes: overall CPDLC performance analysis, overall ADS-C performance analysis, overall CPDLC performance analysis of each base station, overall ADS-C performance analysis of each base station, overall CPDLC performance analysis of each airline operator and aircraft type, and overall ADS-C performance analysis of each airline operator and aircraft type.

10. The data link quality monitoring and evaluation device based on PBCS operation according to claim 9, characterized in that: In the subsystem performance failure analysis module Transmission duration distribution statistics: For subsystems with substandard performance identified based on specified analysis standards, a histogram of the actual transmission duration of the subsystem under this standard is provided, thereby showing the concentrated distribution of the actual transmission duration of the specified subsystem; Transmission Duration Scatter Plot Analysis: The horizontal axis represents time, and the vertical axis represents the actual transmission duration of the non-compliant subsystems according to the specified analysis standard. A scatter plot of the actual transmission duration of all non-compliant subsystems is drawn to visually show how the transmission performance of the non-compliant subsystems changes over time. Monthly Comparative Analysis: For the sub-compliant subsystems found in the analysis, their actual monthly operating performance is compared and analyzed to observe whether there are any patterns of change over time or performance degradation trends. Multi-dimensional performance analysis: For base station performance deficiencies discovered during the analysis, the message data used for analysis is extracted, and the performance of the airline operator and aircraft type in that part of the message is re-analyzed; for airline operator or aircraft type performance deficiencies discovered during the analysis, the message data used for analysis is extracted, and that part of the message is re-analyzed based on base station performance; through this cross-dimensional analysis, performance changes under different dimensions are discovered, assisting in identifying the causes of performance deficiencies.

Images