A method and apparatus for data alignment

Abstract

The application discloses a data alignment method and device, and relates to the technical field of computers. A specific implementation of the method comprises the following steps: obtaining target cabin sound data and target flight data corresponding to a target flight terminal; performing parameter analysis on the target flight data to obtain multiple air-ground conversation time points; sorting the multiple air-ground conversation time points according to time to obtain a first time sequence corresponding to the multiple air-ground conversation time points; cutting the target cabin sound data to obtain a second time sequence corresponding to multiple cabin sound time points; and determining an alignment time point of the target cabin sound data and the target flight data according to the overlap degree of the first time sequence and the second time sequence. The implementation can accurately determine the alignment time point between the target cabin sound data and the target flight data, thereby realizing effective alignment between the target cabin sound data and the target flight data, and greatly improving the accuracy of subsequent data analysis in accident analysis and flight quality evaluation.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer, and in particular, to a data alignment method and device. BACKGROUND

[0002] In the field of aviation, flight data and cabin sound data are important basis for accident analysis and flight quality evaluation. However, due to different data sources, inconsistent time stamp formats and data missing of flight data and cabin sound data, there may be a problem of data misalignment between flight data and cabin sound data of the same flight segment, thereby affecting the accuracy and reliability of subsequent data analysis. Therefore, there is an urgent need for a method and device capable of realizing data alignment between flight data and cabin sound data. SUMMARY

[0003] Therefore, the embodiments of the present application provide a data alignment method and device, which can accurately determine the alignment time between target cabin sound data and target flight data by processing the target flight data and the target cabin sound data respectively and based on the overlap between the first time sequence corresponding to the target flight data and the second time sequence corresponding to the target cabin sound data, thereby realizing effective alignment between the target cabin sound data and the target flight data and greatly improving the accuracy of subsequent data analysis in accident analysis and flight quality evaluation.

[0004] To achieve the above object, according to an aspect of the embodiments of the present application, a data alignment method is provided.

[0005] The data alignment method of the embodiments of the present application comprises: obtaining target flight data and target cabin sound data corresponding to a target flight terminal; performing parameter analysis on the target flight data to obtain a plurality of air-ground conversation time points; sorting the plurality of air-ground conversation time points according to time to obtain a first time sequence corresponding to the plurality of air-ground conversation time points; cutting the target cabin sound data to obtain a second time sequence corresponding to a plurality of cabin sound time points; and determining an alignment time of the target cabin sound data and the target flight data according to the overlap of the first time sequence and the second time sequence.

[0006] Optionally, the obtaining of the target flight data and the target cabin sound data corresponding to the target flight terminal comprises: obtaining target cabin sound data corresponding to the target flight terminal; determining a plurality of flight segments corresponding to the target flight terminal according to the target cabin sound data; obtaining flight data corresponding to each flight segment respectively, and determining the target flight data from the plurality of flight data.

[0007] Optionally, the parameter analysis on the target flight data to obtain a plurality of air-ground dialogue time points comprises: performing very high frequency parameter analysis on the target flight data to generate a very high frequency parameter result corresponding to each flight time point; and in response to the very high frequency parameter result indicating that the very high frequency parameter result is in an enabled state, taking the flight time point corresponding to the very high frequency parameter result as the air-ground dialogue time point.

[0008] Optionally, the sorting of the plurality of air-ground dialogue time points according to time to obtain a first time sequence corresponding to the plurality of air-ground dialogue time points comprises: sorting the plurality of air-ground dialogue time points according to time to generate an intermediate time sequence; and performing binary conversion on the intermediate time sequence to obtain the first time sequence.

[0009] Optionally, the cutting of the target cabin sound data to obtain a second time sequence corresponding to a plurality of cabin sound time points comprises: cutting the target cabin sound data according to a preset time period to obtain a plurality of cabin sound time points; and generating the second time sequence according to whether a voice signal exists in the cabin sound time points; wherein if the cabin sound time point has a voice signal, 1 is recorded; and if the cabin sound time point has no voice signal, 0 is recorded.

[0010] Optionally, the determining of an alignment time point of the target cabin sound data and the target flight data according to an overlap degree of the first time sequence and the second time sequence comprises: for each target cabin sound time point in the second time sequence: performing a sliding dot product operation on the target cabin sound time point and all time points in the second time sequence to determine a target overlap degree of the target cabin sound time point and the second time sequence; and determining the alignment time point of the target cabin sound data and the target flight data according to the size of the target overlap degree corresponding to each target cabin sound time point.

[0011] Optionally, the determining of the alignment time point of the target cabin sound data and the target flight data according to the size of the target overlap degree corresponding to each target cabin sound time point comprises: obtaining machine sound data of the target flight terminal; taking a target cabin sound time point with the largest target overlap degree among the target overlap degrees corresponding to each target cabin sound time point as a preliminary alignment time point, and determining whether a target machine sound matching the preliminary alignment time point exists in the machine sound data; and if so, taking the preliminary alignment time point as the alignment time point.

[0012] Optionally, the method further comprises: if not, taking a target cabin sound time point with the second largest target overlap degree among the target overlap degrees corresponding to each target cabin sound time point as a preliminary alignment time point, and repeatedly performing the step of determining whether a target machine sound matching the preliminary alignment time point exists in the machine sound data until the alignment time point is determined.

[0013] Optionally, the method further comprises: length aligning the target cabin sound data and the target flight data; and / or, determining that the target cabin sound data and the target flight data include necessary fields; and / or, performing missing value processing on the target cabin sound data and the target flight data; and / or, performing format conversion on the target cabin sound data and the target flight data.

[0014] To achieve the above object, according to another aspect of the embodiment of the present application, a data alignment device is provided.

[0015] The data alignment device of the embodiment of the present application comprises:

[0016] An acquisition module is configured to acquire target cabin sound data and target flight data corresponding to a target flight terminal;

[0017] An analysis module is configured to perform parameter analysis on the target flight data to obtain a plurality of air-ground conversation time points;

[0018] A first sorting module is configured to sort the plurality of air-ground conversation time points according to time to obtain a first time sequence corresponding to the plurality of air-ground conversation time points;

[0019] A second sorting module is configured to cut the target cabin sound data to obtain a second time sequence corresponding to a plurality of cabin sound time points;

[0020] A determination module is configured to determine an alignment time point of the target cabin sound data and the target flight data according to an overlap degree of the first time sequence and the second time sequence.

[0021] To achieve the above object, according to another aspect of the embodiment of the present application, an electronic device for data alignment is provided.

[0022] The electronic device for data alignment of the embodiment of the present application comprises one or more processors; a storage device configured to store one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors implement a data alignment method of the embodiment of the present application.

[0023] To achieve the above object, according to another aspect of the embodiment of the present application, a computer readable storage medium is provided.

[0024] The computer readable storage medium of the embodiment of the present application has a computer program stored thereon, when the program is executed by a processor, a data alignment method of the embodiment of the present application is implemented.

[0025] To achieve the above object, according to another aspect of the embodiments of the present application, a computer program product is provided.

[0026] The computer program product of the embodiments of the present application, when executed by a processor, implements the data alignment method of the embodiments of the present application.

[0027] The embodiment of the above application has the following advantages or beneficial effects: by processing the target flight data and the target cabin sound data respectively, and based on the overlapping degree between the first time sequence corresponding to the target flight data and the second time sequence corresponding to the target cabin sound data, the alignment time between the target cabin sound data and the target flight data can be accurately determined, thereby realizing effective alignment between the target cabin sound data and the target flight data, and greatly improving the accuracy of subsequent data analysis in accident analysis and flight quality evaluation.

[0028] The further effects of the above non-conventional optional mode will be described in the following combined with the specific embodiments. BRIEF DESCRIPTION OF DRAWINGS

[0029] The accompanying drawings serve to better understand the present application and do not constitute an improper limitation on the present application. Among them:

[0030] Figure 1 is the main flowchart of the data alignment method according to the embodiments of the present application;

[0031] Figure 2 is the main flowchart of obtaining target cabin sound data and target flight data according to the embodiments of the present application;

[0032] Figure 3 is the main flowchart of obtaining multiple air-ground conversation time points according to the embodiments of the present application;

[0033] Figure 4 is the main flowchart of obtaining the first time sequence according to the embodiments of the present application;

[0034] Figure 5 is the main flowchart of obtaining the second time sequence according to the embodiments of the present application;

[0035] Figure 6 is the main flowchart of determining the alignment time of the target cabin sound data and the target flight data according to the embodiments of the present application;

[0036] Figure 7 is the main module diagram of the data alignment device according to the embodiments of the present application;

[0037] Figure 8 is an exemplary system architecture diagram to which the embodiments of the present application can be applied;

[0038] Figure 9 is a structural schematic diagram of a computer system of a terminal device or a server suitable for implementing embodiments of the present application. DETAILED DESCRIPTION

[0039] Exemplary embodiments of the present application are described below with reference to the accompanying drawings, which include various details of the embodiments of the present application to assist in understanding, which should be considered in their context only. Therefore, those of ordinary skill in the art should realize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present application. Also, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0040] It should be noted that the embodiments of the present application and the technical features in the embodiments can be combined with each other without conflict.

[0041] It should be noted that in the technical solutions of the present disclosure, the collection, collection, updating, analysis, processing, use, transmission, storage, etc. of user personal information are in line with relevant laws and regulations, are used for legal purposes, and do not violate public order and good customs. Necessary measures are taken to prevent illegal access to user personal information data, and to maintain user personal information security, network security and national security.

[0042] Figure 1 is a schematic diagram of the main steps of the data alignment method according to the embodiments of the present application.

[0043] As shown in Figure 1 , the data alignment method of the embodiments of the present application mainly includes the following steps:

[0044] Step S101: obtaining target cabin audio data and target flight data corresponding to a target flight terminal;

[0045] Step S102: performing parameter analysis on the target flight data to obtain a plurality of air-ground conversation time points;

[0046] Step S103: sorting the plurality of air-ground conversation time points according to time to obtain a first time sequence corresponding to the plurality of air-ground conversation time points;

[0047] Step S104: cutting the target cabin audio data to obtain a second time sequence corresponding to a plurality of cabin audio time points;

[0048] Step S105: determining the alignment time point of the target cabin audio data and the target flight data according to the overlap degree of the first time sequence and the second time sequence.

[0049] The data alignment method provided by the application can be applied in the field of civil aviation in particular, and the cabin sound data and the flight data are usually for a civil aviation aircraft, so the target flight terminal in the embodiment of the application can be understood as a single civil aviation aircraft. It can be seen from the above process that the embodiment of the application actually obtains the first time sequence corresponding to the target flight data and the second time sequence corresponding to the target cabin sound data by respectively processing the target cabin sound data and the target flight data, and then obtains the alignment time of the target flight data and the target cabin sound data by matching the overlap degree of the first time sequence and the second time sequence. It can be understood that for different flight terminals, the cabin sound data and the flight data are also different, so the target cabin sound data and the target flight data in the embodiment of the application correspond to the target flight terminal. By obtaining the target cabin sound data and the target flight data corresponding to the target flight terminal, the effective alignment of the target cabin sound data and the target flight data can be realized through a series of subsequent analysis processes.

[0050] Specifically, the cabin sound data refers to the sound data in the flight terminal recorded by the cabin sound recorder. Usually, the cabin sound data starts to be recorded after the flight terminal starts, and the recording continues until the flight terminal is turned off, that is, the data recorded between the start and the stop of the flight terminal can include machine sound data (that is, machine voice broadcast sound corresponding to different states of the flight terminal) and air-ground conversation data (that is, conversation sound between the ground control center and the captain). For example, when the flight speed of the flight terminal reaches V1, the machine will broadcast the sound of "V one", at this time, the cabin sound recorder will record the sound of "V one". When the flight terminal is in the landing stage, the machine will broadcast the sound of "one hundred" when the radio height is 100 feet, at this time, the cabin sound recorder will record the sound of "one hundred". When the flight terminal is in the landing stage, the machine broadcasts the sound of "fifty" when the radio height is 50 feet, at this time, the cabin sound recorder will record the sound of "fifty".

[0051] The flight data refers to the data between the take-off and the landing of the flight terminal, that is, the recording length of the flight data and the cabin sound data is usually inconsistent, which is also the analysis difficulty encountered in the prior art when analyzing the flight data and the cabin sound data. For example, the flight data can include various parameters of the flight terminal, such as flight height, airspeed, acceleration, pitch attitude, thrust lever position, reverse thrust state, etc. Only after the cabin sound data and the flight data are effectively aligned, the operation of the captain can be accurately judged whether there is a mistake in the subsequent accident analysis, and the cause of the accident is determined.

[0052] Hereinafter, the embodiment of the present application respectively details the process of obtaining the target cabin sound data and the target flight data in step S101, and the specific alignment process of steps S102 to S105.

[0053] For the process of obtaining the target cabin sound data and the target flight data in step S101, in an optional embodiment, it is required to determine the multiple flight segments corresponding to the target flight terminal, i.e., as shown in Figure 2 , including:

[0054] Step S201: Obtain the target cabin sound data corresponding to the target flight terminal.

[0055] Step S202: Determine the multiple flight segments corresponding to the target flight terminal according to the target cabin sound data.

[0056] Step S203: Obtain the flight data corresponding to each flight segment respectively, and determine the target flight data from the multiple flight data.

[0057] Exemplarily, for a civil aviation passenger plane, a civil aviation passenger plane usually flies multiple flight segments continuously in a started state: for example, it flies from airport A to airport B first, then continues to fly to airport C, and finally returns to airport A, so the flight segments corresponding to the civil aviation passenger plane actually include three segments: flight segment A-B, flight segment B-C and flight segment C-A, but the civil aviation passenger plane is always in a started state, so the multiple flight segments actually correspond to one cabin sound data. In the embodiment of the present application, the multiple flight segments corresponding to the target flight terminal can be determined according to the data time length of the target cabin sound data first, then the flight data corresponding to each flight segment is obtained respectively, and finally the flight data to be compared is taken as the target flight data.

[0058] In an optional embodiment, for the specific process of obtaining multiple air-ground conversation time points in step S102 of the embodiment of the present application, as shown in Figure 3 , including:

[0059] Step S301: Obtain the target flight data corresponding to the target flight terminal.

[0060] Step S302: Perform very high frequency parameter analysis on the target flight data to generate the very high frequency parameter result corresponding to each flight time point respectively.

[0061] Step S303: In response to the very high frequency parameter result indicating that the very high frequency parameter is in an enabled state, take the flight time point corresponding to the very high frequency parameter result as the air-ground conversation time point.

[0062] Target flight data is often stored in the flight terminal's Quick Access Recorder (QAR) data recorder, primarily used for flight quality monitoring, safety assessments, maintenance, and accident investigations. The QAR Very High Frequency (VHF) parameter records whether VHF communication is enabled. Specific values ​​include "emit" and "not emit." When enabled, the parameter value is "emit," while when disabled, the value is "not emit."

[0063] In actual application, the air-ground dialogue moment is a time dimension, which requires a lot of calculation and storage space in the data processing process. Therefore, in the embodiment of the present invention, the air-ground dialogue moment is converted. By converting it into a binary first time series, the amount of data calculation in the subsequent data alignment process can be effectively improved. Specifically, the process of obtaining the first time series in step S103 is as follows: Figure 4 Shown, including:

[0064] Step S401: Acquire target flight data corresponding to the target flight terminal;

[0065] Step S402: Performing VHF parameter analysis on the target flight data to generate VHF parameter results corresponding to each flight moment;

[0066] Step S403: In response to the VHF parameter being in the enabled state, the flight time corresponding to the VHF parameter result is used as the air-ground dialogue time;

[0067] Step S404: sorting the multiple air-ground conversation moments by time to generate an intermediate time sequence;

[0068] Step S405: performing binary conversion on the intermediate time series to obtain a first time series.

[0069] For example, consider the intermediate time series T = {t1, t2, ⋯, ti}, obtained by arranging multiple air-ground dialogue moments. Ti represents the i-th air-ground dialogue moment, and each air-ground dialogue moment is 1 / 8 second (i.e., with a time accuracy of 125 milliseconds). By performing binary conversion on this intermediate time series T, we obtain the first time series S = {s1, s2, ⋯, sn}, where n = the total duration of the flight data (in seconds) × 8. If the corresponding t exists in sn, then sn = 1; otherwise, sn = 0.

[0070] Through the above process, the first time series is determined from the target flight data. The process of obtaining the second time series is described in detail below. In an optional embodiment, the process of obtaining the second time series in step S104 is as follows: Figure 5 Shown, including:

[0071] Step S501: Acquire target flight data corresponding to the target flight terminal;

[0072] Step S502: Slice the target cabin voice data according to a preset time period to obtain multiple cabin voice moments;

[0073] Step S503: generating a second time series according to whether a voice signal exists at the cabin sound time;

[0074] Among them, if there is a voice signal at the cabin sound moment, it is recorded as 1; if there is no voice signal at the cabin sound moment, it is recorded as 0.

[0075] The preset time period can be the same as the air-ground dialogue time unit in the target flight data, also set to 1 / 8 second (125 milliseconds). For example, the second time series can be represented by C, C = {c1, c2, ⋯, cn}, where cn = 1 if a voice signal is present in cn, and 0 otherwise. This shows that this embodiment of the present invention represents both the first time series corresponding to the target flight data and the second time series corresponding to the target cabin voice data in binary form, converting both the voice signal and the time signal into quantifiable numerical sequences, thereby achieving data alignment.

[0076] Specifically, for step S105, an optional embodiment includes: for each target cabin sound moment in the second time series: performing a sliding dot product operation on the target cabin sound moment and all the moments in the first time series to determine the target overlap degree between the target cabin sound moment and the first time series; and determining the alignment moment of the target cabin sound data and the target flight data based on the size of the target overlap degree corresponding to each of the target cabin sound moments.

[0077] For example, the second time series C is reversed (from cn to c1) and the first time series S (from s1 to sn) are respectively subjected to sliding dot product operations. The sliding dot product operation formula is as follows (1):

[0078] Formula (1)

[0079] Where j represents the sliding window, N represents the maximum number of moments in the first time series and the second time series, which is obtained by length alignment of sn and cn. ,when When it is not in the range of 1 to sn, , when k is not in the range of 1 to cn, ; each sliding window corresponds to a dot product value, the greater the dot product value, the higher the time overlap degree of the cabin sound time in the target cabin sound data and the air-ground conversation time in the target flight data, the higher the matching alignment probability. Therefore, in an optional embodiment, the sliding window with the maximum dot product value can be used as the alignment time of the target cabin sound data and the target flight data.

[0080] However, in the actual flight process of the flight terminal, the machine sound data can also provide an important basis for accident analysis and flight quality evaluation, so in a further optional embodiment, whether the machine sound data exists can also be further referred to as a determination standard for the alignment time. As shown in Figure 6 determining the alignment time of the target cabin sound data and the target flight data comprises:

[0081] Step S601: for each target cabin sound time in the second time sequence: performing a sliding dot product operation on the target cabin sound time and all times in the second time sequence to determine a target overlap degree of the target cabin sound time and the second time sequence;

[0082] Step S602: obtaining machine sound data of the target flight terminal;

[0083] Step S603: taking the maximum target cabin sound time in the target overlap degree corresponding to each target cabin sound time as a preliminary alignment time, and determining whether there is a target machine sound in the machine sound data that matches the preliminary alignment time;

[0084] If yes, perform step S604: taking the preliminary alignment time as the alignment time;

[0085] If no, perform step S605: taking the second largest target cabin sound time in the target overlap degree corresponding to each target cabin sound time as a preliminary alignment time, and repeating the step of determining whether there is a target machine sound in the machine sound data that matches the preliminary alignment time until the alignment time is determined.

[0086] In the process of determining whether there is a target machine sound in the machine sound data that matches the preliminary alignment time in step S603, a preset time offset can be set, and it is determined whether there is a target machine sound that matches the preliminary alignment time in the preset time offset. Through the above steps S601 to S605, the preliminary alignment time can be further determined whether it can be used as the alignment time in combination with the machine sound data, effectively improving the accuracy of the determined alignment time.

[0087] In an alternative embodiment, the method for data alignment provided by the present application further comprises length alignment of the target cabin audio data and the target flight data after step S101 and before step S102. Specifically, when the total time length of the target cabin audio data and the target flight data is inconsistent, the data with shorter total time length can be extended to the same length as the data with longer total time length by zero padding at the end of the data, i.e. the consistency of the total time length of the target cabin audio data and the target flight data is achieved by filling invalid values without changing the original time sequence of the data, so as to ensure that each time point in the target cabin audio data and the target flight data can be one-to-one corresponding.

[0088] In an alternative embodiment, the method for data alignment provided by the present application further comprises determining the mandatory fields included in the target cabin audio data and the target flight data. Exemplarily, the mandatory fields in the target flight data can be qar data (such as qar start time, qar end time, etc.), very high frequency parameter, radio altitude, landing altitude 100, landing altitude 50, etc. The mandatory fields in the target cabin audio data can be audio start time and audio end time, etc.

[0089] In a further alternative embodiment, after obtaining the target cabin audio data and the target flight data, the continuity and rationality of the target cabin audio data and the target flight data need to be checked to ensure that each time point corresponds to unique data, and the target cabin audio data and the target flight data are processed for missing values when there are missing values. Exemplarily, the missing value processing can include missing value filling and abnormal value repair. For missing values, they can be reasonably filled according to the context data, and for missing values that cannot be filled, they can be marked as special values for subsequent manual filling. For abnormal values, statistical methods can be used for identification, and the identified abnormal values can be corrected or removed according to the context.

[0090] In a further alternative embodiment, the target cabin audio data and the target flight data can also be format converted. Specifically, the time stamps in the target cabin audio data and the target flight data can be all unified as UTC time, Beijing time or QAR time, and the minimum unit of time is 1 / 8 second, so as to ensure that the time stamps in the target cabin audio data and the target flight data are in the same time zone and use unified time format and time unit.

[0091] According to the method for data alignment, the alignment time between the target cabin sound data and the target flight data can be accurately determined by processing the target flight data and the target cabin sound data respectively and based on the overlapping degree between the first time sequence corresponding to the target flight data and the second time sequence corresponding to the target cabin sound data, so that effective alignment between the target cabin sound data and the target flight data is realized, and the accuracy of data analysis in subsequent accident analysis and flight quality evaluation is greatly improved.

[0092] Figure 7 FIG. 1 is a schematic diagram of main modules of a device for data alignment according to an embodiment of the present application.

[0093] As shown in Figure 7 FIG. 1, the device 700 for data alignment according to an embodiment of the present application comprises:

[0094] An acquisition module 701 is configured to acquire target cabin sound data and target flight data corresponding to a target flight terminal.

[0095] An analysis module 702 is configured to perform parameter analysis on the target flight data to obtain multiple air-ground conversation time points.

[0096] A first sorting module 703 is configured to sort the multiple air-ground conversation time points according to time to obtain a first time sequence corresponding to the multiple air-ground conversation time points.

[0097] A second sorting module 704 is configured to cut the target cabin sound data to obtain a second time sequence corresponding to multiple cabin sound time points.

[0098] A determination module 705 is configured to determine an alignment time of the target cabin sound data and the target flight data according to an overlapping degree of the first time sequence and the second time sequence.

[0099] In an optional embodiment of the present application, the acquisition module 701 is further configured to acquire target cabin sound data corresponding to a target flight terminal; determine multiple flight segments corresponding to the target flight terminal according to the target cabin sound data; acquire flight data corresponding to each flight segment respectively, and determine the target flight data from the multiple flight data.

[0100] In an optional embodiment of the present application, the analysis module 702 is further configured to perform very high frequency parameter analysis on the target flight data to generate a very high frequency parameter result corresponding to each flight time point respectively; and in response to the very high frequency parameter result being in an enabled state, use the flight time point corresponding to the very high frequency parameter result as the air-ground conversation time point.

[0101] In an optional embodiment of the present application, the first sorting module 703 is further configured to sort the plurality of air-ground dialogue time points according to time to generate an intermediate time sequence; and perform binary conversion on the intermediate time sequence to obtain the first time sequence.

[0102] In an optional embodiment of the present application, the second sorting module 704 is further configured to cut the target cabin sound data according to a preset time period to obtain a plurality of cabin sound time points; and generate the second time sequence according to whether a voice signal exists in the cabin sound time points; wherein if the cabin sound time point has a voice signal, 1 is recorded; and if the cabin sound time point has no voice signal, 0 is recorded.

[0103] In an optional embodiment of the present application, the determining module 705 is further configured to, for each target cabin sound time point in the second time sequence: perform a sliding dot product operation on the target cabin sound time point and all time points in the first time sequence to determine a target overlap degree of the target cabin sound time point and the first time sequence; and determine an alignment time point of the target cabin sound data and the target flight data according to the size of the target overlap degree corresponding to each target cabin sound time point.

[0104] In an optional embodiment of the present application, the determining module 705 is further configured to obtain machine sound data of the target flight terminal; determine a target cabin sound time point with the largest target overlap degree as a preliminary alignment time point corresponding to each target cabin sound time point, and determine whether a target machine sound matching the preliminary alignment time point exists in the machine sound data; and if so, take the preliminary alignment time point as the alignment time point.

[0105] In an optional embodiment of the present application, the determining module 705 is further configured to, if not, determine a target cabin sound time point with the second largest target overlap degree as a preliminary alignment time point corresponding to each target cabin sound time point, and repeatedly perform the step of determining whether a target machine sound matching the preliminary alignment time point exists in the machine sound data until the alignment time point is determined.

[0106] In an optional embodiment of the present application, the data alignment apparatus further comprises: a checking module configured to perform length alignment on the target cabin sound data and the target flight data; and / or, determine that the target cabin sound data and the target flight data include necessary fields; and / or, perform missing value processing on the target cabin sound data and the target flight data; and / or, perform format conversion on the target cabin sound data and the target flight data.

[0107] According to the data alignment device provided in the embodiment of the present application, the alignment time between the target cabin sound data and the target flight data can be accurately determined by processing the target flight data and the target cabin sound data respectively and based on the overlapping degree between the first time sequence corresponding to the target flight data and the second time sequence corresponding to the target cabin sound data, so that effective alignment between the target cabin sound data and the target flight data is realized, and the accuracy of data analysis in subsequent accident analysis and flight quality evaluation is greatly improved.

[0108] Figure 8 An exemplary system architecture 800 to which the method of data alignment or the device of data alignment according to the embodiments of the present application can be applied is shown.

[0109] As shown in Figure 8 , the system architecture 800 can include flight terminals 801, 802, 803, a network 804 and a server 805. The network 804 is a medium to provide communication links between the flight terminals 801, 802, 803 and the server 805. The network 804 can include various connection types, such as wired, wireless communication links or fiber optic cables, etc.

[0110] The user can use the flight terminals 801, 802, 803 to interact with the server 805 through the network 804 to receive or send data, etc. Various sensors can be installed on the flight terminals 801, 802, 803 to obtain various flight data of the flight terminals in real time.

[0111] The server 805 can be a server providing various services, such as a background management server providing support for the target cabin sound data and the target flight data sent by the user using the flight terminals 801, 802, 803. The background management server can analyze and process the received target cabin sound data and target flight data, etc., and perform accident analysis based on the processing results (such as the alignment time), etc.

[0112] It should be noted that the method of data alignment provided in the embodiments of the present application is generally executed by the server 805, and correspondingly, the device of data alignment is generally arranged in the server 805.

[0113] It should be understood that Figure 8 the number of terminal devices, networks and servers in

[0114] Reference is made to Figure 9 , which shows a structural schematic diagram of a computer system 900 of a terminal device suitable for implementing the embodiments of the present application. Figure 9 The terminal device shown is only an example and should not impose any limitation on the functions and use range of the embodiments of the present application.

[0115] like Figure 9 As shown, computer system 900 includes a central processing unit (CPU) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage unit 908 into a random access memory (RAM) 903. Various programs and data required for the operation of system 900 are also stored in RAM 903. CPU 901, ROM 902, and RAM 903 are connected to each other via a bus 904. A first input / output (I / O) interface 905 is also connected to bus 904.

[0116] The following components are connected to the first I / O interface 905: an input section 906 including a keyboard, a mouse, and the like; an output section 907 including devices such as a cathode ray tube (CRT), a liquid crystal display (LCD), and speakers; a storage section 908 including devices such as a hard disk; and a communication section 909 including a network interface card such as a LAN card or a modem. The communication section 909 performs communication processing via a network such as the Internet. A drive 910 is also connected to the first I / O interface 905 as needed. Removable media 911, such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, is installed in the drive 910 as needed, so that computer programs read from the media can be installed in the storage section 908 as needed.

[0117] In particular, according to embodiments disclosed herein, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed herein include a computer program product comprising a computer program embodied on a computer-readable medium, the computer program containing program code for executing the methods illustrated in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 909 and / or installed from removable media 911. When executed by central processing unit (CPU) 901, the computer program performs the aforementioned functions defined in the system of the present invention.

[0118] It should be noted that the computer-readable medium shown in the present application can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or component, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, the computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, device or component. In the present application, the computer-readable signal medium can include a data signal carried in a baseband or as a part of a carrier wave, which carries computer-readable program code. Such a propagated data signal can take various forms, including but not limited to an electromagnetic signal, an optical signal or any suitable combination of the above. The computer-readable signal medium can also be any computer-readable medium other than the computer-readable storage medium, which can send, propagate or transmit a program for use by or in conjunction with an instruction execution system, device or component. The program code contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0119] The flowcharts and block diagrams in the drawings illustrate the possible implementation architectures, functions and operations of the systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowcharts or block diagrams can represent a module, a program segment or a part of code containing one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions noted in the blocks can occur in different order than that shown in the drawings. For example, two blocks that are shown in succession can actually be executed substantially in parallel, and sometimes in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams or flowcharts, and the combination of blocks in the block diagrams or flowcharts, can be implemented by a dedicated hardware-based system that performs the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0120] The modules described in the embodiments of the present application can be implemented in the form of software or in the form of hardware. The described modules can also be arranged in a processor, for example, a processor can be described as including an acquisition module, an analysis module, a first sorting module, a second sorting module and a determination module. In some cases, the names of these modules do not constitute a limitation on the modules themselves, for example, the acquisition module can also be described as "a module that acquires target cabin sound data and target flight data corresponding to a target flight terminal".

[0121] As another aspect, the present application also provides a computer readable medium, which can be included in the device described in the above embodiments, or can exist independently without being assembled into the device. The computer readable medium carries one or more programs, when the one or more programs are executed by the device, the device includes: acquiring target cabin sound data and target flight data corresponding to a target flight terminal; performing parameter analysis on the target flight data to obtain a plurality of air-ground conversation time points; sorting the plurality of air-ground conversation time points according to time to obtain a first time sequence corresponding to the plurality of air-ground conversation time points; cutting the target cabin sound data to obtain a second time sequence corresponding to a plurality of cabin sound time points; and determining an alignment time point of the target cabin sound data and the target flight data according to an overlap degree between the first time sequence and the second time sequence.

[0122] According to the technical solution of the embodiments of the present application, by processing the target flight data and the target cabin sound data respectively, and based on the overlap degree between the first time sequence corresponding to the target flight data and the second time sequence corresponding to the target cabin sound data, the alignment time point between the target cabin sound data and the target flight data can be accurately determined, thereby realizing effective alignment between the target cabin sound data and the target flight data, and greatly improving the accuracy of subsequent data analysis in accident analysis and flight quality evaluation.

[0123] The above specific embodiments do not constitute a limitation on the protection scope of the present application. Those skilled in the art should understand that various modifications, combinations, sub-combinations and substitutions can be made depending on design requirements and other factors. Any modification, equivalent replacement and improvement made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. A method for data alignment, characterized in that: include: Obtain target cabin sound data and target flight data corresponding to the target flight terminal; Performing parameter analysis on the target flight data to obtain multiple air-ground dialogue moments; sorting the plurality of air-ground conversation moments according to time to obtain a first time sequence corresponding to the plurality of air-ground conversation moments; Slicing the target cabin voice data to obtain a second time series corresponding to a plurality of cabin voice moments; Based on the degree of overlap between the first time series and the second time series, the alignment moment of the target cabin sound data and the target flight data is determined, including: for each target cabin sound moment in the second time series: performing a sliding dot product operation on the target cabin sound moment and all the moments in the first time series to determine the target overlap degree of the target cabin sound moment with the first time series; and determining the alignment moment of the target cabin sound data and the target flight data based on the size of the target overlap degree corresponding to each target cabin sound moment.

2. The method according to claim 1, characterized in that The acquiring of target cabin voice data and target flight data corresponding to the target flight terminal includes: Obtain target cabin sound data corresponding to the target flight terminal; determining a plurality of flight segments corresponding to the target flight terminal according to the target cabin voice data; The flight data corresponding to each of the flight segments is obtained respectively, and the target flight data is determined from the plurality of flight data.

3. The method according to claim 1, characterized in that The parameter analysis of the target flight data is performed to obtain multiple air-ground dialogue moments, including: Performing a very high frequency parameter analysis on the target flight data to generate a very high frequency parameter result corresponding to each flight moment; In response to the very high frequency parameter result indicating that the very high frequency parameter is in an enabled state, the flight time corresponding to the very high frequency parameter result is used as the air-ground dialogue time.

4. The method according to claim 1, wherein The step of sorting the plurality of air-ground dialogue moments according to time to obtain a first time sequence corresponding to the plurality of air-ground dialogue moments includes: Sorting the plurality of air-ground dialogue moments according to time to generate an intermediate time sequence; Perform binary conversion on the intermediate time series to obtain the first time series.

5. The method according to claim 4, characterized in that The step of cutting the target cabin voice data to obtain a second time series corresponding to a plurality of cabin voice moments includes: cutting the target cabin voice data according to a preset time period to obtain a plurality of cabin voice moments; generating a second time series according to whether a voice signal exists at the cabin sound moment; Among them, if there is a voice signal at the cabin sound moment, it is recorded as 1; if there is no voice signal at the cabin sound moment, it is recorded as 0.

6. The method according to claim 1, characterized in that The step of determining the alignment time of the target cockpit sound data and the target flight data according to the target overlap degrees corresponding to the target cockpit sound moments includes: Acquiring machine sound data of the target flight terminal; using the target cabin sound moment with the largest target overlap corresponding to each target cabin sound moment as a preliminary alignment moment, and determining whether there is a target machine sound matching the preliminary alignment moment in the machine sound data; If yes, the preparatory alignment moment is used as the alignment moment.

7. The method according to claim 6, characterized in that Also includes: If not, take the target cabin sound moment with the second largest target overlap corresponding to each of the target cabin sound moments as the preliminary alignment moment, and repeat the step of determining whether there is a target machine sound matching the preliminary alignment moment in the machine sound data until the alignment moment is determined.

8. The method according to claim 1, characterized in that Also includes: performing length alignment on the target cockpit voice data and the target flight data; and / or, Determining that the target cockpit voice data and the target flight data include required fields; and / or, performing missing value processing on the target cabin sound data and the target flight data; and / or, Format conversion is performed on the target cockpit voice data and the target flight data.

9. A data alignment device, characterized in that: include: An acquisition module acquires target cabin sound data and target flight data corresponding to the target flight terminal; an analysis module, configured to perform parameter analysis on the target flight data to obtain a plurality of air-ground dialogue moments; A first sorting module is configured to sort the plurality of air-ground conversation moments according to time to obtain a first time sequence corresponding to the plurality of air-ground conversation moments; A second sorting module is configured to segment the target cabin voice data to obtain a second time series corresponding to a plurality of cabin voice moments; A determination module is used to determine the alignment moment of the target cabin sound data and the target flight data based on the overlap between the first time series and the second time series, including: for each target cabin sound moment in the second time series: performing a sliding dot product operation on the target cabin sound moment and all the moments in the first time series to determine the target overlap between the target cabin sound moment and the first time series; and determining the alignment moment of the target cabin sound data and the target flight data based on the size of the target overlap corresponding to each target cabin sound moment.

10. An electronic device for data alignment, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 8.

11. A computer-readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 8 is implemented.

12. A computer program product comprising a computer program, wherein when the computer program is executed by a processor, the computer program implements the method according to any one of claims 1 to 8.

Images