Data message processing method and device, storage medium and electronic equipment

Abstract

The invention discloses a data message processing method and device, a storage medium and electronic equipment, and relates to the technical field of data processing. The method comprises the steps that under the condition that it is detected that a data message which is sent abnormally exists in the data message sending process, the data message which is sent abnormally is stored in a first data table, and the first data table is used for recording field information and metadata information of the data message which is sent abnormally; acquiring the data message with abnormal transmission from the first data table based on a preset time interval, and judging whether the data message with abnormal transmission is retransmitted or not to obtain a judgment result; and if the judgment result is that the data message which is sent abnormally is re-sent, sending the data message which is sent abnormally to a target theme corresponding to a target airline company system corresponding to the data message which is sent abnormally in the message middleware. According to the method and the device, the technical problem of relatively low efficiency due to the fact that abnormal data messages in the data transmission process are reissued manually in the prior art is solved.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a method, device, storage medium and electronic device for processing data messages. Background Art

[0002] High-frequency messages refer to high-frequency message interaction messages generated by business systems due to changes in business events, such as high-frequency flight data messages, high-frequency passenger data messages, etc. Airlines have to receive a wide range of high-frequency message data products, which have an important impact on flight operations, ticket sales, passenger services, etc. However, during the data transmission process, due to network failures, data packet loss, system anomalies, etc., some messages may not be correctly received or processed, which will cause many problems for the internal information integration of airlines, and even cause inconvenience to passengers, reducing the service quality and customer satisfaction of airlines.

[0003] At present, in the existing technology, during the data transmission process, the detection, storage and resending of abnormal data messages usually rely on manual operations, which are inefficient and prone to errors, and may cause repeated sending of messages, affecting business performance and passenger experience.

[0004] To address the above-mentioned problems, no effective solution has been proposed yet. Summary of the invention

[0005] The embodiments of the present invention provide a method, device, storage medium and electronic device for processing data packets, so as to at least solve the technical problem that the prior art relies on manual retransmission of abnormal data packets in the data transmission process, which has low efficiency.

[0006] According to one aspect of an embodiment of the present invention, a method for processing data packets is provided, comprising: in a case where it is detected that there is a data packet with abnormal sending during the data packet sending process, storing the data packet with abnormal sending in a first data table, wherein the first data table is used to record field information and metadata information of the data packet with abnormal sending; obtaining the data packet with abnormal sending from the first data table based on a preset time interval, and determining whether to resend the data packet with abnormal sending to obtain a determination result; if the determination result is to resend the data packet with abnormal sending, sending the data packet with abnormal sending to a target topic corresponding to the target airline system corresponding to the data packet with abnormal sending in the message middleware.

[0007] Furthermore, it is determined whether to resend the data message with the sending exception to obtain a judgment result, including: obtaining the number of sending times corresponding to the data message with the sending exception from the first data table, and comparing the number of sending times with a preset threshold; if the number of sending times is less than or equal to the preset threshold, resending the data message with the sending exception is used as the judgment result; if the number of sending times is greater than the preset threshold, not sending the data message with the sending exception is used as the judgment result.

[0008] Furthermore, before detecting the presence of an abnormally sent data message during the data message sending process, the method also includes: calling the server of the message middleware to send the data message to be sent to the message middleware; detecting the calling duration of the server of the message middleware, and when it is detected that the calling duration is greater than a preset duration, determining that the data message to be sent is an abnormally sent data message; when it is detected that the calling duration is less than or equal to the preset duration, detecting the feedback information of the server, and when it is detected that the feedback information is abnormal, determining that the data message to be sent is an abnormally sent data message.

[0009] Furthermore, the message middleware is used to obtain the data message with sending exceptions from the target topic corresponding to the target airline system, send the data message with sending exceptions to the target airline system, and store the characteristic information of the data message with sending exceptions and the offset corresponding to the characteristic information in the second data table.

[0010] Furthermore, the method also includes: receiving a data message acquisition request sent by the target airline system through the message middleware, wherein the data message acquisition request includes at least target characteristic information of the data message to be acquired; acquiring an offset corresponding to characteristic information identical to the target characteristic information from the second data table, and determining the data message to be acquired based on the offset; and sending the data message to be acquired to the target airline system.

[0011] Furthermore, after determining whether to resend the data message with the sending exception and obtaining the determination result, the method further includes: if the determination result is not to send the data message with the sending exception, deleting the data message with the sending exception in the first data table.

[0012] Furthermore, after sending the abnormal data message to the target topic corresponding to the target airline system corresponding to the abnormal data message in the message middleware, the method also includes: adding one to the number of times the abnormal data message is sent in the first data table.

[0013] According to another aspect of an embodiment of the present invention, a data message processing device is also provided, including: a first processing module, for storing the data message with abnormal sending in a first data table when detecting that there is a data message with abnormal sending during the data message sending process, wherein the first data table is used to record field information and metadata information of the data message with abnormal sending; a second processing module, for obtaining the data message with abnormal sending from the first data table based on a preset time interval, and determining whether to resend the data message with abnormal sending to obtain a determination result; and a third processing module, for sending the data message with abnormal sending to a target topic corresponding to the target airline system corresponding to the data message with abnormal sending in the message middleware if the determination result is to resend the data message with abnormal sending.

[0014] According to another aspect of an embodiment of the present invention, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the computer program implements the above-mentioned data message processing method.

[0015] According to another aspect of an embodiment of the present invention, a computer-readable storage medium is provided, in which a computer program is stored, wherein the computer program is configured to execute the above-mentioned method for processing data packets when running.

[0016] According to another aspect of an embodiment of the present invention, there is further provided an electronic device, which includes one or more processors; a memory for storing one or more programs, which enables the one or more processors to run the programs when the one or more programs are executed by the one or more processors, wherein the programs are configured to execute the above-mentioned method for processing data messages when running.

[0017] In an embodiment of the present invention, when it is detected that there is a data message with abnormal sending during the data message sending process, the data message with abnormal sending is stored in a first data table, wherein the first data table is used to record field information and metadata information of the data message with abnormal sending; the data message with abnormal sending is obtained from the first data table based on a preset time interval, and it is determined whether to resend the data message with abnormal sending to obtain a determination result; if the determination result is to resend the data message with abnormal sending, the data message with abnormal sending is sent to a target topic corresponding to the target airline system corresponding to the data message with abnormal sending in the message middleware.

[0018] In the above process, based on the preset time interval, the data message with sending exception is obtained from the first data table, and it is determined whether to resend the data message with sending exception, so that the number supplement demand when the transmission exception occurs can be automatically and timely completed, thereby realizing the automatic number supplement of civil aviation high-frequency message transmission, reducing the data loss rate caused by system failure or network interruption, reducing the complexity and workload of manual number supplement, avoiding the problems caused by repeated message sending, ensuring the smooth integration of internal information of the airline, improving the efficiency and quality of flight operation, ticket sales and passenger service, enhancing the integrity and reliability of the airline's data transmission, thereby effectively improving passenger satisfaction and the service quality of the airline.

[0019] It can be seen that through the technical solution of the present invention, the purpose of timely and automatically completing the need for complement when a transmission anomaly occurs is achieved, thereby achieving the technical effect of improving the efficiency of reissuing abnormal data messages, and further solving the technical problem of low efficiency in the prior art of relying on manual reissuance of abnormal data messages in the data transmission process. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0021] Figure 1 is a flow chart of an optional data message processing method according to an embodiment of the present invention;

[0022] Figure 2 It is a schematic diagram of an optional process of automatically reissuing a data message by a push system according to an embodiment of the present invention;

[0023] Figure 3 It is a schematic diagram of a process of automatically reissuing a data message by a message middleware according to an optional embodiment of the present invention;

[0024] Figure 4 is a schematic diagram of an optional data message processing device according to an embodiment of the present invention;

[0025] Figure 5 is a schematic diagram of an optional electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0026] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0027] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0028] It should be noted that the relevant information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for display, data for analysis, etc.) involved in the present invention are all information and data authorized by the user or fully authorized by all parties. For example, an interface is set between the system and the relevant user or organization. Before obtaining relevant information, it is necessary to send an acquisition request to the aforementioned user or organization through the interface, and obtain relevant information after receiving the consent information fed back by the aforementioned user or organization.

[0029] Example 1

[0030] According to an embodiment of the present invention, an embodiment of a method for processing a data message is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0031] Figure 1 is a flowchart of an optional method for processing data packets according to an embodiment of the present invention, such as Figure 1 As shown, the method comprises the following steps:

[0032] Step S101, when it is detected that there is a data message with abnormal sending in the data message sending process, the data message with abnormal sending is stored in a first data table, wherein the first data table is used to record field information and metadata information of the data message with abnormal sending.

[0033] Step S102: acquiring the data message with abnormal transmission from the first data table based on a preset time interval, and determining whether to resend the data message with abnormal transmission to obtain a determination result.

[0034] Step S103, if the judgment result is to resend the data message with the sending exception, the data message with the sending exception is sent to the target topic corresponding to the target airline system corresponding to the data message with the sending exception in the message middleware.

[0035] In the above steps, the application system, processor, electronic device and other devices can be used as the execution subject. Optionally, the data message processing system can be used as the execution subject, which includes the push system, message middleware and airline system. For example, the data synchronization service of the push system will synchronize each high-frequency data message received to the message middleware through the dedicated network streaming, and then the message middleware will send it to the corresponding airline system. In this process, the main reasons for data transmission failure include synchronization service abnormality, dedicated network abnormality, middleware server abnormality, etc.

[0036] In an optional embodiment, before detecting the presence of an abnormally sent data message during the data message sending process, the server of the message middleware is called to send the data message to be sent to the message middleware; the calling duration of the message middleware server is detected, and when it is detected that the calling duration is greater than a preset duration, it is determined that the data message to be sent is a data message with an abnormal sending; when it is detected that the calling duration is less than or equal to the preset duration, the feedback information of the server is detected, and when it is detected that the feedback information is abnormal, it is determined that the data message to be sent is a data message with an abnormal sending.

[0037] Optionally, the data message may be a high-frequency data message generated by a business system due to a change in business events. The push system first calls the server of the message middleware to send the data message to be sent to the message middleware. The push system will perform high-frequency data message push anomaly detection, including detecting the call duration of the message middleware server. For example, it is detected whether there is a call timeout in the message middleware server during the push process (that is, the call duration is greater than the preset duration). If there is a call timeout, it is considered that the push has failed, that is, it is determined that the data message to be sent is a data message with an abnormal sending, and it is written into the push abnormality data table (that is, the first data table) for storage. That is, when the push system detects that there is a data message with an abnormal sending during the data message sending process, the data message with the abnormal sending will be stored in the first data table.

[0038] Optionally, anomaly detection also includes detecting feedback information from the server, for example, detecting whether the server has normal information feedback after the message is sent to the server of the message middleware. For example, under normal circumstances, the server will feedback the partition number, offset number, etc. of the message pushed to the message middleware. If an abnormal feedback information is detected (for example, there is no feedback information or the offset number is -1), it is considered that the push has failed, and the push exception data table also needs to be written.

[0039] Optionally, a document-oriented distributed database (Elasticsearch, es) is used to store complete exception messages, and combined with the business meaning of the message itself, an exception information index is constructed. For example, an index named exception_reports is created, and its fields include: message ID (message_id), flight number (flight_number), flight date (flight_date), message source (message_source), message type (message_type), message time (message_time) and compressed original message (compressed_message).

[0040] Optionally, a timed task component is used to establish an independent routing link to process abnormal messages, and data remediation actions are cyclically performed within a specified period, that is, data messages with abnormal transmission are obtained from the first data table based on a preset time interval, and it is determined whether to resend the data messages with abnormal transmission.

[0041] Optionally, a corresponding message topic is constructed for each airline in the message middleware to ensure that the high-frequency message data of each airline are isolated from each other. For example, the message topic corresponding to airline A is Topic 1, and the message topic corresponding to airline B is Topic 2. Therefore, after determining that the abnormal data message needs to be resent, the abnormal data message can be sent to the target topic corresponding to the target airline system corresponding to the abnormal data message in the message middleware.

[0042] In an optional embodiment, after determining whether to resend the data message with the sending exception and obtaining the determination result, if the determination result is not to send the data message with the sending exception, the data message with the sending exception is deleted from the first data table.

[0043] In an optional embodiment, after sending the abnormal data message to the target topic corresponding to the target airline system corresponding to the abnormal data message in the message middleware, the number of times the abnormal data message is sent is increased by one in the first data table.

[0044] Optionally, the push number (i.e., the number of sends) is recorded in the push exception data table to determine whether the message needs to be pushed again. For example, if the push number is already greater than the set repeated push number (i.e., the preset threshold), the data needs to be deleted, that is, the data message with the sending exception is deleted in the first data table; if the push number is less than or equal to the preset threshold, the message is pushed again and 1 is added to the push number.

[0045] Based on the scheme defined by the above steps S101 to S103, it can be known that in an embodiment of the present invention, when it is detected that there is a data message with abnormal sending during the data message sending process, the data message with abnormal sending is stored in a first data table, wherein the first data table is used to record the field information and metadata information of the data message with abnormal sending; the data message with abnormal sending is obtained from the first data table based on a preset time interval, and it is determined whether to resend the data message with abnormal sending to obtain a determination result; if the determination result is to resend the data message with abnormal sending, the data message with abnormal sending is sent to the target topic corresponding to the target airline system corresponding to the data message with abnormal sending in the message middleware.

[0046] It is easy to notice that in the above process, based on the preset time interval, the data message with sending exception is obtained from the first data table, and it is determined whether to resend the data message with sending exception, so that the number supplement requirement when the transmission exception occurs can be automatically and timely completed, thereby realizing the automatic number supplement of civil aviation high-frequency message transmission, reducing the data loss rate caused by system failure or network interruption, reducing the complexity and workload of manual number supplement, avoiding the problems caused by repeated message sending, ensuring the smooth integration of internal information of the airline, improving the efficiency and quality of flight operations, ticket sales and passenger services, and enhancing the integrity and reliability of the airline's data transmission, thereby effectively improving passenger satisfaction and the service quality of the airline.

[0047] It can be seen that through the technical solution of the present invention, the purpose of timely and automatically completing the need for complement when a transmission anomaly occurs is achieved, thereby achieving the technical effect of improving the efficiency of reissuing abnormal data messages, and further solving the technical problem of low efficiency in the prior art of relying on manual reissuance of abnormal data messages in the data transmission process.

[0048] In an optional embodiment, determining whether to resend a data message with abnormal sending to obtain a determination result includes: obtaining the number of transmission times corresponding to the data message with abnormal sending from a first data table, and comparing the number of transmission times with a preset threshold; if the number of transmission times is less than or equal to the preset threshold, resending the data message with abnormal sending is used as the determination result; if the number of transmission times is greater than the preset threshold, not sending the data message with abnormal sending is used as the determination result.

[0049] Optionally, in the process of determining whether to resend the data message with abnormal transmission and obtaining the determination result, the number of transmissions corresponding to the data message with abnormal transmission is first obtained from the first data table, and the number of transmissions is compared with a preset threshold value. If the number of transmissions is less than or equal to the preset threshold value, the data message with abnormal transmission is resent as the determination result; if the number of transmissions is greater than the preset threshold value, the data message with abnormal transmission is not sent as the determination result. For example, if the number of pushes is already greater than the set number of repeated pushes (i.e., the preset threshold value), the data needs to be deleted, i.e., the data message with abnormal transmission is deleted in the first data table; if the number of pushes is less than or equal to the preset threshold value, the message is re-pushed, and 1 is added to the number of pushes.

[0050] In an optional embodiment, the message middleware is used to obtain the data message with sending exceptions from the target topic corresponding to the target airline system, send the data message with sending exceptions to the target airline system, and store the characteristic information of the data message with sending exceptions and the offset corresponding to the characteristic information in a second data table.

[0051] In an optional embodiment, a data message acquisition request sent by a target airline system is received through a message middleware, wherein the data message acquisition request includes at least target characteristic information of the data message to be acquired; an offset corresponding to characteristic information identical to the target characteristic information is acquired from a second data table, and the data message to be acquired is determined based on the offset; and the data message to be acquired is sent to the target airline system.

[0052] Optionally, by using the message middleware to record the offset of each message and the data retransmission mechanism, the data within a specific time range can be supplemented, and a data supplement method with business scenario characteristics is provided for airlines. For example, the message middleware can obtain the data message with abnormal transmission from the target topic corresponding to the target airline system, send the data message with abnormal transmission to the target airline system, and store the characteristic information (such as characteristic field) of the data message with abnormal transmission and the offset corresponding to the characteristic information in the push record data table (i.e., the second data table). For another example, when a certain airline system (i.e., the target airline system) proposes a requirement for additional push, the message middleware receives the data message acquisition request sent by the target airline system, and according to the missing data clues provided by the airline, such as the type of missing message, the time period of the missing message and other target characteristic information, the corresponding offset value can be obtained from the push record data table, and the message middleware client is used to re-push the relevant data (i.e., the data message to be obtained) to the airline system through the queried offset, that is, the data message to be obtained is sent to the target airline system.

[0053] It should be noted that automatic data replenishment through message middleware provides airlines with a targeted data remediation method. Compared with blind batch push, it can screen and filter according to the specific requirements of the airlines for high-frequency messages, so as to achieve accurate and rapid data replenishment, effectively reducing the losses of the airlines.

[0054] In an optional embodiment, it is possible to use Figure 2 The schematic diagram shown in the figure realizes the retransmission of data messages. Figure 2 FIG. 1 is a schematic diagram of an optional process of automatically reissuing a data message by a push system according to an embodiment of the present invention. Figure 2As shown, the push system starts to push data messages and provide high-frequency data for airlines. When a push exception is found, the message that failed to be sent this time is attempted to be resent, which can be understood as the system trying to automatically make up the number. Specifically, the push system performs high-frequency data message push exception detection, mainly including message middleware server call timeout detection and server feedback information detection. When a push exception occurs (for example, the message middleware server call timeout or the server feedback information is abnormal), the high-frequency message that has not been successfully pushed is stored in the push exception data table in the database. By creating a separate process, the abnormal message is obtained from the database according to a periodic cycle and re-pushed to the message middleware. The process can use a scheduled task to achieve periodic execution. In order to track the push status of abnormal messages, the number of pushes is recorded for each abnormal message in the database, and the number is updated after each re-push. In order to maintain the normal operation of the database and avoid abnormal messages occupying too much storage space, abnormal messages that have been pushed more than a certain threshold are regularly deleted. This threshold can be set according to actual conditions. Optionally, in order to facilitate troubleshooting and performance optimization, logs of key steps are recorded, and the entire process is monitored to generate monitoring logs, for example, the number of abnormal messages processed each day and the proportion of successful pushes can be monitored. By screening the logs, you can analyze the types of problematic messages, the time periods with the most problems, and the messages that cannot be pushed after multiple retries after the problem occurs. From the collected data combined with the environment at the time, summarize the cause of the problem, further improve the application, and avoid similar problems.

[0055] It should be noted that the automatic complement of the push system is a self-rescue strategy for abnormal messages during high-frequency data forwarding, which can reduce push anomalies caused by failures of the push application itself.

[0056] In an optional embodiment, it is possible to use Figure 3 The schematic diagram shown in the figure realizes the retransmission of data messages. Figure 3This is a flow chart of an optional message middleware automatic resending data message according to an embodiment of the present invention. By using the message middleware to record the offset of each message and the data resending mechanism, the data in a specific time range can be supplemented, providing airlines with a data supplement method with business scenario characteristics. First, a message middleware consumer is created and a corresponding message topic is constructed for each airline to ensure that the high-frequency data of each airline is isolated from each other. The consumer is responsible for reading the high-frequency data from the message topic and pushing it to the corresponding airline system. The current offset is recorded by implementing a custom callback function in the consumer, that is, the consumer records the current offset each time it reads data from the message topic. While recording the offset, it is also necessary to store the characteristic fields of each high-frequency data (such as flight number, flight date, message source, message type, message time, etc.) in the push record data table in the database, that is, the push record data table contains these characteristic fields and the corresponding offset. Taking the high-frequency data of the Electronic Ticketing System (ETS) as an example, it is necessary to extract the flight number, flight date, PNR number, message type, message time, etc. in the ETS message and store them in the database. Figure 3 As shown, the push system receives the original data message and parses the message, reads the push rules from the push rule library and pushes the data message to the topic corresponding to the corresponding airline (such as Air China, China Southern Airlines, Hainan Airlines, etc.) in the message middleware. The message middleware integrates the airline response information and the push message information, generates a push record and stores it in the database. When a certain airline system requires additional push, the corresponding offset value can be obtained from the database according to the missing data clues (such as the type of missing message, the time period of the missing message, etc.) and feature fields provided by the airline. The message middleware client is used to re-push the relevant data to the airline system through the queried offset. In the push process, unnecessary high-frequency data can be filtered according to user demands, for example, filtering out specific types of messages that users want. Optionally, in order to facilitate problem troubleshooting and performance optimization, logs of key steps are recorded, and the entire process is monitored to generate monitoring logs. For example, the number of messages processed each day and the number of requests for additional push can be monitored, which can provide a checklist for airline data supplement.

[0057] In the embodiment of the present invention, an automatic number-filling scheme for the push system is provided, that is, when the push is abnormal, the push system automatically detects and stores the abnormal messages, and then re-pushes these abnormal messages through scheduled tasks; an automatic number-filling scheme for the message middleware is also provided, that is, the consumer records the offset and feature fields of each message, and when the airline makes a supplementary push request, the corresponding offset is found according to the feature field, and the missing message data is re-pushed using the client, and data is screened and filtered according to the needs of the airline during the push process. The problem of data loss during the transmission of high-frequency messages in civil aviation is effectively solved, ensuring that high-frequency messages can be filled in a timely and accurate manner even if they encounter failures during transmission, reducing the risk of data loss and improving the integrity and reliability of data transmission.

[0058] It can be seen that through the technical solution of the present invention, the purpose of timely and automatically completing the need for complement when a transmission anomaly occurs is achieved, thereby achieving the technical effect of improving the efficiency of reissuing abnormal data messages, and further solving the technical problem of low efficiency in the prior art of relying on manual reissuance of abnormal data messages in the data transmission process.

[0059] Example 2

[0060] According to an embodiment of the present invention, an embodiment of a data message processing device is provided, wherein: Figure 4 is a schematic diagram of an optional data message processing device according to an embodiment of the present invention, such as Figure 4 As shown, the device includes: a first processing module 401, which is used to store the data message with abnormal sending in a first data table when it is detected that there is a data message with abnormal sending in the process of sending the data message, wherein the first data table is used to record the field information and metadata information of the data message with abnormal sending; a second processing module 402, which is used to obtain the data message with abnormal sending from the first data table based on a preset time interval, and determine whether to resend the data message with abnormal sending to obtain a determination result; and a third processing module 403, which is used to send the data message with abnormal sending to a target topic corresponding to the target airline system corresponding to the data message with abnormal sending in the message middleware if the determination result is to resend the data message with abnormal sending.

[0061] It should be noted that the above-mentioned first processing module 401, second processing module 402 and third processing module 403 correspond to steps S101 to S103 in the above-mentioned embodiment, and the examples and application scenarios implemented by the three modules and the corresponding steps are the same, but are not limited to the contents disclosed in the above-mentioned embodiment 1.

[0062] Optionally, the second processing module includes: a comparison module, used to obtain the number of sending times corresponding to the data message with abnormal sending from the first data table, and compare the number of sending times with a preset threshold; a first determination module, used to resend the data message with abnormal sending as a judgment result if the number of sending times is less than or equal to the preset threshold; and a second determination module, used to not send the data message with abnormal sending as a judgment result if the number of sending times is greater than the preset threshold.

[0063] Optionally, the data message processing device also includes: a fourth processing module, which is used to call the server of the message middleware to send the data message to the message middleware before detecting that there is a data message with abnormal sending during the data message sending process; a third determination module, which is used to detect the calling duration of the message middleware server, and determine that the data message to be sent is a data message with abnormal sending when it is detected that the calling duration is greater than a preset duration; a fourth determination module, which is used to detect the feedback information of the server when it is detected that the calling duration is less than or equal to the preset duration, and determine that the data message to be sent is a data message with abnormal sending when it is detected that the feedback information is abnormal.

[0064] Optionally, the message middleware is used to obtain the data message with the sending exception from the target topic corresponding to the target airline system, send the data message with the sending exception to the target airline system, and store the characteristic information of the data message with the sending exception and the offset corresponding to the characteristic information in the second data table.

[0065] Optionally, the data message processing device also includes: a receiving module, used to receive a data message acquisition request sent by a target airline system through a message middleware, wherein the data message acquisition request includes at least target characteristic information of the data message to be acquired; a fifth determination module, used to obtain an offset corresponding to characteristic information that is the same as the target characteristic information from a second data table, and determine the data message to be acquired based on the offset; and a sending module, used to send the data message to be acquired to the target airline system.

[0066] Optionally, the data message processing device also includes: a fifth processing module, which is used to determine whether to resend the data message with abnormal sending, and after obtaining the determination result, if the determination result is not to send the data message with abnormal sending, then delete the data message with abnormal sending in the first data table.

[0067] Optionally, the data message processing device also includes: a sixth processing module, which is used to add one to the number of sending times corresponding to the abnormal data message in the first data table after sending the abnormal data message to the target topic corresponding to the target airline system corresponding to the abnormal data message in the message middleware.

[0068] Example 3

[0069] According to another aspect of an embodiment of the present invention, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the computer program implements the above-mentioned data message processing method.

[0070] Example 4

[0071] According to another aspect of an embodiment of the present invention, a computer-readable storage medium is provided, in which a computer program is stored, wherein the computer program is configured to execute the above-mentioned method for processing data packets when running.

[0072] Example 5

[0073] According to another aspect of an embodiment of the present invention, there is also provided an electronic device, wherein: Figure 5 is a schematic diagram of an optional electronic device according to an embodiment of the present invention, such as Figure 5 As shown, the electronic device includes one or more processors; a memory for storing one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors are used to run the programs, wherein the programs are set to execute the above-mentioned data message processing method when running. When the processor executes the program, the following steps are implemented: when it is detected that there is a data message with abnormal transmission in the data message transmission process, the data message with abnormal transmission is stored in the first data table, wherein the first data table is used to record the field information and metadata information of the data message with abnormal transmission; based on a preset time interval, the data message with abnormal transmission is obtained from the first data table, and it is determined whether to resend the data message with abnormal transmission to obtain a determination result; if the determination result is to resend the data message with abnormal transmission, the data message with abnormal transmission is sent to the target topic corresponding to the target airline system corresponding to the data message with abnormal transmission in the message middleware.

[0074] Optionally, when the processor executes the program, the following steps are also implemented: obtaining the number of transmissions corresponding to the data message with abnormal transmission from the first data table, and comparing the number of transmissions with a preset threshold; if the number of transmissions is less than or equal to the preset threshold, resending the data message with abnormal transmission is used as a judgment result; if the number of transmissions is greater than the preset threshold, not sending the data message with abnormal transmission is used as a judgment result.

[0075] Optionally, the processor also implements the following steps when executing the program: before detecting that there is a data message with sending abnormality during the data message sending process, calling the server of the message middleware to send the data message to be sent to the message middleware; detecting the calling duration of the message middleware server, and when detecting that the calling duration is greater than a preset duration, determining that the data message to be sent is a data message with sending abnormality; when detecting that the calling duration is less than or equal to a preset duration, detecting the feedback information of the server, and when detecting that the feedback information is abnormal, determining that the data message to be sent is a data message with sending abnormality.

[0076] Optionally, the message middleware is used to obtain the data message with the sending exception from the target topic corresponding to the target airline system, send the data message with the sending exception to the target airline system, and store the characteristic information of the data message with the sending exception and the offset corresponding to the characteristic information in the second data table.

[0077] Optionally, when executing the program, the processor also implements the following steps: receiving a data message acquisition request sent by the target airline system through the message middleware, wherein the data message acquisition request includes at least target characteristic information of the data message to be acquired; acquiring an offset corresponding to characteristic information identical to the target characteristic information from the second data table, and determining the data message to be acquired based on the offset; and sending the data message to be acquired to the target airline system.

[0078] Optionally, when executing the program, the processor further implements the following steps: after determining whether to resend the data message with the sending exception, and obtaining the determination result, if the determination result is not to send the data message with the sending exception, then deleting the data message with the sending exception in the first data table.

[0079] Optionally, when the processor executes the program, the following steps are also implemented: after sending the abnormal data message to the target topic corresponding to the target airline system corresponding to the abnormal data message in the message middleware, the number of times the abnormal data message is sent is increased by one in the first data table.

[0080] The devices in this article can be servers, PCs, PADs, mobile phones, etc.

[0081] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0082] In the above embodiments of the present invention, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0083] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0084] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0085] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0086] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.

[0087] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. A method for processing a data message, characterized in that: include: In the case where a data message with abnormal transmission is detected during the data message transmission process, the data message with abnormal transmission is stored in a first data table, wherein the first data table is used to record field information and metadata information of the data message with abnormal transmission; Acquire the data message with the sending exception from the first data table based on a preset time interval, and determine whether to resend the data message with the sending exception to obtain a determination result; If the judgment result is to resend the abnormally sent data message, the abnormally sent data message is sent to the target topic corresponding to the target airline system corresponding to the abnormally sent data message in the message middleware.

2. The method according to claim 1, characterized in that Determine whether to resend the data message with the sending exception, and obtain a determination result, including: Acquire the sending number corresponding to the abnormally sent data message from the first data table, and compare the sending number with a preset threshold; If the number of transmissions is less than or equal to the preset threshold, resending the data message with the transmission exception is used as the judgment result; If the number of transmission times is greater than the preset threshold, not sending the data message with the transmission exception is taken as the judgment result.

3. The method according to claim 1, characterized in that Before detecting that there is a data message with abnormal transmission in the data message transmission process, the method further includes: Calling the server of the message middleware to send the data message to be sent to the message middleware; Detecting the calling duration of the server of the message middleware, and determining that the data message to be sent is the data message with the sending exception when detecting that the calling duration is greater than the preset duration; When it is detected that the calling duration is less than or equal to the preset duration, the feedback information of the server is detected, and when it is detected that the feedback information is abnormal, the data packet to be sent is determined to be the data packet with abnormal sending.

4. The method according to claim 1, characterized in that: The message middleware is used to obtain the data message with the sending exception from the target topic corresponding to the target airline system, send the data message with the sending exception to the target airline system, and store the characteristic information of the data message with the sending exception and the offset corresponding to the characteristic information in the second data table.

5. The method according to claim 4, characterized in that The method further comprises: Receiving, through the message middleware, a data message acquisition request sent by the target airline system, wherein the data message acquisition request at least includes target feature information of the data message to be acquired; Acquire an offset corresponding to the characteristic information identical to the target characteristic information from the second data table, and determine the data message to be acquired according to the offset; The data message to be acquired is sent to the target airline system.

6. The method according to claim 1, characterized in that After determining whether to resend the abnormally sent data message and obtaining a determination result, the method further includes: If the judgment result is not to send the data message with the sending exception, then the data message with the sending exception is deleted from the first data table.

7. The method according to claim 1, characterized in that After sending the abnormal data message to the target topic corresponding to the target airline system corresponding to the abnormal data message in the message middleware, the method further includes: In the first data table, the number of times the data message with the abnormal sending is sent is increased by one.

8. A data message processing device, characterized in that: include: A first processing module, configured to, when detecting that a data message with abnormal transmission exists during the data message transmission process, store the data message with abnormal transmission in a first data table, wherein the first data table is used to record field information and metadata information of the data message with abnormal transmission; A second processing module is used to obtain the data message with the sending exception from the first data table based on a preset time interval, and determine whether to resend the data message with the sending exception to obtain a determination result; The third processing module is used for sending the data message with the sending exception to the target topic corresponding to the target airline system corresponding to the data message with the sending exception in the message middleware if the judgment result is to resend the data message with the sending exception.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program is configured to execute the method for processing a data message as claimed in any one of claims 1 to 7 when running.

10. An electronic device, characterized in that: The electronic device includes one or more processors; A memory for storing one or more programs, which, when the one or more programs are executed by the one or more processors, enables the one or more processors to run the programs, wherein the program is configured to execute the method for processing the data message described in any one of claims 1 to 7 when running.

Images