Data processing method and device, computer equipment and readable storage medium

Abstract

The invention relates to a data processing method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: executing a preset timed acquisition task to obtain a target event data set crawled from an information platform; encrypting and packaging the target event data set, and transmitting the encrypted and packaged target event data set to an intranet information space through a preset transmission protocol; the encrypted and packaged target event data set in the intranet information space is analyzed, and the decrypted target event data set is stored in an intranet database; and generating a push message based on the target event data set in the intranet database, and pushing the push message to each information receiver. By adopting the method, the data security and timeliness of the target event data set can be ensured.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a data processing method, apparatus, computer equipment, computer-readable storage medium, and computer program product. Background Art

[0002] In the current environment where the internal network of an enterprise is isolated from the external Internet, the target information platform in the external Internet usually announces target events to various enterprises by publishing announcements.

[0003] In traditional technology, it is usually necessary to obtain the published announcements in the target information platform, use the announcements as source data, and manually connect the external Internet and the enterprise's internal network. That is, when the source data (for example, event announcements) are manually analyzed and processed, the target event results are obtained, and a notification message of the target event results is manually generated on the enterprise's internal network to inform various departments within the enterprise of the target event results.

[0004] However, in traditional technologies, information between the enterprise's internal network and the external Internet is synchronized manually. The manual processing efficiency is low, which often leads to the omission or leakage of important enterprise information, and the security and accuracy of data synchronization cannot be guaranteed. Summary of the invention

[0005] Based on this, it is necessary to provide a data processing method, apparatus, computer device, computer-readable storage medium and computer program product to address the above technical issues.

[0006] In a first aspect, the present application provides a data processing method, the method comprising:

[0007] Execute the preset timed collection task to obtain the target event data set crawled from the information platform;

[0008] Encrypting and encapsulating the target event data set, and transmitting the encrypted and encapsulated target event data set to the intranet information space through a preset transmission protocol;

[0009] Parsing the target event data set encrypted and encapsulated in the intranet information space, and storing the decrypted target event data set in an intranet database;

[0010] A push message is generated based on the target event data set in the intranet database and pushed to each information recipient.

[0011] In one embodiment, executing a preset timed collection task to obtain a target event data set crawled from an information platform includes:

[0012] Based on the preset collection cycle, query the target event list from the information platform;

[0013] Based on each target event title included in the target event list, the target event data corresponding to each target event title is read in turn, and the target event data set is crawled using a preset crawling algorithm.

[0014] In one embodiment, based on each target event title included in the target event list, sequentially reading the target event data corresponding to each target event title, and crawling the target event data set by using a preset crawling algorithm, includes:

[0015] Based on each target event title included in the target event list, crawling initial target event data corresponding to each target event title in sequence;

[0016] Performing data conversion on the initial target event data based on a text parser to obtain target event data;

[0017] The target event data is subjected to data preprocessing and key field extraction to obtain a target event data set, and the target event data set is stored in a database in a structured data form.

[0018] In one embodiment, encrypting and encapsulating the target event data set, and transmitting the encrypted and encapsulated target event data set to an intranet information space through a preset transmission protocol, includes:

[0019] Based on a preset timing cycle, read the target event data stored in the database;

[0020] Identifying event times in the target event data, and grouping the target event data according to the event times to obtain target event data groups;

[0021] Encrypt and encapsulate each target event data group based on an asymmetric encryption method to obtain encrypted data;

[0022] Based on a preset sending cycle, the encrypted data is sent to the intranet information space via a preset transmission protocol.

[0023] In one embodiment, the step of parsing the encrypted and encapsulated target event data set in the intranet information space and storing the decrypted target event data set in an intranet database includes:

[0024] Decrypting the target event data set encrypted and encapsulated in the intranet information space based on a preset asymmetric decryption method;

[0025] The decrypted target event data set is stored in an intranet database; the target event data set is used to generate a target event message.

[0026] In one embodiment, the generating a push message based on the target event data set in the intranet database and pushing it to each information recipient includes:

[0027] Based on the target event data set in the intranet database, generating a push message of the target event;

[0028] Based on the association relationship between the target event and the information recipient, the push message of the target event is pushed to each information recipient.

[0029] In one embodiment, the method further comprises:

[0030] In response to an event report generation request, obtaining the target event data set in the intranet database;

[0031] Based on preset information extraction rules, feature information of the target event data set is extracted, and based on the feature information and an event report template matching the information extraction rules, a target event report is generated.

[0032] In a second aspect, the present application further provides a data processing device, comprising:

[0033] The task execution module is used to execute the preset timed collection task and obtain the target event data set crawled from the information platform;

[0034] A transmission module, used to encrypt and encapsulate the target event data set, and transmit the encrypted and encapsulated target event data set to the intranet information space through a preset transmission protocol;

[0035] A storage module, used for parsing the target event data set encrypted and encapsulated in the intranet information space, and storing the decrypted target event data set in an intranet database;

[0036] The push module is used to generate a push message based on the target event data set in the intranet database and push it to each information recipient.

[0037] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:

[0038] Execute the preset timed collection task to obtain the target event data set crawled from the information platform;

[0039] Encrypting and encapsulating the target event data set, and transmitting the encrypted and encapsulated target event data set to the intranet information space through a preset transmission protocol;

[0040] Parsing the target event data set encrypted and encapsulated in the intranet information space, and storing the decrypted target event data set in an intranet database;

[0041] A push message is generated based on the target event data set in the intranet database and pushed to each information recipient.

[0042] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the following steps are implemented:

[0043] Execute the preset timed collection task to obtain the target event data set crawled from the information platform;

[0044] Encrypting and encapsulating the target event data set, and transmitting the encrypted and encapsulated target event data set to the intranet information space through a preset transmission protocol;

[0045] Parsing the target event data set encrypted and encapsulated in the intranet information space, and storing the decrypted target event data set in an intranet database;

[0046] A push message is generated based on the target event data set in the intranet database and pushed to each information recipient.

[0047] In a fifth aspect, the present application further provides a computer program product, including a computer program, which implements the following steps when executed by a processor:

[0048] Execute the preset timed collection task to obtain the target event data set crawled from the information platform;

[0049] Encrypting and encapsulating the target event data set, and transmitting the encrypted and encapsulated target event data set to the intranet information space through a preset transmission protocol;

[0050] Parsing the target event data set encrypted and encapsulated in the intranet information space, and storing the decrypted target event data set in an intranet database;

[0051] A push message is generated based on the target event data set in the intranet database and pushed to each information recipient.

[0052] The above-mentioned data processing method, device, computer equipment, computer-readable storage medium and computer program product execute preset timed collection tasks to obtain target event data sets crawled from the information platform; encrypt and encapsulate the target event data sets, and transmit the encrypted and encapsulated target event data sets to the intranet information space through a preset transmission protocol; parse the encrypted and encapsulated target event data sets in the intranet information space, and store the decrypted target event data sets in the intranet database; generate a push message based on the target event data sets in the intranet database and push it to each information recipient. With this method, the target event data sets are crawled from the information platform at regular intervals through preset timed collection tasks, and then the target event data sets of the external Internet are transmitted to the intranet information space through encryption and encapsulation, thereby ensuring the data security and timeliness of the target event data sets. The encrypted and encapsulated target event data sets in the intranet information space are automatically parsed, the parsed target event data are stored in the intranet database, and the corresponding push messages are generated and pushed to each information recipient, thereby avoiding the omission of important information and improving the efficiency of target event notification. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0054] Figure 1 is a flow chart of a data processing method in one embodiment;

[0055] Figure 2 A schematic diagram of a process for obtaining a target event data set in one embodiment;

[0056] Figure 3 A schematic diagram of a process of converting and storing target event data format in one embodiment;

[0057] Figure 4 A schematic diagram of a flow chart of the steps of encrypting, encapsulating and transmitting a target event data set in one embodiment;

[0058] Figure 5 A schematic diagram of a process for decrypting a target event data set and storing it in an intranet database in one embodiment;

[0059] Figure 6 A flowchart of the steps of generating an event push message and pushing it to each information recipient in one embodiment;

[0060] Figure 7A schematic diagram of an interface for a push message in the form of an email in an embodiment;

[0061] Figure 8 A schematic diagram of a flow chart of steps for generating a target event report in one embodiment;

[0062] Fig. 9 A schematic diagram of an interface for generating a penalty report in an embodiment;

[0063] Fig.10 is a structural block diagram of a data processing device in one embodiment;

[0064] Fig.11 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0065] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0066] In one embodiment, Figure 1 As shown, some important information notifications will be released in the form of announcements on various information platforms on the external Internet. For example, in the financial field, national financial regulatory agencies will release financial penalty announcements and other related announcements through official websites. These announcement information needs to be promptly known by enterprises and corresponding improvement measures should be taken. Therefore, the present application provides a data processing method, through which important announcements on information platforms can be promptly known, and announcement notifications can be conveyed to relevant departments and relevant personnel. This embodiment uses the application of this method to a server as an example. It can be understood that this method can also be applied to a system including a terminal and a server, and implemented through the interaction between the terminal and the server. In this embodiment, the method includes the following steps:

[0067] Step 102, execute the preset timed collection task to obtain the target event data set crawled from the information platform.

[0068] In the implementation, an information synchronization and analysis system is pre-built, and the information synchronization and analysis system includes a first server and a second server. Among them, a first server is set up in the external Internet, and the first server includes a data acquisition module and a data parsing module. The data acquisition module can be built based on the SpringBoot framework, and web crawler technology and HTML (HyperText Markup Language) parser are pre-deployed therein. The target event data is crawled from the information platform through the web crawler technology in the data acquisition module, and the crawled data is parsed through the HTML parser to convert the data into a target event data set in the target format. The target event data set is then identified and key fields are extracted through the data parsing module to obtain the target event data set. Then, the first server can store the obtained target event data set in the database of the first server for further analysis and processing of the target event data set.

[0069] Step 104: encrypt and encapsulate the target event data set, and transmit the encrypted and encapsulated target event data set to the intranet information space through a preset transmission protocol.

[0070] In implementation, in the external Internet, after the first server processes and stores the target event data crawled from the information platform, it is also necessary to synchronize data with the second server in the enterprise's internal network. In addition, since the target event data set may contain sensitive data, in order to ensure the safe transmission of sensitive data between the internal and external networks, an encryption transmission module is also added to the first server. The encryption transmission module integrates multiple encryption methods such as asymmetric encryption methods, symmetric encryption methods, and MD5 encryption methods. When the target event data set is safely transmitted between the internal and external networks, the encryption transmission module in the first server encrypts and encapsulates the target event data set to obtain the encrypted and encapsulated target event data set. Then, the encrypted and encapsulated target event data set is transmitted between the first server and the second server in the enterprise's internal network through a preset transmission protocol, and the encrypted and encapsulated target event data set is stored in the intranet information space (which can also be called storage space) of the second server. Specifically, the first server can send the encrypted target event data set to the designated mailbox of the second server in the intranet in the form of an email to complete the encrypted transmission of the target event data set between the internal and external networks.

[0071] Optionally, different encryption methods are integrated in the encryption transmission module, and different encryption methods can adapt to different target event data and different application scenarios. Specifically, different data encryption methods can be selected for encryption based on the importance of the target event data or the data form, etc. The encryption method used by the encryption transmission module is not limited in the embodiment of the present application.

[0072] Step 106, parsing the encrypted and encapsulated target event data set in the intranet information space, and storing the decrypted target event data set in the intranet database.

[0073] In implementation, after the second server in the information synchronization and analysis system receives the encrypted and encapsulated target event data set, the second server automatically parses the encrypted and encapsulated target event data set in the intranet information space, obtains the decrypted target event data set, and stores the decrypted target event data set in the intranet database. At this time, based on the preset timed collection task, the data in the intranet database and the data in the external database complete data synchronization, and the full amount of target event data is obtained in the intranet database.

[0074] Step 108: Generate a push message based on the target event data set in the intranet database and push it to each information recipient.

[0075] In implementation, the information synchronization and analysis system also includes a message push module. After the target event data set is obtained in the intranet database, the message push module extracts the key information contained in the target event data set. And based on the key information, a corresponding push message is generated. For example, the target event data set contains various penalty announcements, and each penalty announcement contains the name of the penalty agency, the penalty date, the penalty reason, the penalty amount, etc. Therefore, the message push module can generate a push message of the corresponding target event from the key information, and then push the push message to each pre-configured information recipient to play the role of notifying each information recipient. Among them, each information recipient can be a pre-configured user terminal node, and the directional push of the push message is completed by pre-configuring the association relationship between the second server and the user terminal node. Optionally, the user application permission can also be opened. If the user wants to receive push messages regularly, an application for subscription-related information can be sent to the second server. After review and authorization, the second server establishes an association relationship with the terminal node where the applicant user is located, so that the push message of the target event can also be sent to the applicant user regularly.

[0076] In the above data processing method, by executing the preset timed collection task, the target event data set crawled from the information platform is obtained; the target event data set is encrypted and encapsulated, and the encrypted and encapsulated target event data set is transmitted to the intranet information space through the preset transmission protocol; the encrypted and encapsulated target event data set in the intranet information space is parsed, and the decrypted target event data set is stored in the intranet database; based on the target event data set in the intranet database, a push message is generated and pushed to each information recipient. With this method, the target event data set is crawled from the information platform at regular intervals through the preset timed collection task, and then the target event data set of the external Internet is transmitted to the intranet information space by encryption and encapsulation, thereby ensuring the data security and timeliness of the target event data set. The encrypted and encapsulated target event data set in the intranet information space is automatically parsed, the parsed target event data is stored in the intranet database, and the corresponding push message is generated and pushed to each information recipient, thereby avoiding the omission of important information and improving the efficiency of target event notification.

[0077] In an exemplary embodiment, Figure 2 As shown, the specific processing process of step 102 includes the following steps 202 to 204. Among them:

[0078] Step 202: Based on a preset collection period, query a target event list from the information platform.

[0079] In implementation, various types of target event announcement information are published in the information platform, and the information platform will summarize the target event announcement information published daily into a target event list, and store the target event titles in the target event list. Therefore, the first server is pre-configured with a scheduled collection task. When the first service executes the scheduled collection task, the first server will query the target event titles from the target event list published daily on the information platform based on the preset collection cycle in the scheduled collection task.

[0080] Step 204, based on each target event title included in the target event list, read the target event data corresponding to each target event title in turn, and crawl the target event data set using a preset crawling algorithm.

[0081] During implementation, the first server reads the target event details corresponding to each target event title in turn based on each target event title included in the target event list (for example, the notification announcement contains date, unit, target event, etc. information), reads the target event data corresponding to the target event title, crawls the target event data through a preset crawling technology, and obtains a target event data set.

[0082] In this embodiment, by executing the scheduled collection task and periodically crawling the target event data set in the information platform, the timeliness of data transmission is guaranteed, the manual data collection operations are reduced, and the data processing efficiency is improved.

[0083] In an exemplary embodiment, Figure 3 As shown, the specific processing process of step 204 includes steps 302 to 306. Among them:

[0084] Step 302: based on each target event title included in the target event list, crawl the initial target event data corresponding to each target event title in sequence.

[0085] In implementation, the first server traverses the target event list and extracts the target event title in each item in the target event list, ensuring that no title is missed in the extraction process and that the format is consistent for subsequent use. Then, based on each target event title included in the target event list, the first server sequentially reads the initial target event data mapped to each target event title. The initial target event data is text content in HTML format type.

[0086] Step 304: Perform data conversion on the initial target event data based on the text parser to obtain target event data.

[0087] In the implementation, an HTML parser is pre-deployed in the first server, and the HTML parser is used to convert the acquired initial target event data in HTML format into target event data in XML format or JSON data format. Specifically, the initial target event data set in the original information platform is usually a target event data set in HTML document format. Therefore, the first server can identify and parse various tags, elements and attributes in the HTML document through the HTML parser. It converts the HTML character stream into a tree structure (usually a document object model, DOM tree) to facilitate subsequent processing by the program.

[0088] Step 306 , preprocessing the target event data and extracting key fields to obtain a target event data set, and storing the target event data set in a database in a structured data form.

[0089] In implementation, after the data format conversion, the first server can further process the target event data after the format conversion, for example, pre-process the target event data by means of data cleaning, screening, standardization, etc., screen out abnormal data in the target event data, etc., and improve the data quality of the target event data. Then, the first server can also perform in-depth analysis of the text information of the target event data after data pre-processing, automatically identify and extract the key fields contained in the target event data (usually text data). For example, taking the target event data published in the information platform as a penalty announcement as an example, the key fields extracted from the target event data include: the name of the penalty agency, the date of penalty, the reason for penalty, the amount of penalty, etc. Thus, based on the extracted key fields, the first server obtains a target event data set containing the key fields. Then, the first server converts the unstructured target event data set into structured data and stores it in the database of the first server.

[0090] In this embodiment, the efficiency of data acquisition is: by automatically crawling the initial data corresponding to each title in the target event list, the complexity and time cost of manual data collection are reduced. This is particularly important for scenarios that require processing large amounts of data. The initial data is batch converted and processed based on the text parser, making the data extraction process more standardized and efficient, reducing the possibility of human error.

[0091] In an exemplary embodiment, after storing the data in the intranet database, the first server can timely feed back the target event data in the content database to the enterprise intranet according to a preset timing cycle to ensure the timeliness of the target event data. Figure 4 As shown, the specific processing process of step 104 includes the following steps:

[0092] Step 401, based on a preset timing cycle, read the target event data stored in the database.

[0093] In implementation, when new target event data is stored in the database of the first server, data synchronization with the enterprise is required. Therefore, in order to ensure the timeliness and accuracy of the target event data, a timing cycle (i.e., a sending cycle) is also set in the first server. When the timing cycle is reached, the first server reads the target event data to be published in the database for data synchronization.

[0094] Step 402, identifying the event time in the target event data, and grouping the target event data according to the event time to obtain target event data groups.

[0095] In implementation, in order to avoid omission of target event data and facilitate subsequent analysis and processing of target event data, the first server can pre-check and classify the target event data in the database and divide the target event data group each time the target event data is sent. Specifically, when the first server crawls the target event data set, it is first classified and stored according to the crawling time of each target event data in the information platform, or it is classified and stored according to the upload time of each target event data. For example, the target event data is released by day, week or month in the information platform, and the target event data released in the same batch have the same upload time. Therefore, when the first server crawls data by day, week or month, the full amount of target event data released in the same batch will be obtained at one time. Thus, the target event data crawled each time is first stored in the database according to the crawling time or the upload time of the target event data. However, different target event data bodies contain event time, which is an event related to the target event. For example, when the target event is a penalty event, the event time of the target event is the penalty date of the penalty event, or the rectification date of the penalty event, etc. Therefore, it is of great significance to centrally analyze the target event data of the same event time to avoid missing events and delaying processing. Therefore, in order to avoid missing target event data, before the first server transmits data between the internal and external networks, it can identify the event time in each target event data, and regroup the target event data based on the event time of each target event data, thereby obtaining each target event data group. For example, in a database storing target event data according to upload time, the first server obtains a target event data set of the current latest upload time (for example, November 27), and the target event data set contains 5 target event data records, among which the event time identified in 3 target event data records is October 25, and the event time identified in 2 target event data records is November 1. After obtaining the target event data in the current target event data set, the first server needs to check the target event data sets of each batch uploaded within a preset time (for example, 15 days) before the current latest upload time, and group the target event data with an event time of October 25 in each target event data with the current 3 target event data records to obtain a target event data group. Group the target event data with an event time of November 1 in each target event data with the current 2 target event data records to obtain a target event data group. The same target event group contains target events with the same event time. Classifying target events with the same event time facilitates the subsequent centralized processing of target events with the same event time.

[0096] Optionally, when the first server verifies each batch of target event data sets before the current latest upload time, it can verify each batch of target event data sets within 15 days before the current latest upload time, or it can verify each batch of target event data sets within 30 days, 3 months, and 6 months before the current latest upload time. The time interval of the target event data set that is verified first can be adjusted based on the attribute characteristics of the target event data and business requirements, which is not limited in the embodiments of the present disclosure.

[0097] Step 403: encrypt and encapsulate each target event data group based on an asymmetric encryption method to obtain encrypted data.

[0098] In implementation, after determining the target event data group, the first server encrypts and encapsulates each target event data group based on an asymmetric encryption method to obtain encrypted data. Optionally, in addition to using an asymmetric encryption method to encrypt and encapsulate each target event data group, other encryption methods may also be used, for example, MD5 encryption method, symmetric encryption method to encrypt the target event data group, and the embodiment of the present application does not limit the encryption method of the target event data.

[0099] Step 404: Based on a preset sending period, the encrypted data is sent to the intranet information space via a preset transmission protocol.

[0100] In implementation, after obtaining the encrypted data, the first server sends the encrypted data to the intranet information space through a preset transmission protocol based on a preset sending cycle. Specifically, an intranet mailbox is pre-set in the second server in the enterprise's internal network. The intranet mailbox, as an intranet information space, can cache the target event data. Therefore, the first server sends the encrypted data to the intranet mailbox in the form of an email based on a preset sending cycle (for example, by day, by week, by month), and the email complies with a preset transmission protocol (for example, SMTP (Simple Mail Transfer Protocol)).

[0101] Optionally, encrypted data transmission can also be performed between the first server and the second server in other forms, for example, data transmission is performed through FTP (File Transfer Protocol), which is a standard network protocol for transferring files in a network. Therefore, encrypted data is transmitted between the first server and the second server through the FTP protocol, and then the encrypted data is stored in the internal storage space of the second server. Therefore, this application does not limit the data transmission method between the first server and the second server.

[0102] In an exemplary embodiment, Figure 5As shown, the specific processing process of step 106 includes:

[0103] Step 501, based on a preset asymmetric decryption method, decrypt the encrypted and encapsulated target event data set in the intranet information space.

[0104] In the implementation, a second server is pre-deployed in the enterprise internal network of the information synchronization and analysis system. After receiving the encrypted and encapsulated target event data set in the intranet information space of the second server, the second server will automatically decrypt the encrypted and encapsulated target event data set in the intranet information space based on a preset asymmetric decryption method. Specifically, during the asymmetric encryption and decryption process, both parties of the communication store a key for encryption or decryption, and then the second server can decrypt the encrypted and encapsulated target event data set based on the pre-stored key to obtain the decrypted target event data set.

[0105] Step 502: Store the decrypted target event data set into the intranet database.

[0106] The target event dataset is used to generate the target event message.

[0107] In implementation, the second server stores the decrypted target event data set in the form of each target event data group in the intranet database, so that the intranet database retains the same target event data as the external database, realizing data synchronization between the intranet and the intranet.

[0108] In this embodiment, a high-intensity data protection is provided through an asymmetric encryption algorithm, ensuring the security of the target event data during transmission and storage. Through a preset asymmetric decryption method, data viewing permissions are further restricted, further ensuring the security of the target event data and avoiding the leakage of the target event data.

[0109] In an exemplary embodiment, Figure 6 As shown, the specific processing process of step 108 includes:

[0110] Step 601: Generate a push message of a target event based on a target event data set in an intranet database.

[0111] In implementation, after the target event data set is stored in the intranet database, in order to ensure the timeliness of the target event data, the second server may also use a timed task to generate a push message of the corresponding target event for the newly added target event data set in the intranet database based on a preset timing period. It is used to notify each information recipient. Specifically, the second server performs data processing on each target event data group in the target event data set, extracts the key information of each target event data in the target event data group, and summarizes the key information of each target event data in the target event data group in units of target event groups to obtain a summary result of each key information. In this way, the second server generates a push message based on the key information of each target event data and the summary result of each key information, so as to inform the users of each information recipient. Among them, the push message can be an email message in the form of an email, such as Figure 7 As shown, Figure 7 The displayed email body contains the summary of key information of each target event data, as well as Figure 7 The table contained in the email contains key information of each target event data. In this way, a push message in the form of an email message is generated, and it can be sent to each information recipient via email. Alternatively, the push message can also be an instant messaging message. In this way, the second server can send the generated instant messaging message to each information recipient with the help of current instant messaging applications and instant messaging tools. Therefore, this application does not limit the push form of the push message and the format type of the push message.

[0112] Step 602: based on the association between the target event and the information receiver, push the push message of the target event to each information receiver.

[0113] In implementation, after the push message is generated, the second server pushes the push message of the target event to each information recipient based on the association relationship between the target event and the information recipient. Specifically, the association relationship between the target event and the information recipient refers to the permission relationship that the information recipient has the authority to view the target event. If the information recipient has the authority to view the target event data of the target event, it means that when the information recipient registers an account or updates the account authorization, the association relationship between the second parent of the target event and the terminal node where the information recipient is located has been established. Therefore, when the second server identifies the key information of the target event data (target event) contained in the push message, the second server pushes the push message of the target event to each information recipient based on the association relationship.

[0114] In this embodiment, a push message is generated based on the target event data set, and the key information of the target event data is notified to each designated information recipient through targeted push of the push message, so that each information recipient can be informed of the target event in a targeted manner, thereby ensuring the security of the target event data. In addition, each information recipient is informed through the push message to avoid event omissions that may occur due to manual active query of the target event data.

[0115] In an exemplary embodiment, Figure 8 As shown, the method also includes:

[0116] Step 801: Obtain a target event data set from an intranet database.

[0117] In implementation, after the target event data is synchronized to the intranet database, the intranet database contains the full amount of target event data in the current information platform. Then, while the second server pushes messages to each information recipient, it can also perform personalized analysis and processing on the target event data set based on the requirements of each information recipient. Specifically, each information recipient can send an event report generation request to the second server, and the second server responds to the event report generation request and directly obtains the target event data set in the intranet database.

[0118] Step 802: extract characteristic information of the target event data set based on preset information extraction rules, and generate a target event report based on the characteristic information and an event report template that matches the information extraction rules.

[0119] In implementation, various information extraction rules are pre-stored in the second server. The information extraction rules can be customized rules for target event information of different information recipients according to their needs, or can be general information extraction rules corresponding to the target event type set based on the target event type, or can be information extraction rules adapted to the scene set in different scenarios. The disclosed embodiment does not limit the information extraction rules preset in the second server. In this way, when the second server responds to the event report generation request, the information extraction rules can be determined based on the customized requirements of the information recipient, the target event type, or any one of the requirements in the scene. The information extraction rules can specifically be to extract the information of the target byte position in the event announcement (target event data) of the target event or to extract the data value corresponding to the target metadata to obtain the key information of the target event data. In this way, the second server extracts the feature information in the target event data set based on the determined information extraction rules. The feature information is the key information of the user's needs.

[0120] For example, if the target event data is the event data of a penalty event, the general extraction rule of the target event type is used as the determined information proposal rule, that is, the information of the general byte position is extracted in the announcement text (penalty event data) of the target event type to obtain the characteristic information of the penalty event. The characteristic information of the penalty event includes: the name of the penalty agency, the penalty date, the reason for the penalty, the penalty amount, etc.

[0121] Furthermore, in the second server, each information extraction rule is matched with an event report template, and the matching relationship is reflected in that the feature information extracted by the information extraction rule can correspond to the target item to be filled in the event report target. In this way, the second server generates a target event report based on the extracted feature information and the event report template that matches the information extraction rule. For example, Fig. 9 As shown, the second server fills the characteristic information of the penalty event into the corresponding items to be filled in the penalty event report template based on the extracted characteristic information of the penalty event to obtain the penalty event report.

[0122] In this embodiment, the target event report is automatically generated based on the preset information extraction rules and report templates, reducing the time and cost of manually writing reports. The automated process can process a large amount of data in a short period of time, quickly generate reports to meet urgent needs, and avoid omissions or errors that may be introduced by manual operations.

[0123] It should be understood that, although the steps in the flowcharts involved in the above embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0124] Based on the same inventive concept, the embodiment of the present application also provides a data processing device for implementing the data processing method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in the one or more data processing device embodiments provided below can refer to the limitations on the data processing method above, and will not be repeated here.

[0125] In an exemplary embodiment, Fig.10As shown, a data processing device 1000 is provided, comprising: a task execution module 1001, a transmission module 1002, a storage module 1003 and a push module 1004, wherein:

[0126] The task execution module 1001 is used to execute the preset timed collection task and obtain the target event data set crawled from the information platform;

[0127] The transmission module 1002 is used to encrypt and encapsulate the target event data set, and transmit the encrypted and encapsulated target event data set to the intranet information space through a preset transmission protocol;

[0128] Storage module 1003, used to parse the encrypted and encapsulated target event data set in the intranet information space, and store the decrypted target event data set in the intranet database;

[0129] The push module 1004 is used to generate a push message based on the target event data set in the intranet database and push it to each information recipient.

[0130] In one exemplary embodiment, the task execution module 1001 is specifically used to query the target event list from the information platform based on a preset collection cycle;

[0131] Based on each target event title included in the target event list, the target event data corresponding to each target event title is read in turn, and the target event data set is crawled through a preset crawling algorithm.

[0132] In one exemplary embodiment, the task execution module 1001 is specifically configured to crawl initial target event data corresponding to each target event title in sequence based on each target event title included in the target event list;

[0133] Performing data conversion on the initial target event data based on the text parser to obtain the target event data;

[0134] The target event data is preprocessed and key fields are extracted to obtain the target event data set, which is then stored in the database in the form of structured data.

[0135] In one exemplary embodiment, the transmission module 1002 is specifically configured to read target event data stored in a database based on a preset timing period;

[0136] Identify the event time in the target event data, group the target event data according to the event time, and obtain target event data groups;

[0137] Encrypt and encapsulate each target event data group based on an asymmetric encryption method to obtain encrypted data;

[0138] Based on the preset sending cycle, the encrypted data is sent to the intranet information space via the preset transmission protocol.

[0139] In one exemplary embodiment, the storage module 1003 is specifically used to decrypt the encrypted and encapsulated target event data set in the intranet information space based on a preset asymmetric decryption method;

[0140] The decrypted target event data set is stored in the intranet database; the target event data set is used to generate the target event message.

[0141] In one of the exemplary embodiments, the push module 1004 is specifically configured to generate a push message of a target event based on a target event data set in an intranet database;

[0142] Based on the association between the target event and the information recipient, the push message of the target event is pushed to each information recipient.

[0143] In one exemplary embodiment, the data processing device further includes:

[0144] An acquisition module, configured to acquire a target event data set from an intranet database in response to an event report generation request;

[0145] The generation module is used to extract feature information of a target event data set based on preset information extraction rules, and to generate a target event report based on the feature information and an event report template that matches the information extraction rules.

[0146] Each module in the above data processing device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0147] In an exemplary embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. Fig.11As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store target event data. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a data processing method is implemented.

[0148] Those skilled in the art will understand that Fig.11 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0149] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0150] Execute the preset timed collection task to obtain the target event data set crawled from the information platform;

[0151] Encrypt and encapsulate the target event data set, and transmit the encrypted and encapsulated target event data set to the intranet information space through a preset transmission protocol;

[0152] Parse the encrypted and encapsulated target event data set in the intranet information space, and store the decrypted target event data set in the intranet database;

[0153] Generate push messages based on the target event data set in the intranet database and push them to each information recipient.

[0154] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0155] Based on the preset collection cycle, query the target event list from the information platform;

[0156] Based on each target event title included in the target event list, the target event data corresponding to each target event title is read in turn, and the target event data set is crawled through a preset crawling algorithm.

[0157] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0158] Based on each target event title included in the target event list, crawling the initial target event data corresponding to each target event title in turn;

[0159] Performing data conversion on the initial target event data based on the text parser to obtain the target event data;

[0160] The target event data is preprocessed and key fields are extracted to obtain the target event data set, which is then stored in the database in the form of structured data.

[0161] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0162] Based on a preset timing cycle, read the target event data stored in the database;

[0163] Identify the event time in the target event data, group the target event data according to the event time, and obtain target event data groups;

[0164] Encrypt and encapsulate each target event data group based on an asymmetric encryption method to obtain encrypted data;

[0165] Based on the preset sending cycle, the encrypted data is sent to the intranet information space via the preset transmission protocol.

[0166] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0167] Decrypt the encrypted and encapsulated target event data set in the intranet information space based on the preset asymmetric decryption method;

[0168] The decrypted target event data set is stored in the intranet database; the target event data set is used to generate the target event message.

[0169] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0170] Generate push messages for target events based on the target event dataset in the intranet database;

[0171] Based on the association between the target event and the information recipient, the push message of the target event is pushed to each information recipient.

[0172] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0173] In response to the event report generation request, obtaining a target event data set from an intranet database;

[0174] Based on preset information extraction rules, feature information of the target event data set is extracted, and based on the feature information and an event report template matching the information extraction rules, a target event report is generated.

[0175] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0176] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0177] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0178] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0179] The above embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A data processing method, characterized in that: The method comprises: Execute the preset timed collection task to obtain the target event data set crawled from the information platform; Encrypting and encapsulating the target event data set, and transmitting the encrypted and encapsulated target event data set to the intranet information space through a preset transmission protocol; Parsing the target event data set encrypted and encapsulated in the intranet information space, and storing the decrypted target event data set in an intranet database; A push message is generated based on the target event data set in the intranet database and pushed to each information recipient.

2. The method according to claim 1, characterized in that The execution of the preset timed collection task to obtain the target event data set crawled from the information platform includes: Based on the preset collection cycle, query the target event list from the information platform; Based on each target event title included in the target event list, the target event data corresponding to each target event title is read in turn, and the target event data set is crawled using a preset crawling algorithm.

3. The method according to claim 2, characterized in that The method of sequentially reading target event data corresponding to each target event title based on each target event title included in the target event list and crawling the target event data set by using a preset crawling algorithm includes: Based on each target event title included in the target event list, crawling initial target event data corresponding to each target event title in sequence; Performing data conversion on the initial target event data based on a text parser to obtain target event data; The target event data is subjected to data preprocessing and key field extraction to obtain a target event data set, and the target event data set is stored in a database in a structured data form.

4. The method according to claim 1, characterized in that: The step of encrypting and encapsulating the target event data set, and transmitting the encrypted and encapsulated target event data set to an intranet information space through a preset transmission protocol includes: Based on a preset timing cycle, read the target event data stored in the database; Identifying event times in the target event data, and grouping the target event data according to the event times to obtain target event data groups; Encrypt and encapsulate each target event data group based on an asymmetric encryption method to obtain encrypted data; Based on a preset sending cycle, the encrypted data is sent to the intranet information space via a preset transmission protocol.

5. The method according to claim 1, characterized in that The step of parsing the encrypted and encapsulated target event data set in the intranet information space and storing the decrypted target event data set in an intranet database includes: Decrypting the target event data set encrypted and encapsulated in the intranet information space based on a preset asymmetric decryption method; The decrypted target event data set is stored in an intranet database; the target event data set is used to generate a target event message.

6. The method according to claim 1, characterized in that The generating a push message based on the target event data set in the intranet database and pushing it to each information recipient includes: Based on the target event data set in the intranet database, generating a push message of the target event; Based on the association relationship between the target event and the information recipient, the push message of the target event is pushed to each information recipient.

7. The method according to claim 1, characterized in that The method further comprises: In response to an event report generation request, obtaining the target event data set in the intranet database; Based on preset information extraction rules, feature information of the target event data set is extracted, and based on the feature information and an event report template matching the information extraction rules, a target event report is generated.

8. A data processing device, characterized in that: The device comprises: The task execution module is used to execute the preset timed collection task and obtain the target event data set crawled from the information platform; A transmission module, used to encrypt and encapsulate the target event data set, and transmit the encrypted and encapsulated target event data set to the intranet information space through a preset transmission protocol; A storage module for parsing the target event data set encrypted and encapsulated in the intranet information space and storing the decrypted target event data set in the intranet database; The push module is used to generate a push message based on the target event data set in the intranet database and push it to each information recipient.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images