Data report processing method, device, computer equipment and storage medium

Abstract

The present invention discloses a data report processing method, device, computer equipment and storage medium. The method receives a data report processing instruction; the data report processing instruction includes a report to be processed and a preset label caliber corresponding to the report to be processed; the report to be processed is associated with a report type; the report to be processed is label calculated according to the preset label caliber to obtain a report label value corresponding to the data to be processed, and the report label value is basic checked to obtain a first check result; other data reports with report types other than the report to be processed are obtained, and a second check result corresponding to the other data reports is determined; the report label value is stability checked according to the first check result and the second check result to obtain a stable check result; when the stable check result indicates that the check is successful, a data report is generated according to the report label value and the report to be processed. The present invention improves the accuracy and efficiency of data report generation.

Description

Technical Field

[0001] The present invention relates to the field of data reports, and in particular to a data report processing method, device, computer equipment and storage medium. Background Art

[0002] In many different fields, data is processed through set indicators and then reports are generated for relevant personnel to analyze the data. Since different decision-making directions are involved, the accuracy of data reports is very important.

[0003] In the prior art, the development of data reports is often implemented based on manual filling. However, if errors are found in the set indicators, the data reports need to be modified repeatedly, which results in a long data report development cycle and a high error rate. Summary of the invention

[0004] The embodiments of the present invention provide a data report processing method, device, computer equipment and storage medium to solve the problem of long data report development cycle and high error rate in the prior art.

[0005] A data report processing method, comprising:

[0006] Receive a data report processing instruction; the data report processing instruction includes a report to be processed and a preset label caliber corresponding to the report to be processed; the report to be processed is associated with a report type;

[0007] Performing label calculation on the report to be processed according to the preset label caliber to obtain a report label value corresponding to the data to be processed, and performing basic verification on the report label value to obtain a first verification result;

[0008] Acquire other data reports of the report type other than the report to be processed, and determine a second verification result corresponding to the other data reports;

[0009] Performing stability verification on the report tag value according to the first verification result and the second verification result to obtain a stability verification result;

[0010] When the stability verification result indicates that the verification is successful, a data report is generated according to the report tag value and the report to be processed.

[0011] A data report processing device, comprising:

[0012] An instruction receiving module, used for receiving a data report processing instruction; the data report processing instruction includes a report to be processed and a preset label caliber corresponding to the report to be processed; the report to be processed is associated with a report type;

[0013] A label calculation module, used to perform label calculation on the report to be processed according to the preset label caliber, obtain a report label value corresponding to the data to be processed, and perform basic verification on the report label value to obtain a first verification result;

[0014] A data acquisition module, used for acquiring other data reports of the report type other than the report to be processed, and determining a second verification result corresponding to the other data reports;

[0015] A stability verification module, used for performing stability verification on the report tag value according to the first verification result and the second verification result to obtain a stability verification result;

[0016] The report generation module is used to generate a data report according to the report tag value and the report to be processed when the stability verification result indicates that the verification is successful.

[0017] A computer device comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned data report processing method when executing the computer program.

[0018] A computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the data report processing method is implemented.

[0019] The above-mentioned data report processing method, device, computer equipment and storage medium, the data report processing method first calculates the label through the preset label caliber, so that the logical rules of label calculation can be unified, and the efficiency and accuracy of report label value generation are improved; then the report label value is basic checked, and stability check is performed through other data tables at different time points, thereby realizing double verification of the report label value, improving the accuracy of report label value generation, and then improving the accuracy of data report generation, reducing the time cost between business parties and developers. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.

[0021] Figure 1 is a schematic diagram of an application environment of a data report processing method in one embodiment of the present invention;

[0022] Figure 2 is a flow chart of a data report processing method in one embodiment of the present invention;

[0023] Figure 3 It is a principle block diagram of a data report processing device in one embodiment of the present invention;

[0024] Figure 4 is a schematic diagram of a computer device in one embodiment of the present invention. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0026] The data report processing method provided by the embodiment of the present invention can be applied as follows: Figure 1 Specifically, the data report processing method is applied in a data report processing system, and the data report processing system includes: Figure 1 The client and server shown in the figure communicate with each other through the network to solve the problem of long development time and high error rate of data reports in the prior art. Among them, the client is also called the user end, which refers to the program corresponding to the server and provides local services to customers. The client can be installed on but not limited to various personal computers, laptops, smart phones, tablets and portable wearable devices. The server can be implemented as an independent server or a server cluster composed of multiple servers. Among them, the server can be an independent server or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN), and big data and artificial intelligence platforms.

[0027] In one embodiment, if Figure 2 As shown, a data report processing method is provided, which is applied in Figure 1 The server in the example is used as an example to illustrate the process, including the following steps:

[0028] S10: receiving a data report processing instruction; the data report processing instruction includes a report to be processed and a preset tag caliber corresponding to the report to be processed; the report to be processed is associated with a report type.

[0029] It can be understood that the data report processing instruction can be sent by business personnel through a mobile terminal, or the server can automatically generate it after the business personnel sends the report to be processed and the preset label caliber. The report to be processed is a report waiting for label calculation and label verification. The preset label caliber specifies the logic for calculating the data in the report to be processed (such as summation calculation or deduplication calculation, etc.). The report type refers to the report type of the report to be processed, which can be generated according to the data source of the report to be processed, that is, the report type can characterize the data source of the report to be processed, so that other data reports with this report type can be obtained in step S30, that is, other data reports at different time points can be obtained from the same data source.

[0030] S20: performing label calculation on the report to be processed according to the preset label caliber to obtain a report label value corresponding to the data to be processed, and performing basic verification on the report label value to obtain a first verification result.

[0031] Specifically, after receiving the data report processing instruction, first determine whether there is report data associated with other reports in the report to be processed. When there is report data associated with other reports in the report to be processed, it is necessary to obtain the associated report data from other reports, and then perform label calculation on the report data in the report to be processed and the associated report data corresponding thereto according to the preset label caliber, that is, perform such as summation calculation or deduplication calculation on the report data and the associated report data corresponding thereto, and then obtain the report label value; if there is no report data associated with other reports in the report to be processed, then directly perform label calculation on the report data in the report to be processed according to the preset label caliber, that is, perform such as summation calculation or deduplication calculation on the report data, and then obtain the report label value. Further, after obtaining the report label value, there may be errors in the preset label caliber or the data in the report to be processed, so that there is an error in the report label value, so it is necessary to perform basic verification on the report label value to obtain the first verification result. Among them, basic verification refers to the initial verification based on the business background, data type, etc. of the report to be processed.

[0032] S30: Acquire other data reports of the report type except the report to be processed, and determine a second verification result corresponding to the other data reports.

[0033] It can be understood that for an enterprise or system, the data reports generated at each different time point or time period may be different. Therefore, according to the report type of the report to be processed, other data reports with the report type other than the report to be processed can be obtained. The other data reports can be one or more, and the report generation time corresponding to each other data report is different. The report generation time of each other data report and the report to be processed is also different. In this way, the report tag value of the report to be processed can be verified according to the other data reports generated at different time points or time periods, so as to improve the accuracy of the report tag value generation. Further, the second verification result of the other data report can be obtained according to the method in step S20, that is, other label calibers corresponding to other data reports (other label calibers correspond to preset label calibers, and the other label calibers specify the logic of label calculation for report data in other report data), and then label calculations are performed on other data reports according to other label calibers to obtain other label values, and then basic verification is performed on other label values ​​to obtain the second verification result.

[0034] S40: Performing stability verification on the report tag value according to the first verification result and the second verification result to obtain a stability verification result.

[0035] It can be understood that in the above description, it is pointed out that the report to be processed and other data reports are data reports of the same report type at different time points or different time periods, and then the label value of the report to be processed and the label value of other data reports can be used to determine whether the report label value of the report to be processed is stable, thereby improving the accuracy of determining the report label value. Specifically, after determining the first verification result corresponding to the report to be processed and the second verification result corresponding to each other data report, it is confirmed whether the first verification result and the second verification result are both results representing successful verification. If the first verification result and the second verification result are both results representing successful verification, that is, the report label value representing the report to be processed is initially verified to be accurate, and the other label values ​​corresponding to other data reports are initially verified to be accurate, then the stability verification can be performed on the report label value of the report to be processed and the other label values ​​corresponding to other data reports, such as by determining the difference between the report label value and the other label values, and comparing the difference with a preset difference threshold (the preset difference threshold can be selected according to the application scenario, and when the report label value represents a numerical label such as an exchange rate, the preset difference threshold can be set to 0.1, etc.), to obtain a stable verification result. The stable verification result includes a result indicating a successful verification and a result indicating a failed verification. For example, if the difference between the report tag value and all other tag values ​​is less than or equal to a preset difference threshold, the stable verification result is a result indicating a successful verification; if the difference between the report tag value and any other tag value is greater than the preset difference threshold, the stable verification result is a result indicating a failed verification.

[0036] S50: When the stability verification result indicates that the verification is successful, a data report is generated according to the report tag value and the report to be processed.

[0037] It can be understood that when the stable verification result indicates that the verification is successful, it means that the label value between the report to be processed and other data reports (such as the report label value of the report to be processed) is relatively similar, and then the report label value can be used as the indicator label of the report to be processed, so as to obtain the data report corresponding to the report to be processed.

[0038] In this embodiment, the label is first calculated through the preset label caliber, so that the logical rules of label calculation can be unified, and the efficiency and accuracy of report label value generation are improved; then the report label value is basic checked, and the stability is checked through other data tables at different time points, thereby achieving double verification of the report label value, improving the accuracy of report label value generation, and then improving the accuracy of data report generation, reducing the time cost between business parties and developers.

[0039] In one embodiment, before step S10, that is, before receiving the data report processing instruction, the process further includes:

[0040] Receive a data report preprocessing instruction; the data report preprocessing instruction includes a report name corresponding to the initial processing report and a data source name.

[0041] It can be understood that the initial processing report can be several reports stored in the database of an enterprise or system. An initial processing report corresponds to a report name and a data source name. The report name is also the desc table name, and the data source name indicates the database source of the initial processing report.

[0042] A hive-based report query instruction is executed according to the report name and the data source name to determine whether the initial processed report is empty.

[0043] Specifically, after receiving the data report preprocessing instruction, the report query instruction based on hive (hive is a data warehouse infrastructure tool, which is used to summarize all reports stored in the database of an enterprise or system, thereby providing query functions by generating scripts, that is, the report query instruction generated here) can be executed according to the report name and the data source name, so as to first obtain whether the initial data report exists under the data storage source corresponding to the data source name (the initial data report may be deleted or updated by the staff, resulting in the non-existence of the initial data report). After determining that the initial data report exists, the initial data report can be tested for null values ​​to determine whether there are specific data values ​​in the initial data report. Therefore, there are two main situations in which the initial processing report is empty: the first situation is: the initial processing report cannot be queried according to the data source name; the second situation is: the initial processing report is queried according to the data source name, but the report data in the initial processing report is empty.

[0044] The initial processing report that is not empty is recorded as a basic processing report, and data consistency verification is performed on all initial report data in the initial processing report to obtain a data verification result.

[0045] Specifically, after executing a hive-based report query instruction according to the report name and the data source name to determine whether the initial processing report is empty, when the initial processing report is not empty, the initial processing report that is not empty is recorded as a basic processing report, and all initial report data in the initial processing report are subjected to data consistency verification to obtain a data verification result. Among them, the data consistency verification includes two situations: one of which is that since the basic processing report under the same data source may be generated by data collected at different time points, it is possible to query from different time points (such as day / week / month periodicity) whether the data volume of the corresponding report data of the same type of basic processing report is consistent. Since the source of the collected data is the same, the values ​​of the data collection may be different, but the total amount of the collected data is basically the same; the other situation is that if there is data synchronization between the basic processing reports, it is necessary to verify whether the report data in the two reports before and after the data synchronization are the same.

[0046] When the data verification result indicates that the verification is successful, the basic processing report is recorded as the report to be processed.

[0047] Specifically, after performing data consistency check on all initial report data in the initial processing report and obtaining the data check result, if the data check result indicates that the check is successful, that is, it indicates that the report data in the basic processing report is error-free, the basic processing report is recorded as the report to be processed. In this way, the reports in the database are first screened, so that the report data in the screened report to be processed is accurate, which improves the efficiency and accuracy of data report processing.

[0048] In one embodiment, in step S20, that is, performing a basic check on the report tag value to obtain a first check result, includes:

[0049] A label background rule corresponding to the report to be processed is obtained, and an initial verification is performed on the report label value according to the label background rule to obtain an initial verification result.

[0050] It can be understood that the label background rules are the business calculation rules corresponding to the report to be processed. For example, assuming that the redemption rate needs to be calculated under the redemption data of an activity prize, the redemption rate is the redemption quantity / collection quantity. Therefore, it can be determined that the numerical range of the report label value corresponding to the report to be processed is between 0 and 1. Therefore, the report label value is first initially verified through the label background rules, and the calculation result of the report label value can be initially reviewed in advance to obtain the initial verification result.

[0051] Determine a tag type corresponding to the report tag value, and obtain a preset verification rule corresponding to the tag type.

[0052] The to-be-processed report is subjected to classification verification according to the preset verification rules to obtain a classification verification result.

[0053] It can be understood that the label type may include a classification label, a numerical label or a report statistical value label. The preset verification rules are different verification rules set for different label types. For example, assuming that the label type is a classification label, the preset verification rule may be to count the distribution value of each classification, and then verify according to the distribution value; assuming that the label type is a numerical label, all values ​​are divided into intervals, so as to count the distribution of each interval, and then verify according to the distribution; assuming that the label type is a report statistical value label, the report values ​​at multiple different times can be counted and a report analysis curve can be formed, so as to determine whether there is a sudden change according to the report analysis curve for verification.

[0054] The first verification result is determined according to the initial verification result and the classification verification result.

[0055] Specifically, after determining the initial verification result and the classification verification result corresponding to the report tag value, assuming that the initial verification result and the classification verification result are both results representing successful verification, the first verification result can be determined as a result representing successful verification; assuming that any one of the initial verification result and the classification verification result is a result representing a failure of verification, the first verification result can be determined as a result representing a failure of verification.

[0056] In one embodiment, in step S40, that is, performing stability verification on the report tag value according to the first verification result and the second verification result to obtain a stability verification result, includes:

[0057] Determine whether the first verification result and the second verification result are both successful verification results; the successful verification result means that the first verification result indicates successful verification, or the second verification result indicates successful verification.

[0058] It can be understood that the first verification result and the second verification result include the result of successful verification or the result of failed verification, so the first verification result and the second verification result that represent successful verification are both regarded as successful verification results. Before performing stability verification on the report tag value, it is necessary to ensure that the first verification result and the second verification result corresponding to the basic verification of the report to be processed and other data reports are both the results representing successful verification before performing stability verification.

[0059] When the first verification result and the second verification result are both verification success results, other label values ​​corresponding to the second verification result are obtained.

[0060] It can be understood that other label values ​​correspond to report label values, that is, by following the method in step S20, other label calibers corresponding to other data reports can be obtained (other label calibers correspond to preset label calibers, and the other label calibers specify the logic of label calculation for report data in other report data), and then label calculations are performed on other data reports according to other label calibers to obtain other label values.

[0061] The difference between the report label value and the other label value is recorded as the report label difference.

[0062] A preset difference threshold is obtained, and stability verification is performed on the report label value according to the report label difference and the preset difference threshold to obtain the stability verification result.

[0063] It can be understood that the preset difference threshold can be selected according to the application scenario. When the report tag value represents a numerical tag such as an exchange rate, the preset difference threshold can be set to 0.1, etc. The report tag difference is the difference between the report tag value and other tag values, that is, each other tag value will correspond to a report tag difference, and then the report tag value can be compared with the preset difference threshold. If the difference between the report tag value and all other tag values ​​is less than or equal to the preset difference threshold, then the stability verification result is a result representing a successful verification; if the difference between the report tag value and any other tag value is greater than the preset difference threshold, then the stability verification result is a result representing a failed verification.

[0064] In one embodiment, the stability check of the report to be processed is performed according to the first check result and the second check result, and after obtaining the stability check result, the method further includes:

[0065] When the stability verification result indicates a verification failure, key activity information is obtained.

[0066] Understandably, when the stable verification result indicates verification failure, that is, the tag value between the report to be processed and other data reports (such as the report tag value of the report to be processed) is relatively large, and the reason for the large tag value difference may be: weekends, holidays or activity nodes cause large fluctuations in the tag values ​​between the report to be processed and other data reports at different time points, which in turn causes the stable verification result to be a result indicating verification failure. Key activity information refers to activity information related to the report to be processed (i.e., industry-related) obtained within a certain range of time.

[0067] In one embodiment, the obtaining of key activity information includes:

[0068] Obtain the report industry label corresponding to the report to be processed.

[0069] It can be understood that the report industry label refers to the industry associated with the report to be processed. For example, the report industry label can be the education industry, the financial industry, etc., or when the report to be processed and other data reports are reports of the same enterprise, the report industry label can also be the exclusive activity name of the enterprise, such as xx Golden Week, or xx Promotion Day, etc. Further, the report industry label can be pre-calibrated for the report to be processed by manual marking.

[0070] At least one basic activity information within a preset time range is crawled by crawler technology; one basic activity information is associated with an activity industry tag.

[0071] It can be understood that crawler technology is a technology that obtains information from web pages through programs or scripts. The preset time range can be determined according to the time when the report to be processed is generated, or the time when the data report processing instruction is received. For example, the time when the data report processing instruction is received is March 21, 2022, and then the preset time range can be determined as seven days after the time when the data report processing instruction is received (such as March 22 to March 29, 2022). Basic activity information refers to activity information such as that released by an enterprise or activity information released by different media platforms. Activity industry tags are used to characterize industry information of basic activity information. For example, activity industry tags can be education industry, financial industry, etc. Furthermore, the activity industry label can be determined by performing entity recognition on the basic activity information, such as identifying the industry entity in the basic activity information, and then extracting the text information corresponding to the industry entity, so as to determine the activity industry label corresponding to the basic activity information based on the text information; illustratively, assuming that a basic activity information is "the financial market ushers in a super week, and the golden week begins to stabilize", the identifiable entity is "finance", and the activity industry label is determined to be the financial industry label; or the basic activity information is "Double Eleven is coming, and the e-commerce war is about to begin", the identifiable entity is "e-commerce", and the activity industry label is determined to be the e-commerce industry label.

[0072] The report industry tag is matched with the activity industry tag.

[0073] Specifically, after crawling at least one basic activity information within a preset time range by using crawler technology, the report industry label can be matched with each activity industry label one by one.

[0074] The activity industry tag matching the report industry tag is recorded as a key industry tag, and the basic activity information associated with the key industry tag is recorded as the key activity information.

[0075] Specifically, after matching the report industry tag with the activity industry tag, the activity industry tag matching the report industry tag can be determined as the key industry tag, and then the basic activity information associated with the key industry tag can be determined as the key activity information.

[0076] A label prediction is performed on the report label value according to the key activity information to obtain a label prediction result corresponding to the report label value.

[0077] Specifically, after obtaining key activity information, it can be determined whether the key activity information has an impact on the report tag value, such as a positive impact, a negative impact, or no impact. For example, when there are festivals such as promotion days and activity days, the report tag value may have a sudden increase at a certain time point or time range; or when there is information such as reducing the intensity of activities and raising commodity prices, the report tag value may have a sudden decrease at a certain time point or time range; or when there is information such as maintaining the current industry's stable progress, the report tag value tends to be stable within a period of time. Then, the change trend of the report tag value can be predicted based on the key activity information to obtain the tag prediction result. Among them, the tag prediction result is the prediction result of the tag value trend of the report tag value, such as the phenomenon that the report tag value may increase or decrease suddenly.

[0078] In one embodiment, the step of performing label prediction on the report label value according to the key activity information to obtain a label prediction result corresponding to the report label value includes:

[0079] Entity recognition and intent feature extraction are performed on the key activity information to obtain entity recognition results and intent extraction results.

[0080] It can be understood that entity recognition is the process of extracting entities from key activity information, so as to determine the industry to which the key activity information belongs based on the entity recognition results. Intent feature extraction is the process of extracting action intentions from key activity information, so as to perform sentiment analysis based on the intent extraction results and entity recognition results.

[0081] Specifically, after obtaining the key activity information, the key activity information can be segmented to obtain multiple key activity words corresponding to the key activity information; then, entity recognition can be performed on each key activity word according to a preset word vector dictionary to obtain an entity recognition result; then, according to a preset intent definition tree, each key activity word and the entity recognition result, intent recognition can be performed on the key activity information to obtain an intent extraction result corresponding to the entity recognition result. Among them, the word segmentation processing is a method of dividing the key activity information into words, such as word segmentation processing can be performed by methods such as stuttering word segmentation and natural language model word segmentation.

[0082] Furthermore, the preset word vector dictionary is a dictionary that stores words and their corresponding word vectors after various words are converted into word vectors in advance. That is, at least one word and the word vector corresponding to the word are stored in the preset word vector dictionary, so that the word vector corresponding to the key active word can be queried in the preset word vector dictionary, and then entity recognition is performed according to the corresponding word vector through a recognition model based on BERT or a recognition model based on ALBERT to obtain an entity recognition result.

[0083] Furthermore, the preset intent definition tree is constructed after pre-collecting a number of intent features and classifying the collected intents (such as according to the category of intent, the emotion of intent, etc.). After determining the entity recognition results corresponding to each key activity word, the industry entity and the execution subject entity can be determined according to the entity recognition results corresponding to each key activity word, and then the key activity words are labeled according to the industry entity and the execution subject entity to obtain the labeled activity information, and the labeled activity information is input into the preset intent definition tree to perform intent recognition on the labeled activity information through the preset intent definition tree to obtain the intent extraction result. Exemplarily, assuming that the key activity information is "XX Department promotes the vigorous development of e-sports platform", the corresponding execution subject entity is "XX Department", then after labeling the "XX Department" with the execution subject entity, the preset intent definition tree can identify the intent features in the labeled activity information as "promote" and "vigorously develop", so that the corresponding intent extraction result can be obtained.

[0084] Perform sentiment analysis on the key activity information according to the entity recognition result and the intention extraction result to obtain an activity sentiment result corresponding to the key activity information.

[0085] Specifically, after performing entity recognition and intention feature extraction on key activity information to obtain entity recognition results and intention extraction results, sentiment analysis is performed on the key activity information based on the entity recognition results and intention extraction results, that is, determining the impact of the intention extraction results on the entity recognition results, and obtaining activity sentiment results. In this embodiment, the activity sentiment results mainly include positive sentiment and negative sentiment, and can also be neutral sentiment.

[0086] The report label value is predicted according to the activity emotion result to obtain the label prediction result.

[0087] Specifically, after performing sentiment analysis on the key activity information based on the entity recognition results and the intent extraction results to obtain the activity sentiment results corresponding to the key activity information, label prediction can be performed on the report label value based on the activity sentiment results to obtain label prediction results. Exemplarily, assuming that the activity sentiment result is a positive sentiment, it can be predicted that the report label value will have a sudden increase at a certain time point or within a certain time range; assuming that the activity sentiment result is a negative sentiment, it can be predicted that the report label value will have a sudden decrease at a certain time point or within a certain time range; assuming that the activity sentiment result is a neutral sentiment, it can be predicted that the report label value will have a small change at a certain time point or within a certain time range.

[0088] The stability verification result is adjusted according to the label prediction result to obtain an adjusted verification result.

[0089] Specifically, after label prediction is performed on the report label value according to the key activity information and the label prediction result corresponding to the report label value is obtained, the impact of the key activity information on the report label value within a certain time range can be determined based on the label prediction result, and other data reports are also reports corresponding to the report to be processed at different time points within a certain time range. For example, the report collected on the first day of the week is regarded as the report to be processed, and the reports collected on the remaining six days are regarded as other data reports. In this way, the stable verification result can be adjusted according to the label prediction result to obtain an adjusted verification result. For example, in the stable verification result, it is found that the label value of other data reports suddenly increases at a certain moment, and the label prediction result indicates that the report label value may increase suddenly at a certain point in time due to the positive emotional influence of the key activity information. At this time, it can be determined that the adjusted verification result indicates that the report label value verification is successful.

[0090] When the adjustment verification result indicates that the verification is successful, a data report is generated according to the report tag value and the report to be processed.

[0091] Specifically, when the adjustment verification result indicates that the verification is successful, that is, the label value between the report to be processed and other data reports (such as the report label value of the report to be processed) is still similar, but because some activity information has an impact on the label value at a certain point in time, the report label value can be used as the indicator label of the report to be processed, thereby obtaining a data report corresponding to the report to be processed.

[0092] It should be understood that the order of execution of the steps in the above embodiment does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention.

[0093] In one embodiment, a data report processing device is provided, and the data report processing device corresponds one-to-one to the data report processing method in the above embodiment. Figure 3 As shown, the data report processing device includes an instruction receiving module 10, a label calculation module 20, a data acquisition module 30, a stability verification module 40 and a report generation module 50. The functional modules are described in detail as follows:

[0094] The instruction receiving module 10 is used to receive a data report processing instruction; the data report processing instruction includes a report to be processed and a preset label caliber corresponding to the report to be processed; the report to be processed is associated with a report type;

[0095] The label calculation module 20 is used to perform label calculation on the report to be processed according to the preset label caliber to obtain a report label value corresponding to the data to be processed, and perform basic verification on the report label value to obtain a first verification result;

[0096] The data acquisition module 30 is used to acquire other data reports of the report type other than the report to be processed, and determine a second verification result corresponding to the other data reports;

[0097] A stability verification module 40, configured to perform stability verification on the report tag value according to the first verification result and the second verification result to obtain a stability verification result;

[0098] The report generation module 50 is used to generate a data report according to the report tag value and the report to be processed when the stability verification result indicates that the verification is successful.

[0099] Preferably, the data report processing device also includes:

[0100] A report data acquisition module, used to receive a data report preprocessing instruction; the data report preprocessing instruction includes a report name and a data source name corresponding to the initial processing report;

[0101] A query instruction execution module, used to execute a hive-based report query instruction according to the report name and the data source name to determine whether the initial processing report is empty;

[0102] A data consistency check module is used to record the initial processing report that is not empty as a basic processing report, and perform data consistency check on all report data in the basic processing report to obtain a data check result;

[0103] The report recording module is used to record the basic processing report as the report to be processed when the data verification result indicates that the verification is successful.

[0104] Preferably, the tag calculation module 20 includes:

[0105] An initial verification unit, used for obtaining a label background rule corresponding to the report to be processed, and performing an initial verification on the report to be processed according to the label background rule to obtain an initial verification result;

[0106] A tag type determination unit, used to determine the tag type corresponding to the report tag value, and obtain a preset verification rule corresponding to the tag type;

[0107] A classification verification unit, used to perform classification verification on the report to be processed according to the preset verification rule to obtain a classification verification result;

[0108] A verification result determining unit is used to determine the first verification result according to the initial verification result and the classified verification result.

[0109] Preferably, the stability verification module 40 includes:

[0110] A result determination unit, used to determine whether the first verification result and the second verification result are both successful verification results; the successful verification result means that the first verification result indicates successful verification, or the second verification result indicates successful verification;

[0111] a label value acquisition unit, configured to acquire other label values ​​corresponding to the second verification result when both the first verification result and the second verification result are verification success results;

[0112] A difference calculation unit, used for recording the difference between the report label value and the other label value as a report label difference;

[0113] The stability verification unit is used to obtain a preset difference threshold, and perform stability verification on the report label value according to the report label difference and the preset difference threshold to obtain the stability verification result.

[0114] Preferably, the data report processing device also includes:

[0115] An information acquisition module, used for acquiring key activity information when the stability verification result indicates a verification failure;

[0116] A label prediction module, used to perform label prediction on the report label value according to the key activity information, and obtain a label prediction result corresponding to the report label value;

[0117] A result adjustment module, used to adjust the stability verification result according to the label prediction result to obtain an adjusted verification result;

[0118] The report adjustment module is used to generate a data report according to the report tag value and the report to be processed when the adjustment verification result indicates that the verification is successful.

[0119] Preferably, the information acquisition module includes:

[0120] A label acquisition unit, used to acquire a report industry label corresponding to the report to be processed;

[0121] An information crawling unit, used to crawl at least one basic activity information within a preset time range by using crawler technology; one basic activity information is associated with an activity industry tag;

[0122] A label matching unit, used for matching the report industry label with the activity industry label;

[0123] The tag recording unit is used to record the activity industry tag matching the report industry tag as a key industry tag, and record the basic activity information associated with the key industry tag as the key activity information.

[0124] Preferably, the label prediction module includes:

[0125] An identification and extraction unit, used to perform entity identification and intention feature extraction on the key activity information to obtain entity identification results and intention extraction results;

[0126] A sentiment analysis unit, configured to perform sentiment analysis on the key activity information according to the entity recognition result and the intention extraction result, to obtain an activity sentiment result corresponding to the key activity information;

[0127] The label prediction unit is used to perform label prediction on the report label value according to the activity emotion result to obtain the label prediction result.

[0128] The specific definition of the data report processing device can be found in the definition of the data report processing method above, which will not be repeated here. Each module in the above-mentioned data report processing device can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0129] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Figure 4As shown. The computer device includes a processor, a memory, a network interface and a database connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used for the data used by the data report processing method in the above embodiment. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a data report processing method is implemented.

[0130] In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the data report processing method in the above embodiment is implemented.

[0131] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the data report processing method in the above embodiment is implemented.

[0132] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0133] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above.

[0134] The embodiments described above are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included in the protection scope of the present invention.

Claims

1. A data report processing method, characterized in that: include: Receive a data report processing instruction; the data report processing instruction includes a report to be processed and a preset label caliber corresponding to the report to be processed; the report to be processed is associated with a report type; Performing label calculation on the report to be processed according to the preset label caliber to obtain a report label value corresponding to the report to be processed, and performing basic verification on the report label value to obtain a first verification result; Acquire other data reports of the report type other than the report to be processed, and determine a second verification result corresponding to the other data reports; Performing stability verification on the report tag value according to the first verification result and the second verification result to obtain a stability verification result; When the stability verification result indicates that the verification is successful, a data report is generated according to the report tag value and the report to be processed; The basic verification of the report tag value to obtain a first verification result includes: Acquire the label background rule corresponding to the report to be processed, and perform an initial verification on the report label value according to the label background rule to obtain an initial verification result; Determine a tag type corresponding to the report tag value, and obtain a preset verification rule corresponding to the tag type; Performing classification verification on the report to be processed according to the preset verification rules to obtain classification verification results; Determining the first verification result according to the initial verification result and the classification verification result; The performing stability verification on the report tag value according to the first verification result and the second verification result to obtain a stability verification result includes: Determining whether the first verification result and the second verification result are both successful verification results; the successful verification result means that the first verification result indicates successful verification, or the second verification result indicates successful verification; When both the first verification result and the second verification result are verification success results, obtaining other label values ​​corresponding to the second verification result; Recording the difference between the report label value and the other label value as the report label difference; A preset difference threshold is obtained, and stability verification is performed on the report label value according to the report label difference and the preset difference threshold to obtain the stability verification result.

2. The data report processing method according to claim 1, characterized in that: Before receiving the data report processing instruction, the method further includes: Receive a data report preprocessing instruction; the data report preprocessing instruction includes a report name and a data source name corresponding to the initial processing report; Execute a hive-based report query instruction according to the report name and the data source name to determine whether the initial processing report is empty; Recording the initial processing report that is not empty as a basic processing report, and performing data consistency verification on all report data in the basic processing report to obtain a data verification result; When the data verification result indicates that the verification is successful, the basic processing report is recorded as the report to be processed.

3. The data report processing method according to claim 1, characterized in that: After performing stability verification on the report tag value according to the first verification result and the second verification result to obtain a stability verification result, the method further includes: When the stability verification result indicates a verification failure, obtaining key activity information; Performing label prediction on the report label value according to the key activity information to obtain a label prediction result corresponding to the report label value; Adjusting the stability verification result according to the label prediction result to obtain an adjusted verification result; When the adjustment verification result indicates that the verification is successful, a data report is generated according to the report tag value and the report to be processed.

4. The data report processing method according to claim 3, characterized in that: The key activity information is obtained, including: Obtain a report industry label corresponding to the report to be processed; Crawling at least one basic activity information within a preset time range by crawling technology; one basic activity information is associated with an activity industry tag; Matching the report industry tag with the activity industry tag; The activity industry tag matching the report industry tag is recorded as a key industry tag, and the basic activity information associated with the key industry tag is recorded as the key activity information.

5. The data report processing method according to claim 3, characterized in that: The step of performing label prediction on the report label value according to the key activity information to obtain a label prediction result corresponding to the report label value includes: Performing entity recognition and intention feature extraction on the key activity information to obtain entity recognition results and intention extraction results; Performing sentiment analysis on the key activity information according to the entity recognition result and the intention extraction result to obtain an activity sentiment result corresponding to the key activity information; The report label value is predicted according to the activity emotion result to obtain the label prediction result.

6. A data report processing device, characterized in that: The data report processing device is used to execute the data report processing method according to any one of claims 1 to 5, and the data report processing device includes: An instruction receiving module, used for receiving a data report processing instruction; the data report processing instruction includes a report to be processed and a preset label caliber corresponding to the report to be processed; the report to be processed is associated with a report type; A label calculation module, used to perform label calculation on the report to be processed according to the preset label caliber, obtain a report label value corresponding to the report to be processed, and perform basic verification on the report label value to obtain a first verification result; A data acquisition module, used to acquire other data reports of the report type other than the report to be processed, and determine a second verification result corresponding to the other data reports A stability verification module, used for performing stability verification on the report tag value according to the first verification result and the second verification result to obtain a stability verification result; The report generation module is used to generate a data report according to the report tag value and the report to be processed when the stability verification result indicates that the verification is successful.

7. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the data report processing method according to any one of claims 1 to 5 is implemented.

8. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the data report processing method according to any one of claims 1 to 5 is implemented.

Images