Flow data quality verification method, device, electronic equipment and storage medium

Abstract

The present application relates to the field of data analysis technology, and provides a flow data quality verification method, device, electronic device and storage medium, the method comprising: obtaining the verification subject of flow data and the business needs of users, the verification subject including the activity page and / or user behavior; using the verification subject and business needs to design corresponding verification objects; wherein, the verification objects corresponding to the activity page include: browsing page, page object, and the verification objects corresponding to the user behavior include: user identity, user source, user destination and interactive behavior; the page object is the corresponding operable object in the browsing page, and the interactive behavior is the user's operation behavior on the browsing page; based on the designed verification object, the verification rules are determined, and the flow data is quality verified based on the verification rules. In this way, the verification of each subject participating in the activity can be comprehensively considered to ensure that all aspects of the flow data quality can be checked and the accuracy of the inspection can be improved.

Description

Technical Field

[0001] The present application relates to the field of data analysis technology, and in particular to a flow data quality verification method, device, electronic device and storage medium. Background Art

[0002] With the rapid development of computer technology, monitoring terminals can obtain traffic data from multiple ports of network access devices in real time, and detect the quality of traffic data from the acquired traffic data, so as to monitor user page behavior and understand user preferences for activity elements. Among them, traffic data is generated based on page tracking, which is usually implemented by developers.

[0003] In the prior art, a flow threshold range set by a user based on experience is stored in a monitoring terminal. After obtaining flow data, the monitoring terminal can determine whether the obtained flow data is within the flow threshold range for quality detection.

[0004] However, the above detection method is only a data check from a data perspective, and the accuracy of the flow data check is low. Summary of the invention

[0005] The present application provides a flow data quality verification method, device, electronic device and storage medium, which can comprehensively consider the verification of various entities participating in the activity, ensure that all aspects of the flow data quality can be checked, and improve the accuracy of the inspection.

[0006] In a first aspect, the present application provides a flow data quality verification method, the method comprising:

[0007] Obtain the verification subject of traffic data and the business needs of users, wherein the verification subject includes active pages and / or user behaviors;

[0008] The corresponding inspection objects are designed using the inspection subject and the business requirements; wherein the inspection objects corresponding to the activity page include: browsing page and page object, and the inspection objects corresponding to the user behavior include: user identity, user source, user destination and interactive behavior; the page object is the corresponding operable object in the browsing page, and the interactive behavior is the user's operation behavior on the browsing page;

[0009] The verification rules are determined based on the designed verification object, and the quality of the flow data is verified based on the verification rules.

[0010] Optionally, designing a corresponding verification object using the verification subject and the business requirement includes:

[0011] Using the verification subject to identify the required verification object;

[0012] The priorities of the required inspection objects are obtained based on the business requirements, and the types of inspection objects and the amount of required detection traffic data corresponding to each inspection object are determined based on the priorities.

[0013] Optionally, the verification rules are determined based on the verification object of the design, including:

[0014] Based on the types of the verification objects and the number of required detection traffic data corresponding to each verification object, the verification dimensions that meet the business needs are determined, and the verification dimensions include: integrity, consistency, existence, validity and transparency; the integrity is used to check whether the records of traffic data are complete; the consistency is used to check whether the records of traffic data are consistent with the data in the predefined document; the existence is used to check whether the records in the traffic data exist; the validity is used to check whether the records in the traffic data have abnormalities or error information; the transparency is used to check whether the records in the traffic data exist on all browsing pages;

[0015] A verification rule is formed according to the verification dimension, and a verification indicator in the verification rule is obtained; the verification indicator is used to perform quality verification on the flow data.

[0016] Optionally, forming a verification rule according to the verification dimension includes:

[0017] Obtaining an application scenario corresponding to the business requirement, and obtaining a verification indicator and a quantity of verification indicators corresponding to each verification dimension based on the application scenario;

[0018] A corresponding algorithm is selected based on the number of detection indicators, and the algorithm is used to process the inspection indicators corresponding to each inspection dimension to obtain inspection rules.

[0019] Optionally, performing quality check on the flow data based on the check rule includes:

[0020] Obtaining flow data in a flow table and extracting a test field in the flow data; the flow table is used to store data collected by embedding points in a browsing page;

[0021] The inspection field is inspected using the inspection indicator in the inspection rule to detect whether the flow data is abnormal.

[0022] Optionally, the method further includes:

[0023] After detecting the abnormality of the traffic data, obtaining a page identity ID corresponding to the abnormal traffic data;

[0024] The corresponding browsing page is found based on the page ID, and the buried point data corresponding to the browsing page is obtained, and the buried point data is fed back to the developer's terminal device so that the developer can re-bury the point based on the buried point data.

[0025] Optionally, the method further includes:

[0026] Obtain the results of the quality check within a preset time, and summarize and count the flow data containing abnormalities in the results to obtain a summary result;

[0027] The summary results are processed by quality trend visualization analysis to obtain processing results, and the processing results are sent to the terminal device of the developer.

[0028] In a second aspect, the present application provides a flow data quality checking device, the device comprising:

[0029] An acquisition module, used to acquire the verification subject of the traffic data and the business needs of the user, wherein the verification subject includes the activity page and / or the user behavior;

[0030] A design module is used to design corresponding verification objects using the verification subject and the business requirements; wherein the verification objects corresponding to the activity page include: browsing page and page object, and the verification objects corresponding to the user behavior include: user identity, user source, user destination and interactive behavior; the page object is the corresponding operable object in the browsing page, and the interactive behavior is the user's operation behavior on the browsing page;

[0031] The checking module is used to determine the checking rules based on the designed checking object, and perform quality checking on the flow data based on the checking rules.

[0032] In a third aspect, the present application provides an electronic device comprising: a processor, a memory, and a computer program; wherein the computer program is stored in the memory and is configured to be executed by the processor, and the computer program includes instructions for executing a flow data quality verification method as described in any one of the first aspects.

[0033] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, they are used to implement the method as described in any one of the first aspects.

[0034] In a fifth aspect, the present application provides a computer program product, comprising a program code. When a computer runs the computer program, the program code executes the method as described in any one of the first aspects.

[0035] In summary, the present application provides a method, device, electronic device and storage medium for checking the quality of flow data, which can obtain the checking subject of flow data and the business needs of users, and the checking subject includes the activity page and / or user behavior; further, the checking subject and business needs are used to design corresponding checking objects; wherein, the checking objects corresponding to the activity page include: browsing page, page object, and the checking objects corresponding to the user behavior include: user identity, user source, user destination and interactive behavior; the page object is the corresponding operable object in the browsing page, and the interactive behavior is the user's operation behavior on the browsing page; and then the checking rules can be determined based on the designed checking objects, and the flow data can be quality checked based on the checking rules. In this way, the present application starts from the business perspective of activity operation, designs business checking subjects and objects, business checking rules, and verifies from the data perspective, comprehensively considers the verification of each subject participating in the activity, ensures that all aspects of data quality can be checked, and improves the accuracy of the inspection. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0037] Figure 1 A schematic diagram of an application scenario provided for an embodiment of the present application;

[0038] Figure 2 A flow chart of a flow data quality checking method provided in an embodiment of the present application;

[0039] Figure 3 A schematic diagram of a flow data quality check framework provided in an embodiment of the present application;

[0040] Figure 4 A schematic diagram of the structure of a design verification rule provided in an embodiment of the present application;

[0041] Figure 5 A schematic diagram of a design verification indicator flow chart provided in an embodiment of the present application;

[0042] Figure 6 A schematic diagram of a page verification interface provided in an embodiment of the present application;

[0043] Figure 7 A schematic diagram of the structure of a flow data quality check device provided in an embodiment of the present application;

[0044] Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0045] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0046] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0047] In order to facilitate the clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words "first", "second" and the like are used to distinguish the same items or similar items with substantially the same functions and effects. For example, the first device and the second device are only used to distinguish different devices, and their order is not limited. Those skilled in the art can understand that the words "first", "second" and the like do not limit the quantity and execution order, and the words "first", "second" and the like do not necessarily limit them to be different.

[0048] It should be noted that, in this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in this application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0049] In the present application, "at least one" means one or more, and "plurality" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.

[0050] The embodiments of the present application are introduced below with reference to the accompanying drawings. Figure 1A schematic diagram of an application scenario provided in an embodiment of the present application. A flow data quality check method provided in the present application can be applied to the following examples: Figure 1 In the application scenario shown. The application scenario includes: a first terminal device 101 of a user, a business platform 102, and a second terminal device 103 of a developer; specifically, a user can participate in online marketing activities, such as lucky draw activities, through the first terminal device 101. Based on the user's touch operation on the activity page in the first terminal device 101, such as clicking on the lucky draw and canceling operations, corresponding traffic data can be generated. The traffic data is generated based on the page embedding on the activity page, and the page embedding is usually designed by the developer through the second terminal device 103. Further, the first terminal device 101 can send the generated traffic data to the business platform 102 for processing. The business platform 102 can understand the user's preference for the activity elements based on the traffic data generated by the first terminal device 101. Since the traffic data generated based on the page embedding usually has manual errors, resulting in inaccurate traffic data, and accurate traffic data is the cornerstone of understanding user behavior, the business platform 102 can also perform quality inspection on the traffic data to determine the problems with the traffic data, and then feedback to the second terminal device 103 of the developer, so that the developer can use the second terminal device 103 to re-embed the points based on the problem.

[0051] The above-mentioned terminal equipment can be a wireless terminal or a wired terminal. The wireless terminal can be a device that provides voice and / or other business data connectivity to users, a handheld device with wireless connection function, or other processing equipment connected to a wireless modem. The wireless terminal can communicate with one or more core network devices via a radio access network (Radio Access Network, referred to as RAN). The wireless terminal can be a mobile terminal, such as a mobile phone (or "cellular" phone) and a computer with a mobile terminal. For example, it can be a portable, pocket-sized, handheld, computer-built-in or vehicle-mounted mobile device that exchanges language and / or data with the radio access network. For another example, the wireless terminal can also be a personal communication service (Personal Communication Service, referred to as PCS) phone, a cordless phone, a Session Initiation Protocol (Session Initiation Protocol, referred to as SIP) phone, a wireless local loop (Wireless Local Loop, referred to as WLL) station, a personal digital assistant (Personal Digital Assistant, referred to as PDA) and other devices. The wireless terminal may also be referred to as a system, a subscriber unit, a subscriber station, a mobile station, a mobile station, a remote station, a remote terminal, an access terminal, a user terminal, a user agent, a user device or user equipment, without limitation. Optionally, the terminal device may also be a smart watch, a tablet computer or other device.

[0052] In one possible implementation, the quality check of the traffic data can be determined based on the traffic threshold range set by the user based on experience and stored in the monitoring terminal. After the traffic data is obtained, the monitoring terminal can determine whether the obtained traffic data is within the traffic threshold range for quality detection.

[0053] However, the above detection method is only a data check from a data perspective, and the accuracy of the flow data check is low.

[0054] In response to the above problems, the present application provides a traffic data quality verification method, which can comprehensively consider the activity page and user behavior according to the business needs in the actual activity operation, design the business verification subject and verification object, and business verification rules from the business perspective of the activity operation, and conduct verification from the data perspective, comprehensively consider the verification of each subject participating in the activity, ensure that all aspects of data quality can be checked, and improve the accuracy of the inspection.

[0055] The technical solution of the present application is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0056] Figure 2 A flow chart of a flow data quality checking method provided in an embodiment of the present application is shown as follows: Figure 2 As shown, the flow data quality checking method includes the following steps:

[0057] S201. Obtain a verification subject of traffic data and a user's business needs, wherein the verification subject includes an activity page and / or user behavior.

[0058] In an embodiment of the present application, traffic data may refer to the user's behavior record data on the activity series pages in the terminal device, such as browsing records, click records, exit records and other data; the verification subject includes the activity page and / or user behavior, and the determination of the verification subject can be based on the application scenario or manual setting. For example, in a certain application scenario, only traffic data related to the activity page or only traffic data related to user behavior can be collected, or, in a specific scenario, traffic data related to both the activity page and user behavior can be collected.

[0059] Among them, the activity page may refer to a series of pages browsed by the user in the terminal device based on the online marketing activity, and the user behavior may refer to the user's operations on the activity page in the terminal device based on the online marketing activity and the basic information of the user.

[0060] In this step, the business requirements of the user are obtained, and the business requirements are used to determine the priorities corresponding to the inspection objects that need to be inspected. Under the priorities, the number of active pages and user behaviors that need to be inspected can be limited.

[0061] S202. Design corresponding verification objects using the verification subject and the business requirements; wherein, the verification objects corresponding to the active page include: browsing page, page object, and the verification objects corresponding to the user behavior include: user identity, user source, user destination, and interactive behavior; the page object is the corresponding operable object in the browsing page, and the interactive behavior is the user's operating behavior on the browsing page.

[0062] In the embodiment of the present application, the inspection object may refer to the object of traffic data inspection, including the inspection object corresponding to the active page and the inspection object corresponding to the user behavior; since the browsing page is composed of the page frame and the objects in the page, the inspection object corresponding to the active page includes the browsing page and the operable objects on the browsing page, such as the corresponding buttons and pop-up windows on the browsing page; and the user's journey in a marketing campaign is based on the touch operation to jump from one browsing page to another, browse and interact with page objects, until exiting the browsing page, so the inspection object corresponding to the user behavior includes user identity, user source, user destination and interactive behavior, etc., and the user identity is used to identify the user's identity information, such as the user identity identification number (Identity The user origin is information for identifying where the user comes from, such as the Internet Protocol (IP) address corresponding to the user. The user destination is used to identify the user's behavioral journey. The behavioral journey may refer to a series of sequential behaviors of the user on an activity series page, such as the user's behavior of entering page 1 of a terminal device based on a browsing or clicking operation, the behavior of entering page 2 (based on a browsing or clicking operation), the behavior of entering page 3 (based on a browsing or clicking operation), ..., the behavior of entering page N (based on a browsing or clicking operation); the interactive behavior is the user's operation behavior on the browsing page, such as a clicking operation, a swiping operation, etc.

[0063] Exemplarily, if it is determined that the inspection subjects of traffic data are active pages and user behaviors, then further, the inspection objects can be circled, such as browsing pages, buttons on browsing pages, user identities, user sources and interactive behaviors. Further, based on business needs, the priority corresponding to each inspection object is obtained, the browsing page corresponds to the priority level one, the button on the browsing page corresponds to the priority level two, the user identity corresponds to the priority level four, the user source corresponds to the priority level five and the interactive behavior corresponds to the priority level three. Further, the inspection objects with the top three priorities are determined to be the designed inspection objects, then the top three inspection objects are browsing pages, buttons on browsing pages and interactive behaviors.

[0064] It should be noted that a browse page refers to a series of browse pages, which can also be called a page series.

[0065] S203: Determine verification rules based on the designed verification object, and perform quality verification on the flow data based on the verification rules.

[0066] In an embodiment of the present application, the verification rule may refer to a traffic data verification rule designed according to the business concerns in the business scenario. Different verification objects correspond to different verification rules. For example, if the verification object is a browsing page, the corresponding verification rule may be whether the browsing page exists in the traffic table, or whether the name of the browsing page in the traffic table is consistent with the page mapping document. The traffic table is used to store a series of traffic data generated by the user's active page on the terminal device and the user behavior data corresponding to the user. The page mapping document is a document given in advance, and the buried data of all browsing pages are stored in the document.

[0067] Exemplarily, taking the designed inspection objects as browsing pages, buttons on browsing pages and interactive behaviors as an example, the inspection rules determined based on the inspection objects include Rule 1, Rule 2 and Rule 3. Rule 1 is used to inspect the traffic data corresponding to the browsing pages, Rule 2 is used to inspect the traffic data corresponding to the buttons on the browsing pages, and Rule 3 is used to inspect the traffic data corresponding to the interactive behaviors. Furthermore, based on Rule 1, Rule 2 and Rule 3, the corresponding traffic data is quality inspected to determine whether there is a problem with the traffic data.

[0068] Therefore, the present application provides a method for checking the quality of traffic data, which can obtain the checking subject of traffic data and the business needs of users, and the checking subject includes the activity page and / or user behavior; further, the checking subject and business needs are used to design corresponding checking objects; wherein, the checking objects corresponding to the activity page include: browsing page, page object, and the checking objects corresponding to the user behavior include: user identity, user source, user destination and interactive behavior; the page object is the corresponding operable object in the browsing page, and the interactive behavior is the user's operating behavior on the browsing page; and then the checking rules can be determined based on the designed checking objects, and the quality of the traffic data can be checked based on the checking rules. In this way, the checking of various subjects participating in the activity, such as the activity page and user behavior, can be comprehensively considered, thereby ensuring that all aspects of data quality can be checked, which greatly improves the accuracy of the inspection compared to scattered activity buried point data or data verification from a data perspective.

[0069] It should be noted that this application can not only perform quality checks on traffic data generated by specific marketing online activities, but also can perform quality checks on traffic data generated during the activity development process.

[0070] Optionally, designing a corresponding verification object using the verification subject and the business requirement includes:

[0071] Using the verification subject to identify the required verification object;

[0072] The priorities of the required inspection objects are obtained based on the business requirements, and the types of inspection objects and the amount of required detection traffic data corresponding to each inspection object are determined based on the priorities.

[0073] In this step, the priority is the level information designed to determine the importance of the inspection object. Under different business needs, the priority of the required inspection object is different, that is, different inspection objects can be designed for different application scenarios. The priority is also used to determine the number of required detection traffic data corresponding to each inspection object. For example, the traffic data corresponding to 40 browsing pages only needs to detect the traffic data corresponding to 30 of them. The embodiment of the present application does not specifically limit the level of priority design of the inspection object and the number of required detection traffic data corresponding to each inspection object. It is set according to business needs, and the above is only an example.

[0074] Therefore, the embodiment of the present application can determine the priority based on the business needs, and then determine the verification object, select the appropriate verification object, and reduce the waste of resources.

[0075] Since each verification object can correspond to different verification dimensions, the verification dimensions of the business verification subject can be further designed; for example, Figure 3 A schematic diagram of a flow data quality check framework provided in an embodiment of the present application; Figure 3 As shown, the traffic data quality verification framework includes a verification subject, a verification object and a verification dimension; the verification subject includes an active page and a user (user behavior), and the verification objects corresponding to the active page include: page series, page objects, and the verification objects corresponding to the user include: user subject (user identity), user source, user destination and interactive behavior. Each verification object can be designed with at least one verification dimension, and the verification dimensions include consistency, integrity, validity, existence, transparency, etc., wherein the verification dimension may also include other characteristics, such as timeliness, etc., which are not specifically limited in the embodiments of the present application.

[0076] It is understandable that under this framework, applicable verification dimensions of the verification object can be designed to form verification rules. Corresponding verification indicators and how to develop and configure indicators can also be sorted out based on the verification rules.

[0077] Optionally, the verification rules are determined based on the verification object of the design, including:

[0078] Based on the types of the verification objects and the number of required detection traffic data corresponding to each verification object, the verification dimensions that meet the business needs are determined, and the verification dimensions include: data integrity, consistency, existence, validity and transparency; the integrity is used to check whether the records of traffic data are complete; the consistency is used to check whether the records of traffic data are consistent with the data in the predefined document; the existence is used to check whether the records in the traffic data exist; the validity is used to check whether the records in the traffic data have abnormalities or error information; the transparency is used to check whether the records in the traffic data exist on all browsing pages;

[0079] A verification rule is formed according to the verification dimension, and a verification indicator in the verification rule is obtained; the verification indicator is used to perform quality verification on the flow data.

[0080] In an embodiment of the present application, the predefined document may refer to a tracking point mapping document given in advance, which is used to store the name of the browsing page, the name of each event such as a click button, a description of each name, etc., and is used to compare the traffic data generated by the user's operations on the browsing page based on marketing activities.

[0081] In this step, the integrity is used to check whether the record of traffic data generated by the user's operations on the browsing page based on marketing activities is complete. If the names corresponding to the user's browsing pages based on marketing activities all exist in the predefined document, it means that the browsing page is complete.

[0082] The consistency is used to check whether the record of traffic data generated by the user's operations on the browsing page based on marketing activities is consistent with the data in the predefined document; if the name description corresponding to the user's browsing page based on marketing activities is consistent with the corresponding name description in the predefined document, it means that the browsing page is consistent.

[0083] The existence is used to check whether the record exists in the traffic data generated by the user's operation on the browsing page based on the marketing activity; if the name corresponding to a browsing page of the user based on the marketing activity exists in the predefined document, it means that the browsing page has existence, and the existence is used for separate comparison.

[0084] The validity is used to check whether there is any abnormality or error information recorded in the traffic data generated by the user's operations on the browsing page based on marketing activities; if the description information generated after the user operates the page object on a browsing page based on the marketing activity is the same as the description information recorded in the predefined document or plays the same role, it means that the page object is valid.

[0085] The transparency is used to check whether the records in the traffic data generated by the user's operations on the browsing page based on marketing activities exist on all browsing pages; that is, whether the same record code corresponding to the user exists on every browsing page browsed by the user. If so, it means that it has transparency.

[0086] Exemplarily, the verification rules are formed according to the verification dimensions, and the verification rules corresponding to the verification dimensions under each verification object are different. Figure 4 A schematic diagram of a design verification rule provided in an embodiment of the present application is shown in FIG. Figure 4 As shown, the verification objects include page series, page objects, user subjects, user sources, user destinations and interactive behaviors, and the verification dimensions include integrity, consistency, existence, validity and transparency. For the same verification dimension, different verification objects correspond to different verification rules. For example, when the verification dimension corresponds to integrity, the verification rules corresponding to page series, page objects, user subjects, user sources, user destinations and interactive behaviors are Rule 21, Rule 22, Rule 23, Rule 24, Rule 25 and Rule 26, respectively. Under other verification dimensions, different verification objects correspond to different verification rules, which are not elaborated here.

[0087] Specifically, if the verification dimensions that meet business needs are determined to be integrity and consistency based on the types of verification objects and the number of required detection traffic data corresponding to each verification object, and the types of verification objects include page series, page objects, and user destinations, then the verification rules can be determined to be Rule 21, Rule 41, Rule 22, Rule 42, Rule 25, and Rule 45, etc., wherein each rule includes the number of required detection traffic data.

[0088] It should be noted that the verification rules corresponding to the verification dimensions under each verification object can be set in advance. After determining the verification object and the verification dimension, the corresponding verification rules can be selected adaptively. Optionally, the verification rules can also be modified according to different application scenarios and business needs, such as increasing or decreasing the verification of a certain verification indicator. The embodiment of the present application does not specifically limit the verification indicators included in the verification rules and the verification rules corresponding to the verification dimensions under each verification object, which depends on the specific circumstances.

[0089] Therefore, the embodiments of the present application can design verification dimensions based on the verification object, and then determine the verification rules, so that it can be applicable to a variety of scenarios. That is, in each scenario, there are corresponding verification rules for quality verification, that is, the traffic data of each dimension of each subject is checked, thereby establishing a systematic traffic verification method and improving the flexibility of the application.

[0090] Optionally, forming a verification rule according to the verification dimension includes:

[0091] Obtaining an application scenario corresponding to the business requirement, and obtaining a verification indicator and a quantity of verification indicators corresponding to each verification dimension based on the application scenario;

[0092] A corresponding algorithm is selected based on the number of detection indicators, and the algorithm is used to process the inspection indicators corresponding to each inspection dimension to obtain inspection rules.

[0093] In the embodiments of the present application, the verification indicator may refer to the indicator required to be used in the verification rules. The verification indicator may be formed by processing the fields corresponding to the traffic data. The verification indicators required for different application scenarios and the number of verification indicators are different. For example, for checking the integrity of the browsing interface, the verification indicator may include the name corresponding to the browsing interface, the number of interfaces corresponding to the browsing interface, etc. The embodiments of the present application do not specifically limit the verification indicators required for different application scenarios and the number of verification indicators.

[0094] In this step, the corresponding algorithm can be selected based on the number of detection indicators. Optionally, if the number of verification indicators corresponding to each verification object is less than a preset threshold, the individual detection indicators can be judged in turn under the corresponding verification dimension. For example, the verification indicator corresponding to the browsing interface is that the name of the browsing interface exists, and the verification indicator corresponding to the page object is that the name of the click event exists. In this case, the rules for judging the individual detection indicators in turn can be determined under the integrity verification dimension.

[0095] Optionally, if the number of verification indicators corresponding to each verification object is greater than a preset threshold, or the verification indicators corresponding to each verification object are specified with a priority, then the verification indicators can be calculated and processed using a weighted algorithm, a weighted subtraction algorithm or a proportional coefficient algorithm under the corresponding verification dimension, that is, each verification indicator corresponds to a different weight or proportional coefficient, and each time a judgment is made, a plurality of different verification indicators are selected for judgment. The embodiment of the present application does not specifically limit the verification rules obtained by processing a plurality of verification indicators using an algorithm. The verification rules may be for checking the integrity and consistency of the name of the browsing interface, the name of the click event, the user ID, the pop-up window clicked by the user, etc., wherein the verification rules include different verification weights corresponding to the verification indicators.

[0096] It should be noted that the algorithm may be a judgment rule converted based on four arithmetic operations or a cross-check algorithm, and the embodiments of the present application do not specifically limit this.

[0097] For example, Figure 5 A schematic diagram of a design verification indicator flow provided in an embodiment of the present application, such as Figure 5As shown, in a certain application scenario, the same verification dimension may correspond to multiple verification rules because the verification objects are different, and each verification rule may correspond to multiple verification indicators. For example, under the verification dimension of integrity, it is necessary to consider: the integrity of the browsing page and the integrity of each object on the page, etc. Therefore, there may be verification rules corresponding to the browsing page, verification rules corresponding to the page object, etc. Furthermore, for the verification rules corresponding to the browsing page, there may be verification indicators such as the existence of the name corresponding to the browsing page and the existence of the interface attributes corresponding to the browsing interface. Specifically, the verification indicators in the verification rules corresponding to the verification objects under each verification dimension are determined according to the application scenario, and the embodiments of the present application do not make specific limitations on this.

[0098] It can be understood that verification indicators are designed according to application scenarios to form verification rules (indicator tree). Further, the formed verification rules are used for development and configuration, that is, the verification indicators of development and configuration are applied to the data collected at the actual tracking points to realize traffic data verification.

[0099] Therefore, the embodiments of the present application can select suitable verification indicators for different application scenarios, and then determine the corresponding verification rules to verify the traffic data, inject business concerns into the verification indicators, ensure that data verification is consistent with business requirements, and ensure the accuracy of verification while improving the flexibility of the application.

[0100] Optionally, performing quality check on the flow data based on the check rule includes:

[0101] Obtaining flow data in a flow table and extracting a test field in the flow data; the flow table is used to store data collected by embedding points in a browsing page;

[0102] The inspection field is inspected using the inspection indicator in the inspection rule to detect whether the flow data is abnormal.

[0103] In an embodiment of the present application, the check field may refer to a field used to check whether the traffic data is normal. It may be extracted from a traffic table or may be considered as a setting. For example, the check field may be the ID of the browsing page or the name of the browsing page.

[0104] In this step, the inspection field is inspected using the inspection indicator in the inspection rule. For example, the ID of the browsing page in the flow table can be compared one by one with the ID of the browsing page stored in the predefined document to check whether the data is abnormal. The inspection method can be based on a computer programming language (such as JAVA, C#, PHP, etc.) or database software (such as mysql, oracle, etc.), which is not specifically limited in the embodiment of the present application. Figure 6 A schematic diagram of a page verification interface provided by an embodiment of the present application, such as Figure 6 As shown, when checking the browsing page, the check points (check indicators) can be: all pages of the activity exist in the flow table; the name description of all pages of the activity in the flow table is consistent with the page mapping document; the name of all pages of the activity in the flow table is in the page mapping document list; further, the corresponding check code is used to check and generate a check record table, such as Figure 6 The record table of page ID comparison shown is used to obtain the verification result.

[0105] Exemplarily, in each verification dimension, different verification objects correspond to different verification rules, and the verification rule includes at least one verification point (verification indicator), as shown in Table 1:

[0106] Table 1

[0107]

[0108] Among them, the first column is the verification object, the second column is the verification dimension, and the third column is the verification point under the corresponding verification rule. For example, when checking the integrity of the page object taking a button as an example, there are two verification points included in the corresponding verification rule, namely, the name description of the click event in the flow table cannot be empty, and the name description of the click event in the flow table should be within the range of the button embedding point name (given by the front end); the button embedding point name is stored in the embedding point mapping document, and the verification points included in the verification rules under other parts of the verification objects can be seen in Table 1, which will not be repeated here; the fourth column is the materials required for verification, and the materials required for verification are the embedding point mapping document (predefined document).

[0109] It should be noted that the different verification rules corresponding to different verification objects under different verification dimensions, and the different verification points included in the verification rules, are not specifically limited in the embodiments of the present application, and the above are merely examples.

[0110] Therefore, the embodiment of the present application can use the inspection field to check whether the flow data is abnormal, thereby improving the accuracy of the inspection.

[0111] Optionally, when the audit dimensions corresponding to different audit objects are the same, the codes of some design audit rules and audit indicators can be universal, that is, the same dimensions of different audit dimensions can be audited by modifying the parameter configuration of the corresponding audit dimension.

[0112] Optionally, the method further includes:

[0113] After detecting the abnormality of the traffic data, obtaining a page identity ID corresponding to the abnormal traffic data;

[0114] The corresponding browsing page is found based on the page ID, and the buried point data corresponding to the browsing page is obtained, and the buried point data is fed back to the developer's terminal device so that the developer can re-bury the point based on the buried point data.

[0115] In an embodiment of the present application, buried point data may refer to data generated by related technologies that capture, process and send specific user behaviors or events, such as the number of clicks of a user on a browsing page, the length of time a user browses a page, etc., wherein the buried point data is generated based on the buried points of the developer on the browsing page. For example, if the developer buries several point areas on a browsing page, and the user responds to the point area based on a touch operation, corresponding buried point data can be generated.

[0116] It should be noted that the buried data corresponding to the browsing page may include the buried data corresponding to the user behavior and the buried data corresponding to the activity page. For example, when tracing abnormal traffic data, after finding the browsing page corresponding to the traffic data, the buried data generated by the user based on touch operations on the browsing page can be obtained, and the user behavior data corresponding to visiting the browsing page, such as user identity, user source, and user destination, can be obtained. The embodiments of the present application do not make specific limitations on this.

[0117] For example, in Figure 1 In the application scenario, users participate in online marketing activities through the first terminal device 101 to generate a large amount of traffic data, and send it to the business platform 102 for verification. After the business platform 102 detects that the traffic data is abnormal, it can obtain the page ID of a browsing page in the online marketing activity corresponding to the abnormal traffic data. Furthermore, based on the page ID, the corresponding browsing page is found, and the buried data corresponding to the browsing page is obtained, and the buried data is fed back to the developer's second terminal device 103, so that the developer can analyze which configurations have problems in the previous buried process and then re-bury the points.

[0118] It can be understood that in the embodiments of the present application, the developer can analyze the tracking data, locate the development problems or configuration problems in the tracking process, and then re-track the points; or the business platform can analyze the tracking data, locate the development problems or configuration problems in the tracking process, and then send the development problems or configuration problems to the developer's terminal device, so that the developer can re-track the points based on the development problems or configuration problems. The embodiments of the present application do not make specific limitations on this.

[0119] Therefore, the embodiments of the present application can trace abnormal traffic data and locate development problems or configuration problems in the developer's tracking process, so that the developer can re-track the points, thereby improving the accuracy of traffic data collection.

[0120] Optionally, the method further includes:

[0121] Obtain the results of the quality check within a preset time, and summarize and count the flow data containing abnormalities in the results to obtain a summary result;

[0122] The summary results are processed by quality trend visualization analysis to obtain processing results, and the processing results are sent to the terminal device of the developer.

[0123] In the embodiment of the present application, the preset time may refer to the time set for collecting the quality check results. The quality check results collected at the preset time may reflect the effect of the quality check performed by the flow data quality check method.

[0124] In this step, the summary results are subjected to a quality trend visualization analysis process. The summary results may be plotted in the form of a distribution graph with time as the horizontal axis and abnormal flow data distribution as the vertical axis, or directly presented in the form of a table, so as to facilitate developers to conduct intuitive analysis of abnormal flow data.

[0125] Therefore, the embodiment of the present application can analyze abnormal data within a preset time, analyze the effectiveness of the flow data quality verification method, and where errors often occur, and optimize the flow data quality verification method in a timely manner.

[0126] In the above-mentioned embodiments, the flow data quality verification method provided by the embodiments of the present application is introduced, and in order to realize the various functions in the method provided by the embodiments of the present application, the electronic device as the execution subject may include a hardware structure and / or a software module, and the above-mentioned functions are realized in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether one of the above-mentioned functions is executed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.

[0127] For example, Figure 7 A schematic diagram of the structure of a flow data quality check device provided in an embodiment of the present application is shown in FIG. Figure 7 As shown, the device includes: an acquisition module 710, a design module 720 and a verification module 730; wherein the acquisition module 710 is used to obtain the verification subject of the traffic data and the business needs of the user, and the verification subject includes the active page and / or the user behavior;

[0128] The design module 720 is used to design corresponding verification objects using the verification subject and the business requirements; wherein the verification objects corresponding to the activity page include: browsing page and page object, and the verification objects corresponding to the user behavior include: user identity, user source, user destination and interactive behavior; the page object is the corresponding operable object in the browsing page, and the interactive behavior is the user's operation behavior on the browsing page;

[0129] The checking module 730 is used to determine the checking rules based on the designed checking object, and perform quality checking on the flow data based on the checking rules.

[0130] Optionally, the design module 720 is specifically used to:

[0131] Using the verification subject to identify the required verification object;

[0132] The priorities of the required inspection objects are obtained based on the business requirements, and the types of inspection objects and the amount of required detection traffic data corresponding to each inspection object are determined based on the priorities.

[0133] Optionally, the checking module 730 includes a determination module and a checking unit; the determination module includes a determination unit and a formation unit;

[0134] Specifically, the determination unit is used to determine the verification dimensions that meet the business needs based on the types of the verification objects and the number of required detection traffic data corresponding to each verification object, and the verification dimensions include: integrity, consistency, existence, validity and transparency; the integrity is used to check whether the records of traffic data are complete; the consistency is used to check whether the records of traffic data are consistent with the data in the predefined document; the existence is used to check whether the records in the traffic data exist; the validity is used to check whether the records in the traffic data have abnormalities or error information; the transparency is used to check whether the records in the traffic data exist on all browsing pages;

[0135] The forming unit is used to form a checking rule according to the checking dimension and obtain the checking index in the checking rule; the checking index is used to perform quality checking on the flow data.

[0136] Optionally, the forming unit is specifically used for:

[0137] Obtaining an application scenario corresponding to the business requirement, and obtaining a verification indicator and a quantity of verification indicators corresponding to each verification dimension based on the application scenario;

[0138] A corresponding algorithm is selected based on the number of detection indicators, and the algorithm is used to process the inspection indicators corresponding to each inspection dimension to obtain inspection rules.

[0139] Optionally, the checking unit is used to:

[0140] Obtaining flow data in a flow table and extracting a test field in the flow data; the flow table is used to store data collected by embedding points in a browsing page;

[0141] The inspection field is inspected using the inspection indicator in the inspection rule to detect whether the flow data is abnormal.

[0142] Optionally, the device further includes a search module, wherein the search module is configured to:

[0143] After detecting the abnormality of the traffic data, obtaining a page identity ID corresponding to the abnormal traffic data;

[0144] The corresponding browsing page is found based on the page ID, and the buried point data corresponding to the browsing page is obtained, and the buried point data is fed back to the developer's terminal device so that the developer can re-bury the point based on the buried point data.

[0145] Optionally, the device further includes a statistical module, and the statistical module includes:

[0146] Obtain the results of the quality check within a preset time, and summarize and count the flow data containing abnormalities in the results to obtain a summary result;

[0147] The summary results are processed by quality trend visualization analysis to obtain processing results, and the processing results are sent to the terminal device of the developer.

[0148] The specific implementation principle and effect of a flow data quality check device provided in an embodiment of the present application can be found in the relevant description and effects corresponding to the above embodiments, and no further details will be given here.

[0149] The present application also provides a schematic diagram of the structure of an electronic device. Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application is shown in FIG. Figure 8 As shown, the electronic device may include: a processor 801 and a memory 802 communicatively connected to the processor; the memory 802 stores a computer program; the processor 801 executes the computer program stored in the memory 802, so that the processor 801 executes the method described in any of the above embodiments.

[0150] The memory 802 and the processor 801 may be connected via a bus 803 .

[0151] An embodiment of the present application further provides a computer-readable storage medium, which stores computer program execution instructions. When the computer program execution instructions are executed by a processor, they are used to implement the method described in any of the aforementioned embodiments of the present application.

[0152] An embodiment of the present application further provides a chip for executing instructions, wherein the chip is used to execute the method described in any of the aforementioned embodiments as executed by an electronic device in any of the aforementioned embodiments of the present application.

[0153] An embodiment of the present application further provides a computer program product, which includes a program code. When a computer runs the computer program, the program code executes the method described in any of the aforementioned embodiments as executed by an electronic device in any of the aforementioned embodiments of the present application.

[0154] In the technical solution of this application, the collection, storage, use, processing, transmission, provision and disclosure of information such as financial data or user data involved shall comply with the provisions of relevant laws and regulations and shall not violate public order and good morals.

[0155] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of modules is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

[0156] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to implement the solution of this embodiment.

[0157] In addition, each functional module in each embodiment of the present application can be integrated into one processing unit, or each module can exist physically separately, or two or more modules can be integrated into one unit. The above-mentioned module-composed unit can be implemented in the form of hardware or in the form of hardware plus software functional units.

[0158] The above-mentioned integrated module implemented in the form of a software function module can be stored in a computer-readable storage medium. The above-mentioned software function module is stored in a storage medium, including a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform some steps of the method described in each embodiment of the present application.

[0159] It should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. A general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in the application may be directly implemented as being executed by a hardware processor, or may be implemented by a combination of hardware and software modules in the processor.

[0160] The memory may include high-speed random access memory (RAM), and may also include non-volatile memory (NVM), such as at least one disk storage, and may also be a USB flash drive, a mobile hard disk, a read-only memory, a disk or an optical disk, etc.

[0161] The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the bus in the drawings of the present application is not limited to only one bus or one type of bus.

[0162] The above storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The storage medium can be any available medium that can be accessed by a general or special computer.

[0163] An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an application specific integrated circuit (ASIC). Of course, the processor and the storage medium can also exist as discrete components in an electronic device or a main control device.

[0164] The above is only a specific implementation of the embodiment of the present application, but the protection scope of the embodiment of the present application is not limited thereto, and any changes or replacements within the technical scope disclosed in the embodiment of the present application should be included in the protection scope of the embodiment of the present application. Therefore, the protection scope of the embodiment of the present application should be based on the protection scope of the claims.

Claims

1. A flow data quality checking method, characterized in that: The method comprises: Obtain the verification subject of traffic data and the business needs of users, wherein the verification subject includes active pages and / or user behaviors; The corresponding inspection object is designed by using the inspection subject and the business demand; wherein the business demand is used to determine the priority of the inspection object, and the priority of the inspection object is used to determine the type of inspection object and the amount of required detection flow data corresponding to each inspection object; the inspection objects corresponding to the activity page include: browsing page, page object, and the inspection objects corresponding to the user behavior include: user identity, user source, user destination and interactive behavior; the page object is the corresponding operable object in the browsing page, and the interactive behavior is the user's operation behavior on the browsing page; Determine the verification rules based on the designed verification object, and perform quality verification on the flow data based on the verification rules; wherein different verification objects correspond to different verification rules; The method further comprises: After detecting the abnormality of the traffic data, obtaining a page identity ID corresponding to the abnormal traffic data; finding a corresponding browsing page based on the page ID, obtaining the buried point data corresponding to the browsing page, and feeding back the buried point data to the developer's terminal device, so that the developer can re-buffer the buried point based on the buried point data; The results of the quality check within a preset time are obtained, and the abnormal traffic data contained in the results are summarized and counted to obtain a summary result; the summary result is subjected to quality trend visualization analysis and processing to obtain a processing result, and the processing result is sent to the developer's terminal device.

2. The method according to claim 1, characterized in that Using the verification subject and the business requirements, a corresponding verification object is designed, including: Using the verification subject to identify the required verification object; The priorities of the required inspection objects are obtained based on the business requirements, and the types of inspection objects and the amount of required detection traffic data corresponding to each inspection object are determined based on the priorities.

3. The method according to claim 2, characterized in that Determine the verification rules based on the designed verification object, including: Based on the types of the verification objects and the number of required detection traffic data corresponding to each verification object, the verification dimensions that meet the business needs are determined, and the verification dimensions include: integrity, consistency, existence, validity and transparency; the integrity is used to check whether the records of traffic data are complete; the consistency is used to check whether the records of traffic data are consistent with the data in the predefined document; the existence is used to check whether the records in the traffic data exist; the validity is used to check whether the records in the traffic data have abnormalities or error information; the transparency is used to check whether the records in the traffic data exist on all browsing pages; A verification rule is formed according to the verification dimension, and a verification indicator in the verification rule is obtained; the verification indicator is used to perform quality verification on the flow data.

4. The method according to claim 3, characterized in that The verification rules are formed according to the verification dimensions, including: Obtaining an application scenario corresponding to the business requirement, and obtaining a verification indicator and a quantity of verification indicators corresponding to each verification dimension based on the application scenario; A corresponding algorithm is selected based on the number of detection indicators, and the algorithm is used to process the inspection indicators corresponding to each inspection dimension to obtain inspection rules.

5. The method according to claim 3, characterized in that: Performing quality check on the flow data based on the check rules includes: Obtaining flow data in a flow table and extracting a test field in the flow data; the flow table is used to store data collected by embedding points in a browsing page; The inspection field is inspected using the inspection indicator in the inspection rule to detect whether the flow data is abnormal.

6. A flow data quality checking device, characterized in that: The device comprises: An acquisition module, used to acquire the verification subject of the traffic data and the business needs of the user, wherein the verification subject includes the activity page and / or the user behavior; A design module is used to design corresponding inspection objects using the inspection subject and the business requirements; wherein the business requirements are used to determine the priority of the inspection object, and the priority of the inspection object is used to determine the type of inspection object and the amount of required detection flow data corresponding to each inspection object; the inspection objects corresponding to the activity page include: browsing page, page object, and the inspection objects corresponding to the user behavior include: user identity, user source, user destination and interactive behavior; the page object is the corresponding operable object in the browsing page, and the interactive behavior is the user's operation behavior on the browsing page; A verification module, used to determine verification rules based on the designed verification object, and perform quality verification on the flow data based on the verification rules; wherein different verification objects correspond to different verification rules; The device further includes a search module, wherein the search module is configured to: After detecting the abnormality of the traffic data, obtaining a page identity ID corresponding to the abnormal traffic data; finding a corresponding browsing page based on the page ID, obtaining the buried point data corresponding to the browsing page, and feeding back the buried point data to the developer's terminal device, so that the developer can re-buffer the buried point based on the buried point data; The device further includes a statistical module, the statistical module including: The results of the quality check within a preset time are obtained, and the abnormal traffic data contained in the results are summarized and counted to obtain a summary result; the summary result is subjected to quality trend visualization analysis and processing to obtain a processing result, and the processing result is sent to the developer's terminal device.

7. An electronic device, characterized in that: include: A processor, a memory and a computer program; wherein the computer program is stored in the memory and is configured to be executed by the processor, and the computer program includes instructions for executing the flow data quality verification method as described in any one of claims 1-5.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, they are used to implement the method according to any one of claims 1 to 5.

9. A computer program product, characterized in that The computer program comprises program codes, and when a computer runs the computer program, the program codes execute the method according to any one of claims 1 to 5.

Images