A data reporting method and device

Abstract

The embodiment of the present invention provides a data reporting method and device, which receives a reporting event sent by a user through a mobile terminal; searches for a data source and a data collection rule corresponding to the reporting event; and obtains complete data collection information from the data source according to the data collection rule. It can be seen that in the embodiment of the present invention, after different users send the same reporting event through different terminals, the data collection rule corresponding to the same reporting event is used to obtain complete data collection information from the data source, thereby avoiding differences in the data reported by different mobile terminals and ensuring the accuracy of the data reported by different mobile terminals.

Description

Technical Field

[0001] The present invention relates to the technical field of data reporting, and in particular to a data reporting method and device. Background Art

[0002] At present, data collection and reporting are completed in a faceted manner, which is prone to misreporting and omissions. There are differences in the data reported on different mobile terminals, which will cause uncertainty in the reported data. The differences and omissions in these data will have a great impact on subsequent data cleaning and data reporting, and there is a problem of large errors in data reporting. Summary of the invention

[0003] In view of this, an embodiment of the present invention provides a data reporting method and device to ensure the accuracy of data reported by different mobile terminals.

[0004] To achieve the above objectives, the embodiments of the present invention provide the following technical solutions:

[0005] In a first aspect, an embodiment of the present application provides a data reporting method, including:

[0006] Receive reporting events sent by users via mobile terminals;

[0007] Find the data source and data collection rules corresponding to the reported event;

[0008] Complete data collection information is obtained from the data source according to the data collection rules.

[0009] Optionally, the above method further includes:

[0010] The data source is managed uniformly according to the business scenario, wherein the management includes at least one of the following: adding, deleting or modifying the data source.

[0011] Optionally, the above method further includes:

[0012] The data collection rules are uniformly managed according to business scenarios, wherein the management includes at least one of the following: adding, deleting or modifying the data collection rules.

[0013] Optionally, in the above method, the step of receiving a reporting event sent by a user via a mobile terminal includes:

[0014] When the user operates the mobile terminal to enter a page through a business scenario, a reporting event triggered by the mobile terminal through the page is received.

[0015] Optionally, in the above method, the step of searching for a data source and a data collection rule corresponding to a reported event includes:

[0016] Obtaining the identifier of the reported event through the reporting entry of the full data statistics engine;

[0017] Find the data source and data collection rules corresponding to the identifier.

[0018] Optionally, in the above method, the data source includes: a business data source and a cache data source;

[0019] The data collection rules include: business rules and cache rules;

[0020] The business rule defines the mapping relationship between metadata and the business data source in a key path manner;

[0021] The cache rule defines the mapping relationship between metadata and the cache data source in a key path manner.

[0022] In a second aspect, an embodiment of the present application provides a data reporting device, including:

[0023] A receiving unit, used to receive a reporting event sent by a user via a mobile terminal;

[0024] A search unit, used to search for a data source and a data collection rule corresponding to the reported event;

[0025] The acquisition unit is used to acquire complete data acquisition information from the data source according to the data acquisition rule.

[0026] Optionally, the above device further comprises:

[0027] A management unit is used to uniformly manage the data source according to the business scenario, wherein the management includes at least one of the following: adding, deleting or modifying the data source.

[0028] Optionally, the above device further comprises:

[0029] A management unit is used to uniformly manage the data collection rules according to business scenarios, wherein the management includes at least one of the following: adding, deleting or modifying the data collection rules.

[0030] The embodiment of the present invention provides a data reporting method and device, which receives a reporting event sent by a user through a mobile terminal; searches for a data source and a data collection rule corresponding to the reporting event; and obtains complete data collection information from the data source according to the data collection rule. It can be seen that in the embodiment of the present invention, after different users send the same reporting event through different terminals, the data collection rule corresponding to the same reporting event is used to obtain complete data collection information from the data source, thereby avoiding differences in the data reported by different mobile terminals and ensuring the accuracy of the data reported by different mobile terminals. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.

[0032] Figure 1 A method flow chart of a data reporting method provided by an embodiment of the present invention;

[0033] Figure 2 A schematic diagram of the structure of a data reporting device provided by an embodiment of the present invention;

[0034] Figure 3 A schematic diagram of a hierarchical framework of a full data statistics architecture provided by an embodiment of the present invention;

[0035] Figure 4 A schematic diagram of an event flow of a full data statistics architecture provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0036] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0037] In this application, the terms "comprises", "comprising" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprising a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element.

[0038] The embodiment of the present invention provides a data reporting method and device, which receives a reporting event sent by a user through a mobile terminal; searches for a data source and a data collection rule corresponding to the reporting event; and obtains complete data collection information from the data source according to the data collection rule. It can be seen that in the embodiment of the present invention, after different users send the same reporting event through different terminals, the data collection rule corresponding to the same reporting event is used to obtain complete data collection information from the data source, thereby avoiding differences in the data reported by different mobile terminals and ensuring the accuracy of the data reported by different mobile terminals.

[0039] See also Figure 1 , a method flow chart of a data reporting method disclosed in an embodiment of the present invention, the method comprising:

[0040] Step S101: receiving a reporting event sent by a user via a mobile terminal;

[0041] It is understandable that after the APP is started, the user performs corresponding operations on the APP interface to trigger the reporting event, and sends the reporting event to the full data statistics engine.

[0042] Step S102: Find the data source and data collection rules corresponding to the reported event;

[0043] It should be noted that in the embodiment of the present invention, the data source, data collection rules, and reporting events are configured by the corresponding developers or product personnel in the data management background and then sent to the mobile terminal. The embodiment of the present invention supports dynamic configuration and sending of data sources, dynamic configuration and sending of data collection rules, and dynamic configuration and sending of reporting events.

[0044] The data source contains the data information corresponding to the metadata report, including business data source and cache data source. Among them, the business data source is obtained by the developer entering the business data source information in the data management background, including the data source type and the data information that can be collected. The cache data source is the cache data dynamically generated during the data reporting process.

[0045] It can be understood that the data source also includes a global data source, a container data source, and the like.

[0046] Data collection rules are used to define metadata collection rules, including business rules and cache rules. Among them, business rules define the mapping relationship between metadata and business data sources through the key path KeyPath method; cache rules define the mapping relationship between metadata and cache data sources through the key path KeyPath method. It can be seen that in the embodiment of the present invention, the KeyPath method is used to obtain simplified data collection rules, perfect data retry logic, and reasonable discarding strategies, which ensures the accuracy of collected data and real-time arrival at the data application layer, thereby realizing the full link of reported data. For example: The PV event of the Mango Channel page needs to report the channel id, and the format of the data collection rule can be as follows:

[0047]

[0048] It can be understood that data collection rules also include global rules and context rules.

[0049] Reporting events are used to define events that need to be reported, including the identifier of the reporting event and the data collection rules required for the reporting event. Reporting events can include PV events, click events, exposure events, etc., without specific restrictions. For example: the reporting event definition uses JSON format, which can be expressed as follows:

[0050] {

[0051] "scene_name":"channel",

[0052] "item":[

[0053] {"eventName":"page",

[0054] "eventId":"page",

[0055] "name":"Channel Browse",

[0056] "desc":"PV event",

[0057] "rules":["channelRule","PVSource"]

[0058] }]}

[0059] Step S103: Acquire complete data collection information from the data source according to the data collection rule.

[0060] It should be noted that after obtaining complete data collection information, the data collection information will be sent to data statistics platforms, data reports and other places where data cleaning is required, and the data collection information will also be cached to provide data support for back-end intelligence.

[0061] In the method provided in the embodiment of the present invention, a reported event sent by a user through a mobile terminal is received; a data source and a data collection rule corresponding to the reported event are searched; and complete data collection information is obtained from the data source according to the data collection rule. It can be seen that in the embodiment of the present invention, after different users send the same reported event through different terminals, the complete data collection information is obtained from the data source using the data collection rule corresponding to the same reported event, thereby avoiding the difference in the data reported by different mobile terminals and ensuring the accuracy of the data reported by different mobile terminals.

[0062] To further optimize the above embodiment, the data reporting method provided in the embodiment of the present invention may further include:

[0063] The data source is managed uniformly according to the business scenario, wherein the management includes at least one of the following: adding, deleting or modifying the data source.

[0064] It is to be understood that the management may also include querying the data source.

[0065] In the embodiment of the present invention, the inventor found that the main reason for the incomplete reported data is that the business collection fields are scattered everywhere, which is inconvenient to assemble and splice. Therefore, the data source is managed uniformly according to the business scenario, which makes the intrusion to the data source less, realizes the dynamic configuration of the data source, and ensures the integrity of the reported data. In addition, the injection and release of the data source are managed by scenario, which does not cause additional memory overhead.

[0066] To further optimize the above embodiment, the data reporting method provided in the embodiment of the present invention may further include:

[0067] The data collection rules are uniformly managed according to business scenarios, wherein the management includes at least one of the following: adding, deleting or modifying the data collection rules.

[0068] It is understandable that the management may also include querying the data collection rules.

[0069] In the embodiment of the present invention, the inventor found that the main reason for the weak ability to repair reported data is that the report repair requires the release of the APP, so the data collection rules are uniformly managed according to the business scenario, and the dynamic configuration of the data collection rules is realized, so that the data collection rules can be updated in time to ensure the timeliness and accuracy of data repair. At the same time, based on the full business data source, the report event can further ensure the integrity of the reported data by dynamically adjusting the data collection rules.

[0070] In order to further optimize the above embodiment, the data reporting method provided in the embodiment of the present invention may further include:

[0071] Perform data verification on the data collection information.

[0072] It should be noted that data verification mainly verifies whether the data collection information is empty and whether the data format is accurate.

[0073] In the embodiment of the present invention, by performing data verification on the data collection information, the correctness of the data collection information is guaranteed, which facilitates the subsequent application of the data collection information.

[0074] To further optimize the above embodiment, the step of receiving a reporting event sent by a user via a mobile terminal includes:

[0075] When the user operates the mobile terminal to enter a page through a business scenario, a reporting event triggered by the mobile terminal through the page is received.

[0076] It should be noted that in the embodiment of the present invention, business scenario caching is performed, specifically storing the configuration information of the business scenario and managing the page information in the business scenario in a stack manner; page information caching is also performed, specifically storing the configuration information of the current page and the configuration information of the source page. By caching business scenarios and page information, it is ensured that the data source can be injected and released by scene and page, without causing additional memory overhead.

[0077] In the embodiment of the present invention, when a user operates a mobile terminal to enter a page through a business scenario, a reporting event triggered by the mobile terminal through the page is received, thereby triggering reporting events by scenario and page without causing additional memory overhead.

[0078] To further optimize the above embodiment, the step of searching for data sources and data collection rules corresponding to the reported events includes:

[0079] Obtaining the identifier of the reported event through the reporting entry of the full data statistics engine;

[0080] Find the data source and data collection rules corresponding to the identifier.

[0081] In the embodiment of the present invention, the reporting entry of the full data statistics engine carries the data reporting identifier, so that the tedious data collection work is completed by the full data statistics engine, thereby avoiding the problem of inaccurate reporting timing caused by the information required to be attached at the reporting timing being too cumbersome, and ensuring the accuracy of the reporting timing.

[0082] See also Figure 2 , a schematic diagram of a data reporting device disclosed in an embodiment of the present invention, the device comprising:

[0083] The receiving unit 201 is used to receive a reporting event sent by a user via a mobile terminal;

[0084] A search unit 202, used to search for a data source and a data collection rule corresponding to the reported event;

[0085] The acquisition unit 203 is used to acquire complete data acquisition information from the data source according to the data acquisition rule.

[0086] In an embodiment of the present invention, after different users send the same reporting event through different terminals, the data collection rules corresponding to the same reporting event are used to obtain complete data collection information from the data source, thereby avoiding differences in data reported by different mobile terminals and ensuring the accuracy of data reported by different mobile terminals.

[0087] To further optimize the above embodiment, the data reporting device provided in the embodiment of the present invention may further include:

[0088] A management unit is used to uniformly manage the data source according to the business scenario, wherein the management includes at least one of the following: adding, deleting or modifying the data source.

[0089] To further optimize the above embodiment, the data reporting device provided in the embodiment of the present invention may further include:

[0090] A management unit is used to uniformly manage the data collection rules according to business scenarios, wherein the management includes at least one of the following: adding, deleting or modifying the data collection rules.

[0091] To further optimize the above embodiment, the data reporting device provided in the embodiment of the present invention may further include:

[0092] A verification unit is used to perform data verification on the data collection information.

[0093] To further optimize the above embodiment, the receiving unit is specifically configured to receive a reporting event triggered by the mobile terminal through the page when the user operates the mobile terminal to enter the page through a business scenario.

[0094] To further optimize the above embodiment, the search unit includes:

[0095] An identification acquisition unit, used to acquire the identification of the reported event through the reporting entry of the full data statistics engine;

[0096] The search subunit is used to search for the data source and data collection rules corresponding to the identifier.

[0097] To further optimize the above embodiment, the data source includes: a business data source and a cache data source;

[0098] The data collection rules include: business rules and cache rules;

[0099] The business rule defines the mapping relationship between metadata and the business data source in a key path manner;

[0100] The cache rule defines the mapping relationship between metadata and the cache data source in a key path manner.

[0101] In order to further optimize the above embodiment, the data reporting device provided in the embodiment of the present invention may further include a cache unit, and the cache unit includes:

[0102] The business scenario cache unit is used to store the scenario configuration information and manage the page information in the scenario in a stack manner;

[0103] The page information cache unit is used to store the configuration information of the current page and the source page.

[0104] See also Figure 3 , which is a schematic diagram of a hierarchical framework of a full data statistics architecture disclosed in an embodiment of the present invention

[0105] It should be noted that the hierarchical framework of the full data statistics architecture includes: reporting event trigger layer, search layer, calculation layer, and data application layer. MGDC stands for Mango Full Data Statistics Engine.

[0106] The reporting event trigger layer will trigger the reporting of PV events, click events, exposure events and other events.

[0107] The search layer is used to find the data source and data collection rules corresponding to the reported events.

[0108] It should be noted that data sources include global data sources, business data sources, container data sources, etc., and collection rules include global rules, business rules, context rules, etc. Among them, the business data source is obtained by developers entering business data source information in the data management background, including data source type and collectible data information. Business rules define the mapping relationship from metadata to business data sources through the key path KeyPath method.

[0109] The calculation layer is used to calculate and generate complete data collection information. The calculation layer includes data source management, context status, data conversion, data verification, etc. Data source management is used to uniformly manage data sources. Context status is used to obtain environmental parameters or environmental status information in a certain scenario. Data conversion is to deeply mine the corresponding data content from the data source and obtain the corresponding data information in the registered data source according to the configured rules. Data verification mainly verifies whether the data is empty and whether the data format is accurate.

[0110] The data application layer includes the server, database, data reports, and reporting.

[0111] It is understandable that the computing layer will send the complete data collection information to the data application layer, and the data application layer will store the data collection information in the server, database, or use the data collection information to generate data reports, or report the data collection information to the data statistics platform, etc.

[0112] See also Figure 4 , which is an event flow chart of the full data statistics architecture disclosed in an embodiment of the present invention.

[0113] Data collection rules, data source streams, and reporting events.

[0114] The full data statistics engine includes: rule engine, data source engine, full data statistics engine entry, calculation engine, and cache engine.

[0115] The data source engine is used to find the data source corresponding to the reported event; it is also used to uniformly manage business data sources according to business scenarios and provide operations such as add, delete, modify and query.

[0116] The rule engine is used to find the data collection rules corresponding to the reported events. It is also used to uniformly manage metadata collection rules according to business scenarios and provide operations such as add, delete, modify and query.

[0117] The full data statistics engine entrance is used to receive triggered reporting events and send the reporting events to the data source engine and rule engine.

[0118] The computing engine is used to generate complete data collection information according to the data source and the data collection rules, specifically to obtain complete data collection information from the data source according to the data collection rules.

[0119] The cache engine is used for business scenario caching, specifically storing the configuration information of the scenario and managing the page information within the scenario in a stack manner; it is also used for page information caching, specifically storing the configuration information of the current page and storing the configuration information of the source page.

[0120] It can be understood that in the embodiment of the present invention, the corresponding developers or product personnel configure the data source, data collection rules, and events in the data management background and send them to the mobile terminal; the APP on the mobile terminal enters the page in the business scenario, triggering the corresponding reporting event; the id of the reported event is sent to the data source engine and the rule engine through the MGDC portal; the data source engine searches for the corresponding data source according to the id of the reported event, and the rule engine searches for the data collection rule corresponding to the reported event according to the id of the reported event; the computing engine generates complete data collection information according to the data source information sent by the data source engine and the data collection rule sent by the rule engine; then the data collection information is sent to the corresponding data application party, and the data collection information is cached by the cache engine to obtain local persistent data, so as to provide data support for back-end intelligence.

[0121] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can refer to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system or system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can refer to the partial description of the method embodiment. The system and system embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without creative work.

[0122] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0123] The above description of the disclosed embodiments enables one skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A data reporting method, characterized in that: The method comprises: Receiving a reporting event sent by a user through a mobile terminal; the receiving of the reporting event sent by the user through the mobile terminal includes: when the user operates the mobile terminal to enter a page through a business scenario, caching the business scenario and page information, and receiving a reporting event triggered by the mobile terminal through the page based on the business scenario and the page information; the page information includes configuration information of the current page and configuration information of the source page; Find the data source and data collection rules corresponding to the reported event; the data collection rules include business rules, cache rules, global rules and context rules; Acquire complete data collection information from the data source according to the data collection rule; The method further comprises: The data source is managed uniformly according to the business scenario, wherein the management includes at least one of the following: adding, deleting, modifying or querying the data source; The data source is sent to the mobile terminal.

2. The method according to claim 1, characterized in that The method further comprises: The data collection rules are uniformly managed according to business scenarios, wherein the management includes at least one of the following: adding, deleting or modifying the data collection rules.

3. The method according to claim 1, characterized in that The method further comprises: Perform data verification on the data collection information.

4. The method according to claim 1, characterized in that: The step of searching for data sources and data collection rules corresponding to the reported events includes: Obtaining the identifier of the reported event through the reporting entry of the full data statistics engine; Find the data source and data collection rules corresponding to the identifier.

5. The method according to claim 1, characterized in that The data sources include: a business data source and a cache data source; The business rule defines the mapping relationship between metadata and the business data source in a key path manner; The cache rule defines the mapping relationship between metadata and the cache data source in a key path manner.

6. A data reporting device, characterized in that: The device comprises: A receiving unit, configured to receive a reporting event sent by a user through a mobile terminal; the receiving unit is specifically configured to cache the business scenario and page information when the user operates the mobile terminal to enter a page through a business scenario, and receive a reporting event triggered by the mobile terminal through the page based on the business scenario and the page information; the page information includes configuration information of the current page and configuration information of the source page; A search unit, used to search for a data source and a data collection rule corresponding to the reported event; the data collection rule includes a business rule, a cache rule, a global rule and a context rule; An acquisition unit, used for acquiring complete data acquisition information from the data source according to the data acquisition rule; The device also includes: A management unit, configured to uniformly manage the data source according to a business scenario, wherein the management includes at least one of the following: adding, deleting, modifying or querying the data source; The management unit is further used to send the data source to the mobile terminal.

7. The device according to claim 6, characterized in that The device also includes: A management unit is used to uniformly manage the data collection rules according to business scenarios, wherein the management includes at least one of the following: adding, deleting or modifying the data collection rules.

Images