An activity data aggregation processing platform and method thereof

Abstract

The application relates to an activity data collection processing platform and a method thereof, which comprises an execution platform, an activity management platform, a big data platform and a job platform, the execution platform is connected with the activity management platform, the activity management platform is connected with the big data platform and the job platform respectively, the execution platform is used for receiving original winning data of a user; the activity management platform analyzes and processes the original winning data according to a pre-configured awarding strategy, generates an awarding file through an offline batch running mode and transmits the awarding file to the job platform; the big data platform is used for executing data warehousing operation and performing awarding information completion operation; the job platform executes corresponding awarding processes according to the awarding file and feeds back an awarding result file to the activity management platform. Compared with the prior art, the application can centrally and uniformly process all activity data and quickly and accurately generates awarding files corresponding to different activity channel parties.

Description

Technical Field

[0001] This invention relates to the field of data processing technology, and in particular to an activity data collection and processing platform and method. Background Technology

[0002] In existing marketing campaigns, prizes are often awarded to enrich the experience and increase user engagement.

[0003] Since prize distribution data is often massive and corresponds to different rule parameters, in existing technical solutions, each activity execution platform directly connects to the prize distribution platform. For activity data that requires prize distribution, each activity channel generates corresponding prize distribution files according to the requirements of each platform. This results in activity data being scattered across various channels, making it impossible to collect and analyze all activity data in a unified manner. In addition, when businesses conduct activities on different systems to distribute the same type of prizes, each channel needs to generate prize distribution messages or files according to the relevant requirements of the prize distribution platform. This leads to problems of redundant development of functions, wasted resources and costs, and also makes it impossible to quickly analyze the cost consumption of all company activities. Summary of the Invention

[0004] The purpose of this invention is to overcome the shortcomings of the existing technology by providing an activity data collection and processing platform and method that can centrally process all activity data and quickly and accurately generate award documents.

[0005] The objective of this invention can be achieved through the following technical solution: an activity data collection and processing platform, comprising an execution platform, an activity management platform, a big data platform, and a job platform, wherein the execution platform is connected to the activity management platform, the activity management platform is connected to the big data platform and the job platform respectively, and the execution platform is used to receive the user's original winning data;

[0006] The activity management platform analyzes and processes the original winning data according to the pre-configured prize distribution strategy, generates prize distribution files through offline batch processing, and transmits them to the operation platform.

[0007] The big data platform is used to perform data warehousing operations and to complete prize information.

[0008] The operating platform executes the corresponding award distribution process according to the award distribution document and sends the award distribution result document back to the activity management platform.

[0009] Furthermore, the big data platform is equipped with an offline data warehouse, which is used for full synchronization of the prize distribution plan table and incremental synchronization of the prize winning data table.

[0010] Furthermore, the offline data warehouse is specifically an HBase data warehouse.

[0011] Furthermore, the aforementioned work platform connects with various activity channels.

[0012] Furthermore, the execution platform is connected to the activity management platform via a data interface.

[0013] A method for collecting and processing activity data includes the following steps:

[0014] S1. When a user participates in an activity on the execution platform, the execution platform obtains the user's original winning data accordingly.

[0015] S2. The execution platform synchronously transmits the original winning data to the activity management platform;

[0016] S3. The activity management platform verifies the received original winning data, and then transmits all the original winning data from the previous day to the big data platform through data warehouse technology.

[0017] The event management platform also generates a prize distribution plan based on the pre-configured prize distribution strategy;

[0018] S4. The big data platform associates the original winning data, the prize distribution plan table, and the card distribution core table to complete the prize distribution information of the original winning data, obtain the preliminary prize distribution document, and transmit it to the activity management platform.

[0019] S5. The activity management platform reviews the preliminary award documents, obtains the approved award documents, and transmits the award documents to the corresponding work platform.

[0020] S6. The work platform executes the award process corresponding to the award document and returns the award result document to the activity management platform.

[0021] Furthermore, in step S3, the activity management platform specifically verifies the data fields of the original winning data according to the set docking rules.

[0022] Furthermore, in step S3, the activity management platform specifically calculates the activity data that needs to be awarded on that day and stores it in the generated award plan table by running the set timed tasks and according to the pre-configured award strategy.

[0023] Furthermore, step S4 specifically includes the following steps:

[0024] S41. The big data platform receives the original winning data and updates the winning data table.

[0025] S42. The big data platform links the winning data table with the prize distribution plan table to obtain a detailed list of prizes to be distributed on that day;

[0026] S43. The big data platform associates the detailed list of prizes to be awarded that day with the core card issuance table to complete the user address, contact information, account number and card number information, obtain the preliminary prize issuance document, and transmit it to the activity management platform.

[0027] Furthermore, in step S43, the big data platform specifically uses user ID information to associate the detailed list of awards to be issued that day with the core table.

[0028] Compared with the prior art, the present invention has the following advantages:

[0029] I. This invention establishes an execution platform, an activity management platform, a big data platform, and a work platform. The execution platform receives users' raw winning data. The activity management platform analyzes and processes the raw winning data according to a pre-configured prize distribution strategy, generates prize distribution files through offline batch processing, and transmits them to the work platform. The big data platform performs data warehousing operations and prize distribution information completion operations. The work platform executes the corresponding prize distribution process according to the prize distribution files and feeds back the prize distribution result files to the activity management platform. This allows the entire collection and processing platform to be uniformly connected to various work platforms. Each activity channel only needs to provide common winning data according to the connection requirements of the activity management platform, avoiding the problem of redundant development of functions and effectively saving resource costs.

[0030] Second, in this invention, the activity management platform is connected to the big data platform. The activity management platform generates prize files by configuring prize distribution strategies and combining Spark offline batch processing, while the big data platform uses an offline data warehouse to fully synchronize the prize distribution plan table and incrementally synchronize the winning data table, thereby enabling efficient and accurate processing of massive activity data.

[0031] Third, this invention utilizes a big data platform to link the winning data table, the prize distribution plan table, and the card issuance core table to determine the prize distribution details list and complete the prize distribution information for the winning data. This not only ensures the accuracy of the prize distribution documents but also facilitates the subsequent calculation of activity operation costs, providing decision-making data support for the operation of the activity and thus saving on later activity cost consumption. Attached Figure Description

[0032] Figure 1 This is a schematic diagram of the platform system structure of the present invention;

[0033] Figure 2 This is a schematic diagram of the method flow of the present invention;

[0034] Figure 3 This is a schematic diagram of the platform architecture in the embodiment;

[0035] The markings in the diagram are as follows: 1. Execution platform, 2. Activity management platform, 3. Big data platform, 4. Job platform. Detailed Implementation

[0036] The present invention will now be described in detail with reference to the accompanying drawings and specific embodiments.

[0037] Example

[0038] like Figure 1 As shown, an activity data collection and processing platform includes an execution platform 1, an activity management platform 2, a big data platform 3, and an operation platform 4. The execution platform 1 is connected to the activity management platform 2, the activity management platform 2 is connected to the big data platform 3 and the operation platform 4 respectively, the operation platform 4 is connected to different activity channels, and the execution platform 1 is used to receive users' original winning data.

[0039] The activity management platform 2 analyzes and processes the original winning data according to the pre-configured prize distribution strategy, generates prize distribution files through Spark offline batch processing, and transmits them to the job platform 4.

[0040] The big data platform is used to perform data warehousing operations and to complete prize information.

[0041] The work platform 4 executes the corresponding award process according to the award document and sends the award result document back to the activity management platform 2.

[0042] Specifically, execution platform 1 is connected to activity management platform 2 via a data interface. Big data platform 3 has an offline data warehouse, which is used for full synchronization of the prize distribution plan table and incremental synchronization of the winning data table. In this embodiment, the offline data warehouse is specifically an HBase data warehouse.

[0043] The aforementioned platform system is applied in practice to implement a method for collecting and processing activity data, such as... Figure 2 As shown, it includes the following steps:

[0044] S1. When a user participates in an activity on the execution platform, the execution platform obtains the user's original winning data accordingly.

[0045] S2. The execution platform synchronously transmits the original winning data to the activity management platform;

[0046] S3. The activity management platform verifies the received original winning data, and then transmits all the original winning data from the previous day to the big data platform through data warehouse technology.

[0047] The event management platform also generates a prize distribution plan based on the pre-configured prize distribution strategy;

[0048] Specifically, the event management platform verifies the data fields of the original winning data according to the set connection rules;

[0049] The event management platform runs pre-defined scheduled tasks and calculates the event data that needs to be awarded on that day based on the pre-configured award strategy, and stores it in the generated award plan table.

[0050] S4. The big data platform associates the original winning data, the prize distribution plan table, and the card distribution core table to complete the prize distribution information of the original winning data, obtain the preliminary prize distribution document, and transmit it to the activity management platform.

[0051] Specifically, the big data platform receives the original winning data and updates the winning data table;

[0052] Then, the winning data table is linked to the prize distribution plan table to obtain a detailed list of prizes to be distributed that day;

[0053] Then, by using the user's ID number information, the detailed list of prizes to be awarded that day is linked to the card issuance core table to complete the user's address, contact information, account number, and card number information, thereby obtaining the preliminary prize issuance document and transmitting it to the activity management platform;

[0054] S5. The activity management platform reviews the preliminary award documents, obtains the approved award documents, and transmits the award documents to the corresponding work platform.

[0055] S6. The work platform executes the award process corresponding to the award document and returns the award result document to the activity management platform.

[0056] In summary, the business process involved in this technical solution is as follows: users participate in activities on the execution platform, and then the execution platform outputs the obtained activity data to the activity management platform through interfaces and files. The activity management platform, in conjunction with a big data platform, stores the prize data in a data warehouse and generates prize files through offline batch processing. This embodiment applies the above technical solution, and the platform system architecture constructed is as follows: Figure 3 As shown, its data flow process includes:

[0057] 1. Users participate in the activity, and the platform obtains the users' original winning data;

[0058] 2. The execution platform will synchronously transmit the user's original winning data to the activity management platform;

[0059] Third, during the data reception and collection phase, the activity management platform verifies the data fields of the original winning data according to the set docking rules;

[0060] IV. The activity management platform will transmit all original winning data after verification on T-1 day to the big data platform through data warehouse technology;

[0061] 5. The big data platform completes the account number, address, and card number information of the original winning data and then sends it back to the activity management platform;

[0062] VI. The event management platform generates award documents based on the data supplemented by the big data platform, which are then reviewed by the business team.

[0063] 7. After the award documents are approved, they will be sent to the event operation platform (core, gift group, third party);

[0064] 8. The event operation platform (core, gift group, third party) sends the prize distribution result file to the event management platform to update the result status.

[0065] In this embodiment, business personnel pre-configure the prize distribution cycle strategy on the activity management platform. The activity management platform then runs a scheduled task, calculating the list of activities requiring prize distribution each day at midnight based on the configured prize distribution strategy, and storing it in the prize distribution plan table. The HBase data warehouse performs full daily synchronization of the prize distribution plan preparation table and incremental synchronization of the winning data table. By associating the winning data table with the prize distribution plan table in HBase, a detailed list of prizes to be distributed today is obtained. Then, by associating the ID number with the card issuance core table, information such as user address, mobile phone number, account number, and card number is obtained. The big data platform generates prize distribution files and transmits them to the activity management platform. The activity management platform generates corresponding prize distribution files based on the prize type and the job platform. After completing the prize distribution process, the job platform sends back the prize distribution result file to the activity management platform for parsing.

[0066] Compared to the approach of each activity channel connecting to its own operating platform, this technical solution avoids redundant development of functional code and ensures that each activity channel accurately receives the corresponding prize distribution documents. In addition, the activity management platform uses Spark offline batch processing to compute massive amounts of data and generate prize distribution documents, effectively improving data processing efficiency.

Claims

1. A method for collecting and processing activity data, implemented using an activity data collection and processing platform, characterized in that, The activity data collection and processing platform includes an execution platform (1), an activity management platform (2), a big data platform (3), and a work platform (4). The execution platform (1) is connected to the activity management platform (2), and the activity management platform (2) is connected to the big data platform (3) and the work platform (4) respectively. The execution platform (1) is used to receive the user's original winning data. The activity management platform (2) analyzes and processes the original winning data according to the pre-configured award strategy, generates award files through offline batch processing, and transmits them to the operation platform (4). The big data platform (3) is used to perform data warehousing operations and to complete prize information; The operation platform (4) executes the corresponding award process according to the award document and feeds back the award result document to the activity management platform (2); The above-mentioned activity data collection and processing method includes the following steps: S1. When a user participates in an activity on the execution platform, the execution platform obtains the user's original winning data accordingly. S2. The execution platform synchronously transmits the original winning data to the activity management platform; S3. The activity management platform verifies the received original winning data, and then transmits all the original winning data from the previous day to the big data platform through data warehouse technology. The event management platform also generates a prize distribution plan based on the pre-configured prize distribution strategy; S4. The big data platform associates the original winning data, the prize distribution plan table, and the card distribution core table to complete the prize distribution information of the original winning data, obtain the preliminary prize distribution document, and transmit it to the activity management platform. S5. The activity management platform reviews the preliminary award documents, obtains the approved award documents, and transmits the award documents to the corresponding work platform. S6. The work platform executes the award distribution process corresponding to the award distribution document and returns the award distribution result document to the activity management platform; Step S4 specifically includes the following steps: S41. The big data platform receives the original winning data and updates the winning data table. S42. The big data platform links the winning data table with the prize distribution plan table to obtain a detailed list of prizes to be distributed on that day; S43. The big data platform associates the detailed list of prizes to be awarded that day with the core card issuance table to complete the user address, contact information, account number and card number information, obtain the preliminary prize issuance document, and transmit it to the activity management platform.

2. The activity data collection and processing method according to claim 1, characterized in that, The big data platform (3) is equipped with an offline data warehouse, which is used for full synchronization of the prize distribution plan table and incremental synchronization of the prize winning data table.

3. The activity data collection and processing method according to claim 2, characterized in that, The offline data warehouse is specifically an HBase data warehouse.

4. The activity data collection and processing method according to claim 1, characterized in that, The operating platform (4) connects to different activity channels.

5. The activity data collection and processing method according to claim 1, characterized in that, The execution platform (1) is connected to the activity management platform (2) through a data interface.

6. The activity data collection and processing method according to claim 1, characterized in that, In step S3, the activity management platform specifically verifies the data fields of the original winning data according to the set docking rules.

7. The activity data collection and processing method according to claim 1, characterized in that, In step S3, the activity management platform specifically runs a set scheduled task and calculates the activity data that needs to be awarded on that day according to the pre-configured award strategy, and stores it in the generated award plan table.

8. The activity data collection and processing method according to claim 1, characterized in that, In step S43, the big data platform specifically uses user ID information to associate the detailed list of awards to be issued that day with the core card issuance table.

Images