A data processing method, apparatus and device

Abstract

The application provides a data processing method, device and equipment, the method comprises the following steps: obtaining real-time basic data of advertisement data from a first data system; obtaining real-time efficiency index data of the advertisement data from a second data system; updating basic data of target advertisement delivery data according to the real-time basic data; generating efficiency index key-value pair data according to the real-time efficiency index data, wherein one efficiency index key corresponds to at least one efficiency index value; storing the efficiency index key-value pair data in a target database; when the efficiency index key-value pair data changes is monitored through a listening event of the target database, generating an efficiency index data update instruction; updating efficiency index data of the target advertisement delivery data according to the efficiency index data update instruction. The scheme of the application can improve the real-time performance of the efficiency index data update of the advertisement delivery, and save the computing resources and the database input and output resources.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of computer information technology, and in particular to a data processing method, device and equipment. BACKGROUND

[0002] In the business logic of an advertising system, there are a large number of data matching problems: for example, a circle of friends advertisement can generate a large number of click, display, consumption data, consultation data and delivery result data. Among them, the advertising API (interface) of the advertising platform will only provide basic advertising display, click consumption and other data; and efficiency indicator data such as consultation data and delivery data needs to be obtained from a third-party CRM (customer relationship management system) or e-commerce API (interface). The efficiency indicator data and the advertising basic data are matched to form a complete advertising delivery data report.

[0003] In the prior art, these advertising delivery data reports need to be refreshed regularly. Data updating is updated in a polling manner, which is also a saturated update. Whether the data has changed or not, as long as the data is pulled, the data needs to be updated; the unchanged data also needs to execute the update database SQL (structured query language). This updating method will cause a large waste of computing resources, slow efficiency and affect the performance of the entire system. SUMMARY

[0004] The technical problem to be solved by the present application is to provide a data processing method, device and equipment, which can improve the real-time performance of advertising delivery efficiency indicator data updating, save computing resources and database IO resources.

[0005] To solve the above technical problems, the technical solutions of the present application are as follows:

[0006] A data processing method, the method comprising:

[0007] obtaining real-time basic data of advertising data from a first data system;

[0008] obtaining real-time efficiency indicator data of the advertising data from a second data system;

[0009] updating the basic data of the target advertising delivery data according to the real-time basic data;

[0010] generating efficiency indicator key-value pair data according to the real-time efficiency indicator data, wherein one efficiency indicator key corresponds to at least one efficiency indicator value;

[0011] storing the efficiency indicator key-value pair data in a target database;

[0012] The efficiency index data update instruction is generated when the efficiency index key-value pair data is changed through a listening event of the target database.

[0013] The efficiency index data of the target advertisement delivery data is updated according to the efficiency index data update instruction.

[0014] Optionally, the real-time basic data of the advertisement data is obtained from the first data system, and the real-time basic data includes:

[0015] The advertisement report data of the advertisement data is obtained from the first data system.

[0016] The real-time basic data is obtained from the advertisement report data, and the real-time basic data includes at least one of an advertisement identifier, a report date, data display, advertisement clicks, and consumption data; the advertisement identifier and the report date have a corresponding relationship index value.

[0017] Optionally, the real-time efficiency index data of the advertisement data is obtained from the second data system, and the real-time efficiency index data includes:

[0018] A plurality of real-time efficiency index data of a plurality of advertisement data is obtained from the second data system; the real-time efficiency index data includes at least one of lead data, order data, conversation data, and valid conversation data generated when the advertisement is delivered on an advertisement platform.

[0019] Optionally, the efficiency index key-value pair data is generated according to the real-time efficiency index data, and the efficiency index key-value pair data includes:

[0020] The creation time of at least one real-time efficiency index in the real-time efficiency index data, the advertisement identifier generating the efficiency index, and the real-time efficiency index identifier are obtained.

[0021] The creation time and the advertisement identifier are combined to form a key in the efficiency index key-value pair data, and the real-time efficiency index identifier is taken as a value in the efficiency index key-value pair data, to obtain the efficiency index key-value pair data.

[0022] Optionally, the efficiency index key-value pair data is stored in a target database, and the efficiency index key-value pair data includes:

[0023] Data with the same key in the efficiency index key-value pair data is stored as a set, and a plurality of values corresponding to the key is stored as elements in the set, to obtain a plurality of sets.

[0024] The plurality of sets is stored in the target database.

[0025] Optionally, the efficiency index key-value pair data is changed through a listening event of the target database, and the efficiency index key-value pair data includes:

[0026] The monitoring event of the target database is called to generate an efficiency index data update instruction when the length of the collection changes.

[0027] Optionally, the efficiency index data of the target advertisement delivery data is updated according to the efficiency index data update instruction, including:

[0028] The data length of the target collection in the target database is obtained according to the efficiency index data update instruction.

[0029] The efficiency index data of the target advertisement delivery data is updated to the data length of the target collection.

[0030] The application further provides a data processing apparatus, including:

[0031] The acquisition module is used for acquiring real-time basic data of advertisement data from a first data system and acquiring real-time efficiency index data of the advertisement data from a second data system.

[0032] The processing module is used for updating basic data of target advertisement delivery data according to the real-time basic data, generating efficiency index key-value pair data according to the real-time efficiency index data, wherein one efficiency index key corresponds to at least one efficiency index value, storing the efficiency index key-value pair data in a target database, generating an efficiency index data update instruction when the efficiency index key-value pair data changes through the monitoring event of the target database, and updating the efficiency index data of the target advertisement delivery data according to the efficiency index data update instruction.

[0033] The application further provides a computing device, including a processor and a memory storing a computer program, wherein the computer program is run by the processor to execute the method as above.

[0034] The application further provides a computer readable storage medium storing instructions, wherein the instructions are run on a computer to make the computer execute the method as above.

[0035] The above-mentioned scheme of the application at least has the following beneficial effects:

[0036] According to the scheme, real-time basic data of advertisement data is acquired from a first data system, real-time efficiency index data of the advertisement data is acquired from a second data system, basic data of target advertisement delivery data is updated according to the real-time basic data, efficiency index key-value pair data is generated according to the real-time efficiency index data, one efficiency index key corresponds to at least one efficiency index value, the efficiency index key-value pair data is stored in a target database, when the efficiency index key-value pair data changes, an efficiency index data update instruction is generated through a listening event of the target database, and efficiency index data of the target advertisement delivery data is updated according to the efficiency index data update instruction. The real-time performance of the efficiency index data update of the advertisement delivery can be improved, and the computing resources and the database IO resources are saved. BRIEF DESCRIPTION OF DRAWINGS

[0037] Figure 1 FIG. 1 is a flow diagram of a data processing method according to an embodiment of the present application;

[0038] Figure 2 FIG. 2 is a schematic diagram of basic data update of target advertisement delivery data according to an embodiment of the present application;

[0039] Figure 3 FIG. 3 is a schematic diagram of efficiency index data update of target advertisement delivery data according to an embodiment of the present application;

[0040] Figure 4 FIG. 4 is a structural schematic diagram of a data processing device according to an embodiment of the present application. DETAILED DESCRIPTION

[0041] Exemplary embodiments of the present application will be described more fully hereinafter with reference to the accompanying drawings. While example embodiments of the present application are shown in the drawings, it is understood that the present application can be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the application to those skilled in the art.

[0042] To better explain the present application, the present application first briefly introduces the technical background in the field of advertisement delivery. The advertisement is divided into a clue type advertisement and an e-commerce type advertisement. The clue type advertisement refers to an advertisement type for efficiently acquiring potential user clues through a one-party clue form or a three-party landing page. The user clue generally refers to personal information such as a user's contact information. That is, after a user clicks on an advertisement, a landing page guides the user to actively leave personal contact information, and relative to an advertisement owner, a user clue is acquired. The e-commerce type advertisement refers to a case where, after a user clicks on an advertisement, a landing page is a commodity page of a major e-commerce platform, and various commodity introductions guide the user to place an order.

[0043] In the advertisement delivery, an advertiser generally concerns an advertisement delivery data report which includes advertisement basic data and advertisement efficiency index data. The advertisement basic data includes data such as display, click and consumption generated by advertisement delivery, and the consumption refers to the cost of delivering the advertisement. The advertisement efficiency index data refers to data for evaluating the effect of advertisement delivery after the advertisement delivery, and the efficiency index includes the number of conversations, the number of effective conversations, the number of leads, the number of orders and the like. The efficiency index needs to be obtained by acquiring real-time efficiency index data from a business system of the advertiser, and then matching the acquired real-time efficiency index data with the corresponding advertisement to obtain. The real-time efficiency index data acquired from the business system of the advertiser refers to customer leads, orders and the like acquired after the advertiser delivers multiple advertisements.

[0044] Taking a lead advertisement as an example, the delivery link of a lead advertisement is as follows:

[0045] 1. The advertisement is displayed in an advertisement platform;

[0046] 2. The user opens a marketing landing page of the advertiser after clicking the advertisement;

[0047] 3. The user leaves his / her contact information if the user is interested in the service content displayed in the landing page;

[0048] 4. The user finally closes the landing page, and the delivery link of the advertisement ends.

[0049] Data generated in this process includes:

[0050] 1. Advertisement basic data (display, click, consumption);

[0051] 2. Real-time efficiency index data of the advertisement (the contact information left by the user enters a CRM (Customer Relationship Management) system of the advertiser).

[0052] In the CRM system of the advertiser, the real-time efficiency index data includes the IP, the device used, the location, the contact information of the user, and the advertisement landing page URL (Uniform Resource Locator) from which the information is sourced, and the advertisement ID (identifier) parameter given by the advertisement platform in the URL. For example, the advertisement landing page URL can be as follows: www.lanjin.com / index.html?ad_id=3621518326276 Wherein, the ad_id is the advertisement ID given by the advertisement platform, and the advertisement ID can be used to identify the user information (leads) stored in the system of the advertiser and to calculate the respective efficiency index of each advertisement. As shown in the following formula: Figure 1 An embodiment of the present application provides a data processing method, which comprises:

[0053] Step 11, obtaining real-time basic data of the advertising data from a first data system; here, the first data system refers to an advertising platform system, i.e. the system of the platform where the advertising is launched;

[0054] Step 12, obtaining real-time efficiency index data of the advertising data from a second data system;

[0055] Here, the second data system refers to the business system of the advertiser who launches the advertising, which can be an e-commerce platform system or a third-party CRM (customer relationship management system);

[0056] Step 13, updating the basic data of the target advertising launch data according to the real-time basic data;

[0057] Step 14, generating efficiency index key-value pair data according to the real-time efficiency index data, wherein one efficiency index key corresponds to at least one efficiency index value;

[0058] Step 15, storing the efficiency index key-value pair data in a target database; here, the target database can be a database based on a Key-Value (key-value) data structure;

[0059] Step 16, when the efficiency index key-value pair data is changed through the listening event of the target database, generating an efficiency index data update instruction;

[0060] Step 17, updating the efficiency index data of the target advertising launch data according to the efficiency index data update instruction.

[0061] In this embodiment, the basic data of the target advertising launch data is updated according to the real-time basic data of the target advertising pulled from the advertising platform system. The key-value pair is generated according to the real-time efficiency index data pulled from the advertiser platform, and the real-time efficiency index data is stored in the target database in the form of key-value pair. Through the method of listening to the new write event of the target database, the instruction for updating the efficiency index data is obtained. Thus, the disadvantage that the database needs to be queried even if there is no new clue in the prior art is avoided. Meanwhile, when the efficiency index is updated after the update instruction is obtained in the present application, the method of obtaining the length of the set where the changed key-value pair is located in the database is used, thus the disadvantage of full fuzzy matching in the prior art is avoided, and the calculation amount is greatly reduced.

[0062] In an optional embodiment of the present application, step 11 can include:

[0063] Step 111, obtaining advertising report data of the advertising data from the first data system;

[0064] Step 112, obtaining real-time basic data from the advertising report data; the real-time basic data includes at least one of an advertising identifier, a report date, data display, advertising clicks, and consumption data; the advertising identifier and the report date have a corresponding relationship index value.

[0065] In the embodiment, as shown in the figure, Figure 2 The advertising platform API (application programming interface) is connected to update the advertising report. The complete advertising hierarchy is advertising, creative, and material. Taking the advertising hierarchy as an example, first, the daily report of the advertising hierarchy needs to be connected, and the advertising daily report data is obtained after the corresponding interface is requested. The fields include: 1. advertising ID; 2. report date; 3. display; 4. clicks; and 5. consumption.

[0066] These fields can determine a basic data situation of an advertisement on a certain day. At this time, the real-time basic data is stored in the database. Generally, the advertising ID and the report date need to establish a joint index to improve the query efficiency. Because only the basic data is obtained at present, the efficiency data is not matched, so the efficiency data is set to 0 at this time.

[0067] As shown in the figure, Figure 3 In an optional embodiment of the application, step 12 can include:

[0068] Step 121, obtaining a plurality of real-time efficiency indicator data of a plurality of advertising data from a second data system; the real-time efficiency indicator data includes at least one real-time efficiency indicator of lead data, order data, conversation data, and valid conversation data generated by the advertising on the advertising platform.

[0069] In the embodiment, the advertiser system stores the lead, order, or conversation information left by the user after clicking the advertisement. Taking the lead data as an example, the advertiser system stores the lead (user information such as a mobile phone number), the creation time of the lead, the identifier of the lead, and the landing page URL of the lead. Because the landing page URL corresponds to the identifier of the landing page advertisement, by querying the lead data, it can be known that the lead is left by the user after browsing which advertisement. Through the creation time, it can be known that the lead comes from which day.

[0070] In an optional embodiment of the application, step 14 can include:

[0071] Step 141, obtaining the creation time of at least one real-time efficiency indicator in the real-time efficiency indicator data, the advertising identifier of generating the efficiency indicator, and the real-time efficiency indicator identifier;

[0072] Step 142, the creation time and the advertisement identification are composed into a key of the efficiency index key-value pair data, the real-time efficiency index identification is taken as a value in the efficiency index key-value pair data, and efficiency index key-value pair data is obtained.

[0073] In the embodiment, the creation time and the advertisement identification of the real-time efficiency index in the real-time efficiency index data are spliced into a string, and the string is taken as a key. The real-time efficiency index identification is taken as a value. Key-value pair data is obtained. Taking the number of leads efficiency index as an example, assuming that the creation time of a lead is a certain year, month and day; the landing page URL (Uniform Resource Locator) of the lead source is www.lanjin.com / index.html?wx_aid=3621518326276, and the advertisement identification in the URL is 3621518326276; the creation time and the advertisement identification are spliced into a string, that is, a certain year, month and day: 3621518326276. The string is taken as a key, and the lead identification of the lead is taken as a value. The lead is stored in a target database in the form of key-value pair.

[0074] In an optional embodiment of the application, step 15 can include:

[0075] Step 151, the data with the same key in the efficiency index key-value pair data is stored as a set, and the multiple values corresponding to the key are stored as elements in the set, and multiple sets are obtained.

[0076] Step 152, the multiple sets are stored in a target database.

[0077] In the embodiment, when the keys key of the multiple efficiency index key-value pair data obtained are the same, that is, the real-time efficiency index data is generated by the same advertisement on the same day, the set type is used to store the key-value pair data. After storage, multiple values exist in a set, and one value corresponds to one lead or order. The key of each value in a set is the same. The number of values (that is, the length of the set) stored in each set represents the number of efficiency indexes obtained by the advertisement corresponding to the key in one day.

[0078] In an optional embodiment of the application, step 16 can include:

[0079] Step 161, a listening event of the target database is called, and when it is monitored that the length of the set changes, an efficiency index data update instruction is generated.

[0080] In this embodiment, the service of starting the key monitoring strategy is used to monitor the set type key update in the target database. When a value is added to a key using the sadd (add one or more member elements to the set) command, the key monitoring strategy service has already obtained the action of adding a value to the set. If the added value is repeated, the monitoring will not respond because the length of the set does not change. If the added value is new, the length of the set + 1, at this time the monitoring service will be triggered, and after capturing the event, it means that the efficiency index number of the date and the advertisement has changed, and then the update SQL (Structured Query Language) can be executed in the database.

[0081] In an optional embodiment of the application, step 17 can include:

[0082] Step 171, according to the efficiency index data update instruction, obtaining the data length of the target set in the target database;

[0083] Step 172, updating the efficiency index data of the target advertisement delivery data to the data length of the target set.

[0084] In this embodiment, when the monitoring service is triggered, it means that the number of values of the key triggering the monitoring service has changed. The length of the set of the key is obtained, and the set length value is the efficiency index data value of the target advertisement delivery data.

[0085] The implementation process of the above method is further described in the following specific embodiment:

[0086] Embodiment 1, taking the number of leads as an example

[0087] 1. First, incrementally pull real-time efficiency index data from the third-party CRM system API and store it in your own data table. Real-time efficiency index data has two important fields: 1. Creation time 2. Landing page URL. The creation time is used to match the date of the advertisement, and through the creation time of the lead, it can be known that the lead comes from which day. The landing page URL field is used to match the specific advertisement. The advertisement platform first displays the advertisement, and the user clicks the advertisement to jump to the specific landing page and leaves the lead (mobile phone number). Therefore, the landing page URL represents the user who left the lead from which landing page. Since the landing page is opened from the advertising media, the advertising platform will attach the advertisement ID and other parameters to the back of the URL for developers to parse.

[0088] 2. Learn that the clue is from the ad with ID 3621518326276, assuming that the clue creation time is a certain year, month and day, the clue belongs to the ad with ID 3621518326276 on a certain year, month and day, at which time the clue can be attributed to a specific ad report.

[0089] 3. Concatenate the date and ad ID into a string of a certain year, month and day: 3621518326276, and store this string as the key and the clue ID as the value in the target database.

[0090] 4. At this time, the service of key monitoring strategy has been started, and the key is updated. The storage of the clue in the target database uses set data type, which can automatically remove the duplicate clue ID and ensure that each clue ID in the set is unique, so as to know the number of clues of the ad on the date by obtaining the length of the clue set of the ad on the date. Use the sadd command to add the clue ID to the key.

[0091] 5. The service has obtained the action of adding value to the set. If the clue ID is repeated, the listener will not respond because the length of the set does not change; if the clue ID is new, the length of the set + 1, at which time the listener service will be triggered, and after capturing the event, it means that the number of clues of the ad on the date has changed, then the latest number of clues can be updated in the database SQL, and the process is ended.

[0092] In the method embodiment of the present application, the listening event is a mechanism for monitoring and capturing events when the key changes. Specifically, the function of Keyspace Notifications can be used to publish notifications when the key of the efficiency indicator key value changes, and to monitor the changes in the key in real time, such as adding, modifying, deleting, and other events. To use the keyspace notification, the following parameters can be configured in the target database: In the configuration file of the target database, set the notify-keyspace-events parameter, for example: notify-keyspace-events Ex, where Ex indicates that the key expiration event (E) and the key deletion event (x) are subscribed. The available event types include: K: all keyspace events (set, del, etc.); E: expired event; x: delete event; g: general command (get, exists, etc.); $: string key (set, append, etc.); Further, specific channels can be subscribed through the SUBSCRIBE or PSUBSCRIBE command of the target database to listen to events, for example: PSUBSCRIBE__keyevent@0__:expired; this command is used to listen to the expiration event of all keys in the database. In this way, the efficiency indicator data update has strong real-time performance, and the publish / subscribe mechanism is used, without additional code logic, only the updated data triggers the data update SQL, greatly optimizing the performance overhead of data calculation.

[0093] The above embodiment of the present application writes a new clue into the target database, and then triggers the advertising report update SQL, directly omitting the fuzzy matching step, only leaving the relatively time-consuming step of updating the advertising report SQL. In the case of the same data size, only the step of pulling the advertising basic report is needed to poll, and the report data can be updated in ten minutes, greatly optimizing the overall report performance.

[0094] As shown in Figure 4 The embodiment of the present application further provides a data processing apparatus 40, comprising:

[0095] The acquisition module 41 is configured to acquire real-time basic data of advertising data from a first data system; and acquire real-time efficiency indicator data of the advertising data from a second data system;

[0096] The processing module 42 is configured to update the base data of the target advertisement delivery data according to the real-time base data, generate efficiency indicator key-value pair data according to the real-time efficiency indicator data, wherein one efficiency indicator key corresponds to at least one efficiency indicator value, store the efficiency indicator key-value pair data in a target database, generate an efficiency indicator data update instruction when the efficiency indicator key-value pair data changes through a listening event of the target database, and update the efficiency indicator data of the target advertisement delivery data according to the efficiency indicator data update instruction.

[0097] Optionally, the real-time base data of the advertisement data obtained from the first data system comprises:

[0098] Advertisement report data of the advertisement data obtained from the first data system;

[0099] The real-time base data is obtained from the advertisement report data, and the real-time base data comprises at least one of an advertisement identifier, a report date, data display, advertisement clicks, and consumption data; the advertisement identifier and the report date have a corresponding relationship index value.

[0100] Optionally, the real-time efficiency indicator data of the advertisement data obtained from the second data system comprises:

[0101] A plurality of real-time efficiency indicator data of a plurality of advertisement data is obtained from the second data system; the real-time efficiency indicator data comprises at least one real-time efficiency indicator of lead data, order data, conversation data, and valid conversation data generated when the advertisement is delivered on an advertisement platform.

[0102] Optionally, the efficiency indicator key-value pair data is generated according to the real-time efficiency indicator data, comprising:

[0103] The creation time of at least one real-time efficiency indicator in the real-time efficiency indicator data, the advertisement identifier generating the efficiency indicator, and the real-time efficiency indicator identifier are obtained;

[0104] The creation time and the advertisement identifier are combined to form a key in the efficiency indicator key-value pair data, the real-time efficiency indicator identifier is taken as a value in the efficiency indicator key-value pair data, and efficiency indicator key-value pair data is obtained.

[0105] Optionally, the efficiency indicator key-value pair data is stored in the target database, comprising:

[0106] Data with the same key in the efficiency indicator key-value pair data is stored as a set, and a plurality of values corresponding to the key is stored as an element in the set, and a plurality of sets is obtained;

[0107] The plurality of sets is stored in the target database.

[0108] Optionally, the change of the efficiency indicator key-value pair data is monitored through a listening event of the target database, and the listening event includes:

[0109] The listening event of the target database is called to generate an efficiency indicator data update instruction when the length of the collection changes.

[0110] Optionally, the efficiency indicator data of the target advertisement delivery data is updated according to the efficiency indicator data update instruction, and the updating includes:

[0111] The data length of the target collection in the target database is obtained according to the efficiency indicator data update instruction.

[0112] The efficiency indicator data of the target advertisement delivery data is updated to the data length of the target collection.

[0113] It should be noted that the device corresponds to the above method, and all implementation manners in the above method embodiments are applicable to the embodiments of the device and can achieve the same technical effects.

[0114] Embodiments of the application also provide a computing device, comprising a processor and a memory storing a computer program, the computer program being executed by the processor to perform the above method. All implementation manners in the above method embodiments are applicable to this embodiment and can achieve the same technical effects.

[0115] Embodiments of the application also provide a computer readable storage medium storing instructions, the instructions being executed on a computer to make the computer perform the above method. All implementation manners in the above method embodiments are applicable to this embodiment and can achieve the same technical effects.

[0116] Those skilled in the art can realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the application.

[0117] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiments, which will not be described here.

[0118] In the embodiments of the present application, it should be understood that the disclosed apparatus and method can be implemented in other manners. For example, the embodiments of the apparatus described above are merely schematic, and the division of the units is merely logical function division, and there can be another division manner in actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections can be indirect couplings or communication connections through some interfaces, devices or units, and can be in electrical, mechanical or other forms.

[0119] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, i.e., can be located in one place, or can be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purposes of the embodiments.

[0120] In addition, each functional unit in the various embodiments of the present application can be integrated in one processing unit, or each unit can be a physically independent unit, or two or more units can be integrated in one unit.

[0121] If the functions are implemented in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application essentially or the part that contributes to the prior art or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The foregoing storage medium includes: U disk, mobile hard disk, ROM, RAM, magnetic disk or optical disk, and various other media that can store program codes.

[0122] Moreover, it is pointed out that in the device and method of the present application, obviously, the components or steps can be decomposed and / or recombined. These decompositions and / or recombination should be considered as equivalent solutions of the present application. Also, the steps of performing the above series of processes can naturally be executed in time sequence according to the order of description, but do not necessarily have to be executed in time sequence. Some steps can be executed in parallel or independently of each other. It can be understood by those skilled in the art that all or any steps or components of the method and device of the present application can be implemented in hardware, firmware, software or a combination thereof in any computing device (including a processor, a storage medium, etc.) or a network of computing devices, using the basic programming skills of those skilled in the art upon reading the description of the present application.

[0123] Therefore, the object of the present application can also be achieved by running a program or a set of programs on any computing device. The computing device can be a commonly known general-purpose device. Therefore, the object of the present application can also be achieved only by providing a program product containing program code for implementing the method or device. That is, such a program product also constitutes the present application, and a storage medium storing such a program product also constitutes the present application. Obviously, the storage medium can be any commonly known storage medium or any storage medium developed in the future. It is also pointed out that in the device and method of the present application, obviously, the components or steps can be decomposed and / or recombined. These decompositions and / or recombination should be considered as equivalent solutions of the present application. Also, the steps of performing the above series of processes can naturally be executed in time sequence according to the order of description, but do not necessarily have to be executed in time sequence. Some steps can be executed in parallel or independently of each other.

[0124] The above is the preferred embodiment of the present application. It should be pointed out that for those skilled in the art, several improvements and refinements can be made without departing from the principles of the present application, and these improvements and refinements should also be considered as the protection scope of the present application.

Claims

1. A data processing method, characterized by, include: Obtain real-time basic data for lead-based advertising from the first data system; Obtain real-time efficiency metrics data of the lead-type advertising data from the second data system; Based on the aforementioned real-time basic data, the basic data of the target ad delivery data is updated; Based on the real-time efficiency index data, generate efficiency index key-value pair data, where one efficiency index key corresponds to at least one efficiency index value. The efficiency index key-value pair data is stored in the target database; By listening to the events of the target database, when a change is detected in the data of the efficiency indicator key-value pair, an efficiency indicator data update instruction is generated. According to the efficiency index data update instruction, update the efficiency index data of the target advertising delivery data; The real-time basic data for obtaining lead-based advertising data from the first data system includes: Ad report data obtained from the first data system for lead-based advertising data; Real-time basic data is obtained from the advertising report data; the real-time basic data includes at least one of: advertising identifier, report date, data display, advertising click, and consumption data; the advertising identifier and the report date have corresponding index values; The real-time efficiency metrics data for obtaining the lead-based advertising data from the second data system include: The second data system obtains multiple real-time efficiency metrics from multiple lead-type advertising data; the real-time efficiency metrics include at least one of the following: lead data, order data, dialogue data, and effective dialogue data generated when the advertisement is placed on the advertising platform, wherein the lead data is the advertisement ID assigned by the advertising platform; Specifically, based on the real-time efficiency index data, efficiency index key-value pair data is generated, including: Obtain the creation time of at least one real-time efficiency indicator from the real-time efficiency indicator data, the advertisement identifier that generated the efficiency indicator, and the real-time efficiency indicator identifier. The creation time and the advertising identifier are used as the keys in the efficiency indicator key-value pair data, and the real-time efficiency indicator identifier is used as the value in the efficiency indicator key-value pair data to obtain the efficiency indicator key-value pair data. The keys in the efficiency metric key-value pair data, which combine the creation time and the advertising identifier, include: The creation time and the advertisement identifier are concatenated into a string to form the key; The storage of the efficiency index key-value pair data in the target database includes: The data with the same key in the efficiency index key-value pair data are stored into a set, and the multiple values ​​corresponding to the key are stored as elements in the set, thus obtaining multiple sets; The multiple sets are stored in the target database; the specific process is as follows: When multiple efficiency metric key-value pairs have the same key, the key-value pairs are stored using a collection type. After storage, a collection contains multiple values, with each value corresponding to a lead or order. The keys of each value in a collection are the same. The number of values ​​stored in each collection represents the efficiency metrics obtained by the advertisement corresponding to that key in a day. Specifically, by monitoring events in the target database, changes in the efficiency metric key-value pair data are detected, including: The system invokes the target database's monitoring events. When a change in the length of the set is detected, an efficiency indicator data update instruction is generated. Specifically, a notification is issued when the key of the efficiency indicator key value changes, and the changes in the key are monitored in real time, including add, modify, and delete events. Events are monitored by subscribing to a preset command channel of the target database. The process of updating the efficiency index data of the target advertising delivery data according to the efficiency index data update instruction includes: According to the efficiency index data update instruction, obtain the data length of the target set in the target database; The efficiency index data of the target ad delivery data is updated to the data length of the target set. When the listening event is triggered, it means that the number of values ​​of the key that triggered the listening event has changed. The length of the set of the key is obtained. The set length value is the efficiency index data value of the target ad delivery data. Specifically, real-time efficiency metrics data are incrementally retrieved from the application programming interface (API) of third-party systems. The real-time efficiency metrics data includes the creation time and the landing page URL. The creation time is used to match the date of the advertisement, and the landing page URL field is used to match the specific advertisement. The advertising platform appends the advertisement ID parameter to the URL for parsing. The date and ad ID are concatenated into a string in a preset format. This string is used as the key, and the lead ID is used as the value. The string is then stored in the target database. The service listens for key updates in the start key listening strategy. Leads are stored in the target database using the set data type. The set type automatically removes duplicate lead IDs, ensuring that each lead ID in the set is unique. The length of the lead set for the preset date ad is obtained to get the number of leads for the ad on the preset date. Lead IDs are added to this key using the sadd command. The service receives the action of adding a value to the set. If the lead ID is duplicated, the set length will not change and the listener will not respond. If the lead ID is newly added, the set length will be incremented by 1 and the listener service will be triggered. If the number of leads for the preset date ad changes after the event is captured, an update SQL will be executed in the database to change the number of leads in the data report to the latest number of leads.

2. A data processing apparatus, characterized by, include: The acquisition module is used to acquire real-time basic data of lead-based advertising data from the first data system; Obtain real-time efficiency metrics data of the lead-type advertising data from the second data system; The processing module is used to update the basic data of the target advertising delivery data based on the real-time basic data; generate efficiency indicator key-value pair data based on the real-time efficiency indicator data, wherein one efficiency indicator key corresponds to at least one efficiency indicator value; store the efficiency indicator key-value pair data in the target database; generate an efficiency indicator data update instruction when a change in the efficiency indicator key-value pair data is detected through the listening event of the target database; and update the efficiency indicator data of the target advertising delivery data according to the efficiency indicator data update instruction. The real-time basic data for obtaining lead-based advertising data from the first data system includes: Ad report data obtained from the first data system for lead-based advertising data; Real-time basic data is obtained from the advertising report data; the real-time basic data includes at least one of: advertising identifier, report date, data display, advertising click, and consumption data; the advertising identifier and the report date have corresponding index values; The real-time efficiency metrics data for obtaining the lead-based advertising data from the second data system include: The second data system obtains multiple real-time efficiency metrics from multiple lead-type advertising data; the real-time efficiency metrics include at least one of the following: lead data, order data, dialogue data, and effective dialogue data generated when the advertisement is placed on the advertising platform, wherein the lead data is the advertisement ID assigned by the advertising platform; Specifically, based on the real-time efficiency index data, efficiency index key-value pair data is generated, including: Obtain the creation time of at least one real-time efficiency indicator from the real-time efficiency indicator data, the advertisement identifier that generated the efficiency indicator, and the real-time efficiency indicator identifier. The creation time and the advertising identifier are used as the keys in the efficiency indicator key-value pair data, and the real-time efficiency indicator identifier is used as the value in the efficiency indicator key-value pair data to obtain the efficiency indicator key-value pair data. The keys in the efficiency metric key-value pair data, which combine the creation time and the advertising identifier, include: The creation time and the advertisement identifier are concatenated into a string to form the key; The storage of the efficiency index key-value pair data in the target database includes: The data with the same key in the efficiency index key-value pair data are stored into a set, and the multiple values ​​corresponding to the key are stored as elements in the set, thus obtaining multiple sets; The multiple sets are stored in the target database; the specific process is as follows: When multiple efficiency metric key-value pairs have the same key, the key-value pairs are stored using a collection type. After storage, a collection contains multiple values, with each value corresponding to a lead or order. The keys of each value in a collection are the same. The number of values ​​stored in each collection represents the efficiency metrics obtained by the advertisement corresponding to that key in a day. Specifically, by monitoring events in the target database, changes in the efficiency metric key-value pair data are detected, including: The system invokes the target database's monitoring events. When a change in the length of the set is detected, an efficiency indicator data update instruction is generated. Specifically, a notification is issued when the key of the efficiency indicator key value changes, and the changes in the key are monitored in real time, including add, modify, and delete events. Events are monitored by subscribing to a preset command channel of the target database. The process of updating the efficiency index data of the target advertising delivery data according to the efficiency index data update instruction includes: According to the efficiency index data update instruction, obtain the data length of the target set in the target database; The efficiency index data of the target ad delivery data is updated to the data length of the target set. When the listening event is triggered, it means that the number of values ​​of the key that triggered the listening event has changed. The length of the set of the key is obtained. The set length value is the efficiency index data value of the target ad delivery data. Specifically, real-time efficiency metrics data are incrementally retrieved from the application programming interface (API) of third-party systems. The real-time efficiency metrics data includes the creation time and the landing page URL. The creation time is used to match the date of the advertisement, and the landing page URL field is used to match the specific advertisement. The advertising platform appends the advertisement ID parameter to the URL for parsing. The date and ad ID are concatenated into a string in a preset format. This string is used as the key, and the lead ID is used as the value. The string is then stored in the target database. The service listens for key updates in the start key listening strategy. Leads are stored in the target database using the set data type. The set type automatically removes duplicate lead IDs, ensuring that each lead ID in the set is unique. The length of the lead set for the preset date ad is obtained to get the number of leads for the ad on the preset date. Lead IDs are added to this key using the sadd command. The service receives the action of adding a value to the set. If the lead ID is duplicated, the set length will not change and the listener will not respond. If the lead ID is newly added, the set length will be incremented by 1 and the listener service will be triggered. If the number of leads for the preset date ad changes after the event is captured, an update SQL will be executed in the database to change the number of leads in the data report to the latest number of leads.

3. A computing device, comprising: include: A processor and a memory storing a computer program, wherein the computer program, when executed by the processor, performs the method as described in claim 1.

4. A computer-readable storage medium, characterized in that, Store instructions that, when executed on a computer, cause the computer to perform the method as described in claim 1.

Images