Data processing strategy test method and device
By receiving and updating compressed files to reduce the cost of synchronizing massive data across cities and determining bidding results based on target indicator storage tables and test plans, efficient testing of data processing strategies for multiple test groups is achieved, solving the problems of high testing costs and low efficiency in the existing technology.
Patent Information
- Application Number
- CN202411504404.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-26
- Publication Date
- 2025-03-25
AI Technical Summary
The testing cost of data processing strategies in the prior art is high and inefficient, mainly due to the need to repeatedly synchronize massive data across cities, resulting in huge bandwidth and storage resources consumption.
By receiving the compressed files sent by the second server, the current indicator storage table is updated, the target indicator storage table is obtained, the bandwidth and storage cost of synchronizing massive data across cities is reduced, and the bidding results are determined based on the target indicator storage table, bidding requests and test plans are determined, so as to realize one-time test comparison of data processing strategies of multiple test groups.
It reduces the cost of data processing strategy testing, improves testing efficiency, and can test and compare data processing strategies of multiple test groups at one time.
Smart Images

Figure CN119690817A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of information processing technology, and in particular to a data processing strategy testing method and device. Background Art
[0002] Currently, when advertising, it is necessary to configure a reasonable data processing strategy based on massive user data in order to obtain the maximum benefit under a limited marketing budget. Therefore, it is necessary to test the data processing strategy to support the continuous optimization and iteration of the data processing strategy. However, in the prior art, it is necessary to repeatedly configure the data processing strategy to test the optimal data processing strategy. Since the server that produces user data and the server that configures the data processing strategy are usually not in the same city, massive data needs to be synchronized across cities each time the configuration is performed. Repeated synchronization of massive data consumes a lot of bandwidth resources and storage resources, resulting in high cost and low efficiency for testing the data processing strategy. Therefore, how to further reduce the cost of testing data processing strategies and improve testing efficiency has become a technical problem that needs to be further solved. Summary of the invention
[0003] The present application proposes a data processing strategy testing method and device to solve the problem of high cost and low efficiency in testing data processing strategies, reduce the cost of testing data processing strategies, and improve testing efficiency.
[0004] In a first aspect, an embodiment of the present application provides a data processing strategy testing method, which is applied to a first server of a data processing strategy testing system, wherein the data processing strategy testing system includes the first server, a second server, and a media server, and the method includes:
[0005] receiving a compressed file sent by the second server, where the compressed file is obtained by the second server compressing a target byte stream file, where the target byte stream file is used to indicate user indicators of all users;
[0006] Update the current indicator storage table according to the compressed file to obtain a target indicator storage table, wherein the target indicator storage table stores valid user indicators, and the valid user indicators are user indicators in a corresponding life cycle;
[0007] Acquire a test plan, the test plan including multiple test groups, each of the multiple test groups including a bound account and a test strategy, the test strategy being used to characterize a data processing strategy for a test;
[0008] When a bidding request sent by the media server is detected, determining a bidding result according to the bidding request, the test scheme and the target indicator storage table;
[0009] The bidding result is sent to the media server to receive the delivery status returned by the media server in response to the bidding result.
[0010] In a second aspect, an embodiment of the present application provides a data processing strategy testing device, which is applied to a first server of a data processing strategy testing system, wherein the data processing strategy testing system includes the first server, the second server, and a media server, and the device includes:
[0011] A first receiving unit is used to receive a compressed file sent by the second server, where the compressed file is obtained by the second server compressing a target byte stream file, where the target byte stream file is used to indicate user indicators of all users;
[0012] The first processing unit is used to update the current indicator storage table according to the compressed file to obtain the target indicator storage table, wherein the target indicator storage table stores effective user indicators, and the effective user indicators are user indicators in the corresponding life cycle; obtain a test plan, wherein the test plan includes multiple test groups, each of the multiple test groups includes a binding account and a test strategy, and the test strategy is used to characterize the data processing strategy for the test; when a bidding request sent by the media server is detected, determine the bidding result according to the bidding request, the test plan and the target indicator storage table; send the bidding result to the media server to receive the delivery status returned by the media server in response to the bidding result.
[0013] In a third aspect, an embodiment of the present application provides a server, comprising a processor, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing the steps in the method described in any one of the first aspects.
[0014] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program / instruction stored thereon, wherein the computer program / instruction, when executed by a processor, implements the steps of the method described in any one of the first aspects.
[0015] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program / instruction, which, when executed by a processor, implements part or all of the steps of the method described in any one of the first aspects of the embodiments of the present application.
[0016] It can be seen that in the present application, the first server receives a compressed file sent by the second server, the compressed file is obtained by the second server compressing the target byte stream file, and the target byte stream file is used to indicate the user indicators of all users; the current indicator storage table is updated according to the compressed file to obtain the target indicator storage table, the target indicator storage table stores valid user indicators, and the valid user indicators are user indicators in the corresponding life cycle; a test plan is obtained, the test plan includes multiple test groups, each of the multiple test groups includes a binding account and a test strategy, and the test strategy is used to characterize the data processing strategy for the test; when a bidding request sent by the media server is detected, the bidding result is determined according to the bidding request, the test plan and the target indicator storage table; the bidding result is sent to the media server to receive the delivery status returned by the media server in response to the bidding result. Since the current indicator storage table is updated according to the received compressed file to obtain the target indicator storage table, the bandwidth cost and storage cost of a single cross-city synchronization of massive data are reduced. In addition, the bidding result is determined according to the target indicator storage table, the received bidding request and the test plan including multiple test groups to obtain the test result returned by the media server in response to the bidding result. The data processing strategies of multiple test groups can be tested and compared at one time, thereby improving the test efficiency. Therefore, compared with the prior art, the cost of testing the data processing strategy is further reduced and the test efficiency is improved. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0018] Figure 1 It is a structural diagram of a data processing strategy testing system provided in an embodiment of the present application;
[0019] Figure 2 It is a structural diagram of a first server in a data processing strategy testing system provided in an embodiment of the present application;
[0020] Figure 3 is a structural diagram of a first server in another data processing strategy testing system provided in an embodiment of the present application;
[0021] Figure 4 It is a flowchart of a data processing strategy testing method provided in an embodiment of the present application;
[0022] Figure 5 It is a scenario diagram of a data processing strategy testing method provided in an embodiment of the present application;
[0023] Figure 6 It is a flowchart of another data processing strategy testing method provided in an embodiment of the present application;
[0024] Figure 7 It is a flowchart of another data processing strategy testing method provided in an embodiment of the present application;
[0025] Figure 8 It is a scenario diagram of another data processing strategy testing method provided in an embodiment of the present application;
[0026] Fig. 9 It is a scenario diagram of another data processing strategy testing method provided in an embodiment of the present application;
[0027] Fig.10 It is a block diagram of the functional units of a data processing strategy testing device provided in an embodiment of the present application;
[0028] Fig.11 It is a block diagram of the functional units of another data processing strategy testing device provided in an embodiment of the present application;
[0029] Fig.12 This is a structural block diagram of a first server provided in an embodiment of the present application. DETAILED DESCRIPTION
[0030] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0031] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.
[0032] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.
[0033] In the embodiments of the present application, "and / or" describes the association relationship of the associated objects, indicating that three relationships may exist. For example, A and / or B can represent the following three situations: A exists alone; A and B exist at the same time; B exists alone. Among them, A and B can be singular or plural.
[0034] In the embodiment of the present application, the symbol " / " can indicate that the objects associated with each other are in an "or" relationship. In addition, the symbol " / " can also indicate a division sign, that is, performing a division operation. For example, A / B can indicate A divided by B.
[0035] In the embodiments of the present application, "at least one item" or similar expressions refer to any combination of these items, including any combination of single items or plural items, and refer to one or more, and multiple refers to two or more. For example, at least one item of a, b, or c can represent the following seven situations: a, b, c, a and b, a and c, b and c, a, b, and c. Among them, each of a, b, and c can be an element or a set containing one or more elements.
[0036] In the embodiments of the present application, "equal to" can be used in conjunction with greater than, and is applicable to the technical solution adopted when greater than, and can also be used in conjunction with less than, and is applicable to the technical solution adopted when less than. When equal to is used in conjunction with greater than, it is not used in conjunction with less than; when equal to is used in conjunction with less than, it is not used in conjunction with greater than.
[0037] In order to better understand the solutions of the embodiments of the present application, the terminal devices, related concepts and backgrounds that may be involved in the embodiments of the present application are first introduced below.
[0038] Advertiser: The entity that needs to place advertisements on advertising media.
[0039] RTA: Real Time API is a real-time advertising program interface. It allows advertisers to make bidding decisions based on real-time data before users click on ads. This interface allows advertisers to use their own data and technical capabilities to protect data privacy while optimizing delivery effects through real-time personalized decisions, giving advertisers greater control and allowing them to decide which traffic is valuable based on their own data and strategies, thereby achieving a more efficient return on advertising expenditure. RTA has high requirements for technical capabilities and data processing speed.
[0040] Currently, when placing advertisements, it is necessary to configure reasonable data processing strategies based on massive user data in order to obtain the maximum benefits under limited marketing budgets. Therefore, it is necessary to test the data processing strategies to support continuous optimization and iteration of the data processing strategies. However, in the prior art, it is necessary to repeatedly configure the data processing strategies to test the optimal data processing strategies. Since the server that produces user data and the server that configures the data processing strategies are usually not in the same city, massive data needs to be synchronized across cities each time the configuration is performed. Repeated synchronization of massive data consumes a lot of bandwidth resources and storage resources, resulting in high cost and low efficiency in testing the data processing strategies.
[0041] To solve the above problems, an embodiment of the present application provides a data processing strategy testing method and device, which updates the current indicator storage table according to the received compressed file to obtain a target indicator storage table, thereby reducing the bandwidth cost and storage cost of a single cross-city synchronization of massive data, and determining the bidding result according to the target indicator storage table, the received bidding request and the test plan including multiple test groups to obtain the test result returned by the media server in response to the bidding result, and can test and compare the data processing strategies of multiple test groups at one time, thereby improving the test efficiency. Therefore, compared with the prior art, the cost of conducting data processing strategy testing is further reduced and the test efficiency is improved.
[0042] See also Figure 1 , Figure 1 Schematic diagram of a data processing strategy testing system provided by an embodiment of the present application. Figure 1 As shown, the data processing strategy testing system 100 includes a first server 110, a second server 120 and a media server 130, wherein the first server 110 is in communication connection with the second server 120, and the first server 110 is in communication connection with the media server 130. The first server 110 may be a server or a server group consisting of a plurality of servers, the second server 120 may be a server or a server group consisting of a plurality of servers, and the media server 130 may be a server or a server group consisting of a plurality of servers.
[0043] See also Figure 2 , Figure 2 Schematic diagram of the structure of a first server in a data processing strategy testing system provided by an embodiment of the present application. Figure 2 As shown, the first server 110 includes a strategy testing module 210 and a Doris cluster 220, the strategy testing module 210 is used to receive a compressed file sent by the second server, the compressed file is obtained by the second server compressing the target byte stream file, and the target byte stream file is used to indicate the user indicators of all users; update the current indicator storage table according to the compressed file to obtain the target indicator storage table, the target indicator storage table stores the effective user indicators, and the effective user indicators are the user indicators in the corresponding life cycle; obtain the test plan, the test plan includes the user group and the test strategy corresponding to each test group in the multiple test groups, and the test strategy is used to characterize the data processing strategy for the users in the corresponding user group; when the bidding request sent by the media server is detected, the bidding result of each test group is determined according to the bidding request, the test plan and the target indicator storage table; send the bidding result of each test group to the media server to receive the delivery status of each test group returned by the media server in response to the bidding result of each test group. The Doris cluster 220 is used to store the indicator storage table, which can be a high-performance, real-time analytical database of a large-scale parallel processing architecture.
[0044] See also Figure 3 , Figure 3 Schematic diagram of the structure of the first server in another data processing strategy testing system provided by the embodiment of the present application. Figure 3 As shown, the first server 110 includes a processor 310 and a memory 320, and the processor 310 is in communication with the memory 320. Among them, one or more programs are stored in the memory 320, and the one or more programs are configured to be executed by the processor 310. The function of the one or more programs is to receive the compressed file sent by the second server, the compressed file is obtained by the second server compressing the target byte stream file, and the target byte stream file is used to indicate the user indicators of all users; update the current indicator storage table according to the compressed file to obtain the target indicator storage table, the target indicator storage table stores the effective user indicators, and the effective user indicators are the user indicators in the corresponding life cycle; obtain the test plan, the test plan includes the user group and the test strategy corresponding to each test group in the multiple test groups, and the test strategy is used to characterize the data processing strategy for the users in the corresponding user group; when the bidding request sent by the media server is detected, the bidding result of each test group is determined according to the bidding request, the test plan and the target indicator storage table; send the bidding result of each test group to the media server to receive the delivery status of each test group returned by the media server in response to the bidding result of each test group.
[0045] A data processing strategy testing method provided in an embodiment of the present application is introduced below.
[0046] See also Figure 4 , Figure 4 is a flow chart of a data processing strategy testing method provided by an embodiment of the present application, which is applied to Figure 1 The first server 110 in the data processing strategy testing system 100 shown in the figure, the data processing strategy testing system 100 includes the first server 110, the second server 120 and the media server 130, the first server 110 is connected in communication with the second server 120, and the first server 110 is connected in communication with the media server 130; Figure 4 As shown, the method comprises the following steps:
[0047] Step S401: receiving a compressed file sent by the second server.
[0048] The compressed file is obtained by the second server compressing the target byte stream file, and the target byte stream file is used to indicate user indicators of all users.
[0049] Among them, the user indicators are used to characterize the user characteristics of the corresponding user, and specifically can be user characteristics of the corresponding user-side terminal device. For example: terminal device A is a user-side terminal device, and the location of terminal device A is in Shenzhen, then the user indicators of terminal device A include "Shenzhen".
[0050] Among them, the target byte stream file is the original indicator data file determined by the second server first, and the original indicator data file records multiple device numbers and multiple decimal exponential data corresponding to the multiple device numbers, and the multiple device numbers correspond to the multiple decimal exponential data one by one; then, a first binary stream file is generated according to the original indicator data file; then, the first binary stream file is read line by line and the multiple device numbers in the first binary stream file are delimited by a fixed length to obtain a second binary stream file, and the removal of the fixed length of the delimiter refers to processing the data stream in a manner of deleting a specific delimiter and ensuring that the length of the remaining part is fixed; and, the decimal indicator data in the second binary stream file is converted into integer indicator data to obtain the target byte stream file. Specifically, the multiple device numbers recorded in the original indicator data file determined by the second server may include, for example: 123467ADSDFS121232131121212112312313131dsfsfsfdsfdsfsfsdfsssssss, and the multiple decimal indicator data may include, for example: 0.123, 0.123, 0.12, 0.124, 0.123, 0.12, 0.123, 0.124, 0.123, 0.124, 0.123, 0.124. Therefore, the obtained first binary stream file includes binary data representing the device number and the decimal indicator data.
[0051] The compressed file may be obtained by the second server performing zip compression on the target byte stream file, and the compressed file is a .rar file.
[0052] Step S402: update the current indicator storage table according to the compressed file to obtain the target indicator storage table.
[0053] The target indicator storage table stores valid user indicators, which are user indicators in a corresponding life cycle.
[0054] In a possible embodiment, updating the current indicator storage table according to the compressed file to obtain the target indicator storage table includes: decompressing the compressed file to obtain the target byte stream file; determining a summary file according to the target byte stream file; and updating the current indicator storage table according to the summary file to obtain the target indicator storage table.
[0055] The summary file is used to characterize the corresponding relationship between the user indicators of all users and the indicator columns in the current indicator storage table.
[0056] It can be seen that in this example, the current indicator storage table is updated by receiving and decompressing the compressed file transmitted by the second server to obtain the target indicator storage table, thereby reducing the data transmission volume of cross-city data synchronization, thereby reducing the bandwidth cost, and then determining the bidding result according to the target indicator storage table, the received bidding request and the test plan including multiple test groups to obtain the test result returned by the media server in response to the bidding result, and being able to test and compare the data processing strategies of multiple test groups at one time, thereby improving the test efficiency. Therefore, compared with the prior art, the cost of testing the data processing strategy is further reduced, and the test efficiency is improved.
[0057] In a possible embodiment, determining the summary file based on the target byte stream file includes: parsing the target byte stream file into the table data file to obtain multiple table data, each table data in the multiple table data represents the user indicator of the corresponding user in the form of table information; determining at least one indicator column corresponding to the multiple table data, the corresponding relationship between the multiple table data and the at least one indicator column is a many-to-one relationship; determining the summary file based on the multiple table data and the at least one indicator column.
[0058] The table data file may be a file in .csv format, for example.
[0059] The current indicator storage table may be, for example, a Doris table.
[0060] Wherein, the determining of at least one indicator column corresponding to the plurality of table data may specifically be determining at least one indicator column in a Doris table corresponding to the plurality of table data, and the Doris table is stored on a Doris cluster deployed on the first server. In a specific implementation, the user indicators generated by the second server can be increased indefinitely, and the total number of indicator columns in the Doris table can be preconfigured to be 10 columns, and each table data in the plurality of table data is mapped to one of the 10 columns, so no matter how many user indicators there are, the indicator columns in the Doris table will not be expanded indefinitely.
[0061] Among them, see Figure 5 , Figure 5 Schematic diagram of a data processing strategy testing method provided by an embodiment of the present application. Figure 5As shown, the multiple table data in the table data file obtained by parsing the target byte stream file include table data A, table data B, table data C and table data D, and at least one indicator column corresponding to the multiple table data is determined to be indicator column 1, indicator column 2, and indicator column 3. Accordingly, the obtained summary file represents the indicator column 1 corresponding to the table data A, the indicator column 2 corresponding to the table data B, the indicator column 3 corresponding to the table data C, and the indicator column 3 corresponding to the table data D.
[0062] It can be seen that in this example, by parsing the target byte stream file into a table data file, the user indicator is expressed in the form of table data, and at least one indicator column corresponding to multiple table data is determined, so as to determine a summary file including multiple table data and the correspondence between multiple table data and at least one indicator column, so as to update the current indicator storage table according to the summary file to obtain the target indicator storage table, so as to determine the bidding result according to the target indicator storage table, the received bidding request and the test plan including multiple test groups to obtain the test result returned by the media server in response to the bidding result, so as to test and compare the data processing strategies of multiple test groups at one time, thereby improving the test efficiency. Therefore, compared with the prior art, the cost of testing the data processing strategy is further reduced and the test efficiency is improved.
[0063] In a possible embodiment, updating the current indicator storage table according to the summary file to obtain the target indicator storage table includes: determining whether the storage status of at least one indicator column in the current indicator storage table is all empty; if not, determining the indicator column with a non-empty storage status in the at least one indicator column in the current indicator storage table as a reused indicator column, the reused indicator column storing invalid user indicators, and the invalid user indicators are user indicators that have exceeded the corresponding life cycle; performing a reuse import operation to import the multiple table data into the current indicator storage table by reusing the reused indicator column to obtain the target indicator storage table; if so, directly importing the multiple table data into the current indicator storage table to obtain the target indicator storage table.
[0064] Among them, the judgment of whether the storage status of at least one indicator column in the current indicator storage table is all empty is to judge whether there is a new user indicator in the cross-city synchronization data that reuses the indicator column previously used in the Doris table. At this time, the new user indicator is a valid user indicator, the old user indicator is an invalid user indicator, and the indicator column previously used is the reused indicator column.
[0065] It can be seen that in this example, by judging whether at least one indicator column in the current indicator storage table is completely empty, the indicator column used before is reused to store indicator data to obtain the target indicator storage table, and then the bidding result is determined according to the target indicator storage table, the received bidding request and the test plan including multiple test groups to obtain the test result returned by the media server in response to the bidding result. The data processing strategies of multiple test groups can be tested and compared at one time, thereby improving the test efficiency. Therefore, compared with the prior art, the cost of testing the data processing strategy is further reduced and the test efficiency is improved.
[0066] In a possible embodiment, the reuse import operation includes the following steps: clearing the reuse indicator column in the current indicator storage table to obtain a first indicator storage table; updating the first indicator storage table according to the multiple table data and the at least one indicator column to obtain the target indicator storage table.
[0067] Among them, the at least one indicator column in the first indicator storage table is all empty.
[0068] Among them, updating the first indicator storage table according to the multiple table data and the at least one indicator column to obtain the target indicator storage table may specifically be writing the multiple table data into corresponding positions in the first indicator storage table according to a corresponding relationship.
[0069] Wherein, after the first indicator storage table is updated according to the multiple table data and the at least one indicator column to obtain the target indicator storage table, the first server deletes the local target byte stream file.
[0070] Among them, see Figure 6 , Figure 6 FIG. 1 is a flow chart of another data processing strategy testing method provided by an embodiment of the present application. Figure 6As shown, in the user indicator data generation and compression stage, the second server performs data cleaning on the acquired original indicator data; reads the mapping relationship between the original data indicator data and the device number; generates the original indicator data file according to the mapping relationship between the original data indicator data and the device number; obtains the target byte stream file according to the original indicator data file; compresses the target byte stream file to obtain a compressed file; and sends the compressed file to the first server. In the data transmission and parsing stage, the policy testing module of the first server receives the compressed file; decompresses the compressed file to obtain the target byte stream file; and determines the summary file according to the target byte stream file. In the stage of importing user indicator data, the policy testing module of the first server parses the summary file into a table data file; determines at least one indicator column corresponding to multiple table data in the table data file; sends multiple table data and at least one indicator column to the Doris cluster of the first server; the Doris cluster of the first server updates the indicator storage table to obtain the current indicator storage table, and returns the update result to the policy testing module of the first server; the policy testing module of the first server then deletes the local target byte stream file.
[0071] It can be seen that in this example, by determining whether at least one indicator column in the current indicator storage table is completely empty, the indicator data stored in the previously used indicator column is cleared to obtain the target indicator storage table, and then the bidding result is determined according to the target indicator storage table, the received bidding request and the test plan including multiple test groups to obtain the test result returned by the media server in response to the bidding result. The data processing strategies of multiple test groups can be tested and compared at one time, thereby improving the test efficiency. Therefore, compared with the prior art, the cost of testing the data processing strategy is further reduced and the test efficiency is improved.
[0072] Step S403, obtaining a test plan.
[0073] The test scheme includes a plurality of test groups, each of the plurality of test groups includes a bound account and a test strategy, and the test strategy is used to characterize a data processing strategy for the test.
[0074] The test plan may be pre-configured on the first server by an operator of an advertiser, for example, and a database of the first server stores the test plan configured by the operator of the advertiser.
[0075] Step S404: when a bidding request sent by the media server is detected, a bidding result is determined according to the bidding request, the test plan and the target indicator storage table.
[0076] The bidding request is generated by the media server according to the startup instruction when the media server receives the startup instruction sent by the user-side terminal device. Specifically, when the user-side terminal device detects the operation of opening the application software corresponding to the media server, it sends the startup instruction to the media server, and the media server generates the bidding request according to the startup instruction and the device number of the terminal device.
[0077] In a possible embodiment, when a bidding request sent by the media server is detected, a bidding result is determined according to the bidding request, the test plan and the target indicator storage table, including: determining a target user indicator according to the bidding request and the target indicator storage table; determining the bidding result according to the target user indicator and the test plan.
[0078] Among them, determining the target user indicator according to the bidding request and the target indicator storage table may specifically be that the first server determines the target user indicator corresponding to the device number according to the device number of the user-side terminal device indicated by the bidding request and the target indicator storage table.
[0079] Among them, see Figure 7 , Figure 7 FIG. 1 is a flow chart of another data processing strategy testing method provided by an embodiment of the present application. Figure 7 As shown, in the indicator loading stage, the second server sends a compressed file to the first server, the first server receives the compressed file, and updates the current indicator storage table according to the compressed file; in the test strategy configuration stage, the advertiser operation personnel configure the test plan, and the first server stores the test plan; in the RTA interface service stage, the first server loads the test plan, when the media server sends a bidding request to the first server, the first server receives the bidding request, determines the target user indicator according to the bidding request and the target indicator storage table, determines the bidding result according to the target user indicator and the test strategy, sends the bidding result to the media server, and the media server responds to the bidding result of each test group and returns the delivery status of each test group.
[0080] It can be seen that in this example, the target user index is determined according to the bidding request and the target index storage table; the bidding result is determined according to the target user index and the test plan, so as to obtain the test result of each test group returned by the media server in response to the bidding result of each test group, and the data processing strategies of multiple test groups can be tested and compared at one time, thereby improving the test efficiency. Therefore, compared with the prior art, the cost of testing the data processing strategy is further reduced and the test efficiency is improved.
[0081] In a possible embodiment, the test strategy includes multiple bid coefficients and rule conditions corresponding to each of the multiple bid coefficients, and determining the bidding result based on the target user indicator and the test plan includes: determining the target bid coefficient based on the rule conditions hit by the target user indicator and the multiple bid coefficients; determining the bidding result based on the target bid coefficient and a bound account in a target test group, the target test group being the test group to which the target test strategy belongs among the multiple test groups, and the target test strategy being the test strategy to which the target bid coefficient belongs.
[0082] Among them, see Figure 8 , Figure 8 FIG. 1 is a schematic diagram of another scenario of a data processing strategy testing method provided by an embodiment of the present application. Figure 8 As shown, the advertiser operator configures the test plan in the RTA test plan management interface 800. The RTA test plan management interface 800 includes three display boxes: test project name, basic settings, and test group settings. The basic settings include the operation boxes of the plan name, plan description, and diversion method, and the test group settings include the test group number, test group name, diversion ratio, operation, binding account, modifying RTA strategy, and the display box of the associated strategy.
[0083] Among them, see Fig. 9 , Fig. 9 FIG. 1 is a schematic diagram of another scenario of a data processing strategy testing method provided by an embodiment of the present application. Fig. 9 As shown, when the operation box for modifying the RTA strategy of the RTA test solution management interface 800 detects the selection operation of the advertiser operator, it jumps to the RTA test strategy management interface 900. The RTA test strategy management interface 900 includes a data source type operation box and display boxes for the test strategy name, negative exclusion rule, and bid rule, wherein the negative exclusion rule includes an operation box for the rule name and rule conditions, and the bid rule includes an operation box for prompt information, bid coefficient, and rule conditions.
[0084] It can be seen that in this example, the target bid coefficient is determined based on the rule conditions of the target user indicator hit and multiple bid coefficients; the bidding result is determined based on the target bid coefficient and the bound account in the target test group, so as to obtain the test result of each test group returned by the media server in response to the bidding result of each test group, and the data processing strategies of multiple test groups can be tested and compared at one time, thereby improving the testing efficiency. Therefore, compared with the prior art, the cost of testing the data processing strategy is further reduced and the testing efficiency is improved.
[0085] Step S405: sending the bidding result to the media server to receive the delivery status returned by the media server in response to the bidding result.
[0086] The delivery situation may be, for example, advertisement exposure.
[0087] It can be seen that in the present application, the first server receives a compressed file sent by the second server, the compressed file is obtained by the second server compressing the target byte stream file, and the target byte stream file is used to indicate the user indicators of all users; the current indicator storage table is updated according to the compressed file to obtain the target indicator storage table, the target indicator storage table stores valid user indicators, and the valid user indicators are user indicators in the corresponding life cycle; a test plan is obtained, the test plan includes a user group and a test strategy corresponding to each test group in a plurality of test groups, and the test strategy is used to characterize the data processing strategy for the users in the corresponding user group; when a bidding request sent by the media server is detected, the bidding result of each test group is determined according to the bidding request, the test plan and the target indicator storage table; the bidding result of each test group is sent to the media server to receive the delivery status of each test group returned by the media server in response to the bidding result of each test group. Since the current indicator storage table is updated according to the received compressed file to obtain the target indicator storage table, the bandwidth cost and storage cost of a single cross-city synchronization of massive data are reduced, and the bidding result of each test group is determined according to the target indicator storage table, the received bidding request and the test plan of multiple test groups to obtain the test result of each test group returned by the media server in response to the bidding result of each test group, thereby testing multiple data processing strategies at one time and improving the test efficiency. Therefore, compared with the prior art, the cost of testing data processing strategies is further reduced and the test efficiency is improved.
[0088] The above mainly introduces the scheme of the embodiment of the present application from the perspective of the execution process on the method side. It is understandable that, in order to realize the above functions, the controller includes a hardware structure and / or software module corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiment provided herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present application.
[0089] In accordance with the above-mentioned embodiments, please refer to Fig.10 , Fig.10 is a functional unit block diagram of a data processing strategy testing device provided by an embodiment of the present application, such as Fig.10As shown, the data processing strategy testing device 1000 includes: a first receiving unit 1001, used to receive a compressed file sent by the second server, the compressed file is obtained by the second server compressing the target byte stream file, and the target byte stream file is used to indicate the user indicators of all users; a first processing unit 1002, used to update the current indicator storage table according to the compressed file to obtain a target indicator storage table, the target indicator storage table stores valid user indicators, and the valid user indicators are user indicators in the corresponding life cycle; obtain a test plan, the test plan includes a user group and a test strategy corresponding to each test group in a plurality of test groups, and the test strategy is used to characterize the data processing strategy for the users in the corresponding user group; when a bidding request sent by the media server is detected, determine the bidding result of each test group according to the test plan and the target indicator storage table; send the bidding result of each test group to the media server to receive the delivery status of each test group returned by the media server in response to the bidding result of each test group.
[0090] In a possible embodiment, in terms of updating the current indicator storage table according to the compressed file to obtain the target indicator storage table, the first processing unit 1002 is specifically used to: decompress the compressed file to obtain the target byte stream file; determine the summary file according to the target byte stream file; update the current indicator storage table according to the summary file to obtain the target indicator storage table.
[0091] In a possible embodiment, in terms of determining the summary file based on the target byte stream file, the first processing unit 1002 is specifically used to: parse the target byte stream file into the table data file to obtain multiple table data, each table data in the multiple table data represents the user indicator of the corresponding user in the form of table information; determine at least one indicator column corresponding to the multiple table data, and the corresponding relationship between the multiple table data and the at least one indicator column is a many-to-one relationship; determine the summary file based on the multiple table data and the at least one indicator column.
[0092] In a possible embodiment, in terms of updating the current indicator storage table according to the summary file to obtain the target indicator storage table, the first processing unit 1002 is specifically used to: determine whether the storage status of at least one indicator column in the current indicator storage table is all empty; if not, determine the indicator column with a non-empty storage status in the at least one indicator column in the current indicator storage table as a reused indicator column, the reused indicator column stores invalid user indicators, and the invalid user indicators are user indicators that have exceeded the corresponding life cycle; perform a reuse import operation to import the multiple table data into the current indicator storage table by reusing the reused indicator column to obtain the target indicator storage table; if so, directly import the multiple table data into the current indicator storage table to obtain the target indicator storage table.
[0093] In a possible embodiment, the data processing strategy testing device 1000 is also specifically used to: clear the reused indicator column in the current indicator storage table to obtain a first indicator storage table; update the first indicator storage table according to the multiple table data and the at least one indicator column to obtain the target indicator storage table.
[0094] In a possible embodiment, in terms of determining the bidding result of each test element group according to the test plan and the target indicator storage table when the bidding request sent by the media server is detected, the first processing unit 1002 is specifically used to: determine the user indicator of each user in the user group corresponding to each test group according to the target indicator storage table; determine the bidding result of each test group according to the user indicator of each user and the test strategy.
[0095] In a possible embodiment, the test strategy includes rule conditions corresponding to each bid coefficient in a plurality of bid coefficients, and in terms of determining the bidding result of each test group according to the user indicator of each user and the test strategy, the first processing unit 1002 is specifically used to: determine the bid coefficient corresponding to each user according to the rule conditions corresponding to the user indicator of each user; determine the bidding result of each test group according to the bid coefficient corresponding to each user.
[0096] It can be understood that since the method embodiment and the device embodiment are different presentation forms of the same technical concept, the content of the method embodiment part in this application should be synchronously adapted to the device embodiment part and will not be repeated here.
[0097] In the case of integrated units, such as Fig.11 As shown, Fig.11 This is a functional unit block diagram of another data processing strategy testing device provided by an embodiment of the present application. Fig.11In the embodiment, the data processing strategy testing device 1000 includes: a processing module 1112 and a communication module 1111. The processing module 1112 is used to control and manage the actions of the data processing strategy testing device 1000, for example, to execute the steps of the first receiving unit 1001 and the first processing unit 1002, and / or to execute other processes of the technology described herein. The communication module 1111 is used to support the interaction between the data processing strategy testing device 1000 and other devices. Fig.11 As shown, the data processing strategy testing device 1000 may further include a storage module 1113 , and the storage module 1113 is used to store program codes and data of the data processing strategy testing device 1000 .
[0098] Among them, the processing module 1112 can be a processor or a controller, for example, a central processing unit (CPU), a general processor, a digital signal processor (DSP), an ASIC, an FPGA or other programmable logic device, a transistor logic device, a hardware component or any combination thereof. It can implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements a computing function, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like. The communication module 1111 can be a transceiver, an RF circuit or a communication interface, and the like. The storage module 1113 can be a memory.
[0099] All relevant contents of each scenario involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and will not be repeated here. Figure 4 The data processing strategy testing method shown.
[0100] The above embodiments can be implemented in whole or in part by software, hardware, firmware or any other combination. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired or wireless means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that contains one or more available media sets. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium. The semiconductor medium can be a solid-state hard disk.
[0101] Fig.12 is a structural block diagram of a first server provided in an embodiment of the present application. Fig.12 As shown, the first server 110 may include one or more of the following components: a processor 310, and a memory 320 coupled to the processor 310, wherein the memory 320 may store one or more computer programs 321, and the one or more computer programs 321 may be configured to implement the methods described in the above embodiments when executed by one or more processors 310.
[0102] The processor 310 may include one or more processing cores. The processor 310 uses various interfaces and lines to connect various parts within the entire first server 110, and executes various functions and processes data of the first server 110 by running or executing instructions, programs, code sets or instruction sets stored in the memory 320, and calling data stored in the memory 320. Optionally, the processor 310 can be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 310 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 310, but may be implemented separately through a communication chip.
[0103] The memory 320 may include a random access memory (RAM) or a read-only memory (ROM). The memory 320 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 320 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc. The data storage area may also store data created by the first server 110 during use, etc.
[0104] It is understandable that the first server 110 may include more or fewer structural elements than those in the above structural block diagram, which is not limited here. The present application embodiment provides a computer-readable storage medium on which a computer program / instruction is stored, and when the computer program / instruction is executed by a processor, the steps of the method described in any possible embodiment are implemented.
[0105] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0106] In the several embodiments provided in the present application, it should be understood that the disclosed methods, devices and systems can be implemented in other ways. For example, the device embodiments described above are merely schematic; for example, the division of the unit is only a logical function division, and there may be other division methods in actual implementation; for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0107] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0108] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may be physically included separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units.
[0109] The above-mentioned integrated unit implemented in the form of a software functional unit can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform some steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: a USB flash drive, a mobile hard disk, a magnetic disk, an optical disk, a volatile memory or a non-volatile memory. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM) or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM) and direct RAM bus random access memory (DR RAM), among other media that can store program code.
[0110] Although the present invention is disclosed as above, the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions without departing from the spirit and scope of the present invention, and can make various changes and modifications, including the combination of the above-mentioned different functions and implementation steps, including software and hardware implementation methods, all of which are within the scope of protection of the present invention.
Claims
1. A data processing strategy testing method, characterized in that: A first server applied to a data processing strategy testing system, the data processing strategy testing system comprising the first server, the second server and the media server, the method comprising: receiving a compressed file sent by the second server, where the compressed file is obtained by the second server compressing a target byte stream file, where the target byte stream file is used to indicate user indicators of all users; Update the current indicator storage table according to the compressed file to obtain a target indicator storage table, wherein the target indicator storage table stores valid user indicators, and the valid user indicators are user indicators in a corresponding life cycle; Acquire a test plan, wherein the test plan includes a plurality of test groups, each of the plurality of test groups includes a bound account and a test strategy, and the test strategy is used to characterize a data processing strategy for a test; When a bidding request sent by the media server is detected, determining a bidding result according to the bidding request, the test scheme and the target indicator storage table; The bidding result is sent to the media server to receive the delivery status returned by the media server in response to the bidding result.
2. The method according to claim 1, characterized in that The updating of the current indicator storage table according to the compressed file to obtain the target indicator storage table includes: Decompressing the compressed file to obtain the target byte stream file; Determine a summary file according to the target byte stream file; The current indicator storage table is updated according to the summary file to obtain the target indicator storage table.
3. The method according to claim 2, characterized in that The step of determining the summary file according to the target byte stream file comprises: Parsing the target byte stream file into the table data file to obtain a plurality of table data, wherein each table data in the plurality of table data represents a user indicator of a corresponding user in the form of table information; Determine at least one indicator column corresponding to the plurality of table data, wherein the correspondence between the plurality of table data and the at least one indicator column is a many-to-one relationship; The summary file is determined according to the plurality of table data and the at least one indicator column.
4. The method according to claim 3, characterized in that The updating of the current indicator storage table according to the summary file to obtain the target indicator storage table includes: Determine whether the storage status of at least one indicator column in the current indicator storage table is all empty; If not, determining the indicator column whose storage state is non-empty in the at least one indicator column in the current indicator storage table as a reused indicator column, wherein the reused indicator column stores invalid user indicators, and the invalid user indicators are user indicators that have exceeded the corresponding life cycle; performing a reuse import operation, so that the multiple table data are imported into the current indicator storage table by reusing the reused indicator column, to obtain the target indicator storage table; If so, the plurality of table data are directly imported into the current indicator storage table to obtain the target indicator storage table.
5. The method according to claim 4, characterized in that The multiplexing import operation includes the following steps: Clear the reuse indicator column in the current indicator storage table to obtain a first indicator storage table; The first indicator storage table is updated according to the multiple table data and the at least one indicator column to obtain the target indicator storage table.
6. The method according to claim 5, characterized in that When the bidding request sent by the media server is detected, determining the bidding result according to the bidding request, the test scheme and the target indicator storage table includes: Determine a target user indicator according to the bidding request and the target indicator storage table; The bidding result is determined according to the target user indicator and the test plan.
7. The method according to claim 6, characterized in that The test strategy includes a plurality of bid coefficients and a rule condition corresponding to each of the plurality of bid coefficients, and the determining the bidding result according to the target user indicator and the test scheme includes: Determining a target bid coefficient according to the rule condition hit by the target user indicator and the multiple bid coefficients; The bidding result is determined according to the target bid coefficient and a bound account in a target test group, wherein the target test group is a test group to which a target test strategy belongs among the multiple test groups, and the target test strategy is a test strategy to which the target bid coefficient belongs.
8. A data processing strategy testing device, characterized in that: A first server applied to a data processing strategy testing system, the data processing strategy testing system comprising the first server, the second server and the media server, the device comprising: A first receiving unit is used to receive a compressed file sent by the second server, where the compressed file is obtained by the second server compressing a target byte stream file, where the target byte stream file is used to indicate user indicators of all users; The first processing unit is used to update the current indicator storage table according to the compressed file to obtain the target indicator storage table, wherein the target indicator storage table stores effective user indicators, and the effective user indicators are user indicators in the corresponding life cycle; obtain a test plan, wherein the test plan includes multiple test groups, each of the multiple test groups includes a binding account and a test strategy, and the test strategy is used to characterize the data processing strategy for the test; when a bidding request sent by the media server is detected, determine the bidding result according to the bidding request, the test plan and the target indicator storage table; send the bidding result to the media server to receive the delivery status returned by the media server in response to the bidding result.
9. A server, characterized in that: The method comprises a processor, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for executing the steps in the method according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that: A computer program / instruction is stored thereon, and when the computer program / instruction is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.