Data processing method and device in recommendation system

Abstract

The embodiments of the present application provide a data processing method and device in a recommendation system. The recommendation system includes at least two recommendation areas, and the method includes: obtaining the basic indicator monitoring value and basic indicator reference value of each recommendation area; determining the comprehensive indicator monitoring value of the recommendation system based on the basic indicator monitoring value of each recommendation area; determining the comprehensive indicator reference value of the recommendation system for each recommendation area based on the basic indicator monitoring value and basic indicator reference value of each recommendation area; determining the abnormal impact weight of the recommendation area on the recommendation system based on the comprehensive indicator monitoring value and the comprehensive indicator reference value, and the abnormal impact weight is used to characterize the degree of abnormal impact of the recommendation area on the recommendation system. The technical solution of the embodiment of the present application can accurately monitor the operating status of the recommendation system through the abnormal impact weight of the recommendation area on the recommendation system.

Description

Technical Field

[0001] The present application relates to the field of computer and data processing technology, and in particular to a data processing method and device in a recommendation system. Background Art

[0002] In data processing scenarios for recommendation systems, such as those using cloud servers to process data, it's necessary to measure the system's health by collecting and monitoring key metrics. Existing solutions typically compare these metrics directly with historical data and use this comparison to monitor the system's health. However, in real-world scenarios, data can often be deceptive, with the resulting analysis often contradicting the actual situation. Therefore, accurately monitoring the health of recommendation systems is a pressing technical challenge. Summary of the Invention

[0003] Embodiments of the present application provide a data processing method, apparatus, computer program product or computer program, computer-readable medium, and electronic device in a recommendation system, thereby accurately monitoring the operating status of the recommendation system, at least to a certain extent, by using the abnormal impact weight of the recommended area on the recommendation system.

[0004] Other features and advantages of the present application will become apparent from the following detailed description, or may be learned in part by practice of the present application.

[0005] According to one aspect of an embodiment of the present application, a data processing method in a recommendation system is provided, wherein the recommendation system includes at least two recommendation areas, and the method includes: obtaining basic indicator monitoring values ​​and basic indicator reference values ​​of each recommendation area; determining a comprehensive indicator monitoring value of the recommendation system based on the basic indicator monitoring values ​​of each recommendation area; determining a comprehensive indicator reference value of the recommendation system for each recommendation area based on the basic indicator monitoring values ​​and basic indicator reference values ​​of each recommendation area; and determining an abnormal impact weight of the recommendation area on the recommendation system based on the comprehensive indicator monitoring values ​​and the comprehensive indicator reference values, wherein the abnormal impact weight is used to characterize the degree of abnormal impact of the recommendation area on the recommendation system.

[0006] According to one aspect of an embodiment of the present application, a data processing device in a recommendation system is provided, wherein the recommendation system includes at least two recommendation areas, and the device includes: an acquisition unit, used to obtain basic indicator monitoring values ​​and basic indicator reference values ​​of each recommendation area; a first determination unit, used to determine a comprehensive indicator monitoring value of the recommendation system based on the basic indicator monitoring values ​​of each recommendation area; a second determination unit, used to determine a comprehensive indicator reference value of the recommendation system for each recommendation area based on the basic indicator monitoring values ​​and basic indicator reference values ​​of each recommendation area; and a third determination unit, used to determine an abnormal impact weight of the recommendation area on the recommendation system based on the comprehensive indicator monitoring values ​​and the comprehensive indicator reference value, wherein the abnormal impact weight is used to characterize the degree of abnormal impact of the recommendation area on the recommendation system.

[0007] In some embodiments of the present application, based on the aforementioned scheme, the basic indicator monitoring value includes a first indicator monitoring value and a second indicator monitoring value, the comprehensive indicator monitoring value is positively correlated with the first indicator monitoring value, and the comprehensive indicator monitoring value is negatively correlated with the second indicator monitoring value; the basic indicator reference value includes a first indicator reference value and a second indicator reference value, the comprehensive indicator reference value of the recommendation system determined for the recommended area is positively correlated with the first indicator reference value corresponding to the recommended area, and the comprehensive indicator reference value of the recommendation system determined for the recommended area is negatively correlated with the second indicator reference value corresponding to the recommended area.

[0008] In some embodiments of the present application, based on the aforementioned scheme, the first determination unit is configured to: sum the first indicator monitoring values ​​of each recommended area to obtain the first indicator monitoring total value; sum the second indicator monitoring values ​​of each recommended area to obtain the second indicator monitoring total value; and determine the ratio of the first indicator monitoring total value to the second indicator monitoring total value as the comprehensive indicator monitoring value of the recommendation system.

[0009] In some embodiments of the present application, based on the aforementioned scheme, the second determination unit is configured to: for each recommended area in the recommendation system, sum the first indicator monitoring values ​​of each recommended area except the current recommended area and the first indicator reference value of the current recommended area to obtain the first indicator reference total value; sum the second indicator monitoring values ​​of each recommended area except the current recommended area and the second indicator reference value of the current recommended area to obtain the second indicator reference total value; determine the ratio of the first indicator reference total value to the second indicator reference total value as the comprehensive indicator reference value of the recommendation system for the current recommended area.

[0010] In some embodiments of the present application, based on the aforementioned solution, the third determination unit is configured to: determine the difference between the comprehensive indicator monitoring value and the comprehensive indicator reference value as the abnormal impact weight of the recommended area on the recommendation system.

[0011] In some embodiments of the present application, based on the aforementioned scheme, the device also includes: a fourth determination unit, which is used to determine the abnormal impact weight of the recommended area on the recommendation system based on the comprehensive indicator monitoring value and the comprehensive indicator reference value, and then determine the maximum abnormal impact weight among the abnormal impact weights corresponding to each recommended area; and determine the recommended area corresponding to the maximum abnormal impact weight as the abnormal recommended area.

[0012] In some embodiments of the present application, based on the aforementioned scheme, the device also includes: a fourth determination unit, which is used to determine the abnormal impact weight of the recommended area on the recommendation system based on the comprehensive indicator monitoring value and the comprehensive indicator reference value, and then determine the abnormal impact weight that exceeds a predetermined threshold among the abnormal impact weights corresponding to each recommended area; and determine the recommended area corresponding to the abnormal impact weight that exceeds the predetermined threshold as an abnormal recommended area.

[0013] According to one aspect of an embodiment of the present application, a computer program product or computer program is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the method provided in the first aspect or various optional implementations of the first aspect.

[0014] According to one aspect of an embodiment of the present application, a computer-readable medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the data processing method in the recommendation system as described in the above embodiment is implemented.

[0015] According to one aspect of an embodiment of the present application, an electronic device is provided, including: one or more processors; and a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the data processing method in the recommendation system as described in the above embodiment.

[0016] In the technical solutions provided in some embodiments of the present application, the basic indicator monitoring values ​​and basic indicator reference values ​​of each recommended area are used to determine the comprehensive indicator monitoring values ​​of the recommendation system, as well as the comprehensive indicator reference values ​​of the recommendation system for each recommended area. Furthermore, the abnormal impact weight of each recommended area on the recommendation system can be determined based on the comprehensive indicator monitoring values ​​and comprehensive indicator reference values. Because the comprehensive indicator monitoring values ​​of the entire recommendation system and the comprehensive indicator reference values ​​of the recommendation system for the corresponding recommended area are taken into account when determining the abnormal impact weight of each recommended area on the recommendation system, the correlation between the data is improved, making the determined abnormal impact weight highly interpretable. Therefore, the abnormal impact weight of the recommended area on the recommendation system can be used to accurately monitor the operating status of the recommendation system.

[0017] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The accompanying drawings are incorporated into and constitute a part of the specification, illustrating embodiments consistent with the present application and, together with the specification, explaining the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application, and those skilled in the art can derive other drawings based on these drawings without inventive effort. In the drawings:

[0019] Figure 1 A schematic diagram showing an exemplary system architecture to which the technical solutions of the embodiments of the present application can be applied;

[0020] Figure 2 An application scenario diagram of a data processing method in a recommendation system according to an embodiment of the present application is shown;

[0021] Figure 3 A flowchart showing a data processing method in a recommendation system according to an embodiment of the present application is shown;

[0022] Figure 4 A detailed flow chart of determining the comprehensive indicator monitoring value of the recommendation system according to one embodiment of the present application is shown;

[0023] Figure 5 A detailed flowchart of determining a comprehensive index reference value of the recommendation system for a recommended area according to an embodiment of the present application is shown;

[0024] Figure 6 A flowchart of a method for determining the abnormal influence weight of the recommended area on the recommendation system according to an embodiment of the present application is shown;

[0025] Figure 7 A flowchart of a method for determining the abnormal influence weight of the recommended area on the recommendation system according to an embodiment of the present application is shown;

[0026] Figure 8 A block diagram of a data processing device in a recommendation system according to an embodiment of the present application is shown;

[0027] Figure 9 A schematic diagram of the structure of a computer system suitable for implementing an electronic device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0028] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be thorough and complete and will fully convey the concepts of the example embodiments to those skilled in the art.

[0029] In addition, described feature, structure or characteristic can be combined in one or more embodiments in any suitable manner.In the following description, many specific details are provided so as to provide a full understanding of the embodiments of the present application. However, it will be appreciated by those skilled in the art that the technical scheme of the present application can be put into practice without one or more of the specific details, or other methods, components, devices, steps etc. can be adopted. In other cases, known methods, devices, implementations or operations are not shown or described in detail to avoid blurring the various aspects of the application.

[0030] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically separate entities. That is, these functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0031] The flowcharts shown in the accompanying drawings are for illustrative purposes only and do not necessarily include all contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may be decomposed, while others may be combined or partially combined. Therefore, the actual execution order may vary depending on the actual situation.

[0032] It should be noted that the terms "first," "second," and the like in the specification and claims of this application and the accompanying drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, such that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described.

[0033] Figure 1 A schematic diagram shows an exemplary system architecture to which the technical solutions of the embodiments of the present application can be applied.

[0034] like Figure 1 As shown, the system architecture may include a terminal device, a network 104, and a server 105. The network 104 is used to provide a medium for a communication link between the terminal device and the server 105. The network 104 may include various connection types, such as a wired communication link, a wireless communication link, and the like.

[0035] In one embodiment of the present application, a user can use a terminal device to send a request to the server 105 to determine the abnormal impact weight of the recommended area on the recommendation system. After receiving the request, the server 105 can obtain the basic indicator monitoring value and the basic indicator reference value of each recommended area, and then determine the comprehensive indicator monitoring value of the recommendation system based on the basic indicator monitoring value of each recommended area. Then, based on the basic indicator monitoring value and the basic indicator reference value of each recommended area, determine the comprehensive indicator reference value of the recommendation system for each recommended area respectively. Finally, based on the comprehensive indicator monitoring value and the comprehensive indicator reference value, determine the abnormal impact weight of the recommended area on the recommendation system. The abnormal impact weight is used to characterize the degree of abnormal impact of the recommended area on the recommendation system.

[0036] It should be noted that the data processing method in the recommendation system provided in the embodiments of the present application is generally executed by the server 105, and accordingly, the data processing device in the recommendation system is generally set in the server 105. However, in other embodiments of the present application, the terminal device may also have similar functions to the server, thereby executing the data processing solution in the recommendation system provided in the embodiments of the present application.

[0037] It should also be noted that Figure 1 The number of terminal devices, networks, and servers in the description is for illustrative purposes only. Depending on the implementation requirements, the server may be an independent physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. The terminal may be a smartphone, tablet computer, laptop computer, desktop computer, smart speaker, smart watch, etc., but is not limited thereto and is not limited to this.

[0038] It's important to explain that cloud computing, as described above, is a computing model that distributes computing tasks across a resource pool consisting of a large number of computers, enabling various application systems to access computing power, storage space, and information services as needed. The network that provides these resources is called the "cloud." To users, the resources in the "cloud" appear infinitely scalable and can be accessed, used, and expanded at any time. By establishing a cloud computing resource pool (referred to as a cloud platform, often referred to as an IaaS (Infrastructure as a Service) platform), various types of virtual resources are deployed within the resource pool for external clients to choose from. The cloud computing resource pool primarily includes computing devices (virtualized machines, including operating systems), storage devices, and network devices.

[0039] Figure 2 An application scenario diagram of a data processing method in a recommendation system according to an embodiment of the present application is shown.

[0040] like Figure 2 As shown, in the present application, the recommendation system can be an advertising recommendation system. After the user is exposed to an advertisement on the terminal video APP interface, the user can choose whether to click on the advertisement, thereby obtaining the advertisement click-through rate of the advertisement. Then, the data processing method in the recommendation system proposed in the present application can be used to process indicators such as advertisement click volume, advertisement exposure volume, and advertisement exposure cost to obtain abnormal impact weights to measure the operating status of the system.

[0041] The following is a detailed description of the implementation details of the technical solution of the embodiment of the present application:

[0042] Figure 3 A flowchart of a data processing method in a recommendation system according to an embodiment of the present application is shown. The data processing method in the recommendation system can be executed by a device having a computing and processing function, such as Figure 1 Executed by the server 105 shown in FIG.

[0043] First of all, it should be noted that in this application, the recommendation system includes at least two recommendation areas.

[0044] For example, in an ad recommendation system, recommendation domains can include different ad recommendation columns, such as ad recommendations in the travel column, ad recommendations in the game column, and ad recommendations in the car column. They can also include different ad recommendation scenarios, such as web page recommendation scenarios, app recommendation scenarios, etc. Recommendation domains can also include different ad types, or different advertisers that recommend ads in the ad recommendation system.

[0045] Reference Figure 3As shown, the data processing method in the recommendation system includes at least steps 310 to 370, which are described in detail as follows:

[0046] In step 310, basic indicator monitoring values ​​and basic indicator reference values ​​of each recommended area are obtained.

[0047] In step 330, the comprehensive indicator monitoring value of the recommendation system is determined based on the basic indicator monitoring value of each recommended area.

[0048] In the present application, the basic indicator monitoring value includes a first indicator monitoring value and a second indicator monitoring value, the comprehensive indicator monitoring value is positively correlated with the first indicator monitoring value, and the comprehensive indicator monitoring value is negatively correlated with the second indicator monitoring value.

[0049] In one embodiment of the present application, the comprehensive indicator monitoring value of the recommendation system is determined based on the basic indicator monitoring value of each recommended area. Figure 4 Follow the steps shown.

[0050] See also Figure 4 , shows a detailed flow chart of determining the comprehensive indicator monitoring value of the recommendation system according to an embodiment of the present application. Specifically, it includes steps 331 to 333:

[0051] Step 331 : summing the first indicator monitoring values ​​of the recommended areas to obtain a total first indicator monitoring value.

[0052] Step 3332: sum up the second indicator monitoring values ​​of each recommended area to obtain the total second indicator monitoring value.

[0053] Step 333: Determine the ratio of the first indicator monitoring total value to the second indicator monitoring total value as the comprehensive indicator monitoring value of the recommendation system.

[0054] Continue to refer to Figure 3 In step 350, based on the basic indicator monitoring value and basic indicator reference value of each recommended area, the comprehensive indicator reference value of the recommendation system is determined for each recommended area.

[0055] In the present application, the basic indicator reference value includes a first indicator reference value and a second indicator reference value. The comprehensive indicator reference value of the recommendation system determined for the recommended area is positively correlated with the first indicator reference value corresponding to the recommended area, and the comprehensive indicator reference value of the recommendation system determined for the recommended area is negatively correlated with the second indicator reference value corresponding to the recommended area.

[0056] In one embodiment of the present application, for each recommended area in the recommendation system, the comprehensive index reference value can be obtained by: Figure 5The steps shown are confirmed.

[0057] See also Figure 5 , shows a detailed flow chart of determining the comprehensive index reference value of the recommendation system for the recommended area according to an embodiment of the present application. Specifically, it includes steps 351 to 353:

[0058] Step 351 : summing the first indicator monitoring values ​​of each recommended area except the current recommended area and the first indicator reference value of the current recommended area to obtain a first indicator reference total value.

[0059] Step 352 : summing the second indicator monitoring values ​​of each recommended area except the current recommended area and the second indicator reference value of the current recommended area to obtain a second indicator reference total value.

[0060] Step 353: Determine the ratio of the first indicator reference total value to the second indicator reference total value as the comprehensive indicator reference value of the recommendation system for the current recommendation area.

[0061] Continue to refer to Figure 3 In step 370, the abnormal impact weight of the recommended area on the recommendation system is determined based on the comprehensive indicator monitoring value and the comprehensive indicator reference value, and the abnormal impact weight is used to represent the abnormal impact degree of the recommended area on the recommendation system.

[0062] In one embodiment of the present application, the abnormal impact weight of the recommended area on the recommendation system is determined based on the comprehensive indicator monitoring value and the comprehensive indicator reference value, and the difference between the comprehensive indicator monitoring value and the comprehensive indicator reference value is determined as the abnormal impact weight of the recommended area on the recommendation system.

[0063] In order to make those skilled in the art more intuitively understand the solutions proposed in the above steps 310 to 370, the following formula will be used to illustrate:

[0064]

[0065] Among them, w i Indicates the abnormal impact of the i-th recommended area on the recommendation system; clk n Indicates the total value of the first indicator monitoring value of each recommended area; imp n Indicates the total monitoring value of the second indicator of each recommended area; represents the first indicator monitoring value corresponding to the i-th recommended area; represents the second indicator monitoring value corresponding to the i-th recommended area; represents the reference value of the first indicator corresponding to the i-th recommended area; Indicates the second indicator reference value corresponding to the i-th recommended area.

[0066] In the above steps 310 to 370 , the basic indicator monitoring value may refer to the value of the basic indicator currently monitored, and the basic indicator reference value may refer to the value of the basic indicator in history.

[0067] Specifically, for example, in an advertisement recommendation system, the basic indicator monitoring value of each recommendation area may include at least one of the following:

[0068] The first method may be to use the number of advertisement clicks and advertisement exposures in each currently monitored recommendation area as basic indicator monitoring values.

[0069] The second method may be to use the advertising exposure cost and advertising exposure amount in each currently monitored recommendation area as basic indicator monitoring values.

[0070] The third method may be to use the advertising exposure cost and advertising click volume in each currently monitored recommendation area as basic indicator monitoring values.

[0071] For example, in an advertisement recommendation system, the basic indicator reference value of each recommendation area may specifically include at least one of the following:

[0072] The first method may be to use the historical ad clicks and historical ad exposures of each recommendation area as basic indicator reference values.

[0073] The second method may be to use the historical advertising exposure cost and historical advertising exposure volume of each recommended area as basic indicator reference values.

[0074] The third method may be to use the historical advertising exposure cost and historical advertising click volume of each recommendation area as basic indicator reference values.

[0075] In one embodiment of the present application, after determining the abnormal influence weight of the recommended area on the recommendation system, the following steps may be performed: Figure 6 Steps shown.

[0076] See also Figure 6 , shows a flow chart of a method for determining the abnormal impact weight of the recommended area on the recommendation system according to an embodiment of the present application. Specifically, it includes steps 381 to 382:

[0077] Step 381 : determining the maximum abnormality impact weight among the abnormality impact weights corresponding to the recommended areas.

[0078] Step 382: Determine the recommended area corresponding to the maximum abnormal impact weight as the abnormal recommended area.

[0079] In one embodiment of the present application, after determining the abnormal influence weight of the recommended area on the recommendation system, the following steps may be performed: Figure 7 Steps shown.

[0080] See also Figure 7 , shows a flow chart of a method for determining the abnormal impact weight of the recommended area on the recommendation system according to an embodiment of the present application. Specifically, it includes steps 383 to 384:

[0081] Step 383 : Determine the abnormal impact weights that exceed a predetermined threshold among the abnormal impact weights corresponding to the recommended areas.

[0082] Step 384: Determine the recommended area corresponding to the abnormal impact weight exceeding the predetermined threshold as an abnormal recommended area.

[0083] In order to help those skilled in the art better understand the present application, the following uses the scenario of an advertising recommendation system as an example to describe the technical solution of the embodiment of the present application in detail through steps 1 to 7:

[0084] Step 1: Determine the comprehensive indicators to be analyzed in the advertising recommendation system.

[0085] For example, in an advertising recommendation system, comprehensive indicators include ad click-through rate, ad cost per thousand impressions, ad cost per click, ad exposure rate, etc. Among them, the "ad click-through rate" in the advertising recommendation system can be determined as the comprehensive indicator to be analyzed.

[0086] Step 2: Determine at least two recommendation areas to be analyzed in the advertising recommendation system.

[0087] Based on step 1, for example, in the advertising recommendation system, according to the advertising recommendation columns, the advertising recommendation system may include a travel column, a game column and a car column. Therefore, the travel column, the game column and the car column may be determined as the recommendation areas to be analyzed.

[0088] Step 3: Obtain the first indicator monitoring value and the second indicator monitoring value of each recommended area.

[0089] Based on step 2, for example, when the comprehensive indicator to be analyzed is the click-through rate of advertisements, the first indicator monitoring value of each recommendation area can refer to the number of advertisement clicks currently monitored in the travel column, game column, and automobile column, which are respectively recorded as c 11 、c 12 、c 13 The second indicator monitoring value of each recommendation area can refer to the number of advertising exposures currently monitored in the travel column, game column and automobile column, respectively recorded as b 11 、b 12 、b13 .

[0090] Step 4: Obtain the first index reference value and the second index reference value of each recommended area.

[0091] Based on step 3, for example, the first indicator reference value of each recommendation area can refer to the number of advertisement clicks monitored in the travel column, game column and automobile column in history, which are recorded as c 21 、c 22 、c 23 The second indicator reference value of each recommended area can refer to the number of advertising exposures monitored in the travel column, game column and automobile column in history, which are recorded as b 21 、b 22 、b 23 .

[0092] Step 5: Determine the comprehensive indicator monitoring value of the comprehensive indicator to be analyzed of the advertising recommendation system.

[0093] Based on step 3, for example, in the advertising recommendation system, the comprehensive indicator monitoring value of the advertising click rate ctr n It can be:

[0094]

[0095] Step 6: Determine the comprehensive index reference value of the comprehensive index to be analyzed for each recommended area.

[0096] Based on steps 3 and 4, for example, in the advertising recommendation system, the comprehensive index reference value of the click-through rate of the tourism column advertisement is ctr o1 It can be:

[0097]

[0098] CTR, a comprehensive indicator reference value for the click-through rate of advertisements in the game column o2 It can be:

[0099]

[0100] Comprehensive index reference value of click-through rate of advertisements in automobile column ctr o3 It can be:

[0101]

[0102] Step 7: Determine the abnormal impact weight of each recommendation area on the advertising recommendation system.

[0103] Based on steps 5 and 6, for example, in the advertising recommendation system, the abnormal influence weight of the travel column on the advertising recommendation system is w1:

[0104] w1=ctr n -ctr o1

[0105] The abnormal influence weight of the game column on the advertising recommendation system is w2:

[0106] w2=ctr n -ctr o2

[0107] The abnormal influence weight of the automobile column on the advertising recommendation system is w3:

[0108] w3=ctr n -ctr o3

[0109] By processing the data in the advertising system through the solution provided by this application, on the one hand, the data processing efficiency can be improved. On the other hand, based on the idea of ​​mobile analysis of control variables, assuming that the basic indicator monitoring value of the current advertising recommendation field does not change, that is, when the basic indicator reference value is the same, the comprehensive indicator monitoring value should be what, and the difference between the actual comprehensive indicator monitoring value is used as the abnormal influence weight of the current recommendation field, which can directly measure the degree of influence of the current recommendation field on the entire advertising recommendation system. Therefore, the interpretability of the abnormal influence weight greatly simplifies the problem of abnormal location in the advertising recommendation system, making abnormal location more accurate and comprehensive.

[0110] In the technical solutions provided in some embodiments of the present application, the basic indicator monitoring values ​​and basic indicator reference values ​​of each recommended area are used to determine the comprehensive indicator monitoring values ​​of the recommendation system, as well as the comprehensive indicator reference values ​​of the recommendation system for each recommended area. Furthermore, the abnormal impact weight of each recommended area on the recommendation system can be determined based on the comprehensive indicator monitoring values ​​and comprehensive indicator reference values. Because the comprehensive indicator monitoring values ​​of the entire recommendation system and the comprehensive indicator reference values ​​of the recommendation system for the corresponding recommended area are taken into account when determining the abnormal impact weight of each recommended area on the recommendation system, the determined abnormal impact weight is highly interpretable, and thus the abnormal impact weight of the recommended area on the recommendation system can be used to accurately monitor the operating status of the recommendation system.

[0111] The following describes an embodiment of the device of the present application, which can be used to execute the data processing method in the recommendation system in the above-mentioned embodiment of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the data processing method in the recommendation system in the above-mentioned present application.

[0112] Figure 8 A block diagram of a data processing device in a recommendation system according to an embodiment of the present application is shown.

[0113] Reference Figure 8 As shown, according to an embodiment of the present application, a data processing device 700 in a recommendation system includes: an acquisition unit 701, a first determination unit 702, a second determination unit 703, and a third determination unit 704. The acquisition unit 701 is used to acquire the basic indicator monitoring value and the basic indicator reference value of each recommended area; the first determination unit 702 is used to determine the comprehensive indicator monitoring value of the recommendation system based on the basic indicator monitoring value of each recommended area; the second determination unit 703 is used to determine the comprehensive indicator reference value of the recommendation system for each recommended area based on the basic indicator monitoring value and the basic indicator reference value of each recommended area; and the third determination unit 704 is used to determine the abnormal impact weight of the recommended area on the recommendation system based on the comprehensive indicator monitoring value and the comprehensive indicator reference value, wherein the abnormal impact weight is used to characterize the degree of abnormal impact of the recommended area on the recommendation system.

[0114] In some embodiments of the present application, based on the aforementioned scheme, the basic indicator monitoring value includes a first indicator monitoring value and a second indicator monitoring value, the comprehensive indicator monitoring value is positively correlated with the first indicator monitoring value, and the comprehensive indicator monitoring value is negatively correlated with the second indicator monitoring value; the basic indicator reference value includes a first indicator reference value and a second indicator reference value, the comprehensive indicator reference value of the recommendation system determined for the recommended area is positively correlated with the first indicator reference value corresponding to the recommended area, and the comprehensive indicator reference value of the recommendation system determined for the recommended area is negatively correlated with the second indicator reference value corresponding to the recommended area.

[0115] In some embodiments of the present application, based on the aforementioned scheme, the first determination unit 702 is configured to: sum the first indicator monitoring values ​​of each recommended area to obtain the first indicator monitoring total value; sum the second indicator monitoring values ​​of each recommended area to obtain the second indicator monitoring total value; and determine the ratio of the first indicator monitoring total value to the second indicator monitoring total value as the comprehensive indicator monitoring value of the recommendation system.

[0116] In some embodiments of the present application, based on the aforementioned scheme, the second determination unit 703 is configured to: for each recommended area in the recommendation system, sum the first indicator monitoring values ​​of each recommended area except the current recommended area and the first indicator reference value of the current recommended area to obtain the first indicator reference total value; sum the second indicator monitoring values ​​of each recommended area except the current recommended area and the second indicator reference value of the current recommended area to obtain the second indicator reference total value; determine the ratio of the first indicator reference total value to the second indicator reference total value as the comprehensive indicator reference value of the recommendation system for the current recommended area.

[0117] In some embodiments of the present application, based on the aforementioned solution, the third determination unit 704 is configured to: determine the difference between the comprehensive indicator monitoring value and the comprehensive indicator reference value as the abnormal impact weight of the recommended area on the recommendation system.

[0118] In some embodiments of the present application, based on the aforementioned scheme, the device also includes: a fourth determination unit, which is used to determine the abnormal impact weight of the recommended area on the recommendation system based on the comprehensive indicator monitoring value and the comprehensive indicator reference value, and then determine the maximum abnormal impact weight among the abnormal impact weights corresponding to each recommended area; and determine the recommended area corresponding to the maximum abnormal impact weight as the abnormal recommended area.

[0119] In some embodiments of the present application, based on the aforementioned scheme, the device also includes: a fourth determination unit, which is used to determine the abnormal impact weight of the recommended area on the recommendation system based on the comprehensive indicator monitoring value and the comprehensive indicator reference value, and then determine the abnormal impact weight that exceeds a predetermined threshold among the abnormal impact weights corresponding to each recommended area; and determine the recommended area corresponding to the abnormal impact weight that exceeds the predetermined threshold as an abnormal recommended area.

[0120] Figure 9 A schematic diagram of the structure of a computer system suitable for implementing an electronic device according to an embodiment of the present application is shown.

[0121] It should be noted that Figure 9 The computer system 900 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0122] like Figure 9 As shown, the computer system 900 includes a central processing unit (CPU) 901, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 902 or the program loaded from the storage part 908 into the random access memory (RAM) 903, such as executing the method described in the above embodiment. Various programs and data required for system operation are also stored in the RAM 903. The CPU 901, ROM 902 and RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0123] The following components are connected to the I / O interface 905: an input section 906 including a keyboard, a mouse, and the like; an output section 907 including devices such as a cathode ray tube (CRT), a liquid crystal display (LCD), and a speaker; a storage section 908 including a hard disk and the like; and a communication section 909 including a network interface card such as a LAN (Local Area Network) card or a modem. The communication section 909 performs communication processing via a network such as the Internet. A drive 910 is also connected to the I / O interface 905 as needed. Removable media 911, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, and the like, are installed in the drive 910 as needed, so that computer programs read therefrom can be installed into the storage section 908 as needed.

[0124] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via the communication section 909, and / or installed from a removable medium 911. When the computer program is executed by the central processing unit (CPU) 901, the various functions defined in the system of the present application are executed.

[0125] It should be noted that the computer-readable medium shown in the embodiments of the present application can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present application, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, or any suitable combination thereof.

[0126] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present application. Among them, each box in the flowchart or block diagram can represent a module, program segment, or part of the code, and the above-mentioned module, program segment, or part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0127] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. In some cases, the names of these units do not constitute limitations on the units themselves.

[0128] As another aspect, the present application further provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the method provided in the first aspect or various optional implementations of the first aspect.

[0129] As another aspect, the present application further provides a computer-readable medium, which may be included in the electronic device described in the above embodiments, or may exist independently without being incorporated into the electronic device. The computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device implements the method described in the above embodiments.

[0130] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiment of the application, the features and functions of two or more modules or units described above can be concretized in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into multiple modules or units to be concretized.

[0131] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the example embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the embodiments of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the embodiments of the present application.

[0132] Those skilled in the art will readily conceive of other embodiments of the present application after considering the specification and practicing the embodiments disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present application that follow the general principles of this application and include common knowledge or customary techniques in the art that are not disclosed herein.

[0133] It should be understood that the present application is not limited to the exact structures described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A data processing method in a recommendation system, characterized in that: The recommendation system includes at least two recommendation areas, and the method includes: Obtaining basic indicator monitoring values ​​and basic indicator reference values ​​for each recommended area, wherein the basic indicator monitoring values ​​include a first indicator monitoring value and a second indicator monitoring value, and the basic indicator reference values ​​include a first indicator reference value and a second indicator reference value; Determine a comprehensive indicator monitoring value of the recommendation system according to the basic indicator monitoring value of each recommended area, wherein the comprehensive indicator monitoring value is positively correlated with the first indicator monitoring value and negatively correlated with the second indicator monitoring value; Determine, for each recommended area, a comprehensive index reference value of the recommendation system based on the basic index monitoring value and the basic index reference value of each recommended area; the comprehensive index reference value of the recommendation system determined for any recommended area is positively correlated with the first index reference value corresponding to the recommended area; the comprehensive index reference value of the recommendation system determined for any recommended area is negatively correlated with the second index reference value corresponding to the recommended area; An abnormal impact weight of the recommended area on the recommendation system is determined according to the comprehensive indicator monitoring value and the comprehensive indicator reference value, where the abnormal impact weight is used to represent the degree of abnormal impact of the recommended area on the recommendation system.

2. The method according to claim 1, characterized in that Determining the comprehensive indicator monitoring value of the recommendation system based on the basic indicator monitoring value of each recommended area includes: Sum the first indicator monitoring values ​​of each recommended area to obtain the total monitoring value of the first indicator; Sum up the second indicator monitoring values ​​of each recommended area to obtain the total second indicator monitoring value; The ratio of the first indicator monitoring total value to the second indicator monitoring total value is determined as the comprehensive indicator monitoring value of the recommendation system.

3. The method according to claim 1, characterized in that For each recommended area in the recommendation system, the comprehensive index reference value is determined in the following manner: Summing the first indicator monitoring values ​​of each recommended area except the current recommended area and the first indicator reference value of the current recommended area to obtain a total reference value of the first indicator; Summing the second indicator monitoring values ​​of each recommended area except the current recommended area and the second indicator reference value of the current recommended area to obtain a second indicator total reference value; The ratio of the first indicator reference total value to the second indicator reference total value is determined as the comprehensive indicator reference value of the recommendation system for the current recommendation area.

4. The method according to claim 1, wherein The determining, based on the comprehensive indicator monitoring value and the comprehensive indicator reference value, the abnormal impact weight of the recommended area on the recommendation system includes: The difference between the comprehensive indicator monitoring value and the comprehensive indicator reference value is determined as the abnormal impact weight of the recommended area on the recommendation system.

5. The method according to claim 1, wherein After determining the abnormal impact weight of the recommended area on the recommendation system based on the comprehensive indicator monitoring value and the comprehensive indicator reference value, the method further includes: Determine the maximum abnormal impact weight among the abnormal impact weights corresponding to each recommended area; The recommended area corresponding to the maximum abnormal impact weight is determined as the abnormal recommended area.

6. The method according to claim 1, wherein After determining the abnormal impact weight of the recommended area on the recommendation system based on the comprehensive indicator monitoring value and the comprehensive indicator reference value, the method further includes: Determining, from the abnormal impact weights corresponding to the recommended areas, an abnormal impact weight exceeding a predetermined threshold; The recommended area corresponding to the abnormal impact weight exceeding a predetermined threshold is determined as an abnormal recommended area.

7. A data processing device in a recommendation system, characterized in that: The recommendation system includes at least two recommendation areas, and the device includes: an acquiring unit, configured to acquire basic indicator monitoring values ​​and basic indicator reference values ​​of each recommended area, wherein the basic indicator monitoring values ​​include a first indicator monitoring value and a second indicator monitoring value, and the basic indicator reference values ​​include a first indicator reference value and a second indicator reference value; a first determining unit, configured to determine a comprehensive indicator monitoring value of the recommendation system according to the basic indicator monitoring values ​​of each recommended area, wherein the comprehensive indicator monitoring value is positively correlated with the first indicator monitoring value and negatively correlated with the second indicator monitoring value; The second determining unit is configured to determine, for each recommended area, a comprehensive index reference value of the recommendation system based on the basic index monitoring value and the basic index reference value of each recommended area; the comprehensive index reference value of the recommendation system determined for any recommended area is positively correlated with the first index reference value corresponding to the recommended area; and the comprehensive index reference value of the recommendation system determined for any recommended area is negatively correlated with the second index reference value corresponding to the recommended area; A third determining unit is configured to determine an abnormal impact weight of the recommended area on the recommendation system based on the comprehensive indicator monitoring value and the comprehensive indicator reference value, wherein the abnormal impact weight is used to represent a degree of abnormal impact of the recommended area on the recommendation system.

8. A computer-readable storage medium having a computer program stored thereon, the computer program comprising executable instructions, and when the executable instructions are executed by a processor, the method according to any one of claims 1 to 6 is implemented.

9. An electronic device, characterized in that: include: processor; as well as a memory for storing executable instructions of the processor; The processor is configured to execute the executable instructions to implement the method according to any one of claims 1 to 6.

Images