Method, apparatus, device, storage medium and program product for providing media items

Abstract

The embodiment of the invention relates to a method and device for providing media items, equipment, a storage medium and a program product. The method comprises the following steps: providing a plurality of target media items with the same priority within a first preset time interval; and in response to determining that a respective access interestingness for a first set of media items of the plurality of target media items exceeds a threshold level within the first predetermined time interval, providing the plurality of target media items at the same priority and the first set of media items at different priorities within a second predetermined time interval, a respective priority of the first set of media items within the second predetermined time interval is associated with a respective access interestingness of the first set of media items within the first predetermined time interval. Therefore, the media items can be provided for the target user in different providing modes in different periods, and the delivery effect of the media items is improved.

Description

Technical Field

[0001] Example embodiments of the present disclosure relate generally to the field of computer technology, and more particularly, to methods, apparatuses, electronic devices, computer-readable storage media, and computer program products for providing media items. Background Art

[0002] With the advancement of computer technology, online advertising (e.g., mini-programs, apps, and webpages) is playing an increasingly important role in helping companies promote their brands, sell products, acquire users, and retain customers. For online advertising, multiple media items, such as different copy and videos, are typically produced for the same campaign (e.g., a product). This approach aims to achieve better advertising results. Summary of the Invention

[0003] In a first aspect of the present disclosure, a method for providing media items is provided. The method includes providing a plurality of target media items at the same priority within a first predetermined time interval. In response to determining that corresponding access interest levels for a first group of media items among the plurality of target media items exceed a threshold level within the first predetermined time interval, providing the plurality of target media items at the same priority within a second predetermined time interval and providing the first group of media items at a different priority, wherein the corresponding priorities of the first group of media items within the second predetermined time interval are associated with the corresponding access interest levels of the first group of media items within the first predetermined time interval.

[0004] In a second aspect of the present disclosure, an apparatus for providing media items is provided. The apparatus includes: a first providing module configured to provide a plurality of target media items at the same priority within a first predetermined time interval; and a second providing module configured to, in response to determining that corresponding access interest levels for a first group of media items among the plurality of target media items exceed a threshold level within the first predetermined time interval, provide the plurality of target media items at the same priority within a second predetermined time interval, and provide the first group of media items at different priorities, wherein the corresponding priorities of the first group of media items within the second predetermined time interval are associated with the corresponding access interest levels of the first group of media items within the first predetermined time interval.

[0005] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the electronic device to perform the method of the first aspect.

[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the medium, and when the computer program is executed by a processor, the method of the first aspect is implemented.

[0007] In a fifth aspect of the present disclosure, a computer program product is provided, which includes a computer program, wherein when the computer program is executed by a processor, the method according to the first aspect of the present disclosure is implemented.

[0008] It should be understood that the content described in this section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] The above and other features, advantages and aspects of the various embodiments of the present disclosure will become more apparent hereinafter with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0010] Figure 1 A schematic diagram illustrating an example environment in which embodiments of the present disclosure can be implemented;

[0011] Figure 2 A flowchart illustrating a method for providing a media item according to some embodiments of the present disclosure is shown;

[0012] Figure 3 A schematic diagram illustrating a manner of providing media items at different stages according to some embodiments of the present disclosure;

[0013] Figure 4 A flowchart illustrating a method for providing media items with different priorities according to some embodiments of the present disclosure is shown;

[0014] Figure 5A A flowchart of a method for providing media items based on target users according to some embodiments of the present disclosure is shown;

[0015] Figure 5B A model for providing media items based on target users according to some embodiments of the present disclosure is shown;

[0016] Figure 6 A schematic structural block diagram showing an apparatus for providing media items according to certain embodiments of the present disclosure; and

[0017] Figure 7 A block diagram is shown of a computing device in which one or more embodiments of the present disclosure may be implemented. DETAILED DESCRIPTION

[0018] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Instead, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0019] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to." The term "based on" should be understood as "based at least in part on." The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment." The term "some embodiments" should be understood as "at least some embodiments." Other explicit and implicit definitions may be included below.

[0020] It should be noted that the acquisition, storage and application of user personal information involved in the technical solution of this disclosure are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0021] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0022] For example, in response to receiving a user's active request, a prompt message is sent to the user to clearly remind the user that the operation requested to be performed will require obtaining and using the user's personal information, so that the user can independently choose whether to provide personal information to the electronic device, application, server or storage medium and other software or hardware that performs the operation of the technical solution of the present disclosure based on the prompt message.

[0023] As an optional but non-limiting implementation, in response to receiving a user's active request, a prompt message may be sent to the user, for example, in the form of a pop-up window, in which the prompt message may be presented in text form. Furthermore, the pop-up window may also include a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0024] It is understandable that the above notification and user authorization process are merely illustrative and do not limit the embodiments of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the embodiments of the present disclosure.

[0025] Media items: In the embodiments of the present disclosure, media items refer to materials in the form of text, pictures, videos, etc. that are generated for a specific project, such as a product (the product can be a physical product, a virtual product, or various organizations or software applications, etc.) to increase the exposure of the project and thereby increase a certain benefit of the project.

[0026] As mentioned above, online advertising typically involves creating multiple media items for the same item (e.g., a product), including different copy (e.g., differing fonts, advertising slogans, and images) and videos. This approach aims to achieve better advertising effectiveness by providing multiple media items. When multiple media items are present, how to maximize advertising effectiveness by delivering each media item to target users (e.g., those targeted by the advertisement) becomes a crucial issue.

[0027] In view of this, an embodiment of the present disclosure provides an improved scheme for providing media items. In this scheme, multiple target media items are provided with the same priority within a first predetermined time interval. In response to determining that the corresponding access interest of a first group of media items among the multiple target media items exceeds a threshold level within the first predetermined time interval, multiple target media items are provided with the same priority within a second predetermined time interval, and the first group of media items are provided with a different priority, and the corresponding priority of the first group of media items within the second predetermined time interval is associated with the corresponding access interest of the first group of media items within the first predetermined time interval. In this way, by providing media items to target users in different provision methods within different time periods, and dynamically adjusting the provision amount of media items based on the provision effect of the media items, a better provision effect can be obtained as much as possible.

[0028] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

[0029] Figure 1 1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. Figure 1 As shown, example environment 100 may include electronic device 110. Electronic device 110 may be configured with a media item providing system.

[0030] In the example environment 100 , the electronic device 110 may deploy a data layer 120 , a model layer 130 , and a real-time interaction and media item providing layer 140 in a media item providing system.

[0031] The data layer 120 is configured to provide, calculate and / or store various data that the model layer relies on. In some embodiments of the present disclosure, the data layer 120 includes real-time algorithm experiment configuration information, online real-time exposure click data, user / media item real-time feature data and offline T+1 conversion data of each scene. Among them, the real-time algorithm, such as the media item currently used by the model layer 130, provides an algorithm. As an example, the real-time algorithm experiment configuration information includes experimental identification (id), experimental resource id, user diversion configuration and other experimental population information, experimental tuning targets and other experimental information. Through the data layer 120, the information of the corresponding experimental population can be obtained in real time to ensure the realization of the real-time experimental link.

[0032] In some embodiments of the present disclosure, online real-time exposure and click-through data refers to the real-time online behavior data of the target user group of the system experiment connected to the media item provision system in the current scenario. For example, for a specific copy, the data layer 120 can obtain real-time online behavior data of the target user group to which the copy is provided. By obtaining real-time online exposure and click-through data, the data layer 120 ensures that the system can obtain real-time online user reactions in the shortest possible time, so that the model layer 130 can use this data to perform real-time algorithm tuning, laying a data foundation for ensuring algorithm effectiveness.

[0033] In some embodiments of the present disclosure, real-time user / media item feature data refers to data about users and their interactions with various media items at the user level. For example, real-time user data may include user profile information such as age, gender, zodiac sign, and educational background, as well as user app activity, app loyalty, and user behavior data within a business line. By incorporating real-time user data, the data layer 120 enables the model layer 130 to achieve better results.

[0034] In some embodiments of the present disclosure, real-time feature data of media items is used to represent data related to the media items that assist in content understanding, such as the media item's embedding, media item characteristics, etc. The data layer 120 obtains real-time feature data of media items. On the one hand, this helps the model layer 130 determine the status of the media items to determine whether to use a cold start model or a personalized model for the media items. On the other hand, it also provides the model layer 130 with sufficient information when new media items are put online, ensuring that the algorithm has more sufficient information to utilize.

[0035] In some embodiments of the present disclosure, the data layer 120 can obtain offline T+1 conversion data for each scenario. Offline T+1 conversion data refers to conversion data determined on T+1 day (i.e., the first working day after the media item is provided). Taking financial loan projects as an example, since there is a buffer period for online user conversions in most scenarios, the timeliness is poor, and the conversion calibers of each scenario vary greatly, it is difficult to uniformly report the conversion data points of each scenario at the actual implementation level. Therefore, the conversion target of each scenario is basically based on the T0 first loan. The embodiments of the present disclosure can achieve better algorithm tuning by obtaining offline T+1 conversion data for each scenario.

[0036] The model layer 130 may include a media item library module, a traffic pool module (not shown), a trial provision and exploration module, a personalized recommendation module, and a fatigue mechanism module. The media item library module is configured to store existing media items and newly added media items for each project or product. The traffic pool module is configured to store information about target users currently available for delivery, such as all users or active users of an APP. The trial provision and exploration module is used to determine the target users and corresponding provision amounts of each media item to be provided based on a preset model and the data currently associated with the access interest of the newly added media items or existing media items and / or the historical access interest association data, thereby exploring the corresponding delivery effect of each media item. The personalized recommendation module is configured to determine the media items suitable for providing to the target user based on the preset model and the data associated with the target user and the media items, thereby providing the suitable media items to the target user. The fatigue mechanism module is configured to prevent the same media items from being provided to the same user all the time, causing the user to have a counter-effect on the media items.

[0037] The real-time interaction and media item provision layer 140 is configured to provide each media item to target users in real time and obtain feedback from the target users on each media item. For example, the real-time interaction and media item provision layer 140 is further configured to provide each media item to the corresponding target users based on the target users and provision amount determined by the model layer 130.

[0038] The electronic device 110 may include any computing system with computing capabilities, such as various computing devices / systems, terminal devices, server devices, etc. The terminal device may be any type of mobile terminal, fixed terminal, or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a handheld computer, a portable game terminal, a VR / AR device, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device, or any combination thereof, including accessories and peripherals of these devices or any combination thereof.

[0039] The electronic device 110 may also be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and big data and artificial intelligence platforms. Server-side devices may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, and the like.

[0040] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the present disclosure.

[0041] Figure 2 1 shows a flow chart of a process 200 for providing a media item according to some embodiments of the present disclosure. The process 200 may be implemented at the electronic device 110. For ease of discussion, reference will be made to Figure 1 The process 200 is described with reference to the environment 100 of FIG.

[0042] At block 210 , the electronic device 110 provides a plurality of target media items with the same priority within a first predetermined time interval.

[0043] The first predetermined time interval is also referred to as the first stage or the trial provision stage. In some embodiments of the present disclosure, this stage is mainly targeted at media items that are newly added to the media item library. For newly added media items, since there is no corresponding feedback data from the target users on the media items, it is impossible to determine the delivery effect of the media items. Therefore, in some embodiments of the present disclosure, the delivery data of each media item, such as click-through rate, conversion rate, etc., is determined through trial provision in the first stage. Reference Figure 3In the first stage, the electronic device 110 provides all target media items provided this time to their respective target users with the same priority, where one circle represents a media item.

[0044] In embodiments of the present disclosure, providing media items may, for example, include presenting or delivering advertisements, promotions, or publicity to predetermined targets through predetermined channels. For example, in a first phase, multiple target media items are provided based on a priority level. For example, the multiple target media items may be newly added media items, such as newly added promotional content with different content. For example, the multiple target media items may be media items for the same project or product. Providing the multiple target media items with the same priority level during a first predetermined time interval allows for obtaining the corresponding delivery effects of the multiple target media items within the first predetermined time interval, thereby providing data support for determining subsequent provisioning strategies. In this context, the term "same priority" refers to the same traffic or provisioning volume for each media item. For example, if there are 10 media items and the total traffic or provisioning volume allocated to these 10 media items is A, then the traffic or provisioning volume for each media item is A / 10. In this context, traffic or provisioning volume refers to the number of users to whom a media item is provided, which can be expressed as the number of users or the number of times a media item is provided. This refers to the number of users or the number of times a media item is provided within the target user population.

[0045] Furthermore, in order to obtain relatively accurate delivery data, the media items need to meet the minimum sample size, that is, the minimum number of delivery users or the number of user times. Exemplarily, process 200 also includes: the electronic device 110 determines the corresponding minimum sample size of the target media items in the multiple target media items based on the corresponding expected conversion rate of the target media items in the multiple target media items; and determines the corresponding supply quantity of each target media item based on the corresponding minimum sample size of the target media items in the multiple target media items and the total supply quantity for the multiple target media items. For example, if the minimum sample size of each media item of 10 target media items is a, b, c, etc., and the total supply quantity of the 10 target media items is A, then the corresponding supply quantity of each target media item is determined based on a, b, c and A. The corresponding supply quantity of each target media item meets its own minimum sample size and is roughly the same as each other.

[0046] As an example, for each target media item, its minimum sample size is determined by the following formula (1).

[0047] n=(Zα / 2+Zβ)^2*(p1*(1-p1)+p2*(1-p2)) / (p1-p2)^2(1)

[0048] Where n is the minimum sample size for each target media item, Zα / 2 is the Z score corresponding to the statistical significance level (for example, the Z score corresponding to the 95% confidence level is approximately 1.96), Zβ is the Z score corresponding to the statistical power (for example, the Z score corresponding to 80% power is approximately 0.84), and p1 and p2 are the expected conversion rates or proportions of the target media item and the control media item. The expected conversion rate or proportion is the conversion rate or proportion that the system expects to achieve for the media item.

[0049] At box 210, after the electronic device 110 provides multiple target media items with the same priority within a first predetermined time interval, the electronic device 110 can also obtain corresponding delivery effects or reports of the multiple target media items, thereby determining the delivery data of each target media item, such as click-through rate, conversion rate, etc.

[0050] It should be understood that the length of the first predetermined time interval can be determined as needed, for example, one week, one month, etc. The first predetermined time interval can be determined based on parameters such as the delivery cycle of the current media item delivery project, which is not specifically limited in this disclosure.

[0051] Continue to refer Figure 2 At box 220, in response to determining that the corresponding access interest of a first group of media items among the multiple target media items exceeds a threshold level within a first predetermined time interval, the electronic device 110 provides the multiple target media items with the same priority within a second predetermined time interval, and provides the first group of media items with a different priority, and the corresponding priority of the first group of media items in the second predetermined time interval is associated with the corresponding access interest of the first group of media items in the first predetermined time interval.

[0052] The second predetermined time interval is also referred to as the second stage or the tuning stage. In some embodiments of the present invention, this stage is mainly for media items that have passed the trial provision stage. Since the delivery data of each media item is obtained during the trial provision stage, each media item is graded during this stage, thereby increasing the supply of media items with good effects (i.e., traffic or the number of target users) and reducing the supply of media items with poor effects. Figure 3 In the second phase, two provisioning methods are used: one is to provide all target media items provided this time with the same priority to their respective target users; the other is to provide the media items that performed well in the trial provision phase with different priorities to their respective target users.

[0053] It should be understood that in the second stage, the total amount of provision occupied by providing multiple target media items with the same priority (referred to as the first provision amount in the embodiment of the present disclosure) and the total amount of provision occupied by providing the first group of media items with different priorities (referred to as the second provision amount in the embodiment of the present disclosure) can be predetermined or dynamically adjusted. For example, at the beginning, the first provision amount and the second provision amount each account for 50% of the total amount of provision provided by the current media item, and can be adjusted to 40% and 60% respectively as needed in the subsequent period. It should be understood that the specific size or ratio of the first provision amount and the second provision amount can be adjusted to any suitable size or ratio as needed, and the present disclosure does not make specific limitations on this. Exemplarily, the first provision amount is less than or equal to the second provision amount.

[0054] It should be understood that the length of the second predetermined time interval can be determined as needed, for example, one week, one month, etc. The second predetermined time interval can be determined based on parameters such as the delivery cycle of the current media item delivery project, and this disclosure does not specifically limit this. The length of the second predetermined time interval can be the same as the length of the first predetermined time interval. The length of the second predetermined time interval can also be different from the length of the first predetermined time interval, for example, the length of the second predetermined time interval is greater than the length of the first predetermined time interval.

[0055] In some embodiments of the present disclosure, a first group of media items is determined based on the corresponding access interest levels among multiple target media items within a first predetermined time interval. Access interest levels represent target user engagement data for a media item, such as click-through rate or conversion rate. For example, when the access interest level of a media item among the multiple target media items exceeds a threshold level, such as a predetermined click-through rate or conversion rate, the target media item may be included in the first group of media items. For another example, the first group of media items may be determined based on the access interest ranking of the media items among the multiple target media items, with the media items among the multiple target media items whose access interest rankings are above a predetermined ranking being included in the first group of media items. For example, media items ranked in the top N% of the multiple target media items in terms of access interest may be included in the first group of media items. For example, media items ranked in the top 20% of the multiple target media items in terms of access interest may be included in the first group of media items. It should be understood that the method for determining the first group of media items may employ any suitable method as needed, and is not limited to the method provided in the embodiments of the present disclosure.

[0056] After the first group of media items is determined, the first group of media items is provided to the target user with different priorities. Exemplarily, the first group of media items can be provided to the target user by a cold start algorithm commonly used in the art. For example, the first group of media items is provided to the target user with different priorities by using algorithms such as Thompson sampling, hybrid linear confidence interval upper bound algorithm (UCB), hybrid linear UCB (LinUCB), etc. As an example, in some examples of the present disclosure, the first group of media items is provided to the target user by Thompson sampling. Figure 4 Describe an example procedure for Thompson sampling.

[0057] Figure 4 1 shows a flowchart of a process 400 for providing media items at different priorities according to some embodiments of the present disclosure. The process 400 may be implemented at the electronic device 110. For ease of discussion, reference will be made to Figure 1 The process 400 is described with reference to the environment 100 of FIG.

[0058] like Figure 4 As shown, at block 410, the electronic device 110 may obtain data associated with the current predetermined level of access interest of the media items in the first group of media items. As an example, the electronic device 110 obtains the current hourly exposure click data of the media items in the first group of media items, such as the click data of each media item per hour.

[0059] At box 411, the electronic device 110 may determine the cumulative data associated with the access interest of the media items in the first group of media items based on the data associated with the access interest at the current predetermined level. For example, the electronic device 110 accumulates the data associated with the access interest at the current predetermined level and the historical data associated with the access interest to determine the cumulative data associated with the access interest of the media items in the first group of media items. For example, the historical data associated with the access interest may include data within a first predetermined time interval and data before the current time within a second predetermined time interval. As an example, the electronic device 110 accumulates the exposure click data of the media items in the first group of media items.

[0060] At box 412, the electronic device 110 can determine the scores associated with the access interest of the corresponding media items in the first group of media items based on the cumulative data associated with the access interest of the media items in the first group of media items. Exemplarily, the electronic device 110 uses the Thompson sampling algorithm to determine the scores associated with the access interest of each media item in the first group of media items, such as the Thompson beta distribution score, based on the cumulative data associated with the access interest of the media items in the first group of media items. It should be understood that the embodiments of the present disclosure are not limited to the Thompson sampling algorithm, and the scores associated with the access interest of the media items, such as the click-through rate and conversion rate scores, can be determined by other suitable algorithms. It should be noted that the conversion rate here refers to the conversion rate determined based on the actual data associated with the access interest of the media items. For example, taking application promotion as an example, the conversion rate can be determined by the cumulative number of clicks and the cumulative number of downloads.

[0061] After determining the corresponding scores associated with the access interest of the first group of media items, the electronic device 110 can determine the corresponding priorities and corresponding provision quantities of the first group of media items based on the corresponding scores associated with the access interest of the first group of media items, wherein the higher the scores associated with the access interest, the higher the corresponding priorities and corresponding provision quantities of the media items. In other words, the higher the scores associated with the access interest, the higher the priority and provision quantities. For example, if the total provision quantity of the first media item is A, the provision quantity of the media item with the first score is, for example, A / 2, the provision quantity of the media item with the second score is, for example, A / 4, and the provision quantity of the media item with the third score is, for example, A / 8. In this way, the purpose of expanding the quantity of high-quality media items and retaining a small flow for low-quality media items can be achieved, thereby achieving a better overall delivery effect.

[0062] It should be understood that in some embodiments of the present disclosure, in the process of providing media items with different priorities, in order to obtain better results, when determining the amount of media items to be provided, in addition to considering the data associated with the access interest of the media items, the relevant data of the target users on the user side may also be considered.

[0063] Continue to refer Figure 4 At block 413 , the electronic device may organize the media item data obtained at blocks 410 to 413 , for example, converting the data into a predetermined format for the user to call when requesting the media item.

[0064] At block 414, the electronic device 110 determines the target user's permitted media items. Specifically, the electronic device 110 determines which media items are permitted for the target user based on the target user's user-side data. The target user's user-side data may include data such as the target user's click-through rate and conversion rate for different media items. For example, the electronic device 110 may determine the target user's permitted media items based on the target user's click-through rate for different media items and corresponding thresholds.

[0065] At block 415 , the electronic device 110 may determine a second set of media items for the target user based on the admitted media items and the first set of media items. For example, the electronic device 110 intersects the admitted media items with the first set of media items to obtain the second set of media items.

[0066] In some embodiments of the present disclosure, in response to determining that the admitted media items and the first set of media items do not intersect, the electronic device 110 may adopt default media items as the second set of media items at block 416. The default media items may be all media items in the first set of media items, or media items that meet a predetermined condition.

[0067] At block 417, electronic device 110 may determine corresponding conversion targets for the second set of media items. Examples of corresponding conversion targets for the second set of media items include click-through rate, activation rate, and the like. These conversion targets may be determined by electronic device 110 based on input from customers of the current media placement project. For example, for financial loan products, the conversion target may include the number of first-time borrowers or the first-time borrower ratio.

[0068] It should be understood that, in the case of the same product, each media item in the second group of media items may use the same conversion goal.

[0069] At block 417 , the electronic device 110 may further perform weighted optimization on the current sampling algorithm based on the conversion rate and conversion target of each media item in the second group of media items, for example, weighted optimization on each parameter in the Thompson beta distribution.

[0070] At block 418 , the electronic device 110 may determine respective scores associated with access interestingness for the second set of media items based on the respective conversion goals for the second set of media items.

[0071] After determining the scores associated with the access interest after smooth scaling of each media item in the second group of media items, the electronic device 110 determines the corresponding priorities and corresponding provision quantities of the second group of media items based on the scores associated with the access interest, wherein the higher the scores associated with the access interest, the higher the corresponding priorities and corresponding provision quantities of the media items. In other words, the higher the scores associated with the access interest, the higher the priority and provision quantities. This can achieve the purpose of expanding the volume of high-quality media items and retaining a small amount of traffic for low-quality media items, thereby achieving a better overall delivery effect.

[0072] Exemplarily, the electronic device performs softmax smoothing on the result obtained at block 417, sets a scale parameter, and calculates the score associated with the access interest of each media item in the second group of media items after smoothing and scaling. Specifically, softmax smoothing controls the proportion of the amount of each media item provided by setting the size of the scale parameter. As an example, if there are four media items, if scale = 50 and the proportion of the amount of each media item provided is 50:30:10:10, then when scale = 100, the proportion of the amount of each media item provided will be expanded, for example, the proportion of the amount of each media item provided may become 60:25:8:7, etc.

[0073] At box 419 , the electronic device 110 performs sampling exposure on each media item in the second group of media items using a random weighted sampling method to ensure that the proportion of the amount of each media item provided online is consistent with the result at box 425 .

[0074] In some embodiments of the present disclosure, process 200 also includes: the electronic device 110 provides the multiple target media items with the same priority within a third predetermined time interval, provides the first group of media items with different priorities, and provides the first group of media items based on the target user, and the provision amount of the first group of media items provided with different priorities and the provision amount of the first group of media items provided based on the target user is greater than the provision amount of multiple target media items provided with the same priority.

[0075] The third predetermined time interval is also referred to as the third stage or the personalized delivery stage. In some embodiments of the present invention, this stage is mainly for media items that have undergone the trial provision stage and the adjustment delivery. Since the media items that have undergone the trial provision stage and the adjustment delivery have obtained more comprehensive delivery data of each media item, in this stage, media items suitable for the target users are further provided to different target users, thereby further increasing the delivery effect of each media item, such as the conversion rate. Figure 3 In the third phase, three delivery methods are used. The first is to deliver all target media items provided this time to their respective target users with the same priority. The second is to deliver media items that performed well in the trial delivery phase to their respective target users with different priorities. The third is to deliver media items that performed well in the trial delivery phase to their respective target users based on their target users.

[0076] It should be understood that in the third stage, the total amount of provision occupied by providing multiple target media items with the same priority (referred to as the first provision amount in the embodiment of the present disclosure), the total amount of provision occupied by providing the first group of media items with different priorities (referred to as the second provision amount in the embodiment of the present disclosure), and the total amount of provision occupied by providing the first group of media items based on the target user's targeted provision (referred to as the third provision amount in the embodiment of the present disclosure) can be predetermined or dynamically adjusted. For example, at the beginning, the first provision amount, the second provision amount, and the third provision amount respectively account for 20%, 40%, and 40% of the total provision amount of the current media item provision project, and can be adjusted to 10%, 40%, and 50% respectively as needed in the subsequent period. It should be understood that the specific size or ratio of the first provision amount, the second provision amount, and the third provision amount can be adjusted to any suitable size or ratio as needed, and the present disclosure does not make specific limitations on this. For example, the first provision amount is smaller than the second provision amount, and smaller than the third provision amount.

[0077] It should be understood that the length of the third predetermined time interval can be determined as needed, for example, one week, one month, etc. The second predetermined time interval can be determined based on parameters such as the delivery cycle of the current media item delivery project, and this disclosure does not specifically limit this. The length of the third predetermined time interval can be the same as the length of the first and second predetermined time intervals. The length of the third predetermined time interval can also be different from the length of the first and second predetermined time intervals, for example, the length of the third predetermined time interval is greater than the length of the first predetermined time interval.

[0078] Figure 5A FIG. 5 is a flow chart showing a process 500 for providing media items based on target users according to some embodiments of the present disclosure. The process 500 may be implemented at the electronic device 110. For ease of discussion, reference will be made to FIG. Figure 1 The process 500 is described with reference to the environment 100 of FIG.

[0079] like Figure 5A As shown, at block 510, electronic device 110 determines the target user's data associated with the media item provision. For example, the target user's data associated with the media item provision includes at least one of the following: user characteristics, media item characteristics, user-media item characteristics, and user historical behavior characteristics. This means that more user-side data will be considered during the personalized delivery phase.

[0080] At block 520, the electronic device 110 determines, using a predetermined model, the corresponding conversion probabilities of the media items in the first set of media items based on the target user's data associated with the media items. For example, the conversion probabilities can be expressed as predicted click-through rates and predicted conversion rates of the media items for the target user.

[0081] Exemplarily, the predetermined model can be developed based on models such as ESMM, HiNet, PEPNet, etc. It should be understood that the predetermined model can be obtained by training in advance based on the initial model and constructed training samples.

[0082] At box 520, the electronic device 110 can predict the conversion probability of the target user for each media item through a predetermined model based on the data associated with the media item provided by the target user and the delivery data of each media item in the first group of media items, such as click-through rate, conversion rate and other data.

[0083] Figure 5B An example architecture diagram of a predetermined model is shown, which can be used to predict conversion rates and click-through rates for various media items for specific users.

[0084] At block 530 , the electronic device 110 determines the media items in the first group of media items to provide to the target user based on the corresponding conversion probabilities of the media items. For example, for a specific target user, the electronic device 110 provides the target user with the media items with the highest conversion probability.

[0085] In some embodiments of the present disclosure, process 500 further includes: electronic device 110, in response to determining that the media item currently being provided to the target user meets a predetermined condition, replacing the media item provided to the target user in the first set of media items. For example, the user can be customized to change the media item after N clicks of exposure, based on actual scenarios. This ensures diverse media item exposure, facilitates improved delivery effectiveness, and enhances delivery effectiveness while optimizing the user experience. This ensures user experience by preventing the user from being continuously exposed to the same media item.

[0086] Figure 6 A schematic structural block diagram of an apparatus for providing media items according to certain embodiments of the present disclosure is shown.

[0087] like Figure 6 As shown, the apparatus 600 includes a first providing module 610 configured to provide a plurality of target media items with the same priority within a first predetermined time interval.

[0088] The device 600 also includes a second providing module 620, which is configured to provide the multiple target media items with the same priority within a second predetermined time interval in response to determining that the corresponding access interest of the first group of media items among the multiple target media items exceeds a threshold level within the first predetermined time interval, and provide the first group of media items with different priorities, and the corresponding priorities of the first group of media items in the second predetermined time interval are associated with the corresponding access interest of the first group of media items in the first predetermined time interval.

[0089] In some embodiments of the present disclosure, the device 600 also includes a third providing module 630, which is configured to provide the multiple target media items with the same priority, provide the first group of media items with different priorities, and provide the first group of media items based on the target user within a third predetermined time interval, and the provision amount of the first group of media items provided with different priorities and the provision amount of the first group of media items provided based on the target user is greater than the provision amount of multiple target media items provided with the same priority.

[0090] In some embodiments, the first providing module 610 is further configured to determine a corresponding minimum sample size of the target media items in the plurality of target media items based on the corresponding expected conversion rates of the target media items in the plurality of target media items.

[0091] In some embodiments, the first providing module 610 is further configured to: determine the corresponding expected conversion rates of the media items among the multiple target media items, as well as the Z scores representing the statistical significance levels and the Z scores representing the statistical efficacy for a preset statistical method; and determine the corresponding minimum sample size of the media items among the multiple target media items based on the corresponding expected conversion rates of the media items among the multiple target media items, as well as the Z scores representing the statistical significance levels and the Z scores representing the statistical efficacy for a preset statistical method.

[0092] In some embodiments, the second providing module 620 is further configured to: obtain data associated with access interest of the first group of media items; determine the corresponding scores associated with access interest of the first group of media items based on the data associated with access interest of the first group of media items; and determine the corresponding priority and corresponding providing quantity of the first group of media items based on the corresponding scores associated with access interest of the first group of media items, wherein the higher the score associated with access interest, the higher the corresponding priority and corresponding providing quantity of the media items.

[0093] In some embodiments, the second providing module 620 is further configured to: determine the access media items of the target user; determine a second group of media items for the target user based on the access media items and the first group of media items; determine the corresponding conversion goals of the second group of media items; determine the corresponding scores associated with access interest of the second group of media items based on the corresponding conversion goals of the second group of media items; and determine the corresponding priority and corresponding providing quantity of the second group of media items based on the corresponding scores associated with access interest of the second group of media items, wherein the higher the score associated with access interest, the higher the corresponding priority and corresponding providing quantity of the media items.

[0094] In some embodiments, the second providing module 620 is further configured to: obtain data associated with the access interest of the current predetermined level of the media items in the first group of media items; and determine the cumulative data associated with the access interest of the media items in the first group of media items based on the data associated with the access interest of the current predetermined level.

[0095] In some embodiments, the third providing module is further configured to: determine the data associated with the media item provision of the target user; determine the corresponding conversion probability of the media items in the first group of media items based on the data associated with the media item provision of the target user through a predetermined model; and determine the media items in the first group of media items provided to the target user based on the corresponding conversion probability of the media items.

[0096] In some embodiments, the data associated with the media item provided by the target user includes at least one of the following: user characteristics, media item characteristics, user-media item characteristics, and user historical behavior characteristics.

[0097] In some embodiments, the third providing module is further configured to: in response to determining that the media item currently provided to the target user meets a predetermined condition, replace the media item provided to the target user in the first group of media items.

[0098] In some embodiments, the third providing module is further configured to: determine the total providing amount for the multiple target media items; and determine the corresponding providing amounts of different providing methods within the second predetermined time interval and the third predetermined time interval based on the total providing amount and the predetermined ratio.

[0099] The units and / or modules included in the device 600 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units and / or modules can be implemented using software and / or firmware, such as machine executable instructions stored on a storage medium. In addition to or as an alternative to machine executable instructions, some or all of the units and / or modules in the device 600 can be implemented at least in part by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0100] It should be understood that one or more steps in the above method can be performed by a suitable electronic device or combination of electronic devices. Such an electronic device or combination of electronic devices may include, for example, Figure 1 The electronic device 110 in.

[0101] Figure 71 shows a block diagram of an electronic device 700 in which one or more embodiments of the present disclosure may be implemented. Figure 7 The illustrated electronic device 700 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. Figure 7 The electronic device 700 shown can be used to implement Figure 1 electronic device 110 or Figure 6 device 600.

[0102] like Figure 7 As shown, electronic device 700 is in the form of a general electronic device. Components of electronic device 700 may include, but are not limited to, one or more processors or processing units 710, memory 720, storage device 730, one or more communication units 740, one or more input devices 750, and one or more output devices 760. Processing unit 710 may be a real or virtual processor and is capable of performing various processes according to programs stored in memory 720. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to increase the parallel processing capabilities of electronic device 700.

[0103] The electronic device 700 typically includes a plurality of computer storage media. Such media can be any available media accessible to the electronic device 700, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 720 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory) or some combination thereof. The storage device 730 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk or any other medium, which can be used to store information and / or data and can be accessed within the electronic device 700.

[0104] The electronic device 700 may further include additional removable / non-removable, volatile / non-volatile storage media. Figure 7 As shown in FIG, a magnetic disk drive for reading from or writing to a removable, non-volatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 720 may include a computer program product 725 having one or more program modules configured to perform the various methods or actions of various embodiments of the present disclosure.

[0105] The communication unit 740 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device 700 can be implemented as a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the electronic device 700 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0106] Input device 750 may be one or more input devices, such as a mouse, keyboard, or trackball. Output device 760 may be one or more output devices, such as a display, a speaker, or a printer. Electronic device 700 may also communicate with one or more external devices (not shown) via communication unit 740 as needed, such as storage devices, display devices, or the like, with one or more devices that allow a user to interact with electronic device 700, or with any device that allows electronic device 700 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0107] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0108] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0109] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0110] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0111] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0112] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, not exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for providing a media item, comprising: providing a plurality of target media items with the same priority within a first predetermined time interval; as well as In response to determining that the corresponding access interest of a first group of media items among the multiple target media items exceeds a threshold level within the first predetermined time interval, the multiple target media items are provided with the same priority within a second predetermined time interval, and the first group of media items are provided with a different priority, and the corresponding priority of the first group of media items within the second predetermined time interval is associated with the corresponding access interest of the first group of media items within the first predetermined time interval.

2. The method according to claim 1, further comprising: Within a third predetermined time interval, the multiple target media items are provided with the same priority, the first group of media items are provided with different priorities, and the first group of media items are provided based on target users, and the provision amount of the first group of media items provided with different priorities and the provision amount of the first group of media items provided based on target users are greater than the provision amount of the multiple target media items provided with the same priority.

3. The method of claim 1 , wherein providing the plurality of target media items at the same priority level comprises: Based on the respective expected conversion rates of the target media items in the plurality of target media items, respective minimum sample sizes of the target media items in the plurality of target media items are determined.

4. The method of claim 3 , wherein determining the corresponding minimum sample size of the target media items in the plurality of target media items comprises: Determining corresponding expected conversion rates of media items among the plurality of target media items, and Z scores representing statistical significance levels and Z scores representing statistical powers according to a preset statistical method; Based on the corresponding expected conversion rates of the media items in the multiple target media items, and the Z scores representing the statistical significance levels and the Z scores representing the statistical power for the preset statistical methods, the corresponding minimum sample sizes of the media items in the multiple target media items are determined.

5. The method of claim 1 , wherein providing the first group of media items with different priorities within a second predetermined time interval comprises: obtaining data associated with access interest of the first group of media items; determining corresponding scores associated with access interest for the first group of media items based on the data associated with access interest for the first group of media items; as well as Based on the respective scores associated with access interest of the first group of media items, respective priorities and respective provision amounts of the first group of media items are determined, wherein the media items with higher scores associated with access interest have higher respective priorities and respective provision amounts.

6. The method according to claim 5, further comprising: Determine the media items that are accessible to target users; determining a second set of media items for the target user based on the admitted media items and the first set of media items; determining corresponding conversion goals for the second set of media items; determining corresponding scores associated with access interestingness of the second group of media items based on corresponding conversion goals of the second group of media items; as well as Based on the respective scores associated with access interest of the second group of media items, respective priorities and respective provision amounts of the second group of media items are determined, wherein the media items with higher scores associated with access interest have higher respective priorities and respective provision amounts.

7. The method according to claim 5, wherein obtaining data associated with access interest of the first group of media items comprises: obtaining data associated with a current predetermined level of access interest of a media item in the first group of media items; as well as The cumulative data associated with access interestingness for the media items in the first set of media items is determined based on the current predetermined level of data associated with access interestingness.

8. The method according to claim 2, wherein providing the first group of media items based on the target user in a targeted manner within a third predetermined time interval comprises: Determining target users for providing data associated with the media item; determining, by a predetermined model, corresponding conversion probabilities of the media items in the first group of media items based on the data associated with the provision of the media items by the target user; A media item from the first set of media items is determined to be provided to the target user based on the corresponding conversion probabilities of the media items. 9 . The method according to claim 8 , wherein the data associated with the media item provision of the target user comprises at least one of the following: user characteristics, media item characteristics, user-media item characteristics, and user historical behavior characteristics.

10. The method according to claim 2, wherein providing the first group of media items based on target users in a third predetermined time interval comprises: In response to determining that the media item currently provided to the target user meets a predetermined condition, the media item provided to the target user in the first group of media items is replaced.

11. The method according to claim 2, further comprising: determining a total offer amount for the plurality of target media items; as well as Corresponding provision amounts of different provision modes within the second predetermined time interval and the third predetermined time interval are determined based on the total provision amount and the predetermined ratio.

12. An apparatus for providing a media item, comprising: A first providing module is configured to provide a plurality of target media items with the same priority within a first predetermined time interval; as well as The second providing module is configured to provide the multiple target media items with the same priority and provide the first group of media items with different priorities in a second predetermined time interval in response to determining that the corresponding access interest of the first group of media items among the multiple target media items exceeds a threshold level in the first predetermined time interval, and the corresponding priority of the first group of media items in the second predetermined time interval is associated with the corresponding access interest of the first group of media items in the first predetermined time interval.

13. An electronic device comprising: at least one processing unit; as well as At least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 11 when executed by the at least one processing unit.

14. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 11.

15. A computer program product tangibly stored in a computer storage medium and comprising computer executable instructions which, when executed by a device, cause the device to perform the method according to any one of claims 1 to 11.

Images