Content delivery method and system, storage medium and electronic equipment

Abstract

The invention discloses a content delivery method and system, a storage medium and electronic equipment, and the method comprises the steps: selecting optimal business content according to an original content delivery strategy when an access instruction of a user is detected, and delivering the optimal business content to the user; judging whether the optimal service content belongs to the content in a running AB test or not, and if yes, judging whether the optimal service content belongs to a test group in a running preset AB test or not; and if yes, confirming the service content associated with the test group, and putting the service content associated with the test group to the user instead of the optimal service content. According to the method, the content delivery strategy and the AB test capability are fused, the defect of extensive release of current content delivery can be improved, after the method is implemented, the AB test can scientifically guide the electronic channel content delivery strategy under real data, and refined operation is achieved.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a content delivery method, system, storage medium and electronic device. Background Art

[0002] Content delivery through electronic channels is currently a common method of information promotion. Currently, content delivery through electronic channels lacks scientific support and is directly released online to face customers after approval. This extensive delivery method is contrary to scientific decision-making, increases the probability of content delivery errors and poor user experience, and is inconsistent with the current trend of refined operations. Summary of the invention

[0003] In view of the deficiencies in the prior art, the present invention provides a content delivery method, system, storage medium and electronic device.

[0004] In a first aspect, the present application provides a content delivery method, the method comprising:

[0005] When a user's access instruction is detected, the optimal business content is selected and delivered to the user according to the original content delivery strategy;

[0006] Determine whether the optimal service content belongs to the content in the running AB test, and if so, determine whether the optimal service content belongs to the test group in the running preset AB test;

[0007] If so, the business content associated with the test group is confirmed, and the business content associated with the test group is used to replace the optimal business content and delivered to the user.

[0008] In some embodiments, the method further comprises:

[0009] Complete business content delivery configuration and AB test configuration in advance.

[0010] In some embodiments, the pre-completing of the business content delivery configuration and the AB test configuration includes:

[0011] Complete banner management, carousel management, screen compression management, pop-up window management, and page configuration on the original business side;

[0012] Complete the configuration of basic test conditions, test ID, test group, and flow ratio on the AB test side;

[0013] Complete the associated configuration and management of the business side and AB test;

[0014] Complete the status synchronization between the business side and AB test;

[0015] Run AB experiments.

[0016] In some embodiments, completing the associated configuration and management of the business side and the AB test includes:

[0017] Configure the association between AB test ID, test group, service type and service side ID;

[0018] Starting from the original business side, configure the test group and original content delivery strategy.

[0019] In some embodiments, the method further comprises:

[0020] Receive user's indicator management instructions, perform indicator management, and complete the development and testing of tracking points for events required for indicator calculation;

[0021] Perform event and data attribute management.

[0022] In some embodiments, the method further comprises:

[0023] Continuously collecting access instructions issued by the user and the business content corresponding to the access instructions after the business content associated with the test group is delivered;

[0024] Collecting device information of the user;

[0025] Collecting and recording events and attribute values ​​used for indicator calculation during the user's use of the client;

[0026] An AB test report is generated according to the access instruction subsequently issued by the user and the business content corresponding to the access instruction, as well as the device information and the record.

[0027] In some embodiments, the method further comprises:

[0028] Receive debugging device management instructions from users and perform device debugging and management.

[0029] In a second aspect, a content delivery system is provided, the system comprising:

[0030] The client module is used to send an access instruction to the content delivery module when an access instruction of a user is detected;

[0031] The content delivery module is used to, upon receiving the access instruction, select the optimal business content for delivery to the user according to the original content delivery strategy to the client module; send a judgment instruction to the AB test module at the same time; and replace the optimal business content with the business content associated with the test group notified by the AB test module to deliver to the user;

[0032] The AB test module is used to determine whether the optimal business content belongs to the content in the running AB test when receiving the judgment instruction again. If so, it is used to determine whether the optimal business content belongs to the test group in the running preset AB test; if so, it is used to confirm the business content associated with the test group and notify the content delivery module of the business content associated with the test group.

[0033] In a third aspect, a storage medium stores a computer program that can be executed by one or more processors and can be used to implement the content delivery method as described in the first aspect.

[0034] In a fourth aspect, an electronic device includes a memory and a processor, wherein the memory stores a computer program, and the memory and the processor are communicatively connected to each other, and when the computer program is executed by the processor, the content delivery method described in the first aspect is executed.

[0035] The present application provides a content delivery method, system, storage medium and electronic device, including: when a user's access instruction is detected, selecting the best business content and delivering it to the user according to the original content delivery strategy; judging whether the best business content belongs to the content in the running AB test, and if so, judging whether the best business content belongs to the test group in the running preset AB test; if so, confirming the business content associated with the test group, and replacing the best business content with the business content associated with the test group for delivery to the user.

[0036] The beneficial effects of this application include:

[0037] 1. The content delivery method of this application integrates content delivery strategy and AB testing capabilities, which can improve the shortcomings of the current extensive content delivery. After the method is implemented, AB experiments can be used under real data to scientifically guide the electronic channel content delivery strategy and achieve refined operations.

[0038] 2. This application forms an application closed loop by integrating content delivery management and AB test basic functions, which can avoid duplicate development and improve the connectivity and utilization of existing business function modules.

[0039] 3. The AB test system used in this application focuses on general capability construction, including traffic allocation between test groups, scientific diversion algorithms, test indicator configuration and calculation and other basic infrastructure. It can be easily and quickly combined with other business scenarios with AB test needs in the future to expand the application scenarios of AB test methods. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.

[0041] Figure 1 A flowchart of a content delivery method provided in an embodiment of the present application;

[0042] Figure 2 A structural diagram of a content delivery system provided in an embodiment of the present application;

[0043] Figure 3 A connection block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0044] The following will describe the implementation methods of the present application in detail with reference to the accompanying drawings and embodiments, so that the implementation process of how the present application applies technical means to solve technical problems and achieve corresponding technical effects can be fully understood and implemented accordingly. The embodiments of the present application and the various features in the embodiments can be combined with each other without conflict, and the technical solutions formed are all within the scope of protection of the present application.

[0045] As can be seen from the background technology, the current content delivery on electronic channels lacks scientific support. It is directly released online to face customers after approval. This extensive delivery method is contrary to scientific decision-making, increases the probability of content delivery errors and poor user experience, and is not in line with the current trend of refined operations.

[0046] In view of this, and in view of the deficiencies in the prior art, the present invention provides a content delivery method, system, storage medium and electronic device.

[0047] Embodiment 1

[0048] Figure 1 A flow chart of a content delivery method provided in an embodiment of the present application is shown as follows: Figure 1 As shown, the method includes:

[0049] S101, when a user's access instruction is detected, the optimal business content is selected according to the original content delivery strategy and delivered to the user;

[0050] S102, determining whether the optimal service content belongs to the content in the running AB test, and if so, determining whether the optimal service content belongs to the test group in the running preset AB test;

[0051] S103: If yes, confirm the business content associated with the test group, and replace the optimal business content with the business content associated with the test group to deliver to the user.

[0052] It should be noted that the method further includes:

[0053] Step S104: if it is determined that the optimal service content does not belong to the content in the running AB test, then continue to select the optimal service content according to the original content delivery strategy and deliver it to the user;

[0054] And step S105, if it is determined that the optimal business content does not belong to the test group in the running preset AB test, continue to select the optimal business content according to the original content delivery strategy and deliver it to the user.

[0055] In some embodiments, the method further comprises:

[0056] Complete business content delivery configuration and AB test configuration in advance.

[0057] In some embodiments, the pre-completing of the business content delivery configuration and the AB test configuration includes:

[0058] Complete banner management, carousel management, screen compression management, pop-up window management, and page configuration on the original business side;

[0059] Complete the configuration of basic test conditions, test ID, test group, and flow ratio on the AB test side;

[0060] Complete the associated configuration and management of the business side and AB test;

[0061] Complete the status synchronization between the business side and AB test;

[0062] Run AB experiments.

[0063] It should be noted that when configuring the basic information of the experiment, the selection of joint parties and categories is added. The joint parties expand the content delivery, and the categories include banner, carousel, screen compression, pop-up window, and page. It can be expanded later according to the access situation of content business. When the content delivery module is configured for joint experiments, the associated test list must be content delivery, and the categories must be consistent to ensure the data isolation of each business sub-module in the content delivery module and reduce the possibility of misoperation.

[0064] It should be further explained that after the completion of the test, it is in draft status. It can be associated on the configuration side after content delivery. After association, the test group design information is brought out, and then the configuration of the specific test group content is completed on the content delivery side. For example, for the AB test of Banner, the Banner configuration of the test group is completed in Banner management, and for the AB test of carousel, the carousel content configuration of the test group is completed in carousel management, and so on for other content; after the content delivery settings are configured, if it is found that there is a problem with the content configuration or the effect is not good, the test group content can still be edited; all status changes and process controls in the test are controlled in the original AB test system, and the test status is synchronized to the content delivery side; the content delivery side can also see the associated tests, test configurations and test operation status; the unique ID of the content delivery side associated with each test group is displayed in the joint test details, which is convenient for comparison, search and comparison between the AB test system and the content delivery side.

[0065] In some embodiments, completing the associated configuration and management of the business side and the AB test includes:

[0066] Configure the association between AB test ID, test group, service type and service side ID;

[0067] Starting from the original business side, configure the test group and original content delivery strategy.

[0068] In some embodiments, the method further comprises:

[0069] Receive user's indicator management instructions, perform indicator management, and complete the development and testing of tracking points for events required for indicator calculation;

[0070] Perform event and data attribute management.

[0071] In some embodiments, the method further comprises:

[0072] Continuously collecting access instructions issued by the user and the business content corresponding to the access instructions after the business content associated with the test group is delivered;

[0073] Collecting device information of the user;

[0074] Collecting and recording events and attribute values ​​used for indicator calculation during the user's use of the client;

[0075] An AB test report is generated according to the access instruction subsequently issued by the user and the business content corresponding to the access instruction, as well as the device information and the record.

[0076] It should be noted that after the test is run, the test report can be viewed in the AB test system, and a quick jump link can be provided in the content delivery module to view the test report, and decide whether to continue the test based on the test results.

[0077] In some embodiments, the method further comprises:

[0078] Receive debugging device management instructions from users and perform device debugging and management.

[0079] In some embodiments, the method further comprises:

[0080] Receive experimental layer management instructions from users and perform corresponding experimental layer management work.

[0081] It should be noted that any problems encountered during the AB test or areas that require optimization and modification can be flexibly managed and adjusted in the future by initiating management instructions.

[0082] In summary, an embodiment of the present application provides a content delivery method, comprising: when a user's access instruction is detected, selecting the best business content for delivery to the user according to the original content delivery strategy; determining whether the best business content belongs to the content in the running AB test, and if so, determining whether the best business content belongs to the test group in the running preset AB test; if so, confirming the business content associated with the test group, and replacing the best business content with the business content associated with the test group for delivery to the user.

[0083] The beneficial effects of this application include:

[0084] 1. The content delivery method of this application integrates content delivery strategy and AB testing capabilities, which can improve the shortcomings of the current extensive content delivery. After the method is implemented, AB experiments can be used under real data to scientifically guide the electronic channel content delivery strategy and achieve refined operations.

[0085] 2. This application forms an application closed loop by integrating content delivery management and AB test basic functions, which can avoid duplicate development and improve the connectivity and utilization of existing business function modules.

[0086] 3. The AB test system used in this application focuses on general capability construction, including traffic allocation between test groups, scientific diversion algorithms, test indicator configuration and calculation and other basic infrastructure. It can be easily and quickly combined with other business scenarios with AB test needs in the future to expand the application scenarios of AB test methods.

[0087] Embodiment 2

[0088] Based on the content delivery method disclosed in the above embodiment of the present invention, Figure 2Specifically disclosed is a content delivery system applying the content delivery method.

[0089] like Figure 2 As shown, an embodiment of the present invention discloses a content delivery system, the system comprising:

[0090] The client module 201 is used to send an access instruction to the content delivery module 202 when an access instruction from a user is detected;

[0091] The content delivery module 202 is used to, upon receiving the access instruction, select the optimal service content to be delivered to the user according to the original content delivery strategy to the client module 201; send a judgment instruction to the AB test module 203 at the same time; and replace the optimal service content with the service content associated with the test group notified by the AB test module to deliver to the user;

[0092] The AB test module 203 is used to determine whether the optimal business content belongs to the content in the running AB test when receiving the judgment instruction again. If so, it is used to determine whether the optimal business content belongs to the test group in the running preset AB test; if so, it is used to confirm the business content associated with the test group and notify the content delivery module 202 of the business content associated with the test group.

[0093] The specific working process of the client module 201, the content delivery module 202 and the AB test module 203 in the content delivery system disclosed in the above embodiment of the present invention can refer to the corresponding content in the content delivery method disclosed in the above embodiment of the present invention, which will not be repeated here.

[0094] In summary, a content delivery system provided by an embodiment of the present application includes: a client module 201, which is used to send an access instruction to a content delivery module 202 when an access instruction of a user is detected; the content delivery module 202 is used to, when receiving the access instruction, select the optimal business content to be delivered to the user according to the original content delivery strategy to the client module 201; and send a judgment instruction to the AB test module 203 at the same time; and replace the optimal business content with the business content associated with the test group notified by the AB test module for delivery to the user; the AB test module 203 is used to, when receiving the judgment instruction again, determine whether the optimal business content belongs to the content in the running AB test, and if so, determine whether the optimal business content belongs to the test group in the running preset AB test; if so, confirm the business content associated with the test group, and notify the content delivery module 202 of the business content associated with the test group.

[0095] The beneficial effects of this application include:

[0096] 1. The content delivery method of this application integrates content delivery strategy and AB testing capabilities, which can improve the shortcomings of the current extensive content delivery. After the method is implemented, AB experiments can be used under real data to scientifically guide the electronic channel content delivery strategy and achieve refined operations.

[0097] 2. This application forms an application closed loop by integrating content delivery management and AB test basic functions, which can avoid duplicate development and improve the connectivity and utilization of existing business function modules.

[0098] 3. The AB test system used in this application focuses on general capability construction, including traffic allocation between test groups, scientific diversion algorithms, test indicator configuration and calculation and other basic infrastructure. It can be easily and quickly combined with other business scenarios with AB test needs in the future to expand the application scenarios of AB test methods.

[0099] Embodiment 3

[0100] This embodiment also provides a computer-readable storage medium, such as a flash memory, a hard disk, a multimedia card, a card-type memory (for example, an SD or DX memory, etc.), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a disk, an optical disk, a server, an App application store, etc., on which a computer program is stored. When the computer program is executed by a processor, the method steps of the first embodiment can be implemented, and this embodiment will not be repeated here.

[0101] Embodiment 4

[0102] Figure 3 A connection block diagram of an electronic device 300 provided in an embodiment of the present application, such as Figure 3 As shown, the electronic device 300 may include: a processor 301 , a memory 302 , a multimedia component 303 , an input / output (I / O) interface 304 , and a communication component 305 .

[0103] The processor 301 is used to execute all or part of the steps in the content delivery method in Embodiment 1. The memory 302 is used to store various types of data, which may include instructions of any application or method in the electronic device, and data related to the application.

[0104] The processor 301 can be an application specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), a field programmable gate array (FPGA), a controller, a microcontroller, a microprocessor or other electronic components, and is used to execute the content delivery method in the above-mentioned embodiment 1.

[0105] The memory 302 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, disk or optical disk.

[0106] The multimedia component 303 may include a screen and an audio component, the screen may be a touch screen, and the audio component is used to output and / or input audio signals. For example, the audio component may include a microphone, and the microphone is used to receive external audio signals. The received audio signal may be further stored in a memory or sent via a communication component. The audio component also includes at least one speaker for outputting audio signals.

[0107] The I / O interface 304 provides an interface between the processor 301 and other interface modules, which may be a keyboard, a mouse, buttons, etc. These buttons may be virtual buttons or physical buttons.

[0108] The communication component 305 is used for wired or wireless communication between the electronic device 300 and other devices. Wireless communication, such as Wi-Fi, Bluetooth, Near Field Communication (NFC), 2G, 3G or 4G, or a combination of one or more of them, so the corresponding communication component 305 can include: Wi-Fi module, Bluetooth module, NFC module.

[0109] In summary, the present application provides a content delivery method, system, storage medium and electronic device, the method comprising: when a user's access instruction is detected, selecting the best business content to deliver to the user according to the original content delivery strategy; judging whether the best business content belongs to the content in the running AB test, if so, judging whether the best business content belongs to the test group in the running preset AB test; if so, confirming the business content associated with the test group, and replacing the best business content with the business content associated with the test group to deliver to the user. This method integrates content delivery strategy and AB test capabilities, and can improve the shortcomings of the current extensive content delivery. After the method is implemented, AB tests can scientifically guide the electronic channel content delivery strategy under real data to achieve refined operations.

[0110] In the several embodiments provided in the present application, it should be understood that the disclosed method can also be implemented in other ways. The method embodiments described above are merely illustrative.

[0111] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0112] Although the implementation methods disclosed in this application are as above, the above contents are only the implementation methods adopted for facilitating the understanding of this application, and are not intended to limit this application. Any technician in the technical field to which this application belongs can make any modifications and changes in the form and details of the implementation without departing from the spirit and scope disclosed in this application, but the scope of patent protection of this application shall still be based on the scope defined in the attached claims.

Claims

1. A content delivery method, characterized in that: The method comprises: When a user's access instruction is detected, the optimal business content is selected and delivered to the user according to the original content delivery strategy; Determine whether the optimal service content belongs to the content in the running AB test, and if so, determine whether the optimal service content belongs to the test group in the running preset AB test; If so, the business content associated with the test group is confirmed, and the business content associated with the test group is used to replace the optimal business content and delivered to the user.

2. The method according to claim 1, characterized in that: The method further comprises: Complete business content delivery configuration and AB test configuration in advance.

3. The method according to claim 2, characterized in that The pre-completion of business content delivery configuration and AB test configuration includes: Complete banner management, carousel management, screen compression management, pop-up window management, and page configuration on the original business side; Complete the configuration of basic test conditions, test ID, test group, and flow ratio on the AB test side; Complete the associated configuration and management of the business side and AB test; Complete the status synchronization between the business side and AB test; Run AB experiments.

4. The method according to claim 3, characterized in that The completion of the associated configuration and management of the business side and the AB test includes: Configure the association between AB test ID, test group, service type and service side ID; Starting from the original business side, configure the test group and original content delivery strategy.

5. The method according to claim 1, characterized in that The method further comprises: Receive user's indicator management instructions, perform indicator management, and complete the development and testing of tracking points for events required for indicator calculation; Perform event and data attribute management.

6. The method according to claim 1, characterized in that The method further comprises: Continuously collecting access instructions issued by the user and the business content corresponding to the access instructions after the business content associated with the test group is delivered; Collecting device information of the user; Collecting and recording events and attribute values ​​used for indicator calculation during the user's use of the client; An AB test report is generated according to the access instruction subsequently issued by the user and the business content corresponding to the access instruction, as well as the device information and the record.

7. The method according to claim 1, characterized in that The method further comprises: Receive debugging device management instructions from users and perform device debugging and management.

8. A content delivery system, characterized in that: The system comprises: The client module is used to send an access instruction to the content delivery module when an access instruction of a user is detected; The content delivery module is used to, upon receiving the access instruction, select the optimal business content for delivery to the user according to the original content delivery strategy to the client module; send a judgment instruction to the AB test module at the same time; and replace the optimal business content with the business content associated with the test group notified by the AB test module to deliver to the user; The AB test module is used to determine whether the optimal business content belongs to the content in the running AB test when receiving the judgment instruction again. If so, it is used to determine whether the optimal business content belongs to the test group in the running preset AB test; if so, it is used to confirm the business content associated with the test group and notify the content delivery module of the business content associated with the test group.

9. A storage medium, characterized in that: The computer program stored in the storage medium can be executed by one or more processors and can be used to implement the content delivery method as described in any one of claims 1 to 7.

10. An electronic device, characterized in that: The method comprises a memory and a processor, wherein a computer program is stored in the memory, and the memory and the processor are communicatively connected with each other. When the computer program is executed by the processor, the content delivery method according to any one of claims 1 to 7 is executed.

Images