AB test control method and system, computer equipment and storage medium

Abstract

The invention relates to the technical field of page testing, and discloses an AB test control method and system, computer equipment and a storage medium, the method comprises the following steps: sending a page request instruction to a server, the request instruction comprising client information of a client; obtaining a page index fed back by the server; according to the page index, matching a page attribute of an experimental group corresponding to the page index; and rendering and generating a page requested by the client according to the page attribute. According to the embodiment of the invention, the processing of the page is decoupled from the server in a mode that the client prestores the experimental group and autonomously generates the page, so that the repeated development of the code of the server side during the AB test is reduced.

Description

Technical Field

[0001] The present application relates to the field of page testing technology, and in particular to an AB testing control method, system, computer equipment and storage medium. Background Art

[0002] Because the product needs to conduct multiple experiments on different functions, different interactive effects, and different display styles in the same area, and finally select the experimental plan with the best user experience and the most customer retention, AB testing will be carried out. At present, the normal processing of AB testing is to use dynamic routing parameters to distinguish different pages, and then request the back-end interface to obtain different routing styles. For components below the page level, dynamic components are used to distinguish them. The processing of different methods requires different processing in the method according to different experiments. Finally, after running for a period of time after going online, the final solution is selected. However, this will cause developers to deal with both AB test logic and normal business logic, and the business logic is repeated. Summary of the invention

[0003] In view of this, the embodiments of the present application provide an AB test control method, system, computer device and storage medium, which can effectively solve problems such as business logic duplication.

[0004] In a first aspect, an embodiment of the present application provides an AB test control method, which is applied to a client, and the method includes: Sending a page request instruction to a server, wherein the request instruction includes client information of the client; Obtaining the page index fed back by the server; According to the page index, matching the page attribute of the experimental group corresponding to the page index; the experimental group is pre-stored locally; According to the page attributes, the page requested by the client is rendered and generated.

[0005] In one embodiment, the page attributes include page structure, page style, and page method; The step of matching the page attribute page index of the experimental group corresponding to the page index according to the page index includes: An experimental group corresponding to the page index is determined, and the page structure, the page style, and the page method of the page corresponding to the page index are obtained from the experimental group to determine the page attribute.

[0006] In one embodiment, rendering and generating the page requested by the client according to the page attributes includes: A page requested by the request instruction is generated according to the page structure, the page style and / or the page method.

[0007] In one embodiment, after sending the page request instruction to the server, the method further includes: Receiving test completion information from the server; Sending a program pruning request to the server; After obtaining the pruning permission information and pruning parameters sent by the server, the experimental group indicated by the pruning parameters is matched and deleted according to the pruning parameters.

[0008] In a second aspect, the present application further provides an AB test control method, which is applied to a server, and the method includes: When receiving a page request instruction from a client, parsing the client information of the client; According to the client information, matching corresponding page indexes from pre-configured experimental groups; The page index is sent to the client.

[0009] In one embodiment, when the AB test is finished and a page request instruction is received from the client, the method further includes: Sending a test end message to the client; After receiving the program pruning request from the client, the program pruning permission information is fed back, and the pruning parameters are fed back according to the test results.

[0010] In one embodiment, the method further comprises: When the AB test is finished, determining the test result, and locking the experimental group according to the test result; When the page request instruction is received, the page index in the experimental group is directly fed back.

[0011] In a third aspect, the present application also provides an AB test control system, including: a server and a client; The client sends a page request instruction to the server, wherein the request instruction includes client information of the client; When the server receives a page request instruction from a client, parsing the client information of the client; According to the client information, matching corresponding page indexes from pre-configured experimental groups; Sending the page index to the client; The client obtains the page index fed back by the server; According to the page index, matching the page attributes of the experimental group corresponding to the page index; According to the page attributes, the page requested by the client is rendered and generated.

[0012] In a fourth aspect, the present application further provides a computer device, comprising a processor and a memory, wherein the memory stores a computer program, and the processor is used to execute the computer program to implement the AB test control method.

[0013] In a fifth aspect, the present application also provides a computer-readable storage medium storing a computer program, which implements the AB test control method when executed on a processor.

[0014] The embodiments of the present application have the following beneficial effects: By storing the page attributes of each style page of AB test on the client, the page generation operation is implemented by the client, which reduces the burden on the server and decouples this part of the operation from the server, making it easier to configure AB tests on the server side, reducing the amount of repeated code and repeated work. At the same time, it makes it easier to integrate new AB tests into the server, increasing the deployment efficiency and work efficiency of AB tests. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0016] Figure 1 A schematic diagram of a flow chart of an AB test control method according to an embodiment of the present application is shown; Figure 2 A schematic diagram of a flow chart of another AB test control method according to an embodiment of the present application is shown; Figure 3 A schematic diagram of an interactive process of an AB test control method according to an embodiment of the present application is shown; Figure 4 A schematic diagram of a code pruning process according to an embodiment of the present application is shown; Figure 5 A schematic diagram of an AB test control system according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0017] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments.

[0018] The components of the embodiments of the present application generally described and shown in the drawings herein may be arranged and designed in various configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0019] Hereinafter, the terms "including", "having" and their cognates that can be used in various embodiments of the present application are intended only to indicate specific features, numbers, steps, operations, elements, components or a combination of the foregoing items, and should not be understood as first excluding the existence of one or more other features, numbers, steps, operations, elements, components or a combination of the foregoing items or increasing the possibility of one or more features, numbers, steps, operations, elements, components or a combination of the foregoing items. In addition, the terms "first", "second", "third" and the like are only used to distinguish descriptions and cannot be understood as indicating or implying relative importance.

[0020] Unless otherwise defined, all terms (including technical terms and scientific terms) used herein have the same meanings as those generally understood by those skilled in the art to which the various embodiments of the present application belong. The terms (such as those defined in generally used dictionaries) will be interpreted as having the same meanings as the contextual meanings in the relevant technical field and will not be interpreted as having idealized meanings or overly formal meanings unless clearly defined in the various embodiments of the present application.

[0021] In the current AB test, after the online test, when the user requests a page, the server needs to obtain different routing styles according to the backend interface to output the page in a targeted manner. At this time, all page data needs to be fed back by the server. After the AB test is completed and the final page is selected, pruning is required so that the server will only feed back the final page after receiving the page request. This requires developers to perform business logic processing on the page configured in the server again. The whole process involves a lot of repetitive work, and it is necessary to pay attention to the impact of each backend interface after pruning. The pruning process after AB testing is cumbersome and has many redundant processes. At the same time, the system is highly coupled to the server test, and other systems that want to perform AB testing also need to be connected to it, which is difficult to handle.

[0022] The technical solution of the present application is applied in the AB testing process. When the AB testing is started, the pages to be tested will be online, and the various page attribute configurations of these pages will be integrated into the client. When the client wants to access the page and sends a request to the server, the server will feedback the page index according to the internal pre-stored matching rules. After the client obtains the page index, the corresponding page attributes are matched inside the client to realize the rendering of the page and form a page of the corresponding style.

[0023] The AB test control method is described below in conjunction with some specific embodiments.

[0024] Figure 1 A flow chart of the AB test control method of the client in an embodiment of the present application is shown. Exemplarily, the AB test control method includes the following steps: Step S100: Send a page request instruction to the server.

[0025] The client sends a page request instruction to the server, and the page request instruction carries the client information of the client itself in addition to the requested page link information.

[0026] Among them, the client information includes client hardware information, user login status on the client, user information, etc. The specific client information fed back is related to the information that testers are concerned about in AB testing, that is, this part of the information is set by the testers before the test. After the test starts, the client will carry the set information when initiating a page request.

[0027] Specifically, the hardware information of the client can be obtained by accessing the device management program of the client, and the login information or user information of the client can be obtained through the status of the client itself.

[0028] Step S200, obtaining the page index fed back by the server.

[0029] The server will feedback the page index and page data of the requested page. The page index is the page index matched by the server according to the client's page request instruction and client information. The page index can be used for the client to match and generate a page of the corresponding style.

[0030] Specifically, the page index may be a unique string, which may be used to match corresponding page attributes.

[0031] Step S300: matching, according to the page index, page attributes of the experimental group corresponding to the page index.

[0032] There will be at least two experimental groups in AB testing. The page attributes of each different style page that needs to be tested will be pre-stored in the client. Page attributes of the same style are classified into the same experimental group. These page attributes correspond to the page index one by one.

[0033] For example, two styles of pages are designed for users of different age groups, one for users under 20 years old and the other for users over 20 years old, and the styles of the two pages are completely different. Therefore, it can be seen that different page attributes will be set for these two pages, and these page attributes exist in the client in this embodiment. For example, the page index for users under 20 years old is recorded as pageA. For users over 20 years old, it is recorded as pageB. When the client receives the page index of the feedback, it can determine the corresponding page attribute according to the page index. In addition, considering that AB testing not only tests the style of one page, but also tests multiple pages, the page index can also be added with the identifier in the page link to ensure the uniqueness of the page index.

[0034] The page attributes include page structure, page style and page method.

[0035] Page structure refers to the layout of the page, such as the arrangement of various elements in the page, the styles of various pop-up boxes and the overall layout of the page.

[0036] Page style refers to the CSS (Cascading Style Sheets) style, which can control the page presentation, such as the color, font style, size, etc. of each page element, and play a decorative role on the page.

[0037] The page method performs differentiated operations based on some states of the current page. Because the user's permissions are different, the interaction results are also different. For example, for VIP users, when watching a video, they can click play to watch it directly, while for non-VIP users, an advertisement will be played on the page. Here, they just click play and jump to the same page. The above page structure and page style are the same, but because of different permissions, the difference in page methods can achieve the effect of displaying different page content to users according to different conditions.

[0038] The above three page attributes correspond to page indexes one by one. As long as the page index is determined, the corresponding page attributes can be matched.

[0039] Among them, for the above three page attributes, the client can provide a set of interfaces specifically. When in the AB testing environment, these interfaces can be automatically called to determine the corresponding page attributes and perform subsequent page generation operations.

[0040] In addition to the above three page attributes, other page attributes can also be added according to needs. When other page attributes are added, you only need to configure one more matching method and corresponding resources for the page attribute, which has good scalability.

[0041] Step S400: Render and generate the page requested by the client according to the page attributes.

[0042] After determining the page attributes, you can render and generate the corresponding page based on the page attributes.

[0043] For the above three page attributes, these three page attributes will be needed to generate the corresponding page. For the page without page method configuration, the page method is not needed and the page can be generated only by relying on page structure and page style.

[0044] It is understandable that this embodiment only discusses how to generate pages of different styles. For the actual data in the page, the server will feedback and send it according to the request. The data will be displayed in the page according to the page structure and page style, and will not be elaborated here.

[0045] In the AB test environment, after the client applies for a page, the final rendered page is still controlled by the server, ensuring that the rendered page meets the requirements of the AB test. At the same time, most page generation operations are integrated into the client, reducing the amount of code on the server. At the same time, by matching different page attributes, the required page can be generated more flexibly, and it is also easier to maintain and modify.

[0046] In addition, if Figure 2 As shown, the AB test control method flow of the server in this embodiment includes: Step S500, when a page request instruction is received from a client, the client information of the client is parsed.

[0047] When the server receives a page request instruction from the client, it will need to feedback the corresponding page index based on the request instruction. As described in the previous steps, the page request instruction carries client information, so it is necessary to parse the client information first to determine the status of the client that sent the page request instruction, so as to determine what kind of page needs to be fed back to it next.

[0048] Step S600: Match corresponding page indexes from pre-configured experimental groups according to the client information.

[0049] For AB testing, testers will pre-configure multiple experimental groups for experiments. Experimental groups can be considered as collections of pages with different styles. In the server, the matching relationship between each experimental group and client information will be pre-configured. For example, for users under 20 years old, it corresponds to experimental group A, and for users over 20 years old, it corresponds to experimental group B, and so on. At the same time, when applying for a page, it includes a page link, so you can directly locate the specific page index.

[0050] It is understandable that AB testing mainly tests pages of different styles. The page content is consistent, but the page structure, style and other attributes that reflect the style are different. Therefore, multiple pages can be configured in each experimental group. As long as the corresponding experimental group is matched through the matching relationship, the corresponding page index can be determined.

[0051] There can be more experimental groups, such as 3 or 4 groups. The testers can design the specific number of experimental groups based on the actual situation.

[0052] According to the matching relationship between the client information and the experimental group, the corresponding page index can be determined. The page index is the page requested by the user and the page index in the corresponding experimental group. In the client, the page index corresponds one-to-one to the page attributes pre-stored by the client.

[0053] It is understandable that the existing technology requires new test logic code to be created on the server side in order to create a new AB test. The logic of these codes is generally the same, but the pages they point to are different. At the same time, because they belong to different test projects, the codes have to be separated, resulting in a lot of code redundancy with the same logic.

[0054] In this embodiment, the server does not need to carry out too much code development. When conducting a new AB test, the server only needs to establish an experimental path and a corresponding matching relationship. The workload is small. The specific page attributes and related matching methods are decoupled to the client, and the client mainly matches the page attributes and can call the corresponding matching interface to implement it. The code has high reusability and reduces redundancy. In this way, when creating a new AB test, there is no need to repeatedly write the test logic code with the same logic, which increases the test efficiency and makes it more convenient to create a new AB test.

[0055] Step S700: sending the page index to the client.

[0056] The page index is fed back to the client, and the client can generate a page of the corresponding style based on the page index.

[0057] The interaction process between the client and the server in this embodiment is as follows Figure 3As shown in the figure, the client requests a page from the server, and the server matches the page index according to the client information of the client, and then the client generates the corresponding page according to the page index. It can be seen that all operations related to page generation are on the client, and the server only needs to match according to the preset rules, and does not need to perform page generation operations.

[0058] When a new AB test needs to be integrated into the server, it is only necessary to configure the experimental group and the corresponding matching rules on the server, and then update the page of the corresponding style of the experimental group to the client. Compared with the prior art that requires writing a complete set of new test programs, the solution of this embodiment reduces the development burden, reduces repetitive work on the server, and enhances scalability, making different AB tests easier to integrate into the server.

[0059] In addition, after completing the AB test, the server will determine which experimental group's page to finally select based on the test data. Therefore, pruning operations are required to delete page-related programs other than the finally selected experimental group to reduce the client's code burden.

[0060] like Figure 4 The figure shows a schematic diagram of the process of pruning by the client, including: Step S800, receiving the test end information from the server.

[0061] This step is executed after step S100, that is, when the client sends a page request to the server, the server has completed the test. At this time, the server will send a test end message to tell the client that the test is over.

[0062] When informing the client that the test is over, the aforementioned page generation operation will still be performed, indicating that the page generation is no longer an AB test, but a page generation for normal online use. It can be seen that by following the aforementioned page generation process, normal page generation services can be provided after the AB test is over, without the user having to make adaptive adjustments to the client code.

[0063] Step S900: sending a program pruning request to the server.

[0064] When the client learns that the AB test is over, it will send a program pruning request to the server. After the test is over, the server will determine the selected page style. Therefore, no matter what the client's customer information is, the page index of the selected page style will be fed back. Therefore, the page attributes corresponding to the page indexes of other experimental groups previously stored, and the programs related to the AB test need to be deleted to delete redundant code, so a program pruning request needs to be issued.

[0065] Step S1000: after obtaining the pruning permission information and pruning parameters sent by the server, matching and deleting the experimental group indicated by the pruning parameters according to the pruning parameters.

[0066] The client can perform pruning only when the server allows pruning. When the server allows pruning, it will send the corresponding pruning parameters to the client. The client can match according to the pruning parameters and delete the corresponding program code.

[0067] It is understandable that the pruning parameter here is an agreed parameter. For example, the pruning parameter may be the name of the experimental group finally selected. Then the pruning program may delete all experimental groups other than the experimental group by matching the regular expression.

[0068] Or it can be the name of the experimental group to be deleted, or the related index number, etc., then the pruning program can match these experimental group names and delete these experimental groups. Those that are not within the pruning parameters will not be deleted.

[0069] The specific pruning parameters can be determined as long as they are agreed upon by the program executing the deletion in the client and the server, and no further restrictions are imposed here.

[0070] In this embodiment, program pruning is mainly performed in the client, which can be implemented through scripts, such as NODE.JS scripts or shall scripts, etc. These scripts can perform program deletion operations through regular expressions or abstract syntax trees, or a combination of both.

[0071] For the server, when the AB test is completed, the test results will be selected based on the test data, that is, an experimental group will be finally locked, and the pages in the experimental group will be used as the pages actually used online. At this time, when the server receives a page request instruction, it will no longer match it, but directly feedback the pages in the experimental group.

[0072] like Figure 5 As shown, the present application also provides an AB test control system, which includes a server 100 and a client 200.

[0073] The server 100 is a server for providing AB testing. Developers can configure different experimental groups for AB testing and corresponding matching rules in the server through simple configuration.

[0074] The client 200 is a user device used by the user to access the page, such as a computer or a smart phone, etc. These devices run corresponding clients to request pages.

[0075] During AB testing, various pre-set page styles are pre-stored in the client 200 , and matching rules for experimental groups representing various page styles are configured by developers in the server 100 .

[0076] The client sends a page request instruction to the server, wherein the request instruction includes client information of the client; When the server receives a page request instruction from a client, parsing the client information of the client; According to the client information, matching corresponding page indexes from pre-configured experimental groups; The page index is sent to the client.

[0077] The client obtains the page index fed back by the server.

[0078] According to the page index, page attributes of the experimental group corresponding to the page index are matched.

[0079] According to the page attributes, the page requested by the client is rendered and generated.

[0080] The operations performed by the client and the server are the same as the above steps and will not be repeated here.

[0081] This embodiment further provides a computer device, which includes a processor and a memory, wherein the memory stores a computer program, and the processor is used to execute the computer program to implement the AB test control method.

[0082] The above-mentioned computer device can be a computer, a server, a smart mobile terminal or other devices, among which the server can be used as a computer device on the server side, and personal devices such as a computer and a smart mobile terminal can be used as a client device.

[0083] This embodiment also provides a computer-readable storage medium storing a computer program. When the computer program is executed on a processor, the AB test control method is implemented.

[0084] The computer-readable storage medium may be a hard disk, a memory, a flash memory, or other storage medium that can be applied to the above-mentioned computer devices.

[0085] It can be understood that the device of this embodiment corresponds to the method of the above embodiment, and the options in the above embodiment are also applicable to this embodiment, so they will not be described repeatedly here.

[0086] The above-mentioned computer device includes a processor and a memory, wherein the memory stores a computer program, and the processor runs the computer program, thereby enabling the computer device to execute the functions of each module in the above-mentioned method or the above-mentioned device.

[0087] Among them, the processor can be an integrated circuit chip with signal processing capabilities. The processor can be a general-purpose processor, including a central processing unit (CPU), a graphics processing unit (GPU), a network processor (NP), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or at least one of other programmable logic devices, discrete gates or transistor logic devices, and discrete hardware components. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc., which can implement or execute the methods, steps and logic block diagrams disclosed in the embodiments of the present application.

[0088] The memory may be, but is not limited to, a random access memory (RAM), a read only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electric erasable programmable read-only memory (EEPROM), etc. The memory is used to store a computer program, and the processor may execute the computer program accordingly after receiving an execution instruction.

[0089] The present application also provides a computer-readable storage medium for storing the computer program used in the above-mentioned computer device. For example, the computer-readable storage medium may include but is not limited to: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes.

[0090] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and structure diagrams in the accompanying drawings show the possible architecture, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the module, a program segment or a part of a code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in an alternative implementation, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the structure diagram and / or the flow diagram, and the combination of boxes in the structure diagram and / or the flow diagram, can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0091] In addition, the functional modules or units in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.

[0092] If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a computer device (which can be a smart phone, a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application.

[0093] The above description is only a specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application.

Claims

1. An AB test control method, characterized in that: Applied to a client, the method comprises: Sending a page request instruction to a server, wherein the request instruction includes client information of the client; Obtaining the page index fed back by the server; According to the page index, matching the page attribute of the experimental group corresponding to the page index; the experimental group is pre-stored locally; According to the page attributes, the page requested by the client is rendered and generated.

2. The AB test control method according to claim 1, characterized in that: The page attributes include page structure, page style and page method; The step of matching the page attribute page index of the experimental group corresponding to the page index according to the page index includes: An experimental group corresponding to the page index is determined, and the page structure, the page style, and the page method of the page corresponding to the page index are obtained from the experimental group to determine the page attribute.

3. The AB test control method according to claim 2, characterized in that: The rendering and generating the page requested by the client according to the page attributes includes: A page requested by the request instruction is generated according to the page structure, the page style and / or the page method.

4. The AB test control method according to claim 1, characterized in that: After sending the page request instruction to the server, the method further includes: Receiving test completion information from the server; Sending a program pruning request to the server; After obtaining the pruning permission information and pruning parameters sent by the server, the experimental group indicated by the pruning parameters is matched and deleted according to the pruning parameters.

5. An AB test control method, characterized in that: Applied to the server, the method includes: When receiving a page request instruction from a client, parsing the client information of the client; According to the client information, matching corresponding page indexes from pre-configured experimental groups; The page index is sent to the client.

6. The AB test control method according to claim 5, characterized in that: When the AB test is finished and a page request instruction is received from the client, it also includes: Sending a test end message to the client; After receiving the program pruning request from the client, the program pruning permission information is fed back, and the pruning parameters are fed back according to the test results.

7. The AB test control method according to claim 5, characterized in that: Also includes: When the AB test is finished, determining the test result, and locking the experimental group according to the test result; When the page request instruction is received, the page index in the experimental group is directly fed back.

8. An AB test control system, characterized in that: include: Server and client; The client sends a page request instruction to the server, wherein the request instruction includes client information of the client; When the server receives a page request instruction from a client, parsing the client information of the client; According to the client information, matching corresponding page indexes from pre-configured experimental groups; Sending the page index to the client; The client obtains the page index fed back by the server; According to the page index, matching the page attributes of the experimental group corresponding to the page index; According to the page attributes, the page requested by the client is rendered and generated.

9. A computer device, characterized in that: The computer device comprises a processor and a memory, wherein the memory stores a computer program, and the processor is configured to execute the computer program to implement the AB test control method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer program is stored therein, and when the computer program is executed on a processor, the AB test control method according to any one of claims 1 to 7 is implemented.

Images