An AB test method and device

Abstract

The embodiment of the invention discloses an AB test method and device. The method comprises a step of determining a test strategy for each test layer in a plurality of test layers, wherein the plurality of test layers are used for determining a target test strategy of each request flow in each test layer, each test layer in the plurality of test layers comprises a reference test and a test to betested, and the test strategy determination step comprises the following steps: obtaining the request flow of at least one user in response to a trigger request of at least one user in a target application; determining a target test corresponding to the i request flow in the request flow of at least one user in the test layer, and distributing the i request flow to the target test; and determining the test strategy in the target test as the corresponding target test strategy of the ith request flow in the test layer, i = 1,... N, and N being the number of the request flows of atleast one user. According to the embodiment of the invention, the problem of long optimization iteration period of a product caused by the fact that multiple tests cannot be carried out by a test method in the prior art is solved.

Description

technical field [0001] The embodiments of the present invention relate to the field of AB testing, in particular to an AB testing method and device. Background technique [0002] Generally, the AB test is an experimental method used in application design to distinguish the degree of support for the effect of two designs on revenue maximization goals (such as click-through rate, etc.), and is mainly used to compare the pros and cons of the two designs. Existing AB testing methods usually release two or more versions of applications at the same time to collect relevant usage data, and then conduct manual comparative analysis. [0003] However, this method relies heavily on the experience of developers and often deviates from the real preferences of users. Moreover, because the product optimization iteration cycle is generally relatively long, the existing testing methods cannot carry out multiple experiments at the same time. , which is not suitable for extensive product opti...

AI Technical Summary

Problems solved by technology

[0004] The embodiment of the present invention provides an AB test method and device to solve the problem in the prior art that the product optimization iteration period is long because the test method cannot perform multiple tests

Images