A method and device for implementing page experiment

Abstract

The present invention discloses a method and device for implementing a page experiment. The method comprises: receiving configuration information of a page experiment, setting a dot mark corresponding to the page experiment in a target page according to the configuration information; filtering the log of the target page according to the dot mark to obtain experimental data; and performing experimental analysis based on the experimental data. The present invention can accurately count data of various dimensions of the experiment, facilitate statistical analysis of experimental data, and greatly shorten the time for data output, saving labor costs, and the technical solution disclosed in the present invention can be reused as long as different experimental information is re-marked, thereby achieving better reuse.

Description

Technical Field

[0001] The present invention relates to the field of grayscale publishing experiments, and in particular to a method and device for implementing a page experiment. Background Art

[0002] Grayscale release experiment is a frequently used method for Internet software release. It refers to a release method that can smoothly transition between black and white, such as A / B testing. The general method of grayscale release experiment is to randomly select some users to experience new functions, analyze user behavior and evaluate the overall quality of new functions. However, due to the large number of online grayscale release experiments, each experiment ends with a huge amount of data that needs to be statistically analyzed, which greatly wastes time and manpower; the complexity of the experiments varies, and the data to be counted also varies greatly, and the data statistics often differ from the actual situation; and different experiments need to be set up separately, the replicability of experimental operations is poor, requiring a lot of repetitive work, and it is impossible to obtain accurate statistics, so it is impossible to accurately obtain the specific performance of the experimental objects and the ranking of non-experimental objects.

[0003] Therefore, how to improve the accuracy and replicability of grayscale release experiments is a problem that needs to be solved in the current field of grayscale release experiments. Summary of the invention

[0004] In view of the above problems, the present invention is proposed to provide a method and device for implementing a page experiment that overcomes the above problems or at least partially solves the above problems.

[0005] According to one aspect of the present invention, a method for implementing a page experiment is provided, comprising:

[0006] Receiving configuration information of a page experiment, and setting a dot mark corresponding to the page experiment in a target page according to the configuration information;

[0007] Filter the log of the target page according to the dot identifier to obtain experimental data;

[0008] Experimental analysis is performed based on the experimental data.

[0009] Optionally, the configuration information includes: flow distribution ratio;

[0010] The method also includes: determining the traffic of the target page for performing the page experiment according to the traffic distribution ratio.

[0011] Optionally, filtering the log of the target page according to the dot identifier to obtain the experimental data includes:

[0012] The traffic logs irrelevant to the page experiment are filtered out according to the dot identification.

[0013] Optionally, the configuration information includes an experiment name, and the dot mark includes an experiment name mark;

[0014] The log of filtering out the traffic irrelevant to the page experiment according to the dot mark includes:

[0015] If the log of a session does not contain the experiment name identifier, the log of the session is filtered out.

[0016] Optionally, the configuration information includes an experimental object, and the dot mark includes an experimental object display mark;

[0017] The log of the target page is filtered according to the dot mark to obtain experimental data including:

[0018] If the log of a session does not contain the experimental subject presentation identifier, the log of the session is filtered out.

[0019] Optionally, filtering the log of the target page according to the dot identifier to obtain the experimental data further includes:

[0020] If the experimental subject display identifier is included, it is further determined whether the log of the session contains click records that are not from the experimental subject, and if so, the corresponding log is filtered out.

[0021] Optionally, the dot mark also includes a subject click mark.

[0022] Optionally, the method further includes:

[0023] Present the experimental analysis results in graphical and / or tabular form.

[0024] According to another aspect of the present invention, a device for implementing a page experiment is provided, comprising:

[0025] A configuration unit, adapted to receive configuration information of a page experiment, and set a dot mark corresponding to the page experiment in a target page according to the configuration information;

[0026] A filtering unit, adapted to filter the log of the target page according to the dot mark to obtain experimental data;

[0027] The analysis unit is adapted to perform experimental analysis based on the experimental data.

[0028] Optionally, the configuration information includes: flow distribution ratio;

[0029] The device also includes: a flow distribution unit, adapted to determine the flow of the target page for performing the page experiment according to the flow distribution ratio.

[0030] Optionally, the filtering unit is further adapted to filter out traffic logs irrelevant to the page experiment according to the dot identifier.

[0031] Optionally, the configuration information includes an experiment name, and the dot mark includes an experiment name mark;

[0032] The filtering unit is further adapted to filter out the log of a session if the log of the session does not contain the experiment name identifier.

[0033] Optionally, the configuration information includes an experimental object, and the dot mark includes an experimental object display mark;

[0034] The filtering unit is further adapted to filter out the log of a session if the log of the session does not contain the experimental subject presentation identifier.

[0035] Optionally, the filtering unit is further adapted to further determine whether the log of the session contains click records of persons other than the experimental subject if the experimental subject display identifier is contained, and if so, filter out the corresponding log.

[0036] Optionally, the dot mark also includes a subject click mark.

[0037] Optionally, the analysis unit is also suitable for displaying the experimental analysis results in graphical and / or tabular form.

[0038] According to another aspect of the present invention, an electronic device is provided, comprising: a processor; and a memory arranged to store computer executable instructions, wherein when the executable instructions are executed, the processor executes any of the above methods.

[0039] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores one or more programs, and when the one or more programs are executed by a processor, the one or more programs implement any of the methods described above.

[0040] From the above, it can be seen that the implementation method of the page experiment disclosed in the technical solution of the present invention is, first, receiving the configuration information of the page experiment, and setting the dot mark corresponding to the page experiment in the target page according to the configuration information; then, filtering the log of the target page according to the dot mark to obtain the experimental data; finally, performing experimental analysis based on the experimental data. The present invention can accurately count the data of various dimensions of different experiments, facilitate the statistical analysis of experimental data, and greatly shorten the time of data output, saving labor costs, and the technical solution disclosed in the present invention can be reused as long as the different experimental information is re-marked, thereby achieving better reuse.

[0041] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present invention. Moreover, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0043] Figure 1 A schematic flow chart of a method for implementing a page experiment according to an embodiment of the present invention is shown;

[0044] Figure 2 A schematic diagram showing the structure of a device for implementing a page experiment according to an embodiment of the present invention is shown;

[0045] Figure 3 A schematic diagram of the structure of an electronic device according to an embodiment of the present invention is shown;

[0046] Figure 4 A schematic diagram of the structure of a computer-readable storage medium according to an embodiment of the present invention is shown;

[0047] Figure 5 A schematic diagram of an experiment information configuration page according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0048] The exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present invention and to enable the scope of the present invention to be fully communicated to those skilled in the art.

[0049] Figure 1 A flow chart of a method for implementing a page experiment according to an embodiment of the present invention is shown; the method comprises:

[0050] Step S110, receiving configuration information of the page experiment, and setting a dot mark corresponding to the page experiment in the target page according to the configuration information.

[0051] In the case where multiple experiments are carried out simultaneously in a certain application, in order to count whether the user pays attention to the new function after logging into the application, it is necessary to obtain the user's behavior data. In the embodiment of the present invention, in order to meet the needs of data statistics and analysis of different experimental types, a unified experimental mode or platform is set. In this mode or platform, first, according to the purpose of the new experiment, several experimental information is accepted and configured. The experimental information may include the experiment type, experiment name, experiment description, experimental object, etc. Figure 5 Then, the above experimental information is matched with the corresponding identifiers, that is, matching and marking are performed to facilitate subsequent statistical analysis. For example, for a specific experiment, abv can be used to identify the experiment name, ablist to identify the experimental object display, abid to identify the experimental object click, and so on.

[0052] In order to obtain comprehensive data, different labels can be used to mark different experimental information in different experiments, thus laying the foundation for obtaining comprehensive data.

[0053] Step S120 , filtering the log of the target page according to the dot mark to obtain experimental data.

[0054] The user access record can be reflected in the log of the server. After the experiment of this embodiment of the present invention starts, the log can be filtered according to the dot mark situation in the corresponding log of the target page to obtain experimental data that meets the purpose of the experiment.

[0055] Step S130, performing experimental analysis based on the experimental data.

[0056] Since multiple projects have been marked according to the experimental information, the experimental data obtained also includes multiple aspects and dimensions. According to the log filtered in step S120, various data such as the display volume and click volume of the experimental objects can be extracted, which is convenient for subsequent statistics, calculations and analysis, and finally the search volume, display volume, click volume and various proportions and rankings of the corresponding experiment can be obtained.

[0057] In addition, in order to ensure the safety of the experiment, the identity of the experimenter can be authenticated when configuring the experimental information, thereby ensuring the security of the experiment and data.

[0058] The implementation method of the page experiment disclosed in this embodiment of the present invention first receives the configuration information of the page experiment, and sets the dot mark corresponding to the page experiment in the target page according to the configuration information; then, the log of the target page is filtered according to the dot mark to obtain the experimental data; finally, the experimental analysis is performed based on the experimental data. It can be seen that the technical solution disclosed in this embodiment can accurately count the data of various dimensions of the experiment, facilitate the statistical analysis of the experimental data, and greatly shorten the time of data output, saving labor costs, and the technical solution disclosed in the present invention can be reused as long as different experimental information is marked, thereby achieving better reuse.

[0059] In a specific embodiment of the present invention, the configuration information received in the page experiment includes: a flow distribution ratio; the method further includes: determining the flow of the target page for performing the page experiment according to the flow distribution ratio.

[0060] When the user traffic of a certain application is too large, if the traffic is not distributed, there will be too much data to be analyzed. Therefore, a preliminary refinement can be made for the user traffic, which can improve the efficiency and accuracy of the experiment, and also facilitate multiple experiments to be carried out at the same time. In an embodiment of the present invention, the user traffic within a period of time is first distributed, and the traffic of the target page used for page experiments is determined according to the traffic distribution ratio. For example, in an experiment of a newly designed picture display box in a search web application, it can be decided in the configuration information that 10% of the traffic will be used for the experiment, and the remaining 90% of the traffic should be used for other experiments or no experiment will be carried out.

[0061] According to a specific embodiment of the present invention, filtering the log of the target page according to the dot identifier to obtain the experimental data includes: filtering out the log of the flow irrelevant to the page experiment according to the dot identifier.

[0062] In this embodiment, within the determined user traffic range, invalid displays or clicks are filtered out based on the user's behavior using the identification information in the log, and the user's valid behavior data is retained. Taking the new experiment of the picture display box as an example, when conducting the experiment, for example, it is possible to determine which users have displayed a new picture display box on the page based on the search results based on the display identification, and then further filter out how much traffic among the users who have displayed the box is attracted by the new picture display box and makes valid clicks. In this way, the logs of traffic that is not related to the page experiment are filtered out.

[0063] In a specific embodiment of the present invention, the configuration information includes the experiment name, and the dot mark includes the experiment name mark. Filtering out the log of traffic irrelevant to the page experiment according to the dot mark includes: if the log of a session does not include the experiment name mark, filtering out the log of the session.

[0064] This embodiment shows the situation of filtering by experiment name. If the log does not contain the identifier of the experiment name, it means that the user did not participate in the experiment. This part of the traffic is invalid traffic and there is no need to count it in the final result. There is no need to analyze the log. In other words, this part of the traffic is not the traffic allocated to the experiment. Of course, the log may contain the names of other experiments, which should be analyzed as experimental data of other experiments.

[0065] According to an embodiment of the present invention, the configuration information includes the experimental object, and the marking mark includes the experimental object display mark. The log of the target page is filtered according to the marking mark to obtain the experimental data, including: if the log of a session does not contain the experimental object display mark, the log of the session is filtered out.

[0066] For example, if a user searches for or follows the above-mentioned image display box, it is also possible to further determine whether the user has displayed the box in the searched page based on the display identification information of the experimental object in the log. If the log does not contain the experimental object display identification, the log of the session is filtered out. For a specific example, a certain part of the traffic is allocated to the image box experiment, but the search results page of the users of this part of the traffic does not actually contain the part related to the image box. For example, when searching for a piece of code, the search results are not related to the image, and there is no image box display in the search results page. Therefore, although the collected logs contain the experiment name, the lack of the experimental object display identification is not helpful for experimental analysis, so this part of the log also needs to be filtered out.

[0067] In one embodiment of the present invention, the log of the target page is filtered according to the dot mark to obtain the experimental data, which also includes: if it contains the experimental object display mark, further determine whether the log of the session contains click records of non-experimental objects, and if so, filter out the corresponding log.

[0068] For example, a recommendation position conducts an AB test on the recommendation display format as an experiment. If the user sees the recommendation position but clicks on other content on the page, it means that no matter what the recommendation display format is, the user does not actually care about this part of the content. In this case, such logs are not helpful for the analysis of the experiment and need to be filtered.

[0069] In one embodiment of the present invention, the dot mark also includes the subject clicking mark.

[0070] In this embodiment, the click behavior of the experimental subject is directly marked when configuring the information, so that the user log can include this information, thereby obtaining accurate analysis and statistical data.

[0071] In one embodiment of the present invention, the method further comprises: displaying the experimental analysis results in graphical and / or tabular form.

[0072] After obtaining the above-mentioned experiment name, experimental object display, experimental object click and other related experimental data, the overall performance of a certain experiment can be obtained based on the statistical analysis results. For example, through the above-mentioned picture display box experiment, it can be obtained that within the allocated traffic range, the degree of attention paid to the new picture display, the degree of acceptance by users, and the impact of the new picture display on the ranking of other picture displays can be obtained.

[0073] Furthermore, according to the method of the present invention, if other experiments need to be conducted, such as a new video box experiment, it is only necessary to re-mark the new video box experiment using the configuration information, and then the experiment can be conducted again, thereby achieving better reuse.

[0074] Figure 2 A schematic diagram of the structure of a device for implementing a page experiment according to an embodiment of the present invention is shown; the device 200 includes:

[0075] The configuration unit 210 is adapted to receive configuration information of the page experiment, and set a dot mark corresponding to the page experiment in the target page according to the configuration information.

[0076] In the case where multiple experiments are carried out simultaneously in a certain application, in order to count whether the user pays attention to the new function after logging into the application, it is necessary to obtain the user's behavior data. In the embodiment of the present invention, in order to meet the needs of data statistics and analysis of different experimental types, a unified experimental mode or platform is set. In this mode or platform, first, according to the purpose of the new experiment, several experimental information is accepted and configured. The experimental information may include the experiment type, experiment name, experiment description, experimental object, etc. Figure 5 Then, the above experimental information is matched with the corresponding identifiers, that is, matching and marking are performed to facilitate subsequent statistical analysis. For example, for a specific experiment, abv can be used to identify the experiment name, ablist to identify the experimental object display, abid to identify the experimental object click, and so on.

[0077] In order to obtain comprehensive data, different labels can be used to mark different experimental information in different experiments, thus laying the foundation for obtaining comprehensive data.

[0078] The filtering unit 220 is adapted to filter the log of the target page according to the dot mark to obtain experimental data.

[0079] The user access record can be reflected in the log of the server. After the experiment of this embodiment of the present invention starts, the log can be filtered according to the dot mark situation in the corresponding log of the target page to obtain experimental data that meets the purpose of the experiment.

[0080] The analysis unit 230 is adapted to perform experimental analysis based on the experimental data.

[0081] Since multiple projects have been marked according to the experimental information, the experimental data obtained also includes multiple aspects and dimensions. According to the logs filtered by the filtering unit 220, various situations such as the display volume and click volume of the experimental objects can be extracted, thereby facilitating statistical analysis of the search volume, display volume, click volume, various proportions and rankings of the corresponding experiments.

[0082] In addition, in order to ensure the safety of the experiment, the identity of the experimenter can be authenticated when configuring the experimental information, thereby ensuring the security of the experiment and data.

[0083] The implementation device of the page experiment disclosed in this embodiment of the present invention, first, the configuration unit 210 receives the configuration information of the page experiment, and sets the dot mark corresponding to the page experiment in the target page according to the configuration information; then, the filtering unit 220 filters the log of the target page according to the dot mark to obtain the experimental data; the analysis unit 230 performs experimental analysis based on the experimental data. It can be seen that the technical solution disclosed in this embodiment can accurately count the data of various dimensions of the experiment, facilitate the statistical analysis of the experimental data, and greatly shorten the time of data output, saving labor costs, and the technical solution can be reused as long as other different experiments are marked again, thereby achieving better reuse.

[0084] In a specific embodiment of the present invention, the configuration information received in the page experiment includes: a flow distribution ratio; the device 200 also includes: a flow distribution unit, adapted to determine the flow of the target page for performing the page experiment according to the flow distribution ratio.

[0085] When the user traffic of a certain application is too large, if the traffic is not distributed, there will be too much data to be analyzed. Therefore, a preliminary refinement can be made for the user traffic, which can improve the efficiency of the experiment and facilitate multiple experiments at the same time. In an embodiment of the present invention, the user traffic within a period of time is first distributed, and the traffic of the target page used for page experiments is determined according to the traffic distribution ratio. For example, in an experiment of a newly designed picture display box in a search web application, it can be decided in the configuration information that 10% of the traffic will be used for the experiment, and the remaining 90% of the traffic should be used for other experiments or no experiment will be conducted.

[0086] According to a specific embodiment of the present invention, the filtering unit 220 is further adapted to filter out the logs of traffic irrelevant to the page experiment according to the dot markers.

[0087] In this embodiment, within the determined user traffic range, invalid displays or clicks are filtered out based on the user's behavior using the identification information in the log, and the user's valid behavior data is retained. Taking the new experiment of the picture display box as an example, when conducting the experiment, for example, it is possible to determine which users have displayed a new picture display box on the page based on the search results based on the display identification, and then further filter out how much traffic among the users who have displayed the box is attracted by the new picture display box and makes valid clicks. In this way, the logs of traffic that is not related to the page experiment are filtered out.

[0088] In a specific embodiment of the present invention, the configuration information includes the experiment name, and the dot mark includes the experiment name mark. The filtering unit 220 is further adapted to filter out the log of a session if the log of the session does not include the experiment name mark.

[0089] This embodiment shows the situation of filtering by experiment name. If the log does not contain the identifier of the experiment name, it means that the user did not participate in the experiment. This part of the traffic is invalid traffic and there is no need to count it in the final result. There is no need to analyze the log. In other words, this part of the traffic is not the traffic allocated to the experiment. Of course, the log may contain the names of other experiments, which should be analyzed as experimental data of other experiments.

[0090] According to an embodiment of the present invention, the configuration information includes the experimental object, and the dot mark includes the experimental object display mark. The filtering unit 220 is further adapted to filter out the log of a session if the log of the session does not contain the experimental object display mark.

[0091] For example, if a user searches for or follows the above-mentioned image display box, it is also possible to further determine whether the user has displayed the box in the searched page based on the display identification information of the experimental object in the log. If the log does not contain the experimental object display identification, the log of the session is filtered out. For a specific example, a certain part of the traffic is allocated to the image box experiment, but the search results page of the users of this part of the traffic does not actually contain the part related to the image box. For example, when searching for a piece of code, the search results are not related to the image, and there is no image box display in the search results page. Therefore, although the collected logs contain the experiment name, the lack of the experimental object display identification is not helpful for experimental analysis, so this part of the log also needs to be filtered out.

[0092] In one embodiment of the present invention, the filtering unit 220 is further adapted to further determine whether the log of the session contains click records of non-experimental subjects if the experimental subject display identifier is included, and if so, filter out the corresponding log.

[0093] For example, a recommendation position conducts an AB test on the recommendation display format as an experiment. If the user sees the recommendation position but clicks on other content on the page, it means that no matter what the recommendation display format is, the user does not actually care about this part of the content. In this case, such logs are not helpful for the analysis of the experiment and need to be filtered.

[0094] In one embodiment of the present invention, the dot mark also includes the subject clicking mark.

[0095] In this embodiment, the click behavior of the experimental subject is directly marked when configuring the information, so that the user log can include this information, thereby obtaining accurate analysis and statistical data.

[0096] In one embodiment of the present invention, the analysis unit 230 is further adapted to display the experimental analysis results in a graphical and / or tabular form.

[0097] After obtaining the above-mentioned accurate experimental data such as the experiment name, experimental object display, and experimental object clicks, the overall performance of a certain experiment can be obtained based on the statistical analysis results. For example, through the above-mentioned picture display box experiment, it can be obtained that within the allocated traffic range, the degree of attention paid to the new picture display, the degree of acceptance by users, and the impact of the new picture display on the ranking of other picture displays can be obtained.

[0098] Furthermore, according to the method of the present invention, if other experiments need to be conducted, such as a new video box experiment, it is only necessary to re-mark the new video box experiment using the configuration information, and then the experiment can be conducted again, thereby achieving better reuse.

[0099] In summary, the technical solution of the present invention first receives the configuration information of the page experiment, and sets the dot mark corresponding to the page experiment in the target page according to the configuration information; then, the log of the target page is filtered according to the dot mark to obtain the experimental data; finally, the experimental analysis is performed based on the experimental data. It can be seen that the present invention can accurately count the data of various dimensions of the experiment, facilitate the statistical analysis of the experimental data, and greatly shorten the time of data output, saving labor costs, and the technical solution disclosed in the present invention can be reused as long as the different experimental information is re-marked, thereby achieving better reuse.

[0100] It should be noted that:

[0101] The algorithm and display provided herein are not inherently related to any particular computer, virtual device or other equipment. Various general-purpose devices can also be used together with the teachings based on this. According to the above description, it is obvious to construct the structure required for this type of device. In addition, the present invention is not directed to any specific programming language either. It should be understood that various programming languages ​​can be utilized to realize the content of the present invention described herein, and the description of the above specific language is for the purpose of disclosing the best mode of the present invention.

[0102] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0103] Similarly, it should be understood that in order to streamline the present invention and aid in understanding one or more of the various inventive aspects, in the above description of exemplary embodiments of the present invention, the various features of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. However, this disclosed method should not be interpreted as reflecting the following intention: that the claimed invention requires more features than the features explicitly recited in each claim. More specifically, as reflected in the claims below, inventive aspects lie in less than all the features of the individual embodiments disclosed above. Therefore, the claims that follow the specific embodiment are hereby expressly incorporated into the specific embodiment, with each claim itself serving as a separate embodiment of the present invention.

[0104] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and in addition they may be divided into a plurality of submodules or subunits or subcomponents. Except that at least some of such features and / or processes or units are mutually exclusive, all features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed in this manner may be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature providing the same, equivalent or similar purpose.

[0105] In addition, those skilled in the art will appreciate that, although some embodiments described herein include certain features included in other embodiments but not other features, the combination of features of different embodiments is meant to be within the scope of the present invention and form different embodiments. For example, in the claims below, any one of the claimed embodiments may be used in any combination.

[0106] The various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or digital signal processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components in the implementation device of the page experiment according to an embodiment of the present invention. The present invention may also be implemented as a device or device program (e.g., a computer program and a computer program product) for executing part or all of the methods described herein. Such a program implementing the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such a signal may be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.

[0107] For example, Figure 3 A schematic diagram of the structure of an electronic device according to an embodiment of the present invention is shown. The electronic device 300 includes a processor 310 and a memory 320 arranged to store computer executable instructions (computer readable program code). The memory 320 can be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk or a ROM. The memory 320 has a storage space 330 for storing a computer readable program code 331 for executing any method step in the above method. For example, the storage space 330 for storing computer readable program code may include individual computer readable program codes 331 for implementing various steps in the above method respectively. The computer readable program code 331 can be read from or written into one or more computer program products. These computer program products include program code carriers such as a hard disk, a compact disk (CD), a memory card or a floppy disk. Such a computer program product is typically, for example Figure 4 The computer-readable storage medium. Figure 4A schematic diagram of the structure of a computer-readable storage medium according to an embodiment of the present invention is shown. The computer-readable storage medium 400 stores a computer-readable program code 331 for executing the method steps according to the present invention, which can be read by the processor 310 of the electronic device 300. When the computer-readable program code 331 is executed by the electronic device 300, the electronic device 300 executes the various steps in the method described above. Specifically, the computer-readable program code 331 stored in the computer-readable storage medium can execute the method shown in any of the above embodiments. The computer-readable program code 331 can be compressed in an appropriate form.

[0108] It should be noted that the above embodiments illustrate the present invention rather than limit it, and that those skilled in the art may devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets shall not be construed as a limitation on the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "one" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present invention may be implemented by means of hardware comprising a number of different elements and by means of a suitably programmed computer. In a unit claim enumerating a number of devices, several of these devices may be embodied by the same hardware item. The use of the words first, second, and third, etc., does not indicate any order. These words may be interpreted as names.

[0109] The present invention discloses A1, a method for implementing a page experiment, wherein the method comprises:

[0110] Receiving configuration information of a page experiment, and setting a dot mark corresponding to the page experiment in a target page according to the configuration information;

[0111] Filter the log of the target page according to the dot identifier to obtain experimental data;

[0112] Experimental analysis is performed based on the experimental data.

[0113] A2. The method as described in A1, wherein the configuration information includes: flow distribution ratio;

[0114] The method also includes: determining the traffic of the target page for performing the page experiment according to the traffic distribution ratio.

[0115] A3. The method as described in A2, wherein filtering the log of the target page according to the dot mark to obtain the experimental data comprises:

[0116] The traffic logs irrelevant to the page experiment are filtered out according to the dot identification.

[0117] A4. The method as described in A3, wherein the configuration information includes an experiment name, and the dot mark includes an experiment name mark;

[0118] The log of filtering out the traffic irrelevant to the page experiment according to the dot mark includes:

[0119] If the log of a session does not contain the experiment name identifier, the log of the session is filtered out.

[0120] A5. The method as described in A1, wherein the configuration information includes an experimental object, and the dot mark includes an experimental object display mark;

[0121] The log of the target page is filtered according to the dot mark to obtain experimental data including:

[0122] If the log of a session does not contain the experimental subject presentation identifier, the log of the session is filtered out.

[0123] A6. The method as described in A5, wherein filtering the log of the target page according to the dot mark to obtain the experimental data further comprises:

[0124] If the experimental subject display identifier is included, it is further determined whether the log of the session contains click records that are not from the experimental subject, and if so, the corresponding log is filtered out.

[0125] A7. A method as described in A5, wherein the dot marking also includes a subject clicking mark.

[0126] A8. The method as described in A1, wherein the method further comprises:

[0127] Present the experimental analysis results in graphical and / or tabular form.

[0128] B9. A device for implementing a page experiment, wherein the device comprises:

[0129] A configuration unit, adapted to receive configuration information of a page experiment, and set a dot mark corresponding to the page experiment in a target page according to the configuration information;

[0130] A filtering unit, adapted to filter the log of the target page according to the dot mark to obtain experimental data;

[0131] The analysis unit is adapted to perform experimental analysis based on the experimental data.

[0132] B10. The device as described in B9, wherein the configuration information includes: a flow distribution ratio;

[0133] The device also includes: a flow distribution unit, adapted to determine the flow of the target page for performing the page experiment according to the flow distribution ratio.

[0134] B11. The device as described in B10, wherein:

[0135] The filtering unit is further adapted to filter out the traffic logs irrelevant to the page experiment according to the dot identifier.

[0136] B12. The device as described in B11, wherein the configuration information includes an experiment name, and the dot mark includes an experiment name mark;

[0137] The filtering unit is further adapted to filter out the log of a session if the log of the session does not contain the experiment name identifier.

[0138] B13. The device as described in B9, wherein the configuration information includes an experimental object, and the dot mark includes an experimental object display mark;

[0139] The filtering unit is further adapted to filter out the log of a session if the log of the session does not contain the experimental subject presentation identifier.

[0140] B14. The device as described in B13, wherein the filtering unit is further adapted to further determine whether the log of the session contains click records of persons other than the experimental subject if the experimental subject display identification is included, and if so, filter out the corresponding log.

[0141] B15. A device as described in B9, wherein the dot marking also includes a subject clicking mark.

[0142] B16. An apparatus as described in B9, wherein the analysis unit is further suitable for displaying the experimental analysis results in graphical and / or tabular form.

[0143] C17. An electronic device, comprising: a processor; and a memory arranged to store computer executable instructions, wherein the executable instructions, when executed, cause the processor to perform a method as described in any one of A1-A8.

[0144] D18. A computer-readable storage medium, wherein the computer-readable storage medium stores one or more programs, and when the one or more programs are executed by a processor, the method described in any one of A1-A8 is implemented.

Claims

1. A method for implementing a page experiment, wherein: The method comprises: Receiving configuration information of a page experiment, and setting a dot mark corresponding to the page experiment in a target page according to the configuration information; Filter the log of the target page according to the dot identifier to obtain experimental data; Performing experimental analysis based on the experimental data; Wherein, the configuration information includes the experimental object, and the dot mark includes the experimental object display mark; The step of filtering the log of the target page according to the dot identifier to obtain experimental data includes: If the log of a session contains the experimental subject display identifier, it is further determined whether the log of the session contains click records that are not the experimental subject, and if so, the corresponding log is filtered out.

2. The method of claim 1, wherein: The configuration information includes: flow distribution ratio; The method also includes: determining the traffic of the target page for performing the page experiment according to the traffic distribution ratio.

3. The method of claim 2, wherein: The log of the target page is filtered according to the dot mark to obtain experimental data including: The traffic logs irrelevant to the page experiment are filtered out according to the dot identification.

4. The method of claim 3, wherein: The configuration information includes an experiment name, and the dot mark includes an experiment name mark; The log of filtering out the traffic irrelevant to the page experiment according to the dot mark includes: If the log of a session does not contain the experiment name identifier, the log of the session is filtered out.

5. The method according to claim 1, wherein filtering the log of the target page according to the dot mark to obtain the experimental data comprises: If the log of a session does not contain the experimental subject presentation identifier, the log of the session is filtered out.

6. The method of claim 5, wherein: The dot marking mark also includes the experimental subject clicking mark.

7. The method of claim 1, wherein: The method further includes: Present the experimental analysis results in graphical and / or tabular form.

8. A device for implementing a page experiment, wherein: The device comprises: A configuration unit, adapted to receive configuration information of a page experiment, and set a dot mark corresponding to the page experiment in a target page according to the configuration information; A filtering unit, adapted to filter the log of the target page according to the dot mark to obtain experimental data; an analysis unit, adapted to perform experimental analysis based on the experimental data; Wherein, the configuration information includes the experimental object, and the dot mark includes the experimental object display mark; The filtering unit is further adapted to further determine whether the log of a session contains a click record of a person other than the experimental subject if the log of the session contains the experimental subject display identifier, and if so, filter out the corresponding log.

9. The device of claim 8, wherein: The configuration information includes: flow distribution ratio; The device also includes: a flow distribution unit, adapted to determine the flow of the target page for performing the page experiment according to the flow distribution ratio.

10. The device of claim 9, wherein: The filtering unit is further adapted to filter out the traffic logs irrelevant to the page experiment according to the dot identifier.

11. The device of claim 10, wherein: The configuration information includes an experiment name, and the dot mark includes an experiment name mark; The filtering unit is further adapted to filter out the log of a session if the log of the session does not contain the experiment name identifier.

12. The device according to claim 8, wherein the filtering unit is further adapted to filter out the log of a session if the log of the session does not contain the experimental subject presentation identifier.

13. The device of claim 8, wherein: The dot marking mark also includes the experimental subject clicking mark.

14. The device of claim 8, wherein: The analysis unit is also suitable for displaying the experimental analysis results in graphical and / or tabular form.

15. An electronic device, wherein: The electronic device comprises: a processor; and a memory arranged to store computer executable instructions, wherein when the executable instructions are executed, the processor executes the method according to any one of claims 1 to 7.

16. A computer-readable storage medium, wherein: The computer-readable storage medium stores one or more programs, which, when executed by a processor, implement the method according to any one of claims 1 to 7.

Images