Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

AB test method, system, device and storage medium

A test method and experimental technology, applied in the field of AB testing, can solve the problems of experimental influence, large result error, and the distribution of tail numbers is not random enough.

Inactive Publication Date: 2019-11-05
JIANGSU MANYUN SOFTWARE TECH CO LTD
View PDF0 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, when using this method, due to the limited number of user IDs, only a limited number of experiments can be carried out. Secondly, the distribution of the tail numbers is not random enough, which will cause the experiments to interact with each other, and there is a large error in the results.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • AB test method, system, device and storage medium
  • AB test method, system, device and storage medium
  • AB test method, system, device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0052] Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus repeated descriptions thereof will be omitted. Some of the block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an AB test method, a system, a device and a storage medium. The method comprises the steps: constructing a plurality of experiment layers, wherein each experiment layer comprises at least one experiment; obtaining experiment configuration data of experiment configuration personnel, wherein the experiment configuration data comprises experiment flow distribution data, and theexperiment flow distribution data comprising flow proportions occupied by each experiment in each experiment layer; obtaining a user request, and distributing a target experiment to which the user request enters in each experiment layer according to the experiment flow distribution data; and distributing the user request to the target experiment in each experiment layer. By the adoption of the scheme, AB testing is conducted based on the layered experiment theory. The experiment flow of different experiment layers is orthogonally distributed. Experiment results cannot be affected. Multi-layerexperiments can be conducted at the same time, and the increasingly-large service flow requirement is met.

Description

technical field [0001] The present invention relates to the technical field of AB testing, in particular to an AB testing method, system, equipment and storage medium. Background technique [0002] The optimization of Internet companies' products, the adjustment of models such as recommendation algorithms, etc., are all obtained by conducting a large number of AB experiments and comparing the results. In the modeling of the algorithm model, the parameters need to be continuously adjusted, the results of different models need to be compared and tested repeatedly, and the design of the front-end product, page layout, font color, etc. need to be tested and compared with different schemes to get better results. The product design is good or bad, and the result evaluation of the algorithm model must be judged based on the data of the AB experiment. [0003] The AB experiment in the prior art is divided according to the last digit of the user ID, and different tail numbers enter ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F11/36
CPCG06F11/3684G06F11/3688
Inventor 韩文欣董延峰申波
Owner JIANGSU MANYUN SOFTWARE TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com