Check patentability & draft patents in minutes with Patsnap Eureka AI!

Method for carrying out click conversion prediction in sparse feature scene

A sparse feature and scene technology, applied in neural learning methods, marketing, biological neural network models, etc., can solve problems such as modeling difficulties, achieve the effects of alleviating gradient problems, improving prediction accuracy, and improving accuracy

Active Publication Date: 2020-07-17
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF8 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Because, in the field of e-commerce, user behavior characteristics are usually sparse and huge, which brings difficulties and challenges to modeling
The early modeling method combining artificial feature engineering and logistic regression (LR for short) required a lot of manual processing. The required talents not only need to have an understanding of business and industry, but also have high experience requirements for algorithm processing. Good or bad often depends on the effect of manual processing of special diagnosis; based on this further, the modeling method of combining gradient boosting tree (GBDT for short) and LR requires a lot of manual processing, but due to its interpretability and GBDT for false The improvement of the weight of the example has greatly improved the accuracy of the prediction calculation; then, with the popularity of the neural network, the method of modeling CTR through the neural network has also gradually emerged, and the method of learning user behavior characteristics through the neural network The performance of the model has been greatly improved. For an Internet company with a large user base, a 1% increase in CTR will bring incomparable benefits, not to mention the neural network-based CTR model. The improved CTR is far from More than 1%

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for carrying out click conversion prediction in sparse feature scene
  • Method for carrying out click conversion prediction in sparse feature scene
  • Method for carrying out click conversion prediction in sparse feature scene

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0043] A method for predicting click conversion in a sparse feature scenario includes the following steps:

[0044] S1: Establish a CTR model, the CTR model includes a first level, a second level, a third level and a fourth level;

[0045] S2: Collect sparse behavioral features of users, and input the sparse behavioral features of users into the CTR model in step S1, and perform matrixing to obtain a sparse feature matrix of users;

[0046] S3: Input the sparse feature matrix of the user, and convert the sparse feature matrix of the user into a dense embedding matrix through the first level of the CTR model;

[0047] S4: Input the dense embedding matrix into the second level, learn low-order interaction features, and obtain the interaction feature relationship between low-order features;

[0048] S5: Use the output in step S4 as the input of the third level, learn high-order interaction features, and obtain the interaction feature relationship between high-order features;

...

Embodiment 2

[0052] Such as figure 1 As shown, the method for predicting click conversion in a sparse feature scenario includes the following steps:

[0053] S1: Establish a CTR model, the CTR model includes a first level, a second level, a third level and a fourth level;

[0054] S2: Collect sparse behavioral features of users, and input the sparse behavioral features of users into the CTR model in step S1, and perform matrixing to obtain a sparse feature matrix of users;

[0055] S3: Input the sparse feature matrix of the user, and convert the sparse feature matrix of the user into a dense embedding matrix through the first level of the CTR model;

[0056] S4: Input the dense embedding matrix into the second-level factorization layer and the second-order interaction layer respectively, where the factorization layer is used to learn the interaction feature information between low-order and linearly related features, and the second-order interaction layer is used to learn Interaction fea...

Embodiment 3

[0061] This embodiment is a supplementary description of Embodiment 2.

[0062] Such as figure 1 As shown, the factorization layer uses the FM model to learn the interaction feature information between low-level and linearly related features.

[0063] The FM model has the following advantages: first, the FM model can still make reliable predictions even when the data is very sparse; second, the FM model has linear time complexity and can be solved directly using the original problem; in addition, the FM model The model is a general model, and the feature value of its training data can be any real number, while other advanced decomposition models have strict restrictions on the input data.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for carrying out click conversion prediction in a sparse feature scene, and relates to the field of click conversion prediction. A CTR model based on a neural networkis established, the CTR model adopts a brand-new neural network structure, interaction information of low-order features can be learned, and meanwhile interaction information of high-order features can be obtained. In addition, the interaction information of the low-order features is not limited to the low-order features of the linear relationship, and also comprises the low-order features of thenonlinear relationship. In order to prevent the problem of gradient updating caused by too deep network layers, a residual error network structure is selected to be added to optimize an algorithm model.

Description

technical field [0001] The invention relates to the field of click conversion rate prediction, in particular to a method for click conversion prediction in a sparse feature scene. Background technique [0002] Click-to-conversion rate, or CTR for short, generally refers to the ratio of users who click on a specific link to the total number of users who view a page, email or ad. It is usually used to measure the success of a website's online advertising campaign and the effectiveness of email campaigns, and is one of the core basis for Internet companies to allocate traffic. It can be seen from this that the higher the click conversion rate, the more successful the advertising campaign, and the more popular the product or the better the product sales. [0003] Based on this background, CTR prediction has always been a popular field of machine learning applications, but it is also a hot problem. Because, in the field of e-commerce, user behavior characteristics are usually s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06Q30/02G06N3/04G06N3/08
CPCG06Q30/0242G06N3/08G06N3/045
Inventor 杨昕梅余楚楚杨承高原李绍荣
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More