Unlock instant, AI-driven research and patent intelligence for your innovation.

A Method for Click Conversion Prediction in Sparse Feature Scenarios

A sparse feature and scene technology, applied in neural learning methods, marketing, data processing applications, etc., can solve problems such as modeling difficulties, achieve the effects of alleviating gradient problems, improving accuracy, and easy optimization

Active Publication Date: 2022-05-27
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Because, in the field of e-commerce, user behavior characteristics are usually sparse and huge, which brings difficulties and challenges to modeling
The early modeling method combining artificial feature engineering and logistic regression (LR for short) required a lot of manual processing. The required talents not only need to have an understanding of business and industry, but also have high experience requirements for algorithm processing. Good or bad often depends on the effect of manual processing of special diagnosis; based on this further, the modeling method of combining gradient boosting tree (GBDT for short) and LR requires a lot of manual processing, but due to its interpretability and GBDT for false The improvement of the weight of the example has greatly improved the accuracy of the prediction calculation; then, with the popularity of the neural network, the method of modeling CTR through the neural network has also gradually emerged, and the method of learning user behavior characteristics through the neural network The performance of the model has been greatly improved. For an Internet company with a large user base, a 1% increase in CTR will bring incomparable benefits, not to mention the neural network-based CTR model. The improved CTR is far from More than 1%

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Method for Click Conversion Prediction in Sparse Feature Scenarios
  • A Method for Click Conversion Prediction in Sparse Feature Scenarios
  • A Method for Click Conversion Prediction in Sparse Feature Scenarios

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0043] The method for click conversion prediction in the sparse feature scenario includes the following steps:

[0044] S1: establish a CTR model, the CTR model includes a first level, a second level, a third level and a fourth level;

[0045] S2: Collect user sparse behavior features, input the user sparse behavior features into the CTR model in step S1, and perform matrixing to obtain a user sparse feature matrix;

[0046] S3: Input the user sparse feature matrix, and convert the user sparse feature matrix into a dense embedding matrix through the first level of the CTR model;

[0047] S4: Input the dense embedding matrix into the second level, learn the low-order interactive features, and obtain the interactive feature relationship between the low-order features;

[0048] S5: take the output in step S4 as the input of the third level, learn high-order interactive features, and obtain the interactive feature relationship between the high-order features;

[0049] S6: Use th...

Embodiment 2

[0052] like figure 1 As shown, the method for click conversion prediction in the sparse feature scenario includes the following steps:

[0053] S1: establish a CTR model, the CTR model includes a first level, a second level, a third level and a fourth level;

[0054] S2: Collect user sparse behavior features, input the user sparse behavior features into the CTR model in step S1, and perform matrixing to obtain a user sparse feature matrix;

[0055] S3: Input the user sparse feature matrix, and convert the user sparse feature matrix into a dense embedding matrix through the first level of the CTR model;

[0056] S4: Input the dense embedding matrix into the second-level factorization layer and the second-order interaction layer respectively, where the factorization layer is used to learn the interactive feature information between low-level and linearly related features, and the second-order interaction layer is used to learn Interaction feature information between features o...

Embodiment 3

[0061] This embodiment is a supplementary description of Embodiment 2.

[0062] like figure 1 As shown, the factorization layer adopts the FM model to learn the interactive feature information between low-order and linearly related features.

[0063] The FM model has the following advantages: first, the FM model can still make reliable predictions even when the data is very sparse; second, the FM model has linear time complexity and can be solved directly using the original problem; in addition, FM The model is a general model, and the feature value of its training data can be any real number, while other advanced decomposition models have strict restrictions on the input data.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for predicting click conversion in a sparse feature scene, and relates to the field of click conversion rate prediction. A neural network-based CTR model is established. This CTR model adopts a new neural network structure, which can not only learn the interaction information of low-order features, but also obtain the interaction information of high-order features. In addition, the mutual information of low-order features is not limited to low-order features of linear relationships, but also includes low-order features of nonlinear relationships. In order to prevent the problem of gradient update caused by too deep network layers, we choose to increase the residual network structure to optimize our algorithm model.

Description

technical field [0001] The invention relates to the field of click conversion rate prediction, in particular to a method for click conversion prediction in a sparse feature scenario. Background technique [0002] Click-to-conversion rate, or CTR for short, usually refers to the ratio of users who click on a particular link to the total number of users who view a page, email, or ad. It is usually used to measure the success of a website's online advertising campaign, as well as the effectiveness of email campaigns, and is one of the core criteria for Internet companies to allocate traffic. It can be seen from this that the higher the click conversion rate, the more successful the advertising campaign, the more popular the product, or the better the product sales. [0003] Based on this background, CTR prediction has always been a hot field for machine learning applications, but it is also a hot problem. Because, in the field of e-commerce, the behavioral features of users a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06Q30/02G06N3/04G06N3/08
CPCG06Q30/0242G06N3/08G06N3/045
Inventor 杨昕梅余楚楚杨承高原李绍荣
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More