Billion-level traffic advertisement real-time processing method, storage medium and electronic equipment, and system

Abstract

The invention discloses a billion-level traffic advertisement real-time processing method, a storage medium, electronic equipment and a system, and relates to the field of internet live broadcast, themethod comprises the following steps: S1, acquiring advertisement information which at least comprises an advertisement ID and an advertisement space ID; and S2, obtaining the type of the client, andstoring the advertisement information of the client of the same type in one or one group of Redis queues; S3, storing the advertisement information in the Redis queue in a Kafka information queue; S4, reading the advertisement information in the Kafka information queue, calculating mapping relationship data between the advertisement information by using a distributed real-time stream processingframework, and storing the mapping relationship data in a MySQL database.

Description

technical field [0001] The invention relates to the field of Internet live broadcasting, in particular to a method and system for real-time processing of billion-level traffic advertisements. Background technique [0002] Advertising is one of the main sources of income for some large Internet companies, and effective and reasonable management of it is an essential skill for an Internet company to develop and gain a foothold in the long run. However, in the era of big data, the network situation is complex, and the security environment is harsh. As an open platform, the live broadcast website is faced with high-traffic access from high-concurrency users all the time. Therefore, how to obtain effective real-time information on massive advertising exposure and click data in a complex network and harsh security environment is a challenge that every live streaming Internet company must face when advertising. [0003] The information management of traditional Internet companies ...

AI Technical Summary

Problems solved by technology

[0003] The information management of traditional Internet companies for advertising is usually to analyze offline advertising information. First, offline storage of the billions of advertising information generated every day will waste a lot of storage space. If the daily advertising exposure, click information bar There are 400 million pieces of information, and if the data size of each piece of information is 0.3kb, then within a day, the space for advertising information that needs to be stored offline is about 120GB, which increases the cost of advertising; secondly, offline advertising information cannot be combined It cannot reflect the effect of advertisement delivery in a timely manner, and the advertisements it places cannot timely control the effect of its delivery.

In addition, a large amount of offline advertising information requires employees to spend a lot of time for offline data processing, so using traditional offline data analysis will consume a lot of time and cost

Images