Method and system for acquiring and analyzing data on news client

Abstract

The invention provides a method and a system for acquiring and analyzing data on a news client. The method comprises the steps: creating a thread according to acquired number of news clients, acquiring a number of CPU cores, and binding each thread to the corresponding CPU core; acquiring program information of each news client, acquiring a preset attribute file of each program, downloading data of each program, generating an acquisition node, and transmitting the data of each acquisition node to an analysis unit after the data of each acquisition node is stored to a corresponding collection queue; analyzing the attribute information of each program, acquiring a text information corresponding to each news, forming an analysis node of each news data, and storing the analysis node of each news data to a preset analysis queue; storing the data in the preset analysis queue on the same CPU core to a corresponding preset output queue, transmitting the data in the preset output queue to a preset database, and monitoring the data of the news client on the basis of the data in a preset database. By adopting the method, the data processing efficiency can be improved.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a method and system for collecting and analyzing data on a news client. Background technique [0002] With the rapid development of mobile Internet technology, there are many kinds of mobile terminal news clients (for the convenience of description, this application may be referred to as news clients for short, such as Sohu News, Toutiao, Baidu News, etc.), which include mainstream media The news client also includes the aggregation news client. The influence of these news clients is expanding day by day and has played a positive role. Compared with watching news on the Internet, the speed of news dissemination on the news clients is more timely and the real-time performance is stronger. It becomes the source information for the development of the event as it spreads for a while. In addition, users who use the news client have a higher degree of participation, so the scope of diss...

AI Technical Summary

Problems solved by technology

[0003] At present, the news supervision department is still in the state of manual supervision of the information released by the news client. Not only is the work efficiency low, but it is also difficult to detect and control the negative information disseminated through the news client in time. In addition, for the data supervision of the news client On the one hand, no more effective scheme has been disclosed in related fields at home and abroad

[0004] In short, the data processing scheme for the news client in the prior art is not ideal enough

Images