Big data method for Internet user behavior collection, analysis and detection

Abstract

The invention discloses a big data method for Internet user behavior collection, analysis and detection. The method comprises the steps of (1) data collection and preprocessing, (2) data analysis and mining and (3) utilization of the data analysis result. Internet user data is collected, wherein the Internet user data mainly refers to microblog, qq and WeChat data as well as main Internet commercial data; the microblog, qq and WeChat data comprises personal basic information and network statement data of users; the main Internet commercial data comprises relevant channels of electronic-commerce, industrial forums and web portals, mainly referring to commodities, commodity sales volumes, user evaluation, etc. A calculation cluster is self-established to perform collection, and nonpublic information such as age prediction is predicted and complemented according to public information. More precise and effective information collection and analysis can be realized, and therefore market trend, consumer public praise and other information can be better grasped quantitatively.

Description

technical field [0001] The invention belongs to the fields of computer, Internet, and information technology, and relates to information collection and analysis technology, especially a big data method for Internet user behavior collection, analysis and detection. Background technique [0002] With the advancement of technology and the Internet, e-commerce has become an important part of the Internet industry, and data has become an indispensable tool to change an enterprise. Especially with the advent of the era of big data, some once very difficult problems can be easily solved. Users' consumption habits, hobbies, relationship networks, and the trends and trends of the entire Internet will all become hot spots for Internet practitioners, and the acquisition and analysis of all these are inseparable from big data. On the one hand, big data mining and analysis based on social media will generate many applications; on the other hand, marketing consulting services based on da...

AI Technical Summary

Problems solved by technology

Few people use it for experiments in the current research (unless it is a base line), but it is indeed a good entry-level algorithm, but it is still too rough for age and other data calculations.

Images