Big data distributed mining analysis service technology

Abstract

The invention discloses a big data distributed mining analysis service technology which comprises a collection terminal, a modeling unit, a database, a server, a display terminal and a power supply. The collection terminal comprises a data collection module and a data transmission module; the modeling unit comprises a data aggregation module, a data preprocessing module and a data classification module; the database comprises a first data storage module, a second data storage module and a Nth data storage module; and the server comprises a data mining module and a data analysis module. According to the invention, user behavior data is acquired, and for the user behavior data, a parallel operation model is adopted to carry out preprocessing and aggregation; and according to the aggregated user behavior data, a user behavior data body model is established and is stored in the database. According to the invention, strong processing capacity and large-scale data storage capacity of a cloudcomputing technology, a body and reasoning thereof and a knowledge discovery method are combined, so that effective and accurate user pushing is implemented.

Description

technical field [0001] The invention relates to the technical field of communication services, in particular to a big data distributed mining analysis service technology. Background technique [0002] With the advent of the information age, the accumulation of data has grown exponentially. In order to mine effective information from the existing massive data, various data analysis algorithms have emerged. Big data technology is an information processing technology that takes all the data resources of any system as the object and discovers the correlation between the data. In terms of service and improvement, it has become a powerful back-end support behind network services. Based on the analysis and utilization of all user behavior information based on big data leveling, it adapts to the characteristics of user behavior information's large scale, complex and diversified data formats, and high computing speed requirements, and can meet the actual needs of various types of n...

AI Technical Summary

Problems solved by technology

For the analysis of user behavior, a lot of research has been done at home and abroad, but there are some problems: first, most of them focus on mining WEB logs, but these logs are not enough to describe the situation when users visit the website in time; second, large websites generally have huge Online users generate a huge amount of real-time behavior and context information. Therefore, the storage capacity and computing speed of the system are stronger, so that the analysis results can be fed back to users in a timely manner.

At present, most user behavior analysis systems use relational database technology and traditional data processing methods, which cannot meet the needs of efficient analysis of massive data.

Images