City domain knowledge detection system and method based on LDA topic model

Abstract

The invention relates to a city domain knowledge detection system and method based on an LDA topic model. The city domain knowledge detection system and method are used for generating a domain knowledge report of a certain domain of a smart city. The system adopts a C / S architecture, adopts a modular system design, and comprises an authentication and management module, a file uploading module, a data cleaning module, an emotion analysis module, a word segmentation and part-of-speech tagging module, a keyword extraction module, a clustering module and a data transmission module. According to the invention, large-scale domain knowledge data generated in the city informatization process is fully utilized, the city domain knowledge report can be automatically generated for the user, and the invention is further applied to the fields such as traffic early warning and public opinion monitoring; the design is good, operation is stable, the system can be used without deploying the environment,and the has high practical application value. The modules are updatable and replaceable, and can be suitable for maintenance, improvement and expansion which may be required in the future. Accordingto the personalized requirements of different users, each module provides customizable parameters or files, so that the system not only meets the general requirements of common users, but also meets the customization requirements of professional users.

Description

technical field [0001] The invention relates to an LDA topic model-based urban domain knowledge detection system and method, in particular to an LDA topic model-based urban domain knowledge detection system and method, belonging to the cross-application field of big data and natural language processing. Background technique [0002] With the improvement of hardware computing power and the improvement of software algorithms, computers have been able to process massive amounts of data in a relatively short period of time. In the era of cloud computing, it has become possible to use big data to monitor and manage cities, and urban big data has become a hot topic. On this basis, the concept of "smart city" was proposed. Smart city is a high-level form of urban informatization that fully applies new information technology to various geographical locations, fields, and industries in the city. [0003] The exchange and sharing of information is the main activity of smart cities. ...

AI Technical Summary

Problems solved by technology

[0004] Due to the characteristics of large amount, wide sources and miscellaneous information in the domain knowledge data of smart cities, it is difficult to apply domain knowledge

If manual processing is used, it will not only be time-consuming and labor-intensive, but the accuracy cannot be guaranteed, and the latest data cannot be followed up in time

Images