Public opinion vertical search analysis system and method

A vertical search and analysis system technology, applied in the field of network public opinion search and analysis systems

Inactive Publication Date: 2012-07-25
TIANJIN UNIV
View PDF3 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the case of diverse and unstable information sources, the amount of maintenance is huge, so this method is suitable for information processing of relatively fixed limited information sources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Public opinion vertical search analysis system and method
  • Public opinion vertical search analysis system and method
  • Public opinion vertical search analysis system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0105] The present invention takes public opinion monitoring as the background, and mainly completes the following processes:

[0106] The first step is to call the vertical search engine crawler module, and use the crawler algorithm to selectively search and download Internet pages related to public opinion topics through the filtering technology based on network topology and web content keywords and the crawling strategy of breadth-first search;

[0107] In this step, the present invention adopts the design of multi-threaded download, and the crawling operation includes the following processing: the downloaded webpage is analyzed:

[0108] When a thread finishes downloading the page, it submits the downloaded page to the parsing buffer thread pool in the form of the link URL contained in the extracted web page, and adds it to the buffer queue to be downloaded, and the thread pool calls the parser to parse the web page and extract the URL , and add the parsed URL to the URL r...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to network information processing technology, and discloses a public opinion vertical search analysis system. The system for text-based network public opinion search analysis comprises a vertical search engine crawler module, a template-based information extraction module, a text orientation analysis module based on phrase extraction, a text orientation analysis module based on vocabulary statistical model. In comparison with the prior art, the accuracy of the information emotion orientation algorithm based on phrase model and the vocabulary statistical model is improved by about 5%, and the algorithm has remarkable improvement effect. Meanwhile, the execution efficiency of processing is improved by designing a multi-threading method, thereby realizing quicker and more accurate public opinion search analysis effect.

Description

technical field [0001] The invention relates to network information processing technology, in particular to a network public opinion search and analysis system and method. Background technique [0002] The main technologies involved in the present invention include: [0003] 1. Key technologies related to network public opinion monitoring [0004] (1) Internet public opinion collection and extraction technology: Internet public opinion is mainly formed and disseminated through channels such as news, forums / BBS, blogs, and instant messaging software. The carriers of these channels are mainly dynamic web pages, which carry loosely structured information. It is very difficult to effectively extract public opinion information. The method of automatically generating webpage information extraction Wrapper realizes the extraction and integration of dynamic webpage data to a certain extent, and has certain processing accuracy and extraction efficiency. [0005] (2) Internet publi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 饶国政贾彪冯志勇
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products