Business travel public opinion analysis method based on scapy crawler architecture and text analysis

A technology of text analysis and public opinion analysis, applied in the field of public opinion analysis, can solve the problems of slow analysis speed and complex technology of business travel public opinion analysis, and achieve the effect of rapid analysis

Pending Publication Date: 2020-12-29
广州瀚信通信科技股份有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to propose a business travel public opinion analysis method based on scrapy crawler architecture and text analy

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Business travel public opinion analysis method based on scapy crawler architecture and text analysis
  • Business travel public opinion analysis method based on scapy crawler architecture and text analysis
  • Business travel public opinion analysis method based on scapy crawler architecture and text analysis

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0066] The present invention will be further described below with reference to the accompanying drawings and specific embodiments. It should be noted that, on the premise of no conflict, the embodiments or technical features described below can be combined arbitrarily to form new embodiments. .

[0067] Please refer to figure 1 and figure 2 , shows a business travel public opinion analysis method based on scrapy crawler architecture and text analysis of the present invention, the method comprises the following steps:

[0068] 100. Obtain Chinese text, process and segment it, and obtain text features;

[0069] In the embodiment of the present invention, the Chinese text is obtained through the scrapy crawler architecture, specifically: accepting the request sent by the engine through the scheduler, sorting and arranging it in a certain way, entering the queue, and returning it to the engine when the engine needs it; The downloader is responsible for downloading all requests...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a business travel public opinion analysis method based on a scapy crawler architecture and text analysis, and the method comprises the following steps: obtaining a Chinese text, and carrying out the processing and segmentation of the Chinese text, and obtaining text features; preprocessing the text features, and judging whether the text features are sent to a word bank ornot; obtaining text categories by the lexicon according to the text features; and performing public opinion analysis on the text. According to the method, Chinese texts are processed and segmented toobtain text features, the text features are processed, the text features are analyzed through a word bank to obtain text categories, and public opinion analysis is carried out on the texts; complex steps are omitted, public opinion analysis is conducted under the condition that certain accuracy is guaranteed, and rapid analysis is achieved.

Description

technical field [0001] The invention relates to the technical field of public opinion analysis, and more particularly, to a business travel public opinion analysis method based on scrapy crawler architecture and text analysis. Background technique [0002] Business travel public opinion analysis is an important aspect of understanding users. After watching videos or using products, users will express their feelings and opinions in various ways, such as the content of TV variety shows, actors' favorites, and opinions on ridges and products; Intuitively and clearly show users' concerns and subjective feelings. [0003] The content of business travel public opinion analysis includes text, pictures, audio and other forms, and the data sources mainly include web page data, client data, forum data and other network-wide data; comprehensive and in-depth analysis from various dimensions, combined with a large number of technical knowledge and Experience, through NLP technology, ca...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/903G06F16/951G06F16/958G06K9/62G06F40/279
CPCG06F16/90344G06F16/951G06F16/958G06F40/279G06F18/24155
Inventor 苏如春孙少峰练镜锋
Owner 广州瀚信通信科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products